pip install scrapy-mongodb==0.12.0

Pipeline to MongoDB for Scrapy. Supports MongoDB replica sets

Source
Among top 50% packages on PyPI.
Over 3.0K downloads in the last 90 days.

Commonly used with scrapy-mongodb

Based on how often these packages appear together in public requirements.txt files on GitHub.

Scrapy

A high-level Web Crawling and Web Scraping framework

queuelib

Collection of persistent (disk-based) queues

w3lib

Library of web-related functions

scraper

Configurable Python Web Scraper

scrapyd

A service for running Scrapy spiders, with an HTTP API

PyDispatcher

Multi-producer-multi-consumer signal dispatching mechanism

parsel

Parsel is a library to extract data from HTML and XML using XPath and CSS selectors

Scaffold

Simple project scaffolding for Python

scrapydo

Crochet-based blocking API for Scrapy.

characteristic

Python attributes without boilerplate.

scrapy-splash

JavaScript support for Scrapy using Splash

scrapyd-client

A client for scrapyd

scrapy-djangoitem

Scrapy extension to write scraped items using Django models

cssselect

cssselect parses CSS3 Selectors and translates them to XPath 1.0

Twisted

An asynchronous networking framework written in Python

crochet

Use Twisted anywhere!

constantly

Symbolic constants in Python

incremental

None

Automat

Self-service finite-state machines for the programmer on the go.

Version usage of scrapy-mongodb

Proportion of downloaded versions in the last 3 months (only versions over 1%).

0.12.0

57.96%

0.8.0

2.61%

0.10.0

2.48%

0.11.0

2.45%

0.9.1

2.11%

0.7.0

1.98%

0.7.2

1.98%

0.9.0

1.94%

0.7.3

1.94%

0.1.0

1.94%

0.3.0

1.91%

0.7.1

1.91%

0.6.3

1.91%

0.2.0

1.91%

0.6.1

1.91%

0.5.0

1.88%

0.6.2

1.88%

0.4.0

1.88%

0.8.1

1.88%

0.6.0

1.84%

0.6.3a1

1.84%

0.5.1

1.84%