pip install scrapyd==1.2.1
A service for running Scrapy spiders, with an HTTP API
SourceAmong top 5% packages on PyPI.
Over 33.9K downloads in the last 90 days.
scrapyd
Based on how often these packages appear together in public
requirements.txt
files on GitHub.
|
A client for scrapyd |
|
|
Collection of persistent (disk-based) queues |
|
|
A high-level Web Crawling and Web Scraping framework |
|
|
Library of web-related functions |
|
|
Parsel is a library to extract data from HTML and XML using XPath and CSS selectors |
|
|
Multi-producer-multi-consumer signal dispatching mechanism |
|
|
Configurable Python Web Scraper |
|
|
Scrapy extension to write scraped items using Django models |
|
|
Python attributes without boilerplate. |
|
|
An asynchronous networking framework written in Python |
|
|
Symbolic constants in Python |
|
|
None |
|
|
Self-service finite-state machines for the programmer on the go. |
|
|
A featureful, immutable, and correct URL for Python. |
|
|
JavaScript support for Scrapy using Splash |
|
|
JavaScript support for Scrapy using Splash |
|
|
Pipeline to MongoDB for Scrapy. Supports MongoDB replica sets |
|
|
cssselect parses CSS3 Selectors and translates them to XPath 1.0 |
|
|
Extract embedded metadata from HTML markup |
scrapydProportion of downloaded versions in the last 3 months (only versions over 1%).
|
1.2.1 |
88.88% |
|
1.2.0 |
5.22% |
|
1.1.0 |
3.62% |
|
1.1.1 |
1.07% |