pip install scrapy-crawlera==1.7.2
Crawlera middleware for Scrapy
SourceAmong top 1% packages on PyPI.
Over 265.8K downloads in the last 90 days.
scrapy-crawlera
Based on how often these packages appear together in public
requirements.txt
files on GitHub.
Scrapy entrypoint for Scrapinghub job runner |
|
Scrapy extension to sync `.scrapy` folder to an S3 bucket |
|
Scrapy extension to store info in storage service |
|
Official Python client for the MonkeyLearn API |
|
Scrapy spider middleware to split an item into multiple items on a multi-valued key |
|
Scrapy spider middleware to clean up query parameters in request URLs |
|
Scrapy middleware to add extra "magic" fields to items |
|
Scrapy middleware to ignore previously crawled pages |
|
Scrapy helper functions and processors |
|
Client interface for Scrapinghub API |
|
The AWS X-Ray SDK for Python (the SDK) enables Python developers to record and emit information from within their applications to the AWS X-Ray service. |
|
An Amazon S3 Transfer Manager |
|
Low-level, data-driven core of boto 3. |
|
JSON Matching Expressions |
|
Upstart-based service management. |
|
Tool to automate running commands in docker. |
|
The AWS SDK for Python |
|
Base environment for Troposphere based CFN project environments |
|
Python CloudWatch Logging |
scrapy-crawlera
Proportion of downloaded versions in the last 3 months (only versions over 1%).
1.6.0 |
84.49% |
1.7.2 |
7.26% |
1.5.0 |
3.82% |
1.7.0 |
2.34% |
1.7.1 |
1.07% |