pip install scrapy-dotpersistence==0.3.0
Scrapy extension to sync `.scrapy` folder to an S3 bucket
SourceAmong top 50% packages on PyPI.
Over 2.7K downloads in the last 90 days.
scrapy-dotpersistence
Based on how often these packages appear together in public
requirements.txt
files on GitHub.
Scrapy spider middleware to split an item into multiple items on a multi-valued key |
|
Scrapy spider middleware to clean up query parameters in request URLs |
|
Scrapy extension to store info in storage service |
|
Official Python client for the MonkeyLearn API |
|
Scrapy entrypoint for Scrapinghub job runner |
|
Scrapy extension to sync `.scrapy` folder to an S3 bucket |
|
Crawlera middleware for Scrapy |
|
Scrapy middleware to ignore previously crawled pages |
|
Scrapy helper functions and processors |
|
Client interface for Scrapinghub API |
|
The AWS X-Ray SDK for Python (the SDK) enables Python developers to record and emit information from within their applications to the AWS X-Ray service. |
|
An Amazon S3 Transfer Manager |
|
Low-level, data-driven core of boto 3. |
|
JSON Matching Expressions |
|
Upstart-based service management. |
|
Tool to automate running commands in docker. |
|
The AWS SDK for Python |
|
Base environment for Troposphere based CFN project environments |
|
Python CloudWatch Logging |
scrapy-dotpersistence
Proportion of downloaded versions in the last 3 months (only versions over 1%).
0.3.0 |
86.58% |
0.2.3 |
6.31% |
0.2.0 |
4.47% |
0.2.2 |
2.63% |