pip install scrapy-pagestorage==0.3.1
Scrapy extension to store info in storage service
SourceAmong top 50% packages on PyPI.
Over 2.3K downloads in the last 90 days.
scrapy-pagestorage
Based on how often these packages appear together in public
requirements.txt
files on GitHub.
|
Scrapy spider middleware to clean up query parameters in request URLs |
|
|
Scrapy extension to store info in storage service |
|
|
Scrapy extension to sync `.scrapy` folder to an S3 bucket |
|
|
Scrapy entrypoint for Scrapinghub job runner |
|
|
Crawlera middleware for Scrapy |
|
|
Scrapy middleware to add extra "magic" fields to items |
|
|
Official Python client for the MonkeyLearn API |
|
|
Scrapy middleware to ignore previously crawled pages |
|
|
Scrapy helper functions and processors |
|
|
Client interface for Scrapinghub API |
|
|
The AWS X-Ray SDK for Python (the SDK) enables Python developers to record and emit information from within their applications to the AWS X-Ray service. |
|
|
An Amazon S3 Transfer Manager |
|
|
Low-level, data-driven core of boto 3. |
|
|
JSON Matching Expressions |
|
|
Upstart-based service management. |
|
|
Tool to automate running commands in docker. |
|
|
The AWS SDK for Python |
|
|
Base environment for Troposphere based CFN project environments |
|
|
Python CloudWatch Logging |
scrapy-pagestorageProportion of downloaded versions in the last 3 months (only versions over 1%).
|
0.3.1 |
58.18% |
|
0.3.0 |
19.05% |
|
0.2.2 |
7.23% |
|
0.2.1 |
5.89% |
|
0.1.0 |
4.89% |
|
0.2.0 |
4.76% |