pip install scrapydo==0.2.2

Crochet-based blocking API for Scrapy.

Source
Among top 50% packages on PyPI.
Over 3.1K downloads in the last 90 days.

Commonly used with scrapydo

Based on how often these packages appear together in public requirements.txt files on GitHub.

Scrapy

A high-level Web Crawling and Web Scraping framework

scrapy-mongodb

Pipeline to MongoDB for Scrapy. Supports MongoDB replica sets

w3lib

Library of web-related functions

queuelib

Collection of persistent (disk-based) queues

echarts-countries-pypkg

pyecharts map extensions - world countries - python package

PyDispatcher

Multi-producer-multi-consumer signal dispatching mechanism

parsel

Parsel is a library to extract data from HTML and XML using XPath and CSS selectors

scraper

Configurable Python Web Scraper

Scaffold

Simple project scaffolding for Python

hyperlink

A featureful, immutable, and correct URL for Python.

html2markdown

Conservatively convert html to markdown

Twisted

An asynchronous networking framework written in Python

Automat

Self-service finite-state machines for the programmer on the go.

scrapyd-client

A client for scrapyd

constantly

Symbolic constants in Python

incremental

None

scrapyd

A service for running Scrapy spiders, with an HTTP API

crochet

Use Twisted anywhere!

characteristic

Python attributes without boilerplate.

Version usage of scrapydo

Proportion of downloaded versions in the last 3 months (only versions over 1%).

0.2.2

95.41%

0.2.1

2.31%

0.1.0

2.28%