pip install queuelib==1.6.2

Collection of persistent (disk-based) and non-persistent (memory-based) queues

Source
Among top 1% packages on PyPI.
Over 2.0M downloads in the last 90 days.

Commonly used with queuelib

Based on how often these packages appear together in public requirements.txt files on GitHub.

w3lib

Library of web-related functions

Scrapy

A high-level Web Crawling and Web Scraping framework

PyDispatcher

Multi-producer-multi-consumer signal dispatching mechanism

parsel

Parsel is a library to extract data from HTML and XML using XPath and CSS selectors

scraper

Configurable Python Web Scraper

Twisted

An asynchronous networking framework written in Python

scrapyd

A service for running Scrapy spiders, with an HTTP API

characteristic

Python attributes without boilerplate.

constantly

Symbolic constants in Python

incremental

None

Automat

Self-service finite-state machines for the programmer on the go.

scrapyd-client

A client for scrapyd

scrapy-djangoitem

Scrapy extension to write scraped items using Django models

hyperlink

A featureful, immutable, and correct URL for Python.

filepath

Object-oriented filesystem path representation.

cssselect

cssselect parses CSS3 Selectors and translates them to XPath 1.0

scrapy-mongodb

Pipeline to MongoDB for Scrapy. Supports MongoDB replica sets

Protego

Pure-Python robots.txt parser with support for modern conventions

extruct

Extract embedded metadata from HTML markup

Version usage of queuelib

Proportion of downloaded versions in the last 3 months (only versions over 1%).

1.6.2

70.29%

1.6.1

20.38%

1.5.0

8.39%