pip install Protego==0.1.16
Pure-Python robots.txt parser with support for modern conventions
SourceAmong top 1% packages on PyPI.
Over 1.4M downloads in the last 90 days.
Protego
Based on how often these packages appear together in public
requirements.txt
files on GitHub.
A featureful, immutable, and correct URL for Python. |
|
Self-service finite-state machines for the programmer on the go. |
|
Symbolic constants in Python |
|
None |
|
Parsel is a library to extract data from HTML and XML using XPath and CSS selectors |
|
Common interface for data container classes |
|
Multi-producer-multi-consumer signal dispatching mechanism |
|
An asynchronous networking framework written in Python |
|
Base library for scrapy's ItemLoader |
|
Configurable Python Web Scraper |
|
Library of web-related functions |
|
Collection of persistent (disk-based) queues |
|
A high-level Web Crawling and Web Scraping framework |
|
Hamcrest framework for matcher objects |
|
Conservatively convert html to markdown |
|
A client for scrapyd |
|
Object-oriented filesystem path representation. |
|
Classes Without Boilerplate |
|
AutobahnTestSuite - WebSocket/WAMP protocol implementation test suite. |
Protego
Proportion of downloaded versions in the last 3 months (only versions over 1%).
0.1.16 |
99.69% |