pip install reppy==0.4.14

Replacement robots.txt Parser

Source
Among top 3% packages on PyPI.
Over 41.8K downloads in the last 90 days.

Commonly used with reppy

Based on how often these packages appear together in public requirements.txt files on GitHub.

readability-lxml

fast html to text parser (article readability tool) with python 3 support

lxml

Powerful and Pythonic XML processing library combining libxml2/libxslt with the ElementTree API.

url

URL parsing, sanitization, and other handy features.

pyquery

A jquery-like library for python

fake-useragent

Up to date simple useragent faker with real world database

take

A DSL for extracting data from a web page.

langdetect

Language detection library ported from Google's language-detection.

shodan

Python library and command-line utility for Shodan (https://developer.shodan.io)

tldextract

Accurately separate the TLD from the registered domain and subdomains of a URL, using the Public Suffix List. By default, this includes the public ICANN TLDs and their exceptions. You can optionally support the Public Suffix List's private domains as well.

stix-validator

APIs and scripts for validating STIX and CybOX documents.

PyStemmer

Snowball stemming algorithms, for information retrieval

functionally

Simple & extensive functional programming library

pointfree

Pointfree style toolkit for Python

docx-mailmerge

Performs a Mail Merge on docx (Microsoft Office Word) files

certauth

Simple Certificate Authority for MITM proxies

HTMLParser

Backport of HTMLParser from python 2.7

urlhelp

Grab bag of helpers for working with urls

surt

Sort-friendly URI Reordering Transform (SURT) python package.

FBRank

A commandline tool helps you visualize league rank and other imformation

Version usage of reppy

Proportion of downloaded versions in the last 3 months (only versions over 1%).

0.3.4

67.92%

0.4.14

16.55%

0.4.12

4.10%

0.3.0

4.09%