pip install urltools==0.4.0

Some functions to parse and normalize URLs.

Source
Among top 50% packages on PyPI.
Over 1.3K downloads in the last 90 days.

Commonly used with urltools

Based on how often these packages appear together in public requirements.txt files on GitHub.

cssselect

cssselect parses CSS3 Selectors and translates them to XPath 1.0

w3lib

Library of web-related functions

queuelib

Collection of persistent (disk-based) queues

Scrapy

A high-level Web Crawling and Web Scraping framework

scraper

Configurable Python Web Scraper

characteristic

Python attributes without boilerplate.

scrapyjs

JavaScript support for Scrapy using Splash

scrapyd

A service for running Scrapy spiders, with an HTTP API

PyDispatcher

Multi-producer-multi-consumer signal dispatching mechanism

scrapy-splash

JavaScript support for Scrapy using Splash

parsel

Parsel is a library to extract data from HTML and XML using XPath and CSS selectors

scrapy-djangoitem

Scrapy extension to write scraped items using Django models

plan

A Python package for writing and deploying cron jobs with a clear and beautiful syntax.

redgreen

(Yet another) nosetests daemon

extruct

Extract embedded metadata from HTML markup

subscope

A command line tool to download subtitles for your movies.

pathod

A pathological HTTP/S daemon for testing and stressing clients.

scrapyd-client

A client for scrapyd

scrapy-mongodb

Pipeline to MongoDB for Scrapy. Supports MongoDB replica sets

Version usage of urltools

Proportion of downloaded versions in the last 3 months (only versions over 1%).

0.4.0

99.02%