Alexandria Library

A curated collection of awesome articles

Here are some ressources related to Scraping, Python, Automation. Hoping you will find learning material, alternative tools or just some interesting stuff.

Home > Programming, Web Development, Open-... > Python, Machine Learning, Web Devel... > Python, Automation, Scraping, Crypt... > Scraping, Python, Automation

Articles

Marginalia.nu API

See discussion (22 comments, 103 points) - Archive

Show HN: Twitter API Reverse Engineered

See discussion (36 comments, 183 points) - Archive

Experimental library for scraping websites using OpenAI's GPT API

See discussion (140 comments, 378 points) - Archive

Show HN: Terminal Based Wikipedia

See discussion (39 comments, 165 points) - Archive

Robot Framework: generic open source automation framework

See discussion (101 comments, 163 points) - Archive

See discussion (91 comments, 226 points) - Archive

Convert curl commands to code in several languages

See discussion (86 comments, 262 points) - Archive

Show HN: Terminal Based Wikipedia

See discussion (79 comments, 138 points) - Archive

Show HN: Pygooglenews – Python library for advanced Google News data mining

See discussion (11 comments, 165 points) - Archive

Show HN: Python package to collect normalized news from almost any website

See discussion (194 comments, 420 points) - Archive

The IA Client – The Swiss Army Knife of Internet Archive

See discussion (21 comments, 172 points) - Archive

Spidermon: Scrapinghub’s Now Open Sourced Spider Monitoring Library

See discussion (31 comments, 115 points) - Archive

Show HN: Instagram-scraper – Scrape instagram photos by tags, without API

See discussion (80 comments, 165 points) - Archive

Requests-HTML: HTML Parsing for Humans

See discussion (90 comments, 467 points) - Archive

Show HN: Sukhoi – A flexible and extensible Webcrawler in Python

See discussion (34 comments, 131 points) - Archive

Show HN: Python bindings to the Servo HTML5 parser, html5ever

See discussion (14 comments, 146 points) - Archive

Web Scraping: Bypassing “403 Forbidden,” captchas, and more

See discussion (225 comments, 564 points) - Archive

RoboBrowser: Your friendly neighborhood web scraper

See discussion (58 comments, 182 points) - Archive

Automated Testing for League of Legends

See discussion (74 comments, 246 points) - Archive

Parsley: a simple language for extracting structured data from web pages

See discussion (24 comments, 149 points) - Archive

Show HN: A Python Spider System with Web UI

See discussion (40 comments, 159 points) - Archive

Show HN: MechanicalSoup, Python library for automating interaction with websites

See discussion (27 comments, 180 points) - Archive

Portia, an open-source visual web scraper

See discussion (67 comments, 367 points) - Archive

Show HN: Easy to use Wikipedia API for Python

See discussion (35 comments, 218 points) - Archive

Upton: A Web Scraping Framework

See discussion (61 comments, 198 points) - Archive

OAuth for Python made easy

See discussion (38 comments, 106 points) - Archive

Scapy: a powerful interactive packet manipulation program

See discussion (13 comments, 108 points) - Archive

Python for Humans

See discussion (73 comments, 256 points) - Archive

Finally a unified Python solution for OAuth 1.0/a, 2.0 (oh and Ofly) consumers

See discussion (11 comments, 81 points) - Archive

Parsing HTML in Python with BeautifulSoup

See discussion (52 comments, 86 points) - Archive

From RSS to My Kindle

See discussion (53 comments, 169 points) - Archive

Show HN: Crawlee for Python – a web scraping and browser automation library

See discussion (57 comments, 254 points) - Archive

Web scraping with GPT-4o: powerful but expensive

See discussion (166 comments, 372 points) - Archive