Lists of packages, services and manuals related to web scraping.
- Python - Python packages
- PHP - PHP packages
- Ruby - Ruby packages
- JavaScript - JavaScript packages
- Go - Go packages
- Command Line Tools - tools with a command line interface
- Web Scraping Manuals - list of articles and books teaching web scraping
- dhamaniasad / HeadlessBrowsers - list of (almost) all headless web browsers in existence
- DNS over HTTPS providers - list of DNS over HTTPs providers
- Awesome Pastebins - list of pastebin sites
- @grablab - talks in English
- @grablab_ru - talks in Russian
Create a new issue. In the issue, provide a link to the project. Either provide a SHORT BRIEF (up to 200 characters) PLAIN TEXT description or do not provide description at all. Do not use emojis and item lists in the description.
Restricted content:
- DO NOT ADD a project if its age is less than half a year
- DO NOT ADD a project if it is about AI agent automation
- DO NOT ADD a project if it is only a wrapper/proxy for remote service (captcha and proxy services are exception from this rule).
The list is based initially on some data from these sources awesome-python, awesome-php, awesome-ruby, ruby-nlp, awesome-javascript