Explore Projects
Discover 162 open source projects
Showing 21-40 of 162 projects
guyueyingmu/avbook
An adult video management system with a web crawler, database, and magnet link library for Japanese adult videos.
FriendsOfPHP/Goutte
Goutte is a simple PHP web scraper library that allows developers to automate web interactions.
hardikvasa/google-images-download
A Python script to download hundreds of images from Google Images.
apify/crawlee-python
Crawlee is a powerful web scraping and browser automation library for Python to build reliable crawlers.
TeamWiseFlow/wiseflow
A Python-based platform that uses LLMs to track and extract websites, RSS feeds, and social media for developers.
BruceDone/awesome-crawler
A comprehensive collection of web crawlers and scrapers in various programming languages.
alirezamika/autoscraper
A powerful, lightweight web scraping library for Python that can automate data extraction from websites.
TonyChen56/WeChatRobot
A C++ library that provides hooks and APIs for building WeChat robots and scrapers.
go-rod/rod
A Go library for automating and scraping websites using the Chrome DevTools Protocol.
dilame/instagram-private-api
A TypeScript SDK for interacting with the Instagram private API, enabling web and mobile app development.
subzeroid/instagrapi
A fast and powerful Python library for interacting with the Instagram Private API, including features like automation and scraping.
MontFerret/ferret
Declarative web scraping library written in Go, providing a powerful DSL for extracting data from websites.
matthewmueller/x-ray
A versatile and powerful web scraping library for JavaScript, designed to help developers extract data from the web with ease.
yujiosaka/headless-chrome-crawler
A powerful, distributed web crawler powered by Headless Chrome for scraping websites at scale.
JustAnotherArchivist/snscrape
A Python library for scraping data from various social media platforms.
tiagozip/cap
A self-hosted CAPTCHA solution for modern web applications
drawrowfly/tiktok-scraper
TikTok Scraper in TypeScript for downloading video posts and collecting metadata
niespodd/browser-fingerprinting
Analysis of bot protection systems and techniques to bypass browser fingerprinting for web scraping.
jaypyles/Scraperr
Scraperr is a self-hosted web scraper built with TypeScript, Docker, and Kubernetes for efficient, scalable data extraction.
Yuukiy/JavSP
A Python-based scraper that aggregates metadata from multiple sites for Japanese adult videos (JAV).
Stay in the loop
Get weekly updates on trending AI coding tools and projects.