Explore Projects
Discover 101 open source projects
Showing 1-20 of 101 projects
NaiboWang/EasySpider
Visual code-free web crawler/spider with GUI for data collection and automation
gocolly/colly
Go Colly - Elegant Scraper and Crawler Framework for Golang
jhao104/proxy_pool
Python proxy pool for web scraping with Redis storage
wistbean/learn_python3_spider
Python爬虫教程从0到1，涵盖抓包、库使用、多线程、数据库等
Jack-Cherish/python-spider
实战网络爬虫教程和工具，涵盖多个平台的数据抓取
binux/pyspider
A powerful web crawler system in Python for building custom web scraping solutions.
Evil0ctal/Douyin_TikTok_Download_API
A high-performance async web scraping tool for extracting data from Douyin, TikTok, Bilibili and more.
Kr1s77/awesome-python-login-model
A Python script for simulating logins on various websites and scraping data with Selenium.
projectdiscovery/katana
A highly customizable web crawler and spider framework for developers to build advanced crawling solutions.
shengqiangzhang/examples-of-web-crawlers
A collection of Python web crawler examples for various websites, suitable for beginners.
s0md3v/Photon
Incredibly fast and powerful OSINT crawler designed for information gathering and intelligence analysis.
crawlab-team/crawlab
A distributed web crawler admin platform for managing spiders in any language or framework.
ssssssss-team/spider-flow
A no-code web crawler platform that allows developers to define crawling workflows visually without writing code.
Jack-Cherish/PythonPark
A comprehensive Python learning resource covering AI, machine learning, web scraping, and more.
guyueyingmu/avbook
An adult video management system with a web crawler, database, and magnet link library for Japanese adult videos.
ihmily/DouyinLiveRecorder
A live stream recording software supporting over 40 platforms like Douyin, TikTok, YouTube, and Twitch.
kangvcar/InfoSpider
INFO-SPIDER is an open-source web scraping toolkit that helps users retrieve data from various sources like email, e-commerce, and social platforms.
lorien/awesome-web-scraping
A comprehensive list of libraries, tools, and APIs for web scraping and data processing.
andeya/pholcus
Pholcus is a high-concurrency web crawler software written in Go for developers needing a powerful, distributed crawling solution.
luyishisi/Anti-Anti-Spider
Anti-Anti-Spider is a Python library that helps developers bypass anti-crawling measures on websites to collect data.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.