Explore Projects
Discover 255 open source projects
Showing 201-220 of 255 projects
kkangert/kspider
Kspider is a graphical web scraping and automation platform that allows developers to create scraping flows without coding.
Altimis/Scweet
Scweet is a powerful Python library for scraping tweets, followers, following, likes, and other Twitter data.
raznem/parsera
Lightweight Python library for scraping websites using large language models (LLMs) and the Playwright browser automation tool.
tinyfish-io/agentql
AgentQL is a suite of tools for connecting your AI to the web, featuring a query language and Playwright integrations for web automation and data extraction.
rebrowser/rebrowser-patches
Collection of patches to avoid automation detection and captchas for web scraping and crawling tools.
submato/xhscrawl
A web scraping tool for collecting data from Xiaohongshu, Bilibili, and other Chinese social platforms.
ityard/python-fxxk-spider
A Python crawler project for scraping free resources.
0x676e67/rnet
An ergonomic Python HTTP client with TLS fingerprinting capabilities for web scraping and crawling.
c4tcom/Katana
A Python tool that enables advanced Google searches and web scraping using Google Dorks.
bookstairs/bookhunter
A Go-based download tool for scraping ebooks from the internet.
syrusakbary/gdom
A Python library for DOM traversal and scraping using GraphQL queries.
stanfordjournalism/search-script-scrape
A collection of 101 real-world web scraping exercises in Python 3 for data journalists.
firecrawl/open-scouts
An open-source, AI-powered web monitoring platform that helps developers automate web searches and email alerts.
cameron/squirt
A fast, extensible library for scraping and parsing web content, enabling speed reading experiences.
istresearch/scrapy-cluster
A distributed, on-demand web scraping solution using Scrapy, Redis, and Kafka for high-performance crawling.
lit26/finvizfinance
A Python library for financial analysis and data scraping from the Finviz platform.
monosans/proxy-scraper-checker
A Rust-based library to scrape and check the availability of HTTP, SOCKS4, and SOCKS5 proxies.
zhentaoo/puppeteer-deep
A powerful Puppeteer-based library for web scraping, automation, and performance analysis, focused on developers building with AI tools.
Minerchu/dongguaTV
An open-source media server platform that leverages AI and web scraping to provide a personalized Netflix-like streaming experience.
mintapi/mintapi
An unofficial screen-scraping API for Mint.com, a popular personal finance management platform.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.