Explore Projects
Discover 53 open source projects
Showing 1-20 of 53 projects
firecrawl/firecrawl
Convert websites into LLM-ready data with API for scraping, crawling, and structured data extraction
scrapy/scrapy
Scrapy is a fast, high-level web crawling and scraping framework for Python developers.
Mintplex-Labs/anything-llm
All-in-one AI app for local and remote LLM usage with RAG, agents, and MCP compatibility
dgtlmoon/changedetection.io
Website change detection and monitoring tool with notifications
D4Vinci/Scrapling
Powerful, flexible Python library for effortless web scraping with AI-powered features.
ScrapeGraphAI/Scrapegraph-ai
AI-powered web scraping library for extracting data from websites and documents
apify/crawlee
Web scraping and browser automation library for Node.js
Evil0ctal/Douyin_TikTok_Download_API
A high-performance async web scraping tool for extracting data from Douyin, TikTok, Bilibili and more.
getmaxun/maxun
Turn websites into clean data pipelines & structured APIs in minutes with a low-code web scraping tool.
seleniumbase/SeleniumBase
Python APIs for web automation, testing, and bypassing bot-detection with ease.
yusufkaraaslan/Skill_Seekers
Automatically convert documentation, GitHub repos, and PDFs into Claude AI skills with conflict detection.
mherrmann/helium
Helium is a lightweight Python library for web automation and scraping, built on top of Selenium.
apify/crawlee-python
Crawlee is a powerful web scraping and browser automation library for Python to build reliable crawlers.
lorien/awesome-web-scraping
A comprehensive list of libraries, tools, and APIs for web scraping and data processing.
alirezamika/autoscraper
A powerful, lightweight web scraping library for Python that can automate data extraction from websites.
go-rod/rod
A Go library for automating and scraping websites using the Chrome DevTools Protocol.
autoscrape-labs/pydoll
Pydoll is a Python library for automating chromium-based browsers without a WebDriver, offering realistic interactions.
firecrawl/firecrawl-mcp-server
Firecrawl MCP Server adds powerful web scraping and search capabilities to AI language models like Cursor and Claude.
adbar/trafilatura
Gathers text and metadata from the web using crawling, scraping, and extraction techniques.
lexiforest/curl_cffi
A Python library that can impersonate browser fingerprints for web scraping and HTTP requests.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.