Explore Projects
Discover 30 open source projects
Showing 1-20 of 30 projects
firecrawl/firecrawl
Convert websites into LLM-ready data with API for scraping, crawling, and structured data extraction
huginn/huginn
Automated agents for monitoring and acting on your behalf online
assafelovic/gpt-researcher
LLM agent for deep research with citations and customizable workflows
D4Vinci/Scrapling
Powerful, flexible Python library for effortless web scraping with AI-powered features.
ScrapeGraphAI/Scrapegraph-ai
AI-powered web scraping library for extracting data from websites and documents
getmaxun/maxun
Turn websites into clean data pipelines & structured APIs in minutes with a low-code web scraping tool.
pystardust/ani-cli
A CLI tool for browsing and playing anime from the command line.
lorien/awesome-web-scraping
A comprehensive list of libraries, tools, and APIs for web scraping and data processing.
alirezamika/autoscraper
A powerful, lightweight web scraping library for Python that can automate data extraction from websites.
daijro/camoufox
An anti-detect browser library built in C++ for web scraping and automation tasks.
niespodd/browser-fingerprinting
Analysis of bot protection systems and techniques to bypass browser fingerprinting for web scraping.
jaypyles/Scraperr
Scraperr is a self-hosted web scraper built with TypeScript, Docker, and Kubernetes for efficient, scalable data extraction.
ultrafunkamsterdam/nodriver
Blazing fast framework for web automation, webscraping, bots and other creative ideas hindered by anti bot systems
itsOwen/CyberScraper-2077
Powerful web scraper using LLM and AI
any4ai/AnyCrawl
AnyCrawl is a Node.js/TypeScript web scraper that extracts structured data from search engines and websites for use in AI/LLM applications.
Kaliiiiiiiiii-Vinyzu/patchright
An undetected version of the Playwright testing and automation library for web scraping and web automation.
scrapoxy/scrapoxy
Scrapoxy is a powerful proxy management tool that simplifies web scraping by handling IP rotation, fingerprinting, and traffic routing to avoid bans.
sarperavci/CloudflareBypassForScraping
A Python script that bypasses Cloudflare's verification to enable web scraping.
GodsScion/Auto_job_applier_linkedIn
Automate the LinkedIn job application process with this Python script that applies to jobs for you.
larymak/Python-project-Scripts
A collection of beginner-friendly Python scripts and projects for developers interested in web scraping, data processing, and more.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.