Explore Projects

Discover 16 open source projects

Active filters (1):
Search: web-scraperร—
Clear all

Showing 1-16 of 16 projects

firecrawl/firecrawl

Convert websites into LLM-ready data with API for scraping, crawling, and structured data extraction

88.5K
Active
TypeScript
Web Scraping AI
Agents & Orchestration
TypeScript
#ai-scraping#web-crawler#llm-data

D4Vinci/Scrapling

Powerful, flexible Python library for effortless web scraping with AI-powered features.

23.6K
Active
Python
Web Scraping
Backend Frameworks
Python
#web-scraping#automation#data-extraction

ScrapeGraphAI/Scrapegraph-ai

AI-powered web scraping library for extracting data from websites and documents

22.9K
Active
Python
Web Scraping AI
RAG & Vector
Python
#ai-scraping#llm#rag

getmaxun/maxun

Turn websites into clean data pipelines & structured APIs in minutes with a low-code web scraping tool.

15.2K
Active
TypeScript
API Clients & Testing
React
#web-scraping#automation#no-code

BruceDone/awesome-crawler

A comprehensive collection of web crawlers and scrapers in various programming languages.

7.1K
Archived
Backend Frameworks
CLI Tools
#web-crawler#web-scraper#scraper

jaypyles/Scraperr

Scraperr is a self-hosted web scraper built with TypeScript, Docker, and Kubernetes for efficient, scalable data extraction.

4.9K
Stable
TypeScript
API Frameworks
CLI Tools
TypeScript
#web-scraping#self-hosted#kubernetes

arpit-omprakash/100ProjectsOfCode

A collection of practical coding projects to build knowledge and skills as a developer.

3.6K
Archived
Coding Challenges
Tutorials & Courses
#programming-projects#learning-resources#coding-challenges

gosom/google-maps-scraper

A Go-based web scraper for extracting data from Google Maps, including business details, reviews, and location information.

3.3K
Active
Go
Backend Frameworks
Web Scraping
#google-maps#web-scraping#distributed-scraping

oxylabs/google-ai-mode-scraper

Scrape Google AI Mode responses without blocks on a large scale using Java.

3.0K
Stable
Java
React
#authentication#streaming#real-time

itsOwen/CyberScraper-2077

Powerful web scraper using LLM and AI

2.9K
Active
Python
AI-powered web scraping tools
OpenAI
#ai-scraping#llm-scraper#web-scraper

oxylabs/how-to-scrape-amazon-product-data

A Python-based web scraper for extracting Amazon product data like titles, ratings, prices, images, and descriptions.

2.6K
Stable
Backend Frameworks
API Clients & Testing
Python
#amazon#web-scraping#data-extraction

oxylabs/how-to-scrape-amazon-prices

Extracts best-selling items, search results, and deals from Amazon using Python and Oxylabs E-Commerce Scraper API.

1.4K
Stable
Python
React
#amazon-scraper#api#python-scraper

oxylabs/how-to-scrape-google-scholar

A Python library for extracting titles, authors, and citations from Google Scholar using web scraping.

1.4K
Stable
Python
Backend & APIs
CLI Tools
Python
#google-scholar#web-scraping#web-crawler

gildas-lormeau/single-file-cli

CLI tool for saving a complete web page as a single HTML file, useful for web archiving and scraping.

1.2K
Stable
JavaScript
CLI Tools
CLI Tools
Node.js
#web-scraping#web-archiving#cli

juancarlospaco/faster-than-requests

A high-performance Python library for making HTTP requests faster than the standard requests library.

1.1K
Active
Nim
Backend & APIs
CLI Tools
#high-performance#web-scraping#http-requests

tholian-network/stealth

Stealth is a secure, peer-to-peer, private, and automatable web browser/scraper/proxy for developers who value privacy.

1.1K
Archived
JavaScript
Privacy Tools
Backend Frameworks
Node.js
#anonymity#privacy-protection#web-browser

Stay in the loop

Get weekly updates on trending AI coding tools and projects.