🕷️Web Scraping AI

AI-enhanced web scraping and data extraction tools

Showing 1-8 of 8 projects

firecrawl/firecrawl

Convert websites into LLM-ready data with API for scraping, crawling, and structured data extraction

88.5K
Active
TypeScript
Web Scraping AI
Agents & Orchestration
TypeScript
#ai-scraping#web-crawler#llm-data

unclecode/crawl4ai

LLM-friendly web crawler & scraper for RAG, agents, and data pipelines

61.4K
Active
Python
RAG & Vector
CLI Tools
Python
#web-crawler#llm-ready#markdown

NanmiCoder/MediaCrawler

Multi-platform social media crawler for content and comment scraping

44.9K
Active
Python
Testing
Web Scraping AI
Python
#web-scraping#social-media#data-mining

gocolly/colly

Go Colly - Elegant Scraper and Crawler Framework for Golang

25.1K
Active
Go
CLI Tools
Backend Frameworks
Go
#golang#scraper#crawler

ScrapeGraphAI/Scrapegraph-ai

AI-powered web scraping library for extracting data from websites and documents

22.9K
Active
Python
Web Scraping AI
RAG & Vector
Python
#ai-scraping#llm#rag

BuilderIO/gpt-crawler

Crawl websites to create custom GPTs from URLs

22.2K
Experimental
TypeScript
RAG & Vector
Web Scraping AI
TypeScript
#gpt#crawler#ai

Jack-Cherish/python-spider

实战网络爬虫教程和工具,涵盖多个平台的数据抓取

19.5K
Archived
Python
Testing
Web Scraping AI
#python#web-scraping#crawler

white0dew/XiaohongshuSkills

Python automation for Xiaohongshu (Little Red Book) - auto-publish, comment, search with multi-engine support

1.5K
Active
Python
Web Scraping AI
No-Code AI Platforms
OpenClaw
#xiaohongshu-automation#python-crawler#auto-publishing

Stay in the loop

Get weekly updates on trending AI coding tools and projects.