Explore Projects

Discover 255 open source projects

Active filters (1):
Search: scrape×
Clear all

Showing 61-80 of 255 projects

jaypyles/Scraperr

Scraperr is a self-hosted web scraper built with TypeScript, Docker, and Kubernetes for efficient, scalable data extraction.

4.9K
Stable
TypeScript
API Frameworks
CLI Tools
TypeScript
#web-scraping#self-hosted#kubernetes

MechanicalSoup/MechanicalSoup

MechanicalSoup is a Python library for automating interaction with websites, useful for web scraping and automation tasks.

4.8K
Active
Python
Backend Frameworks
API Clients & Testing
#web-scraping#automation#requests

fb55/htmlparser2

A fast and forgiving HTML and XML parser for use in web scraping and other web development tasks.

4.8K
Active
TypeScript
Frontend Frameworks
API Frameworks
React
#html-parser#xml-parser#web-scraping

REMitchell/python-scraping

Web scraping with Python code samples from the book

4.7K
Archived
Jupyter Notebook
React
#web-scraping#python#book-samples

bjesus/pipet

A versatile tool for web scraping and data extraction, designed for hackers and power users.

4.7K
Archived
Go
CLI Tools
Backend Frameworks
#web-scraping#data-extraction#cli-tool

sparklemotion/mechanize

Mechanize is a Ruby library that makes automated web interaction and scraping easy.

4.4K
Active
Ruby
Backend Frameworks
API Clients & Testing
Ruby
#web-scraping#automation#http-client

dataabc/weibo-crawler

A Python-based web crawler that can scrape data, images, and videos from Weibo, a popular social media platform in China.

4.4K
Active
Python
Backend Frameworks
Data Crawling & Scraping
Python
#weibo#crawler#scraper

d60/twikit

A powerful Python library for scraping Twitter data without an API key, providing developers with free access to the Twitter internal API.

4.1K
Experimental
Python
API Clients & Testing
Backend Frameworks
Python
#twitter#scraper#web-scraping

omkarcloud/botasaurus

Powerful scraping framework to build undetectable web scrapers using Python

4.1K
Active
Python
Backend Frameworks
CLI Tools
#web-scraping#anti-detection#undetectable

bisguzar/twitter-scraper

Scrape Twitter Frontend API without authentication using Python.

4.0K
Archived
Python
React
#Twitter API#No Authentication#Scraping

joeyism/linkedin_scraper

A Python library for scraping LinkedIn profile data, useful for developer discovery and recruitment.

3.8K
Active
Python
Backend & APIs
Databases
#linkedin#scraper#web-scraping

JavScraper/Emby.Plugins.JavScraper

A plugin for Emby/Jellyfin media servers that can scrape information from Japanese adult video websites.

3.7K
Archived
C#
API Frameworks
Backend Frameworks
#emby#jellyfin#jav

snooppr/snoop

A powerful OSINT tool for gathering open-source intelligence and performing online investigations.

3.7K
Active
Python
Security Research
CLI Tools
Python
#osint#security-research#open-source-intelligence

mobile-next/mobile-mcp

A TypeScript-based MCP server for automating mobile app testing on iOS, Android, emulators, and real devices.

3.7K
Active
TypeScript
MCP Servers
Android
Next.js
#mobile-automation#mobile-testing#real-devices

Boris-code/feapder

A powerful Python-based web scraping framework with features like browser rendering and data deduplication.

3.6K
Stable
Python
Backend Frameworks
CLI Tools
Python
#crawler#scraper#web-scraping

elliotgao2/toapi

A Python library that makes it easy to create APIs for any website, simplifying web scraping and API development.

3.6K
Archived
Python
API Clients & Testing
Backend Frameworks
#web-scraping#api-development#web-crawling

Gerapy/Gerapy

A distributed crawler management framework based on Scrapy, Scrapyd, Django, and Vue.js for web scraping.

3.5K
Archived
Python
API Frameworks
Backend Frameworks
Django
#scrapy#scrapyd#django

owner888/phpspider

A powerful PHP-based web scraping tool for extracting data at scale, suitable for vibe coders working with AI tools.

3.5K
Archived
PHP
Backend Frameworks
API Frameworks
#web-scraping#data-extraction#php

jstrieb/github-stats

A Python library that provides better GitHub statistics images for your profile, including private repos.

3.4K
Active
Python
CLI Tools
Documentation
Python
#github#stats#visualization

gosom/google-maps-scraper

A Go-based web scraper for extracting data from Google Maps, including business details, reviews, and location information.

3.3K
Active
Go
Backend Frameworks
Web Scraping
#google-maps#web-scraping#distributed-scraping
1...35...13

Stay in the loop

Get weekly updates on trending AI coding tools and projects.