Explore Projects

Discover 162 open source projects

Active filters (1):
Search: scrapersร—
Clear all

Showing 121-140 of 162 projects

OpnTec/parliament-scraper-artwork

A web scraper for extracting data from the UK Parliament website and generating artwork from the scraped data.

1.4K
Archived
Backend Frameworks
Web Scraping
Node.js
#web-scraping#data-extraction#artwork-generation

lorey/mlscraper

Effortlessly scrape data from websites using machine learning and HTML examples with this Python library.

1.4K
Archived
Python
Backend Frameworks
ETL & Pipelines
#web-scraping#data-extraction#machine-learning

Avnsx/fansly-downloader

Easy-to-use tool for downloading content from Fansly platform, with customization options and support for various media types.

1.4K
Archived
Python
General Utilities
Backend Frameworks
#fansly#downloader#scraper

isaackogan/TikTokLive

A Python library to receive real-time TikTok livestream events like comments and gifts.

1.4K
Stable
Python
API Clients & Testing
Backend Frameworks
#tiktok#live-streaming#api-wrapper

monperrus/crawler-user-agents

A Go library that provides a database of syntactic patterns of HTTP user-agents used by bots/crawlers/scrapers.

1.4K
Active
Go
CLI Tools
API Frameworks
#user-agent#crawler#bot

martinsbalodis/web-scraper-chrome-extension

A Chrome extension for web data extraction and web scraping tasks.

1.4K
Archived
JavaScript
Chrome Extensions
#web-scraping#data-extraction#chrome-extension

felipecsl/wombat

Lightweight Ruby web crawler/scraper with an elegant DSL to extract structured data from pages.

1.4K
Stable
Ruby
Backend Frameworks
API Frameworks
#crawler#scraper#dsl

kgspider/crawler

A JavaScript web scraper repository focused on reverse engineering and advanced crawling techniques.

1.3K
Experimental
JavaScript
Backend Frameworks
CLI Tools
Node.js
#crawler#web-scraper#reverse-engineering

adyzng/jd-autobuy

A Python web scraper for automatically logging in and purchasing items on JD.com.

1.3K
Archived
Python
Backend & APIs
API Frameworks
Python
#crawler#scraper#jingdong

huaying/instagram-crawler

A Python library for scraping Instagram posts, profiles, and hashtag data without using the Instagram API.

1.3K
Archived
Python
Backend Frameworks
API Clients & Testing
#instagram#scraper#web-scraping

erma0/douyin

A TypeScript-based web scraper for collecting public data from the Douyin (TikTok) platform.

1.3K
Active
TypeScript
Backend Frameworks
Caching
TypeScript
#web-scraper#douyin#tiktok

cinemagoer/cinemagoer

A Python package for retrieving and managing data from the IMDb movie database.

1.3K
Stable
Python
Backend Frameworks
Databases
Python
#movie-database#imdb#scraper

facundoolano/app-store-scraper

A JavaScript library for scraping data from the iTunes App Store, useful for developers building app discovery platforms.

1.3K
Experimental
JavaScript
API Clients & Testing
API Clients & Testing
Node.js
#app-store#data-scraping#api-client

techwithtim/Price-Tracking-Web-Scraper

An automated price tracker that uses Bright Data, Playwright, React, and Flask for web scraping.

1.3K
Archived
Python
API Frameworks
Backend Frameworks
React
#web-scraping#automation#price-tracking

Altimis/Scweet

Scweet is a powerful Python library for scraping tweets, followers, following, likes, and other Twitter data.

1.3K
Experimental
Python
API Clients & Testing
Backend Frameworks
#twitter#scraping#data-extraction

LiuRoy/zhihu_spider

This is a Python web scraper for the Zhihu question-and-answer platform, not related to vibe coders or AI tools.

1.3K
Archived
Python
Backend Frameworks
CLI Tools
#web-scraper#zhihu#python

0x676e67/rnet

An ergonomic Python HTTP client with TLS fingerprinting capabilities for web scraping and crawling.

1.2K
Active
Rust
API Clients & Testing
Backend Frameworks
Rust
#http#https#tls

mariostoev/finviz

An unofficial Python API for the financial analysis platform Finviz, providing access to data and charts.

1.2K
Active
Python
API Clients & Testing
Databases
#finviz#financial-analysis#web-scraping

monosans/proxy-scraper-checker

A Rust-based library to scrape and check the availability of HTTP, SOCKS4, and SOCKS5 proxies.

1.2K
Active
Rust
API Frameworks
CLI Tools
#proxy-scraper#proxy-checker#proxy-list

MiningCattiva/x-spider

A TypeScript-based Twitter web scraper (spider) for developer discovery and analysis.

1.2K
Archived
TypeScript
Backend Frameworks
CLI Tools
TypeScript
#web-scraper#twitter#data-extraction
1...689

Stay in the loop

Get weekly updates on trending AI coding tools and projects.