Explore Projects

Discover 255 open source projects

Active filters (1):
Search: scraping×
Clear all

Showing 181-200 of 255 projects

OpnTec/parliament-scraper-artwork

A web scraper for extracting data from the UK Parliament website and generating artwork from the scraped data.

1.4K
Archived
Backend Frameworks
Web Scraping
Node.js
#web-scraping#data-extraction#artwork-generation

lorey/mlscraper

Effortlessly scrape data from websites using machine learning and HTML examples with this Python library.

1.4K
Archived
Python
Backend Frameworks
ETL & Pipelines
#web-scraping#data-extraction#machine-learning

scrapy-plugins/scrapy-playwright

Scrapy-Playwright is a Python library that integrates the Playwright browser automation tool with the Scrapy web scraping framework.

1.4K
Active
Python
Backend Frameworks
CLI Tools
Python
#chrome-headless#firefox-headless#headless-browser

mtvpls/MoonTVPlus

Enhanced video aggregator player with external player support, upscaling, danmaku, and comment scraping.

1.4K
Active
TypeScript
Component Libraries (Vue/Svelte)
General Utilities
TypeScript
#video-player#media-streaming#danmaku

dinubs/jam-api

A library for parsing web pages using CSS query selectors, useful for web scraping and data extraction.

1.4K
Archived
HTML
API Clients & Testing
Frontend Frameworks
Node
#web-scraping#data-extraction#html-parsing

PKUJohnson/OpenData

An open-source financial data extraction tool that allows easy API access to web scrape data from various websites.

1.4K
Archived
Python
ETL & Pipelines
CLI Tools
Python
#web-scraping#data-extraction#financial-data

martinsbalodis/web-scraper-chrome-extension

A Chrome extension for web data extraction and web scraping tasks.

1.4K
Archived
JavaScript
Chrome Extensions
#web-scraping#data-extraction#chrome-extension

scrapy/quotesbot

This is a sample Scrapy project for educational purposes, focused on web scraping and data extraction.

1.4K
Archived
Python
Backend Frameworks
Data Extraction & Pipelines
Python
#web-scraping#data-extraction#educational

xisuo67/XHS-Spider

A web scraping and data collection tool for the Chinese social media platform Xiaohongshu (Little Red Book).

1.4K
Stable
Backend Frameworks
API Frameworks
C#
#crawler#downloader#scraper

VideoData/DY-Data

This is a comprehensive set of tools for scraping and interacting with the Douyin (TikTok) platform, including video search, API access, comment collection, and more.

1.3K
Archived
JavaScript
API Frameworks
Backend Frameworks
Node.js
#douyin#tiktok#scraping

enetx/surf

Advanced Go HTTP client with browser impersonation, HTTP/3 support, and anti-bot bypass for web automation and scraping.

1.3K
Active
Go
Backend Frameworks
API Clients & Testing
#http-client#automation#scraping

philippta/flyscrape

Flyscrape is a command-line web scraping tool designed for developers without advanced programming skills.

1.3K
Stable
Go
CLI Tools
Backend Frameworks
#web-scraping#command-line#go

alongubkin/spider

A now-inactive JavaScript library for creating simple, unsurprising web crawling and scraping tools.

1.3K
Archived
JavaScript
Backend Frameworks
CLI Tools
Node
#web-crawling#scraping#automation

scrapy/parsel

Parsel is a Python library for extracting data from XML/HTML documents using XPath or CSS selectors.

1.3K
Active
Python
Backend Frameworks
CLI Tools
#scraping#css#xpath

ShilongLee/Crawler

An open-source API server for scraping data from popular platforms like TikTok, Kuaishou, and Weibo.

1.3K
Experimental
JavaScript
API Clients & Testing
Backend Frameworks
Node
#web-scraping#data-extraction#platform-apis

huaying/instagram-crawler

A Python library for scraping Instagram posts, profiles, and hashtag data without using the Instagram API.

1.3K
Archived
Python
Backend Frameworks
API Clients & Testing
#instagram#scraper#web-scraping

okfn-brasil/querido-diario

An open-source project that provides access to Brazilian government gazettes, enabling civic tech and data science applications.

1.3K
Stable
Python
Backend Frameworks
Databases
Python
#open-data#scraping#govtech

facundoolano/app-store-scraper

A JavaScript library for scraping data from the iTunes App Store, useful for developers building app discovery platforms.

1.3K
Experimental
JavaScript
API Clients & Testing
API Clients & Testing
Node.js
#app-store#data-scraping#api-client

sunra/php-simple-html-dom-parser

A PHP library for parsing HTML documents and extracting data, useful for web scraping and automation.

1.3K
Archived
HTML
Backend Frameworks
General Utilities
PHP
#html-parsing#web-scraping#data-extraction

techwithtim/Price-Tracking-Web-Scraper

An automated price tracker that uses Bright Data, Playwright, React, and Flask for web scraping.

1.3K
Archived
Python
API Frameworks
Backend Frameworks
React
#web-scraping#automation#price-tracking
1...911...13

Stay in the loop

Get weekly updates on trending AI coding tools and projects.