Explore Projects

Discover 255 open source projects

Active filters (1):
Search: scrapingร—
Clear all

Showing 101-120 of 255 projects

oxylabs/free-proxy-list

Provides a free proxy list with US IP addresses for web scraping and other projects.

2.6K
Stable
Backend & APIs
CLI Tools
#free-proxies#web-scraping#privacy

oxylabs/how-to-scrape-amazon-product-data

A Python-based web scraper for extracting Amazon product data like titles, ratings, prices, images, and descriptions.

2.6K
Stable
Backend Frameworks
API Clients & Testing
Python
#amazon#web-scraping#data-extraction

Virtual-Browser/VirtualBrowser

A free, anti-fingerprint browser that provides privacy-focused features for web scraping and web3 airdrops.

2.6K
Stable
Vue
Frontend Frameworks
Privacy Tools
Vue
#anti-detection#fingerprint-browser#privacy-tools

oxylabs/oxylabs-ai-studio-py

AI-powered web scraping and data gathering SDK for building intelligent agents and LLM apps

2.5K
Stable
Python
LLM Frameworks
AI SDKs & Wrappers
Python
#ai-crawler#ai-scraper#web-scraping

transitive-bullshit/awesome-puppeteer

A curated list of awesome resources for the Puppeteer headless Chrome/Chromium automation library.

2.5K
Archived
CLI Tools
Backend Frameworks
#automation#headless-chrome#scraping

oxylabs/google-news-scraper

A Python library for scraping the latest global news from Google News using their API.

2.5K
Stable
Python
API Clients & Testing
Backend Frameworks
Python
#google-news-api#news-scraper#api-client

obheda12/GitDorker

A Python tool to scrape GitHub for sensitive information using a large repository of dorks.

2.5K
Archived
Python
API Clients & Testing
CLI Tools
Python
#github#security#scraping

Kaliiiiiiiiii-Vinyzu/patchright

An undetected version of the Playwright testing and automation library for web scraping and web automation.

2.5K
Active
JavaScript
Backend Frameworks
API Frameworks
Node
#automation#web-scraping#web-automation

omkarcloud/google-maps-scraper

A Google Maps scraper that extracts data like names, addresses, phone numbers, reviews, websites, and ratings.

2.5K
Active
Data & Databases
API Clients & Testing
#google-maps#scraping#lead-generation

taspinar/twitterscraper

A Python library for scraping tweets from Twitter, useful for data analysis and social media monitoring.

2.5K
Archived
Python
Backend & APIs
ETL & Pipelines
#twitter#data-scraping#social-media

lorien/grab

A powerful web scraping framework for Python that supports asynchronous crawling and flexible data extraction.

2.5K
Stable
Python
Backend Frameworks
CLI Tools
Python
#web-scraping#crawling#asynchronous

codingforentrepreneurs/30-Days-of-Python

Learn Python in 30 days for entrepreneurs

2.4K
Archived
HTML
Python Programming
#Python#Coding#Entrepreneurship

scrapoxy/scrapoxy

Scrapoxy is a powerful proxy management tool that simplifies web scraping by handling IP rotation, fingerprinting, and traffic routing to avoid bans.

2.4K
Stable
API Frameworks
Backend Frameworks
#proxies#web-scraping#ip-rotation

oxylabs/perplexity-scraper

A Java library for scraping brand mentions, rankings, and competitor intelligence from the Perplexity AI platform.

2.4K
Stable
Java
LLM Wrappers & SDKs
API Clients & Testing
#ai-scraper#llm-api#llm-scraper

iliane5/meridian

Meridian delivers personalized daily briefs by scraping news sources, analyzing with AI, and providing concise summaries.

2.4K
Experimental
TypeScript
React
#authentication#streaming#real-time

emadehsan/thal

A JavaScript library for web scraping using Puppeteer and Chrome Headless.

2.4K
Archived
JavaScript
Backend Frameworks
CLI Tools
Node
#web-scraping#puppeteer#chrome-headless

dickreuter/Poker

A fully functional poker bot that uses computer vision, neural networks, and genetic algorithms to play poker on various platforms.

2.4K
Experimental
Python
Computer Vision
API Frameworks
Python
#poker#computer-vision#genetic-algorithms

rust-scraper/scraper

A Rust library for parsing and querying HTML with CSS selectors, useful for web scraping tasks.

2.3K
Active
Rust
API Frameworks
CLI Tools
#web-scraping#html-parsing#css-selectors

spider-rs/spider

A powerful web scraping and crawling library for Rust developers

2.3K
Active
Rust
API Frameworks
CLI Tools
#automation#crawler#headless-chrome

vladkens/twscrape

Scrapes Twitter API search results and user profiles with authorization support.

2.3K
Experimental
Python
React
#authentication#scraping#authorization
1...57...13

Stay in the loop

Get weekly updates on trending AI coding tools and projects.