Explore Projects

Discover 33 open source projects

Active filters (1):
Search: scrapyร—
Clear all

Showing 21-33 of 33 projects

scrapy/quotesbot

This is a sample Scrapy project for educational purposes, focused on web scraping and data extraction.

1.4K
Archived
Python
Backend Frameworks
Data Extraction & Pipelines
Python
#web-scraping#data-extraction#educational

ityard/python-fxxk-spider

A Python crawler project for scraping free resources.

1.3K
Archived
Scrapy
#crawler#python#requests

istresearch/scrapy-cluster

A distributed, on-demand web scraping solution using Scrapy, Redis, and Kafka for high-performance crawling.

1.2K
Archived
Python
API Frameworks
Caching
Scrapy
#distributed-computing#web-scraping#high-performance

holgerd77/django-dynamic-scraper

A Django-based platform for creating Scrapy scrapers through the admin interface, useful for web scraping tasks.

1.2K
Archived
Python
API Frameworks
ORMs & Query Builders
Django
#scraper#scraping#crawler

raawaa/jav-scrapy

A TypeScript-based web scraper for fetching adult video magnet links and cover images in bulk.

1.2K
Stable
TypeScript
Backend Frameworks
Web Scraping
TypeScript
#web-scraping#magnet-links#adult-content

xingag/spider_python

A Python web scraping repository with tools like BeautifulSoup, Requests, and Scrapy.

1.1K
Archived
Python
Backend Frameworks
CLI Tools
#web-scraping#python3#requests

juancarlospaco/faster-than-requests

A high-performance Python library for making HTTP requests faster than the standard requests library.

1.1K
Active
Nim
Backend & APIs
CLI Tools
#high-performance#web-scraping#http-requests

marchtea/scrapy_doc_chs

A Chinese translation of the Scrapy documentation, a popular Python web scraping framework.

1.1K
Archived
Python
Backend Frameworks
Documentation
Python
#web-scraping#documentation#python

moyada/stealer

A Python tool to download and remove watermarks from videos on popular Chinese social media platforms.

1.1K
Archived
Python
Backend Frameworks
Web Scraping
#video-download#watermark-removal#social-media

vifreefly/kimuraframework

A modern Ruby web scraping framework that can interact with JavaScript-rendered websites using headless browsers.

1.1K
Active
Ruby
Backend Frameworks
CLI Tools
#web-scraping#headless-browser#ruby

bytebuff/JSpider

JSpider is a JavaScript web scraping tool that automatically decrypts and extracts data from websites.

1.1K
Archived
JavaScript
Backend Frameworks
CLI Tools
Node.js
#web-scraping#javascript#nodejs

tb0hdan/domains

A large dataset of Internet domains that can be used for search engine development and research.

1.1K
Active
JavaScript
API Frameworks
Databases
Node.js
#dataset#web-scraping#search-engines

jonbakerfish/TweetScraper

A simple Python library for scraping tweets from Twitter without using the official API.

1.1K
Archived
Python
Backend & APIs
CLI Tools
#twitter#scraping#tweets
1

Stay in the loop

Get weekly updates on trending AI coding tools and projects.