istresearch/scrapy-cluster
A distributed, on-demand web scraping solution using Scrapy, Redis, and Kafka for high-performance crawling.
Python
Backend & APIs
API Frameworks
MIT
1.2K
Stars
322
Forks
Apr 14, 2015
Created
Nov 7, 2023
Last Updated
Project Analytics
Stars Growth (1 Month)
-1
-0.1% change
Avg Daily Growth (1 Month)
-0.0
stars per day
Fork/Star Ratio (All Time)
26.2%
High engagement
Lifetime Growth
0.3
stars/day over 4.0K days
Stars Over Time
Forks Over Time
Open Issues Over Time
Pull Requests Over Time
Commits Over Time
AI-Generated Tags
distributed-computing
web-scraping
high-performance
crawling
kafka
redis
Similar Projects
nocodb/nocodb
NocoDB is a free, self-hostable no-code database platform and Airtable alternative with REST API capabilities.
62.3K
TypeScript
pocketbase/pocketbase
Realtime backend with SQLite, files/users management, and REST API
56.6K
Go
dani-garcia/vaultwarden
Self-hosted Bitwarden-compatible password manager server in Rust
56.3K
Rust
jellyfin/jellyfin
Media server for streaming and managing media
49.1K
C#
Comments (0)
Sign in to leave a comment or vote
Sign InNo comments yet. Be the first to comment!
Stay in the loop
Get weekly updates on trending AI coding tools and projects.