Explore Projects

Discover 101 open source projects

Active filters (1):
Search: spider×
Clear all

Showing 41-60 of 101 projects

cirosantilli/china-dictatorship

Political activism documentation on Chinese government censorship, human rights, and censorship circumvention techniques.

2.9K
Active
HTML
Resource Collections
Privacy Tools
#censorship-circumvention#china-dictatorship#human-rights

CharlesPikachu/DecryptLogin

Comprehensive Python library for logging in to various websites using the requests library.

2.9K
Archived
Python
API Clients & Testing
Backend Frameworks
#web-scraping#authentication#login

DormyMo/SpiderKeeper

An open-source admin UI for the Scrapy web scraping framework, providing a dashboard for managing and monitoring spiders.

2.8K
Archived
Python
API Frameworks
CLI Tools
Django
#web-scraping#scrapy#dashboard

shiyanhui/dht

A BitTorrent DHT protocol and spider implementation in Go for developers interested in peer-to-peer networking.

2.8K
Archived
Go
API Frameworks
CLI Tools
#bittorrent#dht#peer-to-peer

geziyor/geziyor

Geziyor is a fast web crawling and scraping framework for Go that supports JavaScript rendering.

2.8K
Experimental
Go
API Frameworks
CLI Tools
#crawler#scraper#web-scraping

striver-ing/wechat-spider

A WeChat spider that crawls articles, reading counts, likes, and comments from public accounts.

2.8K
Archived
Python
Express
#authentication#streaming#real-time

pibigstar/go-demo

A comprehensive Go programming language tutorial covering basics, design patterns, interviews, and more.

2.7K
Experimental
Go
API Frameworks
Authentication
Go
#go#go-tools#go-tutorials

jae-jae/QueryList

A progressive PHP crawler framework that allows developers to build elegant web scrapers and crawlers.

2.7K
Experimental
PHP
Backend Frameworks
ETL & Pipelines
#crawler#scraper#spider

lorien/grab

A powerful web scraping framework for Python that supports asynchronous crawling and flexible data extraction.

2.5K
Stable
Python
Backend Frameworks
CLI Tools
Python
#web-scraping#crawling#asynchronous

Python3WebSpider/Python3WebSpider

A Python library for building web crawlers and spiders, suitable for vibe coders interested in web automation.

2.4K
Archived
Backend Frameworks
CLI Tools
#web-scraping#automation#python

QianyanTech/Image-Downloader

A Python library for downloading images from Google, Bing, and Baidu.

2.3K
Archived
Python
React
#image-downloader#google-images#pyqt

JayBizzle/Crawler-Detect

A PHP library for detecting bots, crawlers, and spiders based on the user agent string.

2.3K
Active
PHP
API Frameworks
CLI Tools
PHP
#bots#crawler#user-agent

sjdirect/abot

A cross-platform, fast, and flexible C# web crawler framework for developers building crawlers and spiders.

2.3K
Archived
C#
Backend Frameworks
#web-crawler#cross-platform#c-sharp

spider-rs/spider

A powerful web scraping and crawling library for Rust developers

2.3K
Active
Rust
API Frameworks
CLI Tools
#automation#crawler#headless-chrome

xianhu/PSpider

A simple and easy-to-use Python web scraping framework with support for multi-threading and proxies.

1.8K
Archived
Python
Backend & APIs
CLI Tools
Python
#crawler#web-scraper#multi-threading

hu17889/go_spider

A flexible and modular Go-based web crawler framework with a concurrent architecture.

1.8K
Archived
Go
API Frameworks
CLI Tools
#crawler#concurrent#pipeline

u3c3/BT-btt

This repository appears to be related to a torrent site and does not seem to be focused on AI coding tools for developers.

1.8K
Archived
Uncategorized
#torrent#crawler#download

gege-circle/.github

A Vue-based chat application with real-time functionality

1.8K
Stable
Component Libraries (Vue/Svelte)
Authentication
Vue
#real-time#vue#chat-application

1N3/BlackWidow

A Python-based web application scanner to gather OSINT and fuzz for OWASP vulnerabilities on a target website.

1.8K
Archived
Python
#osint#vulnerability-scanning#fuzzing

coder-hxl/x-crawl

Flexible and AI-assisted Node.js crawler library for building web scrapers and crawlers.

1.8K
Active
TypeScript
LLM Frameworks
API Frameworks
Node.js
#ai-crawl#chromium#crawler

Stay in the loop

Get weekly updates on trending AI coding tools and projects.