Explore Projects
Discover 96 open source projects
Showing 81-96 of 96 projects
fugary/calibre-douban
This is a Python plugin for the Calibre ebook management tool that uses web crawling to obtain book metadata from the Douban platform.
tavily-ai/tavily-mcp
A production-ready MCP server with real-time search, extract, map, and crawl capabilities for vibe coders.
rebrowser/rebrowser-patches
Collection of patches to avoid automation detection and captchas for web scraping and crawling tools.
InstaPy/instagram-profilecrawl
A Python script that quickly crawls and extracts information from Instagram profiles.
0x676e67/rnet
An ergonomic Python HTTP client with TLS fingerprinting capabilities for web scraping and crawling.
istresearch/scrapy-cluster
A distributed, on-demand web scraping solution using Scrapy, Redis, and Kafka for high-performance crawling.
hengliyin/cdfang-spider
A spider to crawl and analyze housing data from the Chengdu Real Estate Association website.
JustinBeckwith/linkinator
A TypeScript-based tool for finding and fixing broken links in websites, documentation, and local files.
tongcheng-security-team/NextScan
NextScan is a comprehensive enterprise-level black-box vulnerability scanning system that integrates vulnerability scanning, management, asset scanning, and crawling services.
jayus0821/swagger-hack
A Python tool that automates the crawling and testing of all Swagger API endpoints.
needleworm/bhban_rpa
This Python-based repository provides examples and code for automating various office tasks like Excel, design, and web scraping.
s045pd/DarkNet_ChineseTrading
This is a Python script for monitoring and crawling the Chinese Darknet, not a developer discovery platform.
ChrisRx/dungeonfs
A FUSE filesystem and dungeon crawling adventure game engine built in Go.
elixir-crawly/crawly
Crawly is a high-level web crawling and scraping framework for Elixir, enabling developers to extract data from websites efficiently.
facebookresearch/cc_net
Tools to download and cleanup Common Crawl data, a large web crawl dataset, for further analysis and processing.
m-sec-org/EZ
EZ is a cross-platform vulnerability scanner that combines information gathering, port scanning, service brute-forcing, URL crawling, and fingerprinting.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.