Explore Projects
Discover 170 open source projects
Showing 101-120 of 170 projects
JSREI/ast-hook-for-js-RE
A tool for exploring browser memory and implementing a crawler solution in JavaScript.
lixi5338619/lxSpider
A Python crawler for various AI-powered platforms and websites
extractus/article-extractor
A Node.js library for extracting the main article content from a given URL using the Readability algorithm.
xianhu/PSpider
A simple and easy-to-use Python web scraping framework with support for multi-threading and proxies.
hu17889/go_spider
A flexible and modular Go-based web crawler framework with a concurrent architecture.
watercrawl/WaterCrawl
A versatile TypeScript-based tool that transforms web content into LLM-ready data for AI/ML applications.
u3c3/BT-btt
This repository appears to be related to a torrent site and does not seem to be focused on AI coding tools for developers.
TeamNewPipe/NewPipeExtractor
A Java library for extracting data from various streaming platforms like YouTube, SoundCloud, and Bandcamp.
coder-hxl/x-crawl
Flexible and AI-assisted Node.js crawler library for building web scrapers and crawlers.
diskoverdata/diskover-community
Diskover is an open-source file indexer, search engine, and analytics tool powered by Elasticsearch.
howie6879/ruia
An async Python 3.6+ web scraping micro-framework based on asyncio for building high-performance crawlers and spiders.
DanMcInerney/xsscrapy
An open-source web crawler and spider tool for detecting cross-site scripting (XSS) vulnerabilities.
MarginaliaSearch/MarginaliaSearch
An internet search engine focused on indexing the small, old, and weird parts of the web.
thecodrr/fdir
Fast directory crawler and globbing library for NodeJS
delaford/game
A JavaScript 2D Medieval RPG with multiplayer capabilities
YoongiKim/AutoCrawler
A powerful Google and Naver web crawler built with Python, Selenium, and multiprocessing for efficient large-scale data collection.
Python3Spiders/WeiboSuperSpider
A powerful Python-based web crawler and toolkit for scraping Weibo data, including user profiles, comments, images, and more.
gigablast/open-source-search-engine
An open-source distributed search engine and web crawler written in C/C++ for Linux.
srx-2000/spider_collection
A collection of Python web scraping scripts for various websites and platforms, including music, video, and real estate data.
rushter/selectolax
A fast HTML5 parser with CSS selectors for Python, useful for web scraping and crawling tasks.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.