Explore Projects

Discover 5 open source projects

Active filters (1):

Search: webcrawler×

Showing 1-5 of 5 projects

A distributed web crawler admin platform for managing spiders in any language or framework.

12.2K

Stable

Backend Frameworks

#crawling#spider-management#distributed

A no-code web crawler platform that allows developers to define crawling workflows visually without writing code.

11.3K

Archived

Java

Web Development

Java

#crawler#jsoup#spider

Python-based AI news extractor beta version

3.8K

Experimental

Python

AI-powered coding assistants

Vibe Coders

#NewsExtractor#VibeCoders#AI-Powered

Heritrix is an open-source, extensible web crawler for archiving websites at scale.

3.2K

Active

Java

Backend Frameworks

ETL & Pipelines

#web-crawling#warc#java

A personal search engine and web crawler for developers to explore their digital footprint.

1.4K

Archived

CLI Tools

API Frameworks

#personal-search#web-crawler#unix-like

Get weekly updates on trending AI coding tools and projects.