Explore Projects
Discover 63 open source projects
Showing 21-40 of 63 projects
ucbepic/docetl
A system for agentic LLM-powered data processing and ETL workflows for unstructured data analysis.
noflo/noflo
Flow-based programming framework for building complex JavaScript applications and services.
xyflow/awesome-node-based-uis
A curated list of resources for creating node-based UI editors and visual programming tools.
blockchain-etl/ethereum-etl
Python scripts for extracting, transforming and loading Ethereum blockchain data into Google BigQuery.
PeerDB-io/peerdb
Fast, cost-effective data replication tool from Postgres to data warehouses, queues, and storage
apache/incubator-devlake
An open-source dev data platform to ingest, analyze, and visualize data from DevOps tools for engineering insights.
TobikoData/sqlmesh
Scalable and efficient data transformation framework with backwards compatibility for dbt.
ETLCPP/etl
Header-only C++ library providing STL-like containers & algorithms for embedded systems without dynamic memory.
datachain-ai/datachain
Comprehensive analytics, versioning, and ETL toolkit for multimodal data (video, audio, PDFs, images)
apache/hamilton
Hamilton is an open-source ETL framework that helps data scientists and engineers build modular, testable dataflows with lineage and metadata.
instill-ai/instill-core
Instill Core is an open-source AI infrastructure tool for orchestrating data, models, and pipelines to build AI-powered applications.
supabase/etl
A real-time Postgres data replication and streaming library built in Rust for building CDC pipelines.
reugn/go-streams
A lightweight stream processing library for Go developers that supports various streaming platforms.
timeplus-io/proton
Fast, single-binary C++ SQL ETL pipeline for stream processing, observability, analytics, and AI/ML.
superglue-ai/superglue
superglue builds integrations and tools from natural language for long-tail and enterprise systems.
data-engineering-community/data-engineering-wiki
A community-driven wiki for learning data engineering, covering topics like data modeling, pipelines, and databases.
san089/Udacity-Data-Engineering-Projects
A collection of Udacity data engineering projects showcasing various tools and technologies.
thbar/kiba
A data processing and ETL (Extract, Transform, Load) framework for Ruby developers.
NVIDIA/aistore
AIStore: A scalable, high-performance, and high-availability storage solution for AI applications and workloads.
yobix-ai/extractous
Powerful, fast, and efficient unstructured data extraction library written in Rust with language bindings.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.