Explore Projects

Discover 10 open source projects

Active filters (1):
Search: datafusionร—
Clear all

Showing 1-10 of 10 projects

apache/datafusion

Apache DataFusion is a powerful SQL query engine written in Rust, designed for big data processing and analysis.

8.5K
Active
Rust
Databases
ETL & Pipelines
#big-data#dataframe#olap

ibis-project/ibis

Portable Python dataframe library for data analysis and manipulation

6.4K
Active
Python
React
#dataframe#python#analysis

roapi/roapi

A Rust-based library to create full-fledged APIs for slowly moving datasets without writing code.

3.4K
Stable
Rust
API Frameworks
Databases
#analytics#column-store#data-lake

lakesoul-io/LakeSoul

LakeSoul is a cloud-native, real-time Lakehouse framework for fast data ingestion and analytics on cloud storage.

3.2K
Active
Java
API Frameworks
Databases
#big-data#lakehouse#streaming

apache/datafusion-ballista

Apache DataFusion Ballista is a distributed query engine for big data analysis, built with Rust and Arrow.

2.0K
Active
Rust
Databases
ETL & Pipelines
#big-data#dataframe#distributed

apache/auron

The Auron accelerator framework leverages vectorized execution to speed up distributed computing on big data platforms like Spark.

1.7K
Active
Rust
Databases
API Frameworks
Spark
#big-data#distributed-computing#vectorized-execution

tansu-io/tansu

Apache Kafka-compatible broker with support for S3, PostgreSQL, SQLite, Apache Iceberg, and Delta Lake.

1.6K
Active
Rust
API Frameworks
Databases
#apache-kafka#s3#postgresql

arkflow-rs/arkflow

High-performance Rust stream processing engine that seamlessly integrates AI capabilities for real-time data processing.

1.3K
Active
Rust
LLM Frameworks
Streaming
#ai#stream-processing#real-time

lakehq/sail

LakeSail is a Rust-based computation framework that unifies batch processing, stream processing, and AI workloads.

1.2K
Active
Rust
ML Ops
ETL & Pipelines
#distributed-computing#data-engineering#big-data

apache/datafusion-comet

A Spark accelerator for Apache DataFusion, a SQL query engine written in Rust, aimed at vibe coders.

1.1K
Active
Scala
LLM Frameworks
Databases
Spark
#spark#rust#data-processing

Stay in the loop

Get weekly updates on trending AI coding tools and projects.