Explore Projects
Discover 140 open source projects
Showing 101-120 of 140 projects
databricks/LearningSparkV2
This is a book that teaches how to use Apache Spark for lightning-fast data analytics.
HariSekhon/Dockerfiles
A collection of 50+ Docker images for DevOps tools, CI/CD, Hadoop, Kafka, Cassandra, and more.
linkedin/dr-elephant
Dr. Elephant is a performance monitoring and tuning tool for Apache Hadoop and Apache Spark.
keyu-tian/SparK
A PyTorch implementation of a BERT-style pretraining method for convolutional networks, enabling more efficient self-supervised learning.
jupyter-incubator/sparkmagic
Provides Jupyter magics and kernels for working with remote Spark clusters, enabling data scientists to easily interact with Spark from Jupyter Notebooks.
spark-examples/pyspark-examples
A collection of PySpark examples covering RDD, DataFrame, and Dataset operations in Python.
iflytek/datasophon
An open-source big data management platform that helps developers build scalable cloud-native data applications.
robinhood/spark
A simple Android sparkline chart view library for displaying data trends.
DTStack/Taier
A big data development platform for submission, scheduling, operation and maintenance, and indicator information display.
mahmoudparsian/pyspark-tutorial
PySpark-Tutorial provides basic algorithms using PySpark for big data analytics and data processing.
yahoo/CaffeOnSpark
Distributed deep learning on Hadoop and Spark clusters for vibe coders.
lucko/spark
A high-performance profiler for Minecraft clients, servers, and proxies written in Java.
t59688/arboris-novel
An AI-powered writing companion that helps spark creative inspiration for novel writing
sryza/spark-timeseries
A library for time series analysis on Apache Spark, enabling efficient large-scale time series processing.
QingWei-Li/vue-trend
A simple, elegant spark lines library for Vue.js developers
apachecn/spark-doc-zh
This repository provides the official Apache Spark documentation in Chinese, a popular big data processing framework.
killrweather/killrweather
A reference application showcasing the integration of streaming and batch data processing with Apache Spark Streaming, Cassandra, Kafka, and Akka.
lakehq/sail
LakeSail is a Rust-based computation framework that unifies batch processing, stream processing, and AI workloads.
emmabostian/design-inspiration
A curated collection of websites to inspire creativity and design for developers.
zinggAI/zingg
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
Stay in the loop
Get weekly updates on trending AI coding tools and projects.