Explore Projects
Discover 56 open source projects
Showing 1-20 of 56 projects
seaweedfs/seaweedfs
Distributed storage system for blobs, files, and data lakes
donnemartin/data-science-ipython-notebooks
Data science Python notebooks covering deep learning, machine learning, big data, and more.
dmlc/xgboost
Distributed gradient boosting library for fast and accurate data science solutions
spotify/luigi
Luigi is a Python module that helps developers build complex batch job pipelines with dependency management and workflow orchestration.
Tencent/APIJSON
APIJSON is a secure, coding-free ORM library that provides APIs and documentation without backend coding.
heibaiying/BigData-Notes
A comprehensive guide to big data technologies like Hadoop, Spark, Kafka, and more for developers.
prestodb/presto
Presto is an open-source distributed SQL query engine for big data, allowing fast analysis of large datasets.
apache/hadoop
Apache Hadoop is a popular open-source distributed computing framework for processing and storing large datasets.
deeplearning4j/deeplearning4j
Suite of tools for deploying and training deep learning models using the JVM
trinodb/trino
Trino is a distributed SQL query engine for big data, allowing fast, scalable, and cost-effective analytics.
madd86/awesome-system-design
A curated list of awesome System Design resources for developers working on distributed systems.
wangzhiwubigdata/God-Of-BigData
A comprehensive collection of resources and learning materials for big data technologies like Flink, Spark, Hadoop, and Hive.
linkedin/school-of-sre
An open-source curriculum for onboarding entry-level talents into the SRE role at LinkedIn.
HariSekhon/DevOps-Bash-tools
A collection of 1000+ DevOps Bash scripts for managing AWS, GCP, Kubernetes, Docker, CI/CD, APIs, databases, and more.
h2oai/h2o-3
An open-source, distributed machine learning platform with support for various algorithms and autoML.
Alluxio/alluxio
Alluxio is an open-source data orchestration platform for analytics and machine learning workloads in the cloud.
apache/hive
Apache Hive is a data warehouse software built on top of Apache Hadoop for querying and managing large datasets.
treeverse/lakeFS
lakeFS is a Git-like version control system for data lakes, enabling data engineers to manage data versioning and data quality.
WeBankFinTech/DataSphereStudio
DataSphereStudio is a one-stop data application development and management portal covering data exchange, analysis, and visualization.
chrislusf/glow
Glow is a distributed computation system written in Go, similar to Hadoop MapReduce, Spark, and Flink.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.