Explore Projects
Discover 19 open source projects
Showing 1-19 of 19 projects
ibis-project/ibis
Portable Python dataframe library for data analysis and manipulation
microsoft/SynapseML
SynapseML is a simple and distributed machine learning library for building and deploying AI models at scale.
apache/linkis
Apache Linkis provides a computation middleware layer to connect, govern, and orchestrate applications with data engines.
uber/petastorm
Petastorm enables training and evaluation of deep learning models from Apache Parquet datasets.
awesome-spark/awesome-spark
A curated list of awesome Apache Spark packages and resources for developers.
ptyadana/SQL-Data-Analysis-and-Visualization-Projects
This GitHub repository contains SQL data analysis and visualization projects using various tools and databases.
jadianes/spark-py-notebooks
Apache Spark and Python tutorials for big data analysis and machine learning as Jupyter notebooks.
narwhals-dev/narwhals
Lightweight and extensible compatibility layer between popular dataframe libraries like Pandas, Dask, and PySpark.
hi-primus/optimus
Agile data preparation workflows made easy with popular Python data science libraries.
jupyter-incubator/sparkmagic
Provides Jupyter magics and kernels for working with remote Spark clusters, enabling data scientists to easily interact with Spark from Jupyter Notebooks.
spark-examples/pyspark-examples
A collection of PySpark examples covering RDD, DataFrame, and Dataset operations in Python.
logicalclocks/hopsworks
Hopsworks is a feature store and MLOps platform for data-intensive AI and machine learning applications.
mahmoudparsian/pyspark-tutorial
PySpark-Tutorial provides basic algorithms using PySpark for big data analytics and data processing.
palantir/pyspark-style-guide
This is a style guide for PySpark code, providing best practices for common situations in PySpark repos.
kavgan/nlp-in-practice
Starter code for solving real-world text data problems using NLP techniques like Gensim Word2Vec and text classification.
lakehq/sail
LakeSail is a Rust-based computation framework that unifies batch processing, stream processing, and AI workloads.
lensacom/sparkit-learn
A Python library that integrates Scikit-learn into the Apache Spark distributed computing framework.
graphframes/graphframes
GraphFrames provides DataFrame-based Graphs for Apache Spark, enabling scalable graph analysis and algorithms.
mahmoudparsian/data-algorithms-book
This repository provides a comprehensive guide and implementations for data algorithms using MapReduce, Spark, Java, and Scala.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.