Search awesome repositories

Apache Spark - A unified analytics engine for large-scale data processing

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

最新Docker容器技术，从真实案例中学习最佳实践！| Learn and understand Docker&Container technologies, with real DevOps practice!

List of Data Science Cheatsheets to rule the world

GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...

Python SQL Parser and Transpiler

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

🧙 Build, run, and manage data pipelines for integrating and transforming data.

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark

State of the Art Natural Language Processing

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

LLM speculative inference server for heterogeneous hardware & consumer GPUs

Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

A large-scale entity and relation database supporting aggregation of properties

Elassandra = Elasticsearch + Apache Cassandra

Distributed Deep learning with Keras & Spark

Nessie: Transactional Catalog for Data Lakes with Git-like semantics

The next generation of cloud-native big data management expert , Aims to help users rapidly build stable, efficient, and scalable cloud-native platforms for big data.

Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster

基于JDK8 AI 聊天机器人！微信公众号 Midjourney画图、卡密兑换、web 支持ChatGPT、Midjourney画图、sd画图，卡密兑换，易支付，公众号引流，邮件注册🔥

Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool

Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!