Sign in
← Back to search
github Not archived

kyegomez/Sophia

Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.

1 awesome list

Quick read

Stars
383
Forks
26
Open issues
13
Commits
58

Activity and growth

Latest capture 2026-09-27 03:08

Stars · last 7 days
No history
Commits · last 7 days
No history
Stars since tracking
+1
Stored snapshots
7

Classification

Topics

#artificial-intelligence #chatgpt #deep-learning #multi-modality #neural-network #optimizer

Metadata

Language
Python
License
Apache-2.0
Default branch
main
Created
2023-05-24
First commit
2023-05-24
Last pushed
2024-06-04
GitHub updated
2026-09-15
Last synced
2026-09-27 03:08
Stack scanned
2026-09-27 03:08
Archived
No

Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.

Sign in to like kyegomez/Sophia
README Open website View on GitHub

AI development signals

0 paths

Agent instructions and tool configuration found in this repository.

No config files detected.

Growth history

Tracked growth

7 observed captures since 2026-05-27. Observed captures are shown by default.

Stars from first capture +1

Chart data

Observed captures only

Time horizon

All tracked data

Custom date range

Stars history

Observed snapshots

Commits history

Observed snapshots

Similar repositories

Nearest indexed repositories by embedding similarity.

NVIDIA/Model-Optimizer

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

3,780 stars
Python 2 awesome lists

huggingface/optimum

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

3,482 stars
Python 1 awesome list

deepspeedai/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

43,081 stars
Python 1 awesome list

hyperopt/hyperopt

Distributed Asynchronous Hyperparameter Optimization in Python

7,595 stars
Python 2 awesome lists

EleutherAI/gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

7,463 stars
Python 3 awesome lists

hpcaitech/ColossalAI

Making large AI models cheaper, faster and more accessible

41,441 stars
Python 4 awesome lists