🚀 LLM inference Engine in Swift/Metal, Load GGUF and safe tensors modes, no conversion, no cpp, pure swift
Appears on
Quick read
Latest capture 2026-10-24 09:45
Compare the starting count and capture dates, not just the percentage. How to read GitHub star growth. Missing history is not zero growth.
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
2 paths
Agent instructions and tool configuration found in this repository.
Explore indexed repositories with these instruction or planning files. File detection is not a quality, compatibility, or safety assessment; check the actual instructions upstream.
AGENTS.md, CLAUDE.md, and GEMINI.md searches also match nested paths. Other file searches require the exact repository-root path. To require several files, select them together in the search filters.
1 observed capture since 2026-10-24. Observed captures are shown by default.
Stars from first capture 0
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
Run transformers directly on Apple's Neural Engine in Swift bypass coreml entirely
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
