Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
Appears on
Quick read
Latest capture 2026-10-17 03:16
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
1 path
Agent instructions and tool configuration found in this repository.
Agent instructions
2 observed captures since 2026-09-05. Observed captures are shown by default.
Stars from first capture +307
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gemma 4 31B, Qwen 3.5 122B (65 tok/s), DeepSeek V4 Flash (1M ctx). Private, offline, airgap-ready. Built for NDA / legal / healthcare workflows.
An app that brings language models directly to your phone.
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
A local multi-agent harness that works with your existing Claude Code, Codex subscriptions, allows you to run an office of agents
