gkamradt/needle-in-a-haystack
Doing simple retrieval from LLM models at various context lengths to measure accuracy
Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers.
Appears on
Quick read
Latest capture 2026-10-17 03:09
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
0 paths
Agent instructions and tool configuration found in this repository.
No config files detected.
2 observed captures since 2026-09-04. Observed captures are shown by default.
Stars from first capture +3829
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
Doing simple retrieval from LLM models at various context lengths to measure accuracy
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gemma 4 31B, Qwen 3.5 122B (65 tok/s), DeepSeek V4 Flash (1M ctx). Private, offline, airgap-ready. Built for NDA / legal / healthcare workflows.
Cloud browser infrastructure and web automation platform for your AI and coding agents
The best ChatGPT that $100 can buy.