Built EdgeRunner in pure Swift and Metal from scratch over a weekend. On Qwen3-0.6B Q8_0, it hits 212 tok/s on M3 Max, beating llama.cpp by 16%. Here's what worked.
Mar 31, 2026 deep dive 5 min read
Tag
Apple Silicon
2 posts tagged with Apple Silicon.
Apple Silicon
ls -la ./tags/apple-siliconWe fully documented EdgeRunner, a Metal LLM inference engine for Apple Silicon. Here's what we found that was actually interesting.
Mar 25, 2026 deep dive 7 min read