engineering
Wax: One File That Survives Hard Kills and Context Resets
I built Wax, a single-file crash-safe memory engine for AI agents on Apple Silicon: WAL durability, hybrid RAG, bitemporal facts, no cloud dependency.
Tag
imported
12 posts
engineering
Inside Swarm's WebSearchTool: How I Built It to Fit a 4K Context Window
I built Swarm's Swift web tool for 4,096-token on-device LLMs. Here's the tiered envelope, the Wax-without-embeddings bet, and fourteen decisions behind it.
engineering
How I Conducted Deep Research with a 3B On-Device Model and a 4K Context Window
A 3B on-device model with a 4K context window produced a 2,336-word grounded research report using live web search. Here's the architecture that made it work.
engineering
EdgeRunner Beats llama.cpp: A Swift/Metal LLM Engine on Apple Silicon
Built EdgeRunner in pure Swift and Metal from scratch over a weekend. On Qwen3-0.6B Q8_0, it hits 212 tok/s on M3 Max, beating llama.cpp by 16%. Here's what w
engineering
What Our Espresso Throughput Experiments Actually Found
A throughput research postmortem from Espresso: what we tested, what failed, what stayed slower than baseline, and where the real architectural blockers are.
engineering
Why iOS Developers Need Conduit: A Unified SDK for Every LLM
If you've shipped AI features in an iOS app recently, you know the drill. Each provider has its own SDK. Switching means rewriting everything. Conduit fixes t
engineering
ContextCore: GPU-Accelerated Context Memory for On-Device AI Agents
We built ContextCore to manage conversation context on Apple Silicon without cloud or battery drain. Four-tier memory, Metal shaders, 63M chunks/sec, sub-5ms
engineering
EdgeRunner Architecture: What We Found When We Read the Whole Damn Codebase
We fully documented EdgeRunner, a Metal LLM inference engine for Apple Silicon. Here's what we found that was actually interesting.
engineering
Why On-Device Observability Is Non-Negotiable for GenAI Applications
How local telemetry transforms AI reliability, privacy, and performance for applications running on edge devices.
engineering
Colony: A Native AI Agent Runtime for Apple Platforms
Colony is a Swift framework that orchestrates AI agent loops on iOS and macOS using Apple's Foundation Models. Here's why it exists and how it works.
engineering
Swift for Coding Agents
After building a multi-agent framework in Swift, I have thoughts on why it might actually be a better fit than Python or TypeScript for this kind of work.
engineering
The file system is becoming the interface for agents
Why the serious agent stacks are converging on files as the primitive for machine behavior, and what that means for the future of AI systems.