Writing · Essays · Field notes

I write to learn, and publish to share.

Technical tutorials, field notes on applied AI, and developer writing from a long stretch shipping production systems. Updated most weeks.

184 postsSince MMXI · Archive complete through Aug 202669 this yearRSS ↗
184 posts
The gate has to touch the real system01 · Essay
EssayAug 2026

The gate has to touch the real system

An agentic terminal, a Mermaid fine-tune, and my context engine ctx. The first two failed because I measured them with instruments I built myself. Verification is paramount, and it has to touch the real system.

pt: The Attention-First Terminal That Builds Itselfpt: The Attention-First Terminal That Builds ItselfTDD-019 · DRAWING
Blueprint Deep DiveAug 202626 MIN

pt: The Attention-First Terminal That Builds Itself

I built pt, an attention-first agentic terminal in Go: durable work contracts, parallel agent lanes with byte-verified delivery, workers on rented orbs. The factory merged nearly 400 PRs in two weeks, and I still couldn't drive my workday through it. This is the blueprint and the retro: what got built, what failed to get traction, the two ctx-backed capabilities that stuck, and the new direction: ctx as a complete, verifiable graph of work that any harness or future model can drive.

Patch footprint beat model price: the clearest signal in 60 coding-agent runs03 · Essay
EssayAug 2026

Patch footprint beat model price: the clearest signal in 60 coding-agent runs

The strongest predictor in a 60-run local-vs-cloud coding-agent benchmark wasn't model quality or price — it was patch footprint. Four-plus-file changes fell to 3/7 held-out checks on every route, including the lane that cost 25x more per run. Decomposition, not a bigger model, is the intervention.

The Eval Harness: 60 Local and Cloud Coding RunsThe Eval Harness: 60 Local and Cloud Coding RunsTDD-019 · DRAWING
Blueprint Deep DiveAug 202620 MIN

The Eval Harness: 60 Local and Cloud Coding Runs

A complete record of 60 coding-agent runs across an 80.76 GiB local DeepSeek quant, hosted DeepSeek, and hosted Claude: task design, hidden scorers, repair passes, provider recovery, exact cost, uncertainty, and workload fit.

OpenRouter vs Vercel AI Gateway: Cost, Routing, and Model Coverage05 · Essay
EssayAug 2026

OpenRouter vs Vercel AI Gateway: Cost, Routing, and Model Coverage

A measured comparison of OpenRouter and Vercel AI Gateway across fees, provider redundancy, model catalogs, prompt caching, routing controls, privacy, and developer experience.

Designing AI EvaluationsDesigning AI EvaluationsTDD-020 · DRAWING
Blueprint Deep DiveAug 202625 MIN

Designing AI Evaluations

A generic blueprint for designing AI evaluations: define the decision, version the system, build representative task sets, choose valid scorers, measure uncertainty, analyze failures, and connect offline tests to production evidence.

Practical Advice on Local Inference and Cloud LLMs - August 202607 · Essay
EssayAug 2026

Practical Advice on Local Inference and Cloud LLMs - August 2026

The short version of two weeks spent measuring local and cloud inference: what a 128 GB MacBook is actually good for, why Vercel's AI Gateway is currently winning my DeepSeek workloads over DeepSeek's own API, which work goes to which model, and the one pricing number to check before comparing any providers.

Rightsizing My Agent Spend: From Opus to DeepSeek V4 Flash 073108 · Essay
EssayAug 2026

Rightsizing My Agent Spend: From Opus to DeepSeek V4 Flash 0731

Eleven agents on Claude Opus 4.8 were burning more than $150 a week, so I shut them off. Moving the fleet to DeepSeek V4 Flash 0731 cut inference roughly 96x on output — and the same model runs just as well locally on my M5 Max as it does through the Vercel AI Gateway. The model swap was one line per bot; the platform underneath it was the actual work.

Sampling Thinking Machines’ Inkling and the Alias Pattern09 · Essay
EssayAug 2026

Sampling Thinking Machines’ Inkling and the Alias Pattern

Sampling Thinking Machines’ Inkling through Baseten and Vercel, then using one alias pattern to route Claude Code between private local DeepSeek and the Vercel AI Gateway.

Vercel AI Gateway Review: Measured Speed & Pricing (2026)10 · Essay
EssayAug 2026

Vercel AI Gateway Review: Measured Speed & Pricing (2026)

Two weeks using Vercel AI Gateway for Claude Code: measured cost and latency, plus the model table and alias that make switching models fast.

The Price FloorThe Price FloorTDD-018 · DRAWING
Blueprint Deep DiveAug 202615 MIN

The Price Floor

What does it actually cost to run a frontier-class open model? I measured DeepSeek V4 Flash 0731 across every layer in August 2026: why the same weights run 5x faster in a different inference engine, prefill versus decode, why speculative-decoding gains don't transfer between stacks, measured cloud throughput against the listed figures, the prompt-cache price that dominates agent workloads, the sold-out market for fast inference, and the monthly crossover where a home Blackwell rig beats the API.

The Voice Box: Running Your Own ElevenLabs, Offline and FreeThe Voice Box: Running Your Own ElevenLabs, Offline and FreeTDD-016 · DRAWING
Blueprint Deep DiveJul 202615 MIN

The Voice Box: Running Your Own ElevenLabs, Offline and Free

Open-weight speech synthesis got good enough to replace a paid API. This is the working drawing for a local text-to-speech studio built on Fish Audio S2 Pro and MLX — every measurement, both bugs, and the discovery that the model ships with no voices at all.

The Cost CurveThe Cost CurveTDD-017 · DRAWING
Blueprint Deep DiveJul 202625 MIN

The Cost Curve

DeepSeek's retrained V4 Flash 0731 moved the model pricing baseline for everyone. This drawing works the full token-dollar ledger: MoE bandwidth arithmetic, quantization, the nine agent benchmarks where a budget model beat the flagship, cache-hit economics, verbosity-adjusted task cost, the price war forcing 80% cuts on the frontier, and the structural trap forcing labs to race their own depreciation curve.

The Model SheetThe Model SheetTDD-006 · DRAWING
Blueprint Deep DiveJul 202620 MIN

The Model Sheet

A model's name is a datasheet most people never learn to read. This drawing goes field by field — parameters, dense versus MoE, training stage, distillation, abliteration and merges, quantization (GGUF, k-quants, imatrix, GPTQ/AWQ) — then does the memory math that decides what runs locally, sources and vets a model on Hugging Face, and tests it on your own task instead of trusting a benchmark.

ctx: The Personal Context Engine Every One of My Agents Sharesctx: The Personal Context Engine Every One of My Agents SharesTDD-015 · DRAWING
Blueprint Deep DiveJul 202630 MIN

ctx: The Personal Context Engine Every One of My Agents Shares

Every agent I use — terminal, browser, phone, across Anthropic and OpenAI — started every conversation knowing nothing about me. So I built one shared memory they all plug into: a technical blueprint for a provider-agnostic personal context engine — one Postgres table, a hybrid retriever with an LLM reranker, and a scope wall enforced by the database, not by prompts.

The Attention HeadThe Attention HeadTDD-010 · DRAWING
Blueprint Deep DiveJul 202615 MIN

The Attention Head

What is an attention head, and how would you prove one does what you think it does? A from-zero walk through a single head in GPT-2 small: what it reads, what it writes, the copying behavior you can watch in its attention map, and why that picture is the weakest evidence there is — with logit attribution and ablation as the stronger tests.

The BenchmarkThe BenchmarkTDD-014 · DRAWING
Blueprint Deep DiveJul 202615 MIN

The Benchmark

A benchmark score is manufactured, and every step leaves a trace. Trace an AI benchmark number back through sampled tasks, prompts, scorers, aggregation, uncertainty, and contamination to the decision it can actually support.

The Diffusion ModelThe Diffusion ModelTDD-013 · DRAWING
Blueprint Deep DiveJul 202615 MIN

The Diffusion Model

A coordinate-consistent visual guide to diffusion and flow: forward noise, learned denoising, guidance, latent compression, DiT, sampling, and flow matching.

The GuardThe GuardTDD-012 · DRAWING
Blueprint Deep DiveJul 202615 MIN

The Guard

A trust-boundary threat model for prompt injection in tool-using agents, with capability scoping, external authorization, and testable security metrics.

The Inference EngineThe Inference EngineTDD-011 · DRAWING
Blueprint Deep DiveJul 202615 MIN

The Inference Engine

A worked guide to LLM inference memory, KV-cache paging, continuous batching, prefill, decode, quantization, and latency-capacity planning.

The TokenizerThe TokenizerTDD-004 · DRAWING
Blueprint Deep DiveJul 202615 MIN

The Tokenizer

How tokenization works: BPE tokenizer training, ordered merges, byte fallback, token IDs, costs, multilingual tradeoffs, and why LLMs use tokens.

The WorkshopThe WorkshopTDD-005 · DRAWING
Blueprint Deep DiveJul 202615 MIN

The Workshop

A complete working drawing for an AI training workshop: how to design, build, deliver, and follow through on an AI workshop for engineers or corporate AI training that works.

We don't want AI pets. Fix your fucking connectors.23 · Essay
EssayJul 2026

We don't want AI pets. Fix your fucking connectors.

Hate mail from the edge of applied AI.

The Embedding SpaceThe Embedding SpaceTDD-002 · DRAWING
Blueprint Deep DiveJul 202615 MIN

The Embedding Space

From the distributional hypothesis and word2vec to contextual sentence encoders: how embeddings are trained, compared, indexed with HNSW, migrated, and evaluated in production.

Showing 24 of 184 posts. More posts load automatically as you scroll.

The Modern Coding letter.

Monthly. One essay on applied AI. No marketing, no spam.