I had been adding optimizations to mini-vllm-rs, my Rust LLM inference engine for macOS, including...
Why Continuous Batching Made My LLM Inference Engine Slower
I had been adding optimizations to mini-vllm-rs, my Rust LLM inference engine for macOS, including...
Four prompts, one folder per idea, and more than one app running by the end of the day. Every prompt is included.
lmux is a small macOS terminal I use to run a bunch of Claude Code and Codex sessions at once. The...
A blind "try again" fixed the bug on the first extra attempt. Telling the model exactly what...