In a typical RAG call, the repeated prefix is 80-95% of input tokens.Guide example (2026-09-10): 4,000 input tokens, 3,600 in a matching cached prefix. $0.50/1M uncached vs $0.075/1M cached. Input line: ~75% lower.Input line only.#LLM #MLOps #AIInfra
Writing is thinking. It's one of the reasons I started blogging again and has helped me immensely. Can't recommend it strongly enough.AI is still ok for proofreading and mundane ta...
Dew Drop - November 10, 2026 (#4789)https://www.alvinashcraft.com/2026/11/10/dew-drop-november-10-2026-4789/#dotnet #webdev #ai #csharp #windowsdev #cloud #appdev #visualstudio #gi...
"In defense of the human code review"I briefly posted a version of this earlier, but I've retitled, reframed and updated it.It's about the increasing pressures to speed up or repla...