LoRA and DoRA explained: matrix shapes, the geometry of weight decomposition, exact memory math for a 27B model, and what the DoRA benchmarks support.
LoRA & DoRA: The Math, Memory, and Trade-offs
Related
Three ways a health AI can fail you, and the tests I wrote for each
A caching bug that broke about 1 in 4 page loads, answers that sound surer than they are, and an emergency check that must fire for some sentences and
SLayer: a semantic layer that stops agents guessing SQL
SLayer Text to SQL fails quietly. The model guesses a join, invents a revenue definition,...
We Keep Hearing About AI Productivity. The QA Group Chat Told a Different Story.
An anonymous poll, a debate about multimodal testing, and some uncomfortable questions about who...