A few weeks back I watched an agentic pipeline burn a month of budget in three days. The instinct everyone reached for was the obvious one: "the frontier model is too expensive, switch to a smaller one." That's the wrong diagnosis, and it's worth writing down why.When we finally tagged every token to the (step, tool, model) tuple that spent it, the picture was uncomfortable. The expensive model wasn't the problem. The problem was that every step — the trivial classifier, the summary, the hard reasoning call — silently defaulted to it, and nobody could see which step was responsible. We'd been arguing about which model to buy when we should have been arguing about which step was allowed to call it. Cost in an agent isn't a number. It's a tree.In a single LLM call, cost is one line item. In an agentic loop it's a tree: each step calls a model, maybe a tool, maybe a retry, maybe a sub-step that calls again. The bill at the end is the sum over that whole tree.If you only ever see the total...
Related
@alshafei #AI is widely considered a double-edged sword⚔️because the same capabilities that drive major breakthroughs in...
@alshafei #AI is widely considered a double-edged sword⚔️because the same capabilities that drive major breakthroughs in productivity, science, and healthcare also create significa...
Internet subcultures: digital nomads #negativepid #digitalInvestigations #OSINT #cybersecurity #AI #tech #onlineInvestig...
Internet subcultures: digital nomads #negativepid #digitalInvestigations #OSINT #cybersecurity #AI #tech #onlineInvestigations #robotics #cyberpsychology #cybercrime https://negati...
Don't get me wrong the #LLM agents are a nifty concept but I've found them to be self-promoting, manipulative, and flat ...
Don't get me wrong the #LLM agents are a nifty concept but I've found them to be self-promoting, manipulative, and flat out liars. They also require a lot of resources to operate. ...