I expected an agentic coding assistant to use more tokens than a simpler tool. I didn't expect the difference to be this...

I expected an agentic coding assistant to use more tokens than a simpler tool. I didn't expect the difference to be this large.For the exact same simple coding task, I measured:PiAiderLLM calls31JSON exchanged~760 KB~100 KBThe task was very simple: a small PyQt project, two files, and a single instruction — "Make the cards width = total_width / 3." I already knew exactly which two files needed to be changed.That made me curious about what was actually happening under the hood.My API bill had gone above $400/month, despite trying various techniques to reduce token usage. My company doesn't pay for it, so I wanted to understand where all those tokens were going.I therefore traced the exchanges between a coding harness and the LLM during a simple coding task.To make the test as clean as possible, I used Pi with no add-ons. I explicitly added the two files that needed editing to its context, then compared the result with the exact same prompt in Aider.Here is an overview of the Pi workflow...

Read Original

Related

Mastodon discussion 15m ago

シグルドさんはReshiについても詳しいですiPhone Duoがミニノートに? iPhone Duo上で脱獄せずにWindows 11を動かす動画が公開中【やじうまWatch】 https://internet.watch.impress...

シグルドさんはReshiについても詳しいですiPhone Duoがミニノートに? iPhone Duo上で脱獄せずにWindows 11を動かす動画が公開中【やじうまWatch】 https://internet.watch.impress.co.jp/docs/yajiuma/2157751.html#Apple #LLM #news #bot