Put the LLM last: I replaced a 7B model with a tiny Go classifier

Most production AI tasks are not LLM tasks. I replaced a 7B model with a tiny 2.4 MB Go classifier: rules first, small model, LLM last.

Read Original

Related