What is disaggregated prefill and decode in LLM inference?

What is disaggregated prefill and decode in LLM inference? Prefill is compute-bound, decode is...

Read Original

Related