When ollama ps shows a CPU/GPU split, your model did not fit and everything runs at the speed of system RAM. Parameters, quantization and the KV cache turn sizing into arithmetic: weights + context + overhead, worked through for Llama 3.
Will this model fit on your GPU? Size a local LLM on paper before you pull it
