Will this model fit on your GPU? Size a local LLM on paper before you pull it
When ollama ps shows a CPU/GPU split, your model did not fit and everything runs at the speed of system RAM. Parameters, quantization and the KV cache turn sizing into arithmetic: ...