llm-visuals: a live Terminal Dashboard for the LLM running on your Machine - It finds the inference servers you already ...

llm-visuals: a live Terminal Dashboard for the LLM running on your Machine - It finds the inference servers you already have up (llama.cpp llama-server, ollama, vLLM, SGLang, …), reads their counters and NVIDIA, AMD or Intel GPU telemetry #TUI #LLM https://github.com/DingoOz/llm-visuals

Read Original

Related