inferbench v0.1.1 🖥️ download, launch & benchmark local LLM engines (llama.cpp & co) from one desktop app. Real tok/s on...

inferbench v0.1.1 🖥️ download, launch & benchmark local LLM engines (llama.cpp & co) from one desktop app. Real tok/s on your own GPU, no cloud, no guesswork. Now serves models + exposes them over MCP (text & image).https://github.com/JoniMartin27/inferbench#llm #localllm #benchmark

Read Original

Related