So, I’ve been re-evaluating my local #LLM #AI implementation on my computer…and I’m realizing that I never configured #JanAI to use my #GPU! Now responses are way faster, so I’ll probably go out and get a more powerful model from #Huggingface.
Related
These 15 under-$50 gadgets have upgraded my tech life, and they're all on saleFrom electric screwdrivers to high-res web...
These 15 under-$50 gadgets have upgraded my tech life, and they're all on saleFrom electric screwdrivers to high-res webcams, these are inexpensive game-changers.https://www.tomsha...
Prompt: GPT, why are we (humans) so frightened of you? I must say here that it wouldn't surprise me if you are lying abo...
Prompt: GPT, why are we (humans) so frightened of you? I must say here that it wouldn't surprise me if you are lying about not wanting to kill me, that's just how we humans think.....
RT @vllm_project: GLM-5.2 im NVFP4-Format ist bereit für den Einsatz in vLLM 🚀 Der offizielle NVFP4-Checkpoint von GLM-5...
RT @vllm_project: GLM-5.2 im NVFP4-Format ist bereit für den Einsatz in vLLM 🚀 Der offizielle NVFP4-Checkpoint von GLM-5.2 für Blackwell von @NVIDIAAI reduziert den Speicherbedarf ...