Just yesterday, I installed Ollama onto my 2019/20 Dell G5 laptop ( i7-9750H CPU, 16GB RAM, Nvidia GTX1660Ti 6GB GPU) running Linux Mint 22.3.I then installed Alpaca (Flatpak) and loaded the Google Gemma4 E4B model.It's small enough to completely load into GPU memory – it responds quite fast.Ok, it's not as powerful as, say Gemini Flash 3.5 running via cloud, but for a local AI it's quite usable.Today, I loaded two more models:Qwen 3.5 9B and Gemma4 12BNeither of these fitted totally within my GPU's 6GB and required the CPU to work a bit.They were thus slower (and a bit noisier).Results from all 3 were comparable, but I didn't really have a suitable test routine.Gemma4 12B is supposed to be a significantly "better" AI, but again I didn't test them thoroughly.I'm going to use Gemma4 E4B by default and reserve Gemma4 12B for more complex problems.#ai
Related
⚡ Remote Business Intelligence Analyst (Contractor) at Doximity.✅ Apply here: https://jobicy.com/jobs/155822-business-in...
⚡ Remote Business Intelligence Analyst (Contractor) at Doximity.✅ Apply here: https://jobicy.com/jobs/155822-business-intelligence-analyst-contractor#RemoteJobs #DataAnalytics #Ana...
Here are the posters in question. Anyway, screw those platforms and their #AI nonsense!If you're considering getting the...
Here are the posters in question. Anyway, screw those platforms and their #AI nonsense!If you're considering getting the gift of fine art, give Marie a shout. She's a full-time, ga...
調べ物をAIに頼むときの分かれ目。出典なしの要約 → そのまま使えない出典つきのメモ → あとから確かめられる差は「出典を残せ」の一言を足すかどうかだけ。#AI #AI活用
調べ物をAIに頼むときの分かれ目。出典なしの要約 → そのまま使えない出典つきのメモ → あとから確かめられる差は「出典を残せ」の一言を足すかどうかだけ。#AI #AI活用