So after a bunch of experimentation on LM Studio it seems like the LLM sweet spot for my aging M2 laptop is Qwen 3.5 9B. If my memory is relatively free I can get 30-50 tok/sec which is quite usable. Im in the middle of building a new UI for a client in Taiwan and translating all the screens and buttons to Traditional Chinese. This tool means I don't need to use any online services. Honestly seeing how good this kind of thing runs locally and comparing the output to ChatGPT, it makes me think that all these AI data centres are a waste of space. At least for general purpose LLMing..#AI #LLM
Related
⚡ Remote Senior Data Engineer – Advertising at Truelogic.✅ Apply here: https://jobicy.com/jobs/163404-senior-data-engine...
⚡ Remote Senior Data Engineer – Advertising at Truelogic.✅ Apply here: https://jobicy.com/jobs/163404-senior-data-engineer-advertising#RemoteJobs #BusinessIntelligence #DataJobs #M...
Windows rückt in die Cloud ... Neues #Windows364 ? :mastoshrug: #MicrosoftIgnite26: #Azure wird agentischer und #Windows...
Windows rückt in die Cloud ... Neues #Windows364 ? :mastoshrug: #MicrosoftIgnite26: #Azure wird agentischer und #Windows :windows: rückt in die #Cloud ☁️ | Developer https://www.he...
Как AI-агент работает в конвейере требованийПродолжаем тему внедрения ИИ в конвейер требований. В прошлый раз мы рассказ...
Как AI-агент работает в конвейере требованийПродолжаем тему внедрения ИИ в конвейер требований. В прошлый раз мы рассказывали про инструменты, которые превращают хаос из встреч, БФ...