Today's development: The #Bazzite based #Steam box is now able to serve LLMs using its GPU when no one is gaming. A plugin to my existing Remote Play user switcher Bazinga plus a small #LLM router named Conduct.The LLM behind the Computer! voice AI assistant is thus able to serve two users concurrently, unless someone starts a game where the secondary LLM is closed down immediately. Bazzite usage is exactly as before, the new functionality doesn't take anything away from the previous experience. Only adds to the total amount of idle GPUs available in a completely transparent manner.Conduct: https://git.sync.wtf/troed/conductBazinga: https://git.sync.wtf/troed/bazingaComputer!: https://git.sync.wtf/starfleet
Related
2024-06-18 | 💼 Career | 🌲🟰🌲 Treequal ⌨️🪞#AI Q: 🚀 What is your go-to strategy for staying calm during a high-stakes techn...
2024-06-18 | 💼 Career | 🌲🟰🌲 Treequal ⌨️🪞#AI Q: 🚀 What is your go-to strategy for staying calm during a high-stakes technical interview?📈 Engineering Growth | 📝 Interview Prep | 💻 C...
Nscale loses $1.02bn in six months on the road to a NYSE listing: Contracts worth $103.4bn tie the AI cloud supplier to ...
Nscale loses $1.02bn in six months on the road to a NYSE listing: Contracts worth $103.4bn tie the AI cloud supplier to Microsoft and Anthropic. The $44.6bn Anthropic build still l...
Anthropic lanza los nuevos modelos Claude Fable y Mythos 5.2Anthropic ha anunciado los modelos Claude Fable 5.2 y Claude...
Anthropic lanza los nuevos modelos Claude Fable y Mythos 5.2Anthropic ha anunciado los modelos Claude Fable 5.2 y Claude Mythos 5.2, que según la empresa están diseñados para afron...