Today's development: The #Bazzite based #Steam box is now able to serve LLMs using its GPU when no one is gaming. A plug...

Today's development: The #Bazzite based #Steam box is now able to serve LLMs using its GPU when no one is gaming. A plugin to my existing Remote Play user switcher Bazinga plus a small #LLM router named Conduct.The LLM behind the Computer! voice AI assistant is thus able to serve two users concurrently, unless someone starts a game where the secondary LLM is closed down immediately. Bazzite usage is exactly as before, the new functionality doesn't take anything away from the previous experience. Only adds to the total amount of idle GPUs available in a completely transparent manner.Conduct: https://git.sync.wtf/troed/conductBazinga: https://git.sync.wtf/troed/bazingaComputer!: https://git.sync.wtf/starfleet

Read Original

Related