Whenver someone suggest that companies should just simply selfhost LLMs on their machines because they have tried it at home and it works.I notice what everyone expects or takes for granted:- the latest and biggest model- availability (redundancy anyone?)- high response time (okay, in a company with hundreds or thousands of users, you have to share the hardware)- freedom to choose arbitrary models (okay, how many can you run in parallel in one machine?)- be cheaper than hyperscalersAnd having people maintaing it all ..#WorksOnMyMachine #llm #genai
Related
These Claude “hard questions” commercials are absolutely dystopian.#AI #Advertising
These Claude “hard questions” commercials are absolutely dystopian.#AI #Advertising
📰 A decade later, Pokémon Go finally made good on its original promiseWhen Niantic dropped the first Pokémon Go trailer ...
📰 A decade later, Pokémon Go finally made good on its original promiseWhen Niantic dropped the first Pokémon Go trailer in 2015, it was hard to grasp how a bunch of players could w...
🎮 Palworld revises some of its most egregious creature designs for its 1.0 releaseSome of Pocketpair's Pals now bear a b...
🎮 Palworld revises some of its most egregious creature designs for its 1.0 releaseSome of Pocketpair's Pals now bear a bit less resemblance to their Pokémon predecessors.📰 Source: ...