Sam Altman calls it "quite terrible" that consumers own DRAM sitting idle most of the time while AI data centres compete...

Sam Altman calls it "quite terrible" that consumers own DRAM sitting idle most of the time while AI data centres compete for the same constrained supply. His answer is maximum utilisation in the cloud, meaning paying OpenAI for compute. With 750 billion USD of infrastructure spending planned through 2030, 32GB DDR5 is unlikely to get cheaper. https://gizmodo.com/sam-altman-all-the-ram-should-belong-to-me-so-i-can-charge-people-to-use-it-2000833412 #AI #AIinfra #GenAI

Read Original

Related

Mastodon discussion 30m ago

Пространственное внимание на RTX 3050: эксперимент с контекстом 16KМожно ли ускорить обучение небольшой языковой модели ...

Пространственное внимание на RTX 3050: эксперимент с контекстом 16KМожно ли ускорить обучение небольшой языковой модели на длинных последовательностях, если заменить полное внимани...