Repeatedly called language models “Grandpa Shelby” on my podcast The Last Enclosure. What do I mean?It's a clunky metaphor from my first blog post on LLMs at @index. Breaks down into three parts:1. Anterograde amnesia (Leonard Shelby from Christopher Nolan’s Memento, no memory beyond the moment)2. Savantism (via capturing high level regularities use plus reasoning traces in language)3. Dementia (unreliable retrieval of associations formed in training)#LLMs #AI #machinelearning #tech
Repeatedly called language models “Grandpa Shelby” on my podcast The Last Enclosure. What do I mean?It's a clunky metaph...
