Here’s a #mathematics problem that I think won’t be solved anytime soon: “when is an llm able to do the inference ‘make ...

Here’s a #mathematics problem that I think won’t be solved anytime soon: “when is an llm able to do the inference ‘make a todo app’ -> ‘code for a todo app’, and when is it not?” Or the corollary “is this model able to make a todo app?”. Or “given ‘a todo app’, what is the code that is going to come out?”Mechanical interpretability approached formally and not empirically is kind of “why does this kind of model seem to be able to generalize to modulo addition after x rounds of training” (arguably empirical too).Now remove “llm” from the equation and replace it “autoregressive symbol processing with attention”. Challenging enough?An #llm / #llms isn’t going to spit out the solution to that anytime soon, I’m reasonably certain.Here’s another one: given this architecture/model M and this task formulation A, will a RL training run with a policy P be able to improve M to reach a certain success rate on A, and how much? What symbols will said trained child model produce when given the input A...

Read Original

Related

Mastodon discussion 27m ago

この大事な時期にMozcに巻き込まれて被弾でもしたら……Google日本語入力が不満な人へ、Windows/Mac対応国産ソフト「もずきー」登場。遅延付きライブ変換とAI文脈補正を搭載、使うほど学習し自分好みに(生成AIクローズアップ) h...

この大事な時期にMozcに巻き込まれて被弾でもしたら……Google日本語入力が不満な人へ、Windows/Mac対応国産ソフト「もずきー」登場。遅延付きライブ変換とAI文脈補正を搭載、使うほど学習し自分好みに(生成AIクローズアップ) https://www.techno-edge.net/article/2026/11/17/5737.html#Appl...

Mastodon discussion 27m ago

ビリーさんはプリムさんにiPhoneのことを話すでしょうかPrimary Vector、Winampスキンが利用可能なiPhone用ミュージックプレイヤーアプリ「golden」をリリース https://www.macotakara.jp/...

ビリーさんはプリムさんにiPhoneのことを話すでしょうかPrimary Vector、Winampスキンが利用可能なiPhone用ミュージックプレイヤーアプリ「golden」をリリース https://www.macotakara.jp/iphone_app_store/entry-52359.html#Apple #LLM #news #bot