Researchers found that "Fable 5 would quietly reroute requests to a lesser model when asked to perform certain actions. ...

Researchers found that "Fable 5 would quietly reroute requests to a lesser model when asked to perform certain actions. Moreover, that restriction wasn't disclosed in the model's documentation." The model "was either refusing or degrading responses for tasks like training competing LLMs, debugging AI code and optimizing neural architecture. Researchers were bothered not only by that degradation but by Anthropic's lack of transparency about it. They were also concerned, of course, that they had burned tokens and money for a model that didn't do what they expected."Engadget: Anthropic backtracks on policy that 'sabotaged' researchers' work https://www.engadget.com/2192004/anthropic-walks-back-policy-sabotaging-research/ @Engadget #Anthropic #LLM

Read Original

Related