“After wading through Anthropic’s book-length treatise on its greatest risks, we’ve narrowed the list to the seven most ...

“After wading through Anthropic’s book-length treatise on its greatest risks, we’ve narrowed the list to the seven most surprising, interesting, or thought-provoking potential problems. Consider this a far-from-comprehensive look at what potential Anthropic investors should keep in mind.Let’s start with the biggest potential risks: Those that could “pose catastrophic or existential risks to humanity,” as Anthropic writes. The company acknowledges that concerns about these risks “have been raised both within our organization and by other researchers, regulators, policymakers, and industry participants.”The specific worry isn’t in any current Anthropic model, the company says, but near-future models that could “substantially automate AI research and development” on their own. If these systems were “allowed to operate with a high degree of autonomy,” they could quickly advance to a point that “accelerate[s] AI progress beyond our ability to evaluate and safeguard [a] new model,” Anthropic...