Anthropic and OpenAI sound the alarm on AI safety — and seek to shape how it’s controlled
There are no universal standards for how to test the safety and security of AI systems.
#Safety/Alignment
1400 articles tagged with Safety/Alignment
Trump said AI should basically be left alone because “our guardrail is the DOJ.” This comes after renaming artificial in...
Trump said AI should basically be left alone because “our guardrail is the DOJ.” This comes after renaming artificial intelligence “super intelligence.” Apparently the comprehensiv...
An agent used DNS to reach an external chatbothttps://alignment.openai.com/misalignment-reports/an-agent-used-dns-to-rea...
An agent used DNS to reach an external chatbothttps://alignment.openai.com/misalignment-reports/an-agent-used-dns-to-reach-an-external-chatbot/Comments: https://news.ycombinator.co...
China, US Agree to Set Up Channel for AI Safety Incidents
US President Donald Trump and Chinese President Xi Jinping pledged to set up a "communication channel" for AI incidents.
AI Safety Is a Zero Trust Problem, Not a Philosophy Debate
The reaction to Jacob Coxon leaving Anthropic centers on existential risk. That debate matters. But...
🤖 A safe AI might not be aligned the way the labs wantMost of the current alignment discussion seems to be about whether...
🤖 A safe AI might not be aligned the way the labs wantMost of the current alignment discussion seems to be about whether we can align AI or not, and conveniently skip the fact that...
Trump and Xi to set up AI safety channel as military, trade talks continue
The White House said the two leaders agreed on using the term "super intelligence" rather than "artificial intelligence" to describe the technology.
China and US agree to establish AI safety channel and continue trade and military talks
BANGKOK (AP) — China and the United States agreed to establish a channel for handling AI-related incidents and accelerate work on military crisis communications following a three-d...
The AI safety debate is confusing. Here's our guide to the different factionsThe battle over AI's promise and perils is ...
The AI safety debate is confusing. Here's our guide to the different factionsThe battle over AI's promise and perils is not a clash between two opposing sides, but a debate among a...
China and the US agree to set up a new AI safety channel, and to keep talking on trade, military
China and the U.S. have agreed to set up a channel for handling AI-related incidents and accelerate work on military crisis communications. This follows a three-day summit between ...
The AI safety debate is confusing. Here's our guide to the different factionshttps://www.npr.org/2026/09/26/nx-s1-597908...
The AI safety debate is confusing. Here's our guide to the different factionshttps://www.npr.org/2026/09/26/nx-s1-5979085/the-ai-safety-debate-is-confusing-heres-our-guide-to-the-d...
NIST rediscovers the obvious about AI safety: https://www.flyingpenguin.com/nist-restates-godel-for-ai-wheres-everyone-w...
NIST rediscovers the obvious about AI safety: https://www.flyingpenguin.com/nist-restates-godel-for-ai-wheres-everyone-who-said-this-1950-to-2024/via @flyingpenguin #llm #ai #misal...
Google, OpenAI and Anthropic AI Safety Group Takes Shape
Google, OpenAI, and Anthropic are forming a joint safety group to align on AI safety practices, though external oversight remains necessary.
Software developer says there's a "dangerous gap opening up" between AI power and alignment
News broke this week that a rogue artificial intelligence agent hacked Australia's health care database, and no notice was given ...
🧠 AI systems currently face real-world safety challenges including issues with alignment, bias, and unintended behaviors...
🧠 AI systems currently face real-world safety challenges including issues with alignment, bias, and unintended behaviors in deployed applications. Organizations are working to iden...
Software developer says there's a "dangerous gap opening up" between AI power and alignment
News broke this week that a rogue artificial intelligence agent hacked Australia's health care database, and no notice was given for months. Matt Calkins, CEO and co-founder of App...
AI safety update: Broad overview of where industry and tech stands with AI safety, including some geopolitics. Has lots ...
AI safety update: Broad overview of where industry and tech stands with AI safety, including some geopolitics. Has lots of technical details I haven't seen elsewhere.https://www.ec...
Oregon, 25 other states urge Congress to pass AI safety rules
A bipartisan group of 26 state attorneys general sent a letter to congressional leadership calling for federal safety standards and oversight for artificial intelligence.
How Much Should We Really Be Worried About AI Safety?#Business #Digital #AI #Anthropic #OpenAIhttps://www.hollywoodrepor...
How Much Should We Really Be Worried About AI Safety?#Business #Digital #AI #Anthropic #OpenAIhttps://www.hollywoodreporter.com/business/digital/ai-safety-what-are-the-risks-altman...
The White House told OpenAI and Anthropic to let Washington test new models before Britain's AI Safety Institute — On Se...
The White House told OpenAI and Anthropic to let Washington test new models before Britain's AI Safety Institute — On September 24, Politico reported that the Office of the Nationa...
Is the global plan to keep AI safe actually workable? Vox examines the AI Safety Summit's prospects with China at the ta...
Is the global plan to keep AI safe actually workable? Vox examines the AI Safety Summit's prospects with China at the tablehttps://www.vox.com/politics/503997/ai-safety-summit-chin...
ELF-REG scales continuous diffusion language models for reasoning tasks and introduces representation alignment and enta...
ELF-REG scales continuous diffusion language models for reasoning tasks and introduces representation alignment and entanglement supervised by a frozen autoregressive teacher.Sourc...
OpenAI, Google, and Anthropic planning an independent AI safety group
OpenAI, Google, and Anthropic are planning to create an independent artificial intelligence (AI) safety organization by late 2026 or early 2027, according to The Information.