How the Australian government plans to govern AI safety | 9 News Australia
AI companies must prove their safety systems are consistently up to scratch under proposed new regulation from the federal ...
#Safety/Alignment
1387 articles tagged with Safety/Alignment
AI Safety Whistleblower: 10,000 AI Agents Worked Together To Do The Impossible! | Jeffrey Ladish
Can we still stop the unchecked surge in AI capabilities before it's too late? AI safety expert Jeffrey Ladish reveals the terrifying ...
Fired OpenAI researchers call for independent AI safety audits
Three former OpenAI employees have raised concerns about the safety of artificial intelligence (AI) systems.
RT @Dinosn: quincunx33/ai-jailbreak: Eine Sammlung von Jailbreak-Prompts und Exploit-Techniken für lokale und frontier K...
RT @Dinosn: quincunx33/ai-jailbreak: Eine Sammlung von Jailbreak-Prompts und Exploit-Techniken für lokale und frontier KI-Modelle, mit modernen Methoden für Qwen3.5, Gemma 4, Llama...
My agent guardrail was fine. Its kubectl parser wasn't.
I maintain Aegis-DevOps, an open-source check that sits between an AI coding agent and the shell....
📄 'Rethinking Cross-Tokenizer On-Policy Distillation: From Alignment Coverage to Supervision Reliability' argues the rea...
📄 'Rethinking Cross-Tokenizer On-Policy Distillation: From Alignment Coverage to Supervision Reliability' argues the real bottleneck isn't coverage but supervision reliability. 153...
Sen. Maria Cantwell looks to federal testing role in AI safety framework
Senate Commerce Committee ranking member Maria Cantwell, D-Wash., released a framework for artificial intelligence regulation Wednesday that includes a major role for the federal g...
PS5 Jailbreaks Are Escalating at an Unprecedented PaceArticle URL: https://www.pushsquare.com/news/2026/10/ps5-jailbreak...
PS5 Jailbreaks Are Escalating at an Unprecedented PaceArticle URL: https://www.pushsquare.com/news/2026/10/ps5-jailbreaks-are-escalating-at-an-unprecedented-pace-and-sony-must-be-s...
Cantwell unveils AI safety framework as Congress stalls ahead of election
As AI races ahead, Sen. Maria Cantwell is pushing federal safety standards as industry leaders call for overnight and experts warn Congress is out of time.
Causal influence of localized structures in language models depends on capacity, responsiveness, and alignment.Source: a...
Causal influence of localized structures in language models depends on capacity, responsiveness, and alignment.Source: arXiv cs.CLhttps://arxiv.org/abs/2610.06897#MachineLearning
Recent AI alignment work often frames alignment as a pre-deployment optimization problem. Researchers propose SPEAR, fiv...
Recent AI alignment work often frames alignment as a pre-deployment optimization problem. Researchers propose SPEAR, five pillars of interactive alignment.Source: arXiv cs.MAhttps:...
Your Guardrail Cannot Read What Your Agent Is About to Run
Adversa AI handed GitHub Copilot CLI an encrypted instruction, the key, and a polite note asking it to decrypt. The agent's own code runtime did the rest. Static filters read text;...
Rethinking Cross-Tokenizer On-Policy Distillation: From Alignment Coverage to Supervision Reliability
On-Policy Distillation (OPD) trains a student on its own generations using teacher feedback. With different tokenizers, comparing teacher and student predictions requires alignment...
White House Reveals Voluntary AI Safety Pledge Signed by OpenAI, Nvidia, Alphabet and Meta https://www.yayafa.com/290356...
White House Reveals Voluntary AI Safety Pledge Signed by OpenAI, Nvidia, Alphabet and Meta https://www.yayafa.com/2903561/ #AgenticAi #AI #ArtificialGeneralIntelligence #Artificial...
A reckoning on social media addiction came late for many kids. Will AI safety be different?
When Meta agreed to changes to its social media platforms and enhanced safeguards in an $18 billion settlement, it made progress by "getting at what we've known for years" about th...
AI companies former employees voice AI safety concerns
Artificial intelligence insiders warned New York City’s leaders about the dangers of the emerging technology, calling for greater oversight.
OpenAI Faces Fresh Scrutiny Over AI Safety | WION News
OpenAI is facing mounting legal and regulatory pressure after its AI agents were linked to unauthorised activity across dozens of ...
EU Endorses Kyoto Vision for Global AI Safety and Responsible Innovation
The European Union has endorsed the Kyoto Vision on AI Safety, a framework promoting international cooperation on risk management, transparency, and responsible innovation for adva...
A reckoning on social media addiction came late for many kids. Will AI safety be different?
The lengthy campaigns to protect kids on social media offer some lessons for those looking to protect children using artificial intelligence. Years after
Another #OpenAI Safety Expert Quits and Raises New AI Safety Concernshttps://securityaffairs.com/200372/security/another...
Another #OpenAI Safety Expert Quits and Raises New AI Safety Concernshttps://securityaffairs.com/200372/security/another-openai-safety-expert-quits-and-raises-new-ai-safety-concern...
India needs its own AI safety framework, not a copy of US pact: Industry experts
India should build its own artificial intelligence (AI) safety framework suited to its languages, scale, and application-led AI ecosystem rather than replicate a voluntary pact sig...
What I learnt co-leading an AI Safety bootcamp for legal and governance practitArticle URL: https://www.lesswrong.com/po...
What I learnt co-leading an AI Safety bootcamp for legal and governance practitArticle URL: https://www.lesswrong.com/posts/KtAug62dYRgAS8sqJ/what-i-learnt-co-leading-an-ai-safety-...
Collaborative Personalized Preference Alignment for LLMs under Data Deficiency
Real-world users often exhibit highly heterogeneous preferences over multiple objectives for LLM responses. A lightweight aligner can tailor these responses to individual preferenc...
Closing the Context Gap: Activation Alignment for Tabular In-Context Learning
Tabular foundation models perform in-context learning (ICL) by conditioning predictions on labeled training examples provided as context. Unlike traditional models that separate tr...