[AINews] Agents disprove Polysemanticity; greatly improve Interpretability & Alignment
Nick Cammarata out of nowhere with some major claims!
#Safety/Alignment
1385 articles tagged with Safety/Alignment
[AINews] Agents disprove Polysemanticity; greatly improve Interpretability & Alignment
Nick Cammarata out of nowhere with some major claims!
Australia putting ‘nothing’ into AI safety despite unknown threats: expert
Further pressure has been piled on the Albanese government to ramp up funding for the AI Safety Institute, accused of putting “nothing” into the body compared to other equivalent b...
FTC Reportedly Probes AI Safety #ainews #ai #openai #artificialintelligence #anthropic
OpenAI and Anthropic are under federal scrutiny! The Federal Trade Commission (FTC) has reportedly subpoenaed two of the ...
Australia’s AI Safety Institute doesn’t have resourcing ‘to be taken seriously’ internationally, experts warn
Australia’s AI Safety Institute doesn’t have the level of resourcing ‘to be taken seriously’ internationally, artificial intelligence experts have told a parliamentary inquiry.
FTC Launches Probe into OpenAI and Anthropic Over AI Safety Claims
The FTC has issued civil investigative demands to OpenAI and Anthropic, seeking extensive records on AI safety testing, risk management, deployment decisions, and public statements...
An independent AI safety research group will soon get staff-level visibility into Anthropic's internal operations, with ...
An independent AI safety research group will soon get staff-level visibility into Anthropic's internal operations, with full freedom to publish what it finds — including anything u...
CNBC: SpaceX agrees to testify to NYC Council about AI safety after receiving subpoena. “SpaceX has agreed to testify be...
CNBC: SpaceX agrees to testify to NYC Council about AI safety after receiving subpoena. “SpaceX has agreed to testify before the New York City Council this week as part of a legisl...
NYC Comptroller Calls for Anthropic to Pause IPO for AI Safety
Anthropic PBC should pause its initial public offering until it has fully addressed risks around the safety, governance and pace of development of artificial intelligence, accordin...
China's ByteDance sets up AI safety team, launches global hiring drive
In a proactive move to address concerns surrounding artificial intelligence safety, ByteDance's AI research division, Seed, is assembling a dedicated Alignment & Preparedness team....
A pattern for AI audit trails that keeps privacy and proof apart: don't make the guardrail layer store prompts and compl...
A pattern for AI audit trails that keeps privacy and proof apart: don't make the guardrail layer store prompts and completions. Per request, record validator verdicts in order, rul...
Nvidia's Jensen Huang says US & China must work together for AI safety
Nvidia CEO Jensen Huang says the US and China must work together to advance AI safely, because the technology is "powerful ...
📰 AI Controls iPhone Via ESP32Do you want to get an AI agent to do something to an iPhone? You could try and jailbreak t...
📰 AI Controls iPhone Via ESP32Do you want to get an AI agent to do something to an iPhone? You could try and jailbreak the device and do some heavy software hacking, or… you could ...
Nvidia pledges $250 million in computing resources to boost UK AI safety research
U.S. chipmaker Nvidia has pledged $250 million worth of computing resources to Britain over five years to support artificial intelligence safety research, backing the country’s amb...
EVA-Cap: Optimizing Audiovisual Video Captioning via Event-Centric Alignment
Recent advances in Omni Language Models (OLMs) provide a unified solution for audiovisual video captioning. Nevertheless, existing approaches predominantly treat captioning as an u...
Mine, Sample, Render: Test-Time Diversity Alignment Of Generative Models
Modern generative models produce high-quality individual outputs but struggle to sample diversely, even when explicitly instructed to do so. We introduce MINE-SAMPLE-RENDER (MSR), ...
Nvidia just pledged $250 MILLION toward AI safety research. #ainews #aivideo #ai #openai
Nvidia just pledged $250 MILLION toward AI safety research. But there's a catch… it's not cash. It's computing resources for ...
Anthropic opens Singapore office, signs AI safety pact with government
The Claude maker now offers in-region inference for firms with strict data residency rules in the city-state, where GovTech, Grab and DBS are already using its models
AI News: Square’s Voice Ordering, AI Safety Gaps and Medical Models
AI voice ordering, safety benchmarks, weather research, grid planning, workplace agents and medical and education tools, ...
Nvidia allocates $250 million for AI safety research in the United Kingdom
US chipmaker Nvidia announced on Wednesday that it will provide researchers in the United Kingdom with computing resources worth $250 million over the next five years to support pr...
Kamala Harris Warns of Narrowing Window for AI Safety Safeguards
Kamala Harris warns that the window to establish safeguards for artificial intelligence is narrowing, raising fresh questions about ...
Advocates for AI safety and regulation are emerging as a force in U.S. elections, spending nearly $50 million this elect...
Advocates for AI safety and regulation are emerging as a force in U.S. elections, spending nearly $50 million this election cycle on candidates who favor regulation, a new analysis...
Anthropic opens office in Singapore, partners with government on AI safety and adoption
Artificial intelligence (AI) company Anthropic has opened a new office in Singapore and signed a memorandum of understanding (MoU) with the country's Ministry of Digital Developmen...
What Happens When You Jailbreak AI With Poetry
I tried to break an AI with a sonnet. It worked. I didn't start with code. I started with...