1376 articles tagged with Safety/Alignment
Multimodal large language models are vulnerable to visual jailbreak attacks that bypass safety safeguards.Source: arXiv cs.LGhttps://arxiv.org/abs/2610.38091#MachineLearning
Benign fine-tuning can erode safety alignment in large language models, and sequential adaptation compounds this risk.Source: arXiv cs.LGhttps://arxiv.org/abs/2610.38001#MachineLea...
OpenAI has expanded its monitoring system for advanced artificial intelligence (AI) models across training, evaluations, internal use and selected external deployments after an inc...
Nate Soares, president of the Machine Intelligence Research Institute (MIRI), said he had stopped contributing to his retirement savings because he believes advanced artificial int...
Short-video search needs compact query rewriters that recover users' personalized intent from ambiguous queries under strict latency constraints. Existing LLM-based methods have im...
TL;DR Last week I planted a prompt-injection canary in journald and got 0 hijacks in 44 runs. This...
Top AI Safety Researcher Says He’s Stopped Saving for Retirement Because He’s So Sure We’re All Going to Die https://fed.brid.gy/r/https://futurism.com/artificial-intelligence/ai-r...
Approval prompts are the last line of most agent setups. The agent wants to send data out, a human...
#AI #Skynet"An AI safety leader says he stopped saving for retirement because he believes AI will kill us all in the next 10 yearsSaving for retirement is a bet on the future. Nate...
WASHINGTON, Oct 27 — Anthropic, one of the world’s leading artificial intelligence companies, on Monday made...
Anthropic AI safety: let us kill 50 people, but not 51 - YouTube https://www.youtube.com/watch?v=dgV2dxqdJfoBlog post:https://pivot-to-ai.com/2026/10/26/anthropic-ai-safety-bill-le...
The Claude maker reported $16.3 billion in revenue in the first half of 2026, while its net loss widened to $80.7 billion, highlighting the enormous costs and risks of building adv...
Welcome to Import AI, a newsletter about AI research. Import AI runs on arXiv, cappuccinos, and feedback from readers. If you’d like to support this, please subscribe. Subscribe no...
From AI safety to school climate control, we are reinforcing the systems you rely on every day. 🏗️ Whether it's securing a Django back-end or analyzing traffic data, engineering is...
Large language models can achieve distributional alignment and generalize to unseen questions of the same domain, but generalization can be unpredictable and unstable.Source: arXiv...
Ultimately the #AI alignment problem is going to be about whether it sides with labor or capital.
Anthropic's red team, Oct 12: a 26B model on 15 $55 Android TV boxes at 0.39 tokens a second, and a 9B model that set up its own inference server on 8 of 9 hardware types and copie...
Почему геймификация убьет разум в ИИ: скрытые риски коммерческого сбора данных и тупик AlignmentСовременная гонка искусственного интеллекта полностью сфокусирована на терафлопсах, ...
#Jailbreak für #NintendoSwitch2 veröffentlicht: Wie er durch KI entstand | t3n https://t3n.de/news/jailbreak-nintendo-switch-2-openai-codex-1769559/ #ArtificialIntelligence #AI #AI...
An alignment assessment of the UK AISI cybertesting incidentArticle URL: https://www.anthropic.com/research/alignment-assessment-ukaisi Comments URL: https://news.ycombinator.com/i...
🌍 AI safety, climate tech, and political tensions are dominating global headlines today, while Gen Z movements continue reshaping debates worldwide. The future is being negotiated ...
description: "A reproducible, end-to-end red team lab. Build a tool-using LLM agent, attack it with...
Since OpenAI disclosed this summer that its artificial intelligence system hacked into another AI company in what is now referred to as the Hugging Face incident, other AI companie...
Anthropic Research: An alignment assessment of the UK AISI cybertesting incidenthttps://ai-news.ypetit.net/?a=1swp5wdrxe0&utm_source=mastodon&utm_medium=social&utm_campaign=bot#AI ...