611 articles tagged with Safety/Alignment
Reward hacking arises when a model improves a proxy reward by exploiting shortcuts rather than solving the intended task. We study this failure mode through the geometry of reinfor...
A small, hackable toolkit for probing multimodal LLMs — attention, hidden states, alignment, and causal tracing.
The draft AI safety executive order that Trump refused to sign was a voluntary framework requiring frontier AI companies to share models with the government 90 days before release....
Trump abruptly cancelled a planned AI safety executive order signing after top AI company CEOs declined to attend, according to reports. The move underscores ongoing uncertainty ov...
📰 Trump canceled AI safety testing EO after snub from tech CEOsTrump delays AI safety testing EO, claiming it would be an innovation “blocker.”📰 Source: Ars Technica🔗 Link: https:/...
Trump canceled AI safety testing EO after snub from tech CEOshttps://arstechnica.com/tech-policy/2026/05/trump-canceled-ai-safety-testing-eo-after-snub-from-tech-ceos/#AI #Policy #...
President Trump reportedly backed away from a major AI safety effort — and the decision could affect how tools like ChatGPT and Gemini evolve.
Camera-controlled video generation has achieved remarkable progress in recent years. However, existing video-to-video re-rendering methods primarily rely on Supervised Fine-Tuning ...
Generative priors in Image Super-Resolution (SR) often compromise faithful restoration, we attribute this limitation to a fundamental spectral misalignment between isotropic object...
If you're still testing LLM guardrails by hand — retyping variations in a chat tab, logging results...
Tech News News: The Trump administration is expected to release a new executive order focused on cybersecurity and artificial intelligence safety as early as this wee.
The conversation around AI safety often focuses on preventing harm, but we also need to understand the mechanisms. A new paper, "The Dynamics of Delusion," provides quantitative ev...
Direct Preference Optimization (DPO) has emerged as a popular alternative to Reinforcement Learning from Human Feedback (RLHF), offering theoretical equivalence with simpler implem...
Aligning Text-to-Image (T2I) generation models with human preferences increasingly relies on image reward models that score or rank generated images according to prompt alignment a...
Public LLM safety benchmarks lie about your real risk. Here's how to build a reproducible eval harness, write domain probes, and gate it in CI.
We present GoLongRL, a fully open-source, capability-oriented post-training recipe for long-context reinforcement learning with verifiable rewards (RLVR). Existing long-context RL ...
For practical use, diffusion- or flow-based generative models must be aligned with task-specific rewards, such as prompt fidelity or aesthetic preference. That alignment is challen...
Alignment pretraining: AI discourse creates self-fulfilling (mis)alignmenthttps://arxiv.org/abs/2601.10160#HackerNews #Tech #AI
The Oakland trial was a fight between two billionaires offering themselves as the guarantors of AI’s future. We deserve a better answer.
Claude pro free Mythos design Opus Cowork Sonnet AI Anthropic App: download free PC android apk iOS, Anthropic Claude API key setup, Claude roleplay mythos client, SillyTavern Clau...
📰 2026: MAGA Coalition Demands Trump Executive Order on Frontier AI Safety Testing & OversightA coalition of MAGA-aligned conservative organizations has issued an open letter urgin...
Import AI 457: AI stuxnet; cursed Muon optimizer; and positive alignment https://importai.substack.com/p/import-ai-457-ai-stuxnet-cursed-muon#AI #Cybersecurity #Research
Welcome to Import AI, a newsletter about AI research. Import AI runs on arXiv, cappuccinos, and feedback from readers. If you’d like to support this, please subscribe. Subscribe no...
📰 2026: MAGA Coalition Demands Mandatory AI Safety Tests from Trump AdministrationA coalition of conservative organizations has urged President Trump to mandate safety testing for ...