Quoting A member of Anthropic’s alignment-science team
The point of the blackmail exercise was to have something to describe to policymakers—results that are visceral enough to land with people, and make misalignment risk actually sali...
#Safety/Alignment
195 articles tagged with Safety/Alignment
Representation Alignment for Just Image Transformers is not Easier than You Think
Representation Alignment (REPA) has emerged as a simple way to accelerate Diffusion Transformers training in latent space. At the same time, pixel-space diffusion transformers such...
tongjingqi/AI-Can-Learn-Scientific-Taste: We propose Reinforcement Learning from Community Feedback (RLCF), a training paradigm that uses large-scale community signals as supervision, and formulate scientific taste learning as a preference modeling and alignment problem.
We propose Reinforcement Learning from Community Feedback (RLCF), a training paradigm that uses large-scale community signals as supervision, and formulate scientific taste learnin...