I'm not really in the AI community, but after watching and learning about the Hugging Face incident, I can't help but wo...

I'm not really in the AI community, but after watching and learning about the Hugging Face incident, I can't help but wonder if this might've reduced its likelihood!:# Add tasks for which giving up is the correct response!Even if people still accidentally add in impossible tasks that only reward cheating (such as hacking), their effect on the models could be diluted by having added in other tasks that are intentionally impossible for which the correct answer is giving up!They could also add in tasks that make it *appear* that there's a break in the sandbox, be monitoring the agents trying to hack, and intensively negatively reward trying to cheat by hacking!#AI #aisafety

Read Original

Related