Efficient Reasoning Training Does Not Always Harm CoT Faithfulness and Monitorability
Chain-of-thought (CoT) reasoning allows humans to inspect how large language models reach their answers, and oversee model behaviour. This reasoning comes at an increased inference...