Steering vectors can guide parameter updates during LLM post-training. This approach improves over plain SFT and distill...

Steering vectors can guide parameter updates during LLM post-training. This approach improves over plain SFT and distillation, reaching up to a twelve percent improvement when distilling from thinking-mode teachers.Source: arXiv cs.LGhttps://arxiv.org/abs/2610.40998#MachineLearning

Read Original

Related