Asynchronous sampling in LLM reinforcement learning creates a training-inference mismatch. Engine numerics and stale weights turn assumed on-policy data into off-policy training samples. #MachineLearning #LLM #ReinforcementLearning
Asynchronous sampling in LLM reinforcement learning creates a training-inference mismatch. Engine numerics and stale wei...
