Score Centering Stabilizes Off-Policy Reinforcement Learning” Small mismatches between the model generating rollouts and the model being trained

@askalphaxiv reports Score Centering Stabilizes Off-Policy Reinforcement Learning” Small mismatches between the model generating rollouts and the model being trained. The linked source contains the original context.