AC2 trains language models with partial rollouts by trusting a learned critic over token chunks

Kaiyue Wen and coauthors propose Actor-Critic with Action Chunking, which scores chunks of tokens with a critic so RL training needs only partial rollouts and runs faster than GRPO.