Submitted by Yuqian Fu 18 Revisiting On-Policy Distillation: Empirical Failure Modes and Simple Fixes Institute of Automation,chinese academy of science 56 2