PIVOT: Progressive Intervention via Online Teacher Correction