OnPoKD introduces the first on‑policy distillation framework for adapting vision‑language models, learning a lightweight controller that builds sample‑wise adaptive targets from reliability and disagreement cues.
Previous methods used a fixed teacher‑prediction target, which can fail under class or domain shift. OnPoKD treats target construction as a dynamic policy decision, allowing per‑sample adaptation. The controller remains lightweight, enabling efficient training on low‑quality multimodal data. This approach aims to improve adaptation robustness without increasing model size.




