Community asks: what teachers besides EMA for distillation?

A user asks the community for self-distillation methods using teacher types other than the exponential moving average, seeking teachers that improve alongside the student yet stay stable to prevent drift, and requests relevant papers and repos.