We end this section by further discussing the choice to use a "mode collapse guard" and why it is not just to make our method look more robust. The insights in this section are for transparency on our method but also positions the work for future integration with curriculum learning (CL) . In curriculum learning, a complex objective function is decomposed into simpler sequential tasks to accelerate the learning process. It may be advantageous to enforce pure exploitation for intermediate tasks as the objective is to learn as quickly as possible this task before moving to the successive task.