Shortcuts

PolyMomentum

class mmengine.optim.PolyMomentum(optimizer, *args, **kwargs)[源代码]

Decays the momentum of each parameter group in a polynomial decay scheme.

Notice that such decay can happen simultaneously with other changes to the parameter value from outside this scheduler.

参数:
  • optimizer (Optimizer or OptimWrapper) – optimizer or Wrapped optimizer.

  • eta_min (float) – Minimum momentum at the end of scheduling. Defaults to 0.

  • power (float) – The power of the polynomial. Defaults to 1.0.

  • begin (int) – Step at which to start updating the parameters. Defaults to 0.

  • end (int) – Step at which to stop updating the parameters. Defaults to INF.

  • last_step (int) – The index of last step. Used for resume without state dict. Defaults to -1.

  • by_epoch (bool) – Whether the scheduled parameters are updated by epochs. Defaults to True.

  • verbose (bool) – Whether to print the value for each update. Defaults to False.