StochasticWeightAverage¶
- class mmengine.model.StochasticWeightAverage(model, interval=1, device=None, update_buffers=False)[源代码]¶
Implements the stochastic weight averaging (SWA) of the model.
Stochastic Weight Averaging was proposed in Averaging Weights Leads to Wider Optima and Better Generalization, UAI 2018. by Pavel Izmailov, Dmitrii Podoprikhin, Timur Garipov, Dmitry Vetrov and Andrew Gordon Wilson.
- avg_func(averaged_param, source_param, steps)[源代码]¶
Compute the average of the parameters using stochastic weight average.
- 参数:
averaged_param (Tensor) – The averaged parameters.
source_param (Tensor) – The source parameters.
steps (int) – The number of times the parameters have been updated.
- 返回类型:
None