mmengine.model.convert_sync_batchnorm¶
- mmengine.model.convert_sync_batchnorm(module, implementation='torch')[source]¶
Helper function to convert all BatchNorm layers in the model to SyncBatchNorm (SyncBN) or `mmcv.ops.sync_bn.SyncBatchNorm`(MMSyncBN) layers. Adapted from <https://pytorch.org/docs/stable/generated/torch.nn.Sy ncBatchNorm.html#torch.nn.SyncBatchNorm.convert_sync_batchnorm>_.
- Parameters
module (nn.Module) – The module containing SyncBatchNorm layers.
implementation (str) –
The type of SyncBatchNorm to convert to.
’torch’: convert to torch.nn.modules.batchnorm.SyncBatchNorm.
’mmcv’: convert to mmcv.ops.sync_bn.SyncBatchNorm.
- Returns
The converted module with SyncBatchNorm layers.
- Return type
nn.Module