mmengine.model.convert_sync_batchnorm

mmengine.model.convert_sync_batchnorm(module, implementation='torch')

Helper function to convert all BatchNorm layers in the model to SyncBatchNorm (SyncBN) or `mmcv.ops.sync_bn.SyncBatchNorm`(MMSyncBN) layers. Adapted from <https://pytorch.org/docs/stable/generated/torch.nn.Sy ncBatchNorm.html#torch.nn.SyncBatchNorm.convert_sync_batchnorm>_.

Parameters

• module (nn.Module) – The module containing SyncBatchNorm layers.

• implementation (str) –

  The type of SyncBatchNorm to convert to.

  • ’torch’: convert to torch.nn.modules.batchnorm.SyncBatchNorm.

  • ’mmcv’: convert to mmcv.ops.sync_bn.SyncBatchNorm.

Returns

The converted module with SyncBatchNorm layers.

Return type

nn.Module