mmengine.model.convert_sync_batchnorm

mmengine.model.convert_sync_batchnorm(module, implementation='torch')

Helper function to convert all BatchNorm layers in the model to SyncBatchNorm (SyncBN) or mmcv.ops.sync_bn.SyncBatchNorm (MMSyncBN) layers. Adapted from PyTorch convert sync batchnorm.

Parameters:

• module (nn.Module) – The module containing SyncBatchNorm layers.

• implementation (str) –

  The type of SyncBatchNorm to convert to.

  • ’torch’: convert to torch.nn.modules.batchnorm.SyncBatchNorm.

  • ’mmcv’: convert to mmcv.ops.sync_bn.SyncBatchNorm.

Returns:

The converted module with SyncBatchNorm layers.

Return type:

nn.Module