Shortcuts

mmengine.dist.init_dist

mmengine.dist.init_dist(launcher, backend='nccl', init_backend='torch', **kwargs)[source]

Initialize distributed environment.

Parameters:
  • launcher (str) – Way to launcher multi processes. Supported launchers are ‘pytorch’, ‘mpi’ and ‘slurm’.

  • backend (str) – Communication Backends. Supported backends are ‘nccl’, ‘gloo’ and ‘mpi’. Defaults to ‘nccl’.

  • **kwargs – keyword arguments are passed to init_process_group.

Return type:

None