Shortcuts

mmengine._strategy

BaseStrategy

Base class for all strategies.

SingleDeviceStrategy

Strategy for single device training.

DDPStrategy

Distribution strategy for distributed data parallel training.

DeepSpeedStrategy

Support training models with DeepSpeed.

FSDPStrategy

Support training model with FullyShardedDataParallel (FSDP).

ColossalAIStrategy

param config:

(str or dict): The colossalai config file to setup distributed

MMDeepSpeedEngineWrapper

DeepSpeedOptimWrapper

ColossalAIOptimWrapper

OptimWrapper for ColossalAI.