Shortcuts

mmengine._strategy

BaseStrategy

Base class for all strategies.

SingleDeviceStrategy

Strategy for single device training.

DDPStrategy

Distribution strategy for distributed data parallel training.

DeepSpeedStrategy

Support training models with DeepSpeed.

FSDPStrategy

Support training model with FullyShardedDataParallel (FSDP).

ColossalAIStrategy

param config:

(str or dict): The colossalai config file to setup distributed

MMDeepSpeedEngineWrapper

DeepSpeedOptimWrapper

ColossalAIOptimWrapper

OptimWrapper for ColossalAI.

Read the Docs v: latest
Versions
latest
stable
v0.10.3
v0.10.2
v0.10.1
v0.10.0
v0.9.1
v0.9.0
v0.8.5
v0.8.4
v0.8.3
v0.8.2
v0.8.1
v0.8.0
v0.7.4
v0.7.3
v0.7.2
v0.7.1
v0.7.0
v0.6.0
v0.5.0
v0.4.0
v0.3.0
v0.2.0
Downloads
epub
On Read the Docs
Project Home
Builds

Free document hosting provided by Read the Docs.