apex新版貌似移除了amp，照当前megatron教程中的安装方式装的话，会在from apex import amp时报错

[KAKSIS]

RT
ImportError: cannot import name 'amp' from 'apex'

[Jintao-Huang]

NVIDIA/apex#1902

[Jintao-Huang]

You can resolve this by commenting out these two lines in the transformers trainer.py.

[Jintao-Huang]

Or install it using the following command to resolve the issue.

# apex
git clone https://github.com/NVIDIA/apex
cd apex
# https://github.com/modelscope/ms-swift/issues/4176
git checkout e13873debc4699d39c6861074b9a3b2a02327f92
pip install -v --disable-pip-version-check --no-cache-dir --no-build-isolation --config-settings "--build-option=--cpp_ext" --config-settings "--build-option=--cuda_ext" ./