Skip to content

训练过程中显存占满,验证时出现out of memory #12370

Open
@SwustLiC

Description

@SwustLiC

Image
如图,在训练一定次数后,进行验证时,模型突然爆出out of memory,之前验证都是正常的,为什么会突然显存暴增导致训练出错

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions