admin管理员组

文章数量:1550692

Errors: Warning: Grad strides do not match bucket view strides. This may indicate grad was not created according to the gradient layout contract, or that the param's strides changed since DDP was constructed. This is not an error, but may impair performance.

 今天在使用mmdet3d进行多卡训练时显示梯度尺度与桶步伐不匹配问题,github上逛了一圈发现可能是由于transpose()、permute()以及view()等操作导致tensor内存不连续,在所有变换操作后使用.contiguous()方法即可解决该问题。

github issue :  https://github/pytorch/pytorch/issues/21819

本文标签: stridesGradwarningViewBucket