New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

910A训练yolov8，损失为0 #343

Open

Calylyli opened this issue Aug 21, 2024 · 3 comments

Calylyli commented Aug 21, 2024

1.Describe the current behavior / 问题描述 (Mandatory / 必填)

Modelart训练mindyolo中yolov8模型loss损失启动可能会是0，然后输出一直是0，有可能会是20多w损失，但训练不了

2.Environment / 环境信息 (Mandatory / 必填)

Hardware Environment / 硬件环境(Mandatory / 必填):Ascend910A，Modelart服务器

后端类型	硬件具体类别
Ascend	910A

Software Environment / 软件环境 (Mandatory / 必填):MindSpore 2.2.14

|Mindspore | MindSpore 2.2.14|
|Mindyolo | mindyolo-0.3.0|
|CANN | CANN-7.0.1.1|
|Python | Python 3.9.10|
|GCC | GCC 9.4.0|
|OS platform|EulerOS 2.0(SP10)|

报错关键日志截图：

**【定位人】**李明辉

Salary-only-17k commented Aug 23, 2024

我训练loss直接爆炸了

m00nLi commented Nov 30, 2024

我训练的loss突然变为负数了，简直逆天

Collaborator

yuedongli1 commented Dec 2, 2024

可尝试设置overflow_still_update为False

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.

Alternative Proxies:

Alternative Proxy