C500推理yolo onnx模型无结果

wxsdiscover
2026年3月25日
chat_bubble_outline 20
  • link
    Members 20 posts
    2026年3月25日 09:00
    link

    使用官方镜像
    cr.metax-tech.com/public-ai-release/maca/onnxruntime maca.ai3.1.0.5-torch2.4-py310-ubuntu22.04-amd64 2fac80e009f7 6 months ago 28.4GB

    安装ultralytics,修改了源码使其在调用onnx格式yolo模型，
    2026-03-24 19:08:43,090 - root - INFO - -----准备加载目标识别模型：/file_manage/models/train_weights/49b34b4427214d2bba0dd27dd7b01490.onnx
    2026-03-24 19:08:43,093 - root - INFO - -----加载目标识别模型成功
    Loading /file_manage/models/train_weights/49b34b4427214d2bba0dd27dd7b01490.onnx for ONNX Runtime inference...
    Using ONNX Runtime 1.12.0+git-a811f5a3 with MACAExecutionProvider

    使用CPU可以推理结果，同环境下-使用GPU推理的推理不出来
    2026-03-24 19:08:43,090 - root - INFO - -----准备加载目标识别模型：/file_manage/models/train_weights/49b34b4427214d2bba0dd27dd7b01490.onnx
    2026-03-24 19:08:43,093 - root - INFO - -----加载目标识别模型成功
    Loading /file_manage/models/train_weights/49b34b4427214d2bba0dd27dd7b01490.onnx for ONNX Runtime inference...
    Using ONNX Runtime 1.12.0+git-a811f5a3 with MACAExecutionProvider
    2026-03-24 19:08:55,020 - root - INFO - 第0张图片：未检测到任何目标
    2026-03-24 19:08:55,048 - werkzeug - INFO - 172.18.0.5 - - [24/Mar/2026 19:08:55] "POST /api/predict HTTP/1.1" 200 -

    使用5060也能推理出来
    配置如下
    root@a6fee036f708:/predict# mx-smi
    mx-smi version: 2.2.8

    =================== MetaX System Management Interface Log ===================
    Timestamp : Tue Mar 24 19:13:48 2026

    Attached GPUs : 16
    +---------------------------------------------------------------------------------+
    | MX-SMI 2.2.8 Kernel Mode Driver Version: 3.3.12 |
    | MACA Version: 3.1.0.14 BIOS Version: 1.29.1.0 |
    |------------------------------------+---------------------+----------------------+
    | GPU NAME Persistence-M | Bus-id | GPU-Util sGPU-M |
    | Temp Pwr:Usage/Cap Perf | Memory-Usage | GPU-State |
    |====================================+=====================+======================|
    | 0 MetaX C500 Off | 0000:05:00.0 | 0% Native |
    | 47C 67W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+
    | 1 MetaX C500 Off | 0000:06:00.0 | 0% Native |
    | 47C 62W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+
    | 2 MetaX C500 Off | 0000:09:00.0 | 0% Native |
    | 47C 58W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+
    | 3 MetaX C500 Off | 0000:0f:00.0 | 0% Native |
    | 45C 56W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+
    | 4 MetaX C500 Off | 0000:27:00.0 | 0% Native |
    | 48C 60W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+
    | 5 MetaX C500 Off | 0000:28:00.0 | 0% Native |
    | 50C 64W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+
    | 6 MetaX C500 Off | 0000:2b:00.0 | 0% Native |
    | 49C 58W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+
    | 7 MetaX C500 Off | 0000:31:00.0 | 0% Native |
    | 51C 62W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+
    | 8 MetaX C500 Off | 0000:85:00.0 | 0% Native |
    | 47C 59W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+
    | 9 MetaX C500 Off | 0000:86:00.0 | 0% Native |
    | 47C 62W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+
    | 10 MetaX C500 Off | 0000:89:00.0 | 0% Native |
    | 47C 62W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+
    | 11 MetaX C500 Off | 0000:8f:00.0 | 0% Native |
    | 46C 58W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+
    | 12 MetaX C500 Off | 0000:a5:00.0 | 0% Native |
    | 50C 64W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+
    | 13 MetaX C500 Off | 0000:a6:00.0 | 0% Native |
    | 50C 65W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+
    | 14 MetaX C500 Off | 0000:a9:00.0 | 0% Native |
    | 49C 63W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+
    | 15 MetaX C500 Off | 0000:af:00.0 | 0% Native |
    | 50C 62W / 350W P0 | 858/65536 MiB | Available |
    +------------------------------------+---------------------+----------------------+

    +---------------------------------------------------------------------------------+
    | Process: |
    | GPU PID Process Name GPU Memory |
    | Usage(MiB) |
    |=================================================================================|
    | no process found |
    +---------------------------------------------------------------------------------+

    End of Log

  • link
    Members 314 posts
    2026年3月25日 10:39
    link

    尊敬的开发者您好，请详细描述您的源码修改过程

  • arrow_forward

    Thread has been moved from 产品&运维.

  • link
    Members 20 posts
    2026年3月25日 11:00
    link

    root@a6fee036f708:/predict# pip show ultralytics
    Name: ultralytics
    Version: 8.4.26
    Summary: Ultralytics YOLO 🚀 for SOTA object detection, multi-object tracking, instance segmentation, pose estimation and image classification.
    Home-page: ultralytics.com
    Author:
    Author-email: Glenn Jocher glenn.jocher@ultralytics.com, Jing Qiu jing.qiu@ultralytics.com
    License: AGPL-3.0
    Location: /opt/conda/lib/python3.10/site-packages
    Requires: matplotlib, numpy, opencv-python, pillow, polars, psutil, pyyaml, requests, scipy, torch, torchvision, ultralytics-thop
    Required-by:
    root@a6fee036f708:/predict# cd /opt/conda/lib/python3.10/site-packages/ultralytics/nn/backends/
    root@a6fee036f708:/opt/conda/lib/python3.10/site-packages/ultralytics/nn/backends# vim
    root@a6fee036f708:/opt/conda/lib/python3.10/site-packages/ultralytics/nn/backends# vim onnx.py

    添加macaexecutionprovider

    image.png

    PNG, 776.8 KB, uploaded by wxsdiscover on 2026年3月25日.

  • link
    Members 314 posts
    2026年3月25日 11:02
    link

    尊敬的开发者您好，请删除macaexecutionprovider后尝试

  • link
    Members 20 posts
    2026年3月25日 11:05
    link

    删除macaexecutionprovider后，你们没有cudaexecutionprovider，会直接到cpu推理

  • link
    Members 314 posts
    2026年3月25日 11:08
    link

    尊敬的开发者您好,请执行pip list | grep onnxruntime

  • link
    Members 20 posts
    2026年3月25日 11:11
    link

    root@a6fee036f708:/predict# pip list | grep onnxruntime
    onnxruntime-gpu 1.12.0+maca3.1.0.5
    root@a6fee036f708:/predict#

  • link
    Members 314 posts
    2026年3月25日 11:19
    link

    尊敬的开发者您好，您的推理启动命令是什么

  • link
    Members 20 posts
    2026年3月25日 11:24
    link
  • link
    Members 314 posts
    2026年3月25日 11:28
    link

    尊敬的开发者您好，您是怎样安装ultralytics的

  • link
    Members 20 posts
    2026年3月25日 11:31
    link

    pip install ultralytics --no-deps，然后修改lib的代码，不直接从本地源码install

  • link
    Members 314 posts
    2026年3月25日 11:32
    link

    尊敬的开发者您好，请先使用onnxruntime推理onnx代码尝试推理，不使用ultralytics 框架

  • link
    Members 20 posts
    2026年3月25日 11:35
    link
  • link
    Members 314 posts
    2026年3月25日 11:36
    link

    尊敬的开发者您好，请在宿主机执行mx-smi

  • link
    Members 20 posts
    2026年3月25日 11:37
    link

    [root@standalone-amd64-mxc500 ~]# mx-smi
    mx-smi version: 2.2.9

    =================== MetaX System Management Interface Log ===================
    Timestamp : Wed Mar 25 11:39:24 2026

    Attached GPUs : 16
    +---------------------------------------------------------------------------------+
    | MX-SMI 2.2.9 Kernel Mode Driver Version: 3.3.12 |
    | MACA Version: 3.2.1.10 BIOS Version: 1.29.1.0 |
    |------------------+-----------------+---------------------+----------------------|
    | Board Name | GPU Persist-M | Bus-id | GPU-Util sGPU-M |
    | Pwr:Usage/Cap | Temp Perf | Memory-Usage | GPU-State |
    |==================+=================+=====================+======================|
    | 0 MetaX C500 | 0 Off | 0000:05:00.0 | 0% Disabled |
    | 68W / 350W | 49C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 1 MetaX C500 | 1 Off | 0000:06:00.0 | 0% Disabled |
    | 62W / 350W | 48C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 2 MetaX C500 | 2 Off | 0000:09:00.0 | 0% Disabled |
    | 59W / 350W | 48C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 3 MetaX C500 | 3 Off | 0000:0f:00.0 | 0% Disabled |
    | 56W / 350W | 46C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 4 MetaX C500 | 4 Off | 0000:27:00.0 | 0% Disabled |
    | 60W / 350W | 49C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 5 MetaX C500 | 5 Off | 0000:28:00.0 | 0% Disabled |
    | 64W / 350W | 51C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 6 MetaX C500 | 6 Off | 0000:2b:00.0 | 0% Disabled |
    | 59W / 350W | 50C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 7 MetaX C500 | 7 Off | 0000:31:00.0 | 0% Disabled |
    | 63W / 350W | 52C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 8 MetaX C500 | 8 Off | 0000:85:00.0 | 0% Disabled |
    | 60W / 350W | 48C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 9 MetaX C500 | 9 Off | 0000:86:00.0 | 0% Disabled |
    | 62W / 350W | 48C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 10 MetaX C500 | 10 Off | 0000:89:00.0 | 0% Disabled |
    | 62W / 350W | 47C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 11 MetaX C500 | 11 Off | 0000:8f:00.0 | 0% Disabled |
    | 59W / 350W | 47C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 12 MetaX C500 | 12 Off | 0000:a5:00.0 | 0% Disabled |
    | 64W / 350W | 52C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 13 MetaX C500 | 13 Off | 0000:a6:00.0 | 0% Disabled |
    | 65W / 350W | 51C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 14 MetaX C500 | 14 Off | 0000:a9:00.0 | 0% Disabled |
    | 63W / 350W | 51C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 15 MetaX C500 | 15 Off | 0000:af:00.0 | 0% Disabled |
    | 62W / 350W | 51C P0 | 859/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+

    +---------------------------------------------------------------------------------+
    | Process: |
    | GPU PID Process Name GPU Memory |
    | Usage(MiB) |
    |=================================================================================|
    | no process found |
    +---------------------------------------------------------------------------------+

    End of Log
    [root@standalone-amd64-mxc500 ~]#

  • link
    Members 314 posts
    2026年3月25日 11:38
    link

    尊敬的开发者您好，请开启个人主题提供贵司联系方式、项目信息

  • link
    Members 20 posts
    2026年3月25日 13:29
    link

    我之前的demo onnx的脚本不对，我的基准模型是yolo26s，我按照v8去解析的，我重新编写了demo onnx的脚本，是可以直接运行onnx的模型，
    root@367d9cb74f5f:/predict# python onnx_demo.py
    ✅ 模型加载成功 (E2E 格式)
    📦 配置类别数: 1

    📷 图片尺寸 (原图): 1918 x 1000 | 缩放比例: 0.3337
    🔍 检测到 2 个有效目标:

    类别 置信度 像素坐标 (x1, y1, x2, y2)

    drone 0.9307 [698, 11, 1883, 504]
    drone 0.9175 [91, 590, 857, 912]

    但是使用ultralytics 框架 仍然不行

  • link
    Members 20 posts
    2026年3月25日 13:33
    link

    并且直接使用model.export(format='onnx'),也不行，你们提供的镜像里是
    root@367d9cb74f5f:/predict# pip list | grep 'onnx'
    onnx 1.12.0
    onnxoptimizer 0.3.13
    onnxruntime-gpu 1.12.0+maca3.1.0.5
    onnxsim 0.4.36

    在调用model.export(format='onnx')，ultralytics 框架会校验onnxruntime和onnxslim，会从后台下载相关依赖，覆盖掉你们的onnx框架，你们有没有解决方法

  • link
    Members 314 posts
    2026年3月25日 13:50
    link

    尊敬的开发者您好，请根据代码逻辑注释相关依赖后安装

  • link
    Members 20 posts
    2026年3月26日 08:49
    link

    现在单用onnx推理有结果，用ultralytics推理没有结果

  • link
    Members 314 posts
    2026年3月26日 10:18
    link

    尊敬的开发者您好，请开启个人主题提供贵司联系方式、项目信息，客户技术支持团队会联系您

  • arrow_forward

    Thread has been moved from 解决中.