• Members 21 posts
    2026年8月3日 10:00

    一、软硬件信息
    1.服务器厂家: H3C
    2.沐曦GPU型号:C550
    3.操作系统内核版本:
    Linux muxi-gpu-server 6.14.0-27-generic #27~24.04.1-Ubuntu SMP PREEMPT_DYNAMIC Tue Jul 22 17:38:49 UTC 2 x86_64 x86_64 x86_64 GNU/Linux
    4.是否开启CPU虚拟化:
    app@muxi-gpu-server:~$ lscpu | grep -i virtualization
    Virtualization: AMD-V
    5、镜像为vllm-metax:0.22.0-maca.ai3.8.0.5-torch2.10-py312-kylinv11-amd64
    6.mx-smi回显:
    app@muxi-gpu-server:~$ mx-smi
    mx-smi version: 2.3.4

    =================== MetaX System Management Interface Log ===================
    Timestamp : Mon Aug 3 01:52:32 2026

    Attached GPUs : 8
    +---------------------------------------------------------------------------------+
    | MX-SMI 2.3.4 Kernel Mode Driver Version: 3.9.10 |
    | MACA Version: 3.8.0.23 BIOS Version: 1.22.3.0 |
    |------------------+-----------------+---------------------+----------------------|
    | Board Name | GPU Persist-M | Bus-id | GPU-Util sGPU-M |
    | Pwr:Usage/Cap | Temp Perf | Memory-Usage | GPU-State |
    |==================+=================+=====================+======================|
    | 0 MetaX C550 | 0 N/A | 0000:23:00.0 | 16% Disabled |
    | 131W / 450W | 46C N/A | 34589/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 1 MetaX C550 | 1 N/A | 0000:26:00.0 | 13% Disabled |
    | 131W / 450W | 41C N/A | 34589/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 2 MetaX C550 | 2 N/A | 0000:63:00.0 | 10% Disabled |
    | 129W / 450W | 41C N/A | 34589/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 3 MetaX C550 | 3 N/A | 0000:66:00.0 | 9% Disabled |
    | 135W / 450W | 47C N/A | 34589/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 4 MetaX C550 | 4 N/A | 0000:a3:00.0 | 9% Disabled |
    | 132W / 450W | 46C N/A | 34589/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 5 MetaX C550 | 5 N/A | 0000:a4:00.0 | 13% Disabled |
    | 130W / 450W | 41C N/A | 34589/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 6 MetaX C550 | 6 N/A | 0000:e3:00.0 | 13% Disabled |
    | 127W / 450W | 41C N/A | 34589/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 7 MetaX C550 | 7 N/A | 0000:e4:00.0 | 8% Disabled |
    | 135W / 450W | 46C N/A | 34589/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+

    +---------------------------------------------------------------------------------+
    | Process: |
    | GPU PID Process Name GPU Memory |
    | Usage(MiB) |
    |=================================================================================|
    | 0 82079 VLLM::Worker_TP 33718 |
    | 1 82080 VLLM::Worker_TP 33718 |
    | 2 82081 VLLM::Worker_TP 33718 |
    | 3 82082 VLLM::Worker_TP 33718 |
    | 4 82083 VLLM::Worker_TP 33718 |
    | 5 82084 VLLM::Worker_TP 33718 |
    | 6 82085 VLLM::Worker_TP 33718 |
    | 7 82086 VLLM::Worker_TP 33718 |
    +---------------------------------------------------------------------------------+

    End of Log
    app@muxi-gpu-server:~$
    根据以上信息,我的8卡能部署 Qwen3.5-397B-A17B‌吗?有什么参数推荐和要求

  • arrow_forward

    Thread has been moved from 公共.

  • Members 21 posts
    2026年8月3日 10:29

    就是8卡 是能跑起来的是吧,显存上是满足的是吗?

  • Members 21 posts
    2026年8月3日 10:34

    就是单台服务器8卡是能部署起来的是吗?

  • Members 21 posts
    2026年8月3日 10:40

    还是必须要2台8卡*64G 的服务器 才能部署起来?

  • arrow_forward

    Thread has been moved from 解决中.