• Members 10 posts
    2026年9月18日 09:59

    版本驱动如下

    mx-smi

    mx-smi version: 2.2.3

    =================== MetaX System Management Interface Log ===================
    Timestamp : Fri Sep 18 09:57:10 2026

    Attached GPUs : 8
    +---------------------------------------------------------------------------------+
    | MX-SMI 2.2.3 Kernel Mode Driver Version: 2.14.6 |
    | MACA Version: 2.32.0.6 BIOS Version: 1.24.3.0 |
    |------------------------------------+---------------------+----------------------+
    | GPU NAME | Bus-id | GPU-Util |
    | Temp Pwr:Usage/Cap | Memory-Usage | |
    |====================================+=====================+======================|
    | 0 MetaX C500 | 0000:43:00.0 | 0% |
    | 41C 52W / 350W | 59366/65536 MiB | |
    +------------------------------------+---------------------+----------------------+
    | 1 MetaX C500 | 0000:45:00.0 | 0% |
    | 43C 54W / 350W | 60006/65536 MiB | |
    +------------------------------------+---------------------+----------------------+
    | 2 MetaX C500 | 0000:47:00.0 | 0% |
    | 46C 56W / 350W | 60006/65536 MiB | |
    +------------------------------------+---------------------+----------------------+
    | 3 MetaX C500 | 0000:4a:00.0 | 0% |
    | 47C 58W / 350W | 59366/65536 MiB | |
    +------------------------------------+---------------------+----------------------+
    | 4 MetaX C500 | 0000:c4:00.0 | 0% |
    | 44C 53W / 350W | 59715/65536 MiB | |
    +------------------------------------+---------------------+----------------------+
    | 5 MetaX C500 | 0000:c6:00.0 | 0% |
    | 45C 54W / 350W | 59605/65536 MiB | |
    +------------------------------------+---------------------+----------------------+
    | 6 MetaX C500 | 0000:c8:00.0 | 0% |
    | 47C 57W / 350W | 59635/65536 MiB | |
    +------------------------------------+---------------------+----------------------+
    | 7 MetaX C500 | 0000:ca:00.0 | 0% |
    | 42C 42W / 350W | 858/65536 MiB | |
    +------------------------------------+---------------------+----------------------+

    +---------------------------------------------------------------------------------+
    | Process: |
    | GPU PID Process Name GPU Memory |
    | Usage(MiB) |
    |=================================================================================|
    | 0 4104065 VLLM::Worker_TP 58500 |
    | 1 4104066 VLLM::Worker_TP 59140 |
    | 2 4104069 VLLM::Worker_TP 59140 |
    | 3 4104070 VLLM::Worker_TP 58500 |
    | 4 2504707 VLLM::EngineCor 58856 |
    | 5 2267768 VLLM::EngineCor 58746 |
    | 6 3061825 VLLM::EngineCor 58776 |
    +---------------------------------------------------------------------------------+

  • arrow_forward

    Thread has been moved from 产品&运维.

  • Members 10 posts
    2026年9月18日 10:45

    这个驱动也可以吗,驱动版本是2.多的

  • Members 10 posts
    2026年9月18日 10:45

    昨晚试了一下第二个一直起不来也没报错

  • Members 10 posts
    2026年9月18日 10:47

    !/bin/bash

    unset CUDA_VISIBLE_DEVICES

    启动Embedding

    vllm serve /mnt/model/ \
    --host 0.0.0.0 \
    --port 8080 \
    --trust_remote_code \
    --served-model-name Qwen3-Embedding-4B \
    --tensor-parallel-size 1 \
    --max-model-len 4096 \
    --gpu-memory-utilization 0.35 &
    EMB_PID=$!

    echo "等待embedding端口8080就绪..."
    until curl -s http://127.0.0.1:8080/v1/models >/dev/null 2>&1
    do
    sleep 3
    echo "8080还没就绪,继续等待..."
    done
    echo "✅ embedding 8080已经就绪"

    启动reranker,压低参数

    vllm serve /mnt/models/ \
    --host 0.0.0.0 \
    --port 8081 \
    --trust_remote_code \
    --served-model-name Qwen3-Reranker-4B \
    --tensor-parallel-size 1 \
    --max-model-len 512 \
    --gpu-memory-utilization 0.20 &
    RERANK_PID=$!

    echo "reranker已启动 PID $RERANK_PID"
    wait

    启动命令如下

  • Members 949 posts
    2026年9月18日 10:49

    尊敬的开发者您好,请先升级驱动到最新版本

  • arrow_forward

    Thread has been moved from 解决中.