MetaX-Tech Developer Forum 论坛首页
  • 沐曦开发者
search
Sign in

godv

  • Members
  • Joined 2026年10月23日
  • message 帖子
  • forum 主题
  • favorite 关注者
  • favorite_border Follows
  • person_outline 详细信息

godv has posted 5 messages.

  • See post chevron_right
    godv
    Members
    想问下沐曦C500 不能连外网 vllm 部署 qwen3.8用什么镜像 已解决 2026年10月30日 15:16

    如题所述,前两天用了这个镜像 modelzoo.llm.vllm:1.0.0-maca.ai3.3.0.11-torch2.6-py310-kylin2309a-arm64 发现不支持qwen3,现在是否有适配 Qwen3 的 vLLM 镜像?服务器是内网环境,如果用一些基础镜像的话会缺少依赖没法下载

  • See post chevron_right
    godv
    Members
    需要modelzoo.llm.vllm:1.0.0-maca.ai3.3.0.11-torch2.6-py310-kylin2309a-arm64镜像离线包导出。 已解决 2026年10月28日 17:46

    另外再提供下paddle:2.6.0-maca.ai3.3.0.10-py310-kylinv10-arm64
    这个镜像离线包

  • See post chevron_right
    godv
    Members
    需要modelzoo.llm.vllm:1.0.0-maca.ai3.3.0.11-torch2.6-py310-kylin2309a-arm64镜像离线包导出。 已解决 2026年10月28日 17:32

    mx-smi version: 2.2.9

    =================== MetaX System Management Interface Log ===================
    Timestamp : Wed Oct 28 17:27:17 2026

    Attached GPUs : 4
    +---------------------------------------------------------------------------------+
    | MX-SMI 2.2.9 Kernel Mode Driver Version: 3.4.4 |
    | MACA Version: 3.3.0.15 BIOS Version: 1.37.2.0 |
    |------------------+-----------------+---------------------+----------------------|
    | Board Name | GPU Persist-M | Bus-id | GPU-Util sGPU-M |
    | Pwr:Usage/Cap | Temp Perf | Memory-Usage | GPU-State |
    |==================+=================+=====================+======================|
    | 0 MetaX C500 | 0 Off | 0000:0b:00.0 | 0% Disabled |
    | 31W / 350W | 30C P0 | 861/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 1 MetaX C500 | 1 Off | 0000:0c:00.0 | 0% Disabled |
    | 29W / 350W | 28C P0 | 861/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 2 MetaX C500 | 2 Off | 0000:0f:00.0 | 0% Disabled |
    | 30W / 350W | 30C P0 | 861/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+
    | 3 MetaX C500 | 3 Off | 0000:10:00.0 | 0% Disabled |
    | 33W / 350W | 30C P0 | 861/65536 MiB | Available |
    +------------------+-----------------+---------------------+----------------------+

    +---------------------------------------------------------------------------------+
    | Process: |
    | GPU PID Process Name GPU Memory |
    | Usage(MiB) |
    |=================================================================================|
    | no process found |
    +---------------------------------------------------------------------------------+

    End of Log

    这个版本是不是用这个镜像包可以 还是必须要3.3.0.15

  • 沐曦开发者论坛
powered by misago