MetaX-Tech Developer Forum 论坛首页
  • 沐曦开发者
search
Sign in
  • chevron_right Threads
  • label 产品&运维
  • label 已解决

pd分离transfer backend

nuuuuuuke
2026年4月30日
chat_bubble_outline 1
  • link
    nuuuuuuke
    Members 12 posts
    2026年4月30日 14:16 2026年4月30日 14:16
    link

    python -m sglang.launch_server --help 2>&1 | grep -A8 -B2 "disaggregation-transfer-backend"

                        [--debug-tensor-dump-inject DEBUG_TENSOR_DUMP_INJECT]
                        [--disaggregation-mode {null,prefill,decode}]
                        [--disaggregation-transfer-backend {mooncake,nixl,ascend,fake,mori}]
                        [--disaggregation-bootstrap-port DISAGGREGATION_BOOTSTRAP_PORT]
                        [--disaggregation-decode-tp DISAGGREGATION_DECODE_TP]
                        [--disaggregation-decode-dp DISAGGREGATION_DECODE_DP]
                        [--disaggregation-prefill-pp DISAGGREGATION_PREFILL_PP]
                        [--disaggregation-ib-device DISAGGREGATION_IB_DEVICE]
                        [--disaggregation-decode-enable-offload-kvcache]
                        [--num-reserved-decode-tokens NUM_RESERVED_DECODE_TOKENS]
                        [--disaggregation-decode-polling-interval DISAGGREGATION_DECODE_POLLING_INTERVAL]
    

    sglang 0.5.9的镜像, pd分离的部署, --disaggregation-transfer-backend用啥 啊, 直接 pip install mooncake的? 还是有沐曦配套的。

  • arrow_forward

    Thread has been moved from 产品&运维.

    • By shuai_chen on 2026年4月30日 17:09.
  • link
    shuai_chen
    Members 458 posts
    2026年4月30日 17:10 2026年4月30日 17:10
    link

    尊敬的开发者您好,PD分离沐曦已适配,当前仅开放给专属客户,请通过商务渠道获取PD分离部署指南

  • arrow_forward

    Thread has been moved from 解决中.

    • By shuai_chen on 2026年5月6日 18:14.
  • arrow_forward

    Thread has been moved from 已解决.

    • By shuai_chen on 2026年5月6日 18:15.
  • arrow_forward

    Thread has been moved from 解决中.

    • By shuai_chen on 2026年5月6日 18:16.
arrow_upward Go to top
  • 沐曦开发者论坛
powered by misago