MetaX-Tech Developer Forum 论坛首页
  • 沐曦开发者
search
Sign in
  • chevron_right Threads
  • label 产品&运维
  • label 已解决

求助部署hunyuanOCR应该使用哪个镜像?

AchillesChen
2025年12月17日
chat_bubble_outline 1
  • link
    AchillesChen
    Members 4 posts
    2025年12月17日 14:50 2025年12月17日 14:50
    link

    因为工作原因,需要在内网网络隔离环境下,部署hunyuanOCR模型。我下载了vllm-metax:0.10.2-maca.ai3.2.1.7-torch2.6-py310-centos9-amd64镜像,并执行vllm serve /models/hunyuanOCR/ --no-enable-prefix-caching --mm-processor-cache-gb 0 --gpu-memory-utilization 0.2命令。


    报错信息如下:
    (APIServer pid=810)
    pydantic_core._pydantic_core.ValidationError: 1 validation error for ModelConfig
    (APIServer pid=810) Value error, The checkpoint you are trying to load has model type 'hunyuan_vl' but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
    (APIServer pid=810)
    You can update Transformers with the command 'pip install --upgrade transformers'. If this does not work, and the checkpoint is very new, then there may not be a release version that supports this model yet. In this case, you can get the most up-to-date code by installing Transformers from source with the command 'pip install --git+github.com/huggingface/transformers.git [type=value_error, input_value=ArgsKwargs((), {'model':...recessor_plugin':None})


    请问是该镜像的transformers库版本过低吗,应该下载哪个镜像呢?

    9b77c576cbb27f491eb16440466e9fd6.png

    PNG, 95.0 KB, uploaded by AchillesChen on 2025年12月17日.

  • edit

    Thread title has been changed from 需要transformers版本大于4.57.3,应该使用哪个镜像?.

    • By AchillesChen on 2025年12月17日 15:07.
  • link
    shuai_chen
    Members 221 posts
    2025年12月19日 10:30 2025年12月19日 10:30
    link

    尊敬的开发者您好,请您离线升级transformers版本。

  • arrow_forward

    Thread has been moved from 产品&运维.

    • By shuai_chen on 2025年12月19日 10:33.
  • arrow_forward

    Thread has been moved from 解决中.

    • By shuai_chen on 2025年12月24日 19:25.
arrow_upward Go to top
  • 沐曦开发者论坛
powered by misago