请问有量化的镜像吗,我想把bf16量化成w8a8,我是c550机器
Thread has been moved from 公共.
尊敬的开发者您好,请参考modelscope.cn/organization/metax-tech 若没有,请使用 LLM Compressor自行量化
Thread has been moved from 解决中.