一、软硬件信息
1.服务器厂家: 联想
2.沐曦GPU型号：C500
3.操作系统内核版本：Linux master 5.15.0-72-generic #79-Ubuntu SMP Wed Apr 19 08:22:18 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
4.是否开启CPU虚拟化：没有
5.mx-smi回显：正常
参照官方说明：developer.metax-tech.com/api/client/document/preview/1269/k8s/03_component.html#oj1rzffy91ep1
helm开启gpuScheduler.deploy=true， v2后，metax-gpu-scheduler不创建
helm安装cmd如下
helm install metax-operator ./metax-operator-0.15.2.tgz --create-namespace -n metax-operator --wait --set driver.payload.version=3.3.0.4-amd64 --set maca.payload.images={"maca-native:3.3.0.4-ubuntu22.04-amd64"} --set gpuScheduler.deploy=true --set gpuScheduler.version=v2
operator log如下
/workspace/cloud/gpu-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:461
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem
/workspace/cloud/gpu-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:421
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1
/workspace/cloud/gpu-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:296
2026-07-22T06:25:49Z info DaemonSet:metax-gpu-device not found in namespace:metax-operator {"error": "DaemonSet.apps \"metax-gpu-device\" not found"}
2026-07-22T06:25:49Z info ConfigMap:metax-device-config not found in namespace:metax-operator {"error": "ConfigMap \"metax-device-config\" not found"}
2026-07-22T06:25:49Z info CompUpdate:gpu-device resource updating plan {"ResourceSyncAction": {"ClusterRole":"Update","ClusterRoleBinding":"Update","ConfigMap/metax-device-config":"Update","DaemonSet":"Update","Role":"Update","RoleBinding":"Update","ServiceAccount":"Update"}, "ResourceDeployed": {"ClusterRole":false,"ClusterRoleBinding":false,"ConfigMap/metax-device-config":false,"DaemonSet":false,"Dependency":false,"Role":false,"RoleBinding":false,"ServiceAccount":false}}
2026-07-22T06:25:49Z info CompUpdate:gpu-device resource updating {"resourceKind": "RoleBinding", "syncAction": "Update"}
2026-07-22T06:25:49Z info CompUpdate:gpu-device resource updating {"resourceKind": "ServiceAccount", "syncAction": "Update"}
2026-07-22T06:25:49Z info CompUpdate:gpu-device resource updating {"resourceKind": "ClusterRole", "syncAction": "Update"}
2026-07-22T06:25:49Z info CompUpdate:gpu-device resource updating {"resourceKind": "ClusterRoleBinding", "syncAction": "Update"}
2026-07-22T06:25:49Z info CompUpdate:gpu-device resource updating {"resourceKind": "Role", "syncAction": "Update"}
2026-07-22T06:25:49Z info CompUpdate:gpu-device resource updating {"resourceKind": "DaemonSet", "syncAction": "Update"}
2026-07-22T06:25:49Z info CompUpdate:gpu-device resource updating {"resourceKind": "ConfigMap/metax-device-config", "syncAction": "Update"}
2026-07-22T06:25:49Z info CompUpdate:gpu-device resource updating result {"ResourceSyncAction": {"ClusterRole":"Done","ClusterRoleBinding":"Done","ConfigMap/metax-device-config":"Done","DaemonSet":"Done","Role":"Done","RoleBinding":"Update","ServiceAccount":"Done"}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":true,"ConfigMap/metax-device-config":true,"DaemonSet":true,"Dependency":false,"Role":true,"RoleBinding":false,"ServiceAccount":true}}
2026-07-22T06:25:49Z error CompUpdate:gpu-device failed to update resource {"error": "comp:gpu-device, resource:RoleBinding, action:Update, error:rolebindings.rbac.authorization.k8s.io \"metax-gpu-device\" not found", "errorCauses": [{"error": "comp:gpu-device, resource:RoleBinding, action:Update, error:rolebindings.rbac.authorization.k8s.io \"metax-gpu-device\" not found"}]}
metax-tech.com/cloud/metax-operator/controllers.CompUpdate
/workspace/cloud/gpu-operator/controllers/resource_process.go:798
metax-tech.com/cloud/metax-operator/controllers.(*ClusterOperatorReconciler).runCompUpdate
/workspace/cloud/gpu-operator/controllers/clusteroperator_controller.go:319
metax-tech.com/cloud/metax-operator/controllers.(*ClusterOperatorReconciler).syncComponents
/workspace/cloud/gpu-operator/controllers/clusteroperator_controller.go:180
metax-tech.com/cloud/metax-operator/controllers.(*ClusterOperatorReconciler).Reconcile
/workspace/cloud/gpu-operator/controllers/clusteroperator_controller.go:105
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile
/workspace/cloud/gpu-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:216
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler
/workspace/cloud/gpu-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:461
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem
/workspace/cloud/gpu-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:421
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1
/workspace/cloud/gpu-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:296
2026-07-22T06:25:49Z info Deployment:metax-gpu-scheduler not found in namespace:metax-operator {"error": "Deployment.apps \"metax-gpu-scheduler\" not found"}
2026-07-22T06:25:49Z info ConfigMap:metax-gpu-scheduler-config not found in namespace:metax-operator {"error": "ConfigMap \"metax-gpu-scheduler-config\" not found"}
2026-07-22T06:25:49Z info CompUpdate:gpu-scheduler resource updating plan {"ResourceSyncAction": {"ConfigMap/metax-gpu-scheduler-config":"Update","MutatingWebhookConfiguration":"Update","Service":"Update"}, "ResourceDeployed": {"ConfigMap/metax-gpu-scheduler-config":false,"Dependency":false,"Deployment":false,"MutatingWebhookConfiguration":false,"Service":false}}
2026-07-22T06:25:49Z info CompUpdate:gpu-scheduler resource updating {"resourceKind": "ConfigMap/metax-gpu-scheduler-config", "syncAction": "Update"}
2026-07-22T06:25:49Z info CompUpdate:gpu-scheduler resource updating {"resourceKind": "Service", "syncAction": "Update"}
2026-07-22T06:25:49Z info CompUpdate:gpu-scheduler resource updating {"resourceKind": "MutatingWebhookConfiguration", "syncAction": "Update"}
2026-07-22T06:25:49Z info CompUpdate:gpu-scheduler resource updating result {"ResourceSyncAction": {"ConfigMap/metax-gpu-scheduler-config":"Done","MutatingWebhookConfiguration":"Done","Service":"Done"}, "ResourceDeployed": {"ConfigMap/metax-gpu-scheduler-config":true,"Dependency":false,"Deployment":false,"MutatingWebhookConfiguration":true,"Service":true}}
2026-07-22T06:25:49Z info CompUpdate:openshift resource updating plan {"ResourceSyncAction": {}, "ResourceDeployed": {"ClusterRole":false,"ClusterRoleBinding":false,"Dependency":false,"SecurityContextConstraints":false}}
2026-07-22T06:25:49Z info CompUpdate:openshift resource updating result {"ResourceSyncAction": {}, "ResourceDeployed": {"ClusterRole":false,"ClusterRoleBinding":false,"Dependency":false,"SecurityContextConstraints":false}}
2026-07-22T06:25:49Z info DaemonSet:metax-topo-worker not found in namespace:metax-operator {"error": "DaemonSet.apps \"metax-topo-worker\" not found"}
2026-07-22T06:25:49Z info CompUpdate:topo-worker resource updating plan {"ResourceSyncAction": {"ClusterRole":"Update","ClusterRoleBinding":"Update","Service":"Update","ServiceAccount":"Update"}, "ResourceDeployed": {"ClusterRole":false,"ClusterRoleBinding":false,"DaemonSet":false,"Dependency":false,"Service":false,"ServiceAccount":false}}
2026-07-22T06:25:49Z info CompUpdate:topo-worker resource updating {"resourceKind": "Service", "syncAction": "Update"}
2026-07-22T06:25:49Z info CompUpdate:topo-worker resource updating {"resourceKind": "ServiceAccount", "syncAction": "Update"}
2026-07-22T06:25:49Z info CompUpdate:topo-worker resource updating {"resourceKind": "ClusterRole", "syncAction": "Update"}
2026-07-22T06:25:49Z info CompUpdate:topo-worker resource updating {"resourceKind": "ClusterRoleBinding", "syncAction": "Update"}
2026-07-22T06:25:50Z info CompUpdate:topo-worker resource updating result {"ResourceSyncAction": {"ClusterRole":"Done","ClusterRoleBinding":"Done","Service":"Done","ServiceAccount":"Done"}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":true,"DaemonSet":false,"Dependency":false,"Service":true,"ServiceAccount":true}}
2026-07-22T06:25:50Z info ConfigMap:vendor-config not found in namespace:metax-operator {"error": "ConfigMap \"vendor-config\" not found"}
2026-07-22T06:25:50Z info CompUpdate:vendor resource updating plan {"ResourceSyncAction": {"ConfigMap/vendor-config":"Update"}, "ResourceDeployed": {"ConfigMap/vendor-config":false,"Dependency":false}}
2026-07-22T06:25:50Z info CompUpdate:vendor resource updating {"resourceKind": "ConfigMap/vendor-config", "syncAction": "Update"}
2026-07-22T06:25:50Z info CompUpdate:vendor resource updating result {"ResourceSyncAction": {"ConfigMap/vendor-config":"Done"}, "ResourceDeployed": {"ConfigMap/vendor-config":true,"Dependency":false}}
2026-07-22T06:25:50Z info DaemonSet:metax-data-exporter not found in namespace:metax-operator {"error": "DaemonSet.apps \"metax-data-exporter\" not found"}
2026-07-22T06:25:50Z info ConfigMap:metax-data-exporter-config not found in namespace:metax-operator {"error": "ConfigMap \"metax-data-exporter-config\" not found"}
2026-07-22T06:25:50Z info CompUpdate:data-exporter resource updating plan {"ResourceSyncAction": {"ConfigMap/metax-data-exporter-config":"Update","Service":"Update"}, "ResourceDeployed": {"ConfigMap/metax-data-exporter-config":false,"DaemonSet":false,"Dependency":false,"Service":false}}
2026-07-22T06:25:50Z info CompUpdate:data-exporter resource updating {"resourceKind": "Service", "syncAction": "Update"}
2026-07-22T06:25:50Z info CompUpdate:data-exporter resource updating {"resourceKind": "ConfigMap/metax-data-exporter-config", "syncAction": "Update"}
2026-07-22T06:25:50Z info CompUpdate:data-exporter resource updating result {"ResourceSyncAction": {"ConfigMap/metax-data-exporter-config":"Done","Service":"Done"}, "ResourceDeployed": {"ConfigMap/metax-data-exporter-config":true,"DaemonSet":false,"Dependency":false,"Service":true}}
2026-07-22T06:25:50Z info unknown field "spec.gpuScheduler" {"controller": "clusteroperator", "controllerGroup": "gpu.metax-tech.com", "controllerKind": "ClusterOperator", "ClusterOperator": {"name":"cluster-operator"}, "namespace": "", "name": "cluster-operator", "reconcileID": "0b90c8f1-044f-4682-94dc-a6dafb91ad02"}
2026-07-22T06:25:50Z info unknown field "spec.openshift" {"controller": "clusteroperator", "controllerGroup": "gpu.metax-tech.com", "controllerKind": "ClusterOperator", "ClusterOperator": {"name":"cluster-operator"}, "namespace": "", "name": "cluster-operator", "reconcileID": "0b90c8f1-044f-4682-94dc-a6dafb91ad02"}
2026-07-22T06:25:50Z info unknown field "spec.vendor" {"controller": "clusteroperator", "controllerGroup": "gpu.metax-tech.com", "controllerKind": "ClusterOperator", "ClusterOperator": {"name":"cluster-operator"}, "namespace": "", "name": "cluster-operator", "reconcileID": "0b90c8f1-044f-4682-94dc-a6dafb91ad02"}
2026-07-22T06:25:50Z info CompUpdate:gpu-label resource updating plan {"ResourceSyncAction": {"DaemonSet":"Update"}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":true,"DaemonSet":true,"Dependency":false,"Role":true,"RoleBinding":true,"ServiceAccount":true}}
2026-07-22T06:25:50Z info CompUpdate:gpu-label resource updating {"resourceKind": "DaemonSet", "syncAction": "Update"}
2026-07-22T06:25:50Z info CompUpdate:gpu-label resource updating result {"ResourceSyncAction": {"DaemonSet":"Done"}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":true,"DaemonSet":true,"Dependency":false,"Role":true,"RoleBinding":true,"ServiceAccount":true}}
2026-07-22T06:25:50Z info CompUpdate:container-runtime resource updating plan {"ResourceSyncAction": {"ClusterRoleBinding":"Update","DaemonSet":"Update"}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":false,"DaemonSet":true,"Dependency":false,"Role":true,"RoleBinding":true,"RuntimeClass":true,"ServiceAccount":true}}
2026-07-22T06:25:50Z info CompUpdate:container-runtime resource updating {"resourceKind": "ClusterRoleBinding", "syncAction": "Update"}
2026-07-22T06:25:50Z info CompUpdate:container-runtime resource updating {"resourceKind": "DaemonSet", "syncAction": "Update"}
2026-07-22T06:25:50Z info CompUpdate:container-runtime resource updating result {"ResourceSyncAction": {"ClusterRoleBinding":"Done","DaemonSet":"Done"}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":true,"DaemonSet":true,"Dependency":false,"Role":true,"RoleBinding":true,"RuntimeClass":true,"ServiceAccount":true}}
2026-07-22T06:25:50Z info CompUpdate:driver resource updating plan {"ResourceSyncAction": {"DaemonSet":"Update"}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":true,"ConfigMap/driver-config":true,"ConfigMap/metax-vfio-config":true,"DaemonSet":true,"Dependency":false,"Role":true,"RoleBinding":true,"ServiceAccount":true}}
2026-07-22T06:25:50Z info CompUpdate:driver resource updating {"resourceKind": "DaemonSet", "syncAction": "Update"}
2026-07-22T06:25:50Z info CompUpdate:driver resource updating result {"ResourceSyncAction": {"DaemonSet":"Done"}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":true,"ConfigMap/driver-config":true,"ConfigMap/metax-vfio-config":true,"DaemonSet":true,"Dependency":false,"Role":true,"RoleBinding":true,"ServiceAccount":true}}
2026-07-22T06:25:50Z info DaemonSet:metax-data-exporter not found in namespace:metax-operator {"error": "DaemonSet.apps \"metax-data-exporter\" not found"}
2026-07-22T06:25:50Z info CompUpdate:data-exporter resource updating plan {"ResourceSyncAction": {}, "ResourceDeployed": {"ConfigMap/metax-data-exporter-config":true,"DaemonSet":false,"Dependency":false,"Service":true}}
2026-07-22T06:25:50Z info CompUpdate:data-exporter resource updating result {"ResourceSyncAction": {}, "ResourceDeployed": {"ConfigMap/metax-data-exporter-config":true,"DaemonSet":false,"Dependency":false,"Service":true}}
2026-07-22T06:25:50Z info DriverUpgrade ValidatingWebhook info {"name": "metax-upgrade-validating-webhook-configuration", "kind": "ValidatingWebhookConfiguration"}
2026-07-22T06:25:50Z info CompUpdate:driver-upgrade resource updating plan {"ResourceSyncAction": {"ValidatingWebhookConfiguration":"Update"}, "ResourceDeployed": {"Dependency":false,"ValidatingWebhookConfiguration":true}}
2026-07-22T06:25:50Z info CompUpdate:driver-upgrade resource updating {"resourceKind": "ValidatingWebhookConfiguration", "syncAction": "Update"}
2026-07-22T06:25:50Z info CompUpdate:driver-upgrade resource updating result {"ResourceSyncAction": {"ValidatingWebhookConfiguration":"Done"}, "ResourceDeployed": {"Dependency":false,"ValidatingWebhookConfiguration":true}}
2026-07-22T06:25:50Z info Deployment:metax-topo-master not found in namespace:metax-operator {"error": "Deployment.apps \"metax-topo-master\" not found"}
2026-07-22T06:25:50Z info CompUpdate:topo-master resource updating plan {"ResourceSyncAction": {}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":true,"ConfigMap/metax-topo-master-config":true,"Dependency":false,"Deployment":false,"Secret":true,"Service":true,"ServiceAccount":true}}
2026-07-22T06:25:50Z info CompUpdate:topo-master resource updating result {"ResourceSyncAction": {}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":true,"ConfigMap/metax-topo-master-config":true,"Dependency":false,"Deployment":false,"Secret":true,"Service":true,"ServiceAccount":true}}
2026-07-22T06:25:50Z info CompUpdate:maca resource updating plan {"ResourceSyncAction": {"DaemonSet":"Update","RoleBinding":"Update"}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":true,"ConfigMap/maca-config":true,"DaemonSet":true,"Dependency":false,"Role":true,"RoleBinding":false,"ServiceAccount":true}}
2026-07-22T06:25:50Z info CompUpdate:maca resource updating {"resourceKind": "RoleBinding", "syncAction": "Update"}
2026-07-22T06:25:50Z info CompUpdate:maca resource updating {"resourceKind": "DaemonSet", "syncAction": "Update"}
2026-07-22T06:25:50Z info CompUpdate:maca resource updating result {"ResourceSyncAction": {"DaemonSet":"Done","RoleBinding":"Done"}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":true,"ConfigMap/maca-config":true,"DaemonSet":true,"Dependency":false,"Role":true,"RoleBinding":true,"ServiceAccount":true}}
2026-07-22T06:25:50Z info CompUpdate:gpu-device resource updating plan {"ResourceSyncAction": {"DaemonSet":"Update","RoleBinding":"Update"}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":true,"ConfigMap/metax-device-config":true,"DaemonSet":true,"Dependency":false,"Role":true,"RoleBinding":false,"ServiceAccount":true}}
2026-07-22T06:25:50Z info CompUpdate:gpu-device resource updating {"resourceKind": "RoleBinding", "syncAction": "Update"}
2026-07-22T06:25:50Z info CompUpdate:gpu-device resource updating {"resourceKind": "DaemonSet", "syncAction": "Update"}
2026-07-22T06:25:50Z info CompUpdate:gpu-device resource updating result {"ResourceSyncAction": {"DaemonSet":"Done","RoleBinding":"Done"}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":true,"ConfigMap/metax-device-config":true,"DaemonSet":true,"Dependency":false,"Role":true,"RoleBinding":true,"ServiceAccount":true}}
2026-07-22T06:25:50Z info Deployment:metax-gpu-scheduler not found in namespace:metax-operator {"error": "Deployment.apps \"metax-gpu-scheduler\" not found"}
2026-07-22T06:25:50Z info CompUpdate:gpu-scheduler resource updating plan {"ResourceSyncAction": {}, "ResourceDeployed": {"ConfigMap/metax-gpu-scheduler-config":true,"Dependency":false,"Deployment":false,"MutatingWebhookConfiguration":true,"Service":true}}
2026-07-22T06:25:50Z info CompUpdate:gpu-scheduler resource updating result {"ResourceSyncAction": {}, "ResourceDeployed": {"ConfigMap/metax-gpu-scheduler-config":true,"Dependency":false,"Deployment":false,"MutatingWebhookConfiguration":true,"Service":true}}
2026-07-22T06:25:50Z info CompUpdate:openshift resource updating plan {"ResourceSyncAction": {}, "ResourceDeployed": {"ClusterRole":false,"ClusterRoleBinding":false,"Dependency":false,"SecurityContextConstraints":false}}
2026-07-22T06:25:50Z info CompUpdate:openshift resource updating result {"ResourceSyncAction": {}, "ResourceDeployed": {"ClusterRole":false,"ClusterRoleBinding":false,"Dependency":false,"SecurityContextConstraints":false}}
2026-07-22T06:25:50Z info DaemonSet:metax-topo-worker not found in namespace:metax-operator {"error": "DaemonSet.apps \"metax-topo-worker\" not found"}
2026-07-22T06:25:50Z info CompUpdate:topo-worker resource updating plan {"ResourceSyncAction": {}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":true,"DaemonSet":false,"Dependency":false,"Service":true,"ServiceAccount":true}}
2026-07-22T06:25:50Z info CompUpdate:topo-worker resource updating result {"ResourceSyncAction": {}, "ResourceDeployed": {"ClusterRole":true,"ClusterRoleBinding":true,"DaemonSet":false,"Dependency":false,"Service":true,"ServiceAccount":true}}
2026-07-22T06:25:50Z info CompUpdate:vendor resource updating plan {"ResourceSyncAction": {}, "ResourceDeployed": {"ConfigMap/vendor-config":true,"Dependency":false}}
2026-07-22T06:25:50Z info CompUpdate:vendor resource updating result {"ResourceSyncAction": {}, "ResourceDeployed": {"ConfigMap/vendor-config":true,"Dependency":false}}
