Task Menu下面Ex cute Loop 0我这边看到的有在docker里面执行模型的命令,且模型执行成功。但是还是一样的报错。如果有防火墙,这个数据应该无法返回。我这边已经确认把gui-profiler加到百名店白名单里面
1.在server日志文件里面,我看到了模型推理过程日志以及结果的打印日志。mcRpcPort.ini: ['cat: /root/mcRpcPort.ini: No such file or directory']这个是需要手动修改还是需要额外启动RPC服务?如何启动
[warning] cannot get rpc server port, try more times:cannot retrieve rpc server port.
mcRpcPort.ini: ['cat: /root/mcRpcPort.ini: No such file or directory']
[warning] cannot get rpc server port, try more times:cannot retrieve rpc server port.
mcToolsExtPid_UsedPort:10466-46153
mcRpcPort.ini: ['10466,46153,python3.10']
[info] mctool client port:46153
INFO 08-07 15:32:15 [parallel_state.py:1004] rank 0 in world size 1 is assigned as DP rank 0, PP rank 0, TP rank 0
INFO 08-07 15:32:15 [cuda.py:204] Using FlashMLA backend on V1 engine.
WARNING 08-07 15:32:15 [topk_topp_sampler.py:69] FlashInfer is not available. Falling back to the PyTorch-native implementation of top-p & top-k sampling. For the best performance, please install FlashInfer.
INFO 08-07 15:32:16 [gpu_model_runner.py:1329] Starting to load model /home/weight/DeepSeek-V2-Lite...
Loading safetensors checkpoint shards: 0% Completed | 0/4 [00:00<?, ?it/s]
Loading safetensors checkpoint shards: 25% Completed | 1/4 [00:04<00:12, 4.27s/it]
Loading safetensors checkpoint shards: 50% Completed | 2/4 [00:07<00:07, 3.54s/it]
Loading safetensors checkpoint shards: 75% Completed | 3/4 [00:11<00:04, 4.02s/it]
[error] cannot connect to server:
[error] execute failed:
[error] Traceback (most recent call last):
File "prpc_client\mctool_client.py", line 36, in init
File "grpc_utilities.py", line 151, in result
File "grpc_utilities.py", line 97, in _block
grpc.FutureTimeoutError
麻烦再帮看看,谢谢。3