昇腾 910B 物理机使用Galaxy镜像部署DeepSeek指南(多机版) 2.2 DeepSeek服务启动 仅需如下3条命令,即可启动服务(根据模型大小,启动服务需等待530分钟不等): cd /home/deepseek sbatch srunclean.sh sbatch srundeepseek.sh 查看log目录下的out文件,当出现如下信息时,服务启动成功: $ more deepseek.33.out Loading cthpc910b/1.0.0/mpich3.2.1 Loading requirement: mpich/3.2.1/gcc10.3.1 Service Address: Config updated successfully. Output file: json/config.33.json Start to parse ranktable file Finished parsing ranktable file. Update worldSize and npuDeviceIds of backend config successfully for Multi Nodes Inference. Start to parse ranktable file Finished parsing ranktable file. Update worldSize and npuDeviceIds of backend config successfully for Multi Nodes Inference. Warning: path /configs/mkicfg.ini does not exist ... Multi Nodes infer slave instance need not init TokenizerProcessPool and HttpWrapper Daemon start success! Daemon start success! 注意 DeepSeek主节点,根据调度节点自动生成,这里log显示为192.168.0.34。 进行检测,给DeepSeek提个问题: $ curl i location ' header 'ContentType: application/json' data '{ "model": "DeepSeekR1", "stream": false, "messages": [ {"role": "user", "content": "你是谁"} ] }' HTTP/1.1 200 OK Connection: close ContentLength: 625 ContentType: application/json KeepAlive: timeout180, max2147483647 {"id":"endpointcommon132","object":"chat.completion","created":1743387462,"model":"DeepSeekR1","choices":[{"index":0,"message":{"role":"assistant","toolcalls":null,"content":" nn nn您好!我是由中国的深度求索(DeepSeek)公司开发的智能助手DeepSeekR1。如您有任何任何问题,我会尽我所能为您提供帮助。"},"finishreason":"stop"}],"usage":{"prompttokens":4,"completiontokens":42,"totaltokens":46},"prefilltime":136,"decodetimearr":[125,74,74,74,76,73,75,73,75,74,75,75,74,74,73,74,74,74,74,74,75,74,74,74,74,74,74,74,77,75,76,75,74,74,74,74,74,75,74,73,82]}