Exp(1) 4.服务启动与停止 shell 进入部署目录 cd /home/deepseek 设置节点启动脚本执行权限 chmod +x node.sh 启动 DeepSeek 服务 sbatch srun.sh 查看npu运行状态 npusmi info 查看实例和作业运行信息 squeue 示例输出 JOBID PARTITION NAME USER ST TIME NODES NODELIST(REASON) 1 batch deepseek root R 1:00:00 2 compute0001,master0001 停止一项服务 scancel [JOBID],根据上文deepseek服务的JOBID为1 scancel 1 停止全部服务 scancel me 服务验证与运维 1.推理服务验证 测试方法:向大模型问一个简单的问题,准备如下脚本并保存到check.sh shell !/bin/bash curl H "ContentType: application/json" d '{ "model": "DeepSeekV4FlashVisionExp", "messages": [{"role": "user", "content": "你好,请用一句话介绍你自己"}], "maxtokens": 1024, "temperature": 0.7 }' 成功响应示例: shell sh check.sh {"id":"chatcmplb15e20a680282ba9","object":"chat.completion","created":1788870096,"model":"DeepSeekV4FlashVisionExp","choices":[{"index":0,"message":{"role":"assistant","content":"你好!我是DeepSeek,一个由深度求索公司创造的AI助手,乐于为你解答问题、提供信息和支持。😊","refusal":null,"annotations":null,"audio":null,"functioncall":null,"reasoning":null},"logprobs":null,"finishreason":"stop","stopreason":null,"tokenids":null,"routedexperts":null}],"servicetier":null,"systemfingerprint":"vllm0.27.1tp4dp4ep6f64ac72","usage":{"prompttokens":11,"totaltokens":40,"completiontokens":29,"prompttokensdetails":null},"promptlogprobs":null,"prompttokenids":null,"prompttext":null,"kvtransferparams":null,"ectransferparams":null,"metrics":null}
来自: