接口描述

请求参数

请求头参数

请求参数

备注：此参数为全平台模型通用，每个模型支持的参数、参数范围可能因模型不同而有所差异，详细可见模型广场内每个模型的API文档。

请求参数示例

{
  "model": "1234567890",    // 模型ID
  "messages": [
    {
      "role": "user",
      "content": "Hello!"
    }
  ]
}

请求返回

非流式返回

非流式正常返回

返回结果示例

{
  "id": "chatcmpl-123",
  "object": "chat.completion",
  "created": 1677652288,
  "model": "xxx-chat",
  "choices": [{
    "index": 0,
    "finish_reason": "stop",
    "message": {
      "role": "assistant",
      "content": "\n\nHello there, how may I assist you today?"
    }
  }],
  "usage": {
    "prompt_tokens": 9,
    "completion_tokens": 12,
    "total_tokens": 21
  }
}

非流式异常返回

非流式异常返回时：

● http code 返回非200。

● http body 中返回 error 结构，error结构中包含code、type、message、param等信息，具体可见错误处理章节内容。

错误结果示例

{
  "error" : {
    "code" : "500001",
    "type" : "INVOKE_MODEL_ERROR",
    "message" : "服务接口异常，请联系管理员"
  }
}

流式返回

流式正常返回

返回结果示例

{"id":"chatcmpl-123","object":"chat.completion.chunk","created":1694268190,"model":"xxx-chat", "choices":[{"index":0,"delta":{"role":"assistant"},"finish_reason":null}]}
{"id":"chatcmpl-123","object":"chat.completion.chunk","created":1694268190,"model":"xxx-chat", "choices":[{"index":0,"delta":{"content":"Hello"},"finish_reason":null}]}
....
{"id":"chatcmpl-123","object":"chat.completion.chunk","created":1694268190,"model":"xxx-chat", "choices":[{"index":0,"delta":{},"finish_reason":"stop"}]}

stream_options.include_usage 为 True 时多返回一条包含usage流式消息。

{"id":"chatcmpl-123","object":"chat.completion.chunk","created":1694268199,"model":"xxx-chat", "choices":[], "usage": {"prompt_tokens": 9,"completion_tokens": 120,"total_tokens": 129}}

流式异常返回

流式异常分为两种：

● 如果在流式请求接收处理之前发生了异常，如鉴权、参数校验等问题，与普通的非流式一样返回http code，并带有error结构。

● 如果在流式请求已经接收，会先对外返回流式请求连接建立的信息，此时http code为200，而在后续模型流式返回过程中发生了异常，会在流式返回的chunk返回error结构，并终止当前的流式请求。

流式请求建立后的异常返回示例

{"id":"chatcmpl-123","object":"chat.completion.chunk","created":1694268190,"model":"xxx-chat", "choices":[{"index":0,"delta":{"role":"assistant"},"finish_reason":null}]}
{"id":"chatcmpl-123","object":"chat.completion.chunk","created":1694268190,"model":"xxx-chat", "choices":[{"index":0,"delta":{"content":"Hello"},"finish_reason":null}]}
....
{"error":{"code":"500001","type":"INVOKE_MODEL_ERROR","message":"服务接口异常，请联系管理员"}}

请求示例代码

假设平台用户组AppKey=884c8fc4054548a7b1ca1123592f5b7，模型ID=96dcaaaaaaaaaaaa5ff55ea377831a，以此为例进行说明。

curl方式请求

curl --request POST \
  --url https://wishub-x1.ctyun.cn/v1/chat/completions \
  --header 'Accept: */*' \
  --header 'Accept-Encoding: gzip, deflate, br' \
  --header 'Authorization: Bearer 884c8fc4054548a7b1ca1123592f5b7' \
  --header 'Content-Type: application/json' \
  --data '{
        "model": "96dcaaaaaaaaaaaa5ff55ea377831a",
        "messages": [
                {
                        "role": "user",
                        "content": "Hello"
                }
        ]
}'

python方式请求

import json
import requests
URL = "https://wishub-x1.ctyun.cn/v1/chat/completions"
headers = {
    "Authorization": "Bearer 884c8fc4054548a7b1ca1123592f5b7",
    "Content-Type": "application/json"
}
data = {
    "model": "96dcaaaaaaaaaaaa5ff55ea377831a",
    "messages": [
        {"role": "user", "content": "Hello"}
    ],
    "stream": True
}
try:
    response = requests.post(URL, headers=headers, json=data, stream=True)
    if response.status_code != 200:
        print(response.text)
    else
        for line in response.iter_lines(chunk_size=8192, decode_unicode=True):
            ## 处理请求
            if line :
                if "[DONE]" == line:
                     break
                # 去除data前缀:
                json_string = line.removeprefix("data:")
                # 转为json: 
                jsonData = json.loads(json_string)
                # 判断是否有值
                if "choices" in jsonData and len(jsonData["choices"][0]) > 0:
                    firstChoice = jsonData["choices"][0]
                    # 取content的逻辑
                    if "delta" in firstChoice and "content" in firstChoice["delta"] :
                        # content内容
                        print(firstChoice["delta"]["content"])
except Exception as e:
    print(f"Exception: {e}")

openai 客户端示例代码

import openai
from openai import OpenAI
client = OpenAI(base_url="https://wishub-x1.ctyun.cn/v1", api_key="884c8fc4054548a7b1ca1123592f5b7")
messages = [
    {"role": "user", "content": "Hello"}
]
try:
    stream = client.chat.completions.create(
        model="96dcaaaaaaaaaaaa5ff55ea377831a",
        messages=messages,
        stream=True 
    )
    # 流式
    for chunk in stream:
        print(chunk.choices[0].delta.content or "", end="", flush=True)
except openai.APIStatusError as e:
    print(f"APIStatusError: {e.status_code}, {e.message}, {e.body}")
except openai.APIError as e:
    print(f"APIError: {e.body}")
except Exception as e:
    print(f"Exception: {e}")