参数化生成请求（with Options）

POST

http://localhost:11434/api/generate

If you want to set custom options for the model at runtime rather than in the Modelfile, you can do so with the options parameter. This example sets every available option, but you can set any of them individually and omit the ones you do not want to override.

请求示例

Shell

JavaScript

Java

Swift

curl --location --request POST 'http://localhost:11434/api/generate' \
--header 'Content-Type: application/json' \
--data-raw '{
    "model": "llama2-7b",
    "prompt": "请用中文回答以下问题",
    "stream": false,
    "options": {
        "num_keep": 1024,
        "seed": 42,
        "num_predict": 128,
        "top_k": 40,
        "top_p": 0.9,
        "temperature": 0.8,
        "repeat_penalty": 1.1,
        "stop": [
            "\n",
            "。"
        ]
    }
}'

响应示例

{
  "model": "llama3.2",
  "created_at": "2023-08-04T19:22:45.499127Z",
  "response": "The sky is blue because it is the color of the sky.",
  "done": true,
  "context": [1, 2, 3],
  "total_duration": 4935886791,
  "load_duration": 534986708,
  "prompt_eval_count": 26,
  "prompt_eval_duration": 107345000,
  "eval_count": 237,
  "eval_duration": 4289432000
}

请求参数

Body 参数application/json

示例

返回响应

🟢200Success

application/json

Body

修改于 2025-03-26 10:16:41

可复现输出请求（Reproducible Outputs）

加载模型