GPT-3.5 Turbo Instruct

POST/v1/chat/completions

This model is a variant of GPT-3.5 Turbo tuned for instructional prompts and omitting chat-related optimizations. Training data: up to Sep 2021.

Request body

Parameters supported by this model. Values, defaults, and limits are read from the model registry.

stringmodelrequired

Model identifier. Set to openai/gpt-3.5-turbo-instruct.

Default: openai/gpt-3.5-turbo-instruct

array<object>messagesrequired

Conversation messages in system, user, or assistant order.

Optional<integer>max_tokens

Maximum number of tokens the model may generate in the response.

Range: −∞ to 4096

Optional<number>temperature

Sampling temperature. Lower values are more deterministic; higher values are more creative.

Range: 0 to 2

Default: 1

Optional<number>top_p

Nucleus sampling threshold. Use this or temperature, but usually not both.

Range: 0 to 1

Optional<boolean>stream

When true, returns incremental Server-Sent Events instead of one completed response.

Default: false

Optional<object>response_format

Controls the response format, including JSON mode or structured JSON output when supported.

Optional<array<string>>stop

Sequences that stop generation when the model produces one of them.

Optional<number>presence_penalty

Penalizes tokens that already appeared, encouraging the model to introduce new topics.

Range: -2 to 2

Optional<number>frequency_penalty

Penalizes repeated tokens, reducing repetition in the generated response.

Range: -2 to 2

Optional<integer>seed

Seed used to make sampling more reproducible when the provider supports it.

Response Schema

Fields returned by this model API response.

array<object>choicesrequired

Generated completion choices.

stringidrequired

Unique chat completion identifier.

stringmodelrequired

Model that generated the response.

Optional<object>usage

Token usage when available.

Model capabilities

array<string>capability_tagsrequired

Capabilities declared by the model registry.

Default: chat, structured_output

integercontext_lengthrequired

Maximum context window accepted by this model.

Default: 4095 tokens

stringexecution_moderequired

Execution mode declared by the model registry.

Default: sync

curl -X POST https://api.sandbase.ai/v1/chat/completions \
  -H "Authorization: Bearer $SANDBASE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "model": "openai/gpt-3.5-turbo-instruct",
  "messages": [
    {
      "role": "user",
      "content": "Describe this product in one sentence."
    }
  ]
}'

Response200 OK

{
  "id": "chatcmpl_abc123",
  "model": "openai/gpt-3.5-turbo-instruct",
  "choices": [
    {
      "message": {
        "role": "assistant",
        "content": "A concise product description."
      }
    }
  ]
}