Skip to main content

Generate Response

Generate Response

Request Body — REQUIRED
stream boolean
timeout number
maxRetries number
data object[] — REQUIRED
providerId uuid — REQUIRED
modelId uuid — REQUIRED
promptParams object — REQUIRED
messages object[]
role — REQUIRED
content string — REQUIRED
prompt string
temperature number
top_p number
n number
stop
max_tokens number
presence_penalty number
frequency_penalty number
logit_bias
user string
functions object[]
function_call object
order number — REQUIRED
Responses
200

Default Response

Schema — OPTIONAL
id string
choices object[]
index number
text string
finish_reason string
role string — OPTIONAL
function_call — OPTIONAL
model string
providerId uuid — OPTIONAL
modelId uuid — OPTIONAL
meta object
usage object — OPTIONAL
completion_tokens number
prompt_tokens number
total_tokens number