Skip to content
sgp
API Reference

Inference

Run inference with free-form payload
POST/v5/inference
ModelsExpand Collapse
InferenceResponse object { response, object }
response: map[unknown] or array of unknown or string or 2 more
One of the following:
map[unknown]
array of unknown
string
number
boolean
object: optional "generic_inference"
InferenceResponseChunk object { response, object }
response: map[unknown] or array of unknown or string or 2 more
One of the following:
map[unknown]
array of unknown
string
number
boolean
object: optional "generic_inference.chunk"
LaunchInferenceConfiguration object { num_retries, timeout_seconds }
num_retries: optional number
timeout_seconds: optional number
InferenceCreateResponse = InferenceResponse { response, object } or InferenceResponseChunk { response, object }
One of the following:
InferenceResponse object { response, object }
response: map[unknown] or array of unknown or string or 2 more
One of the following:
map[unknown]
array of unknown
string
number
boolean
object: optional "generic_inference"
InferenceResponseChunk object { response, object }
response: map[unknown] or array of unknown or string or 2 more
One of the following:
map[unknown]
array of unknown
string
number
boolean
object: optional "generic_inference.chunk"