API Reference

Copy Markdown

Open in Claude

Open in ChatGPT

Open in Cursor

---

Copy Markdown

View as Markdown

Inference

Run inference with free-form payload

client.Inference.New(ctx, body) (*InferenceNewResponseUnion, error)

POST/v5/inference

ModelsExpand Collapse

type InferenceResponse struct{…}

Response InferenceResponseResponseUnion

One of the following:

type InferenceResponseResponseMap map[string, any]

type InferenceResponseResponseArray []any

string

float64

bool

Object InferenceResponseObjectOptional

type InferenceResponseChunk struct{…}

Response InferenceResponseChunkResponseUnion

One of the following:

type InferenceResponseChunkResponseMap map[string, any]

type InferenceResponseChunkResponseArray []any

string

float64

bool

Object InferenceResponseChunkObjectOptional

type LaunchInferenceConfiguration struct{…}

NumRetries int64Optional

TimeoutSeconds int64Optional