## Run inference with free-form payload

**post** `/v5/inference`

Runs a model using a free-form, vendor-native request payload rather than a fixed OpenAI schema.

Use this endpoint when the target model does not fit the OpenAI chat, responses, or
text-completion contracts: the `args` field is an arbitrary dict passed straight through to the
selected vendor gateway, and the reply is returned inside `response` as arbitrary JSON (object,
array, string, number, or boolean). Prefer /v5/chat/completions, /v5/responses, or /v5/completions
when your request matches one of those OpenAI-standard shapes, since those return typed OpenAI
response objects. The model is chosen from the `model` field formatted as `vendor/name`, which
selects the per-vendor inference gateway. When the request enables streaming, the response is sent
as server-sent events with each chunk wrapped as a `generic_inference.chunk` object; otherwise a
single `generic_inference` object is returned.

### Body Parameters

- `model: string`

  model specified as `vendor/name` (ex. openai/gpt-5)

- `args: optional map[unknown]`

  Arguments passed into model

- `inference_configuration: optional LaunchInferenceConfiguration`

  Vendor specific configuration

  - `num_retries: optional number`

  - `timeout_seconds: optional number`

### Returns

- `InferenceResponse object { response, object }`

  - `response: map[unknown] or array of unknown or string or 2 more`

    - `map[unknown]`

    - `array of unknown`

    - `string`

    - `number`

    - `boolean`

  - `object: optional "generic_inference"`

    - `"generic_inference"`

- `InferenceResponseChunk object { response, object }`

  - `response: map[unknown] or array of unknown or string or 2 more`

    - `map[unknown]`

    - `array of unknown`

    - `string`

    - `number`

    - `boolean`

  - `object: optional "generic_inference.chunk"`

    - `"generic_inference.chunk"`

### Example

```http
curl https://api.egp.scale.com/v5/inference \
    -H 'Content-Type: application/json' \
    -H "x-api-key: $SGP_API_KEY" \
    -d '{
          "model": "model"
        }'
```

#### Response

```json
{
  "response": {
    "foo": "bar"
  },
  "object": "generic_inference"
}
```