Fields
| Field | Type | Required | Description | Example |
|---|---|---|---|---|
completions | Optional[components.UpdatePrivateEndpointSettingsRequestCompletions] | ➖ | N/A | |
context_length | OptionalNullable[int] | ➖ | Longest prompt plus completion, in tokens, or null to keep the model default. | 128000 |
excluded_parameters | List[components.UpdatePrivateEndpointSettingsRequestExcludedParameter] | ➖ | Request parameters the upstream rejects even though the model supports them; requests using one do not route here. Cannot name a tested parameter. | [ “logit_bias” ] |
inputs | Optional[components.UpdatePrivateEndpointSettingsRequestInputs] | ➖ | N/A | |
max_completion_tokens | OptionalNullable[int] | ➖ | Longest completion the upstream returns, in tokens, or null to keep the model default. | 16384 |
max_prompt_tokens | OptionalNullable[int] | ➖ | Longest prompt, in tokens, or null for no cap below the context length. Cannot exceed context_length, or the model context length while context_length is null. | null |
quantization | Optional[components.PrivateEndpointQuantization] | ➖ | Weight precision the deployment runs at; unknown when not stated. | bf16 |
reasoning | Optional[components.UpdatePrivateEndpointSettingsRequestReasoning] | ➖ | N/A | |
tool_choice | Optional[components.UpdatePrivateEndpointSettingsRequestToolChoice] | ➖ | N/A |