Class ServerLlmInferenceApi

java.lang.Object

com.github.copilot.generated.rpc.ServerLlmInferenceApi

@Generated("copilot-sdk-codegen")
public final class ServerLlmInferenceApi
extends Object

API methods for the llmInference namespace.

Since:

1.0.0

Method Summary

Modifier and Type	Method	Description
CompletableFuture<LlmInferenceHttpResponseChunkResult>	httpResponseChunk(LlmInferenceHttpResponseChunkParams params)	Delivers a body byte range (or a terminal transport error) for an in-flight response, correlated by requestId.
CompletableFuture<LlmInferenceHttpResponseStartResult>	httpResponseStart(LlmInferenceHttpResponseStartParams params)	Delivers the response head (status + headers) for an in-flight request, correlated by the requestId the runtime supplied in httpRequestStart.
CompletableFuture<LlmInferenceSetProviderResult>	setProvider()	Registers an SDK client as the LLM inference callback provider.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

setProvider

@CopilotExperimental
public CompletableFuture<LlmInferenceSetProviderResult> setProvider()

Registers an SDK client as the LLM inference callback provider.

Since:

1.0.0

httpResponseStart

@CopilotExperimental
public CompletableFuture<LlmInferenceHttpResponseStartResult> httpResponseStart(LlmInferenceHttpResponseStartParams params)

Delivers the response head (status + headers) for an in-flight request, correlated by the requestId the runtime supplied in httpRequestStart. Must be called exactly once per request before any httpResponseChunk frames.

Since:

1.0.0

httpResponseChunk

@CopilotExperimental
public CompletableFuture<LlmInferenceHttpResponseChunkResult> httpResponseChunk(LlmInferenceHttpResponseChunkParams params)

Delivers a body byte range (or a terminal transport error) for an in-flight response, correlated by requestId. Set `end` true on the last chunk. When `error` is set the response terminates with a transport-level failure and the runtime raises an APIConnectionError.

Since:

1.0.0