Class LanguageModelFrontendDelegateImpl

Implements

LanguageModelFrontendDelegate

Index

Constructors

Properties

frontendDelegateClient logger registry requestCancellationTokenMap

Methods

cancel request sendTokens setClient

Constructors

constructor

new LanguageModelFrontendDelegateImpl(): LanguageModelFrontendDelegateImpl
Returns LanguageModelFrontendDelegateImpl

Properties

`Private` frontendDelegateClient

frontendDelegateClient: LanguageModelDelegateClient

`Private` logger

logger: ILogger

`Private` registry

registry: LanguageModelRegistry

`Private` requestCancellationTokenMap

requestCancellationTokenMap: Map<string, CancellationTokenSource> = ...

Methods

cancel

cancel(requestId): void
Parameters
- requestId: string
Returns void
Implementation of LanguageModelFrontendDelegate.cancel
- Defined in packages/ai-core/src/node/language-model-frontend-delegate.ts:66

request

request(modelId, request, requestId, cancellationToken?): Promise<LanguageModelResponseDelegate>
Parameters
- modelId: string
- request: LanguageModelRequest
- requestId: string
- Optional cancellationToken: CancellationToken
Returns Promise<LanguageModelResponseDelegate>
Implementation of LanguageModelFrontendDelegate.request
- Defined in packages/ai-core/src/node/language-model-frontend-delegate.ts:70

`Protected` sendTokens

sendTokens(id, stream): void
Parameters
- id: string
- stream: AsyncIterable<LanguageModelStreamResponsePart>
Returns void
- Defined in packages/ai-core/src/node/language-model-frontend-delegate.ts:108

setClient

setClient(client): void
Parameters
- client: LanguageModelDelegateClient
Returns void
- Defined in packages/ai-core/src/node/language-model-frontend-delegate.ts:62