Class StreamingAsyncIterator

Implements

AsyncIterableIterator<LanguageModelStreamResponsePart>
Disposable

Index

Constructors

Properties

done messageCache model? requestId requestQueue stream terminalError toDispose tokenUsageService?

Methods

[asyncIterator] dispose handleIncoming next registerStreamListener

Constructors

constructor

new StreamingAsyncIterator(
    stream: ChatCompletionStream,
    requestId: string,
    cancellationToken?: CancellationToken,
    tokenUsageService?: TokenUsageService,
    model?: string,
): StreamingAsyncIterator
Parameters
- stream: ChatCompletionStream
- requestId: string
- OptionalcancellationToken: CancellationToken
- OptionaltokenUsageService: TokenUsageService
- Optionalmodel: string
Returns StreamingAsyncIterator
- Defined in src/node/openai-streaming-iterator.ts:32

Properties

`Protected`done

done: boolean = false

`Protected` `Readonly`messageCache

messageCache: LanguageModelStreamResponsePart[] = ...

`Protected` `Optional` `Readonly`model

model?: string

`Protected` `Readonly`requestId

requestId: string

`Protected` `Readonly`requestQueue

requestQueue: Deferred<IterResult>[] = ...

`Protected` `Readonly`stream

stream: ChatCompletionStream

`Protected`terminalError

terminalError: undefined | Error = undefined

`Protected` `Readonly`toDispose

toDispose: DisposableCollection = ...

`Protected` `Optional` `Readonly`tokenUsageService

tokenUsageService?: TokenUsageService

Methods

[asyncIterator]

"[asyncIterator]"(): AsyncIterableIterator<LanguageModelStreamResponsePart>
Returns AsyncIterableIterator<LanguageModelStreamResponsePart>
Implementation of AsyncIterableIterator.[asyncIterator]
- Defined in src/node/openai-streaming-iterator.ts:102

dispose

dispose(): void
Dispose this object.

Returns void
Implementation of Disposable.dispose
- Defined in src/node/openai-streaming-iterator.ts:151

`Protected`handleIncoming

handleIncoming(message: LanguageModelStreamResponsePart): void
Parameters
- message: LanguageModelStreamResponsePart
Returns void
- Defined in src/node/openai-streaming-iterator.ts:128

next

next(): Promise<IterResult>
NOTE: 'next' is defined using a tuple to ensure we report the correct assignability errors in all places.

Returns Promise<IterResult>
Implementation of AsyncIterableIterator.next
- Defined in src/node/openai-streaming-iterator.ts:104

`Protected`registerStreamListener

registerStreamListener<Event extends keyof ChatCompletionStreamEvents<null>>(
    eventType: Event,
    handler: ChatCompletionStreamEvents<null>[Event],
    once?: boolean,
): void
Type Parameters
- Event extends keyof ChatCompletionStreamEvents<null>
Parameters
- eventType: Event
- handler: ChatCompletionStreamEvents<null>[Event]
- Optionalonce: boolean
Returns void
- Defined in src/node/openai-streaming-iterator.ts:142