Class OpenAiModel

constructor

• new OpenAiModel(id, model, enableStreaming, apiKey, url, defaultRequestSettings?): OpenAiModel

• Parameters

  • id: string

    the unique id for this language model. It will be used to identify the model in the UI.
  • model: string

    the model id as it is used by the OpenAI API
  • enableStreaming: boolean

    whether the streaming API shall be used
  • apiKey: (() => undefined | string)

    a function that returns the API key to use for this model, called on each request

    • • (): undefined | string

      • Returns undefined | string

  • url: undefined | string

    the OpenAI API compatible endpoint where the model is hosted. If not provided the default OpenAI endpoint will be used.
  • Optional defaultRequestSettings: {
        [key: string]: unknown;
    }

    optional default settings for requests made using this model.

    • [key: string]: unknown

  Returns OpenAiModel

apiKey

Optional defaultRequestSettings

enableStreaming

Readonly id

model

url

request

• request(request, cancellationToken?): Promise<LanguageModelResponse>

• Parameters

  • request: LanguageModelRequest
  • Optional cancellationToken: CancellationToken

  Returns Promise<LanguageModelResponse>