Class OpenAiModel

constructor

• new OpenAiModel(
      id: string,
      model: string,
      status: LanguageModelStatus,
      enableStreaming: boolean,
      apiKey: () => undefined | string,
      apiVersion: () => undefined | string,
      supportsStructuredOutput: boolean,
      url: undefined | string,
      deployment: undefined | string,
      openAiModelUtils: OpenAiModelUtils,
      developerMessageSettings?: DeveloperMessageSettings,
      maxRetries?: number,
      tokenUsageService?: TokenUsageService,
  ): OpenAiModel

  Parameters

  • id: string

    the unique id for this language model. It will be used to identify the model in the UI.

  • model: string

    the model id as it is used by the OpenAI API

  • status: LanguageModelStatus
  • enableStreaming: boolean

    whether the streaming API shall be used

  • apiKey: () => undefined | string

    a function that returns the API key to use for this model, called on each request

  • apiVersion: () => undefined | string

    a function that returns the OpenAPI version to use for this model, called on each request

  • supportsStructuredOutput: boolean
  • url: undefined | string

    the OpenAI API compatible endpoint where the model is hosted. If not provided the default OpenAI endpoint will be used.

  • deployment: undefined | string
  • openAiModelUtils: OpenAiModelUtils
  • developerMessageSettings: DeveloperMessageSettings = 'developer'

    how to handle system messages

  • maxRetries: number = 3

    the maximum number of retry attempts when a request fails

  • OptionaltokenUsageService: TokenUsageService

  Returns OpenAiModel

apiKey

apiVersion

deployment

developerMessageSettings

enableStreaming

Readonlyid

maxRetries

model

openAiModelUtils

status

supportsStructuredOutput

url

request

• request(
      request: UserRequest,
      cancellationToken?: CancellationToken,
  ): Promise<LanguageModelResponse>

  Parameters

  • request: UserRequest
  • OptionalcancellationToken: CancellationToken

  Returns Promise<LanguageModelResponse>