Class LlamafileLanguageModel

constructor

• new LlamafileLanguageModel(name, uri, port, defaultRequestSettings?): LlamafileLanguageModel

• Parameters

  • name: string

    the unique name for this language model. It will be used to identify the model in the UI.
  • uri: string

    the URI pointing to the Llamafile model location.
  • port: number

    the port on which the Llamafile model server operates.
  • Optional defaultRequestSettings: {
        [key: string]: unknown;
    }

    optional default settings for requests made using this model.

    • [key: string]: unknown

  Returns LlamafileLanguageModel

Optional defaultRequestSettings

Readonly name

Readonly port

Readonly providerId

Readonly uri

Readonly vendor

id

• get id(): string

• Returns string

request

• request(request, cancellationToken?): Promise<LanguageModelResponse>

• Parameters

  • request: LanguageModelRequest
  • Optional cancellationToken: CancellationToken

  Returns Promise<LanguageModelResponse>