Class LlamafileLanguageModel

constructor

• new LlamafileLanguageModel(name, uri, port): LlamafileLanguageModel

• Parameters

  • name: string

    the unique name for this language model. It will be used to identify the model in the UI.
  • uri: string

    the URI pointing to the Llamafile model location.
  • port: number

    the port on which the Llamafile model server operates.

  Returns LlamafileLanguageModel

Readonly name

Readonly port

Readonly providerId

Readonly uri

Readonly vendor

id

• get id(): string

• Returns string

request

• request(request, cancellationToken?): Promise<LanguageModelResponse>

• Parameters

  • request: LanguageModelRequest
  • Optional cancellationToken: CancellationToken

  Returns Promise<LanguageModelResponse>