Class LlamafileLanguageModel

See also VS Code ILanguageModelChatMetadata

Implements

LanguageModel

Index

Constructors

Properties

name port providerId status uri vendor

Accessors

Methods

getSettings request

Constructors

constructor

new LlamafileLanguageModel(
    name: string,
    status: LanguageModelStatus,
    uri: string,
    port: number,
): LlamafileLanguageModel
Parameters
- name: string
  the unique name for this language model. It will be used to identify the model in the UI.
- status: LanguageModelStatus
- uri: string
  the URI pointing to the Llamafile model location.
- port: number
  the port on which the Llamafile model server operates.
Returns LlamafileLanguageModel
- Defined in common/llamafile-language-model.ts:37

Properties

`Readonly`name

name: string

the unique name for this language model. It will be used to identify the model in the UI.

`Readonly`port

port: number

the port on which the Llamafile model server operates.

`Readonly`providerId

providerId: "llamafile" = 'llamafile'

status

status: LanguageModelStatus

`Readonly`uri

uri: string

the URI pointing to the Llamafile model location.

`Readonly`vendor

vendor: string = 'Mozilla'

Accessors

id

get id(): string
Returns string
Implementation of LanguageModel.id
- Defined in common/llamafile-language-model.ts:44

Methods

`Protected`getSettings

getSettings(request: LanguageModelRequest): Record<string, unknown>
Parameters
- request: LanguageModelRequest
Returns Record<string, unknown>
- Defined in common/llamafile-language-model.ts:47

request

request(
request: LanguageModelRequest,
cancellationToken?: CancellationToken,
): Promise<LanguageModelResponse>
Parameters
- request: LanguageModelRequest
- OptionalcancellationToken: CancellationToken
Returns Promise<LanguageModelResponse>
Implementation of LanguageModel.request
- Defined in common/llamafile-language-model.ts:57