Class LlamafileManagerImpl

Implements

LlamafileManager

Index

Constructors

Properties

client languageModelRegistry processMap

Methods

addLanguageModels getStartedLlamafiles isStarted removeLanguageModels setClient startServer stopServer updateRequestSettings

Constructors

constructor

new LlamafileManagerImpl(): LlamafileManagerImpl
Returns LlamafileManagerImpl

Properties

`Private` client

client: LlamafileServerManagerClient

`Protected` languageModelRegistry

languageModelRegistry: LanguageModelRegistry

`Private` processMap

processMap: Map<string, ChildProcessWithoutNullStreams> = ...

Methods

addLanguageModels

addLanguageModels(LlamafileModelDescriptions): Promise<void>
Parameters
- LlamafileModelDescriptions: LlamafileModelDescription[]
Returns Promise<void>
Implementation of LlamafileManager.addLanguageModels
- Defined in packages/ai-llamafile/src/node/llamafile-manager-impl.ts:33

getStartedLlamafiles

getStartedLlamafiles(): Promise<string[]>
Returns Promise<string[]>
Implementation of LlamafileManager.getStartedLlamafiles
- Defined in packages/ai-llamafile/src/node/llamafile-manager-impl.ts:74

isStarted

isStarted(name): boolean
Parameters
- name: string
Returns boolean
- Defined in packages/ai-llamafile/src/node/llamafile-manager-impl.ts:121

removeLanguageModels

removeLanguageModels(modelIds): void
Parameters
- modelIds: string[]
Returns void
Implementation of LlamafileManager.removeLanguageModels
- Defined in packages/ai-llamafile/src/node/llamafile-manager-impl.ts:69

setClient

setClient(client): void
Parameters
- client: LlamafileServerManagerClient
Returns void
Implementation of LlamafileManager.setClient
- Defined in packages/ai-llamafile/src/node/llamafile-manager-impl.ts:125

startServer

startServer(name): Promise<void>
Parameters
- name: string
Returns Promise<void>
Implementation of LlamafileManager.startServer
- Defined in packages/ai-llamafile/src/node/llamafile-manager-impl.ts:79

stopServer

stopServer(name): void
Parameters
- name: string
Returns void
Implementation of LlamafileManager.stopServer
- Defined in packages/ai-llamafile/src/node/llamafile-manager-impl.ts:113

updateRequestSettings

updateRequestSettings(modelId, requestSettings?): Promise<void>
Parameters
- modelId: string
- Optional requestSettings: {
  [key: string]: unknown;
  }
  - [key: string]: unknown
Returns Promise<void>
Implementation of LlamafileManager.updateRequestSettings
- Defined in packages/ai-llamafile/src/node/llamafile-manager-impl.ts:57