Class LlamafileManagerImpl

Implements

LlamafileManager

Index

Constructors

Properties

languageModelRegistry logger

Methods

addLanguageModels attachProcessHandlers calculateStatus getLlamafileModel getStartedLlamafiles isStarted removeLanguageModels setClient spawnLlamafileProcess startServer stopServer updateLanguageModelStatus

Constructors

constructor

new LlamafileManagerImpl(): LlamafileManagerImpl
Returns LlamafileManagerImpl

Properties

`Protected`languageModelRegistry

languageModelRegistry: LanguageModelRegistry

`Protected` `Readonly`logger

logger: ILogger

Methods

addLanguageModels

addLanguageModels(
LlamafileModelDescriptions: LlamafileModelDescription[],
): Promise<void>
Parameters
- LlamafileModelDescriptions: LlamafileModelDescription[]
Returns Promise<void>
Implementation of LlamafileManager.addLanguageModels
- Defined in node/llamafile-manager-impl.ts:37

`Protected`attachProcessHandlers

attachProcessHandlers(
name: string,
currentProcess: ChildProcessWithoutNullStreams,
): void
Parameters
- name: string
- currentProcess: ChildProcessWithoutNullStreams
Returns void
- Defined in node/llamafile-manager-impl.ts:99

`Protected`calculateStatus

calculateStatus(started: boolean, message?: string): LanguageModelStatus
Parameters
- started: boolean
- Optionalmessage: string
Returns LanguageModelStatus
- Defined in node/llamafile-manager-impl.ts:130

`Protected`getLlamafileModel

getLlamafileModel(name: string): Promise<undefined | LlamafileLanguageModel>
Parameters
- name: string
Returns Promise<undefined | LlamafileLanguageModel>
- Defined in node/llamafile-manager-impl.ts:87

getStartedLlamafiles

getStartedLlamafiles(): Promise<string[]>
Returns Promise<string[]>
Implementation of LlamafileManager.getStartedLlamafiles
- Defined in node/llamafile-manager-impl.ts:66

isStarted

isStarted(name: string): boolean
Parameters
- name: string
Returns boolean
- Defined in node/llamafile-manager-impl.ts:148

removeLanguageModels

removeLanguageModels(modelIds: string[]): void
Parameters
- modelIds: string[]
Returns void
Implementation of LlamafileManager.removeLanguageModels
- Defined in node/llamafile-manager-impl.ts:61

setClient

setClient(client: LlamafileServerManagerClient): void
Parameters
- client: LlamafileServerManagerClient
Returns void
Implementation of LlamafileManager.setClient
- Defined in node/llamafile-manager-impl.ts:152

`Protected`spawnLlamafileProcess

spawnLlamafileProcess(
llm: LlamafileLanguageModel,
): ChildProcessWithoutNullStreams
Parameters
- llm: LlamafileLanguageModel
Returns ChildProcessWithoutNullStreams
- Defined in node/llamafile-manager-impl.ts:92

startServer

startServer(name: string): Promise<void>
Parameters
- name: string
Returns Promise<void>
Implementation of LlamafileManager.startServer
- Defined in node/llamafile-manager-impl.ts:71

stopServer

stopServer(name: string): void
Parameters
- name: string
Returns void
Implementation of LlamafileManager.stopServer
- Defined in node/llamafile-manager-impl.ts:138

`Protected`updateLanguageModelStatus

updateLanguageModelStatus(
    modelId: string,
    hasStarted: boolean,
    message?: string,
): Promise<void>
Parameters
- modelId: string
- hasStarted: boolean
- Optionalmessage: string
Returns Promise<void>
- Defined in node/llamafile-manager-impl.ts:123