Class OllamaModel

Implements

  • LanguageModel

Constructors

constructor

Properties

DEFAULT_REQUEST_SETTINGS host id model providerId vendor

Methods

createAsyncIterable createMessageContent dispatchRequest getSettings handleCancellationAndWrapIterator handleStructuredOutputRequest handleToolsRequest initializeOllama request toOllamaMessage toOllamaTool

Constructors

constructor

  • new OllamaModel(id, model, host): OllamaModel

  • Parameters

    • id: string

      the unique id for this language model. It will be used to identify the model in the UI.

    • model: string

      the unique model name as used in the Ollama environment.

    • host: (() => undefined | string)
        • (): undefined | string

        • Returns undefined | string

    Returns OllamaModel

Properties

Protected Readonly DEFAULT_REQUEST_SETTINGS

DEFAULT_REQUEST_SETTINGS: Partial<Omit<ChatRequest, "stream" | "model">> = ...

Protected host

host: (() => undefined | string)

Type declaration

    • (): undefined | string

    • Returns undefined | string

Readonly id

id: string

the unique id for this language model. It will be used to identify the model in the UI.

Protected Readonly model

model: string

the unique model name as used in the Ollama environment.

Readonly providerId

providerId: "ollama" = 'ollama'

Readonly vendor

vendor: string = 'Ollama'

Methods

Protected createAsyncIterable

Private createMessageContent

Protected dispatchRequest

  • dispatchRequest(ollama, ollamaRequest, structured, cancellation?): Promise<LanguageModelResponse>

  • Parameters

    • ollama: Ollama
    • ollamaRequest: ExtendedChatRequest
    • structured: boolean
    • Optional cancellation: CancellationToken

    Returns Promise<LanguageModelResponse>

Protected getSettings

  • getSettings(request): Partial<ChatRequest>

  • Retrieves the settings for the chat request, merging the request-specific settings with the default settings.

    Parameters

    • request: LanguageModelRequest

      The language model request containing specific settings.

    Returns Partial<ChatRequest>

    A partial ChatRequest object containing the merged settings.

Protected handleCancellationAndWrapIterator

Protected handleStructuredOutputRequest

Protected handleToolsRequest

  • handleToolsRequest(ollama, chatRequest, prevResponse?): Promise<LanguageModelResponse>

  • Parameters

    • ollama: Ollama
    • chatRequest: ExtendedChatRequest
    • Optional prevResponse: ChatResponse

    Returns Promise<LanguageModelResponse>

Protected initializeOllama

request

  • request(request, cancellationToken?): Promise<LanguageModelResponse>

  • Parameters

    • request: LanguageModelRequest
    • Optional cancellationToken: CancellationToken

    Returns Promise<LanguageModelResponse>

Protected toOllamaMessage

Protected toOllamaTool

Settings

Member Visibility

Theme

On This Page

constructorDEFAULT_REQUEST_SETTINGShostidmodelproviderIdvendorcreateAsyncIterablecreateMessageContentdispatchRequestgetSettingshandleCancellationAndWrapIteratorhandleStructuredOutputRequesthandleToolsRequestinitializeOllamarequesttoOllamaMessagetoOllamaTool