Class OllamaModel

Protected ReadonlyDEFAULT_REQUEST_SETTINGS

Protectedhost

Protected Readonlymodel

Protected Optional ReadonlytokenUsageService

ProtectedcheckThinkingSupport

• checkThinkingSupport(ollama: Ollama, model: string): Promise<boolean>

  Check if the Ollama server supports thinking.

  Use the Ollama 'show' request to get information about the model, so we can check the capabilities for the 'thinking' capability.

  Parameters

  • ollama: Ollama

    The Ollama client instance.

  • model: string

    The name of the Ollama model.

  Returns Promise<boolean>

  A boolean indicating whether the Ollama model supports thinking.

ProtecteddispatchRequest

• dispatchRequest(
      ollama: Ollama,
      ollamaRequest: ExtendedChatRequest,
      structured: boolean,
      cancellation?: CancellationToken,
  ): Promise<LanguageModelResponse>

  Parameters

  • ollama: Ollama
  • ollamaRequest: ExtendedChatRequest
  • structured: boolean
  • Optionalcancellation: CancellationToken

  Returns Promise<LanguageModelResponse>

ProtectedgetSettings

• getSettings(request: LanguageModelRequest): Partial<ChatRequest>

  Retrieves the settings for the chat request, merging the request-specific settings with the default settings.

  Parameters

  • request: LanguageModelRequest

    The language model request containing specific settings.

  Returns Partial<ChatRequest>

  A partial ChatRequest object containing the merged settings.

ProtectedhandleNonStreamingRequest

• handleNonStreamingRequest(
      ollama: Ollama,
      chatRequest: ExtendedNonStreamingChatRequest,
      cancellation?: CancellationToken,
  ): Promise<LanguageModelResponse>

  Parameters

  • ollama: Ollama
  • chatRequest: ExtendedNonStreamingChatRequest
  • Optionalcancellation: CancellationToken

  Returns Promise<LanguageModelResponse>

ProtectedhandleStreamingRequest

• handleStreamingRequest(
      ollama: Ollama,
      chatRequest: ExtendedChatRequest,
      cancellation?: CancellationToken,
  ): Promise<LanguageModelStreamResponse>

  Parameters

  • ollama: Ollama
  • chatRequest: ExtendedChatRequest
  • Optionalcancellation: CancellationToken

  Returns Promise<LanguageModelStreamResponse>

ProtectedhandleStructuredOutputRequest

• handleStructuredOutputRequest(
      ollama: Ollama,
      chatRequest: ChatRequest,
  ): Promise<LanguageModelParsedResponse>

  Parameters

  • ollama: Ollama
  • chatRequest: ChatRequest

  Returns Promise<LanguageModelParsedResponse>

ProtectedinitializeOllama

• initializeOllama(): Ollama

  Returns Ollama

ProtectedtoOllamaMessage

• toOllamaMessage(message: LanguageModelMessage): undefined | Message

  Parameters

  • message: LanguageModelMessage

  Returns undefined | Message

ProtectedtoOllamaMessageRole

• toOllamaMessageRole(message: LanguageModelMessage): string

  Parameters

  • message: LanguageModelMessage

  Returns string

ProtectedtoOllamaTool

• toOllamaTool(tool: ToolRequest): ToolWithHandler

  Parameters

  • tool: ToolRequest

  Returns ToolWithHandler