Class OllamaModel

Protected ReadonlyDEFAULT_REQUEST_SETTINGS

Protectedhost

Protected Readonlymodel

ProtectedcheckThinkingSupport

• checkThinkingSupport(ollama: Ollama, model: string): Promise<boolean>

  Check if the Ollama server supports thinking.

  Use the Ollama 'show' request to get information about the model, so we can check the capabilities for the 'thinking' capability.

  Parameters

  • ollama: Ollama

    The Ollama client instance.

  • model: string

    The name of the Ollama model.

  Returns Promise<boolean>

  A boolean indicating whether the Ollama model supports thinking.

ProtecteddispatchRequest

• dispatchRequest(
      ollama: Ollama,
      ollamaRequest: ExtendedChatRequest,
      structured: boolean,
      cancellation?: CancellationToken,
      reasoning?: ReasoningSettings,
  ): Promise<LanguageModelResponse>

  Parameters

  • ollama: Ollama
  • ollamaRequest: ExtendedChatRequest
  • structured: boolean
  • Optionalcancellation: CancellationToken
  • Optionalreasoning: ReasoningSettings

  Returns Promise<LanguageModelResponse>

ProtectedgetSettings

• getSettings(request: LanguageModelRequest): Partial<ChatRequest>

  Retrieves the settings for the chat request, merging the request-specific settings with the default settings.

  Parameters

  • request: LanguageModelRequest

    The language model request containing specific settings.

  Returns Partial<ChatRequest>

  A partial ChatRequest object containing the merged settings.

ProtectedgetThinkingParameter

• getThinkingParameter(
      reasoning: undefined | ReasoningSettings,
      model: string,
  ): boolean | "low" | "medium" | "high"

  Parameters

  • reasoning: undefined | ReasoningSettings
  • model: string

  Returns boolean | "low" | "medium" | "high"

ProtectedhandleNonStreamingRequest

• handleNonStreamingRequest(
      ollama: Ollama,
      chatRequest: ExtendedNonStreamingChatRequest,
      cancellation?: CancellationToken,
      reasoning?: ReasoningSettings,
  ): Promise<LanguageModelResponse>

  Parameters

  • ollama: Ollama
  • chatRequest: ExtendedNonStreamingChatRequest
  • Optionalcancellation: CancellationToken
  • Optionalreasoning: ReasoningSettings

  Returns Promise<LanguageModelResponse>

ProtectedhandleStreamingRequest

• handleStreamingRequest(
      ollama: Ollama,
      chatRequest: ExtendedChatRequest,
      cancellation?: CancellationToken,
      reasoning?: ReasoningSettings,
  ): Promise<LanguageModelStreamResponse>

  Parameters

  • ollama: Ollama
  • chatRequest: ExtendedChatRequest
  • Optionalcancellation: CancellationToken
  • Optionalreasoning: ReasoningSettings

  Returns Promise<LanguageModelStreamResponse>

ProtectedhandleStructuredOutputRequest

• handleStructuredOutputRequest(
      ollama: Ollama,
      chatRequest: ChatRequest,
  ): Promise<LanguageModelParsedResponse>

  Parameters

  • ollama: Ollama
  • chatRequest: ChatRequest

  Returns Promise<LanguageModelParsedResponse>

ProtectedinitializeOllama

• initializeOllama(): Ollama

  Returns Ollama

ProtectedrequiresEffortLevel

• requiresEffortLevel(model: string): boolean

  Checks if the model requires effort levels instead of a boolean for think.

  Parameters

  • model: string

  Returns boolean

ProtectedtoOllamaMessage

• toOllamaMessage(message: LanguageModelMessage): undefined | Message

  Parameters

  • message: LanguageModelMessage

  Returns undefined | Message

ProtectedtoOllamaMessageRole

• toOllamaMessageRole(message: LanguageModelMessage): string

  Parameters

  • message: LanguageModelMessage

  Returns string

ProtectedtoOllamaTool

• toOllamaTool(tool: ToolRequest): ToolWithHandler

  Parameters

  • tool: ToolRequest

  Returns ToolWithHandler