Class AnthropicModel

Implements the Anthropic language model integration for Theia

Implements

LanguageModel

Index

Constructors

Properties

apiKey enableStreaming id maxRetries maxTokens model status tokenUsageService? useCaching

Methods

createTools getSettings handleNonStreamingRequest handleStreamingRequest initializeAnthropic request

Constructors

constructor

new AnthropicModel(
    id: string,
    model: string,
    status: LanguageModelStatus,
    enableStreaming: boolean,
    useCaching: boolean,
    apiKey: () => undefined | string,
    maxTokens?: number,
    maxRetries?: number,
    tokenUsageService?: TokenUsageService,
): AnthropicModel
Parameters
- id: string
- model: string
- status: LanguageModelStatus
- enableStreaming: boolean
- useCaching: boolean
- apiKey: () => undefined | string
- maxTokens: number = DEFAULT_MAX_TOKENS
- maxRetries: number = 3
- OptionaltokenUsageService: TokenUsageService
Returns AnthropicModel
- Defined in node/anthropic-language-model.ts:196

Properties

apiKey

apiKey: () => undefined | string

enableStreaming

enableStreaming: boolean

`Readonly`id

id: string

maxRetries

maxRetries: number = 3

maxTokens

maxTokens: number = DEFAULT_MAX_TOKENS

model

model: string

status

status: LanguageModelStatus

`Protected` `Optional` `Readonly`tokenUsageService

tokenUsageService?: TokenUsageService

useCaching

useCaching: boolean

Methods

`Protected`createTools

createTools(request: LanguageModelRequest): undefined | Tool[]
Parameters
- request: LanguageModelRequest
Returns undefined | Tool[]
- Defined in node/anthropic-language-model.ts:375

`Protected`getSettings

getSettings(request: LanguageModelRequest): Readonly<Record<string, unknown>>
Parameters
- request: LanguageModelRequest
Returns Readonly<Record<string, unknown>>
- Defined in node/anthropic-language-model.ts:208

`Protected`handleNonStreamingRequest

handleNonStreamingRequest(
anthropic: Anthropic,
request: UserRequest,
): Promise<LanguageModelTextResponse>
Parameters
- anthropic: Anthropic
- request: UserRequest
Returns Promise<LanguageModelTextResponse>
- Defined in node/anthropic-language-model.ts:392

`Protected`handleStreamingRequest

handleStreamingRequest(
    anthropic: Anthropic,
    request: UserRequest,
    cancellationToken?: CancellationToken,
    toolMessages?: readonly MessageParam[],
): Promise<LanguageModelStreamResponse>
Parameters
- anthropic: Anthropic
- request: UserRequest
- OptionalcancellationToken: CancellationToken
- OptionaltoolMessages: readonly MessageParam[]
Returns Promise<LanguageModelStreamResponse>
- Defined in node/anthropic-language-model.ts:230

`Protected`initializeAnthropic

initializeAnthropic(): Anthropic
Returns Anthropic
- Defined in node/anthropic-language-model.ts:431

request

request(
request: UserRequest,
cancellationToken?: CancellationToken,
): Promise<LanguageModelResponse>
Parameters
- request: UserRequest
- OptionalcancellationToken: CancellationToken
Returns Promise<LanguageModelResponse>
Implementation of LanguageModel.request
- Defined in node/anthropic-language-model.ts:212