Interface LanguageModelToolTokenizationOptions

Options related to tokenization for a tool invocation.

Stubbed

interface LanguageModelToolTokenizationOptions {
tokenBudget: number;
countTokens(text: string, token?: CancellationToken): Thenable<number>;
}

Index

Properties

Methods

Properties

tokenBudget

tokenBudget: number

If known, the maximum number of tokens the tool should emit in its result.

Stubbed

Methods

countTokens

countTokens(text: string, token?: CancellationToken): Thenable<number>
Count the number of tokens in a message using the model specific tokenizer-logic.
Parameters
- text: string
  A string.
- Optionaltoken: CancellationToken
  Optional cancellation token. See CancellationTokenSource for how to create one.
Returns Thenable<number>
A thenable that resolves to the number of tokens.

Stubbed
- Defined in packages/plugin/src/theia.d.ts:19611