Interface LanguageModelToolTokenizationOptions

Options related to tokenization for a tool invocation.

Stubbed

interface LanguageModelToolTokenizationOptions {
tokenBudget: number;
countTokens(text, token?): Thenable<number>;
}

Index

Properties

Methods

Properties

tokenBudget

tokenBudget: number

If known, the maximum number of tokens the tool should emit in its result.

Methods

countTokens

countTokens(text, token?): Thenable<number>
Count the number of tokens in a message using the model specific tokenizer-logic.
Parameters
- text: string
  A string.
- Optional token: CancellationToken
  Optional cancellation token. See CancellationTokenSource for how to create one.
Returns Thenable<number>
A thenable that resolves to the number of tokens.
- Defined in packages/plugin/src/theia.d.ts:18438