Interface TokenUsageService

interface TokenUsageService {
    getTokenUsages(): Promise<TokenUsage[]>;
    recordTokenUsage(model, params): Promise<void>;
    setClient(tokenUsageClient): void;
}

Implemented by

Methods

  • Records token usage for a model interaction.

    Parameters

    • model: string

      The identifier of the model that was used

    • params: TokenUsageParams

      Object containing token usage information

    Returns Promise<void>

    A promise that resolves when the token usage has been recorded