Interface Usage

Abstract Data Type (ADT) encapsulating metadata on the usage of an AI provider's API per AI request.

interface Usage {
    generationTokens?: number;
    promptTokens?: number;
    totalTokens?: number;
}

Properties

generationTokens?: number

The number of tokens returned in the generation (aka completion) of the AI's response.

promptTokens?: number

The number of tokens used in the prompt of the AI request.

totalTokens?: number

The total number of tokens from both the prompt of an AI request and generation of the AI's response.