Skip to main content

​
Installation

​
Overview

The @ai-billing/google package provides middleware for tracking token usage and calculating costs when using Google models with the Vercel AI SDK. It captures Google-specific metrics, such as internalReasoningTokens, inputCacheReadTokens, and inputCacheWriteTokens, ensuring that Prompt Caching and reasoning costs are accurately reflected.

​
Usage

To use the middleware, wrap your Google model using wrapLanguageModel from the ai package and pass the createGoogleMiddleware.
1

Initialize the Google provider

First, set up the Google provider using your API key.
2

Define model pricing

Set up a price resolver to define the costs for the models you’ll be using. For Google, you can specify costs for standard prompt/completion tokens, cached tokens (inputCacheReadTokens and inputCacheWriteTokens), and internalReasoningTokens.
3

Create the billing middleware

Initialize the Google billing middleware. You need to provide a destination (such as consoleDestination) where billing events will be sent, along with your priceResolver.
4

Wrap the model

Use wrapLanguageModel from the ai package to apply the billing middleware to your Google model.
5

Use the wrapped model

Finally, use the wrapped model with AI SDK functions like generateText or streamText. The billing middleware will automatically track tokens, handle caching and reasoning metrics, and calculate costs.