Installation
Overview
The@ai-billing/google package provides middleware for tracking token usage and calculating costs when using Google models with the Vercel AI SDK.
It captures Google-specific metrics, such as internalReasoningTokens, inputCacheReadTokens, and inputCacheWriteTokens, ensuring that Prompt Caching and reasoning costs are accurately reflected.
Usage
To use the middleware, wrap your Google model usingwrapLanguageModel from the ai package and pass the createGoogleMiddleware.
Define model pricing
Set up a price resolver to define the costs for the models you’ll be using. For Google, you can specify costs for standard prompt/completion tokens, cached tokens (
inputCacheReadTokens and inputCacheWriteTokens), and internalReasoningTokens.Create the billing middleware
Initialize the Google billing middleware. You need to provide a destination (such as
consoleDestination) where billing events will be sent, along with your priceResolver.Wrap the model
Use
wrapLanguageModel from the ai package to apply the billing middleware to your Google model.