Installation
Overview
The@ai-billing/anthropic package provides middleware for tracking token usage and calculating costs when using Anthropic models with the Vercel AI SDK.
It captures Anthropic-specific metrics, such as inputCacheReadTokens and inputCacheWriteTokens, ensuring that Prompt Caching costs are accurately reflected.
Usage
To use the middleware, wrap your Anthropic model usingwrapLanguageModel from the ai package and pass the createAnthropicMiddleware.
Define model pricing
Set up a price resolver to define the costs for the models you’ll be using. For Anthropic, you can specify costs for both standard prompt/completion tokens and cached tokens (
inputCacheReadTokens and inputCacheWriteTokens).Create the billing middleware
Initialize the Anthropic billing middleware. You need to provide a destination (such as
consoleDestination) where billing events will be sent, along with your priceResolver.Wrap the model
Use
wrapLanguageModel from the ai package to apply the billing middleware to your Anthropic model.