Variants
Your model configuration: which model to use, system prompt, and parameters.
What are variants?
Variants are your execution configuration—combining the model, system prompt, and parameters (temperature, max tokens, etc.).
When do you use variants?
Use variants when you want to test different model configurations on the same dataset. Attach multiple variants to an A/B test to compare their performance.
How do variants work?
You attach variants to A/B tests. The A/B test provides the data (requests), and the variant provides the execution logic. This separation lets you test multiple configurations on the same prompts.
Variants can be defined from scratch or created from pre-built templates.
Once you've tested your variants and identified the best performer, you can mark it as the production variant. When a router selects an A/B test, it automatically uses that test's production variant to handle requests.