Variants

What are variants?

Variants are your execution configuration. They can take two forms:

• combination of the model, system prompt, and parameters (temperature, max tokens, etc.)
• Narev router

When do you use variants?

Use variants when you want to test how different model and router configurations perform on the benchmark. Attach multiple variants to an benchmark to compare their performance.

How do variants work?

You attach variants to benchmarks. The benchmark provides the data (requests), and the variant provides the execution logic. This separation lets you test multiple configurations on the same prompts.