Analyzing Results
Understand your A/B test results and compare variant performance.
Learn how to read the results dashboard, compare variants across quality, latency, and cost metrics, and make informed decisions about which configuration to use.
Results Tab
The Results tab provides comprehensive analytics for your A/B test, organized into five sections:
- Summary - High-level overview comparing all variants across your selected metrics
- Cost - Detailed breakdown of cost metrics, including total spend and per-request costs
- Latency - Response time analysis showing performance differences between variants
- Quality - Custom quality metrics you've configured for your application
- Prompt-by-prompt - Granular inspection of individual prompts and their responses
Use the metric selectors to choose which specific metrics to focus on when comparing your variants. This helps you identify the optimal balance between cost, performance, and quality for your use case.