File Upload

Set up a benchmark to organize your prompts and compare variants.

File Upload

Upload your test data directly as files. Ideal for analyzing historical data or running experiments with pre-collected datasets.

Key Feature: Test with existing data
Supported Formats: CSV, JSON, and JSONL

Field Requirements

Regardless of your file format, your file must contain the following fields:

  • messages (required): An array of message objects, each with:
    • role: The role of the message sender (e.g., "user", "assistant", "system")
    • content: The message content
  • expected_output (optional): The expected response for evaluation purposes

Format Examples

The expected_output field is optional. If provided, it enables quality metrics and evaluation features for your A/B tests.

The expected_output field is optional. If provided, it enables quality metrics and evaluation features for your A/B tests.

Manual entryLive Test

Still have questions? Ask on Discord