Data Sources

Configure data sources for your A/B tests in Narev

Narev supports multiple data sources to collect data for your A/B tests. Choose the option that best fits your integration needs.

Live Test

Use Narev as a gateway for real-time testing. This is the easiest integration method, allowing you to test multiple models simultaneously by routing requests through Narev.

Key Feature: Simplest to set up
Requirement: Change your API endpoint to point to Narev

Learn more about A/B Testing with the API for detailed examples and implementation guides.

Tracing Platform

Integrate with your existing tracing platform. Narev automatically syncs your traces, enabling you to analyze and compare model performance without changing your current setup.

Supported Platforms:

Key Feature: No endpoint changes required
Requirement: Connect your tracing platform to Narev

File Upload

Upload your test data directly as files. Ideal for analyzing historical data or running experiments with pre-collected datasets.

Key Feature: Test with existing data
Supported Formats: CSV, JSON, and JSONL

File Format Requirements

Your upload file must contain the following fields:

messages (required): An array of message objects, each with:
- role: The role of the message sender (e.g., "user", "assistant", "system")
- content: The message content
expected_output (optional): The expected response for evaluation purposes

Format Examples

CSV Format

messages,expected_output
"[{""role"":""user"",""content"":""What is the capital of France?""}]","Paris"
"[{""role"":""user"",""content"":""Explain quantum computing""}]","Quantum computing uses quantum mechanics..."

JSON Format

[
  {
    "messages": [{ "role": "user", "content": "What is the capital of France?" }],
    "expected_output": "Paris"
  },
  {
    "messages": [{ "role": "user", "content": "Explain quantum computing" }],
    "expected_output": "Quantum computing uses quantum mechanics..."
  }
]

JSONL Format (one JSON object per line)

{"messages": [{"role": "user", "content": "What is the capital of France?"}], "expected_output": "Paris"}
{"messages": [{"role": "user", "content": "Explain quantum computing"}], "expected_output": "Quantum computing uses quantum mechanics..."}

The expected_output field is optional. If provided, it enables quality metrics and evaluation features for your A/B tests.

Manual Entry

Quickly create tests by manually entering prompts and responses. Perfect for small-scale experiments and quick comparisons.

Key Feature: Fastest way to test
Requirement: None - start testing immediately

Creating A/B Tests Setting up Variants