LangSmith

Import production traces from LangSmith into Narev.

Use your production traces as test datasets. Instead of guessing which model works better, test against the prompts your users are actually sending.

Prerequisites

  • An active LangSmith account with production traces
  • LangSmith API key (starts with lsv2pt...)
  • Production traces in your LangSmith project

Setup

  1. Create a new A/B test
  2. Navigate to Setup tab
  3. In the Data Source section select Import from traces
  4. Select LangSmith as provider
  5. Enter your credentials:
    • Project Name: Your LangSmith project identifier
    • API Key: Your LangSmith API key (starts with lsv2pt...)
  6. Select your Date Range (default: last 7 days)
  7. Click Save Project to import traces

Import traces from LangSmith interface

FAQ