Narev
  • Twitter
  • Create

  • Evals
    • Models
    • Hardware

  • Catalog

> Hub > Evals > Models > …

loading run

> Hub > Evals > Models > run-1b98a4e3-1787057990608

Scorer: ExactMatch

loading chart
Score vs cost per task
#scoremodel
cost
price
ttfttotal tok
150%deepseek/deepseek-v4-pro
$0.00064
$1.74 / $3.48 per 1M
3.36s358.2
2failedopenai/gpt-5.2
—
$1.75 / $14.00 per 1M
—0
3failedanthropic/claude-sonnet-5
—
$2.00 / $10.00 per 1M
—0

Prompts

  • Count occurrences of the letter "r" in "Raspberry", treating uppercase and lowercase as equivalent. …
  • Count the number of occurrences of the lowercase letter "r" in the hyphenated word "error-prone". An…
  • Count the number of occurrences of the lowercase letter "r" in the string "rarararararararararar". A…
  • Count the number of occurrences of the lowercase letter "r" in the word "apple". Answer with only th…
  • Count the number of occurrences of the lowercase letter "r" in the word "car". Answer with only the …
  • Count the number of occurrences of the lowercase letter "r" in the word "characteristically". Answer…
  • Count the number of occurrences of the lowercase letter "r" in the word "mirror". Answer with only t…
  • Count the number of occurrences of the lowercase letter "r" in the word "refrigerator". Answer with …
  • Count the number of occurrences of the lowercase letter "r" in the word "rrrrrrrr". Answer with only…
  • Count the number of occurrences of the lowercase letter "r" in the word "strawberry". Answer with on…