Narev
  • Twitter
  • Register

  • Evals
    • Models
    • Hardware

  • Catalog

> Hub > Evals > Models > …

loading run

> Hub > Evals > Models > Apple Foldable Specifications

These items measure recall and interpretation of the stated pricing, display sizes, and processor specifications for Apple's new foldable device.

Scorer: Factuality

loading chart
Score vs cost per task
#scoremodel
cost
price
ttfttotal tok
160%perplexity/sonar-pro-search$0.000223.71s68
260%gpt-6-astra
$0.00337
$200000.00 / $1000000.00 per 1M
2.76s126
36%anthropic/claude-opus-4.8
$0.00346
$5.00 / $25.00 per 1M
1.36s212

Prompts

  • Approximately what percentage of the inner display's stated diagonal size is the outer display's sta…
  • How far below $2,000 is the foldable's starting US price? A) $10 B) $100 C) It is not below $2,000 D…
  • How much larger is the 7.6-inch inner display than the outer display? A) 1.8 inches B) 2.0 inches C)…
  • What is the size of the foldable's inner display? A) 7.6 inches B) 7.2 inches C) 7.9 inches D) 8.1 i…
  • What is the size of the foldable's outer display? A) 5.8 inches B) 6.1 inches C) 4.9 inches D) 5.4 i…
  • What is the starting US price of Apple's new foldable? A) $1,799 B) $1,899 C) $1,999 D) $2,099 Reply…
  • Which chip powers Apple's new foldable? A) A19 Pro B) A20 Pro C) M5 D) A20 Reply with the letter of …
  • Which display on Apple's foldable is larger? A) The inner display B) The outer display C) Both displ…
  • Which option correctly pairs the foldable's inner and outer display sizes? A) 7.6-inch inner and 5.8…
  • Which specification summary correctly identifies the foldable's processor family and starting price?…
Create your own benchmark →