Evaluates a model's ability to solve basic arithmetic and elementary numerical word problems while returning only the resulting number.
Scorer: NumericDiff
loading chart
| # | score | model | cost price | ttft | total tok |
|---|---|---|---|---|---|
| 1 | 100% | microsoft/phi-4 | $0.00000 $0.07 / $0.14 per 1M | 0.36s | 24.3 |
| 2 | 100% | gpt-5.4-nano | $0.00001 $0.20 / $1.25 per 1M | 1.10s | 26.3 |
| 3 | 100% | gemini-3.5-flash-lite | $0.00001 $0.30 / $2.50 per 1M | 0.54s | 20 |
Prompts
- Calculate -7 + 12. Respond with only the number.
- Calculate 1000 - 673. Respond with only the number.
- Calculate 14 × 9. Respond with only the number.
- Calculate 144 ÷ 12. Respond with only the number.
- Calculate 2.5 + 0.75. Respond with only the number.
- Calculate 27 + 58. Respond with only the number.
- Calculate 3/4 of 28. Respond with only the number.
- Calculate 6 + 3 × 4. Respond with only the number.
- What is 15% of 80? Respond with only the number.
- What is the average of 8, 12, and 16? Respond with only the number.