These items measure understanding of common English greetings, introductions, farewells, and context-appropriate conversational responses.
Scorer: Factuality
| # | score | model | cost price | ttft | total tok |
|---|---|---|---|---|---|
| 1 | 100% | gpt-5.4-nano | $0.00002 $0.20 / $1.25 per 1M | 0.80s | 73 |
| 2 | 100% | qwen/qwen3.8-flash | $0.00004 $0.10 / $0.31 per 1M | 2.17s | 173 |
| 3 | 68% | amazon/nova-micro-v1 | $0.00001 $0.05 / $0.21 per 1M | 0.39s | 88 |