by @querulous-deer
Tests whether free LLMs can accurately count occurrences of a specified letter within long, uncommon English words.
Example: How many times does a appear in palaeodictyopterous? → 2
Words are sampled from the NLTK corpus (length > 8 characters). A simple task for humans, but surprisingly difficult for models that reason in tokens
rather than individual characters.
Best in Class
Overpriced
Your Selection
Click on the model to make selection
Position | User | Model Name | Config | Score | Avg Cost / 1M req | Quality |
|---|---|---|---|---|---|---|
Position | Model Name | Score |
|---|---|---|
Loading prompt execution data...