Narev
  • Twitter
  • Create

  • Evals
    • Models
    • Hardware

  • Catalog

> Hub > Evals > Models > …

loading run

> Hub > Evals > Models > Python Programming Competency

Evaluates core Python programming knowledge across language semantics, standard library behavior, scoping, memory model, and object-oriented paradigms.

Scorer: Factuality

loading chart
Score vs cost per task
#scoremodel
cost
price
ttfttotal tok
1100%gpt-5.3-codex
$0.00023
$1.75 / $14.00 per 1M
1.07s98.8
2100%moonshotai/kimi-k2.7-code
$0.00045
$0.69 / $3.49 per 1M
0.72s203.6
390%qwen/qwen3-coder-next
$0.00001
$0.12 / $0.80 per 1M
0.90s100.1

Prompts

  • Consider the following function definition: ```python def append_to(element, target=[]): target.…
  • In Python, what does the `__slots__` attribute in a class definition primarily do? A) Restricts the …
  • In Python's `try...except...else...finally` block, when does the `else` block execute? A) Whenever a…
  • What does the `yield from` expression in a Python generator do? A) Terminates the generator and retu…
  • What is the output of `print(type(type))` in Python 3? A) `<class 'object'>` B) `<class 'class'>` C)…
  • What is the result of executing `bool([]) == bool([False])` in Python? A) True B) False C) TypeError…
  • What is the time complexity of checking `item in s` where `s` is a standard Python `set` containing …
  • What will `sorted(['10', '2', '1', '20'])` return in Python? A) `['1', '10', '2', '20']` B) `['1', '…
  • Which built-in module provides support for abstract base classes in Python? A) `abc` B) `typing` C) …
  • Which of the following statements about the Global Interpreter Lock (GIL) in standard CPython is cor…