Narev
  • Twitter
  • Create

  • Evals
    • Models
    • Hardware

  • Catalog

> Hub > Evals > Models > …

loading run

> Hub > Evals > Models > OCaml Programming Competence

Tests foundational and intermediate knowledge of the OCaml programming language, including syntax, module system, type system, mutability, and standard library conventions.

Scorer: Factuality

loading chart
Score vs cost per task
#scoremodel
cost
price
ttfttotal tok
192%qwen/qwen3-coder-next
$0.00006
$0.12 / $0.80 per 1M
0.68s146.6
270%gpt-5.4-mini
$0.00008
$0.75 / $4.50 per 1M
0.80s85.5
356%ministral-3b-2512
$0.00001
$0.10 / $0.10 per 1M
0.19s121.1

Prompts

  • Given the record definition `type point = { mutable x : int; mutable y : int }` and a value `p : poi…
  • In modern OCaml, `string` values are immutable sequences of bytes. Which standard type is used for m…
  • In OCaml, what type does the compiler assign to the expression `ref []` due to the value restriction…
  • In OCaml, which operator is used for structural equality (comparing values by their contents) rather…
  • In the OCaml module system, what is a functor? A) A higher-order function that maps over an option o…
  • Introduced in OCaml 5.0, which language mechanism provides native support for structured non-local c…
  • What is the inferred return type of the infinite non-terminating expression `let rec loop () = loop …
  • What is the standard OCaml list constructor operator used to prepend an element `x` to a list `xs`? …
  • What is the type signature of `List.fold_left` in OCaml's standard library? A) ('a -> 'b -> 'a) -> '…
  • Which keyword in OCaml is used to define an explicit module signature or interface type within sourc…