flair/mastermind_24_mcq_random
Viewer
•
Updated
•
30.4k
•
95
MastermindEval
Prompting and multiple-choice (MCQ) benchmarks to evaluate reasoning capabilities of LLMs using Mastermind.
-
-
flair/mastermind_35_mcq_random
Viewer • Updated • 37.1k • 113 -
flair/mastermind_46_mcq_random
Viewer • Updated • 36.1k • 92 -
flair/mastermind_24_mcq_close
Viewer • Updated • 30.4k • 103 -
flair/mastermind_35_mcq_close
Viewer • Updated • 37.1k • 123 -
flair/mastermind_46_mcq_close
Viewer • Updated • 36.1k • 96 -
flair/mastermind_24_prompt
Viewer • Updated • 30.4k • 21 -
flair/mastermind_35_prompt
Viewer • Updated • 37.1k • 13 -
flair/mastermind_46_prompt
Viewer • Updated • 36.1k • 13 -
MastermindEval: A Simple But Scalable Reasoning Benchmark
Paper • 2503.05891 • Published • 1