Analytics · what's hard, and who beat it

Task heatmap

Every task (rows, hardest first) against every submission (columns, best first). passed failed not runTasks at the top with low pass-rate are the ones almost nobody cracks; a red row across most columns is where the whole field is stuck. Click a cell → that run.

50submissions

16tasks

1unsolved by all

62%avg pass rate

columns: most tasks passed first, then cheapest · sort tasks:

task	pass rate
write-compressor	0%
model-extraction-relu-logits	4%
query-optimize	16%
pytorch-model-cli	16%
cancel-async-tasks	18%
headless-terminal	52%
qemu-startup	66%
sanitize-git-repo	80%
custom-memory-heap-crash	80%
sparql-university	82%
nginx-request-logging	88%
multi-source-data-merger	94%
modernize-scientific-stack	94%
kv-store-grpc	96%
fix-git	100%
fix-code-vulnerability	100%

Hardest tasks

write-compressor0% solved
model-extraction-relu-logits4% solved
query-optimize16% solved
pytorch-model-cli16% solved
cancel-async-tasks18% solved