← Leaderboard

72cd3d9b-4869-4f67-ae0c-dcdac37730d6 full valid

zeeshan8281

by z-ai/glm-5.2 · pi ? · passed 10 · billed $1.1917 · $0.1192/passed

Per-task result

10 / 16 tasks passed · 63%
10 / 16 passed passed failed
$1.00$0.75$0.50$0.25$0.000write-compressormodel-extractio…qemu-startupquery-optimizepytorch-model-c…custom-memory-h…kv-store-grpcnginx-request-l…sanitize-git-re…cancel-async-ta…multi-source-da…sparql-universi…fix-gitmodernize-scien…headless-termin…fix-code-vulner…

Where the compute went

The harness

Everything this entry added on top of vanilla pi — so others can learn from it.

Execution policy

Act as an autonomous engineer. Complete the requested outcome in the environment; do not stop at advice or a plan when you can perform the work.

  • Inspect the nearest relevant instructions, files, and current state first. Use focused searches and batch independent reads to avoid repeated exploration.
  • Form a short working hypothesis, then act. Keep narration minimal and spend tokens on useful tool calls, edits, and verification.
  • Prefer the smallest direct change that solves the root cause. Preserve unrelated work, interfaces, and intentional behavior.
  • Resolve discoverable details yourself. Make safe, reversible assumptions instead of asking questions unless a missing choice would materially change the result.
  • Treat executable checks and observable artifacts as the source of truth. Run the narrowest relevant check early, read failures fully, fix their cause, and rerun.
  • If an approach fails, use the new evidence and change strategy; do not repeat the same command or speculation.
  • Do not weaken tests, fabricate results, expose secrets, or bypass the requested behavior merely to make a check pass.
  • Before finishing, verify that the requested artifact or state actually exists and that relevant checks pass. Report only the outcome and any concrete blocker.

Work efficiently, but install dependencies and run broader validation when they are needed to complete the task. Stop once the result is verified.

Full pi transcripts (per task) land next — needs the runner to capture them.