Can your harness ship it for less?
Everyone runs the same agent — a vanilla piCLI on OpenRouter. Tune the harness, not the model, to solve the ranked Terminal-Bench task set for the fewest billed dollars. Match the GLM 5.2 baseline's pass count, then cheapest wins— and every dollar is real, pulled from OpenRouter's generation ledger.
The line is the record — the cheapest qualifying harness so far, stepping down as entrants get cheaper. Dots are submissions (greener = more tasks passed) — click one to open its run.
| # | Participant | Passed | Billed cost | $/passed |
|---|---|---|---|---|
| 1 |  baseline | 10 | $0.9143 | $0.0914 |
| 2 |  dennisonbertram | 10 | $0.9742 | $0.0974 |
| 3 | dennisonbertram | 10 | $1.0050 | $0.1005 |
| 4 | dennisonbertram | 10 | $1.0192 | $0.1019 |
| 5 | dennisonbertram | 10 | $1.0246 | $0.1025 |
| 6 |  mcclurejt | 10 | $1.0251 | $0.1025 |
| 7 | dennisonbertram | 10 | $1.0337 | $0.1034 |
| 8 | dennisonbertram | 11 | $1.0689 | $0.0972 |
| 9 | mcclurejt | 10 | $1.0703 | $0.1070 |
| 10 | dennisonbertram | 10 | $1.1044 | $0.1104 |
| 11 | dennisonbertram | 11 | $1.1212 | $0.1019 |
| 12 | mcclurejt | 10 | $1.1266 | $0.1127 |
| 13 | mcclurejt | 10 | $1.1373 | $0.1137 |
| 14 | dennisonbertram | 10 | $1.1421 | $0.1142 |
| 15 |  zeeshan8281 | 10 | $1.1606 | $0.1161 |
| 16 | dennisonbertram | 12 | $1.1669 | $0.0972 |
| 17 | mcclurejt | 10 | $1.1689 | $0.1169 |
| 18 | zeeshan8281 | 10 | $1.1887 | $0.1189 |
| 19 | dennisonbertram | 10 | $1.1910 | $0.1191 |
| 20 | zeeshan8281 | 10 | $1.1917 | $0.1192 |
| 21 | dennisonbertram | 11 | $1.1983 | $0.1089 |
| 22 | dennisonbertram | 10 | $1.2047 | $0.1205 |
| 23 | dennisonbertram | 11 | $1.2400 | $0.1127 |
| 24 | zeeshan8281 | 10 | $1.2537 | $0.1254 |
| 25 | mcclurejt | 10 | $1.2638 | $0.1264 |
| 26 | dennisonbertram | 12 | $1.2672 | $0.1056 |
| 27 | zeeshan8281 | 11 | $1.2849 | $0.1168 |
| 28 | mcclurejt | 12 | $1.3303 | $0.1109 |
| 29 | dennisonbertram | 10 | $1.3456 | $0.1346 |
| 30 | dennisonbertram | 10 | $1.4116 | $0.1412 |
| 31 | dennisonbertram | 10 | $1.4356 | $0.1436 |
| 32 | dennisonbertram | 11 | $1.5536 | $0.1412 |
| Participant | Passed | Billed cost | To qualify |
|---|---|---|---|
| dennisonbertram | 9 | $0.9169 | +1 |
| zeeshan8281 | 9 | $0.9222 | +1 |
| dennisonbertram | 9 | $0.9271 | +1 |
| mcclurejt | 9 | $0.9770 | +1 |
| mcclurejt | 9 | $0.9867 | +1 |
| mcclurejt | 9 | $1.0001 | +1 |
| mcclurejt | 9 | $1.0528 | +1 |
| mcclurejt | 9 | $1.0613 | +1 |
| zeeshan8281 | 9 | $1.0619 | +1 |
| dennisonbertram | 9 | $1.0632 | +1 |
| mcclurejt | 9 | $1.1131 | +1 |
| mcclurejt | 9 | $1.1163 | +1 |
| dennisonbertram | 9 | $1.2031 | +1 |
| dennisonbertram | 9 | $1.2261 | +1 |
| dennisonbertram | 9 | $1.2668 | +1 |
| zeeshan8281 | 9 | $1.3095 | +1 |
| mcclurejt | 9 | $1.3787 | +1 |
| dennisonbertram | 8 | $1.2954 | +2 |
How it works
Same agent for everyone
Every entry runs a vanilla pi CLI on OpenRouter. The model isn't the variable — the harness is.
Tune the harness
Add skills, profiles, config — anything but the model source — to solve the ranked Terminal-Bench task set your way.
Cheapest wins
Match the GLM 5.2 baseline's pass count, then the fewest billed OpenRouter dollars takes the top spot.