Oh My Otter

Results

Anonymous benchmark results

Aggregated from reports submitted with omot report, always with the sample size n. Cells with fewer than five reports are hidden.

Results are self-reported by people running omot; outcomes are verified locally by the CLI, but corrections and minutes are honest estimates. Cells with fewer than 5 reports are hidden. Download the raw data.

Total reports
Overall pass rate
Median corrections
By task
By readiness band

By coding agent