How benchmark changes earn trust.

Change policy

Prompt text, judge panels, weights, renderer versions, repeat counts, calibration sets, and ranking rules are versioned together. Any material change creates a new evaluation configuration instead of silently rewriting historical results. Results from incompatible configurations are not combined.

Corrections and conflicts

Incorrect metadata, broken artifacts, route mismatches, and judge failures are hidden or corrected with an audit trail. Model vendors do not pay for placement. If sponsorship is introduced, it must be labeled and cannot change scores or rank. Methodological challenges can be sent to bench@buseybench.com.

See the exact scoring and coverage rules on the methodology page.