Submit

Model submission · open now

Submit a publicly priced API endpoint. OpenDisclosure runs it with the fixed harness, prompt and parameters, with no custom prompt or code. Entry identity includes the provider, model version and hosting region. EU-hosted entries appear on the ranked board; others appear in the reference section.

OpenDisclosure pays up to a per-run cap agreed before evaluation. Above that cap the vendor supplies credits, disclosed on the row. Results are published whatever they show. Vendors have seven days to flag a configuration error before publication, not to withhold results. No submission receives access to any split.

System submission · planned

A system will be submitted as an OCI container implementing a small contract: page text in, spans out. OpenDisclosure will run it in its sandbox with no network egress except a metered LLM proxy, a fixed seed, and CPU, memory and time limits. Cost will be metered at the proxy plus published GPU list price for in-container inference. OpenDisclosure’s own system will go through the same contract.

Cost basis

Costs use vendor list prices in EUR excluding VAT at the recorded price date, published cached-input rates, no batch discounts, and all calls including retries and failures, divided by page-calls.

Disputes and corrections

Report a configuration or scoring error by email with the entry and evidence. We investigate, publish a dated correction in the changelog, and retain the original number visibly struck through alongside its replacement.

How to submit today

Email info@opendisclosure.eu with subject Benchmark submission. Include the model name and version, provider, endpoint, hosting region, public price page, weights licence, and whether credits are available.