Skip to benchmark content
← Leaderboard

Rules only

FloorMaintainer

The zero-cost rules-only baseline, run by the benchmark harness.

Vendor
OpenDisclosure
Provider
None
Region
Not applicable
Version
pilot 2026-10-14
Composition
OpenDisclosure's rule engine without a model

F2 score

16.5%95% CI 10.9%–22.3%

Leak recall

13.7%95% CI 8.9%–18.7%

Over-redaction

4.4%95% CI 2.5%–7.0%

Output precision

64.9%95% CI 55.0%–71.0%

Cost per 1,000 pages

EUR 0.0095% CI not applicable · measured list-price cost

Recall by bucket

Universal identifiers
44.6%95% CI 30.4%–57.0%
Names
7.2%95% CI 4.7%–11.0%
Contextual personal data
7.8%95% CI 3.3%–14.1%

Breakdowns

Groups below the reporting floor are not shown.

LanguageDocumentsF2RecallOver-redaction
de2418.4%15.4%9.5%
en2426.1%22.1%7.4%
es225.9%4.8%1.4%
fr2031.1%26.6%6.0%
it238.6%7.0%7.1%
nl2212.3%10.1%3.7%

Provenance

Dataset version and split
1.0.0-r3+labels.20261006.1 · tuning
Scoring
1.3
Harness version
pilot-2026-10-15
Run date
2026-10-14
Documents
135
Pages
892
Repeats
1
Price date
2026-09-29
Spend
EUR 0.00
Credits
None · paid by OpenDisclosure

Cite this

@misc{eu-redaction-rules-only,
  author = {OpenDisclosure},
  title = {EU Redaction Benchmark: Rules only},
  year = {2026},
  url = {https://opendisclosure.eu/benchmark/systems/rules-only/},
  note = {r3-tuning-pilot-2026-10-15; tuning split; scoring 1.3}
}
Download JSON