Rules only
FloorMaintainer
The zero-cost rules-only baseline, run by the benchmark harness.
- Vendor
- OpenDisclosure
- Provider
- None
- Region
- Not applicable
- Version
- pilot 2026-10-14
- Composition
- OpenDisclosure's rule engine without a model
F2 score
16.5%95% CI 10.9%–22.3%Leak recall
13.7%95% CI 8.9%–18.7%Over-redaction
4.4%95% CI 2.5%–7.0%Output precision
64.9%95% CI 55.0%–71.0%Cost per 1,000 pages
EUR 0.0095% CI not applicable · measured list-price costRecall by bucket
Universal identifiers44.6%95% CI 30.4%–57.0%
Names7.2%95% CI 4.7%–11.0%
Contextual personal data7.8%95% CI 3.3%–14.1%
Breakdowns
Groups below the reporting floor are not shown.
| Language | Documents | F2 | Recall | Over-redaction |
|---|---|---|---|---|
| de | 24 | 18.4% | 15.4% | 9.5% |
| en | 24 | 26.1% | 22.1% | 7.4% |
| es | 22 | 5.9% | 4.8% | 1.4% |
| fr | 20 | 31.1% | 26.6% | 6.0% |
| it | 23 | 8.6% | 7.0% | 7.1% |
| nl | 22 | 12.3% | 10.1% | 3.7% |
Provenance
- Dataset version and split
- 1.0.0-r3+labels.20261006.1 · tuning
- Scoring
- 1.3
- Harness version
- pilot-2026-10-15
- Run date
- 2026-10-14
- Documents
- 135
- Pages
- 892
- Repeats
- 1
- Price date
- 2026-09-29
- Spend
- EUR 0.00
- Credits
- None · paid by OpenDisclosure
Cite this
@misc{eu-redaction-rules-only,
author = {OpenDisclosure},
title = {EU Redaction Benchmark: Rules only},
year = {2026},
url = {https://opendisclosure.eu/benchmark/systems/rules-only/},
note = {r3-tuning-pilot-2026-10-15; tuning split; scoring 1.3}
}Download JSON