← all blocks
eval-metric · v1.0.0
Expected Calibration Error
Mean per-bin gap between predicted probability and observed frequency, weighted by bin size.
Contract
- Input:
- PredictionsWithActuals
- Output:
- Metric
- Determinism:
- pure
- Side effects:
- none
- Leakage window:
- 0s
Params (live form)
JSON
{
"num_bins": 10
}Examples
Citations
- Naeini, Cooper, Hauskrecht 2015 — Obtaining Well Calibrated Probabilities Using Bayesian Binning