Brier gap
Compare Brier scores across groups.
Testing methods
11Demographic parity ratio
Compare positive prediction rates across groups as a ratio.
ECE gap
Compare expected calibration error across groups.
Equal opportunity difference
Compare true positive rates across groups.
Equalized odds difference
Compare true positive and false positive rates across groups.
False positive and false negative rate gaps
Compare false positive and false negative rate gaps across groups.
Group-wise gaps
Compare group-level classification, regression or oriented-box results.
Intersectional worst-group
Identify the lowest-performing intersection of group attributes.
NLL gap
Compare negative log-likelihood across groups.
Statistical parity difference
Measure the difference in positive prediction rates across groups.
Worst-group
Identify the lowest-performing group for the selected task metric.
1–11 of 11 results