probcal: Calibration of Binary and Multiclass Probabilities
Provides S3 calibrators, metrics, and diagnostics for binary and multiclass probability calibration. Binary methods include Platt scaling, temperature scaling, beta calibration, histogram binning, and isotonic regression. Multiclass methods include temperature scaling, vector scaling, Dirichlet calibration, and a one-vs-rest wrapper for the binary calibrators. A calibration-inference layer adds debiased calibration errors, bootstrap confidence intervals, and a kernel calibration hypothesis test for binary and multiclass predictions, including the strong (canonical) multiclass case. Methods follow Platt (1999, ISBN:9780262194488), Zadrozny and Elkan (2002) <doi:10.1145/775047.775151>, Guo et al. (2017) <https://proceedings.mlr.press/v70/guo17a.html>, Kull et al. (2017) <doi:10.1214/17-EJS1338SI>, Kull et al. (2019) <doi:10.48550/arXiv.1910.12656>, Widmann et al. (2019) <doi:10.48550/arXiv.1910.11385>, and Kumar et al. (2019) <doi:10.48550/arXiv.1909.10155>.
| Version: | 0.2.0 |
| Depends: | R (≥ 4.1.0) |
| Imports: | cli, ggplot2, stats, withr |
| Suggests: | betacal, dplyr, knitr, pkgdown, reticulate, rmarkdown, roxygen2, testthat (≥ 3.0.0) |
| Published: | 2026-07-09 |
| DOI: | 10.32614/CRAN.package.probcal (may not be active yet) |
| Author: | Pedro Rafael Diniz Marinho
 [aut, cre,
cph] |
| Maintainer: | Pedro Rafael Diniz Marinho <pedro.rafael.marinho at gmail.com> |
| BugReports: | https://github.com/prdm0/probcal/issues/ |
| License: | MIT + file LICENSE |
| URL: | https://prdm0.github.io/probcal/, https://github.com/prdm0/probcal/ |
| NeedsCompilation: | no |
| Language: | en-US |
| Citation: | probcal citation info |
| Materials: | README, NEWS |
| CRAN checks: | probcal results |
Documentation:
| Reference manual: | probcal.html , probcal.pdf |
| Vignettes: |
Applied Calibration Workflow (source, R code) Choosing a Calibrator (source, R code) Multiclass Calibration (source, R code) Numerical Validation (source, R code) Calibrating Binary Probabilities (source, R code) |
Downloads:
| Package source: | probcal_0.2.0.tar.gz |
| Windows binaries: | r-devel: not available, r-release: not available, r-oldrel: not available |
| macOS binaries: | r-release (arm64): not available, r-oldrel (arm64): not available, r-release (x86_64): not available, r-oldrel (x86_64): not available |
Linking:
Please use the canonical form https://CRAN.R-project.org/package=probcal to link to this page.