We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Conformalized Ordinal Classification with Marginal and Conditional Coverage

Abstract: Conformal prediction is a general distribution-free approach for constructing prediction sets combined with any machine learning algorithm that achieve valid marginal or conditional coverage in finite samples. Ordinal classification is common in real applications where the target variable has natural ordering among the class labels. In this paper, we discuss constructing distribution-free prediction sets for such ordinal classification problems by leveraging the ideas of conformal prediction and multiple testing with FWER control. Newer conformal prediction methods are developed for constructing contiguous and non-contiguous prediction sets based on marginal and conditional (class-specific) conformal $p$-values, respectively. Theoretically, we prove that the proposed methods respectively achieve satisfactory levels of marginal and class-specific conditional coverages. Through simulation study and real data analysis, these proposed methods show promising performance compared to the existing conformal method.
Comments: 13 pages, 4 figures; 3 supplementary pages
Subjects: Methodology (stat.ME); Machine Learning (stat.ML)
Cite as: arXiv:2404.16610 [stat.ME]
  (or arXiv:2404.16610v1 [stat.ME] for this version)

Submission history

From: Wenge Guo [view email]
[v1] Thu, 25 Apr 2024 13:49:59 GMT (356kb,D)

Link back to: arXiv, form interface, contact.