We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: Safe Testing

Abstract: We develop the theory of hypothesis testing based on the e-value, a notion of evidence that, unlike the p-value, allows for effortlessly combining results from several studies in the common scenario where the decision to perform a new study may depend on previous outcomes. Tests based on e-values are safe, i.e. they preserve Type-I error guarantees, under such optional continuation. We define growth-rate optimality (GRO) as an analogue of power in an optional continuation context, and we show how to construct GRO e-variables for general testing problems with composite null and alternative, emphasizing models with nuisance parameters. GRO e-values take the form of Bayes factors with special priors. We illustrate the theory using several classic examples including a one-sample safe t-test and the 2 x 2 contingency table. Sharing Fisherian, Neymanian and Jeffreys-Bayesian interpretations, e-values may provide a methodology acceptable to adherents of all three schools.
Comments: Accepted as discussion paper to the Journal of the Royal Statistical Society series B
Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Machine Learning (cs.LG); Methodology (stat.ME)
Cite as: arXiv:1906.07801 [math.ST]
  (or arXiv:1906.07801v5 [math.ST] for this version)

Submission history

From: Rianne de Heide [view email]
[v1] Tue, 18 Jun 2019 20:39:27 GMT (85kb,D)
[v2] Wed, 10 Jun 2020 08:38:35 GMT (96kb,D)
[v3] Mon, 6 Dec 2021 20:41:47 GMT (75kb,D)
[v4] Tue, 7 Mar 2023 15:17:24 GMT (165kb,D)
[v5] Fri, 10 Mar 2023 13:14:45 GMT (165kb,D)

Link back to: arXiv, form interface, contact.