Refine
Year of publication
Document Type
- Article (308)
- Preprint (232)
- Working Paper (1)
Language
- English (541)
Has Fulltext
- yes (541)
Is part of the Bibliography
- no (541)
Keywords
- BESIII (18)
- e +-e − Experiments (13)
- Branching fraction (9)
- LHC (8)
- Particle and Resonance Production (7)
- Quarkonium (7)
- Spectroscopy (6)
- Hadronic decays (5)
- Heavy-ion collisions (5)
- Branching fractions (4)
Non-standard errors
(2021)
In statistics, samples are drawn from a population in a data-generating process (DGP). Standard errors measure the uncertainty in sample estimates of population parameters. In science, evidence is generated to test hypotheses in an evidence-generating process (EGP). We claim that EGP variation across researchers adds uncertainty: non-standard errors. To study them, we let 164 teams test six hypotheses on the same sample. We find that non-standard errors are sizeable, on par with standard errors. Their size (i) co-varies only weakly with team merits, reproducibility, or peer rating, (ii) declines significantly after peer-feedback, and (iii) is underestimated by participants.