The Parable of Schrodinger’s Cat and the Illusion of Statistical Significance in Clinical Trials.

Milton Packer M.D.
Packer, M. (2019). “The Parable of Schrodinger’s Cat and the Illusion of Statistical Significance in Clinical Trials.” Circulation 140(10): 799-800.
The field of quantum physics offers important lessons for those involved in the interpretation of clinical trials. A key distinction between quantum physics and classical Newtonian physics is that the latter is deterministic; it describes the future state of a system with definitiveness, and it is useful for understanding the behavior of large objects (ie, those encountered on a human scale). However, at a subatomic level, the utility of Newtonian physics breaks down; it is superseded by quantum physics, in which the future state of a system is defined in a probabilistic rather than deterministic manner. The quantification of uncertainty allows quantum physics to resolve issues that classical physics cannot address. In many ways, the evolution of thinking about clinical evidence parallels the evolution of thinking in physics. When the effect size of a drug or device is large, descriptive studies generally suffice in establishing the efficacy of an intervention. If the mortality rate of pneumococcal pneumonia is uniformly 90% and declines to 10% with the advent of penicillin, there is no need for a randomized controlled trial. The response to imatinib in leukemia was so dramatic that the Food and Drug Administration approved the drug based on an open-label uncontrolled trial of <50 patients.1 If the clinical course of a serious event is highly predictable, a substantial benefit after an intervention represents compelling evidence for efficacy. However, just as classical physics loses its applicability when one shifts to very small effects, the usefulness of descriptive studies evaporates when physicians move from drugs with a 90% benefit to agents that reduce risk by only 10% to 20%. Cardiovascular drugs typically exert small treatment effects and are studied in a setting where outcomes cannot be predicted with precision. (Excerpt from text, p. 799.)