TY - JOUR T1 - “Not Statistically Different” Does Not Necessarily Mean “the Same”: The Important but Underappreciated Distinction Between Difference and Equivalence Studies AU - Harris, Alex H.S. AU - Fernandes-Taylor, Sara AU - Giori, Nicholas Y1 - 2012/03/07 N1 - 10.2106/JBJS.K.00568 JO - The Journal of Bone & Joint Surgery SP - e29 1 EP - 4 VL - 94 IS - 5 N2 - Researchers often want to evaluate whether a new medical or surgical treatment is equivalent to an existing treatment. The new treatment may be preferred if its results are equivalent to those of the existing approach in terms of complications or outcomes but it is superior in terms of ease of use, safety, or cost. However, many researchers are unaware that the equivalence of two interventions cannot be established by failing to find a statistical difference between them. This somewhat subtle detail of research design and statistical analysis has very important clinical implications. The goal of this brief paper is to explain the distinctions between the familiar difference trial (or superiority trial) study design and the often more appropriate but much less familiar equivalence study design. These designs have different underlying hypotheses, power calculations, statistical analyses, and conclusions. Claiming the equivalence of two interventions on the basis of a nonsignificant difference in the results of a difference trial and analysis, as is unfortunately common, may lead to incorrect conclusions and inappropriate changes in clinical practice1,2. Erroneous equivalence claims in the medical literature have been reviewed by Greene et al.3. SN - 0021-9355 M3 - doi: 10.2106/JBJS.K.00568 UR - http://dx.doi.org/10.2106/JBJS.K.00568 ER -