What is the Fragility Distance?

The unconstrained distance from a clinical trial result to the p = 0.05 boundary, counted in patients. · 中文版

The Fragility Distance (FD) is the minimum number of single-patient edits, each adding one patient to any cell of a clinical trial's 2×2 table or removing one patient from any cell, that moves the trial across p = 0.05 under the two-sided Fisher's exact test: a significant result becomes nonsignificant, or a nonsignificant result becomes significant. Total enrollment, arm sizes, and outcome totals are all free to change. FD is the L1 (taxicab) edit distance from the observed table to the nearest table on the other side of the significance boundary, so every constrained fragility index, including the Fragility Index and the Global Fragility Index, bounds it from above. Dividing by the smallest margin of the observed table gives the Fragility Distance Quotient (FDQ). The FD was defined by Thomas F. Heston in a 2026 Internet Medical Journal article.

This Fragility Distance is a biostatistics measure of clinical trial evidence. In this context FD does not refer to familial dysautonomia or to the Freedman–Diaconis histogram rule.

Formal definition

For a 2×2 table with Arm A events a and non-events b, Arm B events c and non-events d, arm sizes nA = a + b and nB = c + d, and total N = a + b + c + d:

Index versus distance. A fragility index is a constrained path length counted in moves: the Fragility Index toggles outcomes within one arm, and the Global Fragility Index moves patients between cells with N fixed. Each move changes two cells, so it costs two edits. A distance removes the constraints and counts single-patient edits. There is exactly one unconstrained minimum, the FD; the indices are its constrained upper bounds.

The edits are a measuring device, not a claim that any error occurred. They price the uncertainty present in every real trial: the enrollment of one more patient, or the loss of one to follow-up.

Worked examples

Trial {a, b, c, d} Baseline p FD Mechanism Example witness table p after m FDQ GFI
Semaglutide vs placebo, NASH cirrhosis {5, 42, 7, 17}0.0901deletion{4, 42, 7, 17}0.038120.0831
{2, 98, 10, 90}0.0332deletions{2, 98, 8, 90}0.057120.1671
{15, 85, 25, 75}0.1112deletions{13, 85, 25, 75}0.047400.0502
{50, 50, 10, 90}< 0.00000136mixed{16, 50, 12, 90}0.055600.60020
{48, 556, 35, 449}0.73112deletions{48, 556, 23, 449}0.048830.1458

In the semaglutide trial, 5 of 47 semaglutide patients and 7 of 24 placebo patients improved, and the authors reported no significant difference. Removing one semaglutide-group responder reverses that classification; adding one placebo responder, or removing one placebo non-responder, does the same. The FI and GFI also equal 1, but each of their moves changes two cells, so the table sits half as far from the boundary as those indices suggest. In the second trial FD = 2·GFI: the GFI move is itself a shortest edit path. In the third, FD = 2 while 2·GFI = 4, because removing two Arm A events is a route no fixed-N index can take. The last row is a rare-event table: FD = 12 removes a third of Arm B's 35 events, a perturbation that FD / N = 0.011 would understate; the margin denominator gives FDQ = 12 / 83 = 0.145.

p-values are two-sided Fisher's exact. Each FD was certified by scoring every table within the stated edit distance of the observed table; several tables can sit at the same minimum distance, and each row shows one of them. The semaglutide counts are from Loomba et al. (2023).

Where the FD fits

A p-value alone is partial evidence. The p–fr–nb framework reports three dimensions: significance (p), fragility (fr), and robustness (nb). FD is a fragility metric: it measures the stability of the significance classification and says nothing about distance from therapeutic neutrality, which the Risk Quotient (RQ) measures. For 2×2 tables the Global Fragility Quotient (GFQ) remains the recommended fr coordinate; FD and FDQ are secondary metrics reported alongside it, with the witness table and mechanism. The author's position is that FD is the primary measure of perturbation fragility for a 2×2 table because it is the true minimum; this is an interpretive position, not an empirical finding. See the full documentation.

Frequently asked questions

What does the Fragility Distance measure?

FD measures how far a trial's significance classification sits from being reversed, counted in single patients added or removed. FD = 1 means that one additional or one lost patient, in a particular cell, moves the result across p = 0.05. It is a count, not a probability.

How is the Fragility Distance different from the Fragility Index and the Global Fragility Index?

The Fragility Index (Walsh et al., 2014) switches outcomes within one arm, and the Global Fragility Index moves patients between any two cells; both hold the sample size fixed, and each of their moves changes two cells. The FD lets the table grow or shrink one patient at a time. Because every toggle and every transfer is a pair of edits, FD ≤ 2·GFI ≤ 2·FI always holds under the same significance test.

What is the Fragility Distance Quotient (FDQ)?

FDQ = min(1, FD / m), where m is the smallest of the four margins of the observed table: the two arm sizes and the two outcome totals. It is the fraction of the trial's scarce resource, the rarer outcome or the smaller arm, that must be added or removed to reverse significance. FDQ is not on the GFQ scale, and the two quotients are not numerically interchangeable. No interpretive bands for FDQ have been set; report the raw FD and the witness table beside it.

Why does the FDQ divide by the smallest margin rather than by N?

Dividing by N counts patients who could not have contributed to the reversal, which understates the perturbation in rare-event trials. In the table {48, 556, 35, 449}, FD = 12 is 1.1% of N but a third of one arm's 35 events and 14.5% of all 83 events. The defining article reported the quotient as FD / N; the framework has since replaced that denominator with the smallest margin.

What does margin-limited mean?

For a nonsignificant result, the nearest significant table usually requires adding to the scarce margin, so FD can exceed m. FDQ is then capped at 1.0 and flagged margin-limited, and the raw FD and witness table carry the information. For a significant result FD never exceeds m, so the cap never applies.

Does the Fragility Distance apply to nonsignificant results?

Yes. For a nonsignificant result, FD is the minimum number of edits that makes the result significant. The search covers both directions of effect, because the nearest significant table can lie across therapeutic neutrality. One definition covers both directions.

What are aFD and dFD?

aFD is the minimum number of patients that must be added, and dFD the minimum that must be removed, to reverse significance. aFD = k means that if the trial had enrolled k more patients, with particular outcomes in particular arms, the classification could have changed; dFD = k means that the loss of k particular patients, for example to follow-up, could have done the same. Both are upper bounds on FD.

Which significance test does the Fragility Distance use?

The two-sided Fisher's exact test at α = 0.05, applied to the observed table and to every edited table, whatever test the original trial reported.

How do I calculate the Fragility Distance?

The calculator on this site does not yet report FD. The computation method, a directed search certified by enumerating every table within the candidate distance, is specified in the framework documentation, FRAGILITY_METRICS.md, in the open-source Fragility Metrics Toolkit (doi:10.5281/zenodo.17254763).

Who developed the Fragility Distance?

Thomas F. Heston, MD, of the University of Washington and Washington State University, defined the FD in “From Fragility Index to Fragility Distance in Clinical Trials” (Internet Medical Journal, 2026). The article shows that the published toggle and transfer indexes are constrained upper bounds on a single geometric quantity.

References

  1. Heston TF. From fragility index to fragility distance in clinical trials. Internet Med J. 2026;1:e22072163. doi:10.5281/zenodo.22072163
  2. Heston TF. The Global Fragility Index: a path-independent measure of statistical fragility. SSRN. 2025. doi:10.2139/ssrn.5709162
  3. Walsh M, Srinathan SK, McAuley DF, et al. The statistical significance of randomized controlled trial results is frequently fragile: a case for a Fragility Index. J Clin Epidemiol. 2014;67(6):622-8. doi:10.1016/j.jclinepi.2013.10.019
  4. Loomba R, Abdelmalek MF, Armstrong MJ, et al. Semaglutide 2·4 mg once weekly in patients with non-alcoholic steatohepatitis-related cirrhosis: a randomised, placebo-controlled phase 2 trial. Lancet Gastroenterol Hepatol. 2023;8:511-22. doi:10.1016/S2468-1253(23)00068-7
  5. Heston TF. Fragility metrics toolkit v6.0.0. Zenodo. 2026. doi:10.5281/zenodo.17254763

Cite the FD as: Heston TF. From Fragility Index to Fragility Distance in Clinical Trials. Internet Medical Journal. 2026;1:e22072163. doi:10.5281/zenodo.22072163

Last updated November 9, 2026.