Three Lenses on a Trustworthy Evidence Base: Completeness, Authenticity, and Robustness as a Reproducible Computational Integrity Audit

Authors

  • Zaki Khan
    Competing Interests
    None declared.

Abstract

Background: Trust in the clinical-trial evidence base is usually defended one study at a time, by hand. We ask whether it can instead be audited computationally, at registry and corpus scale, and whether such auditing can be honest about its own blind spots. Methods: We assemble three automated, reproducible lenses on a single programme and apply each to public data: (a) field-level structural missingness across the full ClinicalTrials.gov registry (AACT snapshot, 12 April 2026; 579,828 studies); (b) a Benford leading-digit screen of 1,175,056 numeric values across 403 Cochrane reviews (the Pairwise70 corpus); and (c) the Walsh statistical Fragility Index recomputed from a landmark trial public 2x2 table (DAPA-HF primary composite). Results: Completeness is poor and uneven: 62.9% of records lacked publication links, 48.2% lacked IPD sharing statements, 32.8% lacked a detailed description, and 10.2% lacked locations, with industry the most affected named sponsor class. Authenticity returns an honest null: the corpus first-digit mean absolute deviation (MAD) was 0.013 (95% CI 0.013-0.014), within Nigrini marginal-conformity band, with no corpus-level digit anomaly. Robustness is modest where it matters: a result significant at p = 1.6x10-5 rested on a Fragility Index of 62 events out of 4,744 randomised (Fragility Quotient 1.31%). Conclusion: Completeness, authenticity, and robustness form a layered, deployable integrity audit — but each lens is bounded, and naming those bounds is part of the method, not a footnote to it.

References

McMurray JJV, Solomon SD, Inzucchi SE, et al. Dapagliflozin in patients with heart failure and reduced ejection fraction. N Engl J Med. 2019;381(21):1995–2008.

Walsh M, Srinathan SK, McAuley DF, et al. The statistical significance of randomized controlled trial results is frequently fragile: a case for a Fragility Index. J Clin Epidemiol. 2014;67(6):622–628.

Nigrini MJ. Benford's Law: Applications for Forensic Accounting, Auditing, and Fraud Detection. Hoboken, NJ: John Wiley & Sons; 2012.

Zarin DA, Tse T, Williams RJ, Rajakannan T. Update on Trial Registration 11 years after the ICMJE policy was established. N Engl J Med. 2017;376(4):383–391.

DeVito NJ, Bacon S, Goldacre B. Compliance with legal requirement to report clinical trial results on ClinicalTrials.gov: a cohort study. Lancet. 2020;395(10221):361–369.

Visual abstract

Published

2026-06-23

Issue

Section

Research Article

How to Cite

Three Lenses on a Trustworthy Evidence Base: Completeness, Authenticity, and Robustness as a Reproducible Computational Integrity Audit. (2026). Synthesis, 2(4). https://synthesis-medicine.org/index.php/journal/article/view/168

Most read articles by the same author(s)