Statistical methods and application cases examples for multiplicity issues in multiple endpoints clinical trials

doi:10.3969/j.issn.1006-7795.2025.02.002

Abstract

Abstract: Performing multiple tests without adjusting the test level results in a higher-than-intended overall familywise error rate (FWER). This phenomenon is known as the multiplicity problem. In this paper, we first introduced the mechanism of multiplicity problem based on the classification and characterization of clinical endpoints. Then, strategies and methods to solve the multiplicity problem were introduced, including the parallel strategy/single-step method, the sequential strategy/multistep method/stepwise method, and their combinations. The results of different analytic strategies may vary. The practical application of the above common strategies and statistical methods were introduced through the case studies of domestic and foreign investigator initiated clinical trial. Multiplicity adjustment for multiple endpoints in clinical trials can be achieved by a single strategy or a combination of strategies. Depending on the selected strategy or combination, the statistical methods and significance level (denoted as α) for each test hypothesis are determined to effectively control the multiplicity problem.

Key words: clinical trials, multiple endpoints, multiplicity, testing strategies, statistical methods

CLC Number:

Bai Xiudan, Xu Qin, Wang Anxin. Statistical methods and application cases examples for multiplicity issues in multiple endpoints clinical trials[J]. Journal of Capital Medical University, 2025, 46(2): 184-190.

References

［1］FDA. Guidance for industry E9 statistical principles for clinical trials［DB/OL］. (1998－09－16)［2024－11－07］. https://www.fda.gov/media/71336/download.
［2］FDA. Multiple endpoints in clinical trials guidance for industry［EB/OL］. (2022－10－21)［2024－11－07］. https://www.fda.gov/media/162416/download.
［3］Pike K T, Reeves B C, Rogers C A. Approaches to multiplicity in publicly funded pragmatic randomised controlled trials: a survey of clinical trials units and a rapid review of published trials［J］. BMC Med Res Methodol, 2022, 22(1): 39.
［4］Khan M S, Khan M S, Ansari Z N, et al. Prevalence of multiplicity and appropriate adjustments among cardiovascular randomized clinical trials published in major medical journals［J］. JAMA Netw Open, 2020, 3(4): e203082.
［5］Andrade C. HARKing, Cherry-picking, P-hacking, fishing expeditions, and data dredging and mining as questionable research practices［J］. J Clin Psychiatry, 2021, 82(1): 33999541.
［6］Chowdhry A K, Park J, Kang J, et al. Finding multiple signals in the noise: handling multiplicity in clinical trials［J］. Int J Radiat Oncol Biol Phys, 2024, 119(3): 750－755.
［7］EMA. Points to consider on multiplicity issues in clinical trials［EB/OL］. (2002－09－19)［2024－11－07］. https://www.ema.europa.eu/en/documents/scientific-guideline/points-consider-multiplicity-issues-clinical-trials_en.pdf.
［8］国家食品药品监督管理局. 药物临床试验多重性问题指导原则（试行）［EB/OL］. (2020－12－31) ［2024－11－07］. https://www.cde.org.cn/main/news/viewInfoCommon/a1fd04ab94ffa83aadee4bd1c0327a7f.
［9］Benda N, Brandt A. Regulatory issues with multiplicity in drug approval: principles and controversies in a changing landscape［J］. J Biopharm Stat, 2018, 28(1): 3－9.
［10］Huque M F, Alosh M, Bhore R. Addressing multiplicity issues of a composite endpoint and its components in clinical trials［J］. J Biopharm Stat, 2011, 21(4): 610－634.
［11］Nicholson K J, Sherman M, Divi S N, et al. The role of family-wise error rate in determining statistical significance［J］. Clin Spine Surg, 2022, 35(5): 222－223.
［12］Schulz K F, Grimes D A. Multiplicity in randomised trials I: endpoints and treatments［J］. Lancet, 2005, 365(9470): 1591－1595.
［13］Cui X, Dickhaus T, Ding Y, et al. Handbook of multiple comparisons［M］. New York: Chapman and Hall/CRC, 2021: 36－38.
［14］Dmitrienko A, D'Agostino RB Sr. Multiplicity considerations in clinical trials［J］. N Engl J Med, 2018, 378(22): 2115－2122.
［15］Alosh M, Bretz F, Huque M. Advanced multiplicity adjustment methods in clinical trials［J］. Stat Med, 2014, 33(4): 693－713.
［16］陈峰, 夏结来. 临床试验统计学［M］. 北京: 人民卫生出版社, 2018: 211－223.
［17］Huque M F. Validity of the hochberg procedure revisited for clinical trial applications［J］. Stat Med, 2016, 35(1): 5－20.
［18］Dmitrienko A, Tamhane A C, Wiens B L. General multistage gatekeeping procedures［J］. Biom J, 2008, 50(5): 667－677.
［19］Sedgwick P. Multiple hypothesis testing and Bonferroni's correction［J］. BMJ, 2014, 349: g6284.
［20］Li J J, Mehrotra D V. An efficient method for accommodating potentially underpowered primary endpoints［J］. Stat Med, 2008, 27(26): 5377－5391.
［21］Hochberg Y. A sharper Bonferroni procedure for multiple tests of significance［J］. Biometrika, 1988, 75:800－802.
［22］Yamaguchi Y S E, Sugitani T, Yoshida S, et al. Confirmatory efficacy testing for individual dose-placebo comparisons using serial gatekeeping procedure in dose-finding trials with multiple comparison procedures-modeling［J］. Pharm Stat, 2022, 21(6): 1309－1323.
［23］Ouyang J, Zhang P, Carroll K J, et al. Comparisons of global tests on intersection hypotheses and their application in matched parallel gatekeeping procedures［J］. J Biopharm Stat, 2020, 30(4): 593－606.
［24］李若冰, 曾新, 李新旭, 等. 图示法在多重性问题中的应用及KeyNote-048案例分析［J］. 中国临床药理学杂志, 2022, 38(10): 1146－1150.
［25］Robertson D S, Wason J M S, Bretz F. Graphical approaches for the control of generalized error rates［J］. Stat Med, 2020, 39(23): 3135－3155.
［26］Kelley R K, Rimassa L, Cheng A L, et al. Cabozantinib plus atezolizumab versus sorafenib for advanced hepatocellular carcinoma (COSMIC-312): a multicentre, open-label, randomised, phase 3 trial［J］. Lancet Oncol, 2022, 23(8): 995－1008.
［27］Zi W J, Song J X, Kong W L, et al. Tirofiban for stroke without large or medium-sized vessel occlusion［J］. N Engl J Med, 2023, 388(22): 2025－2036.
［28］Burtness B, Harrington K J, Greil R, et al. Pembrolizumab alone or with chemotherapy versus cetuximab with chemotherapy for recurrent or metastatic squamous cell carcinoma of the head and neck (KEYNOTE-048): a randomised, open-label, phase 3 study［J］. Lancet, 2019, 394(10212): 1915－1928.

[1]	Yang Xiao, Xia Xue, Zhou Quan, Hao Yunyi, Wang Anxin. Application of sample size re-estimation within the “promising zone” framework in adaptive design clinical trials [J]. Journal of Capital Medical University, 2025, 46(2): 197-201.
[2]	Qu Junda, Yang Minfu, Li Chunlin, Sun Liwei, Gao He, Zhang Xu. Research progress on imaging segmentation and quantification methods for epicardial adipose tissue and its clinical applications [J]. Journal of Capital Medical University, 2025, 46(1): 99-105.
[3]	hu Liming, Jiao Kun, Liu Wei, Li Shengli. Effects of new bone allograft on physiological and biochemical indices of animals [J]. Journal of Capital Medical University, 2023, 44(6): 1053-1059.
[4]	Ji Jianghuai, Zhao Xiaoxiao, Li Qianpeng, An Yi, Zhao Lei, Li Dongguo. Identification of protein-coding genes regulated by aberrant methylation in glioblastoma [J]. Journal of Capital Medical University, 2021, 42(1): 71-76.
[5]	Zhang Yunxian, Wang Yamei, Zhou Ping. Construction and functional analysis of circular RNA interaction network based on open chromatin in breast cancer [J]. Journal of Capital Medical University, 2019, 40(6): 901-910.
[6]	Jiang Ziwen, Zhou Zhimin, Tang Hongbo, Du bo, Zhang Qiqing, Dai Yinmei. Cell toxicity and cell uptake study of pullulan acetate nanoparticles to BeWo b30 cells [J]. Journal of Capital Medical University, 2016, 37(4): 418-423.
[7]	Chen Xin, Luo Tao, Huang Ying. Development and clinical application of new-type IVCF [J]. Journal of Capital Medical University, 2016, 37(2): 248-251.
[8]	Guo Qiyu;Gao Yan;Cong Lin;Shao Ningsheng. Effects of Leptin on Gene and Protein Expression and Tyrosine Phosphorylation of Leptin Receptor in Rat hepatocyte [J]. Journal of Capital Medical University, 2007, 28(3): 304-306.
[9]	Lu Guang;Zhang Jian;Li Jianxin;Gu Yongquan;Sun Haichen;Chen Liang;Liu Qingyang;Wang Zhonggao . Evaluation of Cytocompatibility of Several Biomaterials on Vascular Tissue Engineering [J]. Journal of Capital Medical University, 2006, 27(3): 321-324.
[10]	Luo Shuqian;Zhao Yuanyuan;Yan Hua;Li Xiang . Study of Morphology of Brain Cortex Using Active Contour Method [J]. Journal of Capital Medical University, 2001, 22(1): 13-16.
[11]	Ma Binrong. Key Technique in Computer Assisted Instruction Research and Application [J]. Journal of Capital Medical University, 2000, 21(1): 23-25.
[12]	Luo Shuqian;Yan Hua. Based on Deformable Surface Model Morphology Extraction of Cortical Surface in MR Images [J]. Journal of Capital Medical University, 1999, 20(1): 9-13.
[13]	Du Jing;Wei Min. Database Designing of Query System of Cosmetology of Traditional Chinese Medicine [J]. Journal of Capital Medical University, 1996, 17(2): 107-109.
[14]	Ma Binrong;Wei Bingzhang. Three Dimension Reconstruction Computer System for Medical Imaging and It's Clinic Application [J]. Journal of Capital Medical University, 1995, 16(2): 109-112.
[15]	Yan Fusheng;Xu Ruixing;Yao Zhiping. A HPTLC Method Measuring the Content of Bluish Dogbane Extract in Bluish Dogbane Cigarette [J]. Journal of Capital Medical University, 1992, 13(4): 260-263.