Finding and assessing treatment effect sweet spots in clinical trial data.

Identifying heterogeneous treatment effects (HTEs) in randomised controlled trials is an important step toward understanding and acting on trial results. However, HTEs are often small and difficult to identify, and HTE modeling methods which are very general can suffer from low power. We present a method that exploits any existing relationship between between illness severity and treatment effect, and searches for the "sweet spot", the contiguous range of illness severity where the estimated treatment benefit is maximized. We further compute a bias-corrected estimate of the conditional average treatment effect (CATE) in the sweet spot, and compute a $p$-value. Because we identify a single sweet spot and $p$-value, we believe our method to be straightforward to interpret and actionable: results from our method can inform future clinical trials and help clinicians make personalized treatment recommendations.

[1]  C. Holmes,et al.  Machine learning analysis plans for randomised controlled trials: detecting treatment effect heterogeneity with strict control of type I error , 2020, Trials.

[2]  R. Tibshirani,et al.  An Approach to Explore for a Sweet-spot in Randomized Trials. , 2019, Journal of clinical epidemiology.

[3]  James Watson,et al.  Graphing and reporting heterogeneous treatment effects through reference classes , 2019, bioRxiv.

[4]  Sören R. Künzel,et al.  Metalearners for estimating heterogeneous treatment effects using machine learning , 2017, Proceedings of the National Academy of Sciences.

[5]  S. Athey,et al.  Generalized random forests , 2016, The Annals of Statistics.

[6]  Matthew M. Chingos,et al.  The Review of Economics and Statistics , 2018 .

[7]  Susan Athey,et al.  Recursive partitioning for heterogeneous causal effects , 2015, Proceedings of the National Academy of Sciences.

[8]  Lu Tian,et al.  Effectively Selecting a Target Population for a Future Comparative Study , 2013, Journal of the American Statistical Association.

[9]  Kamolrat Silamut,et al.  Artesunate versus quinine in the treatment of severe falciparum malaria in African children (AQUAMAT): an open-label, randomised trial , 2010, The Lancet.

[10]  David M Kent,et al.  Assessing and reporting heterogeneity in treatment effects in clinical trials: a proposal , 2010, Trials.

[11]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[12]  R. Tibshirani,et al.  Pre-validation and inference in microarrays , 2002, Statistical applications in genetics and molecular biology.

[13]  R. Tibshirani,et al.  An Introduction to the Bootstrap , 1995 .