QuTE: Decentralized multiple testing on sensor networks with false discovery rate control

The field of distributed estimation, computation, testing and learning on graphs has witnessed large advances in theory and wide adoption in practice. However, there do not currently exist any methods for multiple hypothesis testing on graphs that are equipped with provable guarantees on error metrics like the false discovery rate (FDR). In this paper, we consider a novel but natural setting where distinct agents reside on the nodes of an undirected graph, and each agent possesses p-values corresponding to one or more hypotheses local to its node. Each agent must individually decide whether to reject one or more local hypotheses by only communicating with its neighbors, with the joint aim that the global FDR over the entire graph must be controlled at a predefined level. We propose a simple decentralized family of Query- Test-Exchange (QuTE) algorithms and prove that they can control FDR under independence or positive dependence of the p-values. Our algorithm reduces to the Benjamini-Hochberg algorithm when the graph is a star or a clique, and to the Bonferroni procedure when the graph has no edges. We study the power of our procedure using a simulation suite of different levels of connectivity and communication on a variety of graph structures, and also provide an illustrative real-world example.

[1]  P. Seeger A Note on a Method for the Analysis of Significances en masse , 1968 .

[2]  Robert R. Tenney,et al.  Detection with distributed sensors , 1980 .

[3]  Ιωαννησ Τσιτσικλησ,et al.  PROBLEMS IN DECENTRALIZED DECISION MAKING AND COMPUTATION , 1984 .

[4]  Maurizio Longo,et al.  Quantization for decentralized hypothesis testing under communication constraints , 1990, IEEE Trans. Inf. Theory.

[5]  P. Varshney,et al.  Some results on distributed nonparametric detection , 1990, 29th IEEE Conference on Decision and Control.

[6]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[7]  Rick S. Blum,et al.  Distributed detection with multiple sensors I. Advanced topics , 1997, Proc. IEEE.

[8]  Pramod K. Varshney,et al.  Distributed detection with multiple sensors I. Fundamentals , 1997, Proc. IEEE.

[9]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[10]  Venugopal V. Veeravalli,et al.  Decentralized detection in sensor networks , 2003, IEEE Trans. Signal Process..

[11]  S. Venkatesh,et al.  Distributed Bayesian hypothesis testing in sensor networks , 2004, Proceedings of the 2004 American Control Conference.

[12]  Michael I. Jordan,et al.  Nonparametric decentralized detection using kernel methods , 2005, IEEE Transactions on Signal Processing.

[13]  Zhi-Quan Luo,et al.  Universal decentralized estimation in a bandwidth constrained sensor network , 2005, IEEE Transactions on Information Theory.

[14]  J. Shamma,et al.  Belief consensus and distributed hypothesis testing in sensor networks , 2006 .

[15]  Dean P. Foster,et al.  α‐investing: a procedure for sequential control of expected false discoveries , 2008 .

[16]  George V. Moustakides,et al.  Decentralized Sequential Hypothesis Testing Using Asynchronous Communication , 2009, IEEE Transactions on Information Theory.

[17]  Mort Naraghi-Pour,et al.  Decentralized Hypothesis Testing in Wireless Sensor Networks in the Presence of Misbehaving Nodes , 2013, IEEE Transactions on Information Forensics and Security.

[18]  Adel Javanmard,et al.  Online Rules for Control of False Discovery Rate and False Discovery Exceedance , 2016, ArXiv.

[19]  Gokhan Gul,et al.  Robust Decentralized Hypothesis Testing , 2017 .

[20]  Martin J. Wainwright,et al.  Online control of the false discovery rate with decaying memory , 2017, NIPS.

[21]  Aaditya Ramdas,et al.  The p‐filter: multilayer false discovery rate control for grouped hypotheses , 2017 .

[22]  James Gross,et al.  Decentralized Hypothesis Testing in Energy Harvesting Wireless Sensor Networks , 2016, IEEE Transactions on Signal Processing.

[23]  Michael I. Jordan,et al.  A unified treatment of multiple testing with prior knowledge using the p-filter , 2017, The Annals of Statistics.