Estimation After Parameter Selection: Performance Analysis and Estimation Methods

In many practical parameter estimation problems, prescreening and parameter selection are performed prior to estimation. In this paper, we consider the problem of estimating a preselected unknown deterministic parameter chosen from a parameter set based on observations according to a predetermined selection rule, Ψ. The data-based parameter selection process may impact the subsequent estimation by introducing a selection bias and creating coupling between decoupled parameters. This paper introduces a post-selection mean squared error (PSMSE) criterion as a performance measure. A corresponding Cramέr-Rao-type bound on the PSMSE of any Ψ-unbiased estimator is derived, where the Ψ-unbiasedness is in the Lehmann-unbiasedness sense. The post-selection maximum-likelihood (PSML) estimator is presented. Itis proved that if there exists an Ψ-unbiased estimator that achieves the Ψ-Cramer-Rao bound (CRB), i.e., an Ψ-efficient estimator, then it is produced by the PSML estimator. In addition, iterative methods are developed for the practical implementation of the PSML estimator. Finally, the proposed Ψ-CRB and PSML estimator are examined for exponential populations, a linear Gaussian model applicable in clinical research, and spectrum sensing in cognitive radio communication.

[1]  Lang Tong,et al.  The Cramér-Rao bound for estimation-after-selection , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  I. Olkin,et al.  Selecting and Ordering Populations: A New Statistical Methodology , 1977 .

[3]  Joseph Tabrikian,et al.  Cyclic Barankin-Type Bounds for Non-Bayesian Periodic Parameter Estimation , 2014, IEEE Transactions on Signal Processing.

[4]  Vladimir Dragalin,et al.  Likelihood inference for a two‐stage design with treatment selection , 2010, Biometrical journal. Biometrische Zeitschrift.

[5]  Mohamed-Slim Alouini,et al.  On the Energy Detection of Unknown Signals Over Fading Channels , 2007, IEEE Transactions on Communications.

[6]  E. Samuel-Cahn,et al.  Evaluating the chosen population: a Bayes and minimax approach , 1986 .

[7]  Joseph Tabrikian,et al.  General Classes of Performance Lower Bounds for Parameter Estimation—Part I: Non-Bayesian Bounds for Unbiased Estimators , 2010, IEEE Transactions on Information Theory.

[8]  C. Walck Hand-book on statistical distributions for experimentalists , 1996 .

[9]  Hagit Messer,et al.  Notes on the Tightness of the Hybrid CramÉr–Rao Lower Bound , 2009, IEEE Transactions on Signal Processing.

[10]  Arie Yeredor,et al.  The joint MAP-ML criterion and its relation to ML and to extended least-squares , 2000, IEEE Trans. Signal Process..

[11]  Allan R. Sampson,et al.  Extension of a Two-Stage Conditionally Unbiased Estimator of the Selected Population to the Bivariate Normal Case , 2007 .

[12]  Palaniappan Vellaisamy,et al.  A note on unbiased estimation following selection , 2009 .

[13]  Palaniappan Vellaisamy,et al.  Estimation of the mean of the selected gamma population , 1988 .

[14]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[15]  Lucy Y. Pao,et al.  Computing budget allocation for optimization of sensor processing order in sequential multi-sensor fusion algorithms , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[16]  Eric Chaumette,et al.  Cramér-Rao Bound Conditioned by the Energy Detector , 2007, IEEE Signal Processing Letters.

[17]  John Whitehead,et al.  On the bias of maximum likelihood estimation following a sequential test , 1986 .

[18]  Boaz Porat,et al.  The Cramer-Rao lower bound for signals with constant amplitude and polynomial phase , 1991, IEEE Trans. Signal Process..

[19]  Nader Nematollahi,et al.  Estimation of the parameter of the selected uniform population under the entropy loss function , 2012 .

[20]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[21]  S. Gupta On Some Multiple Decision (Selection and Ranking) Rules , 1965 .

[22]  Eric Chaumette,et al.  A New Barankin Bound Approximation for the Prediction of the Threshold Region Performance of Maximum Likelihood Estimators , 2008, IEEE Transactions on Signal Processing.

[23]  Jayant V. Deshpande,et al.  A note on conditionally unbiased estimation after selection , 1995 .

[24]  Hagit Messer,et al.  Order statistics approach for determining the number of sources using an array of sensors , 1999, IEEE Signal Processing Letters.

[25]  Neeraj Misra,et al.  On estimating the scale parameter of the selected gamma population under the scale invariant squared error loss function , 2006 .

[26]  Herbert Robbins,et al.  The U,V Method of Estimation , 1988 .

[27]  P. Stoica,et al.  On the Cramer-Rao bound for model-based spectral analysis , 2002, IEEE Signal Processing Letters.

[28]  Joseph Tabrikian,et al.  Non-Bayesian Periodic Cramér-Rao Bound , 2013, IEEE Transactions on Signal Processing.

[29]  E. Barankin Locally Best Unbiased Estimates , 1949 .

[30]  Jonathan E. Taylor,et al.  Exact Post Model Selection Inference for Marginal Screening , 2014, NIPS.

[31]  Wei-Ping Zhu,et al.  Relay-Selection Improves the Security-Reliability Trade-Off in Cognitive Radio Systems , 2014, IEEE Transactions on Communications.

[32]  Simon Haykin,et al.  Cognitive radio: brain-empowered wireless communications , 2005, IEEE Journal on Selected Areas in Communications.

[33]  P. Larzabal,et al.  On the influence of a detection step on lower bounds for deterministic parameter estimation , 2005, IEEE Transactions on Signal Processing.

[34]  B. Efron Estimation and Accuracy After Model Selection , 2014, Journal of the American Statistical Association.

[35]  Martin Wolf,et al.  Channel selection measures for multi-microphone speech recognition , 2014, Speech Commun..

[36]  Eric Chaumette,et al.  On ordered normally distributed vector parameter estimates , 2015, Signal Process..

[37]  Umberto Mengali,et al.  The modified Cramer-Rao bound in vector parameter estimation , 1998, IEEE Trans. Commun..

[38]  J. Pritchard,et al.  Overcoming the winner's curse: estimating penetrance parameters from case-control data. , 2007, American journal of human genetics.

[39]  Ruiguang Song On estimating the mean of the selected uniform population , 1992 .

[40]  Georgios B. Giannakis,et al.  Sensor-Centric Data Reduction for Estimation With WSNs via Censoring and Quantization , 2012, IEEE Transactions on Signal Processing.

[41]  Nigel Stallard,et al.  Point estimates and confidence regions for sequential trials involving selection , 2005 .

[42]  S. Panchapakesan,et al.  Estimation after subset selection from exponential populations , 1986 .

[43]  Umberto Mengali,et al.  The modified Cramer-Rao bound and its application to synchronization problems , 1994, IEEE Trans. Commun..

[44]  S Panchapakesan,et al.  An Estimation Problem Relating to Subset Selection for Normal Populations. , 1983 .

[45]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[46]  H. V. Trees,et al.  Bayesian Bounds for Parameter Estimation and Nonlinear Filtering/Tracking , 2007 .

[47]  J. Proakis On the Probability of Error for Multichannel Reception of Binary Signals , 1968 .

[48]  Takeo Fujii,et al.  A novel spectrum sensing method using multi-antennas without channel state information , 2009, 2009 6th International Symposium on Wireless Communication Systems.

[49]  Harold B. Sackrowitz,et al.  A Decision Theory Formulation for Population Selection Followed by Estimating the Mean of the Selected Population , 1988 .

[50]  Jack Bowden,et al.  Unbiased Estimation of Selected Treatment Means in Two‐Stage Trials , 2008, Biometrical journal. Biometrische Zeitschrift.

[51]  Simon Doclo,et al.  Reference Microphone Selection for MWF-based Noise Reduction Using Distributed Microphone Arrays , 2012, ITG Conference on Speech Communication.

[52]  Alfred O. Hero,et al.  Optimal Two-Stage Search for Sparse Targets Using Convex Criteria , 2008, IEEE Transactions on Signal Processing.

[53]  H. Vincent Poor,et al.  Sensor Selection in Distributed Multiple-Radar Architectures for Localization: A Knapsack Problem Formulation , 2012, IEEE Transactions on Signal Processing.

[54]  Yonina C. Eldar Minimum variance in biased estimation: bounds and asymptotically optimal estimators , 2004, IEEE Transactions on Signal Processing.

[55]  Joseph Tabrikian,et al.  Bayesian Estimation in the Presence of Deterministic Nuisance Parameters—Part I: Performance Bounds , 2015, IEEE Transactions on Signal Processing.

[56]  Werner Brannath,et al.  Shrinkage estimation in two‐stage adaptive designs with midtrial treatment selection , 2013, Statistics in medicine.

[57]  N. Mukhopadhyay,et al.  Multistage selection and ranking procedures : second-order asymptotics , 1994 .

[58]  B. Efron Tweedie’s Formula and Selection Bias , 2011, Journal of the American Statistical Association.

[59]  Hagit Messer,et al.  Detection and parameter estimation of a transient signal using order statistics , 2000, IEEE Trans. Signal Process..

[60]  Xiaomin Lu,et al.  On estimating the mean of the selected normal population in two-stage adaptive designs , 2013 .

[61]  J. Kalbfleisch,et al.  Maximization by Parts in Likelihood Inference , 2005 .

[62]  Stephen E. Fienberg,et al.  Testing Statistical Hypotheses , 2005 .

[63]  David A. Shnidman,et al.  Two noncentral chi-square generalizations , 1996, IEEE Trans. Inf. Theory.

[64]  Alfred O. Hero,et al.  Two-Stage Multiscale Search for Sparse Targets , 2011, IEEE Transactions on Signal Processing.

[65]  Tong Zhao,et al.  Distributed Sequential Bayesian Estimation of a Diffusive Source in Wireless Sensor Networks , 2007, IEEE Transactions on Signal Processing.