How to Allocate Resources For Features Acquisition?

We study classification problems where features are corrupted by noise and where the magnitude of the noise in each feature is influenced by the resources allocated to its acquisition. This is the case, for example, when multiple sensors share a common resource (power, bandwidth, attention, etc.). We develop a method for computing the optimal resource allocation for a variety of scenarios and derive theoretical bounds concerning the benefit that may arise by non-uniform allocation. We further demonstrate the effectiveness of the developed method in simulations.

[1]  Foster J. Provost,et al.  Active feature-value acquisition for classifier induction , 2004, Fourth IEEE International Conference on Data Mining (ICDM'04).

[2]  Daphne Koller,et al.  Active Classification based on Value of Classifier , 2011, NIPS.

[3]  Michael Athans,et al.  1972 IFAC congress paper: On the determination of optimal costly measurement strategies for linear stochastic systems , 1972 .

[4]  Steven R. Rogers,et al.  Optimal measurement scheduling for prediction and estimation , 1990, IEEE Trans. Acoust. Speech Signal Process..

[5]  Alfred O. Hero,et al.  Sensor Management: Past, Present, and Future , 2011, IEEE Sensors Journal.

[6]  D. Kleinman,et al.  Optimal measurement scheduling for state estimation , 1992, [Proceedings] 1992 IEEE International Conference on Systems, Man, and Cybernetics.

[7]  Kilian Q. Weinberger,et al.  The Greedy Miser: Learning under Test-time Budgets , 2012, ICML.

[8]  J. Peschon,et al.  Optimal control of measurement subsystems , 1967, IEEE Transactions on Automatic Control.

[9]  Nicolò Cesa-Bianchi,et al.  Online Learning of Noisy Data , 2011, IEEE Transactions on Information Theory.

[10]  Alexander J. Smola,et al.  Second Order Cone Programming Approaches for Handling Missing and Uncertain Data , 2006, J. Mach. Learn. Res..

[11]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[12]  Venkatesh Saligrama,et al.  Feature-Budgeted Random Forest , 2015, ICML.

[13]  V. Krishnamurthy,et al.  Hierarchical resource management in adaptive airborne surveillance radars , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[14]  Seymour Stein,et al.  Modern communication principles : with applications to digital signaling , 1967 .

[15]  Shie Mannor,et al.  Dynamic Sensing: Better Classification under Acquisition Constraints , 2015, ICML.

[16]  Carlos S. Kubrusly,et al.  Stochastic approximation algorithms and applications , 1973, CDC 1973.

[17]  Venkatesh Saligrama,et al.  Multi-stage classifier design , 2012, Machine Learning.

[18]  Ingo Steinwart,et al.  Consistency of support vector machines and other regularized kernel classifiers , 2005, IEEE Transactions on Information Theory.

[19]  David A. Castañón,et al.  Adaptive sensor management for feature-based classification , 2010, 49th IEEE Conference on Decision and Control (CDC).

[20]  Martin Zinkevich,et al.  Online Convex Programming and Generalized Infinitesimal Gradient Ascent , 2003, ICML.

[21]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[22]  Ambuj Tewari,et al.  On the Complexity of Linear Prediction: Risk Bounds, Margin Bounds, and Regularization , 2008, NIPS.

[23]  Shie Mannor,et al.  A distributional interpretation of robust optimization , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[24]  Shie Mannor,et al.  Robustness and Regularization of Support Vector Machines , 2008, J. Mach. Learn. Res..

[25]  Ning Xiong,et al.  Multi-sensor management for information fusion: issues and approaches , 2002, Inf. Fusion.

[26]  Russell Greiner,et al.  Budgeted Learning of Naive-Bayes Classifiers , 2003, UAI.

[27]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[28]  William Nick Street,et al.  Breast Cancer Diagnosis and Prognosis Via Linear Programming , 1995, Oper. Res..

[29]  Matt J. Kusner,et al.  Cost-Sensitive Tree of Classifiers , 2012, ICML.

[30]  M. Athans.  On the Determination of Optimal Costly Measurement Strategies for Linear Stochastic Systems , 1972 .