Delay optimal multichannel opportunistic access

The problem of minimizing queueing delay of opportunistic access of multiple continuous time Markov channels is considered. A new access policy based on myopic sensing and adaptive transmission (MS-AT) is proposed. Under the framework of risk sensitive constrained Markov decision process with effective bandwidth as a measure of queueing delay, it is shown that MS-AT achieves simultaneously throughput and delay optimality. It is shown further that both the effective bandwidth and the throughput of MS-AT are two-segment piece-wise linear functions of the collision constraint (maximum allowable conditional collision probability) with the effective bandwidth and throughput coinciding in the regime of tight collision constraints. Analytical and simulation comparisons are conducted with the myopic sensing and memoryless transmission (MS-MT) policy which is throughput optimal but delay suboptimal in the regime of tight collision constraints.

[1]  Panganamala Ramana Kumar,et al.  Scheduling Heterogeneous Real-Time Traffic Over Fading Wireless Channels , 2014, IEEE/ACM Transactions on Networking.

[2]  Dapeng Wu,et al.  Effective capacity: a wireless link model for support of quality of service , 2003, IEEE Trans. Wirel. Commun..

[3]  Mingyan Liu,et al.  Optimality of Myopic Sensing in Multi-Channel Opportunistic Access , 2008, 2008 IEEE International Conference on Communications.

[4]  Sanjay Shakkottai,et al.  Effective Capacity and QoS for Wireless Scheduling , 2008, IEEE Transactions on Automatic Control.

[5]  S. Marcus,et al.  Risk sensitive control of Markov processes in countable state space , 1996 .

[6]  Lang Tong,et al.  Queuing Analysis in Multichannel Cognitive Spectrum Access: A Large Deviation Approach , 2010, 2010 Proceedings IEEE INFOCOM.

[7]  Ananthram Swami,et al.  Decentralized cognitive MAC for opportunistic spectrum access in ad hoc networks: A POMDP framework , 2007, IEEE Journal on Selected Areas in Communications.

[8]  Lang Tong,et al.  Interference-aware OFDMA resource allocation: A predictive approach , 2008, MILCOM 2008 - 2008 IEEE Military Communications Conference.

[9]  Lang Tong,et al.  Optimal Cognitive Access of Markovian Channels under Tight Collision Constraints , 2011, IEEE J. Sel. Areas Commun..

[10]  Frank Kelly,et al.  Notes on effective bandwidths , 1994 .

[11]  Cheng-Shang Chang,et al.  Stability, queue length, and delay of deterministic and stochastic queueing networks , 1994, IEEE Trans. Autom. Control..

[12]  Lang Tong,et al.  Delay Analysis for Cognitive Radio Networks with Random Access: A Fluid Queue View , 2010, 2010 Proceedings IEEE INFOCOM.

[13]  Frank P. Kelly,et al.  Effective bandwidths at multi-class queues , 1991, Queueing Syst. Theory Appl..

[14]  Brian M. Sadler,et al.  COGNITIVE RADIOS FOR DYNAMIC SPECTRUM ACCESS - Dynamic Spectrum Access in the Time Domain: Modeling and Exploiting White Space , 2007, IEEE Communications Magazine.

[15]  Jean C. Walrand,et al.  Effective bandwidths: Call admission, traffic policing and filtering for ATM networks , 1995, Queueing Syst. Theory Appl..

[16]  I-Hong Hou Scheduling Heterogeneous Real-Time Traffic Over Fading Wireless Channels , 2014, IEEE/ACM Transactions on Networking.

[17]  Lang Tong,et al.  Multiuser cognitive access of continuous time Markov channels: Maximum throughput and effective bandwidth regions , 2010, 2010 Information Theory and Applications Workshop (ITA).

[18]  Lang Tong,et al.  Maximum Throughput Region of Multiuser Cognitive Access of Continuous Time Markovian Channels , 2011, IEEE Journal on Selected Areas in Communications.

[19]  Joseph Y. Hui Resource allocation for broadband networks , 1988, IEEE J. Sel. Areas Commun..

[20]  Michel Mandjes,et al.  Large Deviations for Performance Analysis: Queues, Communications, and Computing , Adam Shwartz and Alan Weiss (New York: Chapman and Hall, 1995). , 1996, Probability in the Engineering and Informational Sciences.

[21]  Panganamala Ramana Kumar,et al.  Admission control and scheduling for QoS guarantees for variable-bit-rate applications on wireless channels , 2009, MobiHoc '09.

[22]  Karel Sladký Constrained Risk-Sensitive Markov Decision Chains , 2009 .

[23]  Brian M. Sadler,et al.  Opportunistic Spectrum Access via Periodic Channel Sensing , 2008, IEEE Transactions on Signal Processing.

[24]  Vivek S. Borkar,et al.  A Theory of QoS for Wireless , 2009, IEEE INFOCOM 2009.

[25]  Brian M. Sadler,et al.  A Survey of Dynamic Spectrum Access , 2007, IEEE Signal Processing Magazine.

[26]  R. Srikant,et al.  A Large Deviations Analysis of Scheduling in Wireless Networks , 2006, IEEE Transactions on Information Theory.

[27]  Debasis Mitra,et al.  Effective bandwidth of general Markovian traffic sources and admission control of high speed networks , 1993, IEEE INFOCOM '93 The Conference on Computer Communications, Proceedings.

[28]  Masami Yasuda,et al.  Discounted Markov decision processes with utility constraints , 2006, Comput. Math. Appl..

[29]  Bhaskar Krishnamachari,et al.  On myopic sensing for multi-channel opportunistic access: structure, optimality, and performance , 2007, IEEE Transactions on Wireless Communications.

[30]  Brian M. Sadler,et al.  Dynamic Spectrum Access in the Time Domain : Modeling and Exploiting Whitespace , 2007 .

[31]  P. Glynn,et al.  Logarithmic asymptotics for steady-state tail probabilities in a single-server queue , 1994, Journal of Applied Probability.