Optimal link adaptation over partially observable Gilbert-Elliot channels

In this paper a communication system operating over a Gilbert-Elliot channel is studied. The goal of the transmitter is to maximize the number of successfully transmitted bits. This is achieved by choosing among three possible actions: (i) betting aggressively by using a weak code that allows the transmission of a high number of bits but provides no protection against a bad channel, ii) betting conservatively by using a strong code that perfectly protects the transmitted bits against a bad channel but does not allow a high number of data bits, iii) betting opportunistically by sensing the channel for a fixed duration and then deciding which code to use. The problem is formulated and solved using the theory of Markov decision processes (MDPs). It is shown that the optimal strategy has a simple threshold structure. Closed form expressions and simplified procedures for the computation of the threshold policies in terms of the system parameters are provided.

[1]  S. Ross.  Quality Control under Markovian Deterioration , 1971 .

[2]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[3]  Saleem A. Kassam,et al.  Finite-state Markov model for Rayleigh fading channels , 1999, IEEE Trans. Commun..

[4]  Brian M. Sadler,et al.  A Survey of Dynamic Spectrum Access , 2007, IEEE Signal Processing Magazine.

[5]  G. Monahan.  Optimal stopping in a partially observable binary-valued markov chain with costly perfect information , 1982 .

[6]  E. Gilbert.  Capacity of a burst-noise channel , 1960 .

[7]  Lang Tong,et al.  Betting on Gilbert-Elliot channels , 2010, IEEE Transactions on Wireless Communications.

[8]  Vikram Krishnamurthy,et al.  Opportunistic file transfer over a fading channel: A POMDP search theory formulation with optimal threshold policies , 2006, IEEE Transactions on Wireless Communications.

[9]  A. Goldsmith,et al.  Variable-rate variable-power MQAM for fading channels , 1996, Proceedings of Vehicular Technology Conference - VTC.

[10]  Danlu Zhang,et al.  Transmission schemes for time-varying wireless channels with partial state observations , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[11]  Steven I. Marcus,et al.  On the computation of the optimal cost function for discrete time Markov models with partial observations , 1991, Ann. Oper. Res..

[12]  K. J. Ray Liu,et al.  Jointly optimized bit-rate/delay control policy for wireless packet networks with fading channels , 2002, IEEE Trans. Commun..