Linear Network Codes: A Unified Framework for Source, Channel, and Network Coding

We examine the issue of separation and code design for network data transmission environments. We demonstrate that source-channel sep-aration holds for several canonical network channel models when the whole network operates over a common finite field. Our approach uses linear codes. This simple, unifying framework allows us to re-establish with economy the optimality of linear codes for single transmitter channels and for Slepian-Wolf source coding. It also enables us to establish the optimality of linear codes for multiple access channels and for erasure broadcast channels. Moreover, we show that source-channel separation holds for these networks. This robustness of separation we show to be strongly predicated on the fact that noise and inputs are independent. The linearity of source, channel, and network coding blurs the delineation between these codes, and thus we explore joint linear de-sign. Finally, we illustrate the fact that design for individual network modules may yield poor results when such modules are concatenated, demonstrating that end-to-end coding is necessary. Thus, we argue, it is the lack of decomposability into canonical network modules, rather than the lack of separation between source and channel coding, that presents major challenges for coding in networks.

[1]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 2003, IEEE Trans. Inf. Theory.

[2]  S. Pradhan,et al.  Group-theoretic construction and analysis of generalized coset codesfor symmetric / asymmetric distributed source coding , 2000 .

[3]  Michelle Effros,et al.  Lossless and lossy broadcast system source codes: theoretical limits, optimal design, and empirical performance , 2000, Proceedings DCC 2000. Data Compression Conference.

[4]  Muriel Médard,et al.  Beyond routing: an algebraic approach to network coding , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[5]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[6]  Jakov Snyders,et al.  Linear codes for the sum mod-2 multiple-access channel with restricted access , 1995, IEEE Trans. Inf. Theory.

[7]  Imre Csiszár Linear codes for sources and source networks: Error exponents, universal coding , 1982, IEEE Trans. Inf. Theory.

[8]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[9]  Robert G. Gallager,et al.  Capacity and coding for degraded broadcast channels , 1974 .

[10]  R. Koetter,et al.  The benefits of coding over routing in a randomized setting , 2003, IEEE International Symposium on Information Theory, 2003. Proceedings..

[11]  E. J. Weldon,et al.  Coding for T-user multiple-access channels , 1979, IEEE Trans. Inf. Theory.

[12]  Peter Sanders,et al.  Polynomial time algorithms for network information flow , 2003, SPAA '03.

[13]  Parag A. Pathak,et al.  Massachusetts Institute of Technology , 1964, Nature.

[14]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[15]  Rudolf Ahlswede,et al.  Network information flow , 2000, IEEE Trans. Inf. Theory.

[16]  Jacob Wolfowitz,et al.  Multiple Access Channels , 1978 .

[17]  Rudolf Ahlswede,et al.  Source coding with side information and a converse for degraded broadcast channels , 1975, IEEE Trans. Inf. Theory.

[18]  P. Chou,et al.  Low complexity algebraic multicast network codes , 2003, IEEE International Symposium on Information Theory, 2003. Proceedings..

[19]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUSS): design and construction , 1999 .

[20]  Qian Zhao,et al.  Broadcast system source codes: a new paradigm for data compression , 1999, Conference Record of the Thirty-Third Asilomar Conference on Signals, Systems, and Computers (Cat. No.CH37020).

[21]  David J. C. MacKay,et al.  Good Error-Correcting Codes Based on Very Sparse Matrices , 1997, IEEE Trans. Inf. Theory.

[22]  M. Dahleh Laboratory for Information and Decision Systems , 2005 .

[23]  Aaron D. Wyner,et al.  A theorem on the entropy of certain binary sequences and applications-II , 1973, IEEE Trans. Inf. Theory.

[24]  Rudolf Ahlswede,et al.  Multi-way communication channels , 1973 .

[25]  Kannan Ramchandran,et al.  Distributed source coding: symmetric rates and applications to sensor networks , 2000, Proceedings DCC 2000. Data Compression Conference.

[26]  Edward C. van der Meulen,et al.  Random coding theorems for the general discrete memoryless broadcast channel , 1975, IEEE Trans. Inf. Theory.

[27]  Teofilo C. Ancheta Bounds and techniques for linear source coding (Ph.D. Thesis abstr.) , 1978, IEEE Trans. Inf. Theory.

[28]  Tomohiko Uyematsu An algebraic construction of codes for Slepian-Wolf source networks , 2001, IEEE Trans. Inf. Theory.

[29]  S. I. Gel'fand,et al.  Multiple-user communication , 1980 .