Abstract
Abstract: The presentation starts by demonstrating in a descriptive way the origin of information theory in
Shannon's 1948 monumental work, and pointing some interdisciplinary aspects within general areas of
electrical engineering and beyond. A change of paradigms in information theory from being a pure
mathematical theory of communications to a theory with wide scope direct practical implications
and applications is overviewed. To demonstrate the rich aspects of the problems considered
and their implications as well as some inter-disciplinary connections, we focus on a simple matrix based linear
additive Gaussian model. From a personal viewpoint, we elaborate on the information-estimation
intimate connection, mentioning its impact on non-linear filtering and on recent views of efficient coding in
single and multi-terminal channels. Possible extensions and a short outlook conclude the presentation.
Shannon's 1948 monumental work, and pointing some interdisciplinary aspects within general areas of
electrical engineering and beyond. A change of paradigms in information theory from being a pure
mathematical theory of communications to a theory with wide scope direct practical implications
and applications is overviewed. To demonstrate the rich aspects of the problems considered
and their implications as well as some inter-disciplinary connections, we focus on a simple matrix based linear
additive Gaussian model. From a personal viewpoint, we elaborate on the information-estimation
intimate connection, mentioning its impact on non-linear filtering and on recent views of efficient coding in
single and multi-terminal channels. Possible extensions and a short outlook conclude the presentation.
Original language | American English |
---|---|
State | Published - 2016 |
Event | 2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016 - Eilat, Israel Duration: 16 Nov 2016 → 18 Nov 2016 |
Conference
Conference | 2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016 |
---|---|
Country/Territory | Israel |
City | Eilat |
Period | 16/11/16 → 18/11/16 |