Information Theory: Some Old and Some New

Research output: Contribution to conferenceOtherpeer-review

Abstract

Abstract: The presentation starts by demonstrating in a descriptive way the origin of information theory in
Shannon's 1948 monumental work, and pointing some interdisciplinary aspects within general areas of
electrical engineering and beyond. A change of paradigms in information theory from being a pure
mathematical theory of communications to a theory with wide scope direct practical implications
and applications is overviewed. To demonstrate the rich aspects of the problems considered
and their implications as well as some inter-disciplinary connections, we focus on a simple matrix based linear
additive Gaussian model. From a personal viewpoint, we elaborate on the information-estimation
intimate connection, mentioning its impact on non-linear filtering and on recent views of efficient coding in
single and multi-terminal channels. Possible extensions and a short outlook conclude the presentation.
Original languageAmerican English
StatePublished - 2016
Event2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016 - Eilat, Israel
Duration: 16 Nov 201618 Nov 2016

Conference

Conference2016 IEEE International Conference on the Science of Electrical Engineering, ICSEE 2016
Country/TerritoryIsrael
CityEilat
Period16/11/1618/11/16

Fingerprint

Dive into the research topics of 'Information Theory: Some Old and Some New'. Together they form a unique fingerprint.

Cite this