The entropy function plays a central role in information theory. Constraints on the entropy function in the form of inequalities, viz. entropy inequalities (often conditional on certain Markov conditions imposed by the problem under consideration), are indispensable tools for proving converse coding theorems. In this expository article, we give an overview o...
Student researchers are an indispensable part of the IEEE Information Theory Society (ITSoc). If academic research is analogized with a communication system, then our faculty body constitutes the codebook, and our student body represents the codewords traveling through the medium of time, taking with them our most consequential messages and research outputs...
This new venture was made possible by generous support from the Board of Governors of the IT Society, and I appreciate their vision and leadership. IEEE BITS looks to publish tutorial articles that view vibrant research areas like machine learning, wireless, quantum information science, and blockchains through an information-theoretic lens. We are supporte...
Privacy has become an emerging challenge in both information theory and computer science due to massive (centralized) collection of user data. In this article, we overview privacy-preserving mechanisms and metrics from the lenses of information theory, and unify different privacy metrics, including f-divergences, Rényi divergences, and differential privacy (...