Expressions for the Entropy of Basic Discrete Distributions. Cheraghchi, M. IEEE Transactions on Information Theory, 65(7):3999–4009, 2019. Preliminary version in Proceedings of ISIT 2018.
Expressions for the Entropy of Basic Discrete Distributions [link]Link  Expressions for the Entropy of Basic Discrete Distributions [link]Paper  doi  abstract   bibtex   
We develop a general method for computing logarithmic and log-gamma expectations of distributions. As a result, we derive series expansions and integral representations of the entropy for several fundamental distributions, including the Poisson, binomial, beta-binomial, negative binomial, and hypergeometric distributions. Our results also establish connections between the entropy functions and to the Riemann zeta function and its generalizations.
@ARTICLE{ref:Che19:entropy,
  author =	 {Mahdi Cheraghchi},
  title =	 {Expressions for the Entropy of Basic Discrete
                  Distributions},
  year =	 2019,
  journal =	 {{IEEE Transactions on Information Theory}},
  volume =	 65,
  number =	 7,
  pages =	 {3999--4009},
  note =	 {Preliminary version in Proceedings of {ISIT 2018}.},
  doi =		 {10.1109/TIT.2019.2900716},
  url_Link =	 {https://ieeexplore.ieee.org/document/8648470},
  url_Paper =	 {https://arxiv.org/abs/1708.06394},
  abstract =	 {We develop a general method for computing
                  logarithmic and log-gamma expectations of
                  distributions. As a result, we derive series
                  expansions and integral representations of the
                  entropy for several fundamental distributions,
                  including the Poisson, binomial, beta-binomial,
                  negative binomial, and hypergeometric
                  distributions. Our results also establish
                  connections between the entropy functions and to the
                  Riemann zeta function and its generalizations.  }
}

Downloads: 0