Information Theory and Statistical Physics

  1. R. Meir and N. Merhav, ``On the stochastic complexity of learning realizable and unrealizable rules,'' Machine Learning, vol. 19, no. 3, pp. 241-261, 1995.
  2. N. Merhav, ``An identity of Chernoff bounds with an interpretation in statistical physics and applications in information theory,'' IEEE Trans. Inform. Theory, vol. 54, no. 8, pp. 3710-3721, August 2008.
  3. N. Merhav, ``Relations between random coding exponents and the statistical physics of random codes,'' IEEE Trans. Inform. Theory, , vol. 55, no. 1, pp. 83-92, January 2009.
  4. N. Merhav, ``The generalized random energy model of spin glasses and its application to the statistical physics of code ensembles with hierarchical structures,'' IEEE Trans. Inform. Theory , vol. 55, no. 3, pp. 1250-1268, March 2009.
  5. N. Merhav, ``The random energy model in a magnetic field and joint source-channel coding,'' Physica A: Statistical Mechanics and its Applications , vol. 387, issue 22, pp. 5662-5674, September 15, 2008.
  6. N. Merhav, ``Joint source-channel coding via statistical mechanics: thermal equilibrium between the source and the channel,'' IEEE Trans. Inform. Theory, vol. 55, no. 12, pp. 5382-5393, December 2009.
  7. N. Merhav, ``On the statistical physics of directed polymers in a random medium and their relation to tree codes,'' IEEE Trans. Inform. Theory, vol. 56, no. 3, pp. 1345-1350, March 2010.
  8. N. Merhav, D. Guo, and S. Shamai (Shitz), ``Statistical physics of signal estimation in Gaussian noise: theory and examples of phase transitions,'' IEEE Trans. Inform. Theory, vol. 56, no. 3, pp. 1400-1416, March 2010.
  9. N. Merhav, ``Physics of the Shannon limits,'' IEEE Trans. Inform. Theory, vol. 56, no. 9, pp. 4274-4285, September 2010. Short version - Proc. 2009 IEEE Workshop on Information Theory (ITW 2009), Taormina, Sicily, Italy, October 11-16, 2009.
  10. N. Merhav, ``Statistical physics and information theory,'' (invited paper) Foundations and Trends in Communications and Information Theory, vol. 6, nos. 1-2, pp. 1-212, 2009.
  11. N. Merhav, ``Another look at the physics of large deviations with application to rate-distortion theory,'' Technical Report, CCIT Pub. no. 742, EE Pub. no. 1699, August 2009. Also, available in arXiv and here is the conference version, which appears in Proc. ISIT 2010, Austin, Texas, U.S.A., June 2010.
  12. N. Merhav, ``Optimum estimation via gradients of partition functions and information measures: a statistical-mechanical perspective,'' IEEE Trans. on Inform. Theory, vol. 57, no. 6, pp. 3887-3898, June 2011.
  13. N. Merhav and Y. Kafri, ``Bose-Einstein condensation in the large deviations regime with applications to information system models,'' Journal of Statistical Mechanics: Theory and Experiment, P02011, February 2010.
  14. N. Merhav, ``Threshold effects in parameter estimation as phase transitions in statistical mechanics,'' IEEE Trans. on Inform. Theory, vol. 57, no. 10, pp. 7000-7010, October 2011.
  15. N. Merhav, ``Data processing theorems and the second law of thermodynamics,'' IEEE Trans. on Inform. Theory, vol. 57, no. 8, pp. 4926-4939, August 2011.
  16. N. Merhav and Y. Kafri, ``Statistical properties of entropy production derived from fluctuation theorems,'' Journal of Statistical Mechanics: Theory and Experiment, P12022, December 2010. doi: 10.1088/1742-5468/2010/12/P12022
  17. N. Merhav, ``A statistical-mechanical view on source coding: physical compression and data compression,'' Journal of Statistical Mechanics: Theory and Experiment, P01029, January 2011, doi: 10.1088/1742-5468/2011/01/P01029. [With a certain overlap to no. 11, but with a different emphasis and some other results.]
  18. N. Merhav, ``On optimum strategies for minimizing exponential moments of a loss function,'' Communications in Information and Systems, vol. 11, no. 4, pp. 343-368, 2011.
  19. N. Merhav, ``Relations between redundancy patterns of the Shannon code and wave diffraction patterns of partially disordered media,'' IEEE Trans. Inform. Theory, vol. 58, no. 6, pp. 3402-3406, January 2012.
  20. N. Merhav, ``Subset-sum phase transitions and data compression,'' Journal of Statistical Mechanics: Theory and Experiment, P09017, September 2011, doi: 10.1088/1742-5468/2011/09/P01029
  21. N. Merhav, ``Another look at expurgated bounds and their statistical-mechanical interpretation,'' unpublished.
  22. N. Merhav, ``Erasure/list exponents for Slepian-Wolf decoding,'' IEEE Trans. Inform. Theory, vol. 60, no. 8, pp. 4463-4471, August 2014.
  23. W. Huleihel and N. Merhav, ``Analysis of mismatched estimation errors using gradients of partition functions,'' IEEE Trans. Inform. Theory,, vol. 60, no. 4, pp. 2190-2216, April 2014.
  24. J. Scarlett, L. Peng, N. Merhav, A. Martinez, and A. G. i Fabregas, ``Expurgated random-coding ensembles: exponents, refinements and connections,'' IEEE Trans. Inform. Theory, vol. 60, no. 8, pp. 4449-4462, August 2014.
  25. W. Huleihel and N. Merhav, ``Asymptotic MMSE analysis under sparse representation modeling,'' IEEE Trans. Inform. Theory,, Signal Processing, vol. 131, pp. 320-332, February 2017.
  26. D. Vinkler, H. Permuter, and N. Merhav, ``Analogy between gambling and measurement-based work extraction,'' Proc. ISIT 2014, pp. 1111-1115, Honolulu, Hawaii, June-July 2014. Full version is here.
  27. N. Merhav, ``Statistical physics of random binning,'' IEEE Trans. Inform. Theory, vol. 61, no. 5, pp. 2454-2464, May 2015.
  28. N. Merhav, ``Sequence complexity and work extraction,'' Journal of Statistical Mechanics: Theory and Experiment, P06037, June 2015. doi:10.1088/1742-5468/2015/06/P06037
  29. N. Merhav, ``Relations between work and entropy production for general information-driven, finite-state engines,'' Journal of Statistical Mechanics: Theory and Experiment, 023207, February 2017. https://doi.org/10.1088/1742-5468/aa58f3
  30. N. Merhav, ``Lower bounds on exponential moments of the quadratic error in parameter estimation,'' IEEE Trans. Inform. Theory, vol. 64, no. 12, pp. 7636--7648, December 2018.
  31. L. Touzo, M. Marsili, N. Merhav, and E. Roldan, ``Optimal work extraction and the minimum description length principle,'' Journal of Statistical Mechanics: Theory and Experiment (JSTAT)}, 094403, September 2020. http://dx.doi.org/10.1088/1742-5468/abacb3