Information Theory course : References

• Information theory, inference, and learning algorithms : David MacKay (free)
• Elements of information theory (2nd edition) : Thomas Cover & Joy Thomas
• Notes by Jérémy Bensadon of courses by Yann Ollivier

• Pattern recognition and machine learning : Christopher Bishop
• The elements of statistical learning (data mining, inference, and prediction) : Trevor Hastie, Robert Tibshirani & Jerome Friedman
• Gaussian processes for Machine Learning : Carl Rasmussen and Christopher Williams