This lecture reviews topics from the "Information" chapter by Mitchell (2009, Chapter 3). This chapter reviews the history and fundamentals of thermodynamics and statistical mechanics and how they led to modern information theory. We review topics as in the second law of thermodynamics, Boltzmann entropy, multi-scale modeling, microstates and macrostates (and coarse graining), temperature and other functions of state, Maxwell's demon, and erasure and the Landaurer limit. This lecture discussion sets up a more formal discussion of information, entropy, and free energy in the next lecture period.
Whiteboard notes for this lecture can be found at: https://www.dropbox.com/s/hjf8k7cnedddoko/SOS220-LectureE1-2023-02-14-Information_and_Thermodynamics.pdf?dl=0
No comments:
Post a Comment