STATISTICAL MECHANICS
Entropy, Information, and Quantum Systems
Graduate Program in Physics — UERJ
Prof. Marcelo Santos Guimarães
2nd semester 2026 — Mondays and Wednesdays, 10:40–12:20 — 1h40 per class
Course Overview
This is a graduate course in equilibrium statistical mechanics. It develops the standard machinery — ensembles, classical and quantum gases, phase transitions, the Ising model, and the renormalization group — and then uses information theory and quantum information to clarify what that machinery means.
The material is organized into 29 lectures across seven modules, interleaved with three in-person written assessments, running from 10 August to 9 December 2026.
Lectures include short concept questions that the whole class answers and then discusses in pairs. These are not graded, but they are where the vocabulary used throughout the course — deciding whether a given claim is exact, a thermodynamic-limit statement, a controlled approximation, or a heuristic — is actually practised.
Learning Outcomes
By the end of the course, a student should be able to:
- derive the microcanonical, canonical, and grand-canonical ensembles and move between their thermodynamic potentials;
- compute fluctuations and response functions, and state when ensembles become equivalent;
- distinguish thermodynamic, Boltzmann, Gibbs, Shannon, von Neumann, entanglement, and Rényi entropies;
- use classical and quantum relative entropy, mutual information, and maximum-entropy inference in statistical-mechanical problems;
- explain why microscopic reversibility does not by itself yield macroscopic entropy increase;
- solve standard classical and quantum-gas problems, including degenerate Fermi gases and Bose–Einstein condensation;
- analyze simple phase transitions through Landau theory and the Ising model;
- explain coarse graining, fixed points, relevance, and universality in the renormalization group;
- state clearly whether a result is exact, a thermodynamic-limit statement, a controlled approximation, a model-specific example, or a heuristic argument.
Main References
- [Kardar-P] M. Kardar, Statistical Physics of Particles, Cambridge University Press, 2007.
- [PB] R. K. Pathria & P. D. Beale, Statistical Mechanics, 3rd ed., Elsevier, 2011.
- [Reichl] L. E. Reichl, A Modern Course in Statistical Physics, 4th ed., Wiley, 2016.
- [Kardar-F] M. Kardar, Statistical Physics of Fields, Cambridge University Press, 2007 — for phase transitions and renormalization.
Additional references:
- [CT] T. M. Cover & J. A. Thomas, Elements of Information Theory, 2nd ed., Wiley, 2006.
- [NC] M. A. Nielsen & I. L. Chuang, Quantum Computation and Quantum Information, Cambridge University Press, 2000.
- [Wilde] M. M. Wilde, Quantum Information Theory, 2nd ed., Cambridge University Press, 2017.
- [Witten] E. Witten, “A Mini-Introduction to Information Theory,” Rivista del Nuovo Cimento 43 (2020), arXiv:1805.11965.
- [Tong] D. Tong, Lectures on Statistical Physics — a concise standard route through ensembles, gases, and phase transitions.
- [Touchette] H. Touchette, “The large deviation approach to statistical mechanics,” Physics Reports 478 (2009) — large deviations and ensemble equivalence.
- [Seifert] U. Seifert, “Stochastic thermodynamics, fluctuation theorems and molecular machines,” Rep. Prog. Phys. 75 (2012) — entropy production and nonequilibrium work.
Assessment System
Grades come only from individual, in-person written assessments. There are three, weighted 30% / 30% / 40%.
| Assessment | Date | Weight | Coverage |
|---|---|---|---|
| Assessment 1 | 16/09 (Wed) | 30% | Modules I–II: thermodynamics, entropy, probability, ensembles, maximum entropy |
| Assessment 2 | 04/11 (Wed) | 30% | Modules III–IV: classical systems, irreversibility, information thermodynamics, quantum entropy, Landauer’s principle |
| Assessment 3 | 09/12 (Wed) | 40% | Modules V–VII: quantum gases, phase transitions, Ising, renormalization + a short cumulative entropy-synthesis problem |
Structure of each assessment
Every assessment has the same two parts.
Part A — Referee exercise (40 points). You receive a short draft derivation, competently written and mostly correct, containing a small number of substantive defects: statements that are wrong, or that claim a stronger status than they possess. For each defect you must
- locate it — quote the sentence or equation;
- diagnose it — say what is wrong, and name the assumption, limit, or approximation that has been misused or hidden;
- repair it — give the corrected statement together with its status: exact, thermodynamic-limit, controlled approximation, mean field, model-specific exact result, or heuristic.
Not everything unusual is wrong: flagging a correct statement costs points, so justify what you flag.
Part B — Calculations (60 points). Two problems of the same kind as the exercises in the lecture notes.
Conditions. One 1h40 meeting per assessment; individual work, in person; one handwritten double-sided A4 formula sheet; no books, internet, or electronic devices.
Practice
The lecture notes contain exercises for self-study. They are not submitted and not graded: the point of the assessments is not to reproduce a solution but to diagnose an argument and state precisely what it does and does not establish. Selected problems can be discussed in optional office hours.
Module Summary
| Module | Theme | Lectures | Dates |
|---|---|---|---|
| I | Thermodynamics and the meaning of entropy | 4 | 10–19 Aug |
| II | Probability, ensembles, and inference | 6 | 24 Aug–14 Sep |
| III | Classical systems and irreversibility | 6 | 21 Sep–7 Oct |
| IV | Information thermodynamics and quantum entropy | 4 | 14–26 Oct |
| V | Ideal quantum gases | 4 | 9–18 Nov |
| VI | Phase transitions and the Ising model | 3 | 23–30 Nov |
| VII | Renormalization and final synthesis | 2 | 2–7 Dec |
| Total | 29 lectures | 10 Aug–7 Dec (+ 3 assessments) |
Reading map
The lecture notes are organized into twelve chapters. Modules and chapters do not correspond one to one — Module IV in particular draws on three different chapters.
| Module | Lectures | Chapters in the notes |
|---|---|---|
| I | 1–4 | 1. Thermodynamics and the macroscopic entropy |
| II | 5–10 | 2. Probability, information, and typicality (probability; maximum entropy; large deviations) · 3. Equilibrium ensembles |
| III | 11–16 | 4. Classical gases and interacting particles · 5. Microscopic dynamics and irreversibility |
| IV | 17–20 | 2. (Shannon entropy, relative entropy, mutual information) · 6. Information is physical · 7. Quantum states, entropy, and equilibrium |
| V | 21–24 | 8. Identical particles and ideal quantum gases |
| VI | 25–27 | 9. Phase transitions, order parameters, and scaling · 10. The Ising model |
| VII | 28–29 | 11. Renormalization and universality · 12. One word, several entropies |
Each chapter opens with a box naming the lectures it covers, and markers in the margin of the text show where one lecture ends and the next begins.
Detailed Calendar
The teaching period runs from 10 August to 12 December, on Mondays and Wednesdays. Three meetings fall on official holidays (7 September, 12 October, 2 November); 28 October (Public Servants’ Day) is kept as a reserve date until the Institute confirms whether classes occur.
| # | Date | Mod. | Type | Topic and scope |
|---|---|---|---|---|
| 1 | 10/08 Mon | I | Lecture | Why statistical mechanics? Macroscopic regularity, equilibrium, microstates and macrostates; the semester-long entropy map |
| 2 | 12/08 Wed | I | Lecture | Laws of thermodynamics. Heat, work, reversible and irreversible processes; Carnot theorem and absolute temperature |
| 3 | 17/08 Mon | I | Lecture | Thermodynamic entropy. Clausius definition, second-law inequalities, entropy production, third law and residual entropy |
| 4 | 19/08 Wed | I | Lecture | Thermodynamic structure. Fundamental relation, extensivity, concavity, Euler and Gibbs–Duhem relations, Legendre transforms and stability |
| 5 | 24/08 Mon | II | Lecture | Probability for many-body systems. Random variables, combinatorics, law of large numbers, central limit theorem, concentration and typicality |
| 6 | 26/08 Wed | II | Lecture | Microcanonical ensemble. Phase-space volume, density of states, Boltzmann entropy, temperature, pressure, ideal gas and the Gibbs paradox |
| 7 | 31/08 Mon | II | Lecture | Canonical ensemble. Derivation from a reservoir, Gibbs distribution, partition function and Gibbs entropy |
| 8 | 02/09 Wed | II | Lecture | Free energy, fluctuations, and response. Energy fluctuations, heat capacity, susceptibilities, convexity and stability |
| — | 07/09 Mon | — | Holiday | No class: Independence Day |
| 9 | 09/09 Wed | II | Lecture | Grand-canonical ensemble. Chemical potential, particle-number fluctuations, grand potential and ensemble equivalence |
| 10 | 14/09 Mon | II | Lecture | Maximum entropy and large deviations. Constrained inference, exponential families, Legendre–Fenchel transforms and the thermodynamic limit |
| — | 16/09 Wed | I–II | Exam | Exam 1 |
| 11 | 21/09 Mon | III | Lecture | Classical ideal gas. Maxwell distribution, equipartition, Sackur–Tetrode entropy and the classical dilute limit |
| 12 | 23/09 Wed | III | Lecture | Molecular degrees of freedom. Harmonic solids, rotations and vibrations of diatomic gases; classical limits and quantum corrections |
| 13 | 28/09 Mon | III | Lecture | Interacting gases. Mayer expansion, second virial coefficient, van der Waals equation and the range of the dilute-gas approximation |
| 14 | 30/09 Wed | III | Lecture | Classical phase-space mechanics. Liouville theorem, invariant measures, ergodicity, mixing, coarse graining and what each does not prove |
| 15 | 05/10 Mon | III | Lecture | Stochastic entropy production. Master equations, detailed balance, stationary currents, local detailed balance and relative-entropy contraction |
| 16 | 07/10 Wed | III | Lecture | Kinetic theory and fluctuation relations. Boltzmann’s $H$-theorem, molecular chaos, Loschmidt’s objection, Jarzynski’s equality and their assumptions |
| — | 12/10 Mon | — | Holiday | No class: Nossa Senhora Aparecida |
| 17 | 14/10 Wed | IV | Lecture | Information and correlations. Shannon entropy, conditional entropy, relative entropy, mutual information and data processing |
| 18 | 19/10 Mon | IV | Lecture | Information is physical. Maxwell’s demon, measurement, feedback, erasure and Landauer’s bound |
| 19 | 21/10 Wed | IV | Lecture | Quantum entropy and equilibrium. Density operators, von Neumann entropy, quantum relative entropy, Gibbs states and the free-energy identity |
| 20 | 26/10 Mon | IV | Lecture | Composite quantum systems. Partial trace, purification, subadditivity, mutual information, entanglement entropy and Rényi entropies |
| — | 28/10 Wed | IV | Reserve | Public Servants’ Day. No new required content; if classes occur, used for worked problems, catch-up, and Exam 2 review |
| — | 02/11 Mon | — | Holiday | No class: All Souls’ Day |
| — | 04/11 Wed | III–IV | Exam | Exam 2 |
| 21 | 09/11 Mon | V | Lecture | Identical particles and occupation numbers. Fock space, Bose and Fermi statistics, grand partition functions and the classical limit |
| 22 | 11/11 Wed | V | Lecture | Ideal Fermi gas. Fermi energy, zero-temperature equation of state, Sommerfeld expansion and low-temperature heat capacity |
| 23 | 16/11 Mon | V | Lecture | Ideal Bose gas. Bose–Einstein condensation, dimensional dependence, critical temperature and condensate fraction |
| 24 | 18/11 Wed | V | Lecture | Photon gas and synthesis of ideal gases. Blackbody thermodynamics; comparison of Maxwell–Boltzmann, Fermi–Dirac and Bose–Einstein regimes |
| 25 | 23/11 Mon | VI | Lecture | Phase transitions. Thermodynamic singularities, order parameters, spontaneous symmetry breaking, Landau free energy and mean-field limits |
| 26 | 25/11 Wed | VI | Lecture | Ising model I. One-dimensional transfer matrix, absence of a finite-temperature transition, correlations and correlation length |
| 27 | 30/11 Mon | VI | Lecture | Ising model II. Mean-field theory, the two-dimensional square lattice (duality and Onsager’s result), Monte Carlo sampling and finite-size scaling |
| 28 | 02/12 Wed | VII | Lecture | Renormalization group I. Coarse graining and rescaling, the exact one-dimensional Ising decimation, coupling flow, fixed points, relevant and irrelevant operators |
| 29 | 07/12 Mon | VII | Lecture | Renormalization group II and entropy synthesis. Critical exponents from RG eigenvalues, power counting and the $\epsilon$-expansion, universality, entropy under coarse graining, entanglement near criticality, final map of entropy concepts |
| — | 09/12 Wed | V–VII | Exam | Exam 3 |
Closeout: classes officially end 12/12; a replacement or final exam may be held on 14/12; corrections and grade review 15–16/12; final grades released by 17/12.
Calendar Summary
| Milestone | Date |
|---|---|
| First lecture | 10/08 (Mon) |
| Holidays (no class) | 07/09, 12/10, 02/11 |
| Exam 1 (Modules I–II) | 16/09 (Wed) |
| Reserve date | 28/10 (Wed) |
| Exam 2 (Modules III–IV) | 04/11 (Wed) |
| Last regular lecture | 07/12 (Mon) |
| Exam 3 (Modules V–VII) | 09/12 (Wed) |
| Replacement / final exam | 14/12 (Mon) |
| Final grades | 17/12 (Thu) |