Entropy: Thermodynamics, Statistics, and Information

Entropy as a thermodynamic state variable

Entropy is a thermodynamic state variable that quantifies the probabilistic distribution of a system’s accessible microscopic configurations (microstates). In classical thermodynamics it is introduced through macroscopic measurements and the second law (e.g., via dS = δQ_rev/T), while in statistical mechanics it is linked to microscopic probabilities, such as Boltzmann’s S = k_B ln Ω for an isolated system and the more general Gibbs/quantum form S = −k_B⟨ln p⟩ (or S = −k_B tr(ρ̂ ln ρ̂)). Because entropy depends only on the system’s equilibrium state, it is a state function rather than a path-dependent quantity. Entropy plays a central role in the second law of thermodynamics: for an isolated system, total entropy cannot decrease and spontaneous evolution drives the system toward thermodynamic equilibrium, where entropy is highest. “Higher” entropy corresponds to energy being more dispersed/disordered among accessible microstates, while “lower” entropy corresponds to more concentrated energy. This monotonic behavior implies irreversibility for many real processes and establishes an “arrow of time” aligned with increasing entropy. Although entropy cannot be directly observed, it can be calculated from measurable properties such as temperature dependence of heat capacity and from thermodynamic relations, and it also governs the direction of spontaneous chemical reactions and other processes like mixing.

0/2 modes complete

Second law of thermodynamics and equilibrium

0/2 modes complete