Entropy and Statistical Mechanics Notes

Concept and Definition of Entropy

  • Mischaracterized as disorder; a cup of crushed ice has lower entropy than a glass of room temperature water.
  • Direct measurement of the probability of an energy configuration and the extent of energy spread.
  • Concentrated energy corresponds to low entropy, whereas dispersed energy corresponds to high entropy.

Microstates and Probability Model

  • Energy in a solid is stored in atomic bonds acting as containers for indivisible units of energy called quanta.
  • A microstate is a specific way energy can be distributed across bonds for a given total energy.
  • In a model of two solids with 66 atomic bonds each, having 66 quanta in Solid A and 22 quanta in Solid B yields 9,7029\text{,}702 microstates.
  • Configurations with energy maximally spread out have the greatest number of microstates, highest probability, and highest entropy.

System Dynamics and Statistical Likelihood

  • Energy continuously shifts between neighboring bonds, altering energy configurations over time.
  • In a 66-bond system starting with 66 quanta in Solid A and 22 in Solid B:
    • There is a 21%21\% probability of reaching maximum energy spread.
    • There is a 13%13\% probability of returning to the initial configuration.
    • There is an 8%8\% probability of Solid A gaining energy.
  • When scaled to larger systems (such as 6,0006\text{,}000 bonds and 8,0008\text{,}000 units of energy initialized with 34\frac{3}{4} energy in Solid A and 14\frac{1}{4} in Solid B), the probability of energy spontaneously concentrating becomes negligible.
  • Spontaneous processes (ice melting, cream spreading in coffee, air leaking from a tire) occur strictly because higher entropy configurations are statistically more probable ("time's arrow").