The Bridge: Shannon, Khinchin, Jaynes, and the Proof That Forgetting Costs Energy

Relatively Human: Fundamental Laws of Biology and Physics by Finglas Media | Physics and Biology

Episode notes

Relatively Human — S1E12: The Bridge

Episode 11 asked if shared mathematics implies physical identity. Episode 12 proves information has physical weight through three discoveries over 64 years.

First, Claude Shannon's 1948 uncertainty formula mirrored thermodynamic entropy. In 1957, Aleksandr Khinchin proved "uniqueness": Shannon's equation is the only possible mathematical formula for uncertainty. However, uniqueness isn't physical identity, just as the Pythagorean theorem applies to both geometry and electrical circuits.

Second, Edwin Jaynes built a bridge in 1957, proving statistical mechanics emerges naturally when applying Shannon's entropy to physical constraints. He proved the fields' identity, demonstrating that the Data Processing Inequality and the second law of thermodynamics are the identica ... 

 ...  Read more
Keywords
physicsinformation theoryentropy