GENEDU 1303 · What Is a Message? Information, Noise, and the Shape of Communication

Led by Claude Shannon Simulacrum

What is information? Shannon defined it as the reduction of uncertainty — independent of meaning. The consequences are everywhere.

1. Module 1

   The Definition of Information

   Led by Claude Shannon Simulacrum

   The question

   Why does "the sun did not rise this morning" contain more information than "the sun rose this morning"? Shannon's answer: information is surprise, measured precisely. What does this definition exclude — and was the exclusion the right move?

   Outcome

   The student can state Shannon's definition and explain why it excludes meaning.

   Sub-units

   1. ○ 1.1 Expected vs Unexpected Open this unit → ✓ ↻
   2. ○ 1.2 Essay: Why Exclude Meaning? Open this unit → ✓ ↻
   Begin the course → Print certificate of completion
2. Module 2

   Channels, Noise, and Redundancy

   Led by Claude Shannon Simulacrum

   The question

   The noisy channel coding theorem: it is always possible to transmit reliably below channel capacity, by using redundancy. English is 50% redundant. Is that redundancy waste or wisdom?

   Outcome

   The student can explain the noisy channel theorem and give examples of protective redundancy.

   Sub-units

   1. ○ 2.1 Redundancy in Practice Open this unit → ✓ ↻
   Open this module → Print certificate of completion
3. Module 3

   Information and Thermodynamic Entropy

   Led by Claude Shannon Simulacrum

   The question

   Shannon's entropy formula is mathematically identical to Boltzmann's thermodynamic entropy. Landauer's principle: erasing a bit increases thermodynamic entropy. Is information physical — or is physics informational?

   Outcome

   The student can explain the connection between information entropy and thermodynamic entropy.

   Sub-units

   1. ○ 3.1 Maxwell's Demon Open this unit → ✓ ↻
   Open this module → Print certificate of completion
4. Module 4

   What Information Theory Cannot Do

   Led by Claude Shannon Simulacrum

   The question

   A false news story has the same information content as a true one, if both are equally surprising. Information theory cannot solve the misinformation problem. What can it not tell us — and what does that reveal about its scope?

   Outcome

   The student can identify the limits of information theory.

   Sub-units

   1. ○ 4.1 Information and Misinformation Open this unit → ✓ ↻
   Open this module → Print certificate of completion
5. Module 5

   Information Is Everywhere

   Led by Claude Shannon Simulacrum

   The question

   DNA is an information storage system. Neural signals are channels. Quantum bits challenge classical information theory. Is information the fundamental substance of the universe — and what is it, really?

   Outcome

   The student can describe three applications of information theory and take a defended position on what information is.

   Sub-units

   1. ○ 5.1 DNA as Information Open this unit → ✓ ↻
   2. ○ 5.2 Final Essay: What Is Information? Open this unit → ✓ ↻
   Open this module → Print certificate of completion