HEC monogram
Memorandum № 1 H = −Σ pᵢ log₂ pᵢ After C. E. Shannon, 1948 · 1949

HIGH ENTROPY CONTENT

A manifesto for saying something new. measure your entropy
000The measure
1948

In 1948, Claude Shannon needed a way to measure information. The answer he found is the most useful idea most people have never met: information is surprise.

A message carries information only to the degree you couldn't have predicted it. If you knew what was coming, the bits are wasted. Shannon called the measure entropy:

H = −Σ pi log₂ pi

A coin that always lands heads tells you nothing. A fair coin tells you one full bit per toss. The unpredictable source is the informative one.

This is arithmetic, not metaphor. A year later Shannon ran the same mathematics through secrecy systems: encryption and information are one subject. A cipher hides meaning by making it look like noise; a great talk does the reverse, delivering what looks impossible to predict and decodes into sense.

And yes, pure noise has maximum entropy and zero value. The objection writes itself. But entropy only pays when the receiver can decode it: the goal is the most surprise your audience can still absorb.

001The problem

Now look at what we call content.

  • Panels where five smart people agree for an hour.≈ 0.00 BITS
  • Keynotes restating what the audience walked in believing.≈ 0.00 BITS
  • Videos summarizing videos summarizing a paper nobody read.≈ 0.00 BITS
  • Guests chosen because they won't cause trouble.≈ 0.00 BITS

That's low-entropy content. You could have predicted every sentence, so by Shannon's own math it carries almost nothing, whatever the production value.

010The claims

Six claims about information

001 / I / NOVELTY

Entropy is novelty.

The value of content is measured by what the audience could not have predicted. Everything else is carrier wave.

010 / II / REDUNDANCY

Agreement is compression.

When everyone on stage agrees, one speaker would have carried the same information. The rest of the panel is redundancy.

011 / III / SIGNAL

Surprise is the signal.

If a talk can be predicted from its title, the talk already happened. You attended the abstract.

100 / IV / FRICTION

Disagreement is a feature.

A panel earns its seats by containing at least one person who thinks the others are wrong, and says so.

101 / V / COST

Safety is expensive.

Every removed risk removes bits. Content optimized to offend no one converges on zero information.

110 / VI / THE TEST

Prediction is the test.

Before you publish, ask what this contains that the audience couldn't have guessed. That part is the content. The rest is packaging.

011The instrument

Measure a sentence.

H per character0.00 bits

Order-0 character entropy is a toy instrument, not a peer review. The real test is whether your audience could have predicted it.

100Field test

Could the audience have predicted it? Then it wasn't content. It was confirmation.

Run the test on the next thing you make: the talk, the panel, the video, the post. Cut everything the audience already had. Ship the residue. The residue is the information.

HEC — High Entropy Content monogram

Say something new,
or say nothing.