Articles · Information theory
What Is Channel Capacity?
The hard ceiling on reliable communication through a noisy channel — and why more clever coding cannot erase noise for free.
Every communication channel introduces uncertainty: a radio signal picks up noise, a storage device flips bits, and a fiber link loses or distorts light. Channel capacity is the sharp boundary between rates that can be made reliable and rates that cannot, under a stated channel model.
More redundancy, not magic
Sending the same message repeatedly is one simple error-correction strategy, but it wastes bandwidth. Shannon’s insight was that carefully designed codes can spread information across a long block so that the receiver can correct typical noise while the overhead approaches a precise limit.
The threshold
Below capacity, the probability of decoding error can be driven arbitrarily close to zero as block length grows. Above capacity, no coding scheme can make reliable communication possible under the same assumptions. Capacity is therefore both an achievability statement and a converse: a lower-side construction and an upper-side impossibility bound meet.
Assumptions are the point
There is no single capacity for “the internet” or “a radio.” The value depends on the channel law, bandwidth, power, alphabet, memory, and error criterion. Change those assumptions and the frontier changes too. A meaningful record must say which channel it describes.
Primary source
Shannon, “A Mathematical Theory of Communication,” Bell System Technical Journal ↗