Introduction

Forward error correction has almost nothing left to give. A decade of soft-decision FEC work took coherent links from hard-decision Reed-Solomon to modern low-density parity-check and staircase codes with net coding gains in the 11-13 dB range, and that harvest is largely spent: the practical codes now sit within a fraction of a decibel of the coding bound, so each new generation returns tenths of a decibel rather than whole decibels. The gap that remains between a real coherent transceiver and the Shannon capacity of its channel is no longer mostly a coding gap. It is a signalling gap, and the tool that closes it is constellation shaping.

Uniform quadrature amplitude modulation (QAM) spends the same energy budget on a rarely useful outer symbol as it does on a frequently useful inner one. Information theory has known since the 1980s that a Gaussian-like input, not a uniform one, maximises the mutual information of an additive white Gaussian noise (AWGN) channel, and that the penalty for using uniform QAM instead approaches 1.53 dB at high spectral efficiency. That figure is a theoretical limit, and probabilistic constellation shaping (PCS) is the engineering that reaches for it by transmitting inner constellation points more often than outer ones while leaving the constellation grid untouched.

PCS is not a laboratory curiosity. It has been carried in commercial coherent digital signal processors (DSPs) since Nokia shipped it in the PSE-3 in 2018 (vendor timeline), and at OFC 2026 the industry marked roughly ten years of the technique with a dedicated session on where it goes next (industry event). Every serious terrestrial and submarine coherent engine now shipping applies some form of shaping, and the OpenROADM Multi-Source Agreement has defined an interoperable PCS mode so that shaped 800G links can run between equipment from different suppliers. If you build, plan, or operate coherent networks, PCS is now part of the working vocabulary alongside OSNR, generalised OSNR (GOSNR), and baud rate.

This article works through PCS end to end: the information-theoretic reason it works, the probabilistic amplitude shaping (PAS) architecture that made it practical, the distribution matching that sits at its core, the mathematics of near-continuous rate adaptation, the way its clean AWGN gain erodes on the nonlinear fibre channel, the engines and standards that ship it in 2026, the gains measured on real link classes, and the operational consequences of being able to dial a wavelength's data rate almost continuously. Where a number appears, its evidence class appears with it, because the difference between a theoretical limit, a measured value, and a vendor claim is exactly the difference between engineering and marketing.

1. The Shannon gap and where shaping gain comes from

Shannon's capacity for a band-limited AWGN channel sets the ceiling every coherent design works against. The capacity-achieving input is a continuous Gaussian, and no discrete constellation with uniform probabilities can reach it. The shortfall has a precise asymptotic value that any optical engineer should carry in their head.

For a fixed constellation cardinality and high spectral efficiency, the distance between the best information rate achievable with uniform M-QAM and the Gaussian capacity tends to a constant. That constant is the ultimate shaping gain.