Lecture 20 — Distinguishability and recovery channels
A channel may change a state without losing the information that distinguishes it from a reference. Relative entropy measures that information, and its monotonicity under channels, the data-processing inequality, is where every recovery argument starts. We prove it in finite dimensions with the relative modular operators of Lecture 9, following Petz, and then prove Petz’s theorem on the case of equality: distinguishability is preserved exactly when one explicit channel, built from the reference state and the adjoint of the channel, undoes the channel on both states. The theorem is tested on dephasing, on a flagged erasure, and on the three-qutrit code of Lecture 2, where the Petz map rebuilds the logical state from any pair of shares. An approximate version, due to Junge, Renner, Sutter, Wilde and Winter, bounds the fidelity of recovery by the loss of relative entropy, and in that form Cotler, Hayden, Penington, Salton, Swingle and Walter used it to extend entanglement-wedge reconstruction to approximate recovery.
How to use this lecture
Classroom core, one meeting of three hours. The history (§1, 10 minutes), the classical model (§2, 20 minutes), the Petz map (§3, 20 minutes), and the proof of data processing (§4, 40 minutes) come before a 10-minute break. After it come the equality theorem (§5, 35 minutes) and the worked examples (§6, 30 minutes), with 15 minutes for Checkpoints 1 and 2; Problems 1–6 are the core assignment. These allocations are proposals and have not been tested in class.
Self-study. Approximate recovery and the fidelity convention (§7), the return to regional reconstruction (§8), and Problems 7–12, including the integral representation of the logarithm and Petz’s condition on Connes cocycles.
Research extension. The Petz map of the deformed code of Lecture 7, rotated Petz maps for a non-unital channel, and the modular form of the recovery map, in Problems 13–15.
Prerequisites. Lecture 2 for the three-qutrit code, Lecture 3 for modular operators in finite dimensions, Lecture 7 for the deformed code, Lecture 9 for Araki’s relative entropy and the Hilbert–Schmidt representation . Density matrices, Kraus operators, and completely positive maps.
What this lecture establishes. In finite dimensions, with faithful states, the data-processing inequality and Petz’s equality theorem are proved completely; the direction from recovery to equality is elementary. The flagged erasure and the three-qutrit Petz map are exact calculations. The universal recovery theorem is stated with its source, and checked on the erasure channel, where it is saturated at the two ends. The extension of these results to von Neumann algebras is stated.
0. Reading
Primary.
- D. Petz, Monotonicity of quantum relative entropy revisited (2003).
- M. Junge, R. Renner, D. Sutter, M. M. Wilde, A. Winter, Universal recovery maps and approximate sufficiency of quantum relative entropy (2015).
- J. Cotler, P. Hayden, G. Penington, G. Salton, B. Swingle, M. Walter, Entanglement Wedge Reconstruction via Universal Recovery Channels (2017).
Secondary.
- D. Petz, Sufficient subalgebras and the relative entropy of states of a von Neumann algebra, Commun. Math. Phys. 105 (1986) 123, and Sufficiency of channels over von Neumann algebras, Quart. J. Math. 39 (1988) 97.
- P. Hayden, R. Jozsa, D. Petz, A. Winter, Structure of states which satisfy strong subadditivity of quantum entropy with equality (2003).
- H. Barnum, E. Knill, Reversing quantum dynamics with near-optimal quantum and classical fidelity (2000).
- M. M. Wilde, From Classical to Quantum Shannon Theory, the chapters on relative entropy and recoverability.
Optional research reading.
- O. Fawzi, R. Renner, Quantum conditional mutual information and approximate Markov chains (2014).
- E. Witten, Notes on Some Entanglement Properties of Quantum Field Theory (2018), §§3.4–3.6, the proof of monotonicity for von Neumann algebras.
- A. Müller-Hermes, D. Reeb, Monotonicity of the Quantum Relative Entropy Under Positive Maps (2015).
- D. Harlow, The Ryu-Takayanagi Formula from Quantum Error Correction (2016).
1. What does it mean to lose no information?
The monotonicity of relative entropy has a history that runs through the strong subadditivity of entropy. Lieb and Ruskai proved strong subadditivity in 1973, and Lindblad derived from it in 1975 that relative entropy cannot increase under a completely positive, trace-preserving map. Uhlmann gave an independent proof in 1977 by interpolation. Petz then asked, in 1986 for subalgebras and in 1988 for channels, when the inequality is an equality, and borrowed the answer from statistics. A family of distributions is said to have a sufficient statistic if a function of the data retains everything needed to distinguish them. Petz showed that a quantum channel preserves the relative entropy of a pair of states exactly when the channel is sufficient for the pair, that is, when some channel reverses it on both states, and he wrote the reversing channel down explicitly. It is now called the Petz map.
The subject returned to prominence through quantum information. Barnum and Knill showed in 2000 that the same map, introduced as a reversal adapted to the input and to the noise, has an error at most twice that of the optimal reversal, measured with a reference system or on a classical ensemble. Hayden, Jozsa, Petz and Winter used the equality theorem in 2003 to classify the states that saturate strong subadditivity, the quantum Markov chains. Whether an approximate equality implies an approximate recovery remained open for a decade. Fawzi and Renner proved a version for conditional mutual information in 2014, and Junge, Renner, Sutter, Wilde and Winter proved in 2015 that a universal recovery channel, depending only on the reference state and the channel, achieves a fidelity controlled by the loss of relative entropy.
In holography these results turn the relative-entropy identity of Lecture 21 into reconstruction. Dong, Harlow and Wall turned the exact identity into reconstruction in 2016 with operator-algebra error correction, and Cotler and collaborators used the approximate identity and the recovery channels of §7 in 2017. The question for this lecture is the one Lecture 7 raised in a finite code: when can the effect of a channel on a family of states be undone, and by what map?
2. The classical model: restore a forgotten label
Let a channel forget and retain from a joint distribution , and fix a reference . Bayes’ rule supplies a recovery channel,
which reinserts with its reference conditional distribution. It recovers the reference exactly, and applied to it gives . The loss of relative entropy is measured by the chain rule,
which follows by splitting into and summing. The loss vanishes exactly when for the relevant , and then the forgotten label is restored by the reference conditional distribution. No physical copy of was preserved: the family of allowed distributions makes it redundant. The quantum version of is the Petz map.
3. The Petz map
For a channel , with Hilbert–Schmidt adjoint , and a faithful reference , the Petz map is
It is completely positive, since conjugations and are completely positive and composition preserves the property. For supported on the support of it preserves the trace,
and it recovers the reference, , because is unital. If the output space contains a sector outside the support of , the map is extended there by a fixed replacement state to obtain a channel on the whole output space. For a classical channel and commuting states it reduces to . These properties make the Petz map a candidate decoder. But they do not by themselves imply that it recovers any state other than ; that is the content of the theorem of §5.
4. Data processing, proved with relative modular operators
We work in finite dimensions with faithful states and on the input and assume that and are faithful on the output, restricting to supports otherwise. In the Hilbert–Schmidt representation of Lecture 9, the relative entropy is
Write and on the input, and and on the output. The proof has four steps.
A contraction between the two representations. Define from output to input matrices by
Since is unital, . The Kadison–Schwarz inequality for the unital completely positive map , , gives
so is a contraction. Because and , also .
An operator inequality. The same inequality applied to gives . Indeed,
A variational bound. For a positive invertible operator and a vector ,
with the supremum attained only at , since the bracket equals . For we have , because and , and . Therefore
and taking the supremum over ,
Integration. The representation and give
This is the data-processing inequality, . [Model proof, in finite dimensions; for von Neumann algebras it is the theorem of Uhlmann, stated in Lecture 9, §6.3.]
Checkpoint 1. Where did complete positivity enter, and where did trace preservation?
Answer. Complete positivity of makes completely positive, which gives the Kadison–Schwarz inequality; positivity alone does not. Trace preservation of makes unital, which gives and the normalization of both vectors. Two-positivity of already suffices for this proof, and Müller-Hermes and Reeb showed by another argument that data processing holds even for positive trace-preserving maps.
5. The equality theorem
Theorem (Petz, 1986–88). Model proof, in finite dimensions. With , , and faithful,
Proof. If the Petz map recovers , apply data processing to and then to , which maps and back to and . The two inequalities force equality.
Conversely, suppose the relative entropies are equal. The integrands of §4 are continuous in and ordered, and their integrals agree, so they agree for every . In the chain of inequalities of the variational bound, the left supremum is attained at , and equality requires to attain the right supremum, whose unique maximizer is . Therefore
In finite dimensions the functions for distinct values of span all functions on the finite spectra of and , so the identity extends to for every function . Take . Since and , the identity reads
that is, . Then
where the second expression uses . By Kadison–Schwarz the difference is positive, and its expectation value in vanishes:
A positive operator with zero expectation value in a faithful state vanishes, so the difference is zero and .
Note that the intermediate identity carries its own meaning. With it reads
which is Petz’s original condition (Problem 10). The operators are the Connes cocycles of the pair of states, the finite form of the relative modular flow. Equality of relative entropies thus says that the adjoint channel carries the relative modular flow of the output to that of the input. Lecture 21 meets the same statement in holography, where boundary modular flow is carried to bulk modular flow.
To recover a whole code, the condition must hold for the relevant family of states, and for their extensions by a reference system when quantum information is to be preserved as well as a classical ensemble. Equality for one pair establishes recovery of that pair alone.
6. Worked examples
A flagged erasure. Let
where the flag is orthogonal to the retained -dimensional space, and fix . On a block-diagonal output the Petz map is : it keeps the successful output and replaces an erasure by the reference state. Therefore , while
because the two outputs have identical flag probabilities. The lost relative entropy is , and except for the Petz map cannot rebuild an unknown erased state. For a pure input the recovered overlap is . For a maximally entangled input with a -dimensional reference, applying the recovered channel to one side gives the overlap . The second test is stricter and detects lost quantum correlations.
The three-qutrit code. Take the code of Lecture 2, with arithmetic modulo three, and the channel that keeps shares 1 and 2, . For the reference the pair is maximally mixed, , and the Petz map is
For the pair state is , with entropy , and : the pair preserves the relative entropy, and returns . The same holds for every code state and for every pair, and the course scripts check it for all three pairs on random states. A single share, by contrast, is maximally mixed for every code state, so and nothing can be recovered. [Exact calculation.] The Petz map is thus an explicit decoder for the authorized sets of the code, obtained from the channel and the reference alone.
Checkpoint 2. Why is the Petz map of the three-qutrit code proportional to the adjoint of the encoding?
Answer. With a maximally mixed reference and a maximally mixed output of the reference, the conjugations by and are multiples of the identity, and only remains, with the factor fixed by trace preservation.
7. Self-study: approximate equality, approximate recovery
Junge, Renner, Sutter, Wilde and Winter proved that for every ,
where is the root fidelity and is a universal recovery channel: an average, with an explicit probability density, of the rotated Petz maps . [Stated only — refs: Junge–Renner–Sutter–Wilde–Winter 2015.] If the loss is at most , the recovered state has root fidelity at least . The unrotated Petz map should not be credited with this bound in general without checking the theorem. The rotations are trivial when and are both multiples of the identity on their supports, as for the three-qutrit code, and more generally when the phases act only between blocks that does not see. A maximally mixed alone is not enough: for amplitude damping with the rotated maps differ (Problem 14).
The erasure channel with is such a case, since is a multiple of the identity on each block and reads only the diagonal blocks, so every rotated Petz map equals . For a pure input, and the loss is , so the bound reads , while the Petz map achieves . The function vanishes at and at and is concave, so the bound holds for every and is saturated at the two ends. The figure shows both curves.
The fidelity convention matters. With the squared fidelity the right side of the bound is , and mixing the two conventions introduces a factor of two. A small error for a particular state is also not a bound on a channel in the diamond norm: uniformity over states, reference dimensions and the code family must be supplied when a statement about a whole algebra is needed.
8. Return to regional reconstruction
For an encoding isometry and a boundary region , the channel of interest is . If it preserves the relative entropy of the logical algebra for all code states, it factors through a channel on the states of that algebra, and the algebraic version of the theorem of §5, which Cotler and collaborators develop, supplies an explicit decoder: an algebraic route to reconstruction that needs no kernel. Lecture 21 derives the needed equality, boundary relative entropy equal to bulk relative entropy, first exactly in a sector code and then semiclassically in holography, and it notes that the identity of §5 on Connes cocycles becomes the statement that boundary modular flow implements bulk modular flow. Dong, Harlow and Wall used the exact equality with operator-algebra error correction to prove entanglement-wedge reconstruction. Cotler and collaborators replaced it by the approximate equality of bulk effective field theory and used the universal recovery channel, which also gives an expression of a bulk operator as the response of the boundary modular Hamiltonian to a perturbation of the bulk state, a noncommutative form of Bayes’ rule. [Stated only — refs: Dong–Harlow–Wall 2016; Cotler et al. 2017.]
This is why a relative-entropy equality is more informative than the equality of one entropy. It compares responses to changing states, and so it constrains a channel.
9. What to take away
- Model proof: in finite dimensions, data processing follows from a contraction between the Hilbert–Schmidt representations, the inequality , a variational bound on resolvents, and the integral representation of the logarithm.
- Model proof: Petz’s theorem, if and only if ; equality also forces , the preservation of relative modular flow.
- Exact calculation: a flagged erasure loses ; the three-qutrit code preserves relative entropy on every pair, where the Petz map is an exact decoder, and loses all of it on a single share.
- Stated only, checked in an example: the universal recovery channel achieves root fidelity at least after a loss ; for the erasure the bound is saturated at and .
10. Looking ahead
Lecture 21 turns to the channel from a code to a boundary region. It derives, in a sector code, that boundary relative entropy equals the relative entropy of the recoverable algebra, with the area-like central term cancelling, and it presents the semiclassical argument of Jafferis, Lewkowycz, Maldacena and Suh. Together with this lecture it explains the reconstruction theorem of Dong, Harlow and Wall for the entanglement wedges of Lecture 19, whose proof uses operator-algebra error correction. Lecture 26 uses the same logic for the radiation of an evaporating black hole, where the island belongs to the entanglement wedge of the radiation.
11. Problem set
Classroom core
-
The classical equality case. Let . Compute the loss of relative entropy and the action of .
-
Petz for dephasing. Let remove the off-diagonal entries in a basis and let be diagonal and faithful. Compute the Petz map and say which states it recovers.
-
Erasure with a reference. Verify the overlap for a maximally entangled input.
-
The contraction. Prove from the Kadison–Schwarz inequality, and show that and .
-
The variational formula. Prove for positive invertible , and identify the unique maximizer.
-
The three-qutrit Petz map. Show that for , and verify that it returns from .
Self-study consolidation
-
A fidelity convention. If the squared fidelity is used, how does the universal bound read?
-
A useless equality. Why does equality for alone establish nothing?
-
The logarithm as an integral. Verify for .
-
Petz’s condition. Show that equality of relative entropies implies for all real .
-
The erasure bound. Prove for .
-
A product state. For , and , show that equality holds and that the Petz map returns .
Research extension
-
The deformed code. Compute the Petz map numerically for the deformed code of Lecture 7 and the pair of shares 1 and 2, since shares 2 and 3 still recover exactly (Lecture 7, §3), and compare it with the explicit decoder, on entangled inputs. Known: the deformation destroys exact recovery, so the relative entropy decreases, and the universal bound controls the loss of fidelity. Completion: the loss of relative entropy and the entanglement fidelity of both decoders as functions of the deformation, with supported inverses and numerical thresholds reported.
-
Rotated Petz maps. For a qubit amplitude-damping channel and a non-maximally mixed reference, compare the Petz map with the universal recovery channel. Known: the two differ when and are not multiples of the identity; the universal channel always satisfies the bound of §7. Completion: the fidelities of both maps and the bound, as functions of the damping, for one pure input.
-
The modular form of recovery. Write the Petz map in terms of the modular flows of and , and interpret the formula of Cotler and collaborators for a bulk operator as the response of a boundary modular Hamiltonian. Known: the rotated Petz maps are conjugations of by modular flows, and their average admits an integral representation over modular time. Completion: the modular form checked on the three-qutrit code, for a logical operator.
12. Answer checkpoints
-
Every conditional relative entropy vanishes, so the loss is zero, and .
-
The Petz map is the same dephasing on the diagonal image: with and diagonal, . It recovers every diagonal state and no coherence.
-
The recovered channel replaces the erased half by , so the state becomes , and .
-
The norm computation of §4 uses and . With , . For a contraction, gives with , so .
-
Completing the square, , and the last term is positive unless .
-
and , so , and . For , only the terms with survive the projection onto equal first and second shares, so and .
-
on the right side, since .
-
Both relative entropies vanish identically for every channel, so the equality carries no information about other states.
-
as .
-
Take in . Since acts as , , whose image under is , while . Multiplying by on the right gives the condition.
-
vanishes at and , and it is concave because of an affine function is concave. A concave function that vanishes at the endpoints is nonnegative between them.
-
, so the partial trace preserves the relative entropy. The adjoint is , and , which returns from .
Wiki connections. Araki–Uhlmann relative entropy