Lecture 4 — An entropy formula in a quantum code

The two-share decoder in Lecture 2 exposed a logical state together with an auxiliary state fixed by the encoding. Its entropy was therefore the logical entropy plus a constant. We now generalize that calculation in two steps. First, both sides will contain recoverable logical information. Second, the accessible algebra will have a center, allowing the additional entropy term to depend on a shared classical sector.

The result has the structure of an area term plus bulk entropy. We can derive that structure entirely within quantum mechanics. The calculation then makes a gravitational question precise: what additional input identifies the central term with the area of an extremal surface?

How to use this lecture

Classroom core, 120 minutes. Review the qutrit entropy and construct the complementary code in Sections 1–3 (30 minutes); derive entropy additivity and work the four-qubit example in Sections 4–5 (30); introduce the center through the explicit three-level model in Section 8 (35); finish with the holographic comparison and discussion (25). Section 8 can be taught directly before the general formulas of Section 7.

Self-study. Derive the relative-entropy and modular identities in Section 6, then read the general direct-sum construction in Section 7. Verify that its formulas reproduce the three-level example. Work through the trace-convention discussion before interpreting any entropy attached to an algebra.

Research extension. Study the general equivalence between complementary recovery and the algebraic entropy formula in Harlow’s paper. This lecture constructs and solves a family of codes; it does not prove that every code with the relevant property can be put in this form.

Prerequisites. Lecture 1 for restriction and centers, Lecture 2 for encoding and reconstruction, and Lecture 3 for logarithms of density matrices.

Reading. Harlow, arXiv:1607.03901, Sections 4–5 and Appendix A, is the primary source for the operator-algebra code structure. Jafferis, Lewkowycz, Maldacena, and Suh, arXiv:1512.06431, is the later gravitational comparison.

What this lecture proves. The entropy, reconstruction, relative-entropy, and compressed modular identities are derived for the explicit finite codes below. Their geometric interpretation is additional input. No gravitational field equation or extremal-surface prescription is derived here.

1. What the three-qutrit code has already taught us

The decoder of Lecture 2 gave

If the logical eigenvalues are , the pair eigenvalues are repeated three times. Hence

The extra term comes from the fixed entanglement between the second decoded register and the erased share. It is present even when the logical input is pure.

That example has only one logical system: the pair recovers all of it, while the remaining share recovers none of it. A spatial division of a bulk would generally leave observables on both sides. We therefore introduce two logical systems and arrange for each physical side to recover one of them.

The guiding calculation remains elementary. Tensor products multiply eigenvalues, direct sums collect distinct blocks, and the logarithm turns those operations into the terms of an entropy formula.

2. An explicit code with complementary recovery

Let the logical Hilbert space be

The physical systems contain additional registers:

The primes label auxiliary registers, not commutants. Choose a fixed normalized entangled vector

For simplicity, the auxiliary spaces have dimension . The two reduced auxiliary states have the same spectrum:

We may also apply arbitrary fixed unitaries and within the respective physical regions. Define the encoding by

with the tensor factors reordered as when interpreting the physical split .

The normalization of and unitarity of imply . Both the auxiliary state and the unitaries are part of the encoding and must be held fixed as the logical state varies.

2.1 Recovering the two logical algebras

On the logical space define

The commutant is taken in . Lecture 1 proved the corresponding finite tensor-factor formula.

For any logical , choose

Then

The analogous formula with reconstructs every operator in on . We call this complementary recovery: one logical algebra is recoverable on , and its commutant is recoverable on the complementary physical system .

This does not recover the same full quantum system on two disjoint regions. The two logical algebras commute. Their intersection here contains only multiples of the identity.

3. What a physical observer’s state looks like

Let be any logical density matrix, including an entangled or mixed state. Its physical encoding is

After tracing out , the unitary disappears from the partial trace. Tracing gives , and tracing gives . Therefore

Similarly,

No assumption of a product logical state was made. Correlations between and remain in the complete encoding, while each reduction contains the appropriate logical restriction.

Physical picture. Decoding region separates the information that may vary with the logical preparation from correlations built into the encoding. The fixed auxiliary state contributes entropy to even when its logical state has no entropy. A local unitary can make the two registers difficult to recognize physically without changing this entropy bookkeeping.

Checkpoint 1. May be chosen separately for each input state while retaining this one encoding?

Answer. No. The displayed is a fixed linear map. Choosing a different auxiliary state depending on an unknown input would define a different operation and would invalidate the recovery and entropy statements as properties of this code.

4. Deriving the entropy identity

We use natural logarithms and . Let be the eigenvalues of and those of . The product state has eigenvalues , so

The physical unitary leaves the spectrum unchanged. This proves entropy additivity in the form needed here, including zero logical eigenvalues by continuity with .

Define a logical operator

It lies in the center of . For the factor algebra in this example, being central forces it to be scalar. We obtain

The same fixed term appears for because the two reductions of the pure auxiliary state have equal entropy.

Exact calculation. This formula holds for every logical state in the specified code. The term is dimensionless entropy. Calling it an “area term” at this stage is a structural comparison.

For maximally entangled auxiliary registers of dimension , and . For unequal weights the term is smaller. Its value is determined by the encoding, not simply by the number of auxiliary levels.

5. A four-qubit model with local mixing

Take one logical qubit on each side and one auxiliary qubit on each side. Choose

Let be the controlled-NOT gate with logical register as control and auxiliary register as target:

Use the analogous gate on . Here is addition modulo two.

The logical basis vector is encoded as

This gives four orthonormal code vectors in a 16-dimensional physical space. Undoing the controlled-NOT gates makes the logical and auxiliary factors explicit.

5.1 A numerical spectrum that can be checked by hand

Choose the logical state

The spectrum of is

Thus

where . Region has entropy because its logical state is pure.

If the two logical qubits were instead in a Bell state, both and would be maximally mixed. Each physical region would have entropy , although the full encoded state would remain pure. One contribution comes from logical entanglement and the other from the fixed auxiliary pair.

5.2 The reconstruction really uses the physical region

Conjugating by the controlled-NOT gives

For example, flipping the control flips the target in the conjugated action, which verifies the first identity on . The logical is spread across two physical qubits inside . Nevertheless, it is fully reconstructable using .

This elementary mixing illustrates why recoverability should be formulated in terms of an algebra and an encoding. A particular tensor factor in the physical register is not necessarily the logical system.

Checkpoint 2. Does the extra reveal a new logical qubit available to Alice?

Answer. No. It comes from the auxiliary state fixed across the entire code. Alice’s region has an additional mixed register after decoding, but that register does not store an independently variable logical input.

6. Self-study: distinguishability and modular Hamiltonians

The entropy identity is not the only exact relation in this code. Two logical states undergo the same unitary mixing and acquire the same auxiliary factor. Their relative distinguishability on therefore depends only on their restrictions to .

6.1 Relative entropy is unchanged by the fixed auxiliary state

For density matrices and with compatible supports, define

It is assigned when the support of is not contained in that of . Assume first that the reference and auxiliary are full rank.

The logarithm of a product is

This follows by applying both sides to product eigenvectors. The same formula holds for on its support. Unitary conjugation carries a matrix logarithm into the logarithm of the conjugated matrix.

Substitution gives

The two auxiliary logarithms cancel. Compatible lower-rank cases follow by restricting to the common auxiliary support; incompatible logical supports give on both sides.

This equality can also be understood operationally. Region contains an exactly recoverable copy of the state on the algebra of , together with a fixed factor carrying no additional information about which logical preparation was chosen.

The general data-processing inequality says that a quantum channel cannot increase relative entropy. We have not proved that theorem here. We have directly proved equality for this particular channel and supplied its recovery map.

6.2 A compressed modular-Hamiltonian identity

Let and . From the product logarithm,

Pull the operator back to the logical Hilbert space:

The expectation in the second term is .

Notice the operation used: this is a compression with and . If is not maximally entangled, need not leave the auxiliary vector proportional to itself. The compressed modular identity alone is not an uncompressed intertwining identity. The reconstruction operators in Section 2 satisfied a stronger relation.

The identity also concerns a one-sided modular Hamiltonian. In the corresponding difference between and , the equal auxiliary entropy terms cancel. This is consistent with the distinction between one-sided and full modular generators in Lecture 3.

6.3 The finite first law

Take a full-rank reference state and a smooth variation

For a differentiable spectral function, the derivative of its trace is

One way to see this is to diagonalize : to first order, the trace sums the diagonal variations weighted by at the eigenvalues; off-diagonal changes of eigenvectors do not change the trace. Within a degenerate eigenspace, the same formula uses the trace of the perturbation in that eigenspace.

For , this yields

Thus

The generator is that of the fixed reference state. This is a finite-dimensional first-order identity. It does not by itself imply a gravitational equation or prescribe where to extremize a surface.

7. Generalizing from a factor to an algebra with a center

In our first code, the central term is a scalar. To let it vary across states while keeping it central, introduce sectors labeled by :

A direct sum says that the state can occupy different mutually orthogonal sectors. Inside each sector there are two quantum systems. We specify the accessible logical algebra

It contains no operator connecting two different sectors.

Its commutant on the code is

and the center is spanned by the sector projectors :

To verify this, first commute with all to eliminate off-diagonal sector blocks, then use the tensor-factor commutant calculation inside each block. The sector label is available in both algebras, while noncommuting quantum observables belong to their respective sides.

7.1 The state seen by the algebra

For a logical state , define

when . Zero-probability sectors contribute zero to the formulas below.

An observable has expectation

Off-diagonal coherences with do not enter. The restricted state is represented abstractly by the blocks .

Using the trace that counts each irreducible matrix block once, define its entropy as

where .

The formula follows from the eigenvalues of the block density matrices. Expanding gives the displayed classical and quantum terms.

This is not generally the entropy of the full logical matrix . The algebra may omit observables that detect coherences between sectors or information in the factors.

7.2 Why the trace convention must be stated

As an operator on the full code Hilbert space, has an ordinary trace containing a factor . That multiplicity counts an inaccessible register.

If one represents the restricted state by the particular ambient extension

its ordinary matrix entropy is

It represents the same expectations on , but its entropy includes the chosen maximally mixed multiplicity registers. We use the first convention and declare it explicitly.

7.3 Encode each sector with its own fixed auxiliary state

Choose a fixed pure auxiliary state in each sector. Let the physical and spaces each contain orthogonal copies of the sector label and the appropriate quantum and auxiliary registers. Encode sector using the construction of Section 2, with local unitaries .

Concretely, choose

A logical vector is mapped to the sum of the sector encodings

with the tensor reordering used in Section 2. Each term lies in the physical block with matching sector labels on and . Normalization within sectors and orthogonality between them give .

Because both physical sides record the sector in orthogonal subspaces, tracing out kills cross-sector coherences. Up to a block unitary on ,

The symbol here means unitary equivalence on the support; unused physical subspaces carry zero eigenvalues.

If and are the eigenvalues of the two factors, the physical eigenvalues are . Expanding their logarithms gives

Define

This is central and may have different eigenvalues in different sectors. The result becomes

Exact calculation. The result holds for all states in the constructed code, including states with coherence between sectors. The restricted algebra and the physical reduction both discard that coherence in the specified way.

Complementary recovery is checked block by block. Both physical sides can measure ; within that sector reconstructs and reconstructs . Shared central information is classical within these algebras, so it does not contradict the noncommutative no-cloning argument.

8. A three-level example with a nonconstant central term

The direct-sum notation becomes concrete in a particularly small model. Take a logical qubit with basis , and two physical qutrits. Define

The two images are orthonormal. The logical algebra we choose to recover separately on and is the diagonal algebra

It is its own commutant on this two-dimensional logical space. The full logical matrix algebra also exists, but it is not recoverable from either physical side alone.

For the pure input

with and real , the physical state is

The reduced state on either side is

The phase is absent because all cross terms have orthogonal labels on the traced-out side.

8.1 Three entropies with different meanings

The full logical input is pure:

Its restriction to the diagonal logical algebra has probabilities :

The physical reduced state has entropy

Thus the central operator is

Sector 0 has a product auxiliary state and contributes zero; sector 1 contains one fixed maximally entangled pair and contributes .

At , the physical eigenvalues are , so

All three quantities can be checked from their defining matrices.

8.2 Which observables can each side reconstruct?

The logical observable is represented on by

It is also represented by the same diagonal matrix on . Direct action on the two encoded basis vectors verifies the intertwining identities.

The logical cannot be reconstructed on alone. The encoded and inputs have identical reductions, although they have logical expectations and . If an representative of existed, those equal reductions would give different expectations of the same local operator, a contradiction.

Physical picture. Each side can read the sector, and neither side can read the relative phase between sectors. The entropy formula counts the uncertain sector label and the fixed entanglement associated with that sector. It does not count a phase that the specified algebra cannot observe.

Checkpoint 3. Would replacing by give the right formula for this pure logical input?

Answer. No. It would omit . The code’s accessible algebra is diagonal, while the full logical state contains coherence between its sectors.

8.3 Relative entropy for the same example

For two inputs with sector probabilities and , , the physical relative entropy is

This equals the relative entropy of the restricted diagonal states. The factors of two cancel because the auxiliary state in each sector is fixed by the same encoding.

The full logical states may be distinct pure superpositions, for which full-matrix relative entropy is infinite. That does not contradict the displayed finite answer: different algebras are being compared.

9. The relation to holography, and the extra claims

The exact code relation is

Its holographic comparison is a semiclassical generalized-entropy relation involving an area contribution and bulk-field entropy. The algebraic structure suggests identifying the logical observables with an effective bulk algebra and with an appropriately defined area operator divided by .

Formal analogy and further input. Our finite construction has established neither a metric nor the existence of a surface whose area equals . It has no rule for extremizing that area. It also has no continuum field dynamics, gravitational constraints, or expansion in Newton’s constant.

The corresponding relative-entropy and modular-Hamiltonian relations acquire holographic content only after a bulk/boundary identification and its regime have been specified. The original JLMS analysis concerns the relation at leading order in the bulk gravitational coupling for the states and setting considered there.

Harlow’s operator-algebra analysis explains a general relationship between recovery and entropy structure. Our notes have proved explicit model cases. A theorem establishing the general normal form is additional mathematical input; an extremal-surface interpretation is additional physical input.

These distinctions give us a program for the rest of the course. We must learn what a local QFT algebra contributes, how a boundary CFT supplies a semiclassical code, and why geometric extremization computes the entropy in that regime. The finite examples tell us which parts of the answer come from encoding alone.

10. What to take away

  • Complementary recovery concerns an algebra and its commutant; it does not clone a full quantum system.
  • Fixed auxiliary entanglement gives an additive entropy term in an explicit code.
  • A center allows the term to depend on a shared sector while remaining central.
  • Entropy of a state restricted to an algebra may differ from entropy of the full logical density matrix.
  • Relative entropy and compressed modular Hamiltonians obey exact identities in these finite codes.
  • Identifying the central term with geometric area and extremizing a surface require further holographic input.

The opening block is now complete. The next planned unit will develop algebras with sectors through constrained quantum systems and then examine a small tensor-network code. Those examples will prepare the passage from a few controlled observables to a pattern of regions and reconstructable algebras.

11. Problem set

Classroom core

1. Unequal auxiliary weights. In the factor code, replace the auxiliary Bell pair by , with . Find and for a maximally mixed logical qubit on .

2. Reconstruct through a gate. Verify the controlled-NOT conjugation rules and by their action on .

3. A central entropy term. In the three-level code, choose . List the physical reduced eigenvalues and calculate , , and .

4. Phase information. Show that changing in Section 8 leaves every one-side expectation unchanged. Give a joint physical operator, defined using , that detects the logical expectation.

Self-study consolidation

5. Relative entropy. In the factor code, take , , and a maximally entangled auxiliary qubit pair. Evaluate both sides of the relative-entropy identity directly from their eigenvalues.

6. Full state versus algebra. In the three-level model with , compare the pure coherent input with the incoherent input . Calculate their full logical entropies, their restricted algebraic entropies, and their physical reduced entropies.

7. A state-dependent central expectation. For the same model, differentiate with respect to . Separate the derivative of the algebraic entropy from that of the central expectation.

Research extension

8. Add a genuine quantum sector. Construct a direct-sum code with two sectors, each containing a logical qubit accessible on , and choose different fixed auxiliary entropies in the two sectors. Write an explicit isometry, recover one noncommuting pair inside each sector, and verify the entropy identity for a mixed state with nonzero sector probabilities. Completion requires matrices or a fully specified basis map; no geometric interpretation is required.

12. Answer checkpoints

1. The central operator is . For , . The endpoints correspond to a product auxiliary state and can be treated by continuity for entropy; logarithmic operator formulas need support restrictions there.

2. Controlled-NOT is its own inverse. Acting successively on gives for the conjugated , and a phase for the conjugated .

3. All three physical eigenvalues are , so . The algebraic entropy is

and the central expectation is .

4. Partial tracing removes all cross-sector terms, leaving the diagonal state independent of . The physical operator , extended by zero on the orthogonal complement of the code, has expectation . It is generally supported jointly on .

5. On ,

On , the spectra are and . Grouping repeated terms produces exactly the same answer.

6. The full logical entropies are and . Both restrictions to have entropy , and both physical reduced states have entropy . Restricting the algebra removes the coherence that distinguishes the full states.

7. For ,

The first term is and the second is . Central does not mean constant across states when the center contains more than the identity.

For Problem 8, a useful starting point is to keep the sector labels orthogonal on both physical sides, use a product auxiliary vector in sector 0, and a maximally entangled auxiliary pair in sector 1. The within-sector logical and should satisfy the reconstruction intertwining identities.


Previous: Lecture 3. Return to the course route or the project guide.

Wiki connections. Ryu–Takayanagi formula · subregion–subalgebra duality