Questions tagged [entropy]

For questions about the various kinds of entropies --- as defined in the context of quantum information theory and quantum statistical mechanics.

Filter by
Sorted by
Tagged with
1 vote
1 answer
69 views

Does quantum mutual information encompass information only about quantum correlations, or does it encompass both classical and quantum correlations?

I am confused about what quantum mutual information gives us. Does it give all kinds of quantum correlations? Or does it give all kinds of quantum and classical correlations? If it consists of ...
4 votes
0 answers
41 views

Is there a known deterministic counterexample for non-additivity of minimal output entropy?

Hastings has proved that the minimal output entropy is not additive: it may happen that $S_{\mathrm{min}}(\Phi_1 \otimes \Phi_2) < S_{\mathrm{min}}(\Phi_1)+S_{\mathrm{min}}(\Phi_2) $ for quantum ...
6 votes
1 answer
369 views

Thermodynamic Speed Limit to Quantum Computing

There's a lot of mystifying jargon in the field of quantum computation, so I would like to examine some elementary physics to maybe help clarify the assumptions being made. Is it not true that the ...
5 votes
1 answer
821 views

What is entropy quantum computing?

Recently there is news concerning some computational breakthroughs by using so-called "entropy quantum computing": https://thequantuminsider.com/2022/07/20/qci-solves-3854-variable-problem-...
2 votes
2 answers
347 views

What is the conditional min-entropy for diagonal ("classical") matrices?

The conditional min-entropy, discussed e.g. in these notes by Watrous, as well as in this other post, can be defined as $$\mathsf{H}_{\rm min }(\mathsf{X} \mid \mathsf{Y})_{\rho}\equiv -\inf _{\sigma \...
0 votes
1 answer
79 views

Upper bound on entanglement entropy of a Product State for any possible partition of the Joint System

Let $|\psi\rangle$ be an $n$ qubit quantum state on a line with Von Neumann entanglement entropy at most $r$ with respect to any bipartition of the qubits (does not have to be a contiguous bipartition)...
1 vote
1 answer
154 views

Is quantum mutual information an entanglement measure?

For a bipartite system, the quantum mutual information is defined via the Von Neumann entropy as follows: $$I(A:B)=S(A)+S(B)-S(AB).$$ It's always positive. Is it an entanglement measurement? Also how ...
4 votes
2 answers
401 views

Energy cost of quantum computation

A quantum computer can be modeled as a single unitary transition of a (large) effective quantum state to another. In order to get errors under control, quantum error correction is assumed. A logical ...
1 vote
0 answers
39 views

Why are all Rényi entropies equal for Clifford dynamics?

In this paper, by Adam Nahum et al., the authors trivially states that "For Clifford dynamics all Rényi entropies are equal ... " which is not trivial to me. Is there a paper or lecture ...
1 vote
0 answers
22 views

States for Tight Maassen-Uffink Uncertainty Relation

I was reading this paper titled "Entropic Uncertainty Relations and their Applications". There,at equation (47) we have the Maassen-Uffink uncertainty relation which states that for a pair ...
1 vote
1 answer
48 views

Quantum relative entropy between pre- and post-measurement states

The quantum relative entropy between the states $\rho$ and $\sigma$ is defined by $$D(\rho||\sigma)= \textrm{tr}\Big(\rho \big(\log\rho - \log \sigma \big) \Big)\,,$$ as long as the support of $\rho$ ...
2 votes
1 answer
103 views

Is Klein's inequality due to Klein?

You may be familiar with "Klein's inequality"; one form of it is $$ -\operatorname{tr}(\rho \log \sigma) + \operatorname{tr}(\rho \log \rho) \ge 0, $$ stating that relative entropy is ...
2 votes
0 answers
47 views

General structure of the state with $I(A:B|C)_{\rho}{=}2 \log_2 \{\min (d_A, d_B)\}$

The conditional quantum mutual information (CQMI) of a state $\rho^{ABC}$ respects the dimension bound $I(A:B|C)_{\rho}{\leq}2 \log_2 \{\min (d_A, d_B)\}$ (Mark Wilde's book, exercise 11.7.9). One ...
0 votes
0 answers
57 views

Proof of the Lieb's theorem

Lemma A6.2: Let $R1 , R2 , S1 , S2 , T1, T2$ be positive operators such that $0 = [R1, R2 ] = [S1, S 2 ] = [T1, T2 ]$, and $$ R1 ≥ S1 + T1\\ R2 ≥ S2 + T2 $$ Then for all $0 ≤ t ≤ 1$, $$ R_1^t R_2^{1−t}...
2 votes
2 answers
186 views

How to show $T(\rho,\sigma)≥\sum_i|r_i − s_i|$ with $r_i,s_i$ eigenvalues of $\rho,\sigma$?

The proof of the Fannes' inequality replies on the formula $T(ρ, σ)≥\sum_i|r_i − s_i|$, where $r_i,s_i$ are the eigenvalues of $\rho,\sigma$, in the descending order. In the proof given in Box 11.2, ...
3 votes
3 answers
111 views

What is the conditional min-entropy of a pure bipartite state?

In this paper, it is stated that the conditional min-entropy $H(A|B)_{\rho_{AB}}$ of $A$ conditioned on $B$ for any $\textbf{pure}$ quantum system $\rho_{AB}=|\psi_{AB} \rangle \langle \psi_{AB} |$ is ...
1 vote
1 answer
59 views

Is it true that $|r_i-s_i| \le 1/2$ for all $i$, where $r_i$ and $s_i$ are the eigenvalues of density matrices $\rho$ and $\sigma$?

In Nielsen and Chuang's Box 11.2: Continuity of the entropy, in the process of proving the Fannes' inequality, it says: A moment’s thought shows that $\left|r_i − s_i\right| \le 1/2$ for all i, The ...
3 votes
1 answer
193 views

Quantum state discrimination and lower bound for conditional von Neumann entropy

Consider two quantum states $\rho_A$ and $\sigma_A$, and define the classical-quantum state over a classical binary system $B$ and $A$, $$\omega_{AB}^\epsilon :=\epsilon \vert 0 \rangle \langle 0 \...
1 vote
2 answers
199 views

Derive the Concavity of Quantum Conditional Entropy from Strong subadditivity

In Exercise 11.25, Page 522, Entropy and information, Quantum Computation and Quantum Information by Nielsen and Chuang, it is required to show that the concavity of the conditional entropy may be ...
1 vote
0 answers
29 views

Find the minimal and maximal of $\widehat{S}_f (\rho \| U^* \sigma U)$

I have been study the minimal (maximal) of a $f-$divergence. Fumio Hiai introduced the $\widehat{S}_f (\rho \| \sigma)$ divergence in his article. $$\widehat{S}_f (\rho \| \sigma) := \text{Tr} \sigma^{...
1 vote
1 answer
69 views

Quantum Relative entropy- the math and intuition

I am new to quantum information theory and have been reading Mark Wilde's notes on quantum relative entropy. http://www.markwilde.com/teaching/2015-fall-qit/lectures/lecture-19.pdf I have three basic ...
1 vote
1 answer
95 views

In what sense is the "conditional min-entropy" a conditional entropy?

$\newcommand{\H}{\mathsf{H}}\newcommand{\Hmin}{\H_{\rm min}}\newcommand{\D}{\mathsf{D}}\newcommand{\Dmax}{\D_{\rm max}}$Consider the conditional min-entropy $\Hmin(A|B)_\rho$, discussed e.g. in this ...
8 votes
1 answer
547 views

How does the conditional min-entropy $H_{\rm min}(A|B)_\rho$ relate to the conditional entropy $H(X|Y)_\rho$?

Suppose we have a classical quantum state $\sum_x |x\rangle \langle x|\otimes \rho_x$, one can define the smooth-min entropy $H_\min(A|B)_\rho$ as the best probability of guessing outcome $x$ given $\...
4 votes
0 answers
39 views

Does the quantum relative entropy have a direct operational interpretation?

Consider the quantum relative entropy, defined as $$D(\rho\|\sigma) = \operatorname{tr}(\rho\log\rho)-\operatorname{tr}(\rho\log\sigma),$$ for all $\rho,\sigma\ge0$ such that $\operatorname{im}(\rho)\...
3 votes
1 answer
70 views

Why can the max-relative entropy be written as $D_{\max}(\rho \parallel \sigma) = \inf \{ \lambda : \rho \leq 2^\lambda \sigma \}$?

The quantum conditional min-entropy is defined as $$H_{\min}(A|B) = - \inf\limits_{\sigma_B} D_{\max} \left( \rho_{AB} \parallel I_A \otimes \sigma_B \right),$$ where $$D_{\max}(\rho \parallel I_A \...
1 vote
1 answer
29 views

Does the max-relative entropy satisfy $0 < D_{\max}(\rho \parallel I_A \otimes \sigma_B) < 1$?

The quantum conditional min-entropy is defined as $$H_{\min}(A|B) = - \inf\limits_{\sigma_B} D_{\max} \left( \rho_{AB} \parallel I_A \otimes \sigma_B \right)$$ where in general $$D_{\max}(\rho \...
1 vote
1 answer
45 views

Prove that the conditional min-entropy is $H_{\rm min}(A|B)=\max_\sigma\sup\{\lambda:\,\rho\le 2^{-\lambda}(I\otimes\sigma)\}$

I have seen various definitions of quantum conditional min-entropy, which I believe are equivalent. $$H_{\min}(A|B) = - \inf\limits_{\sigma_B} D_{\max} \left( \rho_{AB} \parallel I_A \otimes \sigma_B ...
4 votes
0 answers
243 views

Prove the equality conditions in the triangle inequality $S(A,B)\ge |S(A)-S(B)|$ for the von Neumann entropy

The triangle inequality or Araki-Lieb inequality of the von Neumann entropy is $$ S(A,B)\ge|S(A)-S(B)| $$ this is proven by introducing a system $R$ which purifies systems $A$ and $B$. Applying ...
5 votes
3 answers
3k views

Quantum Supremacy: Some questions on cross-entropy benchmarking

I was skimming through the Google quantum supremacy paper but got stuck on this section: For a given circuit, we collect the measured bit-strings $\{x_i\}$ and compute the linear XEB fidelity [24-26, ...
3 votes
0 answers
217 views

Prove $|η(r) − η(s)| ≤ η(|r − s|)$ when $|r − s| ≤ 1/2$ [closed]

Background If $\rho$ and $\sigma$ are density matrices such that the trace distance between them satisfies $T(\rho,\sigma)\leq1/e$. Then the Fannes' inequality states that $$|S(\rho)-S(\sigma)|\leq T(...
1 vote
1 answer
196 views

Conditional entropy as relative entropy between probability distributions

Find the expression for the conditional entropy $H(Y|X)$ as a relative entropy between two probability distributions. Use this expression to deduce that $H(Y |X)≥0$, and to find the equality ...
2 votes
0 answers
56 views

Can't understand how $D_{A,B} + D_{A,C} \ge E_{A,B}+E_{A,C}$ is proved used the subadditivity of entropy

I am reading Monogamy properties of quantum and classical correlations. Eq.10 states that $$D_{A,B} + D_{A,C} \ge E_{A,B}+E_{A,C},$$ where $D_{i,j}$ is the quantum discord, and $E_{A,B}$ is the ...
0 votes
1 answer
155 views

How is the von Neumann entropy of a state defined from its eigendecomposition?

The definition of the von Neumann entropy of a mixed state says that it can be calculated as the Shannon entropy of coefficients of the decomposition of the state into a sum of projectors. My question:...
3 votes
2 answers
332 views

Qualitative meaning of the bond dimension of a matrix product state

Consider a matrix product state (MPS) with a bond dimension $D$. What is the physical intuition behind the bond dimension? Is it, in any way, related to the spatial geometry? In this note, it is ...
1 vote
0 answers
64 views

von Neumann entropy of an arbitrary composition system

I understand the von Neumann entropy of a $2$-composite system is that of the reduced density matrix? What is the von Neumann entropy of an entanglement of a more than $3$ composite system?
3 votes
1 answer
106 views

Difference between min/max-entropies and the von Neumann entropy

Consider the (smooth) min-entropy, max-entropy and von Neumann entropy of a given density operator $\rho_A$. Does a small gap between $H_{\max(\min)}(A)_\rho$ and $H(A)_\rho$ implies a small gap ...
3 votes
1 answer
62 views

Quasi concavity of max-relative entropy?

The max-relative entropy between two states is defined as $$D_{\max }(\rho \| \sigma):=\log \min \{\lambda: \rho \leq \lambda \sigma\}.$$ It is known that the max-relative entropy is quasi-convex. ...
2 votes
0 answers
41 views

Why are "smooth entropic quantities" useful/necessary?

Consider the $\epsilon$-smoothed relative max-entropy of $\rho$ with respect to $Q$, defined as (following Watrous' notation from these notes): $$\mathrm D_{\rm max}^{\epsilon}(\rho\|Q) = \min_{\xi\in ...
5 votes
0 answers
144 views

Connection between smooth max-relative entropy and smooth max-information

The max-relative entropy between two states is defined as $$D_{\max }(\rho \| \sigma):=\log \min \{\lambda: \rho \leq \lambda \sigma\},$$ where $\rho\leq \sigma$ should be read as $\sigma - \rho$ is ...
1 vote
0 answers
16 views

What is the idea behind compressibility results in terms of Renyi entropies?

In (Tomamichel 2015), in (1.2) the author mentions the result that a source $X$ with probability distribution $\rho\equiv\rho_X$ admits an $(\varepsilon,m)$-code as long as there is some $\alpha\in[\...
5 votes
1 answer
153 views

Is the quantum min-relative entropy $D_{\min}(\rho\|\sigma)=-\log(F(\rho, \sigma)^2)$ or $D_{\min}(\rho\|\sigma)=-\log(tr(\Pi_\rho\sigma))$?

In John Watrous' lectures, he defines the quantum min-relative entropy as $$D_{\min}(\rho\|\sigma) = -\log(F(\rho, \sigma)^2),$$ where $F(\rho,\sigma) = tr(\sqrt{\rho\sigma})$. Here, I use this ...
0 votes
1 answer
57 views

Entanglement entropy for graph states defined on a tree graph

Consider a $k-\text{ary}$ tree $T$, for a constant $k$. Consider the corresponding graph state $|\mathsf{G}_T \rangle$ that is defined on $T$. Is it true that $|\mathsf{G}_T \rangle$ saturates the ...
6 votes
3 answers
5k views

What is a "maximally mixed state"?

What is meant by maximally mixed states? Does this mean that there are partially mixed states? For example, consider $\rho_{GHZ} = \left| {GHZ} \right\rangle \left\langle {GHZ} \right|$ and $\rho_W =...
0 votes
1 answer
262 views

How to take Statevector for subsystem?

I want to calculate the 2nd Renyi entropy using the density matrix in Qiskit. To do this, I need to calculate the $Tr(\rho^2)$ for subsystem. The complete system consists of 12 qubits from which I ...
3 votes
2 answers
237 views

Derivation of the linear cross entropy

I'm looking at cross-entropy benchmarks and there's much that I'm reading at the moment but I'm stuck on one detail: how to derive the linear cross-entropy formula from the cross-entropy formula. The ...
6 votes
1 answer
476 views

Does computing the quantum mutual information $I(\rho^{AB})$ require full tomographic information of $\rho^{AB}$?

In the discussions about quantum correlations, particularly beyond entanglement (discord, dissonance e.t.c), one can often meet two definitions of mutual information of a quantum system $\rho^{AB}$: ...
1 vote
0 answers
42 views

Understanding conditional $L_2$ distances

I see that conditional $L_2$ distances from uniform are defined in the following way: $L_2(\rho_{AB}\vert \sigma_B)= \text{tr}\left(((\rho_{AB}- \mu_{A} \otimes \rho_{B}) (\mathbb{I}_A \otimes \...
7 votes
1 answer
846 views

What is "linear" in linear entropy?

Why is the linear entropy, defined by $S_L = 1 - \textrm{Tr} \rho^2$, called linear?
1 vote
1 answer
65 views

Data Processing equality variation

Let $\rho_{AB}$ be a state and $T: B \rightarrow C$ be a CPTP map with $\sigma_{AC}= T(\rho_{AB})$. It is well known that $H_{\infty}(A \vert B)_{\rho} \geq H_{\infty}(A \vert C)_{\sigma}$ (aka data ...
2 votes
1 answer
184 views

Why von Neumann entropy requires diagonalization and linear entropy doesn't?

The linear entropy for a state $\rho$ is defined as $S_L = 1 - Tr[\rho^2]$, while as von Neumann entropy as $S_{N} = -Tr[\rho \ln \rho]$. According to quantiki, the computation of $S_{N}$ requires ...