Skip to main content
conciseness
Source Link
forky40
  • 7.6k
  • 2
  • 12
  • 32

I would argue thatTo me, QST (at least the nonadaptive kind) is more like a parameter estimation problem, which is - a more constrained type of learning problem that is slightly more constrained than ordinary supervised ML.$^1$

The typical setup for parameter estimation is, startstarts with an unknown variable $\theta$ sampled from a prior distribution $p(\theta)$ and sample some unknown variable $\theta$. This $\theta$ is fixed for the duration of the learning task, and (for simplicity) induces a distribution of observations $$ p(\{(x_1, y_1), \dots, (x_n, y_n)\}|\theta):= p(B|\theta), \tag{1} $$ where I use   $B$ as shorthand to representrepresents the "training data" of, i.e. learner's observations. The learner's goal is, upon sampling observations from $p(B|\theta)$, to output an estimate $\hat{\theta} = \hat{\theta}(B)$ that is close to $\theta$ by some metric $d$. This metricmight look like minimizing a distance $d(\theta, \hat{\theta})$ where the function $d$ does not depend on the distribution of $B$ - it is not sufficient to just minimize $d(\theta, \hat{\theta})$ with respect to $p(B|\theta)$.

In the basic setting of QST, you correctly observed thatthe observations look like $B=\{(E_i,\langle \hat{E_i}\rangle_{\rho} )\}_{i=1}^n$, where $E_i$ denotes a measurement setting and $\langle \hat{E_i}\rangle_{\rho}$ is an empirical estimate for the result of that measurement (subject to statistical noise, other experimental errors, etc). However, to relateTo connect this back to parameter estimation, the variable $\theta:=\rho$ consists of all of the entries of $\rho$, and so $\hat{\theta}:= \hat{\rho}$ represents the learner's best guess for $\rho$. Typically we consider $d(\rho, \hat{\rho}) = \lVert \rho - \hat{\rho} \rVert_1$, and so the learner's goal islearner wants to outputfind $\hat{\rho}$ that minimizes this distance. ForIf there's a prior distribution of states $p(\rho)$, the learner might try to minimize \begin{equation} \mathbb{E}_{p(\rho)} \left(\mathbb{E}_{p(B|\rho)} \lVert \rho - \hat{\rho}(\{(E_1,\langle \hat{E_1}\rangle_{\rho}), \dots, (E_n,\langle \hat{E_n}\rangle_{\rho})\}) \rVert_1\right) \tag{2} \end{equation}

The reason this differs from a ``prediction problem'' (e.g. supervised learning) is that the term in the parentheses above depends explicitly on $\rho$. In most supervised learning problems, you care less about learning the exact value of an underlying parameter, and more about predicting each new label $y_i$ given $x_i$In most supervised learning problems, you care less about learning the exact value of an underlying parameter, and more about predicting each new label $y_i$ given $x_i$.

 

SoGiven the above, phrasing QST as a supervised learning problem is kind of sketchy, but I'll try anyways. Here's one possible setup: Suppose $\rho$ is still sampled according to $p(\rho)$, but that instead of learning $\rho$, you want to be able to predict measurement outcomes for randomly sampled measurements $E_i$. Mathematically, you want to come up with a function $f$ that minimizes \begin{equation} \mathbb{E}_{p(\rho)} \left(\mathbb{E}_{p(E)} |f(E) - \langle \hat{E}\rangle_{\rho}|\right) \tag{3} \end{equation} This now resembles a supervised learning problem. In fact, its almost identical to linear regression: You randomly sample pairs $(E_i, y_i)$ where $y_i:= \langle \hat{E}_i, \rho \rangle$, and your goal is to predict $y=\langle E, \rho \rangle$ with respect to the distribution of $E$.

NoteThis problem should not be much harder than QST, since if we had a good estimate $\hat{\rho}$ for $\rho$, then we could compute $\text{tr}(\hat{\rho}E_i) = y_i$. On the other hand, it might be that our distribution over measurements only contains a handful of measurements $E$ so that full knowledge of $\hat{\rho}$ is simply unnecessary for the task (this is some of the intuition behind classical shadows techniques).


$^1$ The way I use terminology here (learning, prediction, parameter estimation) is not really standardizedisn't necessarily standard - its always better to just explain the learning setting in detail.

I would argue that QST (at least the nonadaptive kind) is more like a parameter estimation problem, which is a type of learning problem that is slightly more constrained than ordinary supervised ML.

The typical setup for parameter estimation is, start with a prior distribution $p(\theta)$ and sample some unknown variable $\theta$. This $\theta$ is fixed for the duration of the learning task, and (for simplicity) induces a distribution of observations $$ p(\{(x_1, y_1), \dots, (x_n, y_n)\}|\theta):= p(B|\theta), \tag{1} $$ where I use $B$ as shorthand to represent the "training data" of observations. The learner's goal is, upon sampling observations from $p(B|\theta)$, to output an estimate $\hat{\theta} = \hat{\theta}(B)$ that is close to $\theta$ by some metric $d$. This metric does not depend on the distribution of $B$ - it is not sufficient to just minimize $d(\theta, \hat{\theta})$ with respect to $p(B|\theta)$.

In the basic setting of QST, you correctly observed that observations look like $B=\{(E_i,\langle \hat{E_i}\rangle_{\rho} )\}_{i=1}^n$, where $E_i$ denotes a measurement setting and $\langle \hat{E_i}\rangle_{\rho}$ is an empirical estimate for the result of that measurement (subject to statistical noise, other experimental errors, etc). However, to relate this back to parameter estimation, the variable $\theta:=\rho$ consists of all of the entries of $\rho$, and so $\hat{\theta}:= \hat{\rho}$ represents the learner's best guess for $\rho$. Typically we consider $d(\rho, \hat{\rho}) = \lVert \rho - \hat{\rho} \rVert_1$, and so the learner's goal is to output $\hat{\rho}$ that minimizes this distance. For a prior distribution of states $p(\rho)$ the learner might try to minimize \begin{equation} \mathbb{E}_{p(\rho)} \left(\mathbb{E}_{p(B|\rho)} \lVert \rho - \hat{\rho}(\{(E_1,\langle \hat{E_1}\rangle_{\rho}), \dots, (E_n,\langle \hat{E_n}\rangle_{\rho})\}) \rVert_1\right) \tag{2} \end{equation}

The reason this differs from a ``prediction problem'' (e.g. supervised learning) is that the term in the parentheses above depends explicitly on $\rho$. In most supervised learning problems, you care less about learning the exact value of an underlying parameter, and more about predicting each new label $y_i$ given $x_i$.

So, phrasing QST as a supervised learning problem is kind of sketchy, but I'll try anyways. Suppose $\rho$ is still sampled according to $p(\rho)$, but that instead of learning $\rho$, you want to be able to predict measurement outcomes for randomly sampled measurements $E_i$. Mathematically, you want to come up with a function $f$ that minimizes \begin{equation} \mathbb{E}_{p(\rho)} \left(\mathbb{E}_{p(E)} |f(E) - \langle \hat{E}\rangle_{\rho}|\right) \tag{3} \end{equation} This now resembles a supervised learning problem. In fact, its almost identical to linear regression: You randomly sample pairs $(E_i, y_i)$ where $y_i:= \langle \hat{E}_i, \rho \rangle$, and your goal is to predict $y=\langle E, \rho \rangle$ with respect to the distribution of $E$.

Note that the way I use terminology here (learning, prediction, parameter estimation) is not really standardized - its always better to just explain the learning setting in detail.

To me, QST (at least the nonadaptive kind) is more like a parameter estimation problem - a more constrained type of learning problem than ordinary supervised ML.$^1$

The typical setup for parameter estimation starts with an unknown variable $\theta$ sampled from a prior distribution $p(\theta)$. This $\theta$ is fixed for the duration of the learning task, and (for simplicity) induces a distribution of observations $$ p(\{(x_1, y_1), \dots, (x_n, y_n)\}|\theta):= p(B|\theta), \tag{1} $$ where   $B$ represents the "training data", i.e. learner's observations. The learner's goal is, upon sampling observations from $p(B|\theta)$, to output an estimate $\hat{\theta} = \hat{\theta}(B)$ that is close to $\theta$. This might look like minimizing a distance $d(\theta, \hat{\theta})$ where the function $d$ does not depend on $p(B|\theta)$.

In basic QST, the observations look like $B=\{(E_i,\langle \hat{E_i}\rangle_{\rho} )\}_{i=1}^n$, where $E_i$ denotes a measurement setting and $\langle \hat{E_i}\rangle_{\rho}$ is an empirical estimate for the result of that measurement (subject to statistical noise, other experimental errors, etc). To connect this to parameter estimation, the variable $\theta:=\rho$ consists of all of the entries of $\rho$, and so $\hat{\theta}:= \hat{\rho}$ represents the learner's best guess for $\rho$. Typically we consider $d(\rho, \hat{\rho}) = \lVert \rho - \hat{\rho} \rVert_1$, and the learner wants to find $\hat{\rho}$ that minimizes this distance. If there's a prior distribution of states $p(\rho)$, the learner might try to minimize \begin{equation} \mathbb{E}_{p(\rho)} \left(\mathbb{E}_{p(B|\rho)} \lVert \rho - \hat{\rho}(\{(E_1,\langle \hat{E_1}\rangle_{\rho}), \dots, (E_n,\langle \hat{E_n}\rangle_{\rho})\}) \rVert_1\right) \tag{2} \end{equation}

The reason this differs from supervised learning is that the term in the parentheses above depends explicitly on $\rho$. In most supervised learning problems, you care less about learning the exact value of an underlying parameter, and more about predicting each new label $y_i$ given $x_i$.

 

Given the above, phrasing QST as a supervised learning problem is kind of sketchy, but I'll try anyways. Here's one possible setup: Suppose $\rho$ is still sampled according to $p(\rho)$, but that instead of learning $\rho$, you want to be able to predict measurement outcomes for randomly sampled measurements $E_i$. Mathematically, you want to come up with a function $f$ that minimizes \begin{equation} \mathbb{E}_{p(\rho)} \left(\mathbb{E}_{p(E)} |f(E) - \langle \hat{E}\rangle_{\rho}|\right) \tag{3} \end{equation} This now resembles a supervised learning problem. In fact, its almost identical to linear regression: You randomly sample pairs $(E_i, y_i)$ where $y_i:= \langle \hat{E}_i, \rho \rangle$, and your goal is to predict $y=\langle E, \rho \rangle$ with respect to the distribution of $E$.

This problem should not be much harder than QST, since if we had a good estimate $\hat{\rho}$ for $\rho$, then we could compute $\text{tr}(\hat{\rho}E_i) = y_i$. On the other hand, it might be that our distribution over measurements only contains a handful of measurements $E$ so that full knowledge of $\hat{\rho}$ is simply unnecessary for the task (this is some of the intuition behind classical shadows techniques).


$^1$ The way I use terminology here (learning, prediction, parameter estimation) isn't necessarily standard - its always better to just explain the learning setting in detail.

Source Link
forky40
  • 7.6k
  • 2
  • 12
  • 32

I would argue that QST (at least the nonadaptive kind) is more like a parameter estimation problem, which is a type of learning problem that is slightly more constrained than ordinary supervised ML.

The typical setup for parameter estimation is, start with a prior distribution $p(\theta)$ and sample some unknown variable $\theta$. This $\theta$ is fixed for the duration of the learning task, and (for simplicity) induces a distribution of observations $$ p(\{(x_1, y_1), \dots, (x_n, y_n)\}|\theta):= p(B|\theta), \tag{1} $$ where I use $B$ as shorthand to represent the "training data" of observations. The learner's goal is, upon sampling observations from $p(B|\theta)$, to output an estimate $\hat{\theta} = \hat{\theta}(B)$ that is close to $\theta$ by some metric $d$. This metric does not depend on the distribution of $B$ - it is not sufficient to just minimize $d(\theta, \hat{\theta})$ with respect to $p(B|\theta)$.

In the basic setting of QST, you correctly observed that observations look like $B=\{(E_i,\langle \hat{E_i}\rangle_{\rho} )\}_{i=1}^n$, where $E_i$ denotes a measurement setting and $\langle \hat{E_i}\rangle_{\rho}$ is an empirical estimate for the result of that measurement (subject to statistical noise, other experimental errors, etc). However, to relate this back to parameter estimation, the variable $\theta:=\rho$ consists of all of the entries of $\rho$, and so $\hat{\theta}:= \hat{\rho}$ represents the learner's best guess for $\rho$. Typically we consider $d(\rho, \hat{\rho}) = \lVert \rho - \hat{\rho} \rVert_1$, and so the learner's goal is to output $\hat{\rho}$ that minimizes this distance. For a prior distribution of states $p(\rho)$ the learner might try to minimize \begin{equation} \mathbb{E}_{p(\rho)} \left(\mathbb{E}_{p(B|\rho)} \lVert \rho - \hat{\rho}(\{(E_1,\langle \hat{E_1}\rangle_{\rho}), \dots, (E_n,\langle \hat{E_n}\rangle_{\rho})\}) \rVert_1\right) \tag{2} \end{equation}

The reason this differs from a ``prediction problem'' (e.g. supervised learning) is that the term in the parentheses above depends explicitly on $\rho$. In most supervised learning problems, you care less about learning the exact value of an underlying parameter, and more about predicting each new label $y_i$ given $x_i$.

So, phrasing QST as a supervised learning problem is kind of sketchy, but I'll try anyways. Suppose $\rho$ is still sampled according to $p(\rho)$, but that instead of learning $\rho$, you want to be able to predict measurement outcomes for randomly sampled measurements $E_i$. Mathematically, you want to come up with a function $f$ that minimizes \begin{equation} \mathbb{E}_{p(\rho)} \left(\mathbb{E}_{p(E)} |f(E) - \langle \hat{E}\rangle_{\rho}|\right) \tag{3} \end{equation} This now resembles a supervised learning problem. In fact, its almost identical to linear regression: You randomly sample pairs $(E_i, y_i)$ where $y_i:= \langle \hat{E}_i, \rho \rangle$, and your goal is to predict $y=\langle E, \rho \rangle$ with respect to the distribution of $E$.

Note that the way I use terminology here (learning, prediction, parameter estimation) is not really standardized - its always better to just explain the learning setting in detail.