Ok, here's my attempt: take a time-dependent Hamiltonian $H(t)$ and consider its evolution in the time interval $[0,t]$. Discretize this interval in $k$ steps of length $\Delta \tau \equiv t/k$
$$
\tau_{n} \equiv n \Delta \tau, \qquad n = 0,1,\ldots,k-1.
$$
Now consider the piecewise-constant product of the propagators $\exp(-i H(\tau_n)\Delta \tau)$ taken in the (right-to-left) time-order:
\begin{equation}\tag{1}\label{eq:ordered}
e^{-i H(\tau_{k-1}) \Delta \tau} e^{-i H(\tau_{k-2}) \Delta \tau} \cdots e^{-i H(\tau_{0}) \Delta \tau}
\end{equation}
then expand the exponentials in their power series and multiply the series together. You will get terms of the form
$$
X_{n_1,\ldots,n_{k}} = \frac{H(\tau_{k-1})^{n_1} H(\tau_{k-2})^{n_2} \cdots H(\tau_0)^{n_k}}{n_1! \, n_2! \cdots n_k!} (-i \Delta \tau)^{n_1+\ldots+n_k}
$$
for $n_1,\ldots,n_k \in \mathbb{N}$. Now collect together the terms of the same order $m = n_1 + \ldots + n_k$. The first few terms of this series $\sum_{m=0}^{\infty} X_m$ are given by
\begin{align*}
X_0 &= I \\
X_1 &= -i \sum_{i=0}^{k-1} H(\tau_i) \Delta \tau \xrightarrow{k \rightarrow \infty} -i \int_0^t H(\tau) \mathrm{d}\tau \\
X_2 &= -\sum_{i>j} H(\tau_i) H(\tau_j) (\Delta \tau)^2 - \sum_i \frac{H(\tau_i)^2}{2!} (\Delta \tau)^2
\end{align*}
Now consider the square $[0,t] \times [0,t] \subseteq \mathbb{R}^2$.

Observe that the first term of $X_2$ above is a Riemann sum of the operator-valued function
\begin{equation}\tag{2}\label{eq:F1}
F(\tau_1, \tau_2) \equiv H(\tau_1) H(\tau_2)
\end{equation}
in the interior of the lower-right triangle where $\tau_1 > \tau_2$. You want to extend the definition of $F(\tau_1, \tau_2) $ to the upper-left triangle in such a way that its integral over the upper-left triangle is the same as the integral in the lower triangle. This of course is done by using the time-ordering "operator" $\mathcal{T}$:
\begin{equation}\tag{3}\label{eq:F2}
F(\tau_1, \tau_2) \equiv \mathcal{T} \Big[ H(\tau_1) H(\tau_2) \Big] = \begin{cases}
H(\tau_1) H(\tau_2) & \text{if $\tau_1 > \tau_2$}\\
H(\tau_2) H(\tau_1) & \text{otherwise}
\end{cases}
\end{equation}
The operator $\mathcal{T}$ does nothing in the lower-right triangle because there the order $\tau_1 > \tau_2$ is respected (so Eq. \eqref{eq:F2} properly defines an extension of Eq. \eqref{eq:F1}), and "corrects" the order that applies in the other triangle (that is $\tau_2 > \tau_1$) so that the Riemann sums of $F$ over the two triangles are the same. Now you can use this fact
$$
-\sum_{i \neq j} \mathcal{T}\Big[ H(\tau_i) H(\tau_j) \Big] (\Delta \tau)^2 = -2\sum_{i>j} \mathcal{T}\Big[ H(\tau_i) H(\tau_j) \Big] (\Delta \tau)^2
$$
and that $\mathcal{T}$ acts trivially if $\tau_i=\tau_j$ to rewrite $X_2$ above as
\begin{align}
X_2 & = -\sum_{i \neq j} \frac{1}{2!}\mathcal{T}\Big[ H(\tau_i) H(\tau_j) \Big] (\Delta \tau)^2 - \sum_{i} \frac{1}{2!} \mathcal{T}\Big[ H(\tau_i) H(\tau_i) \Big] (\Delta \tau)^2\\
& = -\sum_{i, j=0}^{k-1} \frac{1}{2!}\mathcal{T}\Big[ H(\tau_i) H(\tau_j) \Big] (\Delta \tau)^2 \xrightarrow{k \rightarrow \infty} \frac{(-i)^2}{2!} \int_0^t \int_0^t \mathcal{T} \Big[ H(\tau_1)H(\tau_2) \Big] \,\mathrm{d}\tau_1 \, \mathrm{d}\tau_2
\end{align}
At this point the generic case should be clear, at least in principle: at the $m$-th order you will have an $m$-dimensional cube $[0,t]^m \subseteq \mathbb{R}^m$ split in $m!$ simplices. Each simplex is defined by the specific ordering of the $m$ coordinates $\tau_1,\ldots,\tau_m$ that holds inside of that simplex. The $m$-th term $X_m$ in the series will contain a Riemann sum of $F(\tau_1,\ldots,\tau_m) \equiv H(\tau_1)\cdots H(\tau_m)$ taken over one of these simplices (call it the "fundamental simplex") where the $m$ coordinates $\tau_j$ are ordered according to the order given in Eq. \eqref{eq:ordered}, as well as some boundary terms. Then one has to extend the definition of $F$ over the full hypercube, while using the time-ordering operator $\mathcal{T}$ to "correct back" the order in each simplex to the order in the fundamental simplex. In this way the Riemann sum of the extension of $F$ in each simplex will be the same. After taking care of the additional boundary terms between the simplices, then one will be able to write $X_m$ as the full Riemann sum over $[0,t]^m$ of the operator-valued function $F(\tau_1,\ldots,\tau_m) \equiv \mathcal{T}[ H(\tau_1) \cdots H(\tau_m)]$, modulo the combinatorial factor $1/m!$ that corrects the overcounting obtained from integrating $F$ over all simplices instead of just one. By taking the $k \rightarrow \infty$ limit of the Riemann sum you get
$$
X_m \xrightarrow{k \rightarrow \infty} \frac{(-i)^m}{m!} \int_{0}^t \cdots \int_{0}^t \mathcal{T}\Big[ H(\tau_1) \cdots H(\tau_m) \Big] \mathrm{d}\tau_1 \cdots \mathrm{d}\tau_m
$$
This is precisely the $m$-th term of the Dyson series, whose sum defines the time-ordered exponential
$$
U(t) = \mathcal{T} \exp\Big(-i\int_0^t H(\tau)\, \mathrm{d}\tau \Big)
$$
so in the limit of $k \rightarrow \infty$ Eq. \eqref{eq:ordered} (in the right-to-left time ordering) correctly gives the unitary propagator generated by the time-dependent Hamiltonian $H(t)$.
All in all this procedure is the same as the one used in deriving the Dyson series. The only difference is that here we have to handle Riemann sums instead of intergals, and so we have some pesky boundary terms (and their combinatorics) to take care of but nothing serious.