Consider a simple two-qubit gate such as the CNOT. The typical presentation of this gate is $$\text{CNOT} = |0\rangle\!\langle0|\otimes I + |1\rangle\!\langle1|\otimes X,$$ with $X$ the Pauli $X$ gate. This gate can also be written reversing the role of control and target, as $$\text{CNOT} = I\otimes |+\rangle\!\langle+| + Z\otimes |-\rangle\!\langle-|.$$ Is this sort of trick a general feature of unitary gates which have a "control-target structure" (that is, unitaries acting on a bipartite space which are block-diagonal in some basis)? More precisely, consider a generic unitary $\mathcal U:\mathcal H_A\otimes\mathcal H_B\to\mathcal H_A\otimes\mathcal H_B$ which has the form $$\mathcal U = \sum_i |u_i\rangle\!\langle u_i|\otimes U_i,$$ for some orthonormal set $\{|u_i\rangle\}_i\in\mathcal H_A$ and collection of unitaries $\{U_i\}_i$.
Is there always a set of orthonormal vectors $\{|v_j\rangle\}_j\subset\mathcal H_B$ and collection of unitaries $\{V_j\}_j$ such that $$\mathcal U = \sum_j V_j\otimes |v_j\rangle\!\langle v_j|$$ also holds?
This question is closely related to General approach for switching control and target qubit, albeit here I'm focusing on a more general case.