We first show that (?)\Rightarrow(?). Let A denote the set of all nonnegative bounded linear operators on the (complex) Hilbert space \mathcal{H}, let B(\mathcal{H}) denote the Banach space of self-adjoint bounded linear operators on \mathcal{H}, and let B_{\mathbb{R}}(\mathcal{H}) denote B(\mathcal{H}) viewed as a real-Banach space. Observe that A is a closed convex set with nonempty interior in the B_{\mathbb{R}}(\mathcal{H}). Let B = B(V), and let us assume for the sake of contradiction that there exists \epsilon > 0 for which (B+\epsilon)\cap A = \emptyset. Since (B+\epsilon)\cap B_{\mathbb{R}}(\mathcal{H}) = \{b+\epsilon\ |\ b \in B\text{ and }b = b^*\} is also a convex set, the Hahn-Banach separation theorem gives us a real-valued continuous linear functional f on B_{\mathbb{R}}(\mathcal{H}), for which r_A := \inf_{a \in A}f(a) \ge \sup\{f(b+\epsilon)\ |\ b \in B\text{ and }b = b^*\}. We note that for any a \in A and \lambda \in \mathbb{R}^+, we have \lambda a \in A, hence r_A = 0. It follows that f is a positive linear functional, so we may assume without loss of generality that ||f|| = 1. We extend f by linearity to be a complex-valued functional on the Banach space B(\mathcal{H}) of all bounded linear operators on \mathcal{H}. Now we observe that for \lambda \in \mathbb{R}, v \in V, and b \in B, we have b+\lambda i(U_v-U_{v^{-1}}) \in B, hence
0 \ge f(b+\lambda i(U_v-U_{v^{-1}})) = f(b)+\lambda f(i(U_v-U_{v^{-1}})).
Since \lambda \in \mathbb{R} was arbitrary, we conclude that for all v \in V we have
f(i(U_v-U_{v^{-1}})) = 0 \Rightarrow f(U_v) = f(U_{v^{-1}}).
Similarly, we see that for any \lambda \in \mathbb{R}, v_1,v_2 \in V, and b \in B, we have b+\lambda(U_{v_1}+U_{v_1^{-1}}-U_{v_2}-U_{v_2^{-1}}) \in B, hence
0 \ge f\left(b+\lambda\left(U_{v_1}+U_{v_1^{-1}}-U_{v_2}-U_{v_2^{-1}}\right)\right) = f(b)+\lambda f\left(U_{v_1}+U_{v_1^{-1}}-U_{v_2}-U_{v_2^{-1}}\right).
Since \lambda \in \mathbb{R} and v_1,v_2 \in V were all arbitrary, we see that
f\left(U_{v_1}+U_{v_1^{-1}}\right) = f\left(U_{v_2}+U_{v_2^{-1}}\right) = 2r.
Combining this with Equation (?), we see that for any v \in V\cup V^{-1} we have f(U_v) = r. Since \frac{1}{2}(U_v+U_{v^{-1}}) \in B, we see that r \le 0.
We now claim that the sequence (f(U_g))_{g \in G} is a positive definite sequence. To prove the claim, let c_1,\cdots,c_n \in \mathbb{C} and g_1,\cdots,g_n \in G be arbitrary, and let V = \sum_{i,j = 1}^nc_i\overline{c_j}U_{g_j^{-1}g_i}. We want to show that f(V) \ge 0, so it suffices to show that V is a positive operator. To this end, let \xi \in \mathcal{H} be arbitrary, and observe that
\langle V\xi,\xi\rangle = \langle\sum_{i,j = 1}^nc_i\overline{c_j}U_{g_j^{-1}g_i}\xi,\xi\rangle = \langle \sum_{i = 1}^nc_iU_{g_i}\xi,\sum_{i = 1}^nc_iU_{g_i}\xi\rangle \ge 0.
Now that we have proven the claim, we use the GNS-construction to create a representation \pi of G on \mathcal{H}' and a cyclic vector \eta \in \mathcal{H}' for which \langle \pi_g\eta,\eta\rangle_{\mathcal{H}'} = f(U_g) for all g \in G. Now let \mathcal{H}'' = \mathcal{H}'\oplus\mathbb{C}, let \xi = (\eta,\sqrt{-r}), and let \pi_g' = \pi_g\oplus\text{Id}. We see that for every v \in V we have
\langle \pi_v'\xi,\xi\rangle_{\mathcal{H}''} = \langle \pi_v\eta,\eta\rangle_{\mathcal{H}'}+r = 0.
Condition (?) tells us that \xi is orthogonal to subspace of \pi'(G)-invariant vectors, which yields the desired contradiction.
We now show that (?)\Rightarrow(?). Let R denote the right regular representation of G on L^2(G,\lambda), where \lambda is the counting measure. Let \epsilon > 0 be arbitrary and let P = \sum_{h \in V\cup V^{-1}}c_hR_h be such that P = P^*, P+\epsilon is positive, (c_h)_{h \in V\cup V^{-1}} is finitely supported, and \sum_{h \in V\cup V^{-1}}c_h = 1. Since P^* = \sum_{h \in V\cup V^{-1}}\overline{c_h}R_h^* = \sum_{h \in V\cup V^{-1}}\overline{c_h}R_{h^{-1}}, we see that c_{h^{-1}} = \overline{c_h} for all h \in G. Let c_{e} = \epsilon and c_g = 0 for g \notin V\cup V^{-1}\cup\{e\}. We will show that (c_g)_{g \in G} is a positive definite sequence. To this end, let (\delta_g)_{g \in G} be the standard bases for L^2(G,\lambda), i.e., \delta_g(g) = 1, and \delta_g(h) = 0 for all h \neq g. We observe that R_h\delta_g = \delta_{gh^{-1}}. Let (z_g)_{g \in G} be any finitely supported sequence of complex numbers, let \xi = \sum_{g \in G}z_g\delta_g, and observe that
\begin{alignedat}{2}
&\sum_{g,h \in G}z_g\overline{z_h}c_{h^{-1}g} = \left\langle\sum_{g \in G}z_g\delta_g,\sum_{g \in G}\left(\sum_{h \in G}\overline{c_{h^{-1}g}}z_h\right)\delta_g\right\rangle = \left\langle\sum_{g \in G}z_g\delta_g,\sum_{g \in G}\left(\sum_{h \in G}c_{g^{-1}h}z_h\right)\delta_g\right\rangle\\
=& \left\langle\sum_{g \in G}z_g\delta_g,\sum_{g \in G}\left(\sum_{h \in G}c_{g^{-1}h}z_hR_{g^{-1}h}\delta_h\right)\right\rangle = \left\langle\sum_{g \in G}z_g\delta_g,\sum_{h \in G}\left(\sum_{g \in G}c_{g^{-1}h}R_{g^{-1}h}\right)z_h\delta_h\right\rangle\\
=& \langle\xi,(P+\epsilon)\xi\rangle \ge 0.
\end{alignedat}
Since \sum_{g \in G}c_g = 1+\epsilon, we see that the desired positive definite sequence (a_g)_{g \in G} is given by a_g = \frac{1}{1+\epsilon}c_g.
Next, we show that (?)\Rightarrow(?). Let \epsilon > 0 be arbitrary, let \epsilon' = \frac{\epsilon}{1+\epsilon}, and observe that for x \in (0,\epsilon') we have \frac
{x}{(1-x)} < \epsilon. Let (a_g)_{g \in G} be a positive definite sequence with a finite support contained in V\cup V^{-1}\cup\{e\} satisfying \sum_{g \in G}a_g = 1 and |a_e| < \epsilon'. Let P = \frac{1}{1-|a_e|}\sum_{g \in V\cup V^{-1}}a_gU_g. Since (a_g)_{g \in G} is positive definite, we see that a_g = \overline{a_{g^{-1}}}, so P = P^*. Since P+\epsilon > P' = \frac{1}{1-|a_e|}\sum_{g \in V\cup V^{-1}\cup\{e\}}a_gU_g, it suffices to show that P' is a positive operator. To this end, we see that f \in L^2(G,\lambda) given by f(g) = a_g is a continuous positive definite function, so using [C(star)AlgebraByDixmier, Theorem 13.8.6] we pick a continuous positive definite function \psi \in L^2(G,\lambda) for which f = \psi*\psi and \psi = \tilde{\psi}, where * denotes convolution and \tilde{F}(g) := \overline{F(g^{-1})}. Letting \Psi = \sum_{g \in G}\psi(g)U_g, we see that \Psi^* = \Psi, and (1-\epsilon')P' = \Psi\Psi = \Psi\Psi^*, so P' is a positive operator.
We now show that (?)\Rightarrow(?). Let \xi_I denote the projection of \xi onto the subspace of \pi(G)-invariant vectors, and let \xi = \xi_I+\xi'. Let \epsilon > 0 be arbitrary, and let P = \sum_{g \in V\cup V^{-1}}c_g\pi_g \in B(V) be such that P+\epsilon is a positive operator. Letting c_{e} = \epsilon and c_g = 0 for g \notin V\cup V^{-1}\cup\{e\}, we see that (c_g)_{g \in G} is a positive definite sequence, so for all g \in G we have |c_g| \le |c_{e}| = \epsilon. We now see that
\begin{alignedat}{2}
&||\xi_I||^2 = \langle P\xi_I,\xi_I\rangle < \langle (P+\epsilon)\xi_I,\xi_I\rangle \le \langle (P+\epsilon)\xi,\xi\rangle = \epsilon||\xi||^2+\sum_{g \in V\cup V^{-1}}c_g\langle \pi_g\xi,\xi\rangle\\
\le & \epsilon||\xi||^2+\sum_{g \in V\cup V^{-1}}|c_g|\cdot\left|\langle \pi_g\xi,\xi\rangle\right| \le \epsilon||\xi||^2+\epsilon\sum_{g \in V\cup V^{-1}}|\langle\pi_g\xi,\xi\rangle|.
\end{alignedat}
Since \epsilon > 0 was arbitrary, we see that ||\xi_I||^2 = 0.
We now show that (?)\rightarrow(?). Let \pi^p be the tensor product of p copies of \pi acting on \otimes_{i = 1}^p\mathcal{H}. We see that \xi^p := \otimes_{i = 1}^p\xi \in \otimes_{i = 1}^p\mathcal{H} satisfies
\sum_{v \in V}|\langle \pi^{p_0}(v)\xi^p,\xi^p\rangle| = \sum_{v \in V}|\langle\pi(v)\xi,\xi\rangle|^p < \infty,
so \xi^p is orthogonal to the space of \pi^p-invariant vectors, hence \xi is orthogonal to the space of \pi-invariant vectors.
It is clear that (?)\rightarrow(?), so we proceed to show that (?)\rightarrow(?). Assume that (?) holds, and suppose that \pi is a unitary representation of G, and \xi\in \mathcal{H}=\mathcal{H}_{\pi} and p\geq 1 are such that \sum_{v\in V}|\langle \pi _v \xi , \xi \rangle |^p<\infty. Let \bar{\pi} be the conjugate representation of \pi on the conjugate Hilbert space \bar{\mathcal{H}} = \{ \bar{\eta} : \eta \in \mathcal{H} \} of \mathcal{H}, i.e., scalar multiplication in \bar{H} is defined by c\bar{\eta}= \overline{\bar{c}\eta}, the inner product is given by \langle \bar{\eta}_0,\bar{\eta}_1\rangle =\langle \eta _1 , \eta _0 \rangle, and \bar{\pi} is defined by \bar{\pi}_g\bar{\eta}= \overline{\pi _g \eta}. Let \mathrm{HS}(\mathcal{H}) be the Hilbert space of all Hilbert-Schmidt operators on \mathcal{H}, and let \sigma be the unitary representation on \mathrm{HS}(\mathcal{H}) given by \sigma _g(T) := \pi _gT\pi _g ^{-1} for T\in \mathrm{HS}(\mathcal{H}) and g\in G. Then the representations \pi\otimes \bar{\pi} and \sigma are isomorphic via the map \mathcal{H}\otimes \bar{\mathcal{H}} \to \mathrm{HS}(\mathcal{H}), \zeta\mapsto \tau_{\zeta}, determined by \langle \tau_{\zeta} \eta _0, \eta _1 \rangle := \langle \zeta , \eta _1\otimes \bar{\eta} _0\rangle, for \zeta\in \mathcal{H}\otimes\bar{\mathcal{H}} and \eta _0, \eta _1 \in \mathcal{H}. We have
\sum _{v\in V}|\langle \sigma _v(\tau_{\xi\otimes \bar{\xi}}), \tau_{\xi\otimes \bar{\xi}}\rangle |^p = \sum _{v\in V}|\langle (\pi _v \xi ) \otimes \overline{(\pi _v \xi )}, \xi\otimes \bar{\xi} \rangle | ^p = \sum _{v\in V}|\langle \pi _v \xi , \xi \rangle | ^{2p} < \infty ,
so the assumption that (?) holds lets us deduce that \tau_{\xi\otimes \bar{\xi}} is orthogonal in \mathrm{HS}(\mathcal{H}) to the subspace of all \sigma-invariant vectors. In particular, given a finite dimensional \pi-invariant subspace \mathcal{K} of \mathcal{H}, it follows that \tau_{\xi\otimes \bar{\xi}} is orthogonal to the orthogonal projection P_{\mathcal{K}} to \mathcal{K}. Taking an orthonormal basis B_{\mathcal{K}} for \mathcal{K} and extending it to an orthonormal basis B for \mathcal{H}, we compute
0=\langle \tau_{\xi\otimes \bar{\xi}} , P_{\mathcal{K}}\rangle = \sum _{e,f\in B}\langle \tau_{\xi\otimes \bar{\xi}}e,f\rangle \overline{\langle P_{\mathcal{K}}e,f\rangle} = \sum _{e\in B_{\mathcal{K}}}\langle \tau_{\xi\otimes \bar{\xi}}e, e\rangle = \sum _{e\in B_{\mathcal{K}}}|\langle \xi , e \rangle | ^2 = \| P_{\mathcal{K}}(\xi ) \| ^2,
which shows that \xi is orthogonal to \mathcal{K}.
It is clear that (?)\rightarrow(?), so let us now show that (?)\rightarrow(?). Let (v_n)_{n = 1}^\infty be an enumeration of the elements of V, and for n \in \mathbb{N} let F_n = (v_m)_{m = 1}^n. Let (H_n)_{n = 1}^\infty be an exhaustion of G by finite sets. Let us assume for the sake of contradiction that there exists \epsilon > 0 such that for all n \in \mathbb{N} there exists a unitary representation \pi_n of G on a Hilbert space \mathcal{H}_n and a unit vector \xi_n \in \mathcal{H}_n for which \sup_{v \in F_n}|\pi_n(v)\xi_n,\xi_n\rangle| < \delta and |\langle\xi_n,\eta_n\rangle| \ge \epsilon for some (\pi_n(H_n),\frac{1}{n})-invariant unit vector \eta_n \in \mathcal{H}_n. Let p \in \beta\mathbb{N}^* be a nonprincipal ultrafilter and let \mathcal{H} := \prod_p\mathcal{H}_n denote the ultraproduct of (\mathcal{H}_n)_{n = 1}^\infty with respect to p. Let \xi,\eta \in \mathcal{H} be the unit vectors corresponding to the equivalence classes of (\xi_n)_{n = 1}^\infty and (\eta_n)_{n = 1}^\infty respectively, and let \pi be the unitary representation of G on \mathcal{H} given by \pi(g)(x_n)_{n = 1}^\infty = (\pi_n(g)x_n)_{n = 1}^\infty. We see that for g \in G we have
\langle\pi(g)\eta,\eta\rangle_{\mathcal{H}} = p-\lim_{n\rightarrow\infty}\langle\pi_n(g)\eta_n,\eta_n\rangle_{\mathcal{H}_n} = 1,
so \eta is a \pi(G)-invariant vector. We also see that for v \in V we have
\langle\pi(v)\xi,\xi\rangle_{\mathcal{H}} = p-\lim_{n\rightarrow\infty}\langle\pi_n(v)\xi_n,\xi_n\rangle_{\mathcal{H}_n} = 0,
so the desired contradiction now follows from the observation that
|\langle\xi,\eta\rangle_{\mathcal{H}}| = p-\lim_{n\rightarrow\infty}|\langle\xi_n,\eta_n\rangle_{\mathcal{H}_n}| \ge \epsilon.
Now we show that (?) is equivalent to (?) and that (?) is equivalent to (?). Let P_I:\mathcal{H}\rightarrow\mathcal{H} denote the orthogonal projection onto the space of \pi-invariant vectors. To this end, we recall that a function \phi:G\rightarrow\mathbb{C} is positive definite if and only if there exists a unitary representation \pi of G on a Hilbert space \mathcal{H} and a cyclic vector \xi such that \phi(g) = \langle \pi(g)\xi,\xi\rangle. The desired result follows from the observation that M(\phi) = 0 if and only if ||P_I\xi|| = 0, and M(|\phi|) = 0 if and only if \pi has no finite dimensional subrepresentations (see Section ?).
It is clear that (?)\rightarrow(?)\rightarrow(?), so we proceed to show that (?)\rightarrow(?). Since \phi(g) = \langle \pi(g)\xi,\xi\rangle is a positive definite sequence, we use Theorem 2.8 to construct an ergodic m.p.s. (X,\mathscr{B},\mu,(\tau_g)_{g \in G}) and a f \in L^2(X,\mu) for which \phi(g) = \langle \tau_gf,f\rangle. We observe that \left(\int_Xfd\mu\right)^2 = M(\phi) = ||P_I\xi||^2. Since 0 = \langle \pi(v)\xi,\xi\rangle = \langle \tau_vf,f\rangle for all v \in V, we see that 0 = \int_Xfd\mu = ||P_I\xi||.