For a given \gamma>0, by the definition of \overline h(M\times \Omega|\Omega), we have that there exist \omega_0\in\Omega and \epsilon_0>0 such that for any 0<\epsilon<\epsilon_0, there exist infinitely many n\in \mathbb N and corresponding 5\epsilon-separated set in M_{\omega_0} with respect to the Bowen metric d_{M\times \Omega,n}^{\phi}, whose cardinality is greater than e^{n(\overline h(M\times\Omega|\Omega)-\frac13\gamma)}.
Firstly, we fix an such \epsilon as above. Without loss of generality, we assume that \epsilon<\frac12\beta_0, where \beta_0 is as in Lemma 3.4. Letting \beta=\frac13\epsilon and applying Lemma 3.4, we have that there exists \alpha>0 corresponding to \beta, which is taken to be smaller than \beta. Then we fix a \delta such that \delta<\frac12\epsilon and
d_M(\pi_M\phi(x,\omega_1),\pi_M\phi(x,\omega_2))<\frac16 \alpha,\ \forall x\in M\text{ and }d_\Omega(\omega_1,\omega_2)<\delta.
Let \{U_0,U_1,\cdot,U_p\} be a collection of \frac13\alpha-balls in M such that M=\cup_{i=1}^pU_i. By Condition H2), there exists N_1\in \mathbb N such that the following holds
\pi_M\phi^n(U_i,\omega)\cap U_j\neq \emptyset,\ \forall i,j\in \{0,1,\cdots,p\},\ n\ge N_1.
Now we fix an N_2>> N_1 such that there exists a 5\epsilon-separated set in M_{\omega_0} with respect to the Bowen metric d_{M\times \Omega,N_2}^{\phi}, whose cardinality is greater than e^{N_2(\overline h(M\times\Omega|\Omega)-\frac13\gamma)}. By the continuity of \phi, one can easily obtain the following technical lemma:
Lem. There exist a nonempty open subset O\subset \Omega and k points y_i:\in M,1\le i\le k with
k\ge e^{n(\overline h(M\times\Omega|\Omega)-\frac13\gamma)}
such that for any \omega\in O, \{(y_i,\omega)\}_{1\le i\le k} is a 3\epsilon-separated set with respect to d^{\phi}_{M\times \Omega,N_2}.
Actually, O can be taken to be a small open neighborhood of \omega_0. For the sake of convenience and without loss of generality, we assume that the following hold:
a1) O is in a \frac12\delta-ball with respect to d^{\theta}_{\Omega,N_2}, where \delta is as in (?);
a2) \frac{\log k}{N_2}> \overline h(M\times \Omega|\Omega)-\frac23\gamma;
a3) \{y_i\}_{1\le i\le k}\subset U_0 (Note that M is compact).
Let N=N_2+N_1. Note that both \Omega_1:=\bigcup_{i\in\mathbb Z}\theta^{iN}(O) and \Omega_2:=\Omega\setminus \Omega_1 are \theta^N-invariant sets since \theta is invertible. Clearly, \Omega_1 and \Omega_2 are both measurable ( actually \Omega_1 is open and \Omega_2 is closed). We will deal with \Omega_1 and \Omega_2 separately.
Following exactly the same procedure as the proof of Lemma 5.2, we can construct a finite Borel measurable partition of \Omega, which is denoted by \xi:=\{\Omega'_t, t\in T\}, Borel measurable simple functions \{g^{0,0},g^{i,0},\ 1\le i\le p\}, and a finite set \{\omega_t\in \Omega'_t,t\in T\} satisfying the following properties:
b1) For any \omega,\omega' fall in an element of \xi, the following holds
d_\Omega(\theta^{ n}\omega,\theta^{ n}\omega')<\delta,\ \forall 0\le n\le N-1,
where \delta satisfies (?);
b2) For 1\le i\le p, g^{i,0}=\sum_{t\in T}g^{i,0}_t\chi_{\Omega'_t}, where
g^{i,0}_t\in U_i\text{ and }\pi_M\phi^{N_1}(g^{i,0}_t,\omega_t)\in U_0;
b3) g^{0,0}=\sum_{t\in T}g^{0,0}_t\chi_{\Omega'_t}, where
g^{0,0}_t\in U_0\text{ and } \pi_M\phi^{N}(g^{0,0}_t,\omega_t)\in U_0 \text{ for some }\omega_t\in \Omega'_t.
For each i\in[1,k]\cap \mathbb N, there exists a finite Borel partition of O, which is denoted by \eta_i:=\left\{O^i_q|q\in\{0,1,\cdots, p\}\right\}, such that the following holds:
Now, we are ready to construct the full random horseshoe by constructing proper pseudo orbits.
Step 1. For each \omega\in \Omega_1=\bigcup_{i\in\mathbb Z}\theta^{iN}(O), we first collect all the hitting time of orbit \{\theta^{iN}\omega\}_{i\in\mathbb Z} with set O, which is denoted by \{n_i(\omega)\}_{i\in I(\omega)}\subset \mathbb Z\cup\{\pm \infty\}. We arrange I(\omega) and n_i(\omega) in the following way:
Case (1.1). n_i(\omega) has the same sign as i, and for any i,j\in I (\omega),
i< j\text{ if and only if }n_i(\omega)< n_j(\omega) ;
Case (1.2). For the positive part of I(\omega), if \{\theta^{iN}\omega\}_{i\in\mathbb N} hits O infinitely many times, let
I(\omega)\cap \mathbb N=\mathbb N;
otherwise, let
I(\omega)\cap \mathbb N=\{1,2,\cdots, m^+(\omega)\}\text{ and }n_{m^+(\omega)+1}=+\infty,
where m^+(\omega) is the number of times \{\theta^{iN}\omega\}_{i\in\mathbb N} hits O;
Case (1.3). Similarly, for the negative part of I(\omega), if \{\theta^{-iN}\omega\}_{i\in\mathbb N} hits O infinitely many times, let
I(\omega)\cap -\mathbb N=-\mathbb N;
otherwise, let
I(\omega)\cap -\mathbb N=\{-1,-2,\cdots, -m^-(\omega)\}\text{ and }n_{m^-(\omega)-1}=-\infty,
where m^-(\omega) is the number of how many times \{\theta^{-iN}\omega\}_{i\in\mathbb N} hitting O;
Case (1.4). If \omega\in \theta^{-N_1}O, put 0 in I(\omega) and let n_0(\omega)=0; otherwise, 0\notin I(\omega).
We remark here that I(\omega) is always non-empty for \omega\in \Omega_1, however, each of I(\omega)\cap \mathbb N, I(\omega)\cap \{0\}, and I(\omega)\cap -\mathbb N could be an empty set.
Step 2. For a given \omega\in\Omega_1 and \hat a=(a_n)\in \mathcal S^k, we define a pseudo orbit as in the following:
Case 1. For n=n_i(\omega), i\in I(\omega), suppose that
\theta^{nN}\omega\in O^{a_n}_q \text{ and } \theta^{nN+N_2}\omega\in \Omega'_{t_1},
then define
y'_{\hat a,\omega}(nN+j)=
\begin{cases}
\pi_M\phi^{j}(y_{a_n},\theta^{nN}\omega),&0\le j\le N_2-1\\
\pi_M\phi^{j-N_2}(g^{q,0}(\theta^{nN+N_2}\omega),\omega_{t_1}),&N_2\le j\le N-1\\
\end{cases}.
Case 2. For n\notin\{n_i(\omega)\}_{i\in I(\omega)}, suppose that \theta^{nN}\omega\in \Omega'_{t_2}, then define
y'_{\hat a,\omega}(nN+j)=\pi_M\phi^j(g^{0,0}(\theta^{nN}\omega),\omega_{t_2}),\ 0\le j\le N-1.
For Case 1., note that \{(y'_{\hat a,\omega}(nN+j),\theta^{nN+j}\omega\}_{0\le j\le N_2-1} is a true orbit, and \theta^{nN}\in O^{a_n}_q, therefore
\pi_M\phi(y'_{\hat a,\omega}(nN+N_2-1),\theta^{nN+N_2-1}\omega),\ y'_{\hat a,\omega}(nN+N_2)\in U_q,
thus
d_M\left(\pi_M\phi(y'_{\hat a,\omega}(nN+N_2-1),\theta^{nN+N_2-1}\omega),\ y'_{\hat a,\omega}(nN+N_2)\right)\le \frac23\alpha.
By b1) and (?), we have that for N_2\le j\le N-1,
\begin{aligned}
&d_M\left(\pi_M\phi\left( y'_{\hat a,\omega}(nN+j),\theta^{nN+j}\omega\right), y'_{\hat a,\omega}(nN+j+1)\right)\\
=&d_M\left(\pi_M\phi\left(\pi_M\phi^j(g^{q,0}(\theta^{nN+N_2}\omega),\omega_{t_1}),\theta^{nN+N_2+j}\omega\right), \pi_M\phi^{j+1}(g^{q,0}(\theta^{nN+N_2}\omega),\omega_{t_1})\right)\\
\le &\frac16\alpha,
\end{aligned}
which implies that \{(y'_{\hat a,\omega}(nN+j),\theta^{nN+j}\omega\}_{N_2\le j\le N-1} is a segment of an (\omega,\frac16\alpha)-pseudo orbit. Hence \{(y'_{\hat a,\omega}(nN+j),\theta^{nN_j}\omega\}_{0\le j\le N-1} is a segment of an (\omega,\frac23\alpha)-pseudo orbit with length N.
For Case 2., by b3), (?), and using the same argument as for N_2\le j\le N-1 in Case 1., we have that \{(y'_{\hat a,\omega}(nN+j),\theta^{nN_j}\omega\}_{0\le j\le N-1} is a segment of an (\omega,\frac16\alpha)-pseudo orbit with length N.
Also note that, all the segments of (\omega,\alpha)-pseudo orbit defined in both Case 1. and Case 2. start and end in U_0 which has diameter \frac23\alpha. Hence, the pseudo orbit \{(y'_{\hat a,\omega}(j),\theta^{j}\omega\}_{j\in \mathbb Z} is an (\omega,\frac23\alpha)-pseudo orbit.
It is clear that \{(y'_{\hat a,\omega}(j),\theta^{j}\omega\}_{j\in \mathbb Z},\ \omega\in\Omega induces an \alpha-pseudo orbit of \tilde\phi by letting
g'_{\hat a,j}(\omega)=y'_{\hat a,\omega}(j),\ j\in \mathbb Z,\ \omega\in\Omega_1.
The Borel measurability of each g'_{\hat a,j} follows from (?) and (?) immediately, since each g'_{\hat a,j} is either a simple function or an image of a simple function under iterations of \phi or \phi^{-1}. Therefore, by applying Theorem 3.7 for \tilde\phi|_{L^\infty(\Omega_1)}, we have that there exists a unique true orbit of \tilde\phi|_{L^\infty(\Omega_1)}, \{(\tilde\phi|_{L^\infty(\Omega_1)})^n(g_{\hat a})\}_{n\in\mathbb Z}, which is \beta-shadowing \{g'_{\hat a,j}\}_{j\in \mathbb Z}.
Now we define the desired horseshoe map by the letting
\Psi(\hat a)|_{\Omega_1}=g_{\hat a},\ \forall \hat a\in \mathcal S_k.
The continuity of \Psi|_{\Omega_1} follows from Lemma 3.6 straightforwardly. The next, we prove that Condition i) of Definition 2.5 for \Psi|_{\Omega_1} holds.
For \hat a'\neq\hat a'' (\in \mathcal S_k), let s=\min\left\{|n|\big |\ a'_n\neq a''_n\right\} and r be such that |r|=s and a'_r\neq a''_r . By the choice of O,y_i,U_i,\epsilon,\alpha,\beta at the beginning of this section, we have that
d^\phi_{M\times \Omega,N_1}\left(\phi^{rN}(\Psi(\hat a_1)(\omega),\omega),\phi^{rN}(\Psi(\hat a_2)(\omega),\omega)\right)>\epsilon,\ \forall \omega\in \theta^{-rN}(O),
where d^\phi_{M\times \Omega,N_1} is the Bowen metric. Note that there is a constant L>1 such that for any \omega\in\Omega and x,y\in M with d(x,y)>0, we have
d(\phi^{\pm1}(x,\omega),\phi^{\pm1}(y,\omega))\le Ld_M(x,y).
Therefore, for any \omega from the non-empty open set \theta^{-rN}(O), the following holds,
\begin{aligned}
& d_M\left(\pi_M\phi^{rN}\left(\Psi(\hat a_1)(\omega),\omega\right),\pi_M\phi^{rN}\left(\Psi(\hat a_2)(\omega),\omega\right)\right)\\
=&d\left(\phi^{rN}\left(\Psi(\hat a_1)(\omega),\omega\right),\phi^{rN}\left(\Psi(\hat a_2)(\omega),\omega\right)\right)\\
\ge& L^{-N_1}d^\phi_{M\times \Omega,N_1}\left(\phi^{rN}(\Psi(\hat a_1)(\omega),\omega),\phi^{rN}(\Psi(\hat a_2)(\omega),\omega)\right)\\
>& \epsilon L^{-N},
\end{aligned}
which implies Condition i) of Definition 2.5 by taking \Delta= \epsilon L^{-N}. The continuity of \Psi^{-1} follows from the same argument as (?).
Final Step. To complete the proof, we need to address the following issues:
Firstly, Condition ii) in Definition 2.5 for \Psi|_{\Omega_1} simply follows from the uniqueness of g_{\hat a} and the same argument used in the proof of Lemma 5.2.
Secondly, we need to extend the definition of g_{\hat a} properly to the whole \Omega. This can be done by Theorem 2.1. Since \Omega_1 and \Omega_2=\Omega\setminus \Omega_2 are both \theta^N-invariant, we can view \Omega_2 independently, and give up to capture entropy from the system \phi^N|_{\Omega_2} (as the entropy captured from \phi^N|_{\Omega_1} is already enough). Theorem 2.1 implies that for large N, there exists a Borel function g:\Omega_2\to M such that
\phi^N|_{\Omega_2}(graph(g))=graph(g).
We simply extend g_{\hat a} to \tilde g_{\hat a} by letting
\tilde g_{\hat a}|_{\Omega_1}=g_{\hat a}\text{ and }\tilde g_{\hat a}|_{\Omega_2}=g.
It is not hard to see that such an extension is harmless for Conditions i) and ii) of Definition 2.5. So the map \Psi:\mathcal S_k\to L^\infty which takes \hat a to \tilde g_{\hat a} gives a full random horseshoe.
Finally, as we required at the beginning of this section that N_2>>N_1, a2) yields
\frac{\log k}N=\frac{\log k}{N_2+2N_1}>\frac{\log k}{N_2}-\frac13\gamma>\overline h(M\times\Omega|\Omega)-\gamma.
This completes the proof of theorem.