arXiv reader

A two-step inertial method with a new step-size rule for variational inequalities in hilbert spaces

Jian-Wen Peng, Jun-Jie Luo and Abubakar Adamu

arXiv
2601.10370v1 · PDF · 15 January 2026
Categories
math.OC
Licence
CC BY 4.0 The site shows the text.

Abstract

In this paper, a two-step inertial Tseng extragradient method involving self-adaptive and Armijo-like step sizes is introduced for solving variational inequalities with a quasimonotone cost function in the setting of a real Hilbert space. Weak convergence of the sequence generated by the proposed algorithm is proved without assuming the Lipschitz condition. An interesting feature of the proposed algorithm is its ability to select the better step size between the self-adaptive and Armijo-like options at each iteration step. Moreover, removing the requirement for the Lipschitz condition on the cost function broadens the applicability of the proposed method. Finally, the algorithm accelerates and complements several existing iterative algorithms for solving variational inequalities in Hilbert spaces.

Items 18

Remark

Remark 1.1

S0NZ

It is well-known that one of the drawbacks of the EGM arises from its requirement to perform two projections onto the closed convex set during each iteration. This requirement can be computationally expensive especially when the structure of C is not simple. Another drawback of this method is the fact that parameter \lambda depends on the explicit value of the Lipschitz constant L which is can be challenging to obtain.

Remark

Remark 1.2

M3PQ

It is important to note that all the improvements of the EGM and their accelerated versions mentioned above have not fully addressed Remark 1.1. They are yet to dispense with the dependency of the step-size on the explicit value of the Lipschitz constant.

Definition

Definition 2.1

RQ6F

Let H be a real Hilbert space. An operator A: H \rightarrow H is said to be:
(i) Lipschitz continuous on H, if there exist a constant L > 0 such that

||Ax-Ay||\leq L||x-y||, \forall x,y \in H.

(ii) uniformly continuous, if for every \epsilon > 0, there exists \delta = \delta(\epsilon)> 0, such that

||Ax-Ay||< \epsilon ,\text{ whenever} ~~||x-y||< \delta,\text{ } \forall x,y \in H;

(iii) sequentially weakly-strongly continuous, if for each sequence {x_k}, we have x_k\rightharpoonup x \in H implies that Ax_k \rightarrow Ax \in H;
(iv) sequentially weakly continuous, if for each sequence {x_n},we have x_n\rightharpoonup x \in H implies that Ax_k \rightarrow Ax \in H ;
(v) monotone, if \langle Ax-Ay,x-y \rangle \geq 0, \forall x,y \in H ;
(vi) \alpha-strongly pseudomonotone, if there exists \alpha > 0 such that

\langle Ax,y-x \rangle \geq 0 \Rightarrow \langle Ay,y-x \rangle \geq \alpha||x-y||^2,\text{ } \forall x,y \in H;

(vii) pseudomonotone, if

\langle Ax,y-x \rangle \geq 0 \Rightarrow \langle Ay,y-x \rangle \geq 0,\text{ } \forall x,y \in H;

(viii) quasimonotone, if

\langle Ax,y-x \rangle > 0 \Rightarrow \langle Ay,y-x \rangle \geq 0,\text{ } \forall x,y \in H;
Lemma

Lemma 2.2

ER0M

Let x,y,z\in H and a,b\in\mathbb{R}. Then

\begin{split} ||(1+a)x-(a-b)y-bz||^2 =&(1+a)||x||^2-(a-b)||y||^2-b||z||^2\\ & +(1+a)(a-b)||x-y||\\ & +b(1+a)||x-z||^2-b(a-b)||y-z||^2 .\\ \end{split}
Used by Proof
Lemma

Lemma 2.3

8IQY

Let C be a nonempty closed subset of a real Hilbert space H. \forall v\in H and \forall z\in C, we have

z = P_{C}v \Leftrightarrow \langle v-z,z-y\rangle\geq0, \forall y \in C.
Used by Proof
Lemma

Lemma 2.4

BL4H

The following identities hold for all u,v\in H :

2\langle u,v \rangle =\|u\|^2+\|v\|^2-\|u-v\|^2=\|u+v\|^2-\|u\|^2-\|v\|^2.
Used by Proof
Lemma

Lemma 2.5

9RHM

([lema60]) Suppose either
(a) A is pseudomonotone on C and S\neq\emptyset;
(b) A is the gradient of G, where G is a differential quasiconvex function on an open set K\supset C and attains its global minimum on C;
(c) A is quasimonotone on C, A\neq 0 on C and C is bounded;
(d) A is quasimonotone on C, A\neq 0 on C and there exists a positive number r such that, for every x\in C with ||x|| \geq r, there exists y \in C such that ||y|| \leq r and \langle Ax,y-x\rangle \leq 0;
(e) A is quasimonotone on C, int C \neq \emptyset and there exists x^* \in S such that Ax^*\neq 0,

Lemma

Lemma 2.6

SBZL

([lema16]) Let H be a Hilbert space and A : H \rightarrow H be a uniformly continuous operator. Suppose x\in H and \psi \geq \sigma > 0. The following inequality holds:

\frac{\|x-P_C(x-\psi Ax)\|}{\psi}\leq\frac{\|x-P_C(x-\sigma Ax)\|}{\sigma} .
Assumption

Assumption 1

9NDF

(i) S_{D}\neq \emptyset;
(ii) A is Lipschitz continuous on H;
(iii) A satisfies the following condition: whenever {x_{k}}\subset C and x_{k}\rightharpoonup v^{*}, one has \left\| {A{v^*}} \right\| \le \lim \mathop {\inf }\limits_{n \to \infty } \left\| {A{x_k}} \right\|;
(iv) A is quasimonotone on H;
(v) The set \{v\in C: Av = 0\} \backslash S_{D} is a finite set.

Uses Definition 2.1 · Used by Lemma 4.3
Assumption

Assumption 2

9IE3

Assume that \alpha, \beta and \mu meet the following conditions:
(a) 0\leq \alpha \leq \frac{1-\mu}{3+\mu};
(b) max\{2\alpha (\frac{1-\mu}{3+\mu})-(1-\alpha),\frac{1}{2}[\alpha(1+\mu)-(\frac{(1-\mu)(1-\alpha)^2}{1+\alpha})]\}<\beta\leq0;
(c) 2\alpha^2\mu-(1-3\alpha)+\mu(1-\alpha)-\beta(4\alpha+3-\mu)+2\mu\beta^2<0.

Used by Proof, Lemma 4.3
Lemma

Lemma 4.1

90JZ

Under the (i)–(iv) of Assumption 1, the sequence {\lambda_{k}} generated Algorithm ? satisfying

\min\{\frac{l\mu}{L},\lambda_{0}\}\leq\lambda_{k}\leq\lambda_{0}.
Proof of Lemma 4.1

Firstly, it is obvious that {\lambda^{(1)}_{k}} is a monotonically decreasing sequence. Since A is a Lipschitz continuous mapping with constant L>0, in the case of Aw_k-Ay_k\neq0, we have

\frac{{\mu \left\| {{w_k} - {y_k}} \right\|}}{{||A{w_k} - A{y_k}||}} \ge \frac{\mu }{L}\frac{{\left\| {{w_k} - {y_k}} \right\|}}{{\left\| {{w_k} - {y_k}} \right\|}} = \frac{\mu }{L}
Lemma

Lemma 4.2

UQ5M

Suppose Assumption 3.1 (i) and (ii) and Assumption 3.2 hold. Then, the sequence \{x_{k}\} generated by Algorithm ? is bounded.

Used by Proof, Proof
Proof of Lemma 4.2

Let q\in S_{D}. First of all, we estimate ||x_{k+1}-q||^2. It can be obtained from the definition of x_{k+1} that:

\begin{aligned} ||x_{k+1}-q||^2 =&||y_{k}-\lambda_{k}(Ay_{k}-Aw_{k})-q||^2 \\ =&||y_{k}-q||^2 +\lambda_{k}^2||Ay_{k}-Aw_{k}||^2-2\lambda_{k}\langle Ay_{k}-Aw_{k},y_{k}-q\rangle \\ =&||w_{k}-q||^2+||w_{k}-y_{k}||^2+2\langle y_{k}-w_{k},w_{k}-q\rangle+\lambda_{k}^2||Ay_{k}-Aw_{k}||^2 \\ &-2\lambda_{k}\langle Ay_{k}-Aw_{k},y_{k}-q\rangle \\ =&||w_{k}-q||^2+||w_{k}-y_{k}||^2-2\langle y_{k}-w_{k},y_{k}-w_{k}\rangle+ 2\langle y_{k}-w_{k},y_{k}-q\rangle \\ &+\lambda_{k}^2||Ay_{k}-Aw_{k}||^2-2\lambda_{k}\langle Ay_{k}-Aw_{k},y_{k}-q\rangle \\ =&||w_{k}-q||^2-||w_{k}-y_{k}||^2+2\langle y_{k}-w_{k},y_{k}-q\rangle+\lambda_{k}^2||Ay_{k}-Aw_{k}||^2 \\ &-2\lambda_{k}\langle Ay_{k}-Aw_{k},y_{k}-q\rangle. \end{aligned}

From the definition of y_{k}, and the fact that S_{D}\subset C,

it can be obtained by Lemma 2.3 that:

\langle w_{k}-\lambda_{k}Aw_{k}-y_{k},y_{k}-q\rangle\geq0,

that is

\langle y_k-w_k,y_k-q\rangle\leq-\lambda_k\langle Aw_k,y_k-q\rangle.

Appling (?) to (Proof), we will have

\begin{aligned} ||x_{k+1}-q||^2 \leq & ||w_{k}-q||^2-||w_{k}-y_{k}||^2-2\lambda_{k}\langle Aw_{k},y_{k}-q\rangle \\ &+\lambda_{k}^2||Ay_{k}-Aw_{k}||^2-2\lambda_{k}\langle Ay_{k}-Aw_{k},y_{k}-q\rangle \\ =&||w_{k}-q||^2-||w_{k}-y_{k}||^2+\lambda_{k}^2||Ay_{k}-Aw_{k}||^2 \\ &-2\lambda_{k}\langle Ay_{k},y_{k}-q \rangle. \end{aligned}

Since q\in S_{D}, \lambda_{k}>0 and y_{k}\in C, we have that

\lambda_{k}\langle Ay_{k},y_{k}-q \rangle \geq0.

Therefore, from (?) we can have

||x_{k+1}-q||^2 \leq ||w_{k}-q||^2-||w_{k}-y_{k}||^2+\lambda_{k}^2||Ay_{k}-Aw_{k}||^2.

From the definition of \lambda_{k}, if {Aw_{k}-Ay_{k}}\neq0, then we have

\lambda_{k}^{(1)} = \min\{\frac{\mu||w_{k}-y_{k}||}{||Aw_{k}-Ay_{k}||},\lambda_{k-1}\}

which means:

\lambda_{k}^{(1)} \leq\frac{\mu||w_{k}-y_{k}||}{||{Aw_{k}-Ay_{k}}||},
\lambda_{k}^{(1)}||{Aw_{k}-Ay_{k}}||\leq\mu||w_{k}-y_{k}||.

Also, we have \lambda_{k}^{(2)}\left\|A w_{k}-A y_{k}\right\| \leq \mu\left\|w_{k}-y_{k}\right\|. Therefore,

\lambda_{k}\left\|A w_{k}-A y_{k}\right\| \leq \mu\left\|w_{k}-y_{k}\right\|.

Substituting (?) into (?), we have

\begin{aligned} ||x_{k+1}-q||^2 \leq&||w_{k}-q||^2-||w_{k}-y_{k}||^2+\mu^2||w_{k}-y_{k}||^2 \\ =& ||w_{k}-q||^2-(1-\mu^2)||w_{k}-y_{k}||^2. \end{aligned}

Observe that

\begin{aligned} ||x_{k+1}-y_{k}||=&||y_{k}-\lambda_{k}(Ay_{k}-Aw_{k})-y_{k}|| \\ = & \lambda_{k}||Ay_{k}-Aw_{k}|| \\ \leq & \mu||w_{k}-y_{k}||, \end{aligned}

and

\begin{aligned} ||x_{k+1}-w_{k}||\leq &||x_{k+1}-y_{k}||+||w_{k}-y_{k}|| \\ \leq & \mu||w_{k}-y_{k}||+||w_{k}-y_{k}|| \\ = & (1+\mu)||w_{k}-y_{k}||. \end{aligned}

Hence, using (?) into (?), we obtain that

-||w_{k}-y_{k}||^2\leq-\frac{1}{(1+\mu)^2}||x_{k+1}-w_{k}||^2.

Applying (?) into (?), we have

||x_{k+1}-q||^2 \leq ||w_{k}-q||^2 - (\frac{1-\mu}{1+\mu})||x_{k+1}-w_{k}||^2.

Also,

\begin{aligned} w_{k}-q = & x_{k}+\alpha(x_{k}-x_{k-1})+\beta(x_{k-1}-x_{k-2})-q\\ = & (1+\alpha)(x_{k}-q)-(\alpha-\beta)(x_{k-1}-q)-\beta(x_{k-2}-q). \end{aligned}

Using Lemma 2.2, we get

\begin{aligned} ||w_{k}-q||^2 =& ||(1+\alpha)(x_{k}-q)-(\alpha-\beta)(x_{k-1}-q)-\beta(x_{k-2}-q)||^2 \\ = & (1+\alpha)||x_{k}-q||^2-(\alpha-\beta)||x_{k-1}-q||^2-\beta||x_{k-2}-q||^2 \\ & +(1+\alpha)(\alpha-\beta)||x_{k}-x_{k-1}||^2+\beta(1+\alpha)||x_{k}-x_{k-2}|| \\ & -\beta(\alpha-\beta)||x_{k-1}-x_{k-2}||^2. \end{aligned}

Furthermore, it can be obtained that

\begin{aligned} ||x_{k+1}-w_{k}||^{2}=&\|x_{k+1}-[x_k+\alpha(x_k-x_{k-1})+\beta(x_{k-1}-x_{k-2})]\|^2 \\ =&\|x_{k+1}-x_{k}-\alpha(x_{k}-x_{k-1})-\beta(x_{k-1}-x_{k-2})\|^{2}\\ =&\|x_{k+1}-x_{k}\|^{2}-2\alpha\langle x_{k+1}-x_{k},x_{k}-x_{k-1}\rangle-2\beta\langle x_{k+1}-x_{k},x_{k-1}-x_{k-2}\rangle \\ &+\alpha^2||x_{k}-x_{k-1}||^2+2\alpha\beta\langle x_{k}-x_{k-1},x_{k-1}-x_{k-2}\rangle+\beta^2||x_{k-1}-x_{k-2}||\\ \geq&\|x_{k+1}-x_{k}\|^{2}-\alpha\|x_{k+1}-x_{k}\|^{2}-\alpha\|x_{k}-x_{k-1}\|^{2}+\alpha^{2}\|x_{k}-x_{k-1}\| \\ &-|\beta|\alpha\|x_{k}-x_{k-1}\|^2-|\beta|\alpha\|x_{k-1}-x_{k-2}\|^{2}+\beta^{2}\|x_{k-1}-x_{k-2}\|^{2} \\ &-|\beta|\|x_{k+1}-x_k\|^2-|\beta|\|x_{k-1}-x_{k-2}\|^2 \\ =&(1-|\beta|-\alpha)\|x_{k+1}-x_{k}\|^{2}+(\alpha^{2}-\alpha-|\beta|\alpha)\|x_{k}-x_{k-1}\|^{2} \\ &+(\beta^{2}-|\beta|-|\beta|\alpha)\|x_{k-1}-x_{k-2}\|^{2}. \end{aligned}

Applying (?) and (?) with (?) and note that \beta <0 we have

\begin{aligned} ||x_{k+1}-q||^{2}\leq&(1+\alpha)\|x_{k}-q\|^{2}-(\alpha-\beta)\|x_{k-1}-q\|^{2}-\beta\|x_{k-2}-q\|^{2}\\ &+(1+\alpha)(\alpha-\beta)\|x_k-x_{k-1}\|^2+\beta(1+\alpha)\|x_k-x_{k-2}\|^2\\ &-\beta(\alpha-\beta)\|x_{k-1}-x_{k-2}\|^2-\Big(\frac{1-\mu}{1+\mu}\Big)(1-|\beta|-\alpha)\|x_{k+1}-x_k\|^2\\ &-\Big(\frac{1-\mu}{1+\mu}\Big)(\alpha^2-\alpha-|\beta|\alpha)\|x_k-x_{k-1}\|^2\\ &-\Big(\frac{1-\mu}{1+\mu}\Big)(\beta^2-|\beta|-|\beta|\alpha)\|x_{k-1}-x_{k-2}\|^2\\ \leq &(1+\alpha)\|x_k-q\|^2-(\alpha-\beta)\|x_{k-1}-q\|^2-\beta\|x_{k-2}-q\|^2+\Big[(1+\alpha)(\alpha-\beta)\\ &-\Big(\frac{1-\mu}{1+\mu}\Big)(\alpha^2-\alpha+\beta\alpha)\Big]\|x_k-x_{k-1}\|^2\\ &-[\beta(\alpha-\beta)+\Big(\frac{1-\mu}{1+\mu}\Big)(\beta^2+\beta+\beta\alpha)]\|x_{k-1}-x_{k-2}\|^2\\ &-\Big(\frac{1-\mu}{1+\mu}\Big)(1+\beta-\alpha)\|x_{k+1}-x_k\|^2. \end{aligned}

By rearranging the inequality above we obtain that:

\begin{aligned} &\|x_{k+1}-q\|^{2}-\alpha\|x_{k}-q\|^{2}-\beta\|x_{k-1}-q\|^{2}+\Big(\frac{1-\mu}{1+\mu}\Big)(1+\beta-\alpha)\|x_{k+1}-x_{k}\|^{2}\\ &\leq\|x_{k}-q\|^{2}-\alpha\|x_{k-1}-q\|^{2}-\beta\|x_{k-2}-q\|^{2}+\Big(\frac{1-\mu}{1+\mu}\Big)(1+\beta-\alpha)\|x_{k}-x_{k-1}\|^{2}\\ &+[(1+\alpha)(\alpha-\beta)-\big(\frac{1-\mu}{1+\mu}\big)(\alpha^2-2\alpha+\beta\alpha+\beta+1)\big]\|x_k-x_{k-1}\|^2\\ &-[\beta(\alpha-\beta)+\left(\frac{1-\mu}{1+\mu}\right)(\beta^2+\beta+\beta\alpha)]\|x_{k-1}-x_{k-2}\|^2. \end{aligned}

Now, let

\Gamma_{k} = \|x_k-q\|^2-\alpha\|x_{k-1}-q\|^2-\beta\|x_{k-2}-q\|^2+\left(\frac{1-\mu}{1+\mu}\right)(1+\beta-\alpha)\|x_k-x_{k-1}\|^2.

Then we can rewrite (?) as

\begin{aligned} \Gamma_{k+1} \leq & \Gamma_k+[(1+\alpha)(\alpha-\beta) -\left(\frac{1-\mu}{1+\mu}\right)(\alpha^2-2\alpha+\beta\alpha+\beta+1)]\|x_k-x_{k-1}\|^2 \\ & -[\beta(\alpha-\beta)+\left(\frac{1-\mu}{1+\mu}\right)(\beta^2+\beta+\beta\alpha)]\|x_{k-1}-x_{k-2}\|^2. \end{aligned}

Claim: \Gamma_{k}\geq0, \forall k>1. Since

\begin{aligned} \Gamma_{k} =&\|x_{k}-q\|^{2}-\alpha\|x_{k-1}-q\|^{2}-\beta\|x_{k-2}-q\|^{2}+\left(\frac{1-\mu}{1+\mu}\right)(1+\beta-\alpha)\|x_{k}-x_{k-1}\|^{2} \\ \geq&\|x_{k}-q\|^{2}-2\alpha\|x_{k}-x_{k-1}\|^{2}-2\alpha\|x_{k}-q\|^{2}-\beta\|x_{k-2}-q\|^{2} \\ &+\left(\frac{1-\mu}{1+\mu}\right)(1+\beta-\alpha)\|x_k-x_{k-1}\|^2 \\ =&(1-2\alpha)\|x_{k}-q\|^{2}+\left[\left(\frac{1-\mu}{1+\mu}\right)(1+\beta-\alpha)-2\alpha\right]\|x_{k}-x_{k-1}\|^{2} \\ &-\beta||x_{k-2}-q||^2. \end{aligned}

From Assumption 2, we have that \alpha<\frac{1}{2},\beta\leq0,\frac{\alpha(3+\mu)}{1-\mu}-1\leq\beta and 0<\alpha<\frac{1-\mu}{3+\mu}, it can be conclude that \Gamma_{k}\geq 0, \forall k>1. Let

\begin{aligned} k_{1} :=& -[(1+\alpha)(\alpha-\beta)-\left(\frac{1-\mu}{1+\mu}\right)(\alpha^2-2\alpha+\beta\alpha+\beta+1)] \\ k_{2} :=& -[(1+\alpha)(\alpha-\beta)-\left(\frac{1-\mu}{1+\mu}\right)(\alpha^2-2\alpha+\beta\alpha+\beta+1)-\beta(\alpha-\beta) -\left(\frac{1-\mu}{1+\mu}\right)(\beta^2+\beta+\beta\alpha)]. \\ \end{aligned}

Thus, we deduce from (?) that

\Gamma_{k+1}-\Gamma_n\leq k_1(\|x_{k-1}-x_{k-2}\|^2-\|x_k-x_{k-1}\|^2)-k_2\|x_{k-1}-x_{k-2}\|^2.

From Assumption 2(b),

\max\Big\{2\alpha (\frac{1-\mu}{3+\mu})-(1-\alpha),\frac{1}{2}[\alpha(1+\mu)-(\frac{(1-\mu)(1-\alpha)^2}{1+\alpha})]\Big\}<\beta\leq0,

which implies that

\frac{1}{2}\left[\alpha(1+\mu)-\frac{(1-\mu)(1-\alpha)^2}{1+\alpha}\right]<\beta,

which can conclude that k_{1}>0.
By Assumption 2(c) we can have k_{2}>0, thus, (?) can be rewritten as

\Gamma_{k+1}+k_1\|x_k-x_{k-1}\|^2\leq\Gamma_k+k_1\|x_{k-1}-x_{k-2}\|^2-k_2\|x_{k-1}-x_{k-2}\|^2.

Letting \Gamma_k^{\prime}=\Gamma_k+k_1\|x_{k-1}-x_{k-2}\|^2. Then, \Gamma_k^{^{\prime}}\geq0, \forall k\geq1. Therefore, we deduce from (?) that

\Gamma_{k+1}^{'}\leq\Gamma_{k}^{'},

which implies that the sequence {\Gamma_{k+1}^{'}} is decreasing and bounded from below and thus \lim\limits_{n\rightarrow\infty}\Gamma_{k}^{'} exists.
Hence, by rearranging (?) and letting k approach infinity, we have

\lim_{k\rightarrow\infty}k_{2}||x_{k-1}-x_{k-2}||^2=0 \implies\lim_{k\rightarrow\infty}||x_{k-1}-x_{k-2}||=0.

It is easy to see that

\begin{aligned} \|x_{k+1}-w_{k}\| =&\|x_{k+1}-x_{k}-\alpha(x_{k}-x_{k-1})-\beta(x_{k-1}-x_{k-2})\| \\ \leq&\|x_{k+1}-x_{k}\|+\alpha\|x_{k}-x_{k-1}\|+\beta\|x_{k-1}-x_{k-2}\|. \end{aligned}

Consequently, by (?) we have

\begin{aligned} \lim_{k\rightarrow\infty}\|x_{k+1}-w_{k}\|=0. \end{aligned}

Furthermore,

\begin{aligned} \|x_{k}-w_{k}\| =&\|x_{k}-x_{k}-\alpha(x_{k}-x_{k-1})-\beta(x_{k-1}-x_{k-2})\|\\ \leq&\alpha\|x_{k}-x_{k-1}\|+\beta\|x_{k-1}-x_{k-2}\|\rightarrow0, k\rightarrow\infty. \end{aligned}

Observe that

\begin{aligned} \|x_{k+1}-w_{k}\|=&\quad\|y_{k}-\lambda_{k}(Ay_{k}-Aw_{k})-w_{k}\|\\ \geq&\quad\|y_{k}-w_{k}\|-\lambda_{k}\|Ay_{k}-Aw_{k}\|\\ \geq&\quad\|y_{k}-w_{k}\|-\mu\|y_{k}-w_{k}\|\\ =&\quad(1-\mu)\|y_{k}-w_{k}\|. \end{aligned}

Using (? )we deduce from (?) that

\lim_{k\rightarrow\infty}\|w_k-y_k\| = 0.

Also,

\|x_k-y_k\|\leq\|x_k-w_k\|+\|w_k-y_k\|\to0, k\to\infty.

Due to the existence of the limit \Gamma_{k}^{'} and (?), we can obtain that the limit of \Gamma_{k} also exists and therefore, the sequence \{\Gamma_{k}\} is bounded. Since \lim\limits_{k\rightarrow\infty}||x_{k+1}-x_{k}||=0, from the definition of \Gamma_{k} we can get that

\lim_{k\to\infty}(\|x_k-q\|^2-\alpha\|x_{k-1}-q\|^2-\beta\|x_{k-2}-q\|^2)

exists. Due to the boundedness of \{\Gamma_{k}\}, we have from (?) that \{x_{k}\} is bounded and \{y_{k}\} and \{w_{k}\} are bounded.

Lemma

Lemma 4.3

3DTE

Let \{x_{k}\} be the sequence generated by algorithm ?, satisfying Assumptions 1(i)-(iv) and Assumptions 2(a)-(c), and assuming that \lim \limits_{k\rightarrow\infty}w_{k}-y_{k} = 0. If v^*is one of the weakly clustered points of {y_k}, then we have at least one of the following: v^*\in S_D or Av^*= 0.

Proof of Lemma 4.3

From the lemma (4.2) above, it can be concluded that \{y_{k}\} is bounded. Therefore let v^* be a weak cluster point of \{y_{k}\}. Hence, we denote \{y_{k_{j}}\} as a subsequence of \{y_{k}\} such that y_{k_{j}}\rightharpoonup v^*\in C.

Now we discuss in two cases.

Case.

First, we assume that \lim \limits_{k\rightarrow\infty}||Ay_{k_{j}}||=0. Consequently, \lim \limits_{k\rightarrow\infty}||Ay_{k_{j}}||=\liminf \limits_{k\rightarrow\infty}||Ay_{k_{j}}||=0

Through the assumption above that y_{k_{j}}\rightharpoonup v^*\in C and A satisfies Assumption 1(iii), that is

0\leq||Av^*||\leq\liminf \limits_{k\rightarrow\infty}||Ay_{k_{j}}||=0.

Which just implies that Av^*=0.

Now we consider the another situation.

Case.

If \limsup\limits_{k\to\infty}\|Ay_{k_j}\|>0. Without loss of generality, we take \lim\limits_{k\to\infty}\|Ay_{k_j}\|=M_{1}>0. It then follows that there exists a \mathbf{K}\in\mathbb{K} such that \|Ay_{k_j}\|>\frac{M_{1}}{2} for all k\geq \mathbf{K} Since y_{k_{j}}=P_C(w_{k_{j}}-\lambda_{k_{j}}Aw_{k_{j}}), we have

\langle w_{k_{j}}-\lambda_{k_{j}}Aw_{k_{j}}-y_{k_{j}},x-y_{k_{j}}\rangle \leq 0,
\frac{1}{\lambda_{k_{j}}}\langle w_{k_{j}}-y_{k_{j}},x-y_{k_{j}} \rangle +\langle Aw_{k_{j}},y_{k_{j}}-w_{k_{j}}\rangle\leq\langle Aw_{k_{j}},x-w_{k_{j}} \rangle.

For the weak convergence of w_{k_{j}}, w_{k_{j}} is bounded. Then, for the A Lipschitz continuous, Aw_{k_{j}} is bounded. By (?) we can get that

\|w_{k_{j}}-y_{k_{j}}\|\to0,k\to\infty;

therefore \|y_{k_{j}}\| is also bounded and through the Lemma(4.1) we get that \lambda_{k_{j}}\geq min\{\frac{l\mu}{L},\lambda_{0}\}. Passing (?) to the limit as k\rightarrow\infty, that is

\liminf \limits_{k\rightarrow\infty}\langle Aw_{k_{j}},x-w_{k_{j}} \rangle \geq 0,\forall x \in C.

Observe that

\begin{aligned} \langle Ay_{k_{j}},x-y_{k_{j}}\rangle =& \langle Ay_{k_{j}}-Aw_{k_{j}},x-w_{k_{j}}\rangle+\langle Aw_{k_{j}},x-w_{k_{j}}\rangle\\ &+\langle Ay_{k_{j}},w_{k_{j}}-y_{k_{j}}\rangle. \end{aligned}

Thus we can get \lim \limits_{k\rightarrow\infty}||Aw_{k_{j}}-Ay_{k_{j}}||=0, for the \lim \limits_{k\rightarrow\infty}||w_{k_{j}}-y_{k_{j}}||=0 and the L -Lipschitz continuity on H of A. Together with (?) and (?) which implies that

\lim \limits_{k\rightarrow\infty}\langle Ay_{k_{j}},x-y_{k_{j}}\rangle \geq 0.

If we suppose that \limsup\limits_{k\rightarrow\infty}\langle Ay_{k_{j}},x-y_{k_{j}}\rangle>0, then there exists a subsequence denoted by y_{n_{k_{j}}} such that \lim\limits_{j\rightarrow\infty}\langle Ay_{n_{k_{j}}},x-y_{n_{k_{j}}} \rangle > 0, that is there exists j_{0}\in \mathbb{K} such that

\langle Ay_{n_{k_{{j}}}},x-y_{k_{j}}\rangle \geq 0, \forall j > j_{0}.

Through the quasimonotonicity(2.1) of A, we get \langle Ax,x-y_{n_{k_{j}}}\rangle\geq0, as j\rightarrow\infty, we conclude that v^*\in S_{D} On the other hand we suppose that if \limsup\limits_{k\rightarrow\infty}\langle Ay_{k_{j}},x-y_{k_{j}}\rangle=0, plus (?) implies that

\lim \limits_{k\rightarrow\infty}\langle Ay_{k_{j}},x-y_{k_{j}}\rangle = 0.

Let \epsilon_{k}:= |Ay_{k_{j}},x-y_{k_{j}}|+\frac{1}{k+1}. Thus we obtain that

\langle Ay_{k_{j}},x-y_{k_{j}}\rangle + \epsilon_{k} > 0, \forall k\geq 1.

Furthermore, for each k\geq \mathbf{K} we can get Ay_{k_{j}}\neq0. Defining that

r_{k_{j}} = \frac{Ay_{k_{j}}}{||Ay_{k_{j}}||^2}, \forall~k\geq \mathbf{K},

then \langle Ay_{k_{j}},r_{k_{j}}\rangle=1 for each k\geq \mathbf{K}. Thus we can conclude from (?) that,

\langle Ay_{k_{j}},x+\epsilon_{k}r_{k_{j}}-y_{k_{j}}\rangle > 0,~ k\geq \mathbf{K}.

Since A is quasimonotone on H, we get

\langle A(x+\epsilon_{k}r_{k_{j}}),x+\epsilon_{k}r_{k_{j}}-y_{k_{j}}\rangle \geq 0.

Thus

\begin{aligned} \langle Ax,x+\epsilon_{k}r_{k_{j}}-y_{k_{j}}\rangle =&\langle Ax-A(x+\epsilon_{k}r_{k_{j}}),x+\epsilon_{k}r_{k_{j}}-y_{k_{j}}\rangle\\ &+\langle A(x+\epsilon_{k}r_{k_{j}}),x+\epsilon_{k}r_{k_{j}}-y_{k_{j}}\rangle \rangle \\ \geq&\langle Ax-A(x+\epsilon_{k}r_{k_{j}}),x+\epsilon_{k}r_{k_{j}}-y_{k_{j}}\rangle \\ \geq&-\|Ax-A(x+\epsilon_kq_{n_k})\|\|x+\epsilon_kq_{n_k}-y_{k_j}\| \\ \geq&-\epsilon_{k}L\|r_{k_{j}}\|\|x+\epsilon_{k}r_{k_{j}}-y_{k_{j}}\| \\ =&-\epsilon_{k}L\frac{1}{\|Ay_{k_{j}}\|}\|x+\epsilon_{k}r_{k_{j}}-y_{k_{j}}\| \\ \geq&-\epsilon_{k}L\frac{2}{M_{1}}\|x+\epsilon_{k}r_{k_{j}}-y_{k_{j}}\|. \end{aligned}

Observe that, tending k\rightarrow\infty, for \{x+\epsilon_{k}r_{k_{j}}-y_{k_{j}}\} is bounded and \lim\limits_{k\rightarrow\infty}\epsilon_{k}=0, we can conclude that \langle Ax,x-v^*\rangle\geq0,~\forall x\in C. This implies that v^*\in S_D.

Theorem

Theorem 4.1

SLG5

Suppose \{x_{k}\} is a sequence generated by Algorithm ?. Then under Assumptions 1 and Assumptions 2 and Ax\neq 0, \forall x \in C. Then {x_{k}} converges weakly to an element of S_{D} \subset S.

Proof of Theorem 4.1

Suppose w_{w}(x_{k}) is a set of weak cluster points of \{x_{k}\}. Which is

w_{w}(x_{k})\subset S_{D}.

We take v^*\in w_{w}(x_{k}).Therefore, there exists a subsequence \{x_{n_{k}}\}\subset\{x_{k}\} such that \{x_{n_{k}}\}\rightarrow v^*, k \rightarrow\infty. Since C is weakly closed, we have that v^*\in C. Furthermore, we can conclude that Av^*\neq0 for Ax\neq0, ~\forall x\in C. By Lemma (4.3), we have v^*\in S_{D}. Hence w_{w}(x_{k})\subset S_{D}. By Lemma (4.2), \lim\limits_{n\rightarrow\infty}\Gamma_{k} exists and \lim\limits_{n\rightarrow\infty}||x_{k+1}-x_{k}||=0, we have

\lim\limits_{n\rightarrow\infty}[||x_{k}-q||^2-\alpha||x_{k-1}-q||^2-\beta||x_{k-1}-q||^2]

exists for \forall q \in S_{D}.

Next we show that x_{k}\rightharpoonup x^*\in S_{D}. Let \{x_{n_{j}}\} and \{x_{n_{m}}\} both \subset \{x_{k}\} such that x_{n_{j}}\rightharpoonup v^*, j\rightarrow\infty and x_{n_{m}}\rightharpoonup x^*, m\rightarrow\infty.

Then we show that x^*=v^*, using (2.4) observe that

2\langle x_{k}, x^*-v^*\rangle = ||x_{k}-v^*||^2-||x_{k}-x^*||^2-||v^*||^2+||x^*||^2;
2\langle x_{k-1}, x^*-v^*\rangle = ||x_{k-1}-v^*||^2-||x_{k-1}-x^*||^2-||v^*||^2+||x^*||^2;

and

2\langle x_{k-2}, x^*-v^*\rangle = ||x_{k-2}-v^*||^2-||x_{k-2}-x^*||^2-||v^*||^2+||x^*||^2;

Therefore,

2\langle -\alpha x_{k-1}, x^*-v^*\rangle = -\alpha||x_{k-1}-v^*||^2+\alpha||x_{k-1}-x^*||^2+\alpha||v^*||^2-\alpha||x^*||^2;

and

2\langle -\beta x_{k-1}, x^*-v^*\rangle = -\beta||x_{k-1}-v^*||^2+\beta||x_{k-1}-x^*||^2+\beta||v^*||^2-\beta||x^*||^2;

Addition of (?), (?) and (?) gives

\begin{aligned} 2\langle x_k-\alpha x_{k-1}-\beta x_{k-2},x^*-v^*\rangle =& \left(\|x_k-v^*\|^2-\alpha\|x_{k-1}-v^*\|^2-\beta\|x_{k-2}-v^*\|^2\right) \\ &-(\|x_k-x^*\|^2-\alpha\|x_{k-1}-x^*\|^2-\beta\|x_{k-2}-x^*\|^2) \\ &+(1-\alpha-\beta)(\|x^*\|-\|v^*\|^2). \end{aligned}

Through (?) we know that

\lim\limits_{n\to\infty}(\|x_k-x^*\|^2-\alpha\|x_{k-1}-x^*\|^2-\beta\|x_{k-2}-x^*\|^2)

exists, and

\lim\limits_{n\to\infty}(\|x_k-v^*\|^2-\alpha\|x_{k-1}-x^*\|^2-\beta\|x_{k-2}-x^*\|^2)

also exists, which implies with (?) that \lim\limits_{n\to\infty}\langle x_{k}-\alpha x_{k-1}-\beta x_{k-2},x^*-v^* \rangle exists.

Consequently,

\begin{aligned} \langle v^*-\alpha v^*-\beta v^*, x^*-v^* \rangle =&\lim\limits_{j\rightarrow\infty} \langle x_{k_{j}}-\alpha x_{k_{j-1}}-\beta x_{n_{j-2}},x^*-v^* \rangle\\ =&\lim\limits_{j\rightarrow\infty} \langle x_{k}-\alpha x_{k-1}-\beta x_{k-2},x^*-v^* \rangle \\ =&\lim\limits_{j\rightarrow\infty} \langle x_{k_{m}}-\alpha x_{k_{m-1}}-\beta x_{k_{m-2}},x^*-v^* \rangle \\ =&\langle x^*-\alpha x^*-\beta x^*,x^*-v^* \rangle . \end{aligned}

Thus,

(1-\alpha-\beta)||x^*-v^*||^2 = 0.

For \beta\leq0<1-\alpha, 1-\alpha-\beta \neq0, we can conclude that x^*=v^*.

Hence, we deduce that \{x_{k}\} converges weakly to a point in S_{D}. This completes the proof.

Source and licence

The text on this page is from arXiv:2601.10370v1 by Jian-Wen Peng, Jun-Jie Luo and Abubakar Adamu, under the licence CC BY 4.0. The corpus made these changes: it read the items out of the LaTeX source, it expanded the macros of the paper, it put each proof after its statement, and it converted the text to HTML. The formulas are the TeX of the paper, and KaTeX renders them. A formula or a reference can look different from the PDF. The page is published under CC BY 4.0.

The record of each item is in analysis/objects/2601/2601.10370.jsonl.