Skip to main content

An implicitly defined iterative sequence for monotone operators in Banach spaces

Abstract

Given a monotone operator in a Banach space, we show that an iterative sequence, which is implicitly defined by a fixed point theorem for mappings of firmly nonexpansive type, converges strongly to a minimum norm zero point of the given operator. Applications to a convex minimization problem and a variational inequality problem are also included.

MSC:47H05, 47J25, 47N10.

1 Introduction

Many nonlinear problems can be formulated as the problem of finding a zero point of a maximal monotone operator in a Banach space. The proximal point method, which was first introduced by Martinet [1] and generally studied by Rockafellar [2], is an iterative method for approximating a solution to this problem.

The proximal point method generates a sequence { x n } by x 1 X and

x n + 1 = ( J + λ n A ) 1 J x n
(1.1)

for all nN, where A:X 2 X is a maximal monotone operator, X is a smooth, strictly convex, and reflexive real Banach space, J:X X is the normalized duality mapping, and { λ n } is a sequence of positive real numbers.

The following result was obtained in [3]: If n = 1 λ n =, then { x n } is bounded if and only if A 1 0 is nonempty. Further, if X is uniformly convex, the norm of X is uniformly Gâteaux differentiable, A 1 0 is nonempty, inf n λ n >0, and J is weakly sequentially continuous, then { x n } converges weakly to an element of A 1 0. This is a generalization of the result due to Rockafellar [2] in Hilbert spaces. See also [4, 5] for some related results.

The aim of the present paper is to study the asymptotic behavior of the sequence { x n } generated by

x n = β n ( J + λ n A ) 1 J x n
(1.2)

for all nN, where A, X, J, and { λ n } are the same as in (1.1) and { β n } is a sequence of [0,1). Under some additional assumptions, we show that { x n } is well defined and is strongly convergent to an element of A 1 0 of minimal norm; see Theorem 3.5.

The schemes (1.1) and (1.2) above are similar to each other, though their properties are quite different. In fact, the former fails to converge strongly even in Hilbert spaces [6], whereas the latter converges strongly in Banach spaces. Further, the former is well defined since R(J+λA)= X for each λ>0, whereas the latter is not necessarily well defined. To study the well definedness and the asymptotic behavior of { x n } in (1.2), we exploit some techniques in [3, 7].

This paper is organized as follows: In Section 2, we give some definitions, recall some known results, and briefly study the existence of a zero point of a monotone operator. In Section 3, using the results in the previous section, we first obtain a convergence theorem for a monotone operator satisfying a range condition; see Theorem 3.1. Using this result, we show a convergence theorem for a maximal monotone operator; see Theorem 3.5. In Section 4, we apply Theorem 3.5 to a convex minimization problem and a variational inequality problem.

2 Preliminaries

Throughout the present paper, we denote by the set of all positive integers, the set of all real numbers, X a smooth, strictly convex, and reflexive real Banach space with dual  X , the norms of X and X , x, x the value of x X at xX, x n x the strong convergence of a sequence { x n } of X to xX, x n x the weak convergence of a sequence { x n } of X to xX, U ¯ the norm closure of UX, coU the convex hull of UX, co ¯ U the closed convex hull of UX, and S X the unit sphere of X, respectively.

Under the assumptions on X, we know that for each xX, there is a corresponding unique Jx in X such that x,Jx= x 2 and Jx=x. The mapping J is called the normalized duality mapping of X into X . We know the following: J:X X is a bijection; J(αx)=αJx for all αR and xX; J is norm-to-weak continuous, that is, J x n Jx whenever { x n } is a sequence of X such that x n xX; J is strictly monotone, that is, xy, x y >0 for all distinct x,yX. The norm of X is said to be uniformly Gâteaux differentiable if the limit

lim t 0 x + t y x t
(2.1)

converges uniformly in x S X for all y S X . The space X is said to be uniformly convex if for each ε(0,2], there exists δ>0 such that (x+y)/21δ whenever x,y S X and xyε. The space X is said to have the Kadec-Klee property if x n x whenever { x n } is a sequence of X such that x n xX and x n x. Every uniformly convex Banach space is both strictly convex and reflexive and has the Kadec-Klee property; see [8, 9].

For a nonempty closed convex subset C of X and xX, there exists a unique point x ˆ in C such that x ˆ xyx for all yC. The metric projection P C of X onto C is defined by P C x= x ˆ for all xX. It is well known [9] that

z= P C (x) sup y C y z , J ( x z ) 0
(2.2)

for (x,z)X×C. The function ϕ:X×XR is defined by

ϕ(x,y)= x 2 2x,Jy+ y 2
(2.3)

for all x,yX; see [10, 11]. If X is a Hilbert space, then ϕ(x,y)= x y 2 for all x,yX. It is easy to see that

( x y ) 2 ϕ(x,y)
(2.4)

and

ϕ(x,y)+ϕ(y,x)=2xy,JxJy
(2.5)

for all x,yX.

Let C be a nonempty subset of X and T:CX a mapping. The set of all fixed points of T is denoted by F(T). The mapping T is said to be of firmly nonexpansive type [12] if

TxTy,JTxJTyTxTy,JxJy
(2.6)

for all x,yC; see also [13]. If X is a Hilbert space, then T:CX is firmly nonexpansive if and only if it is of firmly nonexpansive type.

For an operator A:X 2 X , the domain D(A), the range R(A), and the graph G(A) of A are defined by D(A)={xX:Ax}, R(A)= x X Ax, and G(A)={(x, x )X× X : x Ax}, respectively. The operator A is said to be monotone if xy, x y 0 whenever (x, x ),(y, y )G(A). It is also said to be maximal monotone if A is monotone and there is no monotone operator B:X 2 X such that AB and G(A)G(B). Let C be a nonempty closed convex subset of X and A:X 2 X a monotone operator such that D(A)C J 1 R(J+A). Then the mapping T:CC defined by Tx= ( J + A ) 1 Jx for all xC is of firmly nonexpansive type and F(T)= A 1 0; see [12, 14]. We know the following lemma.

Lemma 2.1 ([3])

Suppose that the norm of X is uniformly Gâteaux differentiable. Let C be a nonempty closed convex subset of X, A:X 2 X a monotone operator such that

D(A)C λ > 0 J 1 R(J+λA),
(2.7)

{ λ n } a sequence of (0,) such that inf n λ n >0, and Q λ n :CC the mapping defined by Q λ n x= ( J + λ n A ) 1 Jx for all xC and nN. If { x n } is a sequence of C such that x n u and x n Q λ n x n 0, then u is an element of A 1 0.

We know the following result for mappings of firmly nonexpansive type.

Lemma 2.2 ([12])

Let C be a nonempty closed convex subset of X and T:CC a mapping of firmly nonexpansive type. Then the following hold:

  1. (i)

    F(T) is nonempty if and only if { T n x} is bounded for some xC;

  2. (ii)

    F(T) is closed and convex.

Using Lemma 2.2, we can show the following.

Lemma 2.3 Let C be a nonempty closed convex subset of X and T:CC a mapping of firmly nonexpansive type. Suppose that β[0,1), 0C, and T(C) is bounded. Then the mapping βT has a unique fixed point.

Proof Set S=βT. Since J is monotone, T is of firmly nonexpansive type, and β[0,1), we have

0 S x S y , J S x J S y = β 2 T x T y , J T x J T y β 2 T x T y , J x J y = β S x S y , J x J y S x S y , J x J y
(2.8)

for all x,yC. This implies that S is of firmly nonexpansive type. Since C is convex, 0C, and β[0,1), we know that S is a mapping of C into itself. Further, since S(C)=βT(C) and T(C) is bounded, the sequence { S n x} is bounded for all xC. Thus Lemma 2.2 implies that F(S) is nonempty.

We next show that F(S) consists of one point. Suppose that p, p F(S). Then it follows from (2.8) that (1β)p p ,JpJ p =0. Since 1β>0, we obtain p p ,JpJ p =0. Thus the strict monotonicity of J implies that p= p . □

As a direct consequence of Lemmas 2.2 and 2.3, we obtain the following.

Corollary 2.4 Let A:X 2 X be a monotone operator such that D(A) is bounded and D(A)C J 1 R(J+A) for some nonempty closed convex subset C of X. Then the following hold:

  1. (i)

    A 1 0 is nonempty, closed, and convex;

  2. (ii)

    if 0C and β[0,1), then there exists a unique pC such that

    p=β ( J + A ) 1 Jp.
    (2.9)

Proof Let T:CC be the mapping defined by Tx= ( J + A ) 1 Jx for all xC. Then we know that T is of firmly nonexpansive type and T(C)D(A). Hence { T n x} is bounded for all xC. On the other hand, we know that F(T)= A 1 0. Therefore, part (i) follows from Lemma 2.2. Part (ii) follows from Lemma 2.3. □

3 Strong convergence of an iterative sequence

In this section, we first show the following strong convergence theorem for a monotone operator satisfying a range condition.

Theorem 3.1 Let X be a smooth, strictly convex, and reflexive real Banach space, C a nonempty closed convex subset of X such that 0C, and A:X 2 X a monotone operator such that D(A) is bounded and

D(A)C λ > 0 J 1 R(J+λA).
(3.1)

Let { λ n } be a sequence of positive real numbers, { β n } a sequence of [0,1), and Q λ n :CC the mapping defined by Q λ n x= ( J + λ n A ) 1 Jx for all xC and nN. Then the following hold:

  1. (i)

    For each nN, there exists a unique x n C such that x n = β n Q λ n x n ;

  2. (ii)

    if X has the Kadec-Klee property, the norm of X is uniformly Gâteaux differentiable, inf n λ n >0, and lim n β n =1, then the sequence { x n } converges strongly to P A 1 0 (0).

Part (i) of Theorem 3.1 follows from Corollary 2.4.

The proof of (i) of Theorem 3.1 Let nN be given and set B= λ n A. Then B:X 2 X is monotone and D(B)=D(A). Thus we know that D(B) is bounded and D(B)C J 1 R(J+B). Therefore, part (ii) of Corollary 2.4 ensures the conclusion. □

Before proving (ii) of Theorem 3.1, we show the following lemma.

Lemma 3.2 The following hold:

  1. (i)

    Q λ n x n y,J Q λ n x n 0 for all y A 1 0 and nN;

  2. (ii)

    ϕ( Q λ n x n ,y)+ϕ(y, Q λ n x n )2y Q λ n x n ,Jy for all y A 1 0 and nN.

Proof We show (i). Let y A 1 0 and nN be given. Since Q λ n is of firmly nonexpansive type and Q λ n y=y, we know that

Q λ n x n y,J Q λ n x n J x n 0.
(3.2)

On the other hand, by the definition of { x n }, we also know that

J Q λ n x n J x n =J Q λ n x n J( β n Q λ n x n )=(1 β n )J Q λ n x n .
(3.3)

By (3.2), (3.3), and 1 β n >0, the result follows.

By (2.5) and (i), we have

ϕ ( Q λ n x n , y ) + ϕ ( y , Q λ n x n ) = 2 Q λ n x n y , J Q λ n x n J y 2 Q λ n x n y , J y
(3.4)

for all y A 1 0 and nN. Thus the result follows. □

We next show (ii) of Theorem 3.1.

The proof of (ii) of Theorem 3.1 Suppose that X has the Kadec-Klee property, the norm of X is uniformly Gâteaux differentiable, inf n λ n >0, and lim n β n =1. Set y n = Q λ n x n for all nN. By (i) of Corollary 2.4, the set A 1 0 is nonempty, closed, and convex. Hence P A 1 0 is well defined. We denote P A 1 0 by P.

Since y n D(A) for all nN and D(A) is bounded, { y n } is bounded. By the definition of { x n }, we have x n = β n y n y n for all nN. Thus { x n } is also bounded.

Let { x n i } be any subsequence of { x n }. To see that x n P(0), it is sufficient to see that there exists a subsequence { x n i j } of { x n i } which converges strongly to P(0). Since X is reflexive and { x n } is a bounded sequence of C, there exist uC and a subsequence { x n i j } of { x n i } such that x n i j u. Since { y n } is bounded and lim n β n =1, we have

x n y n = β n y n y n =(1 β n ) y n 0.
(3.5)

Since inf j λ n i j inf n λ n >0, Lemma 2.1 shows that u is an element of A 1 0. It also follows from (3.5) and x n i j u that y n i j u.

We next show that x n i j u. By (2.4) and (ii) of Lemma 3.2, we have

( y n i j u ) 2 ϕ ( y n i j , u ) ϕ ( y n i j , u ) + ϕ ( u , y n i j ) 2 u y n i j , J u 0 .
(3.6)

Thus we obtain y n i j u. Since X has the Kadec-Klee property, we have y n i j u. Consequently, it follows from (3.5) that x n i j u.

We next show that u=P(0). To see this, let y A 1 0 be given. Since J is norm-to-weak continuous and y n i j u, we know that J y n i j Ju. On the other hand, by (i) of Lemma 3.2, we have

y n i j y,J y n i j 0
(3.7)

for all jN. Letting j in (3.7), we obtain uy,Ju0 and hence

sup y A 1 0 y u , J ( 0 u ) 0.
(3.8)

Noting that u A 1 0, we have from (2.2) and (3.8) that u=P(0). Therefore, we conclude that { x n } converges strongly to P(0). □

As a direct consequence of Theorem 3.1, we obtain the following corollary.

Corollary 3.3 Let X be a smooth, strictly convex, and reflexive real Banach space, C a nonempty closed convex subset of X such that 0C, T:CC a mapping of firmly nonexpansive type such that T(C) is bounded, { λ n } a sequence of positive real numbers, and { β n } a sequence of [0,1). Then the following hold:

  1. (i)

    For each nN, there exists a unique x n C such that x n = β n T x n ;

  2. (ii)

    if X has the Kadec-Klee property, the norm of X is uniformly Gâteaux differentiable, and lim n β n =1, then the sequence { x n } converges strongly to P F ( T ) (0).

Proof Let A:X 2 X be the mapping defined by A=J T 1 J, where T 1 :X 2 X is defined by

T 1 x={ { u C : T u = x } ( x T ( C ) ) ; ( x T ( C ) )
(3.9)

for all xX. Then, by [14], we know that the following hold:

  • A is a monotone operator and A 1 0=F(T);

  • D(A)=T(C)C= J 1 R(J+A);

  • Tx= ( J + A ) 1 Jx for all xC.

Thus the result follows from Theorem 3.1. □

Remark 3.4 In the case when C is bounded, Corollary 3.3 is reduced to the result obtained in [7].

Using Theorem 3.1, we can also show the following strong convergence theorem for a maximal monotone operator.

Theorem 3.5 Let X be a smooth, strictly convex, and reflexive real Banach space, A:X 2 X a maximal monotone operator such that 0 D ( A ) ¯ and D(A) is bounded, { λ n } a sequence of positive real numbers, and { β n } a sequence of [0,1). Then for each nN, there exists a unique x n D ( A ) ¯ satisfying (1.2). Moreover, if X has the Kadec-Klee property, the norm of X is uniformly Gâteaux differentiable, inf n λ n >0, and lim n β n =1, then the sequence { x n } converges strongly to P A 1 0 (0).

Proof The maximal monotonicity of A implies that D(A) is nonempty and hence so is D ( A ) ¯ . It is obvious that D ( A ) ¯ is closed. It is well known [15] that D ( A ) ¯ is convex. In fact, we know that

lim μ 0 ( I + μ J 1 A ) 1 x=x
(3.10)

for all x co ¯ D(A), where I denotes the identity mapping on X; see [16, 17]. Since ( I + μ J 1 A ) 1 xD(A) for all μ>0 and xX, it follows from (3.10) that co ¯ D(A) D ( A ) ¯ . Thus co ¯ D(A)= D ( A ) ¯ and hence D ( A ) ¯ is convex.

On the other hand, since A is maximal monotone, we know that R(J+λA)= X for all λ>0; see [18]. Putting C= D ( A ) ¯ , we have

D(A)CX= λ > 0 J 1 R(J+λA).
(3.11)

Noting that 0 D ( A ) ¯ =C, we obtain the desired result by Theorem 3.1. □

4 Results deduced from Theorem 3.5

In this final section, we study two applications of Theorem 3.5. Throughout this section, we suppose the following:

  • X is a uniformly convex real Banach space whose norm is uniformly Gâteaux differentiable;

  • { λ n } is a sequence of positive real numbers such that inf n λ n >0;

  • { β n } is a sequence of [0,1) such that lim n β n =1.

We first study a convex minimization problem. For a function f:X(,], we denote by argminf or argmin y X f(y) the set of all uX such that f(u)=inff(X). In the case when argminf={p} for some pX, we identify argminf with p. The set of all xX such that f(x)R is denoted by D(f). We denote by ∂f the subdifferential mapping of f; see [17, 19] for more details.

Corollary 4.1 Let f:X(,] be a proper lower semicontinuous convex function such that 0 D ( f ) ¯ and D(f) is bounded. Then for each nN, there exists a unique x n D ( f ) ¯ such that

x n = β n argmin y X { f ( y ) + 1 2 λ n ϕ ( y , x n ) } .
(4.1)

Moreover, the sequence { x n } converges strongly to P argmin f (0).

Proof Let A:X 2 X be the operator defined by A=f. It is well known that A is maximal monotone [20] and A 1 0=argminf. Since D(f) is bounded and D(A)D(f), we know that D(A) is bounded. By Brøndsted and Rockafellar’s theorem [21], we know that D ( f ) ¯ = D ( A ) ¯ . Thus we have 0 D ( A ) ¯ . Further, the equality

( J + λ A ) 1 Jx= argmin y X { f ( y ) + 1 2 λ ϕ ( y , x ) }
(4.2)

holds for all λ>0 and xX. Thus we know that x n = β n ( J + λ n A ) 1 J x n for all nN. Consequently, Theorem 3.5 implies the conclusion. □

We finally study a variational inequality problem. For a nonempty closed convex subset C of X and an operator B:C X , we denote by VI(C,B) the set of all uC such that yu,Bu0 for all yC. In the case when VI(C,B)={p} for some pC, we identify VI(C,B) with p. The operator B is said to be hemicontinuous if the mapping g:[0,1] X defined by g(t)=B(tx+(1t)y) for all t[0,1] is continuous with respect to the weak* topology in X for all x,yC.

Corollary 4.2 Let C be a nonempty bounded closed convex subset of X such that 0C and B:C X a monotone and hemicontinuous operator. Then for each nN, there exists a unique x n C such that

x n = β n VI ( C , B + 1 λ n ( J J x n ) ) .
(4.3)

Moreover, the sequence { x n } converges strongly to P VI ( C , B ) (0).

Proof Let A:X 2 X be the operator defined by

A(x)={ B ( x ) + i C ( x ) ( x C ) ; ( x X C )
(4.4)

for all xX, where i C denotes the indicator function of C. It is well known that A is maximal monotone [18], A 1 0=VI(C,B), and D(A)=C. Thus we know that D(A) is bounded and 0D(A). Further, the equality

( J + λ A ) 1 Jx=VI ( C , B + 1 λ ( J J x ) )
(4.5)

holds for all λ>0 and xX. Thus we have x n = β n ( J + λ n A ) 1 J x n for all nN. Consequently, Theorem 3.5 implies the conclusion. □

References

  1. Martinet B: Régularisation d’inéquations variationnelles par approximations successives. Rev. Fr. Inform. Rech. Opér. 1970, 4: 154–158. (in French)

    MathSciNet  Google Scholar 

  2. Rockafellar RT: Monotone operators and the proximal point algorithm. SIAM J. Control Optim. 1976, 14: 877–898. 10.1137/0314056

    Article  MathSciNet  Google Scholar 

  3. Aoyama K, Kohsaka F, Takahashi W: Proximal point methods for monotone operators in Banach spaces. Taiwanese J. Math. 2011, 15: 259–281.

    MathSciNet  Google Scholar 

  4. Kamimura S: The proximal point algorithm in a Banach space. In Nonlinear Analysis and Convex Analysis. Yokohama Publishers, Yokohama; 2004:143–148.

    Google Scholar 

  5. Kamimura S, Kohsaka F, Takahashi W: Weak and strong convergence theorems for maximal monotone operators in a Banach space. Set-Valued Anal. 2004, 12: 417–429. 10.1007/s11228-004-8196-4

    Article  MathSciNet  Google Scholar 

  6. Güler O: On the convergence of the proximal point algorithm for convex minimization. SIAM J. Control Optim. 1991, 29: 403–419. 10.1137/0329022

    Article  MathSciNet  Google Scholar 

  7. Kohsaka F, Takahashi W: Strongly convergent net given by a fixed point theorem for firmly nonexpansive type mappings. Appl. Math. Comput. 2008, 202: 760–765. 10.1016/j.amc.2008.03.019

    Article  MathSciNet  Google Scholar 

  8. Cioranescu I: Geometry of Banach Spaces, Duality Mappings and Nonlinear Problems. Kluwer Academic, Dordrecht; 1990.

    Book  Google Scholar 

  9. Takahashi W: Nonlinear Functional Analysis. Yokohama Publishers, Yokohama; 2000.

    Google Scholar 

  10. Alber YI: Metric and generalized projection operators in Banach spaces: properties and applications. Lecture Notes in Pure and Appl. Math. 178. In Theory and Applications of Nonlinear Operators of Accretive and Monotone Type. Dekker, New York; 1996:15–50.

    Google Scholar 

  11. Kamimura S, Takahashi W: Strong convergence of a proximal-type algorithm in a Banach space. SIAM J. Optim. 2002, 13: 938–945. 10.1137/S105262340139611X

    Article  MathSciNet  Google Scholar 

  12. Kohsaka F, Takahashi W: Existence and approximation of fixed points of firmly nonexpansive-type mappings in Banach spaces. SIAM J. Optim. 2008, 19: 824–835. 10.1137/070688717

    Article  MathSciNet  Google Scholar 

  13. Aoyama K, Kohsaka F, Takahashi W: Three generalizations of firmly nonexpansive mappings: their relations and continuity properties. J. Nonlinear Convex Anal. 2009, 10: 131–147.

    MathSciNet  Google Scholar 

  14. Kohsaka F, Takahashi W: Fixed point theorems for a class of nonlinear mappings related to maximal monotone operators in Banach spaces. Arch. Math. 2008, 91: 166–177. 10.1007/s00013-008-2545-8

    Article  MathSciNet  Google Scholar 

  15. Rockafellar RT: On the virtual convexity of the domain and range of a nonlinear maximal monotone operator. Math. Ann. 1970, 185: 81–90. 10.1007/BF01359698

    Article  MathSciNet  Google Scholar 

  16. Barbu V: Nonlinear Semigroups and Differential Equations in Banach Spaces. Editura Academiei Republicii Socialiste România, Bucharest; 1976.

    Book  Google Scholar 

  17. Takahashi W: Convex Analysis and Approximation of Fixed Points. Yokohama Publishers, Yokohama; 2000. (in Japanese)

    Google Scholar 

  18. Rockafellar RT: On the maximality of sums of nonlinear monotone operators. Trans. Am. Math. Soc. 1970, 149: 75–88. 10.1090/S0002-9947-1970-0282272-5

    Article  MathSciNet  Google Scholar 

  19. Zălinescu C: Convex Analysis in General Vector Spaces. World Scientific, River Edge; 2002.

    Book  Google Scholar 

  20. Rockafellar RT: On the maximal monotonicity of subdifferential mappings. Pac. J. Math. 1970, 33: 209–216. 10.2140/pjm.1970.33.209

    Article  MathSciNet  Google Scholar 

  21. Brøndsted A, Rockafellar RT: On the subdifferentiability of convex functions. Proc. Am. Math. Soc. 1965, 16: 605–611. 10.1090/S0002-9939-1965-0178103-8

    Article  Google Scholar 

Download references

Acknowledgements

The author would like to thank the anonymous referees for carefully reading the original version of the manuscript. The author is supported by Grant-in-Aid for Young Scientists No. 25800094 from the Japan Society for the Promotion of Science.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fumiaki Kohsaka.

Additional information

Competing interests

The author declares that he has no competing interests.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kohsaka, F. An implicitly defined iterative sequence for monotone operators in Banach spaces. J Inequal Appl 2014, 181 (2014). https://doi.org/10.1186/1029-242X-2014-181

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1029-242X-2014-181

Keywords