We introduce and study alternating minimization algorithms of the following type (x0,y0)X×Y,α,μ,ν>0\mboxgiven,(xk,yk)(xk+1,yk)(xk+1,yk+1)\mboxasfollows{xk+1=\mboxargmin{f(ξ)+μ2Q(ξ,yk)+α2ξxk2: ξX}yk+1=\mboxargmin{g(η)+μ2Q(xk+1,η)+ν2ηyk2: ηY}\begin{array}{c} (x_0,y_0)\in\X\times\Y,\: \alpha,\mu,\nu>0\mbox{ given},\\ \rule{0pt}{12pt} (x_k,y_k)\rightarrow(\xku,y_k)\rightarrow(\xku,\yku)\mbox{ as follows} \\ \rule{0pt}{12pt} \left\{\begin{array}{l} \xku=\mbox{argmin} \{f(\xi)+\frac{\mu}{2}Q(\xi,y_k)+ \frac{\alpha}{2}\parallel\xi-x_k\parallel^2:\ \xi\in\X\}\\ \rule{0pt}{12pt} \yku=\mbox{argmin} \{g(\eta)+\frac{\mu}{2}Q(\xku,\eta)+\frac{\nu}{2} \parallel\eta- y_k\parallel^2:\ \eta\in\Y\} \end{array}\right. \end{array} where X\X and Y\Y are real Hilbert spaces, f:XR{+}f:\X\to\R\cup\{+\infty\}, g:YR{+}g:\Y\to\R\cup\{+\infty\} are closed convex proper functions, Q:(x,y)X×YR+Q:(x,y)\in\X\times\Y\to\R^+ is a nonnegative quadratic form (hence convex, but possibly nondefinite) which couples the variables xx and yy. A particular important situation is the ``weak coupling'' Q(x,y)=AxBy2Q(x,y)=\parallel Ax-By\parallel^2 where AL(X,Z)A\in L(\X,\mathcal Z), BL(Y,Z)B\in L(\Y,\mathcal Z) are continuous linear operators acting respectively from X\X and Y\Y into a third Hilbert space Z\mathcal Z. \par The ``cost-to-move'' terms ξx2\parallel\xi-x\parallel^{2} and ηy2\parallel\eta-y\parallel^{2} induce dissipative effects which are similar to friction in mechanics, anchoring and inertia in decision sciences. As a result, for each initial data (x0,y0)(x_0,y_0), the proximal-like algorithm generates a sequence (xk,yk)(x_k,y_k) which weakly converges to a minimum point of the convex function L(x,y)=f(x)+g(y)+μ2Q(x,y)L(x,y)=f(x)+g(y)+\frac{\mu}{2}Q(x,y). The cost-to-move terms, which vanish asymptotically, have a crucial role in the convergence of the algorithm. A direct alternating minimization of the function LL could fail to produce a convergent sequence in the weak coupling case. \par Applications are given in game theory, variational problems and PDE's. These results are then extended to an arbitrary number of decision variables and to monotone inclusions.

Contact details are reproduced from the original publication and may be historical.

Hedy Attouch

Inst. de Mathématiques et de Modélisation, UMR CNRS 5149, CC 51, Université Montpellier II, Place Eugène Batallion, 34095 Montpellier, France

attouch@math.univ-montp2.fr

Jérôme Bolte

Equipe Combinatoire et Optimisation, Université Paris 6, Place Jussieu, 75252 Paris, France

bolte@math.jussieu.fr

Patrick Redont

Inst. de Mathématiques et de Modélisation, UMR CNRS 5149, CC 51, Université Montpellier II, Place Eugène Batallion, 34095 Montpellier, France

redont@math.univ-montp2.fr

H. Attouch, J. Bolte, P. Redont, A. Soubeyran. “Alternating Proximal Algorithms for Weakly Coupled Convex Minimization Problems. Applications to Dynamical Games and PDE's.” Journal of Convex Analysis 15 (2008), No. 3, 485–506.