LaTex2Web logo

Documents Live, a web authoring and publishing system

If you see this, something is wrong

Table of contents

First published on Tuesday, Mar 11, 2025 and last modified on Saturday, May 9, 2026 by François Chaplais.

Cours d’optimisation
Enseignement spécialisé Année scolaire 2018-2019

Nicolas Petit Centre Automatique et Systèmes, Mines Paris - PSL

1 Optimisation continue de dimension finie

\[ \left\lVert x_{k+1}-x^*\right\rVert \leq r \left\lVert x_k-x^*\right\rVert \]
\[ \lim_{k\rightarrow\infty} \left\lVert x_{k+1}-x^*\right\rVert /\left\lVert x_k-x^*\right\rVert =0 \]
\[ \left\lVert x_{k+1}-x^*\right\rVert \leq M \left\lVert x_k-x^*\right\rVert ^2 \]
\[ x^{k+1}=x^k+l^k p^k \]
\[ f(x^{k+1})=f(x_k)-l^k \left\lVert \nabla f(x^k)\right\rVert ^2 + \circ(l^k) \]
\[ \lim_{k\rightarrow +\infty} f(x_k) = 0, \]
\[ \sum_{k\in\mathbb{N}} \left\lVert \nabla f(x^k)\right\rVert ^2 \]
\[ \lim_{k\rightarrow \infty}\left\lVert \nabla f(x^k)\right\rVert =0 \]
\[ (x^{k+1}-x^*)^T Q (x^{k+1}-x^*) \leq\left(\frac{\lambda_n-\lambda_1}{\lambda_n+\lambda_1}\right)^2(x^{k}-x^*)^TQ (x^{k}-x^*) \]
\[ q(x)=f(x^k)+\nabla f(x^k)^T(x-x^k)+\frac{1}{2}(x-x^k)^T\nabla^2 f(x^k) (x-x^k) \]
\[ \nabla f(x^k)+\nabla^2 f(x^k)(x-x^k)=0 \]
\[ p^k=-\left({B^k}\right)^{-1} \nabla f(x^k) \]
\[ {\mathbb{R}^n} \ni p \mapsto m^k(p)=f(x^k)+\nabla f(x^k)^T p + \frac{1}{2} p^T B^k p\in \mathbb{R} \]
\[ x^{k+1}=x^k+l^k p^k \]
\[ {\mathbb{R}^n} \ni p \mapsto m^{k+1}(p)=f(x^{k+1})+\nabla f(x^{k+1})^T p +\frac{1}{2} p^T B^{k+1} p\in \mathbb{R} \]
\[ s^k=x^{k+1}-x^k, \]
\[ y^k=\nabla f(x^{k+1})-\nabla f(x^k) \]
\[ B^{k+1} s^k=y^k \]
\[ (s^k)^T y^k>0 \]
\[ \nabla f(x^{k+1})^T s^k \geq c_2 \nabla f(x^k)^T s^k \]
\[ \begin{align*} U_1&=(B^k)^{-1} y^k\\ U_2&=s^k \\ a&=(y^k)^T (B^k)^{-1} y^k \\ b&=(y^k)^T s^k\end{align*} \]
\[ \begin{align*}B^{k+1}=B^{k} - B^{k} U \left( I_{(2)}+V^T B^{k} U\right)V^TB^{k}\end{align*} \]
\[ \begin{align*}B^{k+1}=&B^{k} + (\gamma^k)^2 y^k (s^k)^T B^{k} s^k (y^k)^T \\ &-\gamma^k y^k (s^k)^T B^{k} - \gamma^k B^{k}s^k (y^k)^T + y^k(y^k)^T\gamma^k\\ =&\left(I-\gamma^k y^k (s^k)^T\right) B^k \left(I-\gamma^k s^k(y^k)^T\right) + \gamma^k y^k (y^k)^T\end{align*} \]
\[ \begin{align*}\min_{\begin{array}{l}B^{-1}=B^{-T} \\ B^{-1} y^k=s^k\end{array}}\left\lVert B^{-1}-(B^k)^{-1}\right\rVert _W \end{align*} \]
1.2.6.1.1 Minimisation suivant les directions conjuguées
\[ \phi(x^{k+1})=\phi(x^k+l^k p^k)=\phi(x^k)+l^k (x^k)^T A p^k -b^T p^k l^k+\frac{1}{2}\left(l^k\right)^2 (p^k)^TAp^k \]
1.2.6.1.2 Calcul des directions conjuguées
\[ p^k=-r^k+\beta^k p^{k-1} \]
\[ \begin{align*}(p^i)^T A p^k= -(p^i)^TAr^k+\beta^k (p^i)^T A p^{k-1} =-(p^i)^TAr^k\end{align*} \]
\[ \begin{align*} A p^i \in A.{\textrm{Vect}}(r^0,A r^0,...,A^ir^0)={\textrm{Vect}}(A r^0,A^2 r^0,...,A^{i+1}r^0)\subset {\textrm{Vect}}(p^0,p^1,...,p^{i+1})\end{align*} \]
\[ (p^i)^T A r^k= \sum_{j=0}^{i+1}\gammaĵ(pĵ)^T r^k = 0 \]
\[ \delta f \approx \frac{\partial f}{\partial x} \delta x+ \frac{\partial f}{\partial u} \delta u \]
\[ 0 \approx \frac{\partial c}{\partial x} \delta x + \frac{\partial c}{\partial u} \delta u \]
\[ \delta f \approx \left(-\frac{\partial f}{\partial x} \left(\frac{\partial c}{\partial x}\right)^{-1} \frac{\partial c}{\partial u}+\frac{\partial f}{\partial u}\right) \delta u \]
\[ \frac{\partial {\mathcal L}}{\partial x}=0,~~ \frac{\partial {\mathcal L}}{\partial u}=0,~~\frac{\partial {\mathcal L}}{\partial \lambda}=0 \]
\[ {\mathcal L} (x^*,\lambda)\leq {\mathcal L} (x^*,\lambda^*) \leq{\mathcal L}(x,\lambda^*) \]
\[ \sup_{\lambda \in L}\inf_{x\in X} {\mathcal L} (x,\lambda)\leq \inf_{x\in X} \sup_{\lambda \in L} {\mathcal L} (x,\lambda) \]
\[ f(x)=\frac{1}{2} x^T G x + x^T d \]
\[ c(x)Āx-b\leq 0 \]

2 Optimisation de trajectoires

\[ X \ni u \mapsto J(u)īnt_{t_1}^{t_2} L(u(t),\dot u(t),t) dt \in\mathbb{R} \]
\[ \begin{align*}\int_{t_1}^{t_2} \left(\frac{\partial L}{\partial u} (u^*,\dot u^*,t)h(t) + \frac{\partial L}{\partial \dot u} (u^*,\dot u^*,t) \dot h(t) \right) dt =0\end{align*} \]
\[ \begin{align*}\int_{t_1}^{t_2} \left(\frac{\partial L}{\partial u} (u^*,\dot u^*,t) - \frac{d}{dt} \frac{\partial L}{\partial \dot u}(u^*,\dot u^*,t)\right) h(t) dt + \left[ \frac{\partial L}{\partial \dot u}(u^*,\dot u^*,t)h(t)\right]_{t_1}^{t_2}=0\end{align*} \]
\[ \begin{align*}\int_{t_1}^{t_2} \left(\frac{\partial L}{\partial u} (u^*,\dot u^*,t) - \frac{d}{dt} \frac{\partial L}{\partial \dot u}(u^*,\dot u^*,t)\right) h(t) dt =0\end{align*} \]
\[ X \ni u \mapsto J(u)īnt_{t_1}^{t_2} L(u(t),\dot u(t),...,u^{(n)},t) dt \in\mathbb{R} \]
\[ \frac{\partial L}{\partial u} - \frac{d}{dt} \frac{\partial L}{\partial \dot u} +\frac{d^2}{dt^2}\frac{\partial L}{\partial \ddot u}+...+ (-1)^n \frac{d^n}{dt^n}\frac{\partial L}{\partial u^{(n)}}=0 \]
\[ u\mapsto J(u)īnt_{t_1}^{t_2}L\left(u(x,y),\frac{\partial}{\partial x}u(x,y),\frac{\partial}{\partial y} u(x,y),x,y\right) dx~dy \in\mathbb{R} \]
\[ \frac{\partial L}{\partial u}-\frac{\partial}{\partial x} \left(\frac{\partial L }{\partial \frac{\partial}{\partial x} u}u(x,y)\right)-\frac{\partial}{\partial y}\left(\frac{\partial L}{\partial \frac{\partial}{\partial y} u} u(x,y)\right)=0 \]
\[ \dot x =f(x,u) \]
\[ X\times U \ni (x,u)\mapsto J(x,u)=\varphi(x(t_2),t_2) +\int_{t_1}^{t_2} L (x(t),u(t),t) dt \]
\[ \begin{align*}\bar J(x,u,\lambda)= J(x,u)+ \int_{t_1}^{t_2}\lambda(t)^T(f(x,u,t)-\dot x)(t) dt\end{align*} \]
\[ \begin{align*}\delta J =& \frac{\partial }{\partial x(t_2)} \varphi(x(t_2),t_2)\delta x(t_2) + \int_{t_1}^{t_2} \left(\frac{\partial }{\partial x}L(x,u,t) \delta x + \frac{\partial }{\partial u}L(x,u,t) \delta u \right) dt \\ =&\frac{\partial }{\partial x(t_2)} \varphi(x(t_2),t_2) \delta x(t_2)\\ & + \int_{t_1}^{t_2} \left( -\lambda(t)^T \frac{\partial}{\partial x}f(x,u,t)\delta x(t) - \dot \lambda(t)^T \delta x(t) -\lambda(t)^T \frac{\partial }{\partial u}f(x,u,t) \delta u(t)\right) dt \\ =&\frac{\partial }{\partial x(t_2)} \varphi(x(t_2),t_2) \delta x(t_2)- \lambda(t_2)^T\delta x(t_2)+\lambda(t_1)^T\delta x(t_1)\\ &+\int_{t_1}^{t_2} \lambda(t)^T\left(\dot {\delta x}(t)-\frac{\partial }{\partial x}f(x,u,t)\delta x(t) - \frac{\partial}{\partial u}f(x,u,t)\delta u(t) \right) dt\\ &=\circ(\delta)\end{align*} \]
\[ X\times U \ni (x,u)\mapsto J(x,u)=\varphi(x(t_2),t_2) +\int_{t_1}^{t_2} L (x(t),u(t),t) dt \]
\[ \begin{align*}\min_{\begin{array}{l}\dot x =f(x,u)\\ x(t_1)=x^0\end{array}}J(x,u)\end{align*} \]
\[ X\times U \ni (x,u)\mapsto J(x,u)=\varphi(x(t_2),t_2) +\int_{t_1}^{t_2} L (x(t),u(t),t) dt \]
\[ \dot\delta x(t)=\frac{\partial f}{\partial x}(x,u,t) \delta x(t) + \frac{\partial f}{\partial u} (x,u,t) \deltau(t)+\circ(\delta) \]
\[ \delta x(t)= M(t,t_1) \delta x(t_1) + \int_{t_1}^t M(t,\tau)\frac{\partial f}{\partial u}(x,u,\tau) \delta u(\tau) d \tau + \circ(\delta) \]
\[ \dot\delta x(t)=\frac{\partial f}{\partial x}(x,u,t) \delta x(t) + \frac{\partial f}{\partial u} (x,u,t) \delta u(t)+\circ(\delta) \]
\[ \dot \lambda(t)=-\left(\frac{\partial f}{\partial x}(x,u,t)\right)^T \lambda(t) - \left(\frac{\partial L}{\partial x}(x,u,t)\right)^T \]
\[ \delta J = \int_{t_1}^{t_2} \left( \frac{\partial L}{\partial u}(x,u,t) + \lambda^T \frac{\partial f}{\partial u}(x,u,t)\right) \delta u(t)dt+\circ(\delta)īnt_{t_1}^{t_2} \frac{\partial H}{\partial u}(x,u,\lambda,t) \delta u(t) dt+\circ(\delta) \]
\[ X\times U \ni (x,u)\mapsto J(x,u)=\varphi(x(t_2),t_2) +\int_{t_1}^{t_2} L (x(t),u(t),t) dt \]
\[ \frac{\partial H}{\partial u} = - \mu^T \frac{\partial C}{\partial u} \]
\[ X\times U \ni (x,u)\mapsto J(x,u)=\varphi(x(t_2),t_2) +\int_{t_1}^{t_2} L (x(t),u(t),t) dt \]
\[ J(x,u)\geq {\mathcal J}(x^0,t_1) \]
\[ J(x,u)= \int_{t_1}^{t_1+\delta t}L(x(t),u(t),t)dt+{\mathcal J}(x(t_1+\delta t),t_1+\delta t) \]
\[ \begin{align*}J(x,u)=&L(x^0,u(t_1),t_1)\delta t+{\mathcal J}(x^0,t_1) + \frac{\partial{\mathcal J}}{\partial x}(x^0,t_1) f(x^0,u(t_1),t_1)\delta t\\ &+\frac{\partial {\mathcal J}}{\partial t}(x^0,t_1)\delta t +\circ(\delta t)\end{align*} \]
\[ \begin{align*}{\mathcal J}(x^0,t_1)= &{\mathcal J}(x^0,t_1)+\circ(\delta t) + \\ &\left(\min_u \left(L(x^0,u(t_1),t_1)+\frac{\partial {\mathcal J}}{\partial x}(x^0,t_1) f(x^0,u(t_1),t_1) \right)+\frac{\partial {\mathcal J}}{\partial t}(x^0,t_1)\right)\delta t\end{align*} \]
\[ \begin{align*}-\frac{\partial {\mathcal J}}{\partial t}= \min_u \left(L(x,u,t)+\frac{\partial {\mathcal J}}{\partial x} f(x,u,t) \right)\end{align*} \]

3 Exercices 1

\[ f(x)=100(x_2-x_1^2)^2+(1-x_1)^2 \]
\[ x_k=\left\{ \begin{array}{l}\left(\frac{1}{4}\right)^{2^k}, \text{ si } k \text{ pair} \\ (x_{k-1})/k, \text{ si } k \text{ impair}\end{array}\right. \]
\[ \min_{x\in\mathbb{R}^n} \| Ax-b\| \]

4 Exercices 2

\[ \mathbb{R}^2 \ni (x_1,x_2)\mapsto f(x_1,x_2)=\exp(x_1+x_2-2)+(x_1-x_2)^2 \]
\[ \mathbb{R}^2 \ni (x_1,x_2)\mapsto q(x_1,x_2)=x_1^2+2 x_2^2+x_1x_2 -x_1 -2 x_2 \]
\[ B_{k+1}=B_k+\frac{(y_k-B_k s_k)(y_k-B_k s_k)^T}{(y_k-B_k s_k)^Ts_k} \]
\[ H_{k+1}=H_k+\frac{(s_k-H_k y_k)(s_k-H_k y_k)^T}{(s_k-H_k y_k)^Ty_k} \]
\[ \mathbb{R}^2 \times \mathbb{R}^* \ni(x_1,x_2,x_3)\mapsto \left(x_1x_2 \sin x_3 + \exp(x_1x_2)\right)/x_3 \]
\[ \begin{align*} x_4=x_1 x_2\\ x_5 = \sin x_3\\ x_6 = \exp{x_4} \\ x_7 = x_4 x_5 \\ x_8 = x_6 + x_7\\ x_9= x_8/x_3 \end{align*} \]

5 Exercices 3

\[ \min_{c(x)=0} f(x) \]
\[ \nabla f(x) + \nabla c(x)^T \lambda=0,~~c(x)=0 \]
\[ M(x,\lambda)=\|\nabla f(x) + \nabla c(x)^T \lambda \|^2+\|c(x)\|^2 \]
\[ \min_{x+y=1} \frac{1}{3} x^3 + \frac{1}{2} y^2 \]
\[ \min_{Ax\geq b} \frac{1}{2} x^T G x +x^T d \]
\[ \max_{Gx+d-A^T\lambda=0,\lambda\geq 0} \frac{1}{2} x^T G x +x^T d -\lambda^T(Ax-b) \]
\[ \max_{\lambda\geq 0} -\frac{1}{2}\lambda^T (AG^{-1}A^T)\lambda +\lambda^T (b+AG^{-1} d) -\frac{1}{2} d^T G^{-1} d \]
\[ \min_{Ax=b} \frac{1}{2} (x-x_0)^T (x-x_0) \]
\[ \lambda^*=-(AA^T)^{-1}(b-Ax_0) \]
\[ x^*=x_0+A^T(AA^T)^{-1}(b-A x_0) \]
\[ \frac{|b-Ax_0|}{\|A\|} \]

6 Exercices 4

\[ \begin{align*}\dot x&=V \cos \theta +u,\\ \dot y&=V \sin\theta\end{align*} \]
\[ Aīnt_0^T y \dot x dt. \]
\[ \int_0^T \exp(-\beta t) E(t) dt. \]
\[ \dot x(t) = \alpha x(t)-r(t). \]

7 Exercices et problèmes complémentaires

\[ \begin{align*}J(y_1,y_2)=(\frac{y_1}{2}-a)^2+ (y_2-b)^2\end{align*} \]
\[ \begin{align*}y_1^2+y_2^2 \leq 1\\ y_1 \geq 0 \\ y_2 \geq 0.\end{align*} \]
\[ \begin{align*} \dot x &= u \\ \dot u &= a \cos \beta \\ \dot y &= v \\ \dot v &= a \sin \beta\end{align*} \]
\[ \tan \beta =\frac{a+bt}{c+dt}. \]
\[ \min_{x\in \mathbb R^3} \sum_{i=1}^m m_i\parallel x-y_i\parallel \]
\[ \begin{align*}Jīnt_{t_0}^{\infty}(x^2+u^2) dt\end{align*} \]
\[ \begin{align*}\dot x = -x^4+u\end{align*} \]
\[ \begin{align*}\min \phi(x(t_f),t_f) +\int_{t_0}^{t_f} L(x(t),u(t),t) dt\end{align*} \]
\[ \begin{align*}x(t_0)ā \text{ (donné) }, \dot x(t)=f(x(t),u(t),t),\psi(x(t_f),t_f)=0\end{align*} \]
\[ J(x)īnt_0^1 (\ddot x(t))^2dt \]
\[ x(0)=\dot x(0)=x(1)=0, ~ \dot x(1)=1 \]
\[ q(x)=\frac{(x^T x)^2}{(x^T Q x) (x^T Q^{-1} x)}\geq \frac{4aA}{(a+A)^2} \]
\[ (\nabla J(v)-\nabla J(u))^T(v-u) \geq \alpha \left\lVert u-v\right\rVert ^2 \]
\[ {\mathcal U}=\left\{u\in \mathbb{R}^n \text{ tels que } \phi_i(u)\leq 0, ~ 1\leq i\leq m\right\} \]
\[ \begin{align*}\int_0^1 (y(x))^{2k} dx \leq C \int_0^1 (y'(x))^{2k} dx\end{align*} \]
\[ \int_0^L (x(l)-z(l))^2 dl \]
\[ \dot x ū, ~ \left\lvert u\right\rvert \leq a, ~ a>0 \text{ donnée.} \]
\[ \left\lVert y\right\rVert ^2=<y,y>īnt_a^b \left\lVert y(t)\right\rVert ^2 dt <+\infty \]
\[ \left\lVert x_0\right\rVert \leq \left\lVert v\right\rVert , ~ \forall v \in V \]
\[ \frac{d}{dt} \theta_b=\frac{a}{2} u^2 - b \theta, ~ \frac{d}{dt} \theta = c u - k \theta, ~ \frac{d}{dt} \xi = D(t)-u \]
\[ \theta_b(0), ~ \theta(0), ~ \xi(0) \]
\[ M^1=\left[\begin{array}{ccccc}0 & 3 & 7 & +\infty & -3 \\ +\infty & 0 & +\infty & 1 & 6\\ +\infty & 4 & 0 & +\infty &+\infty\\ 3 & +\infty & -4 & 0 & +\infty \\ +\infty & +\infty & +\infty & 5 &0\end{array}\right] \]
\[ c: [0,~L]\ni s \mapsto c(s)\in \mathbb R^2 \]
\[ Jīnt_0 ^1 L(x(t),u(t))dt + \varphi(x(1)) \]
\[ \phi(x(\tau^-))=0 \]
\[ x(\tau^+)=x(\tau^-)-\Delta \]
\[ c(x,y,z)= x^2/a^2+y^2/b^2+z^2/c^2-1=0 \]
\[ f(x,y,z)=8 xyz \]
\[ \min \frac{K}{2} (x(T)-L/2)^2+\int_0^T y(\tau)^2 d\tau \]
\[ \begin{align*}&\dot x = \cos \theta\\ &\dot y = \sin \theta\\ &\dot \thetaū\\ &u\in [-\alpha, \alpha]\\ &x(0)=0, ~y(0)=0, ~\theta(0)=0, ~y(T)=0, ~\theta(T)=0\end{align*} \]
\[ \int_{pays} f(x(z)) dz \]
\[ f(x) \geq f(y) \text{ implique } f'(x) \leq f'(y) \]
\[ \min_x J(x), ~ {\text{sous les contraintes}} ~ g_i(x)\leq 0i=1...m \]
\[ \min_{x\in \mathbb R^n} J(x)+\epsilon \sum_{i=1}^m\gamma(g_i(x)), ~ \epsilon>0 \]
\[ J_k(x)=J(x)+\epsilon_k p(x)\triangleq J(x)+\epsilon_k \sum_{i=1}^m\gamma(g_i(x)) \]
\[ \begin{align*}\dot r&= -u h(u)\\ \dot p&ū v + \epsilon p\end{align*} \]
\[ \min_{x=(x_1,...,x_n) \in \mathbb R^n} f(x), ~ f(x)īnt_{-1}^1 \left( t^n -\sum_{k=1}^n x_k t^{k-1} \right)^2dt \]
\[ \min \frac{1}{2}\int_{t_1}^{t_2} x_1^2(t) dt \]
\[ \dot x_1= x_2+u, ~ \dot x_2= -u, ~ x_1(t_1)ā , ~ x_2(t_1)=b, ~ x_1(t_2)=x_2(t_2)=0 \]
\[ \min t_2-t_1 \]
\[ \dot x Āx+Bu, ~ x\in \mathbb{R}^n, ~ u \in \mathbb{R}, ~ a \leq u(t) \leq b, ~ x(t_1)=\alpha, ~ x(t_2)=\beta \]
\[ \begin{align*}\dot x(t) =& A(t) x(t) + B(t) u\end{align*} \]
\[ \begin{align*}x(t_f) =& x_f\end{align*} \]
Figure 7. Différents réglages de la commande LQR.
\[ E_i=\{a \; | \; D_i a\leq d_i\}\subset \mathbb{R}^n, ~ F_i=[\gamma_i,\mu_i]\subset \mathbb{R} \]

Notes

References

[1] J. Nocedal and S. J. Wright Numerical Optimization Springer 1999 Springer Series in Operations Research

[2] M. Minoux Programmation Mathématique. Théorie et algorithmes Dunod 1983 1, 2

[3] User's Guide for NPSOL 5.0: A Fortran Package for Nonlinear Programming P. E. Gill and W. Murray and M. A. Saunders and M. A. Wright Systems Optimization Laboratory Stanford University, Stanford, CA 94305 1998

[4] P. E. Gill and W. Murray and M. A. Saunders R. Bulirsch and D. Kraft Large-scale SQP Methods and their Application in Trajectory Optimization 1 Birkhäuser Verlag 1994

[5] V. M. Tikhomirov Stories about Maxima and Minima American Mathematical Society 1990 Mathematical World. Volume 1

[6] W. H. Press and B. P. Flanerry and S. A. Teukolsky and W. T. Vetterling Numerical Recipes: The Art of Scientific Computing New York:Cambridge University Press 1986

[7] F. Bonnans The Shooting Algorithm for Optimal Control Problems: A Review of Some Theoretical and Numerical Aspects INRIA 2002 Notes de cours, http://www-rocq.inria.fr/sydoco/cours/tutorial.html

[8] S. M. Roberts and J. S. Shipman Two-point boundary value problems: shooting methods American Elsevier 1972

[9] L. Pontryagin and et al. Théorie Mathématique de Processus Optimaux Editions Mir, Moscou 1974

[10] Mathworks Optimization Toolbox The Math Works Inc. 2002 User's guide, http://www.mathworks.com

[11] S. P. Banks and K. Dinesh Approximate Optimal Control and Stability of Nonlinear Finite- and Infinite-Dimensional Systems Annals of Operations Research 2000 98 1 19–44 10.1023/A:1019279617898

[12] J. R. Leigh Functional analysis and linear control theory Academic Press Inc. 1980

[13] B. T. Polyak Convexity of nonlinear image of a small ball with applications to optimization Set-Valued Analysis 2001 9 1-2 159–168

[14] J. J. Mor‚ and S. J. Wright Optimization Software guide SIAM 1993 Frontiers in Applied Mathematics

[15] D. P. Bertsekas Nonlinear programming Athena Scientific 1999 2

[16] J.-B. Hiriart-Urruty Optimisation et analyse convexe Presses Universitaires de France 1998

[17] S. Boyd and L. Vandenberghe Convex optimization Cambridge University Press 2004

[18] E. Polak Optimization - Algorithms and Consistent Approximations Springer-Verlag 1998

[19] D. G. Luenberger Optimization by vector spaces methods Wiley 1969

[20] I. M. Gelfand and S. V. Fomin Calculus of variations Dover 2000

[21] A. E. Bryson and Y. C. Ho Applied Optimal Control Ginn and Company 1969

[22] A. E. Bryson Dynamic Optimization Addison-Wesley 1999

[23] A. R. Forsyth Calculus of variations Cambridge at the University Press 1927

[24] L. V. Kantorovich and V. I. Krylov Approximate methods of higher analysis Interscience Publishers, Inc. - New York 1964

[25] H. J. Sussmann and J. C. Willems 300 years of optimal control: from the brachystochrone to the maximum principle IEEE 1997 32–44 disponible sur https://sites.math.rutgers.edu/ sussmann/

[26] A. D. Aleksandrov and A. N. Kolmogorov and M. A. Lavrent'ev Mathematics. Its contents, methods and meaning The M. I. T. Press 1969

[27] R. Courant and D. Hilbert Methods of Mathematical Physics Interscience 1962 2

[28] L. P. Lebedev and M. J. Cloud The calculus of variations and functional analysis World Scientific Publishing Co. 2003 12 Series on stability, vibration and control of systems

[29] G. Allaire Analyse numérique et optimisation. Cours de l'École Polytechnique École Polytechnique 2004

[30] D. P. Bertsekas Dynamic Programming and Optimal Control Athena Scientific 2001 1, 2 2

[31] S. E. Dreyfus and A. M. Law The art and theory of dynamic programming Academic Press 1977

[32] J.-Ch. Culioli Introduction à l'optimisation Ellipses 1994