This content was uploaded by our users and we assume good faith they have the permission to share this book. If you own the copyright to this book and it is wrongfully on our website, we offer a simple DMCA procedure to remove your content from our site. Start by pressing the button below!
. If we set y, = z , + 6 , we get d
-Y, at
-
AY, +
P"(Y,
-
$1 = f
in
Q, (2.10)
345
5.2. Boundary Control of Parabolic Variational Inequalities
We may write Eq. (2.10) as d
-y, df
where
.,(X7f)
=
-
I
Y,(X,O) =Yo(X) Y, = u 1 2
(Y,
=
4v2 2E2 -
-(l/EXy,
1 + ;(ye-
9)
in Q,
in a , in C.,
ify,-
-
0
We set 8,
Ay, - E-'(Y, - * ) - = f + v,
(2.11)
@ <- E ,
if
-*so,
if y, - JI > 0. (2.12)
-
+>-.We have
and
Multiplying Eq. (2.11) by IS,lp-2S, and integrating on Q, we get, after some calculation involving the Holder inequality,
and so, by Gronwall's lemma,
5. Optimal Control of Parabolic Variational Inequalities
346
Finally, by estimate (2.13) we see that, on a subsequence, y,
--f
weakly in
y
w,','(Q)
and, in particular,
Y& + Y
dyE dt
P " ( Y & - JI)
--f
+
in L 2 ( 0 , T ;Hi(fl)),
2 dt
weaklyin L 2 ( Q ) ,
77
weakstar in L " ( 0 , T ; L P ( f l ) ) .
(2.15)
We have, therefore, dY --Ay+7=0 dt y(0) = y o , y = u
inQ, (2.16)
in 2
This implies that dY jQ(z(y-z) +Vy.V(y-z)
for all z
E
K
=
{z
=
E
dxdt+
jQ7 7 ( y - z ) d x d t 2 0
(2.17)
W?'(Q); z 2 0). Since
j Q 7 ( x , t ) ( y ( x , t )- z ) d x d t > O
VZEK,
We infer by (2.15) and (2.16) that y is the solution to Eq. (2.11, i.e., ~ ( xt ), E P ( y ( x , t ) - + ( x ) ) a.e. ( x , t ) E Q. Estimate (2.5) is implied by (2.13) and (2.141, whilst the uniqueness is obvious. As seen earlier in Chapter 4 (Eq. (3.13)), perhaps the most important physical model for problem (2.1) is the one phase Stefan problem describing the melting process of a solid. 5.2.2. The Optimal Control Problem
We shall study here the optimal control problem: g ( t , y ) ) d t + 4 ( u ) + cpo(y(T))
(2.18)
5.2. Boundary Control of Parabolic Variational Inequalities
on ally E WpZ"(Q) and u E W2-1/P*1-1/2P (I;),p > ( N the state system (2.1) and to the constraints u 2 0
in I;,
u(x,O) = y , ( x )
+ 2)/2,
in R.
347
subject to (2.19)
(For simplicity, we take I(I = 0.1 Here, g : [O, TI x L2(R) + R ' , p,: L2(R) + R + are locally Lipschitz and 6:W2-1/p*1-1'2p(2) + R is a lower semicontinuous convex function such that for all u E D(+),u 2 0 a.e. in 2, u(x,O) = y , ( x ) Vx E dR. The latter assumption allows us to incorporate the control constraints (2.19) into the cost functional of problem (2.18). We set XP = W2-1/P,1-1/2P(I;) and denote by Ill . Illp the natural norm of X p . Theorem 2.1. Let ( y * ,u * ) E W:('Q) X X p be an optimal pair for problem (2.18). Then there is 6 E L2(Q), p E L"(0, T ; L2(R)) n L2(0,T ; H,'(R)) n BV([O,TI; H-'(R)), s > N/2 such that
(2.20) y*
=
0,
6 E dg(t,y*)
Ay* - f ) p
=
o
dP
- - E a+(u*) dU
We note that the product y * ( p , + A p 'c C@>. w
p
'
a x . in Q , (2.21)
a.e. in Q, in I;.
(2.22) (2.23)
6 ) makes sense because y*
E
g
Prooj We shall use the standard method. Consider the approximating control problem:
Minimize
subject to (2.1), (2.19).
348
5. Optimal Control of Parabolic Variational Inequalities
Here, g" and ppo"are defined as in the previous cases and, since the map
u - + y is compact from X p to C(is>, it follows by a standard device that
problem (2.24) has for every E > 0 at least one solution ( y , , u s ) E Wp'.'(Q) x X p . Moreover, using Lemma 2.1 and arguing as in the proof of Proposition 1.2, it follows that, for E 0, -+
u,
-+
y,
+y*
p"( y , )
u*
+
strongly in X p , strongly in
f + by*
T2v1( Q) c C ( e), (2.25)
weakly in LP( Q).
- y:
Now let p , E H 2 -'(Q) n L2(0,T; H,'(R)) be the solution to the boundary value problem
JP,
+ AP, dt
- P , ~ " ( Y , )=
in C,
p,= 0 P,(V
in Q,
Vg"(t,y,)
+ Vqo,"(Y&(T))= 0
in
a.
(2.26)
Then, by a little calculation, we find that
-+ dP, dv
d+(u,)
+ F ( u , - u*) 3 0
(2.27)
in 2 ,
where F: X p -+ X; is the duality mapping of X p and d+: X p -+ X; is the subdifferential of 4. Now multiplying Eq. (2.26) by p , and sign p , , we get the estimate
kT
l l ~ , ( t ) l I & (+~ )
Ilp,(t)llk:(n) dt +
/n I
b"(y,)p,l h d t
IC .
(2.28)
Hence, on a subsequence, we have (see the proof of Proposition 1.2)
P , -+P
stronglyin L2(Q),weaklyin L 2 ( 0 , T ;H , ' ( Q ) ) , weak star in L"(0, T; L 2 ( a ) ) ,
p,(t)
-+
p(t)
strongly in
a ) for every t E [0, T I ,
where p E BV([O,TI; H-'(R)), s > N/2. Moreover, there is p such that, on a generalized subsequence of { E } ,
BE(y , ) p ,
+
p
E
weak star (vaguely) in ( Lm( Q))* .
(2.29) (L"(Q))*
349
5.2. Boundary Control of Parabolic Variational Inequalities
Then, letting
E
tend to zero in Eq. (2.26), we get dP
+Ap dt
-p E
in Q ,
dg(t,y*)
in R ,
P ( T ) + dcp,(Y*(T)) 3 0 p = o
In other words, 35 E L2(Q),t ( x , t ) that
E
in
X.
(2.30)
d g ( t , y * X x , t ) a.e. ( x , t )
E
Q, such
for all cp E L2(0,T ; H,'(R)) n L'(Q) such that d q / & E L2(0,T ; H-'(R)) and cp(x,O) = 0. Moreover, by (1.46) and (1.47), we have p,P"(y,) + p ( f p , b E ( y E ) y E+ o
JY *
7+ A Y * ) = 0
stronglyin L ' ( Q ) ,
strongly in L ' ( Q ) .
Then, by (2.29, we infer that PY*
=
0,
and Eqs. (2.20, (2.22) follow. Now, let x E Wp2"(Q)be the solution to the boundary value problem JX
--Ax=O dt x=w x(x,O) = xo(x)
in C, in a,
where w E X p , xo E W;-2/p(R) and x0(x) = w ( x , 0) a.e. x by Lemma 2.1,
II xIIw2.1p( Q ) IC( 111 w III p + II
(2.31) E
R. Then,
xOIIW,~-~/P(~~)).
On the other hand, by the trace theorem (see, e.g., Ladyzhenskaya et al. [l]) we may choose xo E W;-2/p(R) such that xo = w(*,O)in dR and
II
XJIw;-2/P(n)
ICllw(0, *)llW,2-%(R)
c 111 w 111 p .
I
350
5. Optimal Control of Parabolic Variational Inequalities
With such a choice, we have
II XIlW,2.'(Q,
I Cllwll,
vw E
xp.
(2.32)
Now multiplying Eq. (2.30) by y, and integrating on Q, after some calculation we get
/ 151Ixldxdl
IIIL(X)I+
Q
(I xol IP,(X,O)I
+ l P & ( X , T)I I x ( x , T)I) h,
and by estimate (2.32) and the trace theorem, we get
Hence, { d p , / d u ) is bounded in X * p (the dual of X p >and, letting zero in Eq. (2.29, it follows by (2.27) that
E
tend to
as claimed. We will consider now a variant of problem (2.18). Minimize on ally system
E
W,'.'(Q>,u dY
E
i T g ( t , y ( t ) ) dt
+ po(y ( T ) )
(2.33)
LYO, T ) , and u E W'*l0([O, TI), subject to the state
dt - AY = f o
in { ( x , t ) E
Q ;y ( x , t ) > 01,
Y =go(x)u(t) in c, in x E a, y(x,O) = 0, u' + f ( u ) = u a.e. t E ( O , T ) , u ( 0 ) = 0,
(2.34a) (2.34b)
5.2. Boundary Control of Parabolic Variational Inequalities
351
and to the control constraints a.e. t
0 5 u ( t ) IM
k T u ( t )dt Here, f o
E
LP(Q), go
E
W:-'/P(dil),
=
E
(2.35)
L.
p >(N
g o 2 0 indil,
(O,T),
+ 2)/2,
and (2.36)
O<MT
The function f : R -+ R is Lipschitz and continuously differentiable. Denote by Uo c LYO, T ) the class of functions u satisfying the constraints (2.35). To be more specific, we shall assume that g(t,y) =
1g ' ( y ( x ) )dx,
4oo(Y)
n
where g': R + R, i ing the conditions
=
=
1S 2 ( Y W ) n
Y
d x 7
E
L2(W
1,2 are continuously differentiable functions satisfy-
+ lyl)
g ' ( y ) 2 -C(1
Vy E R,i
=
(2.37)
1,2.
Theorem 2.2. Let ( y * , u * ) be optimal for problem (2.33). Then there are p E L2(0,T ; H,'(Q)) n BV([O,TI; H-'((n)) n L"(0, T ; L2(il)>and q E AC([O,TI) such that dP
dt + Ap
=
p
=
0
in [ y *
P
=
0
in 2 ,
q ' ( t ) - f ' ( u * ( t ) ) q ( t )=
-g:(y)
=
in [ y * > 01,
0, f o z 01,
p ( x , T ) = -g,2(y*(x,T)),
1'1 go zdPd x d s I
q ( T ) = 0,
an
a.e. t
E
(2.38) (O,T), (2.39)
where h is some real number. Proo& Since the proof is essentially the same as that of Theorem 2.1, it will be sketched only.
352
5. Optimal Control of Parabolic Variational Inequalities
Consider the approximating penalized problem: Minimize
{ / Q g ' ( y ( x , t ) ) dxdt
1
LT(
+
+ / g ' ( y ( x , T ) ) dx n
(2.41)
u( t ) - u*( t ) ) 2dt
on all ( y , u, u ) , subject to dY
-at
AY + P e ( y ) = f o
in Z,
y =g,u
in
Q, inn,
y(x,O) = O
and to constraints (2.34b), (2.35). If ( y * , u * , u * ) is optimal for problem (2.411, it follows as before that u, -,u*
strongly in ~ ' ( 0T,) ,
ye -,y *
strongly in W,'.'(Q),
u, -, u*
strongly in w','( [0, T I ) .
On the other hand, problem (2.41) has the following optimality system: dP&
-+
dt
Pe
=
0
in Z,
p,(x,T)
=
-g,2(ye(x,T)),
x E
q:(t) -f'(ve(t))qe(t)
qe(T)
q,(t)
in
Ape - P"(Ye)Pe = g i ( Y e )
+ u*(t) - u,(t)
E
=
lTd'
=
0,
Q,
a,
(2.42)
/ang o ( x ) 'Pe du, (2.43)
dh(u,)(t)
a.e. t
E
( O , T ) , (2.44)
where dh: L2(0,T ) -,L2(0,T ) is the subdifferential of the indicator function h to the subset U,,i.e., h(u)
=
if u E U,, otherwise.
Now, we may represent dh as (see, e.g., Section 2 in Chapter 2) dh(u)
=
dh,(u)
+ dh,(u),
u E L*(O,T),
5.2. Boundary Control of Parabolic Variational Inequalities
353
where h , is the indicator function of {u E L2(0,T ) ; 0 Iu IM a.e. in (0, T)) and h , is the indicator function of {u E L2(0,T ) ; :/ u ( t ) dt = L). As shown earlier, we have dh,(u)
= {w E
L~(O,T); w(t)
=
o a.e. in [ t ; o < u ( t ) < M I ,
w 2 0 a.e. in [ t ; u ( t ) and dh,(u) = {A
E
w 2 0 a.e. in [ t ; u ( t )
=MI,
=
O]}
R). Then, by (2.441, we see that
+ u*(t) - u,(t)
a.e. in [ t ; q , ( t )
=
< A,],
(2.44)‘
where A, E R. Now using the standard estimate for the solution p , to Eq. (2.42), it follows that, on a subsequence, stronglyin H - ” ( R ) , V t E [ O , T ] ,
p,(t) + p ( t )
strongly in L 2 ( Q ) weakly , in L 2 ( 0 , T ;Hj(R)),
PE + P
where s > N/2 and p
E
B”(Y&)P,
BV([O,TI; H - ” ( R ) ) Moreover, . we have +
weak star in (L”( Q ) ) * ,
P
aPE aP + dV
weakly in Xp* .
dV
Then, letting E tend to zero in the system (2.42H2.441, we see that p satisfies the system JP
+ Ap dt
-p
=g:(y*)
in Q,
P ( X , T ) = -g,’(y*(x, T ) ) q r ( t ) - f ’ ( u * ( t ) ) q ( t )=
Y,, in a, in
p = o
1‘1
d n
t
go
JP
dads
a.e. f
q ( T ) = 0. Similarly, letting
E
(2.45) E
(o,T), (2.46)
tend to zero in Eq. (2.44)’, we get
u*(t) =
i“
M
a.e. [ t a.e. [t
( 0 , T ) ;q ( t ) < A], E ( 0 , T ) ;q ( t ) > A], E
(2.47)
354
5. Optimal Control of Parabolic Variational Inequalities
where A
E R. Moreover, as seen in the previous proof we have p = 0 in Q; y * ( x , t ) > 0) and p = 0 in { ( x , t ) E Q; y * ( x , t ) = 0, fo + 01, thereby completing the proof.
{(x,t) E
In particular, it follows by Theorem 2.2 that if d p / d u 2 0 in dR (this happens, for instance, if gi s 0, g; 2 0, by virtue of the maximum principle for parabolic equations), then q is monotonically increasing and so every optimal control u* for problem (2.32) has at most one switching point t , . More will be said about this in Example 2 following. We note also that Theorem 2.2 extends to control systems (2.33) with boundary conditions of the following form (see, e.g., Barbu and Barron [ll): m
y
=
+f ( u ) = u
U’
where u = ( u , , .. . , u r n > , u W2-l/p(dR), i = 1,. . . ,m .
C gi(x)ui(t)
in 2
i= 1
a.e. in ( O , T ) , =
( u l , . . . , un),
f
u( 0 ) = 0, = (fl,.
. . , f,,,),
and gi
E
5.2.3. Examples 1. Control of oxygen difision in an absorbing tissue. The oxygen diffusion in absorbing tissue R c R3 is governed by the obstacle problem (see, e.g., E. Magenes [l], and Elliott and Ockendon [l], p. 127)
dY dt
- - Ay
+ 1= 0
y(x,O) = y o ( x ) , y=u
in ( ( x , t ) x
E
E
Q;y ( x , t )
> O},
a,
in C
=
dR x ( O , T ) ,
(2.48)
where y o is the initial distribution of oxygen concentration in the tissue and u ( t ) is a prescribed concentration on dR at moment t , which satisfies the constraints u ( t ) E U, V t E [0,TI,
u ~ = { ~ E x ~ ; u ( x , o ) = ~ ~ ( x ) v ~ E ~ R , ~ ~ o ~
5.2. Boundary Control of Parabolic Variational Inequalities
355
We associate with control system (2.48) the cost functional
1141; + J ( y ( x , T ) ) - Y o ( x ) ) 2h,
(2.49a)
R
where y o E ,!,'(a). This is a problem of the form (2.181, where g
cp,(y)
=
y
Ily -y0112L2(n,,
= 0 and
EL2(Q).
Then, &$(u) = Fu + Nu@) V u E X, where F: X p + X; is the duality mapping of X p = W;-'/P,1-1/2P(.C) and Nu, c X; is the normal cone to U,, i.e., Nu,(u)
= (r]
EX;; (r],u - u ) 2 OVUE
u,}.
If we take u = u + cp, there cp 2 0, cp E C;(Z), we get ( r ] , ~ )I0. Hence, r] is a nonpositive Radon measure on 2, i.e., r] E M ( 2 ) . Moreover, it is readily seen that r] = 0 in ((x,t ) E 2; u ( x , t ) > 0). Then, by Theorem 2.1, the optimality system for this problem is JP at
-
+ Ap = 0
in [ y * > 01, in [ y * in 2,
p =0 p =O
=
01,
(2.49b)
whilst the optimal control u* is given by
- + Fu* dP dU
=
0
u*=o
because (77, u * ) u* =
0,
r] I0
-F-1(2) dV
in
=
for all
["
dV
in [ u * > 01, in[S>o],
r] E NuI,(u*).Equivalently,
< 01,
2. Optimal control of the one phase Stefan problem. Consider the melting process of a body of ice Q c R3 maintained at 0°C in contact with a region
5. Optimal Control of Parabolic Variational Inequalities
356
of water on T, and at controlled temperature u on r,. The boundary d f l is composed of two disjoint parts rland r, , and n = 0. Let N x , t 1 be the water temperature of point x E fl at time t. Initially, the water occupies the domain fl, c fl at temperature 8, (see Fig. 4.1). If t = u ( x ) is the equation of the water-ice interface, then the temperature distribution 8 satisfies the one phase Stefan problem
r1 r2
8=0 e(x,o)
=
in { ( x , t ) vx E
e,(x)
E
Q; ' + ( x ) 2 t } ,
a,,
e(x,o) =
o
vx
E
R\R,,
(2.51)
along with the Dirichlet boundary conditions 8( x , t ) = go( x ) u ( t ) e(x,t)
=
o
rl x (0, T ) , in 2, = r, x ( O , T ) ,
in 2 ,
=
(2.52)
where go E
w:-l/p(rl),
8,
c(fio),
E
go 2 0
p >(N
in
rl,
+ 2)/2,
eo(x)
>o
vx
E
no. (2.53)
We will consider here the following model optimization problem associated with the controlled melting process (2.51), (2.52): (2.54) on all 8 and u subject to (2.50, (2.52) and to the control constraints u where u
E L"(0, T
) ;0 I u ( t ) I M ,
We will assume of course that MT > L.
1 T
0
u ( t ) dt =
E
Uo,
5.2. Boundary Control of Parabolic Variational Inequalities
357
As seen in Chapter 4, (Section 3.21, by the transformation y(x, t )
/ k x , s ) e ( x , $1ds,
=
0
where x is the characteristic function of Q + = { ( x , t ) ; u ( x ) < t system (2.50, (2.52) reduces to the controlled obstacle problem
0
in R,
y(x,O)
=
y(x,t) y(x,t)
=g,(x)v(t)
u’(t) = u(t)
=
0
V(x,t)
a.e. t
E
I
T ) , the
(2.55) V(x,t)
E c1;
(2.56)
E 22,
(O,T),
u(0) = 0,
(2.57)
where fo = 8, in R, and fo = - p in R \ R,. In terms of y, problem (2.54) becomes: (2.58)
Maximize jay( x , T) dx on all (y,u ) E W$ ‘(Q)X Uo satkfiing (2.55142.57).
Applying Theorem 2.2, where f = 0, g ’ = 0, g2(y) = -y, we find that every optimal control u* is of the form (2.401, where
(2.59) and
dP dt
-
+ Ap = 0 p =0 p = O
in
{(x,t) E
Q ; y*(x,t) > O } ,
in { ( x , t ) E Q ; y*(x,t) in2, p(x,T) = 1
=
o , f o ( x , t ) + 01, V ~ E R . (2.60)
Inasmuch as dy*/dt - A y * > 0 in Ro X (O,T), we infer that y* > 0 in 0, x (0,T).
358
5. Optimal Control of Parabolic Variational Inequalities
Hence, p satisfies Eq. (2.60) in { ( x , t ) E Q;x E R,, t E (0, T ) ) and, by standard regularity results for parabolic Dirichlet problems (see for instance Chapter 4, Section 3.11, we know that p E C2’ X [O, T ) ) and p E C([O, TI; L2(R)). Then, by virtue of the maximum principle for linear parabolic operators (see, e.g., Porter and Weinberger [l], p. 170) we have
‘(a,
p > 0 in R, x ( 0 , T )
JP
dV
< 0 in
rl x ( 0 , T ) .
Then, by Eqs. (2.47) and (2.59), it follows that q is increasing and the optimal control u* has one switch point t o , i.e., (2.61) where Mt, = L. We have therefore proved: Corollary 2.1. Under assumptions (2.53) the optimal control problem (2.54) W has a unique solution u * , given by (2.61).
We will consider now the following problem: Given the surface So = ( ( t ,x ) ; t = K x ) } , find u E U, such that So is as “close as possible” to the free boundary S = dQ, of problem (2.51). This is an inverse Stefan problem in which the melting surface is known and the temperature on the surface rl has to be determined. Let y o be a given smooth function on Q such that y O ( x , t )= 0 for 0 I t I l ( x ) and d YO -
yo I 0
Ayo
in R ,
(2.62)
where fo is defined as before. Then the least square approach to this inverse problem (which in general is not well-posed) leads us to a problem of the form (2.33), i.e.: Minimize
/n
(y ( x , t )
-
y o ( x , t))’ dxdt
on all ( y , u ) E W: ‘(Q) X U, satisbins (2.55)-(2.57).
(2.63)
5.2. Boundary Control of Parabolic Variational Inequalities
359
Then, by Theorem 2.2, every optimal control u* of problem (2.63) is given by Eq. (2.401, where
and JP dt
- + Ap
=
in [ y * > 01,
2(y* - y o )
in [ y * = 0; fo z 01, in C, p(x,T) =0
p = o p = o
in R . (2.64)
By (2.551, (2.62), and the maximum principle, it follows that y * 2 y o in Q . Then, by (2.64), we conclude (again by virtue of the maximum principle) that d p / d u > 0 in Cl and so, by (2.401, we see that u* = M on [O, t o ] , u* = 0 on [ t o ,TI, where Mt, = L. 5.2.4. The Obstacle Problem with Neumann Boundaiy Control
The previous results remain true for optimal control problems with payoff (2.65) and governed by the variational inequality (2.11, i.e., dY
- A Y =fo dt dY
- Ay dt
in{(x,t) E Q ; y ( x , t ) > O ) ,
in Q
2fo, y 2 0
Y(X,O) =yo(x),
x
E
=
R
X
(O,T),
a,
(2.66)
with the boundary conditions dY +cry dU
du
-
dt
=u
+ AU = BU
in C , , Vt
E
y =O (O,T),
inC2,
(2.67)
~ ( 0= ) 0.
(2.68)
Here, R is a bounded, open subset of R" with a sufficiently smooth boundary dR = rl u r2,TI n T2 = 0, C i= ri x (0, T ) , i = 1,2; A is a
5. Optimal Control of Parabolic Variational Inequalities
360
linear continuous operator from L 2 ( 2 , )to itself, B is a linear continuous operator from a Hilbert space of controllers U to L2(Cl), a > 0, and fo
E
(2.69)
W'72([0,T1; L2(fl)),
y o ~ ~ ~ ( f ly o) =, 0 in
r,,
Regarding the functions g : [0, TI + R we will assume that:
dY0 dv
-
X
+ "yo = 0
in I?,,
yo 2 0.
(2.70)
L2(fl) + R, (po: L 2 ( f l )+ R,and h: U
(i) h is convex, lower semicontinuous and
h ( u ) 2 yllullZl +
c
Vu
E
u,
(2.71)
for some y > 0 and C E R, (ii) g is measurable in r , g ( t , 0) E L"(0,T ) , and there exists C that g ( t , y ) + %(Y)
2 C(llYIlL2(n) + 1)
VY
E
E
R such
L2(fl). (2.72)
For every r > 0, there exists L , > 0 such that Ig(t,y) - g ( t , z)l + IVO(Y) - cpo(z)l 5 L,llY - Z l l L 2 W
for all t E [O,Tl and IlyII~qn)+ I I z I I L ~ R ) Ir. Under assumptions (2.69), (2.70) the boundary value problem (2.66)-(2.68) has for every u E U a unique solution y E W ' 3 2 ( [ 0 , T ] ; V ) n W'9"([0,T];H ) (see Corollary 3.3, Chapter 4). Here, V = {y E H'(fl); y = 0 in r,}, H = L2(fl). Moreover, y = lim,+o y, strongly in C([O,TI; H ) and weakly in W'."([O,TI; H ) n W ' T ~ ( [TI; O , V ) ,where y is the solution to the approximating equation a "
-y dt
-
dv
-
dt
Ay
+ p"(y)
+ Av = Bu
where p" is defined by (1.17).
=fo
in Q
in ( O , T ) ,
=
fl x ( O , T ) ,
u ( 0 ) = 0,
(2.73)
5.2. Boundary Control of Parabolic Variational Inequalities
361
The following estimate holds: J l y , I l w ~ ~ ~ (H[)on,W~I]. ;~ ( [ O , Tv]); I C(1 + Ilullu). Then, by a standard device (see Proposition 1.11, it follows that optimal control problem (2.65) admits at least one optimal control u*. Regarding the characterization of optimal controllers, we have: Theorem 23. Let ( y * ,u * ) be an optimal pair for problem (2.65), (2.66). Then there exists p E L2(0,T ; V ) n L“(0,T ; L2(fl)) n BV([O,TI; (V n Hs(fl))‘), s > N/2, such that d p / d t + A p E (L“(Q))*and
($+ A p ) .
E
d g ( t ,y * )
a.e. in { ( x , t )
P ( T ) + dcp,(Y*(T)) dP
dV
p
=
0
+ ap=O
inZ,,
3
E
Q ; y*( x , t )
in fl,
0
in&,
p=O
a.e. in { ( x , t ) E Q ; y*( x , t )
=
> 0 } , (2.74) (2.75) (2.76)
0 , f o ( x , t ) Z O}, (2.77)
B* l T e - A * ( s - t ) p ( s ) ds E d h ( u * ) .
(2.78)
(A* is the adjoint of A J If N = 1, then y* E C ( 8 ) and Eq. (2.74) becomes
where 6 E L2(Q). Here, BV([O,TI; (V n Hs(fl))’) is the space of functions with bounded variation from [O, TI to (V n Hs(fl))’.
Proof Since the proof is essentially the same as that of Theorem 2.1, it will be sketched only. Also, for the sake of simplicity we will assume that g and cpo are differentiable on L2(fl). For every E > 0, consider the approximating control problem: Minimize
5. Optimal Control of Parabolic Variational Inequalities
362
Let ( y & u,) , be a solution to problem (2.78). By assumptions (9, (ii) we see that, for E + 0, u,
+
u*
strongly in U ,
y,
+
y*
strongly in C([O,T I ; H ) , weakly in W ' T [0, ~ ( T I ; H ) n W ' , 2 [0, ( TI;V ) ,
u,
u*
strongly in
dv, dt
+ Av& = Bp&
-+
[o, T I ;
L ~q)), (
where -
a.e. in ( O , T ) ,
u,(O)
=
0.
On the other hand, we have j u T ( V y g ( t , y & ( f ) ) , Z ( t ) ) d+t h f ( u , , w )
+ (u,
-
u*,w) 2 0
Vw
E
U,
where h' is the directional derivative of h , (., and ( * , ) are the scalar products in L2(R) and U, respectively, whilst z is the solution to Z, -
A Z + P"(Y,)z
in Q, in R ,
0 z(x,O) = 0
dv dt
-
=
+ Ru = Bw
in ( O , T ) ,
v(0) = 0.
Let p , E W',2([0, TI; L2(R)) n L2(0,T ; V ) be the solution to boundary value problem d
-P, dt + AP,
-
P,P&(Y&)= V,g(t, Y,)
x
P , ( X , T ) + V % ( Y & ( T ) ) ( x )= 0 ,
dP& + ap, dV
=
0
in Z , ,
After some calculation, we get that h'(u,,w)
+ (u, - u*,w)
in
p,
=
0
in
Q9 E
a,
Z2.
(2.80)
5.2. Boundary Control of Parabolic Variational Inequalities
This yields B * ( [ T e - A * ( ~ - r % ( gds )
1+
u,
- u* E
363
dh(u,).
Next, we multiply Eq. (2.80) by p , and sign p , and integrate on Q. We obtain the estimate
Hence, {(P,)~} is bounded in L'(0, T ; L'(s1)) + L2(0,T ; V ' ) c L'(0, T ; ( H s ( ( R )n V ) ' )for s > N / 2 (by Sobolev's imbedding theorem). Thus, on a subsequence, we have p,
+
p
weakly in L 2 ( 0 ,T ; V ) ,
weak star in Lm(O,T ; L2(a ) ) ,
and by the Helly theorem, stronglyin ( H ' ( ( R ) n V ) ' ,
p,(t) -+p(t)
Vt
E
[O,T].
Now, since the injection of V into L2(a)is compact, for every A > 0 we have
Finally, arguing as in the previous proofs we see that (on a subsequence)
P , P " ( Y & ) + ~ ( f o -Y: + A Y * ) PJ"(Y,)
+
strongbin L ' ( Q ) , strongly in L'( Q) .
0
Combining the preceding relations, we conclude that p satisfies Eqs. (2.74H2.78). If N = 1, then it follows that y, + y* in C(&) and so we infer that PY*
=
( p I+ A p
-
6 ) =~0
in
Q,
5. Optimal Control of Parabolic Variational Inequalities
364
where 6 = lim, p with y * .
--t
,V,,g(t,y,) (in L2(Q))and p y * stands for the product of
Theorem 2.3 can be applied as in the previous example to optimal control of the one phase Stefan problem with boundary value conditions de
-++(8-u)=O
dv
in&,
8 = 0 in2,.
5.3. The Time-Optimal Control Problem 5.3.1. The Formulation of the Problem
Consider the control process described by the nonlinear Cauchy problem
where M is a maximal monotone mapping in a Hilbert space H with the norm I I and scalar product (., * ). Then, as seen earlier, for every y o E D ( M ) and u E L:,,(O,m; H ) problem (3.1) has a unique mild solution y = y ( t , y o , u ) E C([O, m); H ) . Denote by %! the class of control functions u ,
-
W = { u E L"(0,m; H ) ; u ( t ) E K a.e. t > 0),
(3.2)
where K is a closed bounded and convex subset of H. Let y o ,y , E D(M ) be fixed. A control u E %! is called admissible if it steers y o to y , in a finite time T, i.e., y ( T , y o ,u ) = y l . If K = ( u E H ; IuI Ip ) , then we have: Lemma 3.1. Assume that y o E D(M ) and y , there is at least one admissible control u E W.
E D(M),
IMoy,l < p. Then
Proof We shall argue as in the proof of Proposition 2.3 in Chapter 4. Consider the feedback law
5 3 . The Time-Optimal Control Problem
Since the operator My problem
365
+ sign(y - y,) is monotone in H X H, the Cauchy
Y(0) =yo3 has a unique mild solution y E C([O,m); H ) . If yo E D ( M ) , then y is a.e. differentiable on (0, m) and we have, therefore, I d -ly(t) 2 dt
-y,I2
-
+ ply(t)
-y,l
IIM0YlllY(t) - Y 1 l
a.e. t > 0,
because M is monotone. (Here, M o t is the minimal section of M . ) This yields ly(t) -y,l
I(IMOy,l- P ) t
+ ly,
-y,l
V t 2 0.
Hence, y(t) = y, for t 2 ( p - IMoy,l)-'lyo - yll. This clearly extends to all yo E D( M). The smallest time t for which y(t, yo, u ) = y, is called the transition time of the control u, and the infimum T(yo,y,) of the transition times of all admissible controls u E % is called minimal time, i.e., T ( y o ,y,)
=
inf{T ; 3 u
E % such
that y( T, y o , u )
= y,).
(3.3)
A control u E % for which y(T(yo, y,), yo, u ) = 0 (if any) is called a time-optimal control of system (3.1) and the pair (y(t, yo, u), u ) is called a time-optimal pair of system (3.1)). Proposition 3.1. Let M be maximal monotone and let S ( t ) = e -M ' , the semigroup generated by M on D( M ) , be compact for every t > 0. Then under conditions of Lemma 3.1 there exists at least one time-optimal control for system (3.1).
Proof Let yo E D ( M ) be arbitrary but fixed. We know that T o = T(y,,y,) < m. Hence, there is a sequence T, + T o and u, such that y(T,, yo, u,) = y, . Let y, = y(t, yo, u,) be the corresponding solution to Eq. (3.1). Without loss of generality, we may assume that u, + u* weak star in Lm(O,T; H ) , where T o < To < 03 (we extend u, be zero outside the
366
5. Optimal Control of Parabolic Variational Inequalities
-
interval [O,T,]) and by Theorem 2.4, Chapter 4, we have, on a subsequence, Y,(t)
Y(t9
Yo u * ) * 9
This clearly implies that y ( T o ,y o ,u ) = y , , and so u* is a time-optimal control for system (3.1). Recall that if M = d 4 where 4: H R is a lower semicontinuous convex function, then the assumptions of Proposition 3.1 hold if, for every A E R, the level sets {x E H ; 4(x) s A) are compact in H. -+
In the linear case, every time-optimal control is a bang-bang control and satisfies a maximum principle type result (Fattorini [l]). More precisely, if M is the generator of an analytic semigroup then every time-optimal control u* for system (3.0, where K = { u E H ; IuI I p } , can be represented as a.e. t > 0, u * ( t ) = p sgn p ( t ) where p is the solution to adjoint equation p ' - M*p
=
0
a.e. t > 0,
and sgn p = pIp1-l if p # 0, sgn 0 = { w ; IwI I1). (For other results of this type, we refer to Balakrishnan [l], J. L. Lions [2], and H. 0. Fattorini [21.) Next we shall prove a similar result for some classes of nonlinear accretive systems of the form (3.1). 5.3.2. The Time-Optimal Control Problem for Smooth Systems We shall consider here the time-optimal problem for system (3.1) in the case where M=A+F,
and: (i)
(3 -4)
-A is the infinitesimal generator of a Co-semigroup of contractions that is analytic and compact; (ii) F: H -+ H is continuously differentiable, monotone, and its FrCchet derivative F' is bounded on bounded subsets; (iii) K is a closed, convex, and bounded subset of H and { p E H ; Ipl I y ) c K for some y > 0. e-At
367
53. The Time-Optimal Control Problem
H
In particular, it follows by (i), (ii) that A X H.
+F
is maximal monotone in
Theorem 3.1. Assume that y o ,y 1 E D ( A ) and that hypotheses (i)-(iii) are satisfied. Let ( y * , u * ) be any time-optimalpair corresponding to y o ,y , , where IAy, + Fy,l < y . Then u*(t)
dHK(
P ( t 1)
a.e. t
E
( O , T * ) (3.5)
in [O,T*], (3.6) a.e. t E (O,T*). (3.7)
p ’ ( t ) - A * p ( t ) - ( F ’ ( y * ) ) * p= 0 HK(p(t)) - (Ay*(t)+ Fy*(t),p(t)) = 1
Here, T* = T ( y , , y l ) is the minimal time and HK is the support function of K, i.e., HK(P)
=
Since, by (3.71, p ( t ) # 0 V t bang-bang control, i.e., u*(t)
K,
sup{(p,u);
E
E
Vp
[0,T*l it follows by (3.5) that u* is a
FrK
a.e. t
E
(O,T*).
(dHKis the subdifferential of HK.)
The solution p to Eq. (3.6) is considered of course in the mild sense and A* denotes the dual of A. The idea of proof is to approximate the time-optimal problem by the free time-optimal control problem min{T
+ lT( h( u( t ) ) + -lu( 0 2 &
t ) I 2 ) dt
1
+ -le-’&( 2E
y ( T ) - y1)I2
where the minimum is taken over all T > 0 and u E L2(0,T ; U),y C([O, TI; H ) satisfying Eq. (3.1) with M = A + F. Here, h: H + R is the indicator function of K, i.e.,
h(u) =
E
if u E K , otherwise.
It is readily seen that problem (3.8) has at least one solution (yE,uE,T,). Lemma 3.2.
Let (y,, u,, T,) be optimal in problem (3.8). Then for
E +
0,
5. Optimal Control of Parabolic Variational Inequalities
368
we have T,
T*
+
l(u,
=
-
T ( y o ,y l ) and
- u*> cis
o
strongly in
~2(0,m;
HI,
(3.9)
u,
+
u*
weak star in L"(0, T * ; H),
y,
+
y*
strongly in C([O, T * ] ;H ) , weakly in W ' , 2 ( [ 0T, * ] ;H).
Proof
(3.10) (3.11)
We have T,
+
i'(5lu,l2 + T
E
1
h ( u , ) ) dt
+- [dt1lr(uE 2
0
+ ( 2 ~ ) - ' l e - ~ " ( y , ( T-,y) l ) 1 2
- u * ) ds
Iu*I2d t .
(We extend u, and u* by 0 on [T,, +m) and [ T * ,+..I, T, IT * and Hence, lim sup,
(3.12)
respectively.)
~
ly,(T,) -ylI
+
0
as
E +
0.
Now, let E,, 4 0 be such that T,, + To and us, + uo weak star in LYO, m; H ) . Since - A generates an analytic semigroup and y o E D ( A ) , we have (see Theorem 4.6 in Chapter l), Ily;IIL2(0,TO;ff, Ic
VE
> 0.
Note also that ly,(t)l Ic
Vt
E
(0,m).
Now, since the semigroup e-A' is compact we deduce by the Arzelh-Ascoli theorem that {y,] is compact in C([O,Tol;H ) . Hence, on a subsequence, again denoted E,, , we have y,"
3
j7
strongly in C([O, T o ] ;H); weakly in W'*'([O,T o ] ;H ) ,
where j is the solution to (3.1) with u = 6. Clearly, j ( T o ) = y , and so uo is admissible. Hence To = T * and by (3.12) we have also that
as claimed.
rn
5.3. The Time-Optimal Control Problem
369
Let (y,, u,, T,) be optimal in problem (3.8). Then there is W’.2([0, T,k H ) n C([O,T,]; H ) such that
Lemma 3.3.
p,
E
y:+Ay,+Fy,=u,
a.e.
p: -A*p, - (F’(y,))*p, = 0
y,(O) p,(t)
E
=y
,,
p,(T,)
(3.13)
a.e.tE(O,T,),
r
E
(O,T,),
1
= - -e-A’Ee-AE & (Y&(T&) -Yl),
(3.14) (3.15)
dh(u,(t)) + &U,(t) + j T , d s / ‘ ( u , ( T ) - u * ( T ) ) dT 0
r
V t E [O,T,], (3.16) ((u,(s)
- u * ( s ) ) ds =
0,
u,(t)
= u*(t)
V t 2 T,, (3.17)
-(AY,(T,) + FY&(T&), P,(T,)) + HK(P,(T,) - &U&(T,>) &
2 + -Iu,(T&)I = 1. 2
(3.18)
Here, d h h ) = {u E H ; (w,u - u ) 2 0 Vu, llull Ip ) and H , ( p ) sup{(p,u); u E K ) is the support function of K. Proof
=
Since ( y e ,u,, T,) is optimal, we have
IkTs(h(u,(t)
+ -21 ( d t
+ A u ( t ) ) + -2l u , ( t ) + Av(t)I2)dt
l((u,
&
+ Au - u * ) ds VA > 0 , u E Lm(O,CQ; H ) ,
370
5. Optimal Control of Parabolic Variational Inequalities
where y ( t , u , y o ) is the solution to system (3.1). Subtracting, dividing by A, and letting A tend to zero, we get joT"(h'(u,(r). 4 t ) ) + +(dt
dt - p ( P & ( % u ( t ) ) dt
&(U,(t),V(t)))
0
(/'(u,(s) - u*(s)) d s , / ' u ( ~ d )r 0
0
1
20
Vu E L"(0, m; H ) ,
where p , is the solution to (3.14), (3.15) and h' is the directional derivative of h. This yields
+((u(7),/mdt~'(u& -u*)ds 7
0
i
d72 0
V u E L " ( 0 , a J ;H ) ,
which implies (3.16) and (3.17). It remains to prove (3.18). We note first that
T,
&
+ ( 2 & ) - ' 1 e - ~ " ( y , ( ~ -y1)12 ,) + 5/~"IU,(~)I' I T, - A
+ (2&)-'le-A"(y,(T,
+ 5 k'-Alu,(t)12 &
VO
dt
- A)
dt
-y1)12
< A < T,.
(3.19)
Since ( & I + ah)-' is Lipschitz on H and p, E W',2([0,T,];H ) (because p,(T,) E D ( A * ) and the semigroup e-A*' is analytic), we see by Eq. (3.16) that u, is Holder continuous on [O,T,]. Hence, y, E C'([O,T,]; H ) (see Theorem 4.5 in Chapter 1) and so we may pass to limit in (3.19), getting &
- ( Y ; ( T & ) , P € ( T & ) )+ ?lU&(T&)I2 5 -1. Equivalently, &
( A Y A T , ) + FY,(T&) - k ( T & ) , P & ( T &+) ),lU&(T&)125 -1.
(3.20)
On the other hand, it follows by (3.16) that - ( & ( T E ) 9 P € ( 7 , € ) )+ &IU,(T&)12+ ( J h ( u , ( T , ) ) ,U & ( T & ) ) = 0 ,
5.3. The Time-Optimal Control Problem
371
and this yields the opposite inequality
Proof of Theorem 3.1. Since 0
E
int K, we have
HK(P) 2 YIP1
VP E H ,
where y > 0. Then, by Eq. (3.181, it follows that &
-lU,(T)I2 + YlP&(T&) - &U&(T&>I 2 5 1 + IFY&(T,) + Ay,l lP,(T&)l
because the operator e-A*Ee-AEAis positive. Since, as seen in Lemma 3.2, y,(T') + y , as implies that &
yIU&(T,)12+ lp,(T,)l
c
I
+ CE E +
V.9 > 0.
0 the preceding
372
5. Optimal Control of Parabolic Variational Inequalities
Then, by the variation of constants formula
and the compactness of the semigroup e - A * t , we conclude that on a subsequence, again denoted E , we have (3.21) strongly in H, V t E [0, T * ] , p , ( t ) -+ p ( t ) Where p is the solution to Eq. (3.6). Then, letting E tend to zero in (3.16), we see that a.e. t E (0, T * ) , p ( t ) E d h ( u*( t ) ) which is equivalent to (3.5). It remains to prove (3.7). To this end, we note first that by Eqs. (3.131, (3.14) we have
5 3 . The Time-Optimal Control Problem
Then, letting that
E
373
tend to zero, it follows by Lemma 3.2, (3.18), and (3.21)
thereby completing the proof.
5.3.3. The Time-Optimal Control Problem for Semilinear Parabolic Equa tions We shall study here the time-optimal control problem in the case where H = L2(R), K = {u E L2(R); lu(x)l Ip a.e. x E R), My = - A y + p ( y ) V y E D ( M ) = { y E H2(R) n H,'(R); 3w E L2(R) such that w ( x ) E p ( y ( x ) ) a.e. x E R}.Here, R is a bounded and open subset of R N with a sufficiently smooth boundary (of class C',',for instance) and /3 is a maximal monotone graph in R X R such that 0 E p(0). In other words, we shall study the problem:
where y ( t , y o , u) is the solution to semilinear parabolic boundary value problem dY dt
--
Ay
+p(y)3u
in R
X (O,m),
and
Regarding y o and y l , we shall assume that y,,y,
E
D ( M ) n L"(R)
and
IIMoylllr(n)< P ,
(3.24)
374
5. Optimal Control of Parabolic Variational Inequalities
It turns out that under the preceding assumptions problem (P) has at least one solution (T*, y*, u*). This follows as in the proof of Lemma 3.1, using Lemma 3.4 following. Lemma 3.4. Under assumptions (3.241, there is at least one admissible control u E Zpforproblem (P).
Proofi We note that Lemma 3.1 is inapplicable here since int K = 0. However, we shall use the same method to prove the existence of an admissible control (see also Proposition 3.5 in Chapter 4). Namely, consider the feedback control 4x9t)
where sign r problem
JY dt
= =
- p sign(y(x, t ) - Yl(X))
r/lrl if r
#
0, sign 0
=
x
t)E
(O,W),
[ - 1,1]. Then the boundary value
AY + P ( Y ) + psign(y - y l ) y(x,O) =yo(x), y=o
V(X,
X E
in
30
x
(o,~),
a,
in dR x (O,m),
has a unique solution y E W'>*([O,T]; L2(R)) n L2(0,T; H,'(R) n H2(R)) for every T > 0 because by Theorem 2.4, in Chapter 2, the operator
MY = MY + psign(y
-Y1),
y
E
WM),
is maximal monotone in L2(R). As a matter of fact,
=
d+ where
5.3. The Time-Optimal Control Problem
375
and by the maximum principle we see that Y ( X , t ) -Y d X )
4x7t)
V ( x , t ) E R x ( O , ( p - P)-lIIYo -YlllL=(nJ. Hence, y ( x , t ) - y , ( x ) I llyo - y,lI~=(n) - ( p - p ) t , and by a ~ymmetric argument it follows that y(x,t) -y,(x)
2
-IlYo -Y,llL-(n) + ( P - P ) f
for x E R, 0 5 t 5 ( p - ~ ) - ' l l y- Y ~ ~ I I L = ~ ~ ) . Hence, y ( x , t ) = y , ( x ) for x E R and t 2 ( p - p)-'llyo - ylIIL=(n), as claimed. Now we shall formulate a maximum principle type result for problem (P). We shall assume that y o ,y , satisfy (3.24) and
Yo
E w;-2/q,q
(01,
4 > max(N,2).
(3.25)
Theorem 3.2. Let ( y * ,u * , T * ) be optimal in problem (P). Then
u*(x,t) E psignp(x,t)
a.e. ( x , t ) E R
X
( O , T * ) , (3.26)
where p E L2(0,T * ; W ~ ~ q " < n R )BV([O, ) T*l; W S ( R + ) W - l . q ( R ) ) ,s > N / 2 , satisfies the system d
-p at
+ Ap - u = 0
+ p / nI p ( x , t ) l d~ = 1
in R x ( O , T * ) ,
a.e. t
E
(o,T*).
(3.27)
(3.28)
Here 5 E L2(R x (0, T * ) ) is such that ( ( x , t ) E p ( y * ( x ,t ) ) a.e. ( x , t ) E R X (0, T * ) and v E (L"(R X (0, T*)))*. In particular, it follows by Eq. (3.28) that p ( t , - ) f 0 a.e. t E (0, T * ) and so for almost every t E (0, T * ) there is R, c R, m(R,) > 0 such that lu*(x,t)l = p a.e. x E a,. Proof of Theorem 3.2. Let ( y * ,u * , T * ) be any optimal pair for problem (P). Proceeding as in the proof of Theorem 3.1, consider the approximating
376
5. Optimal Control of Parabolic Variational Inequalities
control problem
where y E W ' * 2 ( [ 0TI; , L2(R)) n L2(0,T ; H,'(R) n HZ(R))V T > 0 is the solution to system dY
-
dt
+ Ay + p " ( y )
=
Y(X,O) =Yo(x> y=o
u in
(o,~),
in R x
a,
in dR x ( 0 , ~ ) .
(3.30)
v(&)&z0~,
Here, T ( E ) > 0, I * l2 is the L2-norm on R and p" is a smooth approximation of p satisfying conditions (k)-(kkk) in Section 1.2. The function h: L2(R) -+ R is the indicator function of K O = (u E L2(R); lu(x)l Ip a.e. x E a}. Let (y,, u,, 7")be optimal in problem (3.29). Then, by Lemma 3.3, there is p, E C([O, T,]; L2(R)) n L2(0,T,; H,'(R) n H2(R)) such that
dye
- Ay, dt y,(x,O) =yo(x)
+ p"(y,)
=
u,
in R,
y,
=
in Q, 0
=
in C,
R
=
X
dR
(O,T,), X
(O,T,), (3.31)
5.3. The Time-Optimal Control Problem
Now, arguing as in the proof of Lemma 3.2, we see that T, T ( y o ,yl), y,(T,) y , in L 2 ( n ) ,and
377
-, T* =
-+
u,
c ( u , - u * ) ds
-+
-+
u*
weak star in L"(0, T*; L2(a ) ) ,
o
strongly in P ( O , ~ ; ~ 2 ( a ) ) ,
strongly in C( [0, T * ] ;L2(a ) ) , y, y* weakly in L2(0,T*; H i ( a ) n H 2 ( a ) )n W l v 2[0, ( T * ] ;L2(a ) ) . -+
(3.35) Now, multiplying Eq. (3.32) by sign p , and integrating on Q,, we get
because by Eq. (3.34) and the monotonicity of p" it follows that (p,(T,)) is bounded in L'(R). To obtain further estimates on p,, we consider the boundary value problem
where hi E L2(0,T*; L Q ( f l ) )i, = 1,. .., N, q > 2. Problem (3.36) has a unique solution u E L"(0, T*; H,'(R)) with d u / d t E L2(0,T*; H-'(R)) (see, e.g., Theorem 1.9 in Chapter 4). Moreover, if q > N then u E L"(Q*) and N
llvllL-(Q*, 5
c C IlhillL2(0,T'; L y l ) ) i= 1
(see Ladyzhenskaya et al. [l],p. 213). Now, if we multiply Eq. (3.32) by u and integrate on Q*, we get the inequality I N
and, since h
=
I
N
( h , , . . .,h,) is arbitrary in L2(0,T; Lq(a)),
5. Optimal Control of Parabolic Variational Inequalities
378
+ l / q ' = 1. Hence, { d p , / d t } is bounded in L'(O,T*; WS(fl) + W-',q(fl)), where s > N/2. (If extend u, by 0 on [T,, +m) we may
where l/q
assume that p , are defined on [O,T*].) Then, according to the Helly theorem, there is p E BV([O,T*]; W S ( R ) + W-'*9(fl)) n L2(0,T*; W,,'*q"
p,,(t) + p ( t ) P&,
+
Vt
[O,T*],
E
weakly in L 2 ( 0 ,T*; W,,'*q'(fl)).
P
On the other hand, since the injection of W ~ ~ q "0 there is ~ ( 6 >) 0 such that (see J. L. Lions [l], p. 71) IIP&,(t)- p ( t ) l l L q n ) I 6llP&,(t)- p ( t ) l l w ; . q n ,
+ T ( s ) l l p & , ( t )- p(t)llH-r(n)+w-'.4(n) Vt
E
[O,T*].
This implies that p,,
Now, letting
E,
+
strongly in ~ ' ( 0 T, * ; ~
p
a)).
q ' (
(3.38)
tend to zero in Eq. (3.321, we see that dP
-
dt
+ Ap - v = 0
in Q * ,
where v = w - lim p " ( y , ) p , on some generalized sequence { E } . Moreover, by (3.33) we get (3.26). If we multiply Eq. (3.31) by P"(y,)I P"(y,)1q-2 and integrate on Q , = fl X (0, T'), we see that { P"(y,)} is bounded in Lq(Q*). This implies that ( y , ) is bounded in Wq2"(Q*) and so on a subsequence, again denoted E, , AY&"-
PYY&")
+
AY* -
5
weakly in
Lq( Q * ),
in c(e.1, Y&" Y * ((x,t) E P(y*(x,t)) a.e. ( x , t ) E Q * .
(3.39)
+
(3.40)
Now, multiplying Eq. (3.31) by p i , (3.32) by y$ , and subtracting the results, we get, as in the proof of Theorem 3.1,
53. The Time-Optimal Control Problem
379
where - u * ( T ) )dT
U,(X,f) = /?'dS/'(U&(T) f 0
and h ; ( p ) = sup((p,u), - (~/2)llull~;u and (3.39), it follows that
as claimed.
E
KO).Then, by (3.341, (3.351,
W
Now we shall consider some particular cases. The first one is that where for r 2 0, for r = 0. As seen earlier, in this case the control system (3.33) reduces to the obstacle controlled problem dY dt
- - Ay dY
--
dt
=
u
in { ( x , t ) ;y ( x , t ) > 0), in CR x
Ay 2 u, y 2 0
y(x,O) = y o ( x )
in C R ,
y
=
0
We take P" in the following form (see (1.17)):
and set
(O,m),
in dR
X
( 0 , ~ ) . (3.41)
5. Optimal Control of Parabolic Variational Inequalities
380
Then we have P,P"(Y,)
=
( P & b " ( Y & ) Y+&2-'p,)x,' + 2-'P&b"(Y&)Y&x,2 a.e. ( x , t ) E Q,, (3.43)
where x:, i = 1,2, is the characteristic function of Q:. Since {p,b"(y,)} is bounded in L'(Q,), {y,) in C@>, and {P"(y,>} is bounded in Lq(Q,), it follows by (3.43) that, for some E, 0, -+
p,, P"n(y,,)
0
+
a.e. in Q*,
(3.44)
whilst by (3.391, (3.40) we have weakly in L'(Q*)-
P,, P " ~ ( Y , , ) P ( A Y * - Y:) E P P ( Y * ) +
Hence, p,, p"n(y,,)
--f
strongly in L ' ( Q * ) ,
0
and so p(u*
+ dt JY* + A y * ) = 0
a.e. in Q*.
Now, using (3.42) once again, we see that
P,( P"(Y,)
-
because m ( Q i ) ,m(Qf)
P,, ~
~"(Y,)Y,) 0 +
-+
0 as
E +
strongly in L'(Q*>,
0. Hence, on a subsequence,
Y Y , ~ )0 Y ,strongly ~ in L'(Q*). +
Since as seen earlier ySn+ y * in C@>, this implies that vy* i.e.,
:(
-
+ Ap
)y* = O
=
0 in Q*,
inQ*.
We have therefore proved the following theorem:
Theorem 33. Let y o E Wo2 - 2 / q , q ( f i ) n H ~ ( R )n L"(R), q > max(N,2) be such thaty, 2 0 in R, and f e t y , E H , ' ( f l ) n H2(R) n LYR) be such that y, 2 0 in R, IlAy,llL-~n,< P . Let ( y * , u * ) be any optimal pair for the time-optimal problem associated with system (3.41). Then there is p E L2(0,T * ; WdVq'(R)) n BV(/([O, T I ; H-S(RZ)
53. The Time-Optimal Control Problem
381
+ W-1.9(R)) such that ( d / d t ) p + A p E M ( p ) and dP dt
-+Ap
0
in { ( x , t ) E Q*;y * ( x , t ) > 0},
(3.45)
in { ( x , t ) E Q*; y * ( x , t ) = 0}, p =0 u * ( x , t ) E psignp(x,t) a.e. ( x , t ) E Q * ,
(3.46)
=
A y * ( x , t ) p ( x , t )dr
=
a.e. t
1
E
(3.47)
(O,T*). (3.48)
p.
Here, M ( p ) is the space of bounded Radon measures on This theorem clearly extends to the time-optimal problem for the variational inequality dY -Ay=u dt
-
i n { y > @},
dY - Ay
in R x
2 u, y 2 @ at y(x,O) = y o ( x ) , y = 0
(O,m),
in dR x
(O,m),
where @ E C2(fi) is a given function such that @ I0 in dR. Now we shall consider the special case where y 1 = 0. If we take, in the approximating problem (3.291, V ( E ) = E - ~ / ' , multiply Eq. (3.31) by d y , / d t , and integrate with respect to x , we get j " ( y , ( x , t ) ) dr
c
I
VE
> 0, t
E
[O,T&],
where C is independent of E and t . We recall that j " ( r ) = 10' p"(s) ds and so, by (3.42), it follows that
j f ( x , T , ) dr
ICE
VE > 0.
If multiply Eq. (3.32) by p,' and integrate on R x ( t , T'), we get
382
5. Optimal Control of Parabolic Variational Inequalities
Hence
in Q*,
P I 0 dP dt
-
+ Ap = 0
in { ( x , t ) E Q*; y * ( x , t ) > O),
in { ( x , t ) E Q*; y*(x,t) = 0), 0 in Q*. (3.49) u*( x , t ) E p sign p ( x , t ) If the open set E = { ( x , t )E Q*; y * ( x , t ) > 0) is connected, then by the maximum principle we conclude that p < 0 in E, and so
p
=
u * ( x , t ) = -1
(3.50) in { ( x , t ) E Q*; y * ( x , t ) > 0 ) . We have obtained, therefore, a feedback representation for the time-optima1 control u*. In general, it follows by (3.50) that u* = - 1 in at least one component of the noncoincidence set { ( x ,t ) ; y*(x,t ) > 0). We shall consider now the case where p is a monotonically increasing locally Lipschitz function on R. Then we may take p" defined by the formula (2.74) in Chapter 3. By (3.40) we see that { b"(y,)} is bounded in L"(Q*), and so extracting a further subsequence if necessary we may assume that pen(
yen)+ g
weak star in L"( Q * ) ,
where g ( x , t ) E d p ( y * ( x , t ) )a.e. ( x , t ) E Q* (see Lemma 2.5 in Chapter 3). Then, by (3.38), we infer that v E Lq'(Q*) and v ( x , t ) E dp(y*(x,t ) )p ( x , t ) a.e. ( x ,t ) E Q*, where d p is the generalized gradient of p. Then, by Theorem 3.2, we have:
Theorem 3.4. Let y o , y , satisfv (3.24), (3.25) and let p be monotonically increasing and locally Lipschitz on R. Then if ( y * , u * , T * )is optimal for problem (PI there are p E L2(0,T * ; Wb.q"cfl>> n BV([O,T * ] ; H - ' ( f l ) + W-'*q(fl)), s > N/2, and 77 E L"(Q*) such that u * ( x , t ) E psignp(x,t)
- + Ap dP dt
-
qp
=
0
a.e. ( x , t ) E Q*,
(3.51)
in Q*,
T ( x , ~E ) dp(y*(x,t))
a.e. ( x , t ) E Q*,
(3.52)
53. The Time-Optimal Control Problem
383
Remark 3.1. If in problem (P) we replace the set 2Zp by
then Theorems 3.2-3.4 remain true except that Eqs. (3.281, (3.481, and (3.53) are replaced by -
la(VY*(X,t )
*
V p ( x ,t ) + 6 ( x , t ) p ( x ,t ) )lfx
+ pIIp(t)ll~2(n) = 1
a.e. t
E
(O,T*),
- v p ( x , t ) d~ + pllp(t)llLzcn)= 1
ax. t
respectively -javy*(x,t>
E
( 0 ,T * ) ,
in the case of the obstacle problem. 5.3.4. Approximating Time-Optimal Control by Infinite Horizon Controllers
Though the results of this section remain true for more general time-optima1 problems, we confine ourselves to parabolic systems of the form (3.23). More precisely, we shall consider the time optimal control problem:
where =
{u
E L"(O,W;~~(fl));u ( t ) E K
a.e.
r > O}.
(3.54)
K is either the set { u E Lm(fl); lu(x)l Ip a.e. x E fl) or { u E L2(fl); Ilull2 5 p ) , and y = y ( t , y o , u ) is the solution to system (3.23). Here, p is a maximal monotone graph in R X R such that 0 E p(0). We shall assume throughout this section that yo E
~ , ' ( a ) , i ( y o ) E L'(fl) ( ~ =i p )
(3 3 )
if K = ( u ; llul12 Ip), and y o E Lm(fl)n Hj(fl), p ( y o ) E L'(a) if K = { u ; llullL=(n,5 p}. As seen earlier (Lemmas 3.1 and 3.4), problem (P,) admits
at least one optimal pair ( y * , u*). We shall approximate problem (PI) by the following family of infinite
384
5. Optimal Control of Parabolic Variational Inequalities
horizon optimal control problems: Minimize
(P")
iw(+
h,( u( t ) ) ) dt
g " (y ( t ) )
on all u E LToc(R+;L2(R)) a n d y n H2(R)), subject to
E
W,i:([O,m); L2(R)>n L:,,(R';
dY - Ay + p " ( y ) = u
in R
drt
R',
X
in a, in drR x R'.
y(x,O) =y,(x) y = o
H,'(R)
(3.56)
Here, p" is a smooth approximation of p, i.e., p" E C2(R), bE2 0, p"(0) = 0, BE E L"(R), and these satisfy assumptions (k)-(kkk) in Section 1.2. The functions g": L2(R) + R and h,: L2(R) + R are defined by h,(u)
=
inf
Iu
- vI22
UEL2(R),
(3.57)
and (3.58) where
TE
C'(R+) is such that
T' 2
1 Lemma 3.5. For all solution ( y 6 ,ue).
0,O I
TI
1 in R', and
for y 2 2,
sufficiently small, problem (P") admits at least one
E
Proo$ It is readily seen that there exists at least one admissible pair ( y , u ) in problem (P"). For instance, we may take u as in the proof of Lemma 3.1 and 3.4. Hence, there are the sequences u , , y , satisfying system (3.56) and such that
/ ( g " ( y , ) + h , ( u , ) ) dt W
d I
0
I d
+ n-',
where d is the infimum in (P"). Then, by the definition of h", we see that the u, remain in a bounded subset of LToc(R+;L2(R)). Hence, on a subsequence, u,
+
u
weakly in LT,,(R'; L 2 ( R ) ) ,
5.3. The Time-Optimal Control Problem
385
and by Eq. (3.56) we see that the y,, remain in a bounded subset of W,i:([O, m); L2(R)) n L:,,(R+; H,'(R) n H2(R)). Hence, we may assume that, for every T > 0, y,, + y = y ( t , y , , u )
stronglyin L ~ ( o , T~ ; ~ (n 0L)~)( o , TH; , ' ( ~ I ) ) ,
weakly in ~ ~ (T 0; H, 2 ( a)), and by the Fatou lemma,
liminf i m g " ( y , , dt ) 2 l m g F ( yd) t , 0
n+m
and
lim inf n-m
because the function u L2(R)). Hence,
as desired.
.m
jo h,( u,,) dt 2 --+
10"h,(u) dt
.m
is convex and 1.s.c. on L:,,(R+;
rn
Theorem 3.5. Let ( y , , u,) be optimal in problem (P"). Then, on a subsequence, E -+ 0, u,
--+
u*
weak star in Lm(O, T*; L 2 ( R ) ) ,
y,
+
y*
weakly in W ' . 2 ( [ 0T, * ] ;L2(a)) n L2(0,T * ; H 2 ( a)), strongly in C([O,T * ] ;L 2 ( R ) ) n L2(0,T * ; H;(R)), (3.59)
where T * is the minimal time and ( y * ,u * ) is an optimalpairforproblem (PI).
Pro05 Let ( y : , u:) E W',2([0,T * ] ; L2(R)) n L2(0,T*; L2(R)) be any optimal pair in problem (PI). (We have already noted that such a pair exists.) We extend u: and y : by 0 on [ T * , +m) and note that yf ,u: is a solution to (3.23) on R X (0,m). Now, let 9, be the solution to Eq. (3.56) for u = u:. Since h,(u:(t)) = 0 a.e. t > 0, we have i r n W ( Y & ( t )+) h , ( u , ( t ) ) ) dt
J0r n g E ( 9 , ( t )dt )
whereas, by Lemma 1.1, I j , ( t ) -yT(t)l2
I CE"~
Vt
E
[O,T*].
(3.60)
5. Optimal Control of Parabolic Variational Inequalities
386
On the other hand, by Eq. (3.56) we have the estimate Ie
IY,(t)l2
(because u:
=
-u(I-T*)
Vt 2 T*
Iyc(T*)12
0 on [T*,m)),and along with (3.60) this yields Iys(t)12
Vt 2 T*.
ICE"~
Then, by the definition (3.58) of g", it follows that, for all small, i m g & ( y , ( t ) ) dt = i T * g " ( y , ( t ) ) dt Ii ' * g " ( y f ( t ) ) dt
E
sufficiently
+CE'/~,
and so limsup j " ( g E ( y & ( t )+) h,(u,(t))) dt &+O
0
IT*
(3.61)
On the other hand, since {uJ is bounded in L:,,(R+; L2(SZ>)it follows by Lemma 1.1 that there exists u* E LYo,(R+; L2(SZ))such that, for every T > 0, uEn-+ u*
ySn -,y*
weakly in L2(0,T ; L2(a ) ) ,
weakly in W ' s 2 ( [ 0T, I ; L2(a ) )n L 2 (0 ,T ; H 2 ( a ) ) , strongly in C ( [0, T I ; L2(a ) )n L2(0,T ; H ' ( S Z ) ) ,
where y* = y ( t , y o , u*). We shall prove that u* is a time-optimal control. We note first that, by (3.58) and (3.611, it follows that the Lebesgue measure of the set {t > 0; ly,(t)li 2 2 ~ ' is~ smaller ~ ) than T * . Thus, there are E, -+ 0 and t, E [O, 2T*] such that 1y,jt,)12I2&,'i4
(3.62)
Vn.
Extracting a further subsequence, we may assume that t, -+ To. On the other hand, since {dyEn/dt)is bounded in every L2(0,T ; L 2 ( f l ) ) , we have ICIt - t,I'/2
Iy,jt) - y,jt,)I2
Vt
E
[O, To].
Then, by (3.621, we conclude that y*(To)= 0. Let f = inf { T ; y * ( T ) = 0). We will prove that = T*. To this end, for every E > 0 consider the set E, = { t E [O, f ] ; ly,(t)l; 2 2 ~ ' / ~By ) . (3.611, we see that limsup m(E,) &+
-
IT* IT ,
0
where m denotes the Lebesgue measure. On the other hand,
5.3. The Time-Optimal Control Problem
387
lim SUP, rn(E,) = f,for otherwise there would exist S > 0 and E, + 0 such that rn(Een)If - S V n . In other words, there would exist a sequence of measurable sets A, c [ O , f ] such that rn(A,) 2 6 and lys$t)l; I 2 ~ ; "V ~t E A,. Clearly, this would imply that ~
+
vt E A , ,
i y * ( t ) i 2 I( 2 ~ , 1 / 4 ) ' / ~ v,
where v, + 0 as n + 03. On the other hand, since y * ( t ) lim rn(t
E
n-rm
#
0 Vt
E
[O,
f],we have
[0,f1;ly*(t)12 I ( 2 & ; / 4 ) ' / 2 + v,)
=
0.
The contradiction we have arrived at shows that indeed lim sup, rn(E,) = f and therefore f = T*, as claimed. This completes the proof. ~
To be more specific, let us assume that K = { u E L2(fl); lul2 s PI. We may pass to limit in system (3.63), (3.64) to get that the optimal pair ( y * , u * ) given by Theorem 3.5 satisfies a maximum principle-type system. Indeed, by (3.63) and (3.56) we get d
dt ( ( P , , -AYE
&
+ P " ( Y & ) > - PlP,(t)l2 - ~ I P , " ) l : + g " ( y , ) )
and, therefore, ( P , ( f ) , - AY&(t> + P & ( Y & ( t ) ) - PlP&(t>l2 &
-
-IP,(t)l; 2
+ g " ( y , ( t ) ) = c.
=
0
388
5. Optimal Control of Parabolic Variational Inequalities
Since p , E L2(R+;L2(fl)), g"(y,) E L'(R+),and ( P e ( t n ) , - A ~ s ( t n )+ P " ( y e ( t n ) ) >
+
for some
0
tn
+
03,
we find that &
~ l ~ & ( t )+I 2T I p e ( t ) I : =
Vt 2 0. (3.65)
( P&('), - A Y e ( t ) + P " ( Y & ( ~ ) )+) g " ( y & ( t ) )
On the other hand, a little calculation reveals that
d -( ) P " ( Y & ( ~ ) )2> 0, dt P e ( t ) , - A Y & ( ~ + and so ( ~ & ( t -) A, Y , ( ~ ) + P " ( Y e ( t ) > ) I0
Vt 2 0.
This implies that plp,(t)lz
I1
V t 2 0.
(3.66)
Noticing that G E ( y , ( t ) ) = 0 for lye(t)l: 2 Z ? E ' / ~ ,it follows by estimate (3.66) and Eq. (3.63) that { p , } is bounded in L"(O,T* - 6; L2(fl)) n L2(0,T* - 6; H,'(R)) for every 6 > 0. Then, by using a standard device we find as in previous proofs that, on a subsequence en + 0, P,, pe,(t)
+
strongly in ~ ~ (T *0 ; L , ~a)), (
P
+p
(t)
strongly in ~ - ' ( f l ) weakly , in .L2( fl) for t E [O, T * ) ,
where p E L'(0, T * ; L2(fl)) n L2(0,T * ; H,'(R)) n BV([O,T * ] ; H-'(fl)) satisfies the equations dP
-+Ap dt
- u=
0
u * ( t ) = p sgn p ( t )
plp(t)l2 - ( p ( t ) , - A y * ( t )
in R x ( O , T * ) ,
(3.67)
a.e. t
(3.68)
+ P(y*(t)))
E
( 0 ,T * ) ,
=
1
a.e. t
E
(O,T*), (3.69)
where u E (L"(R x (0, T*))*. In particular, it follows by (3.68) and (3.69) that u* is a bang-bang control, i.e., lu*(t)l2 = p a.e. f E (O,T*). For special choices of P (for instance, P locally Lipschitz or a maximal monotone graph of the form (1.6)), we may deduce Theorems 3.3 and 3.4
5.4. Approximating Optimal Control Problems
389
from the preceding optimality system (see Remark 3.1). We refer the reader to author's book [7] for other results in this direction. 5.4. Approximating Optimal Control Problems via the Fractional Steps Method 5.4.1. The Description of the Approximating Scheme
We will return now to the optimal control problem (PI in Section 1.1, i.e.,
on all ( y , u ) E C([O,TI; H ) n L2(0,T ; U),subject to the state system
y'(t)
+Ay(t) + Fy(t) 3 (Bu)(t) + f ( t )
a.e. t
E
(O,T), (44
Y(0) = y o ,
in a real Hilbert space H. Here, B E L(L2(0,T ; U),Lz(O,T ; H ) ) , g : [0,TI x H + R, cpo: H + R, h: U + R satisfy assumptions (v), (vi) in Section 1.1, and U is a real Hilbert space. The operator A : V + V' is linear, continuous, symmetric, and coercive, i.e., Vy E V
( A Y , ~2) ~lly1I2 whilst F = dcp: H that
+ H,
where cp: H
Vy
(Ay,FAy) 2
FA = K 1 ( Z
+
-
R
is a l.s.c., convex function such A > O,
D ( A , ) 9
(I + hF)-')
= dqA.
(4.3)
We will assume further that the projection operator P of H onto K = D( F ) maps V into itself and (APy,Py)
(AY,Y)
VY
E
(4.4)
Here, V is as usually a real Hilbert space compactly, continuously, and densely imbedded in H, with the norm denoted )I * I(. We will assume, finally, that
390
5. Optimal Control of Parabolic Variational Inequalities
As seen earlier, assumptions (4.3), (4.5) imply that A monotone. More precisely, A + F = d+, where
+(Y)
=
+(AY,Y) + 4 Y )
+ F is maximal
VY E V *
Then, the Cauchy problem has for every u E L2(0,T ; U ) a unique solution y" E W'g2([0,TI; H ) n L2(0,T ; D ( A , ) ) . Since the map u + y" is compact from L2(0,T ; U ) to C([O, TI; H ) , problem (4.1) has a solution. Here, we will approximate problem (4.1) by the following one: Minimize
on ally: [O, TI
+
j b T ( g ( t ,y ( t ) ) + h ( u ( t ) ) )dt + v o ( y ( ~ ) ) (4.6)
H, u
E
L2(0,T ; V ) , subject to
a.e. t E ( i e , ( i + l ) ~ ) , y ' ( t ) + A y ( t ) = ( B u ) ( t ) +f(t) y + ( i ~=) w ; ( E ) for i = 1,..., n - 1, y + ( O ) = y o , (4.7) wf + Fwi 3 0 E = T / n , in ( 0 , E ) , (4.8) ~ ~ (=0P y)- ( i ~ ) for i = 1 , 2 , . . ., n - 1.
Here, y - ( i ~ and ) y + ( i ~are ) respectively the left and right limits of y at iE. Since, by assumption (4.31, e - F ' V c V for all t > 0, it is readily seen that problem (4.7), (4.8) has a unique solution y : [O, TI + H, which is piecewise continuous and belongs to W's2([i&,(i+ 0 . ~ 1 ;H ) n L 2 ( i s , ( i+ 1 ) ~V ; ) on every interval [ i ~ , (+i l ) ~ ] Then, . by a standard device, it follows that the optimal control problem (4.6) has for every E > 0 at least one solution u f . We set W U ) =
j b T M Y " ( t ) ) + h ( u ( t ) ) )dt + % ( Y " ( T ) )
and ?&(U)
=
/T(s(Y,"(w + h ( u ( t ) ) )dt + cpo(Y,"(T)), 0
where y," is the solution to system (4.71, (4.8). Then, in terms of ? and ?=, we may rewrite problem (4.1) and (4.6) as min{?(u); u
E L 2 ( 0 , T ;U
min{?&(u); u
E
)},
(4.9)
L 2 ( 0 , T ;U ) } .
(4.10)
respectively, The main result of this section is the following convergence theorem.
5.4. Approximating Optimal Control Problems
391
Theorem 4.1.
Assume that beside the preceding hypotheses at least one of the following assumptions holds: (i) B is compact from L2(0,T ; U ) to L2(0,T ; H I ; (ii) F = dI,, where C is a closed convex subset of H .
Then lim (inf{qc(u); u
E+
0
E
L 2 ( 0 , T ;U ) } ) = inf{*(u); u
E
L2(0,T;U ) } , (4.11)
and if {u:} is a sequence of optimal controls for problem (4.6) then q(uz)
+
inf{*(u); u
E L 2 ( 0 , T ;U
Moreover, every weak limit point of {u:} for problem (4.1).
E +
)}.
(4.12)
0 is an optimal control of
It is apparently clear that conceptually and practically the decoupled problem (4.6) is simpler than the original problem (4.1). Now we shall briefly present some typical situations to which Theorem 4.1 is applicable. 1. Consider the distributed control system
du
-
dt
+ Du = B,u 4 0 ) = uo,
a.e. t u=
E
(O,T),
(q,...,%),
(4.14)
in an open domain R c R"' with a sufficiently smooth boundav. Here, (Y 2 0, p: R + R is a maximal monotone graph (eventually, multivalued) such that D( p ) = R and 0 E p(O), D is a Lipschitz mapping from R" to itself, Bo E L(RP,R"), ai E L"(R) for i = 1,. . . ,m , and
f where p
=
E
dj.
L2(Q),
yo E H ' ( W
Aye)
E
L'W,
392
5. Optimal Control of Parabolic Variational Inequalities
We may apply Theorem 4.1, where U A : V -+ V' is defined by
(respectively, A y
=
- A y and V
=
H,'(R) if a
( F y ) ( x ) = (w E L2(R); w ( x )
c
= RP,
E
=
V = H'(R), H
= L2(R),
O), and
p ( y ( x ) ) a.e.x
E
a},
m
( B u ) ( t , x )=
i= 1
u
a,(x)u;(t),
ELZ(0,T;U).
Assumption (i) is obviously satisfied by virtue of the Arzelii theorem. We leave it to the reader to write the iterative scheme and to formulate the approximating problem (4.6) in the present situation. 2. Consider the optimal control problem (4.1) governed by the free boundary problem (the obstacle problem) dY dt
inQ
--Ay>u
Y(X,O) = y , ( x ) y = o
in a, in 2 ,
(4.15)
where y o E H,'(R), y o 2 0 a.e. in R. As seen earlier, this control system is of the form (4.21, where H = L2(R), V = H,'(R), A = - A , and F = dZ, where C = { y E Hi(R); y ( x ) 2 0 a.e. x E R).We note that in this case ( P y X x ) = y + ( x ) = max(y(x),O}, a.e. x E R,and assumptions (4.3) (4.4) are clearly satisfied since lIvPylILz(n) IIIvyIILz(n) Since e-F'y in this case,
=y
+ V t 2 0, and all y
dY --AY=u dt
in
E
Q6
V y E H,'(R).
L2(R), system (4.7), (4.8) becomes,
=
R x ( i ~ , ( i+ l ) ~ ) ,
+
in 2; = dR x ( i ~ , ( i I ) & ) , y = o Y(X,O) =y,(x) in a, y + ( x , i ~=) m a x { y - ( x , i E ) , O } a.e. x E R.
(4.16)
5.4. Approximating Optimal Control Problems
393
Arguing as in the proof of Theorem 1.2, we get for the corresponding problem (4.6) the following optimality system (assume that g is Giiteaux differentiable and 'p,, = 0):
p - ( x , ( i + 1 ) ~ =) p + ( x , ( i+ 1 ) ~ ) p-(x,(i + 1 ) ~= ) 0 p-(x,T) =0 p
E
> 01, in { x ; (Y,*)+ ( x , ( i + in ( x ; ( y , * )+ ( x , ( i + 1 ) ~ = ) 0}, in 0, (4.17)
dh(u*)
a.e. t
E
(4.18)
(0,T).
This system can be solved numerically by a gradient type algorithm and the numerical tests performed by V. Arniiutu (see Barbu [ll]) show that a large amount of computing time is saved using this scheme. 5.4.2. The Convergence of the Scheme
We will prove Theorem 4.1 here. The main ingredient of the proof is Proposition 4.1, which also has an interest in itself. Proposition 4.1. Under the assumptions of Theorem 4.1, if (u,) is weakly convergent to u as E,, -+ 0, then
y : ~+ y " ( t )
strongly in H , V t E [ O , T I .
(4.19)
We recall that y," is the solution to ystem (4.7), (4.8). Let us postpone for the time being the proof of Proposition 4.1 and derive now Theorem 4.1. Let u,* be an optimal controller for problem (4.6) and let y,* be the corresponding solution to system (4.7), (4.8). By assumption (v) in Section 1.1, (u,} is bounded in L2(0,T;U )and so, on a subsequence E,, + 0 as n + 03, u,"
+
u*
weakly in L2(0,T ; U ) ,
(4.20)
whilst by Lemma 4.1, y,*Jt) + y " ' ( t )
strongly in H , V t
E
[O,T].
(4.21)
5. Optimal Control of Parabolic Variational Inequalities
394
(We set yzn = y,"cn.) This clearly implies that
g(Yz"> and since u
+
+
in L'(0, T ) ,
g(y"')
(4.22)
:/ h ( u ) is weakly lower semicontinuous, we have
On the other hand, we have *&,(U&")
I *&,(G*)
Vn,
where G* is optimal in problem (4.1). Letting n tend to (4.21144.23) that
a, we
get by (4.24)
* ( u * ) 5 liminf *&,(uEn)I *(G*) n-m
and, therefore, * ( u * ) = lim V&,(u&,) = n+m
*(fi*)
=
inf{*(u); u
E
L 2 ( 0 , T ;U)},
i.e., u* is an optimal control for problem (4.1). To prove (4.121, we set = y " : and note that, by (4.20) and the ArzelL-Ascoli theorem,
Y&" + y *
=yu*
strongly in
c([o, TI;
H).
Hence,
whilst by (4.24) we see that
Therefore, *(uZn) + *(u*), as claimed. This completes the proof.
W
To prove Proposition 4.1 under hypothesis (i) we shall establish first a Lie-Trotter product formula for the nonhomogeneous Cauchy problem
y*
+ Ay + Fy = 4 , y(0) =x,
f 2 0,
(4.25)
5.4. Approximating Optimal Control Problems
395
where q E L'(R+; H I , x E D( A ) n D( F ) = D(F ) = K , and A, F satisfy assumptions (4.31, (4.4). As mentioned earlier (Remark 1.4 in Chapter 4) we may write (4.25) as an autonomous differential equation
d -S(t)(x,q) +dS(t)(x,q) dt
and w
=
=
0
t
2
0,
(4.26)
e - F r xis the solution to
w'
+ Fw = 0
inR+,
w(0) = x .
It is easily seen that S,(t) and S 2 ( t ) are generated by the operators d,and d2: d 1 ( x , q ) = [ A- q(O), -4'1,
Now let P: H + K be the projection on K K x L'(R+; H ) be the operator
Lemma 4.1.
For all ( x , q ) €3, we have
uniformb on compact intervals.
d 2 ( x 3 q ) = [FX,Ol. =
D( F ) , and let Q: X -+Z=
396
5. Optimal Control of Parabolic Variational Inequalities
Prooj We will use the nonlinear Chernoff theorem (Theorem 2.2 in of nonexpansive Chapter 4). To this end, consider the family operators on 3, t 2 0, r ( t )= Q s , ( t ) s z ( t ) , and set
X,
=
(I
+ At-'(I
-
t 2 0.
r(r)))-'(x,q),
(4.30)
Then, according to Chernoff theorem, to prove (4.29) it suffices to show that lim X I = ( I + A A ) - ' ( x , q ) ,
VA > 0.
1-0
(4.31)
According to (4.271, (4.281, we may rewrite (4.30) as
(t
+ A)y'(s)
-
Ay'(s
+ t ) = tq(s)
VS 2 0,
(4.33)
where X I = ( x ' , y ' ) E X and e-A' is the semigroup generated on H by -A". Inasmuch as the operators (I ,W-' and (I + A t - ' ( I - r(t)))-'are nonexpansive, without loss of generality we may assume that x E D ( A ) n D ( F ) and q , q' E L2(R+; V ) n L'(R+; V ) (the general case follows by density). Then, by Eq. (4.33), we see that y' E L'(R+; V ) n L2(R+;V ) ,y' is V-absolutely continuous on compact intervals, and
+
IlyfllL1(R+;V)
llqllLi(R+;V),
i
=
1,2,
Hence, { Y ' ) ~ , is compact in L'(R+; H ) n C(R+; H ) and, therefore,
y'
strongly in H, uniformly in s on compacta.
+w
Since, by (4.33), ly'(s)l ds Ijrnlq(s)lds jPrn P
Vp
> 0,
we may conclude, therefore, that y'
+w
stronglyin L'(R+; H).
(4.34)
5.4. Approximating Optimal Control Problems
+ E W',2([0,
On the other hand, for each
and, therefore, for t 1 -(y'(s f
H ) , @(O)
=
CQ);
397
0, we have
0,
+
+ t ) -y'(s))
+
weaklyin L2(R+; H).
w'
Then, letting t tend to zero in (4.331, we see that a.e. in R + .
w - w' = q Next, by (4.34), it follows that 1
-
t
/'e-A('-s)y'(s) ds o
+
strongly in H as t
w(0)
To complete the proof it remains to be shown that, for t x'
+
+
0.
0,
strongly in H ,
+ x:
(4.35)
where x: is the solution to the equation x:
+ A( Ax: + Fx:)
=x
+ Aw(0).
(4.36)
To this aim, we set q' = t - ' / i e-A('-s)y '( s ) d s . Noticing that P = (I dZ,)-', we may equivalently write (4.32) as t-'(xt -
e-A'X')
+ At-'
+
+ At-le-A'(x' - e-FIX')
dZK(A-'(t
+ A)x'
- tA-'x) 3x
+ Aq'
-XI.
(4.37)
Let z ' ( s ) = e-Asx' and let u be arbitrary but fixed in V. Multiplying the equation z' + Az = 0 by z' - u and integrating over [O,t l , we get (e-AtX'
+
- XI, x'
t(
- u)
+
ile-A'x' - x'12
cPdz'(s)> - cP,(u))
where q l ( y ) = i ( A y , y ) , y Similarly,
E
5 0,
(4.38)
V.
(e-FIXf - X I , XI - u ) + +le-"'x' - x'12
+
t(
cp( e - F s x ' ) - cp( u ) ) ds I
0.
(4.39)
398
5. Optimal Control of Parabolic Variational Inequalities
Hence, t-'(e-Frx' - x',e-Ar(x' - u ) )
+ t-1 /b(cp(e-F'x') <
t-'(e-F'x'
+ ( 2 t ) - ' 1 e - ~ ' x ' - X'I'
- cp(u) e-A'X'
-
+ cpl(e-ASx') x')
-
- cpl(u)) ds
+ t-'le-F'x'
- x'I le-A'u - uI.
(4.40)
+
Now multiply (4.37) by x' - e-F'x' t h - ' ( x ' - x ) , and use the accretivity of ePA'along with the definition of JZ, to get t-l(xr
<
e - ~ ~ X -~ , - FXr X~' )
- ( X I
+(x
-
e-A'x',x' - x ) - ( x ' - e-F'x',e-Ar(x' - x ) )
+ Aq'
- x ' , x ' - e-F'x')
+ t h - ' ( x + hq' - x ' , x '
-x).
Combining this with (4.38) and (4.40) yields h(t-'(e-A'x' - x ' ) , x ' - u )
+ At-'
/b(
I A(cp(u)
q( eCFsx')
+ h(t-'e-A'(e-F'x'
-x'),x'
- u)
+ cpl( e-Asx')) ds
+ q , ( u ) ) + (2t)-'hle-A'u
- uI2
+ Ix' - e-F'~'1(21x' - XI + Ix + hq' - x'l) + t h - ' l x + hq' - x ' I Ix' - X I .
(4.41)
Next, by (4.321, we have XI
=
+
t ( ~t ) - ' x
+ A ( A + t)-lP(e-A'e-F'x' + t q ' ) ,
whilst by assumption (4.3) it follows that cpl(e-F'x) I cpl(x)
V t 2 0, Vx E V .
This yields
Ilx'll
4 llxll
+ Allq'll
IC
Vt
> 0,
because as previously seen ( q ' } is bounded in LYO, 1; V ) . We may conclude, therefore, that { x ' } is a compact subset of H and so on a subsequence, again denoted ( t } ,we have x'
+ x,"
strongly in H .
(4.42)
399
5.4. Approximating Optimal Control Problems
Since the functions cp and cpl are lower semicontinuous, by the Fatou lemma we have
+ cpl(e-ASx'))
liminf t-1 l ( c p ( e - F ' x ' ) 1-0
+ cpo,<x,">. (4.43)
cis 2 cp(x;>
Next, from (4.42), we see that (see also Theorem 1.10 in Chapter 4)
+ le-A'x'
t - ' l u - e-A1u12
- X'I
+ le-F'x' - X ' I + o
as t
+
0. (4.44)
Now, coming back to Eq. (4.371, it follows by the definition of dZ, that
+ h)x'-
ht-'(dZ,(h-'(t
+ h ) ~-' t h - ' x ) , x ' - x )
2 -(dZK(h-'(f = -h-l(e-A'Xl
- th-'(x
th-'x),x' - U)
-xf,xf-x ) -
+ hq'
-x',x'
(e-Ftx'
-x))
-X',e-AI(x'
-x),
and by (4.44) we infer that liminf t-'(dZ,(h-'(t t+O
+ A)x'
- th-'x),x' - u ) 2
0.
Along with (4.371, (4.40, and (4.43), this yields -
where
=
cp
lim ( x
t+o
+ cpl.
+ hq'
- x ' , x' - u ) 5 A(
=
dcp
-
C#J(
x')),
Hence,
(x," - hw(0) - - x , x '
Since &$
C#J( u )
- U ) Ih ( + ( u ) - C # J ( X ' ) ) .
+ d p l and u is arbitrary in H , this implies that x + h ( O ) - x," E A( A + F ) x , " ,
i.e., x," is the solution to Eq. (4.36), as desired. Proof of Proposition 4.1. We shall assume first that hypothesis (i) holds. Let (u,) be weakly convergent to u in L2(0,T; U ) and let y, = y , " ~be the corresponding solution to (4.71, (4.8). Then {Bu,) is strongly convergent to Bu in L2(0,T; H I , and if we extend Bu, and Bu by 0 on ( T ,CQ),then by Lemma 4.1 the sequence 9, defined by [9&(t)9ii~(t)]
= (Qs1(E)S2(E))i(y07f+
Bu~)?
'
+ ')'I,
(4.45)
400
5. Optimal Control of Parabolic Variational Inequalities
or, equivalently Vt
Y & ( t ) = P ( y , ) - ).i(
E
[i&,(i
+ l).],
(4.46)
is strongly convergent to y " ( t ) for every t E [O, TI. On the other hand we have, by (4.7) and (4.81, I(y,")- ( i ~ )- ( y , " ) , (i.)l=
l(y,")- ( i . ) - e - F " P ( y , " ) - (i.)l
(4.47)
+f l
(4 S O )
and
Note also that
IBu,
ds I CE"'
Vi.
5.4. Approximating Optimal Control Problems
401
Along with (4.471, this yields l 0 lim l(yE)- ( i ~ )- ( y & ) +( i ~ ) =
&+
0
because e-Ff is continuous in t and { ( y & ) - ( i ~ )is} compact in H. Now, using once again Eq. (4.71, we see that lY&(t) - (YE>+( i d 2 I
+ IfI2)h)
C(El(Y&)+( i E ) I 2 + jr(lBu,12 is
Vt
E
[i&,(i
+l)~],
and along with (4.50) this implies that ye( t )
y"( t )
strongly in H , V t
E
[0,T I ,
as claimed. Now we shall assume that hypothesis (ii) holds, i.e., F = dZ,. Then, ePfFP= P = (I + A dZ,)-l for all t > 0, K = C, and the system (4.71, (4.8) becomes y ' ( t ) + A y ( t ) = ( B u ) ( t ) +f(t) y+(i.) = P y - ( i E ) .
a.e. t
E
(i~,(i+ l ) ~ ) ,
(4.51)
Let uEn-+ u be weakly convergent in L2(0,T; U).For simplicity, we set E, = E and: :y = y, . By the estimate (4.491, we have
uEn- u,,
c1
N- 1 i=o
(i+ 1 ) s
IE
(lYl(t)l'
+ IlY.(t)l12) (4.52)
and, therefore,
(4.53) On the other hand, we have
(4.54)
5. Optimal Control of Parabolic Variational Inequalities
402
Since e-A'C c C V t
2
0, we have
Substituting this in (4.54),we get the estimate
Along with (4.521, this yields T
v y, + Ily,(t)ll
4
0
c
Vn,t
E
[O,T],
where V y, stands for the variation of y,: [O, TI H. Since the injection of V into H is compact we conclude, by virtue of the infinite dimensional Helly theorem, that on a subsequence, again denoted y, , -+
stronglyin H , V t
y,(t) - + y ( t )
E
[O,T].
(4.55)
By estimate (4.53), it follows that A y E L2(0,T; H ) . Now, let z E C be arbitrary but futed, and let t E [ k ~ , (+k l ) ~ ] , s E [ i E , ( i + l ) ~ ] i, < k, be two points on the interval [O, TI. By Eq. (4.51) we get 1
n(IYn(t)
--I2 k
- I(yn)+
+3 C1 ( K Y n ) j=
( k ~ -z12) )
( j ~ - - I)2
- I(Yn)+ ( ( j -
1 ) ~ -21') )
+ + ( I ( y , ) _ ( ( i + 118) - z12 - ~ y , ( s ) - z12) f
=
This yields
[(Bun +f-AY,,Y,
-z)dT.
5.4. Approximating Optimal Control Problems
403
On the other hand, we have
and letting n tend to
+a
we get
T1 ( I y ( t ) - 21’ - l y ( s ) - 21’)
I/‘(Bu
+ f - A y , y - z ) d~ (4.56)
S
for all 0 Is It I T . Before proceeding further, let us observe that y ( t ) E C a.e. t Indeed, we have
ly,(t) - Py,(t)l I
E
(0, T ) .
lI:
e - A ( f - S ) ( B u+, f ) ds I CE”’,
because e-AfCc C V t 2 0. Hence, y ( t ) = Py(t), as claimed. Now, in (4.56) take z = y ( s ) . By Gronwall’s lemma, we get ~ y ( t -) y ( s ) ~I/ ‘ I B ~+ f + ~ d7 y ~
for 0
Is
t
T,
S
and therefore the function y : [O, TI + H is absolutely continuous and almost everywhere differentiable. On the other hand, by (4.56) we have (Y(t)-Y(S),Y(S)
- 2)
404
5. Optimal Control of Parabolic Variational Inequalities
Then, dividing by t - s and letting s tend to t , we see that ( y ' ( t ) + A y ( t ) - ( B u ) ( t )- f ( t ) , y ( t ) for all z
E
= y",
I0
a.e. t
E
(O,T),
C. Hence,
Y ' ( t ) +AY(t)
i.e., y
-2)
+ dZ,(Y(t>)
3
( B u ) ( t )+ f ( t )
ax. t
E
(O,ET),
as claimed. This completes the proof of Proposition 4.1.
Bibliographical Notes and Remarks
Section 1. Theorems 1.1-1.4 along with other related results were established in the author's work [4, 5 , 71. In a particular case, Theorem 1.2 has been previously given by Ch. Saguez [2]. D. Tiba [ll (see also [31 and [41) has obtained similar results for optimal control problems governed by hyperbolic equations of the form y,, - Ay + y ( y , ) 3 Bu, nonlinear parabolic equations in divergent form, and the nonlinear diffusion equation y, - A p ( y ) 3 Bu (see also D. Tiba and Zhou Meike ill). In this context, we also mention the work of S. Anifa [l] on optimal control of a free boundary problem that models the dynamics of population. By similar methods and a sharp analysis of optimality system, A. Friedman [3] has obtained the exact description of the optimal controller for the obstacle problem with constraints of the form { u E L"(Q); 0 Iu IM , u h d t = L}. Periodic optimal control problems for the two phase Stefan problem were studied by Friedman et al. [2]. Theorems 1.1 and 1.2, were extended by Zheng-Xu He [l] to state constraints problems of the form (PI (see also D. Tiba [31). Numerical schemes for problems of this type were studied by V. ArnZutu [l]. We mention in this context the works of I. Pawlow [l], and M. Niezgodka and I. Pawlow [l]. Section 2. In a slightly different form, Theorems 2.1-2.3 were established first in the author's work [5, 7, 91 (see Friedman [3, 41 for the one phase Stefan problem; see also Ch. Moreno and Ch. Saguez [l]). There is an extensive literature on the inverse Stefan problem and optimal control of moving surfaces, and we refer the reader to the survey of K. H. Hoffmann and M. Niezgodka [l] for references and significant results. A different approach to the inverse Stefan problem that consists of reducing it to a linear optimal control problem in a noncylindrical domain was used in the works of V. Barbu [16], and V. Barbu, G. DaPrato, and J. P. Zolesio 111 (see also V. ArnZutu [21). The control of the moving boundary of the
Bibliographic Notes and Remarks
405
+ ay = u
inZ,,
two phase Stefan problem, y, - AP(y)
3f
in Q,
dY
-= dV
0 in Z,,
dY
dV
where /3 is the enthalpy function (see Section 3.3 in Chapter 4) has important industrial applications and was studied by the methods developed here by several authors, including Ch. Saguez [31, D. Tiba [4], D. Tiba and Zhou Meike [l], V. Arngutu and V. Barbu [l], and D. Tiba and P. Neittaanamaki [l]. The optimal control of the moving boundary of a process modeling growth of a crystal was discussed in the work of Th. Seidman [l,21. Section 3. The main results of this section (Theorems 3.1 and 3.4) were established in the author’s work [lo, 121. The approach presented in Section 3.3 was first used in the author’s work [7, 91 to get first order necessary conditions of optimality for the time-optimal control problem. A different approach involving the Eckeland variational principle was developed by H. 0. Fattorini [3]. Section 4. The contents of this section closely follows the author’s work [14]. For other related results, we refer to the author’s work [15, 191.
This page intentionally left blank
Chapter 6
Optimal Control in Real Time
In this chapter we will be concerned with the feedback representation of optimal controllers to problems studied in the previous chapter. We will see that under quite general conditions such a control is a feedback control of the form u = d h * ( - B * d , J l ( t , y ) ) , where Jl is a generalized solution to a certain Hamilton-Jacobi equation associated with the given problem (the dynamic programming equation). 6.1. Optimal Feedback Controllers 6.1.1. Closed Loop Systems
Consider a general control process E [O,TI, Y ’ ( t ) + MY(t) 3 W t ) + f ( t ) , Y ( 0 ) = Yo (1.1) in a real Hilbert space H , where M = d 4 , 4: H -+ R is a lower semicontinuous convex function, d 4 : H + 2 H is the subdifferential of 4, B E L(U, H I , and U is another real Hilbert space. Here, y o E D(4) and f E L2(0,T: H ) . The control function u : [0, TI -+ U is said to be a feedback control if it can be represented as a function of the present state of the system (1.11, i.e., 9
-
u(t) E A(t,y(t)) a.e. t E ( O , T ) , ( 14 where A: [O, TI X H U is a multivalued mapping. Of course, some continuity and measurability assumptions on A are in order. A map A: H + U is said to be upper semicontinuous at y from H to U, if for 407
6. Optimal Control in Real Time
408
every weakly open subset D of U satisfying M y ) c D there exists a neighborhood B ( y , 8 ) of y such that A ( B ( y , 8 ) ) c D. The multivalued map N t ) : [0, TI -+ U is said to be measurable if for each closed subset C of U the set {t E [O,Tl; A ( t ) n C # 01 is Lebesgue measurable. It is easily seen that if R ( A ) is bounded in U then A is upper semicontinuous from H to U,, and with weakly closed values if and only if A is closed in H X U,. (Here, U, is the space U endowed with the weak topology.) If in the state system (1.1) we replace the control u by the feedback control (1.2), we obtain the closed loop system Y' +MY
-
t E (O,T),
BA(t,Y) 3 f ( t ) , Y ( 0 ) = Yo *
(1.3)
We say that the feedback control A is compatible with system (1.1) if (1.2) has at least one local solution. In general, the Cauchy problem (1.2) is not well-posed unless we impose further conditions on the feedback law A. We mention in this direction the following result due to Attouch and Damlamian [ l ] More . general results of this type can be found in Vrabie's book [ll (see also the monographs of Aubin and Cellina [ll and Filipov [l] for a complete treatment of nonmonotone differential inclusions in R N).
Proposition 1.1. Let H be a separable Hilbert space and let A, = B A : [0,TI x D(M ) + H , be upper semicontinuous in y , measurable in t , and with compact convex values. Assume further that (a) For each y o E D(M ) there exist r > 0 and h, that SUP{
IIvIILI;
vE
Ao(f7
Y ) ) 5 ho(t)
and every level set { y
E
H ; +( y )
a-e. t IA}
E
E
L2(0,T ; R+) such
(0, T)7 IIy
Ir
is compact in H . (1.4)
Then for each y o E D ( M ) there is 0 < To < T such that the Cauchy problem (1.3) has at least one strong solution y on [0,To]that satisfies y dY t'/2 dt
E
E
C([O,ToI; H ) ,
L 2 ( 0 ,T o ; H ) ,
Y(t)E D ( M ) +(y)
E
L'(0, T ) ,
as.t
E
t'l2My
(O,T,), E
L 2 ( 0 ,T ; H ) .
(1.5) I f y o E D(+),then y
E
W',*([O,T o ] ;H ) and + ( y ) E AC([O,To];H I .
6.1. Optimal Feedback Controllers
409
This means that there exists one measurable selection A ( t ) of B N t , y ( t ) ) such that A E L2(0,T; H ) and dY -(t) dt
+ My(t) 3 A(t) +f ( t )
hoof: Denote by q :L'(0, T o ; H )
a.e. t
(0,T).
) the operator
+ L2(0,To; H
( q z ) ( t )= y ( t )
E
a.e. t E (O,To),
where y is the solution to the Cauchy problem y ' ( t ) + M y ( t ) = z ( t ) +f ( t ) Y(0) =Yo Let D c L2(0,T o ;H )
D
=
X
a.e.t
E
(O,T,), ( 1 -6)
*
L2(0,T o ; H ) be the multivalued mapping
{ [ y , u ]E L 2 ( 0 , T o H ; ) x L 2 ( 0 , T oH ; ) ;y ( t )
E
D(M),
l y ( t ) - yol Ir a.e. t E (0, T o ) , u ( t ) E B A ( t , y ( t ) ) a.e. 1 E (O,To)]. We have: Lemma 1.1. D is upper semicontinuous and with compact convex values from L2(0,To; H ) into L;(O, To; H ) . Moreover, Dy # 0for ally E L2(0,To; H I , y ( t ) E D(M ) , Iy(t) - yol Ir a.e. t E (0, To). (Here, Lt(0, T o ; H ) is the space L2(0,T o ; H ) endowed with the weak topology.) Proof: Let y , + y strongly in L2(0,To; H ) and u, E Dy, , u, in L2(0,T,,;H ) . We have, therefore, u,(t) E B h ( t , y , ( t ) )
a.e. t
E
+
u weakly
(0,T).
By Mazur's theorem, there is {wm},a finite combination of the u,, n 2 m, such that w, + u strongly in L2(0,T o ; H ) as m + w. Thus, there is a measurable subset I c (0, T ) such that m(Z) = T and on a subsequence, again denoted n , we have y,(t) Y,(t)
+y ( t ED
)
strongly in H, V t E I ,
( M ) , %(t) E BA(t,Y,(t)), strongly in H , V t E Z. wm(t) + u ( t )
V t E I,
410
6. Optimal Control in Real Time
Since BR(t, * ) is upper semicontinuous to U,,, , for every weakly neighborhood 7 of B A ( t , y ( t ) ) there is a neighborhood % of y ( t ) such that B M t , x) c 7 for all x E %. This clearly implies that u ( t ) E B M t , y ( t ) ) V t E I. Now let y E L2(0,T o ;H ) be such that y ( t ) E D( A ) , l y ( t ) - y o ( I r a.e. t E (0, To).Then, the multivalued mapping t + B N t , y ( t ) ) is clearly measurable and so, according to a well-known selection result due to C. Castaign (see, e.g., C. Castaign and M. Valadier [11) it has a measurable selection, which by condition (1.4) is in L2(0,To ; H I . Now we come back to operator ‘4’ previously defined. For any 6 E L2(0,T o ; H I , denote by xg the set ( z E L2(0,T o ; H I ; Iz(t)l I 6 0 ) a.e. t E (0,T)). Lemma 1.2. The operator 1I’ defined on X , is continuous from L i ( 0 ,To ; H ) to LYO, To; H ) .
Proo$ Let 2, E X be weakly convergent to z in L2(0,To; H ) and denote by y, the corresponding solutions to (1.6). We have the estimates (see Section 1.5, Chapter 4)
and by the Arzelh-Ascoli theorem we infer that (y,) is compact in E > 0. Hence, on a subsequence, we have
C ( [ E To]; , H ) for every
y,(t) + y ( t )
stronglyin H , V t
E
[O,TO],
uniformly on every interval [ E , To], E > 0. By the Lebesgue dominated convergence theorem, it follows that y E L2(0,T o ;H ) and y, + y strongly in L2(0,To;H ). By standard arguments, this implies that y = 1I’z is the solution to (1.61, as claimed. Proof of Proposition 1.1 (continued). We may write problem (1.3) as y
E
*D(y),
l y ( t ) -yol 5 r
a.e. t
E
@,To)
or, equivalently, WED’4’W
WEXg,
where 6 = l l B l l ~ H , ~)~h O ,(see assumption (3.3)).
(1.7)
6.1. Optimal Feedback Controllers
411
By Lemmas 1.1 and 1.2, the operator DlIr is upper semicontinuous on Lt(0,T o ; H I , has compact convex values and X , is a compact subset of Lt(0,T o ;H ) . Moreover, DlIr maps X , into itself if To is sufficiently small. Indeed, for z E X , we have, by Eq. (1.61,
+ 4(Y(t)>- 4(Yo)
3(lY(t) -Yo12)’
a.e. t
5 ( w ( t ) +f(t),Y(t) - Y o )
E
(O,TO),
and this yields l Y ( t ) -Yo1 5
c(t + @s)
+ If(sN2ds)
Vt
E
[O,TOl.
(We assume first that y o E D(+).) Hence, for To sufficiently small we have l*w(t)
- y,l
sr
Vt
E
[O, To],
and so by assumption (1.4) it follows that D q w E X , , as claimed. - If y o E D(4) = D(M ) , the same conclusion follows by density. Then, by the Kakutani theorem (see Theorem 2.2 in Chapter 1) in the space Lt(0, T o ; H I , we infer that the operator D q has at least one fixed point w E X,. Equivalently, there is y = q w such that
w
=@
*
in L 2 ( 0 , T o ;H ) .
By the definitions of D and we see that y is a solution to the Cauchy problem (1.3). We note that the conditions (1.5) follow by Theorem 1.10 in Chapter 4. Consider now the optimal control problem:
subject to
y’
=
d + ( y ) 3 Bu + f
a.e. t
E
(O,T),
(1.9)
Y(0) =Yo9 where the functions g : [0, TI X H -+ R, q o :H + R and h: U conditions (v), (vi) from Section 1.1 in Chapter 5.
+
R satisfy
412
6. Optimal Control in Real Time
An optimal control u for problem (120, (1.9) that is represented in the feedback form (1.2) is called optimal feedback control. We shall see in the sequel that for a quite general class of optimal control problems of the form (1.8) every optimal control can be represented as a feedback control, and the synthesis function A can be easily described in terms of the solutions to the optimality system associated with (1.81, (1.9). To be more specific, we will consider the optimal control problem (1.8) governed by the semilinear parabolic equation
JY dt
Ay
--
+ P ( y ) = Bu + f
in Q
=
R x (O,T),
in 2 = dR x ( O , T ) , in a,.
y = o y(x,O) =yo(x)
(1 .lo)
where is a locally Lipschitz real valued function that satisfies the condition 0 IP ' ( r ) IC(IP(r)I
+ Irl + 1)
a.e. r
E
(1.11)
R.
As seen earlier this is a problem of the form (1.91, where H = L 2 ( n )and d 4 ( y ) = - A y + P ( y > V y E D ( 4 ) = {Z E H,'(R) n H2(R>; P ( z ) E L2(R)}. It is readily seen that D ( d 4 ) is dense in L2(R). Indeed, for any z E H,'(Q) we have (1 E P ) - ' z E (we may assume P(0) = 0) and
+
(1 + E P ) - ' z ( x )
+z ( x )
a.e. x
E
for
1(1+ E P ) - ' Z ( X ) I
IIZ(X)I
a.e. x E
(a).
+
Hence, (1 E P ) - ' z + z strongly in L 2 ( n )as Define the map r: [O, TI x H + H by
E +
E +
0,
0.
where ( y ' , u', p ' ) satisfy the system d
-y'
dS
d
-p' dS
-
+ Ap'
y'(x,t) y'
Ay' -
+ P ( y ' ) = Bu' dp(y')p'
= z,(x), = p' =
0
E
in Q' = R
+f
dg(s,y')
=
dC!
B*p'(s) E dh(u'(s))
(t,T),
in Q',
p ' ( x , T ) 3 -drp,(y(x,T)) in C'
X
x ( t ,T ) , a.e. s E ( t , T ) ,
in
a, (1.13) (1.14)
6.1. Optimal Feedback Controllers
and ( y ' , u ' ) problem
E
413
C ( [ t ,TI; H ) x L2(t,T; U ) is a solution to optimization
{ l T ( g ( s , y ( s ) )+ h ( u ( s ) ) )ds + cp,(y(T)), (1.15)
Minimize
subject to u E L 2 ( t , T ;U )and dY
-dS
Ay
+ p ( y ) = Bu + f in R,
y(x,t) =zo(x)
in Q',
y
=
in Z'.
0
(1.16)
As seen in Proposition 1.1 and Theorem 1.1 in Chapter 5, for every ( t , z , ) E [O,T]x L2(R) there are y',u', and p' € A C ( [ t , T ] ; Y * )n C,([t, TI; L2(R)) n L2(t,T; H,'(R)) satisfying Eqs. (1.13), (1.14). Hence, r is well-defined on [O, TI X L2(R).
Theorem 1.1. Every optimal control u* for problem (1.81, (1.10) has the feedback representation a.e. t
u*(t) E dh*(B*r(t,y*(t)))
E
(1.17)
(O,T),
where y* is the corresponding optimal state. Theorem 1.1 amounts to saying that every optimal control of problem (1.8), (1.10) is an optimal feedback control with the synthesis function V ( t , y ) E [O,T] X L 2 ( n ) . (1.18)
A ( t , y ) = dh*(B*r(t,y))
Pro05 Let ( y * , u * ) be any optimal pair for problem (1.8), (1.10). Then, obviously, ( y * ,u * ) is also optimal for the problem: Minimize
(lT(
g( s, y ( s))
d
-y
dS
-
Ay
+ h( u( s)))
ds
+ cpo( y ( T ) ) ,
+ p ( y ) = Bu + f
y(x,t) =y*(x,t)
in R,
y
subject to
in R', =
0
in Z',
(1.19)
and so by Theorem 1.1 in Chapter 5 we infer that there are p' AC([t,T l ; Y * )n CJt, TI; L2(R>)n L2(t,T; H,'(R)) such that d
-pf dS
+ Ap'
-
dp(y*)p'
E
dg(s,y*)
in
E
'p',
p f ( x , t )E -d'p,(y*(x,T)), x E R, p' = 0 in u*(s) E dh*(B*p'(s)) a.e. s E ( t , T ) .
X',
(1.20) (1.21)
414
6. Optimal Control in Real Time
The function u* being measurable, it is a.e. approximately continuous on [0, TI. This means that for almost all t E (0, T ) there is a measurable set El c (0, T ) such that t is a density point for El and u*IE, is continuous at t. Let us denote by E' the set of all s E [ t ,TI for which (1.21) holds. Since, for almost all t E (0, TI, t is a density point for E' n El there is a sequence s, + t such that u*( s,)
+
and
u*(t)
u*( s,) E dh*( B*p'( s n ) ) .
Since p' is weakly continuous on [ t ,TI, we have
B*p'(s,)
--$
B*p'(t)
weakly in L'(fl),
and dh* being weakly-strongly closed in U X U we conclude that u * ( t ) E dh*(B*p'(t))a.e. t E (0, TI. In other words, we have shown that u*(t)E dh*(B*r(t,y*(t)))
a.e. t
E
(O,T),
thereby completing the proof. Regarding the properties of the synthesis function A, we have: Proposition 1.2. For each t E [0,TI, the map r(t,* 1: L'(fl) + Lk(fl) is uppersemicontinuous and bounded on bounded subsets. For each yo E L'(fl), r(-,yo):[O, TI -+ L'(fl) is measurable.
Proog It is easily seen that r(t, ) is bounded on every bounded subset. We assume that r is not upper semicontinuous from L'(fl) to L;(fl), and argue from this to a contradiction. This would imply that there are y o E L'(fl), y," -+ y o strongly in L2(fl), and .I," E r(t,y,") such that 7; E D for all n. Here, D is a weakly open subset of L'(fl) and
T ( t , Y , ) c D.
(1.22)
By the definition of r there are ( y : , u f , p i ) satisfying the system (1.13), (1.14), and p ; ( t ) = $, y:(t) = y," . By (1.15, (1.16) it is easily seen that { y i } is bounded in C ( [ t ,TI; ,!,'(a)) and It"' dyi/ds} is bounded in L2(t,T; L2(fl)). Thus, on a subsequence, again denoted (n),we have u:, --$ u' y:(s) - + y ' ( s )
weakly in L'(t, T; U ) , stronglyin H , V s E [ t , T ] ,
weaklyin w ' . ' ( [ s , T ] ;H ) VS E ( O , T ) , Y,: - j Y ' where y' is the solution to (1.13) with the Cauchy condition y ' ( t ) = y o . Then, by the estimates proved in Proposition 1.2, Chapter 5, we know that
6.1. Optimal Feedback Controllers
415
(see also Theorem 1.1 in Chapter 5 ) strongly in ~ ~ T( ; tL*( , a)),
P:,+PI
weak star in L"(t, T; L 2 ( a ) ) , and stronglyinY*,Vs
p:,(s)+ p ' ( s )
E
[t,T],
where p' is the solution to (1.13), (1.14). and p:,(t) - + p ' ( t ) strongly in Y* Since ( p i ( t ) }is bounded in L2(Cl),we conclude that
3
weakly in L ~a( ) ,V t E [0, TI.
p : , ( t ) --+ p ' ( t )
Hence, .I," + p ' ( t ) E r ( t , y , ) weakly in L 2 ( f l ) ,which by virtue of (1.22) implies that .I," E D for all n sufficiently large. The contradiction at which we have arrived completes the proof. Let y o E L 2 ( f l )be arbitrary but fixed. Then by a similar argument it follows that the multivalued function t -+ r(t,y o ) = p ' ( t ) is weakly upper semicontinuous from [0, TI to L 2 ( a ) , which clearly implies that (U*,y,))Y'(C) is a closed subset of [O,Tl for each closed subset C of L 2 ( f l ) ,i.e., IX-,y o ) is measurable, as claimed. Theorem 1.1 provides a simple method to compute the synthesis function A associated with problem (1.8), (1.9) by decoupling the corresponding optimality system. However, since in general the multivalued mapping (1.18) is neither upper semicontinuous nor has convex values, the existence result given by Proposition 1.1 is not applicable to closed loop system (1.2) and so it is not clear if the corresponding feedback control (1.17) is compatible with system (1.10). However, if h ( u ) = ~ I u I we ~ may replace u by the relaxed feedback control
u
=
B*conv T ( t , y ) ,
which by virtue of Propositions 1.1 and 1.2 can be implemented into system (1.10). Let us observe that if, in the problem (1.8, (1.101, g ( t , . 1, po,and p are continuously differentiable with Lipschitz derivatives and if ah* is Lipschitz, then by standard fixed point arguments it follows that for It - TI I6 sufficiently small, the system (1.13), (1.14) has a unique solution ( y ' , p ' ) . Hence, for T sufficiently small, r(t,* ) is single valued and continuous on a
416
6. Optimal Control in Real Time
given bounded subset of L 2 ( n ) .Then the feedback control (1.17) is continuous, and so by Proposition 1.1 it is compatible with the system (1.10). Now, if we approximate g, q o , and h by g", (qo>",p", and h,(u) = h(u) + E I U I ; , respectively, we may construct an approximating feedback control compatible with the system (1.10) on a sufficiently small interval of time. Remark 1.1. If p is merely locally Lipschitz or in the case of the obstacle problem, we may define the map r as U t ,2 0 ) = p ' ( t
+ 01,
where ( y ' , p ' ) satisfy the corresponding optimality system on [ t ,TI, and p'(t + 0) = w - lims+t,s, I p'(s> in ~ ~ ( n ) . 6.1.2. The Optimal Value Function
We shall consider here problem (PI studied in Chapter 5, i.e.,
on all ( y , u ) E C([O,TI; H ) X L2(0,T ; U),subject to dY
-dt( t )
+Ay(t)
+ d q ( y ( t ) ) 3 Bu(t)
a.e. t
E
(O,T), ( 1.23)
Y(0) =Yo7
where A is a linear, continuous, and symmetric operator from V to V' satisfying the coercivity condition ( A y , y ) 2 ~llY1I2 and q : H
+
vy
E
v,
(1.24)
R is a lower semicontinuous convex function such that
( A y , d q & ( y ) )2
-c(l + ldq&(y)12)(1+ Iyl)
where D ( A H )= { y & > 0.
E
V; Ay E H ) and dqc
vy = &-l(Z
D(AH),
-(I
(1.25)
+ &dq)-',
Here, H and V are real Hilbert spaces such that V c H c V' algebraically and topologically, and the injection of V into H is compact.
6.1. Optimal Feedback Controllers
-
417
We shall denote as usual by 1 the scalar product of H, and also the pairing between V and V’, and by I I (respectively, II * 11) the norm of H (respectively, V ) . As seen earlier, the operator (a,
-
+
A,u = A u n H ,
dc#~=A, dq,
is maximal monotone in H
X
H , and
Regarding the functions g: H + R, q o :H + R, and the operator B: U + H, we shall assume that hypotheses (iv), (v), and (vi) or (vi)’ of Section 1.1 in Chapter 5 are satisfied. As noted earlier, for every y o E D( 4) the Cauchy problem (1.23) has a unique solution y E C([O, TI; H ) n L’(0, T; V )with t’/’ dy/ds E L’(0, T ; H ) , t*/2A,y E L’(0, T; H ) . For 0 < t < s < T and y o E D( 4), denote by y ( s , t, y o ) the solution to the Cauchy problem
dY
-(s)
dr
+ d ~ $ ( y ( s ) 3) Bu(s)
The function
a.e. s
E
(t,T),
y ( t ) = y o . (1.26)
9:[O. TI x D(4) + R,
is called the optimal value function of problem (P).
Proof: By Proposition 1.1 in Chapter 5 we know that the infimum defining $ ( t , y o ) is attained. Since d+ is monotone, we have ly(s, t , y o u ) - Y ( S , t , 2 0 u)l 5 I Y O - ZOI 9
9
Vs E [ t , T ] . (1.28)
418
6. Optimal Control in Real Time
Now if multiply Eq. (1.23) by y(s) - yo, where yo E D ( d 4 ) , and integrate on [ t ,sl, we get ly(s,t,yo,u)l I lyol + C ( [ ' l u ( ~ ) l ~d ~ 1) +
Vs
E
[ t , T l , (1.29)
where C is independent of t and s. Now let yo E D(4 ) be such that lyol 5 r. We have @(t?YO)5 /?'(g(Y(sJ7Yo,0)) + 4 0 ) ) ds + %(Y(T,t,YO,O))
c,.
<
( 1.30)
(We may assume that 0 E D(h).) By virtue of assumption (v) we may therefore restrict the optimization problem (1.24) to the class A, of u E L2(t,T; U ) satisfying the condition dT
LTIU(T)l:
c:.
Then, by estimates (1.281, (1.291, it follows that for u EA,the function yo .+ JtT g(y(s, t , yo, u ) ds + (po(y,T, t , yo, u)) is Lipschitz on B, = { y E D( d 4 ) ; lyl Ir ) with the Lipschitz constant independent of u €Ar. Since ~
for yo, zo E B, and some u $(t, 20)
=
E&,
such that
[=(g(Y(s, t , 2 0 u ) ) + 4 u ) ) ds + cPo(Y(T7 9
20
7
u)),
we obtain that l$(t,yo)
-
$ ( t , 2,)l
I L,lYo - 201
VYOJO
E
B,,
as claimed. On the other hand, for every yo E D ( d 4 ) we have Iy(s, & Y o u ) - Y(S, t , Yo ,u)l 9
I ly(t,f,yo,u) -yo
+
t t
lBu(~)ld~ ld4(yo)lIt + - fl.
(1.31)
Now let us observe that without any loss of generality we may assume that, for yo E B,, A, c { u E LTt, T; U ) ; l u ( ~ )I l~ C,), where C , is independent of t. Indeed, if u' is a minimum point for the functional (1.27) then by
6.1. Optimal Feedback Controllers
419
(1.29) we see that the corresponding optimal state y' has an independent bound in C ( [ t ,TI; H ) . On the other hand, a.e. s
u'(s) E dh*(B*p'(s))
where p'
E LYt, T ;
E
(t,T),
H ) and
Ip'(s)l
c;
vs E [ t , T ] .
I
This follows as in the proof of Proposition 1.2 in Chapter 5, approximating problem (1.27) by a family of smooth control problems and taking the limit of the corresponding optimality system, dY& + Ay ds
-
+ VCp"(y,) = Bu,
in ( t , T ) ,
dP& = Vg"(y,) ds -4,- V2Cp"(Y&)P&
in ( t , T ) ,
-
Y & ( t )= Y o ,
P & ( T )= -V(cpO)&(Y&(T)).
Since, by assumption (v), dh* is bounded on bounded subsets, we conclude that l u ' ( s ) I ~I C j
V y o E Br, s
[t,T],
E
and so by (1.31) we have Iy(s,f,yo,u) -y(s,t,yo,u)l for all t If such that
Is IT .
IC;It
-
fl
Now let u , E L2(t,T ; H ) and y,
vu
€4,(1.32)
= y ( s , t , y o ,u,)
be
+(t,YO) = / T ( g ( Y f ( s ) )+ h ( u , ( s ) ) )ds + cpO(Yl(T)), and let 4 s ) = u o for s Muo) < a.We have
E
[f,t], and u ( s )
=
u I ( s ) for s E [ t , T l , where
+(f, Y o ) - + ( t , Y o ) 5 [ ' M Y ( S , f, Yo u ) ) + h ( u 0 ) ) ds 9
+ l T M Y ( s .f, Y o u ) ) - g ( Y ( s ,t , Yo u ) ) ) ds 9
9
+ (Po(Y(T,f, Yo u ) ) - CpO(Y(T3t , Yo , u ) > , 9
which along with the estimate (1.32) yields l + ( f , y o ) - +(t,yo)l 5 Llt - fl
V t , f E [%TI.
(We note that L depends on r ( y o E Br n D(d+)).)
420
6. Optimal Control in Real Time
Now we shall prove the dynamic programmingprinciple for problem (P).
Prooj Let ( y , u ) y ( s , t , y o ,u ) and
E
C([t,TI; H ) x L 2 ( t , T ; U ) be such that y
=
This yields
+ @ ( s , y ( s , t , y o , u ) ) ;24 On the other hand, for all u have
E
E
1
L 2 ( t , T ;U )
*
L2 (t,T ; U ) and y ( s ) = y ( s , I , y o ,u), we
We may choose y and u in a such a way that
6.1. Optimal Feedback Controllers
421
and so
thereby completing the proof. (The continuity of $ is obvious.)
W
6.1.3. The Dynamic Programming Equation As in the classical theory of calculus of variations, we associate with the problem (PI the Hamilton-Jacobi equation $ f ( t , Y ) - h * ( - B * I C ; ( t , y ) ) - ( d 4 ( Y ) , c G ; ( t , Y ) +) d Y ) = 0 in [ O , T ] x H $(T,Y) = Vo(Y) VY = H . (1.34) where I/Jf and i,hy represent the partial derivative of $ with respect to t and y , whilst h* is the conjugate of h . Equation (1.34) is called the dynamic programming equation corresponding to problem (PI. In general, this equation does not have a solution in the classical sense even if the space H is finite dimensional and d 4 , g , and qo are smooth. However, under supplementary conditions on problem (P) the optimal value function I) satisfies Eq. (1.34) in some generalized sense. Let us denote by 0,’ $ ( t , y ) the superdifferential of $(t, * at y , i.e., the set of all 7 E H such that limsup ( ( + ( t , z) - + ( t , y ) - (7,z - y ) ) l z - y t - ’ }
I0.
(1.35)
Z+Y
Similarly, Dy- $(t, y ) , the subdifferential of of all w E H such that
$0, ) at y , is defined as the set
We will assume now that: (a) (b)
A is a linear, continuous and symmetric operator from V to V’ satisfying condition (1.24); V c H c V’ algebraically and topologically; the injection of V into H is compact;
6. Optimal Control in Real Time
The operator F = dcp: H -+H is FrCchet differentiable on H with locally Lipschitz FrCchet differential VF; The functions g and cp, are continuously differentiable on H with locally Lipschitz derivatives Vg and Vcp, , respectively. The function h: U + R is convex, lower semicontinuous, and
h ( u ) 2 alult
+y
Vu
E
U,
where a > 0. Moreover, the conjugate function h* is differentiable with locally Lipschitz derivative Vh*. Theorem 1.2. Let assumptions (a)-(e) be satisfied. Then the optimal value [0,TI X H + H is continuous, locally Lipschitz in y for every function t E [0,TI, Lipschitz in t for every y E D ( A , ) , 0,’ $ ( t , y ) # 0 V ( t , y ) E [O, TI X H , and
+:
More precisely, Eq. (1.36) holds for all ( t , y ) for which @ ( . , y ) is differentiable at t. satisfies the Roughly speaking, Theorem 1.2 amounts to saying that Hamilton-Jacobi equation (1.34) in the following weak sense: * f ( l 9 Y ) - h*( - B * D , + @ ( t , Y )
( A H Y + F Y , ~ , + * ( t , Y )+) d Y ) a.e. t
E
( O , T ) ,y
ED(A,).
=
0
(1.36)‘
Regarding the optimal feedback controllers, we have: Theorem 1 3 . Under assumptions (a)-(e), every optimal control u* of problem (PI is expressed as a function of the optimal state y* by the feedback law
u * ( t ) E Vh*( - B * D , + J I ( t , y * ( t ) )
V t E [O,T].
(1.37)
Proof of Theorem 1.2. Let ( t , y o ) E [0,TI X D ( A , ) be arbitrary but fixed. Then, as seen in Chapter 5 (Proposition 1.11, there are y‘ E C ( [ t ,TI; H )
6.1. Optimal Feedback Controllers
and u'
E L2(t,T ; lJ) such
423
that
and d -y'(s) ds
+ A , y ' ( s ) + F y ' ( s ) = Bu'(s) Y'(t> =Yo
u'(s)
=
=
(1.39)
*
Then, by the maximum principle, there is p'
P'(T)
a.e. s E ( t ,T ) ,
E
C ( [ t ,TI; H ) such that
(1.40)
-Vvo(y'(T)),
Vh*(B*p'(s))
Vs
E
(1.41)
(t,T).
Since y' E W 1 , 2 ( [TI; t , H ) , the functions s -+ V g ( y ' ( s ) )and s -+ V F ( y ' ( s ) ) are Holder continuous. Moreover, inasmuch as p' E W 1 , 2 ( [61; t , H ) for every t < S < T , we conclude that s + V g ( y ' ( s ) ) + V F ( y ' ( s ) ) p ' ( s ) is Holder continuous on every interval [ t , 61 c [ t ,TI, and so p' is a classical solution to Eq. (1.40) on every [ t , 61 (see Theorem 4.5 in Chapter 1). Finally, since by (1.41) u' is Holder continuous on every [ t , 61, we infer that y' is a classical solution (Le., a C'-solution) to Eq. (1.39) on [ t ,TI. Now, if multiply Eq. (1.39) by dp'/ds, Eq. (1.40) by dy'/ds, and subtract the results, we get d - [ ( A Y ' ( s ) , P ' ( s ) ) + ( F Y ' ( S ) , P ' ( S ) ) + g ( y ' ( s ) > - h*(B*p'(s))l ds =0 Vs E ( t , T ) , because, by virtue of Eq. (1.41), d -h*(B*p'(s)) ds
=
Vs
E
(t,T).
424
6. Optimal Control in Real Time
We set
r(t,yo)
=
{ - p ' ( t ) ; p' satisfies Eqs. (1.40), (1.41) along with some optimal pair (y', u')}.
We have: For euery ( t ,yo) E [0,TI
Lemma 1.4.
r(t,Yo) = Proof
X
H , we have
qw,Yo).
( 1.43)
For any x E H we have
@ ( t ,x ) - @ ( t Yo) ,
I lT(g(y,(sN
-
d Y W ) ) ds + Vo(Y,(T))
-
Vo(Y'(T)),
(1.44)
where
y;(s) +Ay,(s)
+ Fy,(s)
s E
= Bu'(s),
(t,T),
YAt) = x * Clearly, we have
ly,(s) -y'(s)l I Clx -Yo1
vs
E
( 1.45)
[t,T).
Now let w be the solution to the equation
w' + A w
+ VF(y')w
0 w ( t ) = x -yo.
It is easily seen that if lyo - XI I
ly,(s) -y'(s)
=
in [ t , T ) , (1.46)
then
- w(s)l I ElYO
--I
vs E [ t , T ) ,
(1.47)
and so by (1.44) we have @(t,X)
-
@(f,Yo)
I j l T ( W Y ' ( S ) ) , w 0 ) ds + (VVo(Y'(T)),w(T))
+
for Ix -yol I
EIX
a(&).
-Yo1 (1.48)
Now we take the scalar product of Eq. (1.40) with w and integrate on [ t ,TI. We get @ ( t , x ) - @(t,YO) I -(p'(t),w(t))
+
EIX
-Yo1
for Ix - yol I 6( E).
6.1. Optimal Feedback Controllers
425
Remark 1.2. It is easily seen that for T - t sufficiently small, the system (1.39)-(1.41) has a unique smooth solution ( y ' , p ' ) and so r(t,. ) is single valued. Moreover, arguing as in the previous proof, it follows that for every R > 0 there is v ( R ) > 0 such that @(r, ) E C ' ( B , ) and
-
V,W,Yo) for all y o
E B, =
=
r(t,Yo)
{ y E H ; lyl
Vt
E
[T - v(R),TI,
IR}.
Proof of Theorem 1.2 (continued). We shall assume first that V q o ( y ) E D ( A ) for all y E H. Then, by Eq. (1.40), we see that p' E C'([t,TI; H ) and y' E C ' ( [ t ,TI; H I . Now let y o E D ( A ) be arbitrary but fixed and let t E [0, TI be such that y o ) is differentiable at t. By the definition of $, we have #(a,
*(t,YO)
=
inf j l o T - t g ( y ( s ) ) + 4 4 s ) ) ) Cis + rpo(Y(T - t ) ) ;
y'
i +
+ Ay + Fy = Bu in [0, T - t ] ,y ( 0 ) = y o .
We set z'(s) = y'(t + s), d ( s ) = u'(t + s), q ' ( s ) = p'(t - t], where ( y ' , p ' ) is defined by (1.38)-(1.41). We have
s) for s E [O, T
426
6. Optimal Control in Real Time
427
6.1. Optimal Feedback Controllers
By assumption (e) it follows that (u:} is bounded in L2(t,T; U ) and so on a subsequence, again denoted { E } , we have
where
weaklyin L 2 ( t , T ;U ) ,
6'
u:
+
y:
+yl
stronglyin C ( [ t , T ] ;H),
p:
+pl
stronglyin C ( [ t , T ] ;H),
(y', g', 2 ) satisfy Eqs. (1.39)-(1.41). *"(t,Yo)
Then, letting W
E
E
lim ,,(t,YO)
&+
0
+
It is also clear that as
*(t,Yo)
E
+
0.
tend to zero in (1.491, we see that - h*(B*lj'(t)) + (AYO
Since, as seen in Lemma 1.4, f i ' ( t )
E
-D,'
+ FYO,fi'(t))+ g ( Y o )
=
0.
$0,y o ) we infer that a.e. t E ( O , T ) ,
for some E D,'@(t, yo). This completes the proof of Theorem 1.2.
W
Remark 1.3. Under the assumptions of Theorem 1.2, for every R > 0 there is T = T ( R ) such that I) is a classical solution to Eq. (1.36) on the domain ( B R n D ( A , ) ) X (0, T ) (see Remark 1.2). Proof of Theorem 1.3. Let ( y * , u*> be any optimal pair in problem (P). Then, by Lemma 1.3, we see that for every t E (O,T), ( y * ,u * ) is also optimal for the problem
This means that u*(s)
=
Vh*(B*p'(s))
Vs E [ t , T ] ,
where p 1 is a solution to the system (1.40) where y' = y*. Then, by Lemma 1.4, we conclude that u * ( t ) E Vh*( -B* D,'+(t, y*(t))) V t E [O, TI, as claimed. rn
6. Optimal Control in Real Time
428
Now we shall recall the concept of viscosity solution for the Hamilton-Jacobi equation (1.34) (M. G. Crandall and P. L. Lions [31). Let rp E C([O, TI x H). Then, y is a viscosity solution to (1.34) on [0, T ] x H if for every continuously differentiable function x : [0, TI X H + R and 8: H -, R satisfying:
x
is weakly sequentially lower semicontinuous and V x , A V X are continuous; (ii) 8 is radial, nondecreasing, and continuously differentiable on H .
(i)
if ( t o ,y o ) E (0, T ) x H is a local maximum (respectively, minimum) of rp - x - 8 (respectively, rp + x + O), we have x , ( t o Y o ) - h*( -B*( X y G o Y o ) + W Y O ) ) ) - ( X x y ( t 0 Y o ) , Y o ) 7
+YO
9
7
9
XJtO
9
(1 S O )
Yo) + VO(Y0)) + d Y 0 ) 2 0
(respectively, X L t o Y o ) + h*( - B * ( x y ( t o ,Yo 9
-( xy@o Y o ) + V 8 ( Y O ) ?FYO) 9
+ V 8 ( Y O ) ) ) - (A x y ( t 0 Y o ) ,Y o ) 7
-g(Yo) 2
0.)
(1.51)
Proposition 1.4. Under assumptions (a)-(e), the optimal value jhction @ is a uiscosity solution to Eq. (1.34).
6.1. Optimal Feedback Controllers
429
For every uo E D(h), we may choose u E W ' * * ( [ t 0 , T ]U; ) such that h(u) E C ( [ t oTI). , For instance, we may take u to be the solution to the Cauchy problem ur
+ dh(u) 3 0
a.e. in ( t o , T ) ,
u ( t o )= u o .
Then, by (1.52), it follows that X r ( t o , Y o ) - ( A ~ y ( t O , y o ) , y o) ( F Y O , X ~ ( ~ O , Y+ O )V O ( y 0 ) ) + g ( y O ) 2
h*(
-
B*( xy@o, Y o ) + V8(YO)),
because 8 is radial nonincreasing, i.e., 8 ( x ) = dlxl), w r 2 0, and so ( A y o , v e ( y o ) )2 0. Assume now that cp + y, 8 has a local minimum at ( t o ,yo). We have, therefore, by Lemma 1.4
+
X(t0,YO) - X ( t , Y ( t ) > + 8(Yo) - O(Y(t))
as claimed. It follows by the uniqueness results in Crandall and Lions [3] that J/ is the unique viscosity solution of Eq. (1.34). In the general case of unbounded operators dqb, the Cauchy problem (1.34) is still well-posed in a certain class of generalized solutions introduced by D. Tgtaru [l] (see also [3]).
430
6 Optimal Control in Real Time
As a matter of fact such a problem can be approximated by a family of smooth optimal control problems of the form
(P,)
Minimize
subject to dY dt
- + Ay
+ dcp"(y) Y(0)
= Bu
in [0, T I ,
=Yo9
where g", cp,", and cp" are smooth approximations of g , cpo, and cp, respectively. Moreover, the optimal value function $ " of problem (P,) satisfies Eq. (1.34) in the sense of Theorem 1.2 and $ &-+ $ on [0, TI X D(+) as E -+ 0. In this context, we may view $ as a generalized solution to Eq. (1.34). More will be said about this equation in Section 2. Now let us come back to the case H = L2(R), A = - A , V = Hi(R), and dcp(y)(x)
=
p(y(x))
tly
E
L2(R),a.e. x
E
R,
(1.53)
where p: R -+ R is a locally Lipschitz function. Though Theorems 1.2 and 1.3 are not applicable to the present situation we have, however: Theorem 1.4. If p satisfies condition (1.11) then every optimal control u* is expressed as function of the corresponding optimal state y * by the feedback law
u*(t)
E
ah*( - B * d $ ( t , y * ( t ) ) )
a.e. t
E
(O,T),
(1.54)
where $: [0,TI X L2(R) + R is the optimal value function and dtC, is the Clarke generalized gradient of $ ( t , * 1. Proo$ According to Lemma 1.4, for every t E [O, TI the optimal pair (y*, u * ) is on the interval [0, t ] optimal for the problem i n f ( ~ ( g ( Y ( s , o , Y o , u )+ ) h ( u ( s ) ) )ds + $ ( t , y ( t , O , y o , u ) ) ; u E L2(0,t;
a)).
431
6.1. Optimal Feedback Controllers
Then, by Theorem 1.1 in Chapter 5, for every t E [O,T] there is p' AC([O,t ] ; Y * ) n C,([O, tl; H ) that satisfies the equations
E
(1.55) (1.56)
B*p'(s) E dh(u*(s)), P ' ( t > E -dtCl(t,y*(t)).
Since the function u* is approximately continuous on [O, T I , arguing as in the proof of Theorem 1.1 it follows by Eq. (1.55) that u * ( t ) E dh*(B*p'(t))
a.e. t
E
(O,T),
which implies (1.541, as desired. Remark 1.4. If, under assumptions of Theorem 1.4, h is G2teaux differentiable and R ( B ) (the range of B ) is dense in H then any dual extremal arc associated with ( y * , u * ) satisfies the equation p ( t ) E -d+(t,y*(t))
a.e. t
E
(0,T).
(1.57)
Indeed, by Eq. (1.55) we have p ( s ) = p ' ( s ) Vs E [O, t ] , which by virtue of (1.56) implies (1.57). (See C. Popa [2]for a similar result in the case of the obstacle control problem and Clarke and Vinter [ l ]for a related finite dimensional result.) 6.1.4. Feedback Controllersfor the Optimal Time Control Problem
We shall consider here the time-optimal control problem (PI studied in Chapter 5 (Section 3.3) with the state system (3.23) and the control constraints u E 2'& = ( u E L"(0,m; L 2 ( f l ) )Iu(t)12 ; I p a.e. t > O}. We shall assume here that p: R + R is locally Lipschitz and 0I P'(r) s C(l
+ I p ( r ) l + Irl)
a.e. r
E
R.
Denote by cp the minimal time function cp(
y o ) = inf ( T ; 3 u
E
gpsuch that y ( T , y o ,u ) = 0) .
( 1.58)
6. Optimal Control in Real Time
432
Also, it is readily seen that (the dynamic programming principle) cp(yo) = i n f k
e}
+ q ( y ( t , y o , u > >u; E
vt
> 0, Y O
E~ ~ ( f i > .
(1.59)
Here, y ( t , y o , u ) is the solution to system (3.23), i.e., dY -by dt
-
+ p ( y ) = Bu
Y(X,O) =y,(x)
in
in Cl x R ' ,
a,
in dR
y = o
X
(1.60)
R ' .
This implies that every time-optimal pair ( y * , u * ) is also optimal in problem (1.58), and so by Theorem 1.1 in Chapter 5 for every f E [0, T * ) (T* is the minimal time) there is p t E AC([O,t ] ; Y*)n C,([O,t]; L2(R>> n C([O, tl; L'(R)) such that dP' ds
- + Apt
-p'ap(y) 3
0
in R x ( O , t ) ,
a,
p'(t)
E
-8cp(y*(t))
in
u*(s>
E
P sgn P ' ( S >
a.e. s
E
( O , t ) , (1.61)
where sgn p' = pf/lp'12 if p' # 0, sgnO = (w E L2(R); lwlq I 1). Then, arguing as in the proof of Theorem 1.1, we conclude that u * ( t ) E -psgn ( ( t ) ,
t ( t )E
d q ( y * ( t ) ) a.e. t E ( O , T * ) , (1.62)
where d q is the generalized gradient (in the sense of Clarke) of cp: L2(R) +
R.
We have proved, therefore: Theorem 1.5. Under the assumption (1.58), any time-optimal control u* of system (1.60) admits the feedback representation (1.62).
It turns out that, at least formally, the minimal time function cp is the solution to the Bellman equation associated with the given problem, i.e.,
( W Y ) , MY) + PIDV(Y)l2 = 1, d o ) = 0,
Y
E L2(W,
(1.63)
433
6.2. A Semigroup Approach to the Dynamic Programming Equation
where My = - A y + p ( y ) V y E D ( M ) = ( y E Hd(fl>n H2(fl);p ( y ) E L2(fl)). Indeed, coming back to approximating problem (P,) in Section 3.3, Chapter 5, we see by Eqs. (3.641, (3.65) there that
+ ep,(t)
u , ( t ) = psgnp,(t)
a.e. t > 0,
and therefore u,(t>
E
- P sgn d V & ( Y & ( t )-) E J 9 & ( Y & ( t ) )
Then, by (3.651, it follows that Hamilton-Jacobi equation
'p,
a x . t > 0. (1.64)
is the solution to the stationary
&
( d 9 & ( Y )MY) , + PldV&(Y)lZ + p J & ( Y ) 12 2- g " ( y )
VY
E
L2(fl)9
v(0) = 0 , i.e., 3v,(y)
E
( 1.65)
d ~ o , ( ysuch ) that
Since by Theorem 3.5, Chapter 5, 'p, + q~as E + 0, Idcp,(y)l2 I p - ' , and g" + 1 as E + 0, we may view 'p, as an approximating solution to Eq. (1.63) and so cp itself is a generalized solution to Eq. (1.63). As a matter of fact, it turns out that cp is a viscosity solution to Eq. (1.63) and that under a supplementary growth condition on p, it is unique in the class of weakly continuous functions on L2(fl) (see Barbu [20], Tgtaru [2]). 6.2. A Semigroup Approach to the Dynamic Programming Equation
6.2.1. Variational and Mild Solutions to the Dynamic Programming Equation We shall study here the Hamilton-Jacobi equation (1.34) in a more general context, namely in the case when d 4 is replaced by a general maximal monotone operator M c H X H. By the substitution q(t, y ) = +(T - t, y ) we reduce this problem to the forward Cauchy problem cp,(t,Y) + h*( --B*cp,(t,y)) + ( M Y , q ( t , y ) ) = d Y ) ,
cp(0,Y)
=
%(Y).
(2.1)
434
6. Optimal Control in Real Time
As seen earlier, there is a close connection between Eq. (2.1) and the optimal control problem
where y = y ( s , x , u ) E C([O,t];H ) is the mild solution to the Cauchy problem
dY ds
-
+ My 3 Bu
in ( O , t ) ,
y(0)
=x E
D(M).
(2.3)
The following hypotheses will be in effect throughout this section:
H and U are real Hilbert spaces with the norms denoted I * I and I . I u , respectively. B E L(U, H ) and M is a maximal monotone subset of H X H with the domain D ( M ) . (ii) h: U R is a lower semicontinuous convex function such that (i)
-+
Denote by h* the conjugate function of h , i.e., h * ( p ) = sup{(p,u) h(u); u E U ) . We have denoted by (., * ) the scalar product of H and by ( * , ) the scalar product of U. B* is the dual operator of B. Given a metric space X we shall denote by B U C ( X ) the space of all bounded and uniformly continuous real valued functions on X endowed with the usual sup norm: llfllb
=
sup{If( x)l; x
E
XI
9
f E BUC( X ) .
By Lip(X), we shall denote the space of all Lipschitz functions f: X -+ R. In the following, the space X will be the closure D( M ) of D ( M ) in H . If g, cpo E B U C ( D ( M ) ) , then the function cp is well-defined on [O,m) x D(M). We set (S(t)cpo)(x)
=
cp(t,x),
t 2 0, x
E
D(M),
(2.5)
and call it variational solution to Hamilton-Jacobi equation (2.1). We have
6.2. A Semigroup Approach to the Dynamic Programming Equation
435
In other words, S(t) is a semigroup of contractions on the Banach space
Y = BUC(D( M ) ) . Proof Obviously, S(t)cpo is bounded on D ( M ) for every t 2 0. For x, xo E D(M ) we have, for any E > 0, S(t)cPo(x) - S ( t ) c p o ( x o )
and y ( s , x, u ) is the mild solution to (2.3). Recalling that (see Theorem 1.1, Chapter 4)
l y ( t , x o ,u > - y ( t , x, (v)t 5 lx0 - XI
+/b(u 0
- v ) l u ds,
we conclude that S(t)cpo is uniformly continuous on D(M ) . The semigroup property (2.6) is an immediate consequence of the optimality principle, whilst (2.6)' follows by the obvious inequality ( S ( t ) c p o ) ( x ) - ( S ( t ) S o ) ( x ) 5 cpO(Y(t9 x, u ) ) - $ o ( t , x, u ) +
where
E
is arbitrary and suitable chosen.
E?
(2.7)
rn
The main result of this section (Theorem 2.1 following) amounts to saying that the semigroup S ( t ) is generated on a certain subset of Y by an m-accretive operator.
436
6. Optimal Control in Real Time
The generator A? of S ( t ) is constructed as follows. For any f E BUC(D( M ) ) and A > 0, define the function (R(A)f)(x)
=
inf{ke*'(f(y(W u
E L:,,(R+;
U ) , y'
+ h ( u ( t ) ) )d t ;
+ My 3 Bu in R f , y ( 0 ) =
It turns out that R(A) is a pseudo-resolvent in Y = BUC(D( M ) ) . More precisely, we have:
Lemma 2.2.
For every A > 0, R(A) maps Y into itself and
R(A)f=R(p)((p-A)R(A)f+f)
Moreover, i f f
E
O < A I p < w .
(2.9)
Lip(D(M)) then R ( A ) E ~ Lip(D( M I ) .
Pro06 Let uo E U be such that h(u,) < co and let y o ( t ) = y ( t , x, u,,) be the corresponding solution to (2.3). We have the obvious inequality
This would imply that 10"e-A'h(u,(t))dt -, - 03 as n + 00, which by virtue of the convexity of h and assumption (2.4) leads to a contradiction. Hence, R(A)f is bounded on D(M). To prove that R(A)f is uniformly continuous consider xl, x2 arbitrary but fixed in D(M). For every E > 0, there are u, and iie such that
6.2. A Semigroup Approach to the Dynamic Programming Equation
for all (y, u ) satisfying Eq. (2.3). This yields
437
438
6. Optimal Control in Real Time
+ k m C h ’ ( f ( r * ( s- t ) ) + h ( u * ( s - t ) ) )ds (2.10) where ( y * , u * ) and ( z * , u * ) satisfy Eq. (2.3) with the initial conditions y*(O) = x , z*(O) = y * ( t ) and are chosen in a such a way that
R( El.)(( El. - A ) R ( A ) f + f ) ( x ) 2
k m e - * l ( f ( y * ( t ) )+ h ( u * ( t ) ) )dt
+kme-”(f(z*(s))
+(
+ h ( u * ( s ) ) )ds -
-
A) j m e - P ‘ d t 0
(2.11)
E.
Now, if we multiply (2.10) by e - ( P - A ) r and integrate on (0,m), we find after some calculation involving (2.11) that
( R ( A ) f ) ( x ) 2 R( El.)(( El.
-
A)R(A)f+f)(x) +
E
> 0,
which completes the proof. Now let d:D ( d ) c Y -+ Y be the operator (eventually, multivalued) defined by
dR(1)f = f - R( 1)f
Vf
E
Y = BUC( D(M)),
D ( d ) ={cp=R(l)f;f€Y).
(2.12)
If the operator A is continuous on H and f,h* are smooth, then it is readily seen that cp = R(l)f satisfies the stationary Hamilton-Jacobi equation
M Y ) + (MY777(Y)) + h*(-B*77(y)) = f ( Y ) y VY E W M ) . 77(Y) E d c p ( Y ) , (This follows easily by the optimality system associated with the infinite horizon optimal control problem (2.81.) Thus, we may view the operator d as an extension on Y of the operator y + (My, cpy(y))+ h*(-B*cpy(y)). If
6.2. A Semigroup Approach to the Dynamic Programming Equation
439
M is linear, then we have (see Barbu and DaPrato [l]) dp=
Y ;W ( X ) = ( ~ ( x ) , M x )+ h*( - B * ~ ( x ) ) V X E D ( M ) , bE V(X) E W x ) }
{W E
w-4.
Lemma 2.3. The operator d is m-accretive in Y ( A Z +&')-'
=
VA
R(A)
X
E
Y and
(0,1].
(2.13)
(I is the unity operator in Y.) Proof: By Eqs. (2.91, (2.12) we see that ( AZ
+ d)
=
for 0 < A
R( A)
I1,
(2.14)
whilst by definition of R(A) it is readily seen that IIR( A)f - R( A)gIIb I A-'
IIf
- gIIb
VA > 0, f,g
E
Y.
Hence, &' is m-accretive (see Section 3.1 in Chapter 2). Moreover, by the resolvent equation ( A Z + d ) - ' f = ( p Z +d)-'(( p - A)(AZ + d ) - ' f + f ) , we infer that (2.13) holds for all A > 0. According to the Crandall-Liggett generation theorem (Theorem 1.3 in Chapter 41,for every 'po E D ( d ) and g E Y the Cauchy problem dP dt
-+dq 38 Cp(0) =
has a unique mild solution 40 formula
E
in
[O,w),
(2.15)
4009
C([O,w); Y ) , given by the exponential
(2.16)
q & ( t )= 40,
for
-8
I t I 0.
(2.17)
440
6. Optimal Control in Real Time
- Moreover, the map T ( t ) :D ( d ) -+ D ( d ) defined by Vcpo
T(t)cpo,= cp(t)
E
(2.18)
D ( d ) ,t 2 0,
is a continuous semigroup of nonlinear contractions of D ( d ) . The function t -+ T(t)cpo is called mild solution to Eq. (2.1). 6.2.2. The Equivalence of Variational and Mild Solutions Coming back to the semigroup S ( t ) defined by formula (2.51, one might suspect that S(t)
=
onD(d).
T(t)
Indeed, we have:
Theorem 2.1. Assume that hypotheses (i), (ii) hold and that g L i p { ( m ) . Then S( t ) 9 0
=
T ( t )~
o ,
E
(2.19)
V t 2 0 , Vpo, E D ( d ) .
Moreover, the operator d is single valued and for every cpo E D ( d ) one has 1 lim - ( ( S ( t ) c p o ) ( x ) - cpo(x)> t10 t
=
-(dvo)(x) +g(x)
Vx E D(M)* (2.20)
Before proving Theorem 2.1 we shall give a precise description of the closure D ( d ) of D ( d ) in Y. We shall denote by Z the set of all cp E Y having the property that the function t -+ SM(t)cp= cp(e-M'x) defined from [O,m) to Y is continuous into the origin. In other words, 2 is the domain of the Co-semigroup S M ( t ) : [O,m)
Proposition 2.1.
-+
Y.
Under the preceding assumptions 2
=
D(d).
441
6.2. A Semigroup Approach to the Dynamic Programming Equation
or, equivalently,
i
8 = cp
E
5 L,(f
BUC(D(M))n Lip(D(M));
Icp(y(t, x , u ) ) - c p ( x ) ~
+ l I u ( s ) I u d s ) V t 2 0 , u E L'(R+; U ) , x
E
D(M)), (2.21)'
where y ( t , x , u) is the solution to (2.3). It is readily seen that Z =8(the closure of 8 in B U C ( D ( M ) ) ) . Indeed, the space B U C ( D ( M ) )n Lip@( M)) is dense in B u C(D( M ) ) (see, e.g., Lasry and Lions [l]) and by the same argument it follows that 2 n Lip(D( M ) ) is dense in 2. Now it is readily seen that for every cp E Z n Lip@( M ) ) ,
and cp& E A *
This implies that 2 =8, as claimed. Hence, to prove Proposition 2.1 it suffices to show that 5 = D ( d ) .Toward this aim, we shall prove first that
(2.23)
0, (2.24)
because cp is Lipschitz (Lemma 2.3). (Here and everywhere in the following we shall denote by C several positive constants independent of E , u,
442
6. Optimal Control in Real Time
and t.) On the other hand, by the optimality principle we have
y’
+ My 3 Bu in ( 0 , t),y(O) = x)
Vt
> 0.
In view of (2.231, this yields 1
+ h(s)) d s ~_< E
- ~ c p ( x )- e-‘/”cp(y,(t)) - / ‘ e - ’ / / ” ( - f ( y , ( s ) )
CL
0
and, therefore, ~ c p ( x )- e-‘/”cp(y,(t)>l<
c(t + ( j b h ( u , ( s ) )d s l ) + E
V t 2 0.
(2.25) On the other hand, by (2.24) we have 1 jbe-sl” ( -El.f ( Y , ( s ) ) + h ( u A s ) ) ) 1 -f(yo) CL
I te-s/”(
1
+ e-””cp(y,(t))
+ h ( u o ) cis + e - ‘ / ” q ( y o ( t > )+ E ,
where uo E U is such that M uo) < w and y o = y ( t , y , uo). This yields
j b h ( u , ( s ) ) ds
I C
(+ a t
Iu,(s)Iu
ds
1+
E
Vt
> 0,
because h is bounded from below by an affine function. Then, by assumption (2.41, we see that
Substituting this into (2.24) and using (2.25), we get I q ( y ( t ) ) - q(x)l
c(r + jblu(s)lu
I
ds)
+E
VE
> 0, t > 0,
where C is independent of E , u, and t. Hence, cp €9. Since the space BUC(D(M)) n Lip@( M ) ) is dense in BUC(D( M ) ) and the operator (I p d - ’ is nonexpansive on Y = BUC(D( M ) ) , we conclude that
+
(I + @)-lf€G
Vf€ Y.
6.2. A Semigroup Approach to the Dynamic Programming Equation
On the other hand, we have (see Proposition 3.2 in Chapter 2), for p
+p~)-'f+f
(I
443 -+
0,
in Y ,
for every f E D ( d ) . Along with (2.22), this implies that D ( d ) C g . To prove that %L c D ( d ) consider f, an arbitrary element of 9, and set
f,
=
(1+
R(
@)-lf=
p-lf),
P
> 0.
We shall prove that f, + f in Y as I*. + 0. Since f, E D ( 4 for all p > 0 this clearly will imply that f E D ( M ) , thereby completing the proof. For every p > 0 and all x E D ( M ) , there are (y,,u,) E C([O,a); H ) n L:,,(O,m); U),y, = y ( t , x , u,) such that P
and
for all u E L:,,(O,m; y ( t , x , u o ) we have
f,G>-f(x)
U.In particular, for 1 . .
j
P O
u
e-'/"(f(Yo(t))
= uo = constant and y o =
-f(X)
+ P.h(uo)) dt
Vp
because f EL^. Similarly,
f ( x > -f,<x>
> 0 , (2.26)
444
6. Optimal Control in Real Time
On the other hand, by (2.26) we see that
Then, by assumption (2.4), we see that for every 6 > 0 there is N ( 6 ) such that
Hence,
This implies that :/ e-'/'h(u,(t))dt + 0 as p -+ 0, and so by (2.261, W (2.27) we conclude that f, + f in Y as p + 0, as claimed.
=s
Proofof Theorem 2.1. We shall prove first that S ( t ) maps D ( d ) into By the optimality principle we have, for itself. To this end, we fix p0 in 8. all 0 I S < t < 03,
6.2. A Semigroup Approach to the Dynamic Programming Equation
445
where uo = constant, h(uo)< m, and y o = Y O , x , uo). Moreover, there exist y,, u, satisfying Eq. (2.3) and such that
and yields
Then, using once again assumption (2.4), we get
Now, coming back to inequalities (2.281, (2.291, we get
where (y, u ) is an arbitrary pair of functions satisfying (2.3). On the other hand, by the definition of S ( t ) it follows by similar argument that
which along with (2.30) implies that S ( t ) q o ~ gas claimed. ,
446
6. Optimal Control in Real Time
Now we shall apply the nonlinear Chernoff theorem (Theorem 2.2 in Chapter 4) on the space Y where C =%, F ( t ) = S(t), and A = d o , docp = dcp + g. To this end, we shall prove that for every p > 0,
=
(I
+ pA?o)-'cpo = ( I + @ ) - ' ( ( p a
+ pg)
Vcpo € 3 . (2.31)
Let us postpone for the time being the proof of (2.31). If (2.31) holds, then we have T(t)cpo =
,'Fm(S(:))"cpo
=
S(t)cpo
Vcpo E % , t 2 0 , (2.32)
i.e., T ( t ) = S ( t ) on 3 = D ( d ) . Now, by definition of S ( t ) , we have ( S ( t ) c p o ) ( x ) - cpo(x)
for all ( y , u ) satisfying Eq. (2.3). If that
(pa E
D ( d , then there is
f E Y )such
6.2. A Semigroup Approach to the Dynamic Programming Equation
i.e.,
[e-”h(u,(s)) ds + j 0f e - ” f ( Y & ( s )ds ) + e-bo(y,(t)) Icpo(x)
+E
This yields
because by Eq. (2.3) we have lye( t ) - XI
ItlMxl
+1 1 ‘Bu,( 0
V t 2 0.
s)l ds
We may conclude, therefore, that jb(lh(~,(s))l
+ lu,(s)lu)
ds IC ( t +
E )
Vt
where C is independent of E and t. We take E = t2. Then, by (2.341, we have
where z:
+ Mz, 3 Bu,
in ( O , . ? ) ,
z,(O)
=x ,
2
0,
447
448
6. Optimal Control in Real Time
and
and so by (2.36) we have
tlx
ED(M),
which along with (2.35) implies that
for all x E D ( M ) and all cpo E D ( d ) , as desired. To complete the proof, it remains to verify (2.31). Since (I @I-' and (I + ( ~ / E X -I s ( E ) ) ) - ' are nonexpansive on 3 = ~ ( d it)suffices , to prove (2.31) for cpo ES3. We set
+
We have
6.2. A Semigroup Approach to the Dynamic Programming Equation
449
Equivalently,
y'
+ My 3 Bu, y ( 0 ) = X , u E L ' ( 0 , c ;
(2.38)
Recall that by the definition of S ( t ) we have
yi
+ My,
3
Bu,
and
Icp,(x)
+ E2
This yields
where y o = y ( t , x, uo), h(u,) < 00,
in
(o,~),
y,(O)
= x,
450
6. Optimal Control in Real Time
Then, by the estimate (2.391, we have
and, using once again assumption (2.41, we get ((lh(u,(t))l
where C is independent of
+ lu,(t)lo) E.
=
(I
+ @)-‘(cp0
VE > 0 ,
(2.41)
Since cpo €9, this implies that
Icp,(y(t)) - cp,(x)l I CE We set cp
dt I CE
Vx
E
W M ) ,t E ( 0 , .).
(2.42)
+ p g ) . As noted earlier, we have
and so there exists a pair ( z , , u,) satisfying the Cauchy problem (2.3) on (0, E ) and such that
((lh(v,(t))l
+ Iu,(t)lu)
dt I CE
VE > 0
(2.44)
6.2. A Semigroup Approach to the Dynamic Programming Equation
451
Now, by (2.421, (2.431, it follows that cp&(X)
- cp(x)
(2.47)
Using the estimates (2.391, (2.411, (2.421, (2.44), and (2.451, in inequalities (2.461, (2.471, we see that
which completes the proof of (2.31).
Remark 2.2. Theorem 2.1 is related to existence of Lie generators for nonlinear semigroups of contractions (J. W. Neuberger [l, 211. Indeed, if g = 0, B = 0, and =
(S(t)cp)(x)
=
(:
if u = 0, otherwise,
cp(e-M'x)
Vx E D ( M ) ,
for all cp E Y = BUC(D( M ) ) . Then, by Theorem 2.1, it follows in particular that this semigroup is generated on Z by a single valued m-accretive operator.
452
6. Optimal Control in Real Time
6.2.3. Approximation of the Dynamic Programming Equation We shall consider here the forward Hamilton-Jacobi equation (2.0, where M = A + dcp and A E L(V,V ' ) , cp: H + R, g , h , and cpo satisfy the assumptions of Section 1.2. As mentioned earlier, the function
+ Ay + d c p ( y ) 3 Bu a.e. in ( O , t ) ,
y'
y(0)
(2.48)
= x , u E L'(0, t ; U ) ) ,
called a variational solution to Eq. (2.11, i.e., +At, x ) + h*( -B*+At,
XI)
+ ( A+ dcp(t, X I , + A t , XI) ( t ,x )
+(O,X)
=
E
cpdx),
=g(x),
(0, T ) x H , (2.49)
is under certain regularity assumptions on cp, a strong solution in some generalized sense (Theorem 1.2). It should be said that due to its complexity Eq. (2.49) is hard to solve or approximate by standard methods. Here, we will briefly discuss the Lie-Trotter scheme (the method of fractional steps) for a such a equation. Formally, a such a scheme for Eq. (2.49) is defined by + f E ( tX, ) + h*( - B * + / ( t , x ) ) + ( A ,+ E ( t , x ) )
+
=
cpo(x)
Vx
E
0
in [ i E , ( i + l ) ~ x] D(cp),
t+b,"(is,x) = + , " ( i E , e - E d C x ) E g ( e - E d p x ) , +"(O,X)
=
i
=
1,..., N - 1, (2.50)
D(cp),
where NE = T. In general, we do not know whether this scheme is convergent for E + 0. However, this happens in some significant situations and in particular if cp = Z,, where C is a closed subset of H such that
(A4,,PV) 2 ( A Y , Y )
(z + AA,)-'c
c
c
VY
E
V,
VA > 0.
(Here, P is the projection operator on C.)We recall that e-' V t 2 0.
(2.51) dQ
=P
453
6.2. A Semigroup Approach to the Dynamic Programming Equation
As seen earlier, this corresponds to an optimal control problem governed by the variational inequality (y’(t)
+ A y ( t ) - B u ( t ) ,y ( t ) - z ) 5 0
a.e. t
E
( O , T ) ,Vz
E
C,
Y(0) =Yo. Theorem 2.2.
Under the preceding assumptions +“(t,X)6G0+(t,X)
V ( t , x ) E [O,TI
where JI is the variational solution to (2.48).
x
c,
(2.52)
W
Theorem 2.2 is a direct consequence of convergence Theorem, 4.1, in Chapter 5 but we omit the details (see the author’s paper [151). It should be observed that Eq. (2.50) is structurally simpler than the original equation and its solution cp can be explicitly written. Indeed, we have
y’
+ Ay = Bu in ( i c , t ) , y ( 0 ) = x, u E ~ ‘ ( 0t ;, u)), t
E
[ i E , ( i + l ) ~ ] ,(2.53)
and in view of the maximum principle (optimality system) we have
where
+ Ayz
=
Bu,*
in ( i c , t ) ,
p: - Ap,
=
0
in ( i s , t ) ,
(y:)’
y,*(ic) = x , u,*(s ) E ah*( B*p,( s ) )
a.e. s
E
( i c ,t ) .
6. Optimal Control in Real Time
454
Hence, uf( s )
for some p
E
+"( t , x )
E
a.e. s
ah*( B * e - ( f - S p) A)
E
(iE,t),
H . Substituting this into (2.531, we get =
inf
PGH
is:
h( ah*(B * e - ( ' - S ) pA ) ) ds
for t
[i&,(i
E
+ Eg( e - ( r - i s ) A x )
+ l ) ~ ]x, E C .
(2.54)
Moreover, V t E [O, T I ,
u = dh*( -B*rG;"(T - t , y ) )
is a suboptimal feedback control for problem (P) in Section 1.2. We will illustrate this on the following example: H = L2(fl), V = Hi(fl), A = - A , C = { y E Hi(fl); y ( x ) 2 0 a.e. x E fl), B = I, h ( u ) = +/, u2 dx, g = 0, and cp,(y) = i / J y - y o ) 2dx. This corresponds to following optimal control problem: Minimize on all u E L2(Q), Q y , E L2(Q),subject to
/Qu2dxdt + =
R
X
( 0 , T ) and y
dY
- - by = u
in ( ( x , t )
at
dY dt
--Ay>u,
i / n ( y ( ~ , T )- y ' ( ~ ) )dx~
y 2 0
y(x,O) =yo(x)
E
E
Q;y ( x , t ) > 0),
inQ, in fl.
L2(0,T ; H,'(fl) n H2(R)),
6.2. A Semigroup Approach to the Dynamic Programming Equation
455
In this case, Eq. (2.49) becomes
where &(y)
=
{w E L 2 ( R ) ; w(x) = 0 a.e. in [ x
w(x) I 0
a.e. in [ x
E
E
R; y ( x )
a; y ( x ) > 01, =
O]}.
By Theorem 2.2, we have
Vt
E
[i&,(i
+ l ) ~ ]y, E L 2 ( R ) ,
(2.56)
where w + = max(w,O) and dz dS
+Az=O
z=o z(t,x) = p ( x ) dW
--Aw=z dS
w=o w(is,x)=y(x)
i n ( i E , t ) x R , i = O , l , ... , N - l , in ( i E , t ) x 3 0 , x
E
a,
in (i&,t) x R , in ( i ~ , t )x d R , in R .
(2.57)
Thus, at every step the calculation of $" reduces to a minimization problem on the space L2(R), which can be solved numerically by standard methods.
6. Bibliographical Notes and Remarks
456
As a second example, we shall consider the dynamic programming equation associated with the optimal control problem
y’ + P ( y )
=
u , lu(t)l
1, Y ( 0 ) = y o
i.e.,
I$xl + p ( x ) q X = g ( x ) ,
$( +
$ ( O , x ) = cpo(x),
x E R, t x
E
E
)
(2.58)
9
(0,779
(2.59)
R,
where p is a locally Lipschitz function. In this case, we have lim, $ “ ( t , x ) W t , x ) E [0, TI X R, where
$(t,x) =
~
$ :
+ $lI:
=
$,E(is,x) =
0
in [ i ~ , ( i + l ) ~ X] R,
+ $ ~ ( ~ E , z ( E ) ) , i = 0,1, ..., N z’ + p ( z ) = 0 in (0, E ) ,
Eg(X)
z(0) = x ,
-
1, (2.60) (2.61)
and arguing as in the proof of (2.54) we get $&(t,x) =
u
=
+ ( t - i ~ ) p +) $ f ( i ~ , w ( ~ ) ) ; w ’ + p (w ) = 0 in (0, E ) , w( 0) = x + ( t - i ~ ) p } , inf { E g ( x
Ipls 1
-sign $,,?(T - t , y )
(2.62)
as an approximating (suboptimal) feedback control of problem (2.58). Bibliographical Notes and Remarks
Section 1. Most of the results of this section have been previously established in a related form in the works of Barbu and DaPrato [l] and Barbu [6, 7, 101. For a recent treatment of dynamic programming for finite dimensional optimal control problems, we refer to the book of St. Mirica [l]. For other related results we refer to the recent works of Cannarsa and Frankowska [11, Cannarsa and DaPrato [11, Barbu, Barron, and Jensen [l], and Fattorini and Sritharan [l] (the last concerned with optimal feedback controllers for the Navier-Stokes systems).
6.2. A Semigroup Approach to the Dynamic Programming Equation
457
The theory of viscosity solutions to Hamilton-Jacobi equations was developed in the works of M. G. Crandall and P. L. Lions [l-31, and M. G. Crandall et al. [ll. In particular, the results of D. Tgtaru [l] cover the existence and uniqueness theory of viscosity solution for the dynamic programming equation associated with problem (PI or the time-optimal problem (in this context, we mention also the work of M. Bardi [l]). Section 2. The results of Section 2.1 and 2.2 have been previously established in the author’s work [13]. The semigroup approach to Hamilton-Jacobi equations was also used by Barbu and DaPrato [2] and Th. Havirneanu [l] (The latter work extends the results of Section 2.1 to Hamilton-Jacobi equations with nonconvex Hamiltonian.) Theorem 2.2 along with other results of this type were given in the author’s work [14, 151. Related results were obtained in a more general context by C. Popa [l] and Th. Havimeanu [2]. We mention also the work of L. C. Evans [2] for a min-max type approximation formula for the solutions to Hamilton-Jacobi equations.
This page intentionally left blank
References
S. Agmon, A. Douglas, and L. Nirenberg [ 11 Estimates near boundary for solutions of elliptic partial differential equations satisfying general boundary conditions, Cornm. Pure Appl. Math. 12(1959), pp. 623-727. S. Anifa [ l ] Optimal control of a nonlinear population dynamics with diffusion, J . Math. Anal. Appf. 152(1990), pp. 176-208. V. Arniiutu [ 11 Approximation of optimal distributed control problems governed by variational inequalities, Numer. Math. 38(1982), pp. 393-416. [2] On approximation of the inverse one-phase Stefan problem, Numerical Methods for Free Boundary Problems, pp. 69-82, P. Neittaanmaki, ed., Birkhauser, Basel, Boston, Berlin 1991. V. Arniiutu and V. Barbu [l] Optimal control of the free boundary in a two-phase Stefan problem, Preprint Series in Mathematics 11, INCREST, Bucharest 1985. E. Asplund [l] Averaged norms, Israel J . Math. 5(1967), pp. 227-233. H. Attouch [ 11 Familles d’optrateurs maximaux monotones et mesurabilitt, Annuli Mat. Pura Appf. CXX(19791, pp. 35-111. 121 Variational Convergence for Functions and Operators, Pitman, Boston, London, Melbourne 1984. H. Attouch and A. Damlamian [l] Problbmes d’tvolution dans les Hilbert et applications, J . Math. Pures Appl. 54(1975), pp. 53-74. [2] Solutions fortts d’intquations variationnelles d’tvolution, Publication Mathhnatique d’Orsay 184, Universitt Paris XI 1976. P. Aubin and A. Cellina [11 Differential Inclusions, Springer-Verlag, Berlin, New York, Heidelberg 1984. A. V. Balakrishnan [ 11 Applied Functional Analysis, Springer-Verlag, Berlin, Heidelberg, New York 1976. H. T. Banks and K. Kunisch [11 Estimation Techniquesfor Distributed Parameter Systems, Birkhauser, Boston -Basel Stuttgart 1989.
459
460
References
P. Baras [ l ] Compacitt de I’optrateur f + u solution d’une Cquation nonlinCaire du/dt + Au 3 f , C . R. Acad. Sci. Paris 286(1978), pp. 1113-1116. V. Barbu [ 11 Continuous perturbation of nonlinear m-accretive operators in Banach spaces, Boll. Unione Mat. Ital. 6(1972), pp. 270-278. [2] Nonlinear Semigroups and Differential Equations in Banach Spaces, Noordhoff International Publishing, Leyden 1976. [3] Necessary conditions for nonconvex distributed control problems governed by elliptic variational inequalities, J . Math. Anal. Appl. 80(1981), pp. 566-597. [4] Necessary conditions for distributed control problems governed by parabolic variational inequalities, S U M J . Control and Optimiz. 19(1981), pp. 64-86. [5] Boundary control problems with nonlinear state equations, SIAM J . Control and Optimiz. 20(1982), pp. 125-143. [6] Optimal feedback controls for a class of nonlinear distributed parameter systems, SLAM J . Control and Optimiz. 21(1983), pp. 871-894. [7] Optimal Control of Variational Inequalities, Research Notes in Mathematics 100, Pitman, Boston 1984. [8] Optimal feedback controls for a class of nonlinear distributed parameter systems, SLAM J . Control and Optimiz. 21(1983), pp. 871-894. [9] The time optimal control problem for parabolic variational inequalities, Appl. Math. Optimiz. 116(1984), pp. 1-22. [ 101 The time optimal control of variational inequalities. Dynamic programming and the maximum principle, Recent Mathematical Methods in Dynamic Programming, pp. 1-19, Capuzo Dolceta, W. H. Fleming, and T. Zolezzi, eds., Lecture Notes in Mathematics 11 19, Springer-Verlag, Berlin, Heidelberg, New York, Tokyo 1985. [ l l ] Optimal control of free boundary problems, Confer. Sem. Mat. Univ. Ban’ (19851, No. 206. [12] The time optimal problem for a class of nonlinear distributed systems, Control Problems for Systems Described by Partial Differential Equations, pp. I. Lasiecka and R. Triggiani, eds. Lecture Notes in Control and Information Sciences 97, Springer-Verlag, Berlin, Heidelberg, New York, Tokyo 1987. [ 131 A semigroup approach to Hamilton-Jacobi equation in Hilbert space, Studia Univ. Babes-Bolyai, Mathematica XXXIII(1988), pp. 63-78. [14] A product formula approach to nonlinear optimal control problems, S U M J . Control and Optimiz. 26(1988), pp. 497-520. [ 151 Approximation of the Hamilton-Jacobi equations via Lie-Trotter product formula, Control Theory and Advanced Technology 4(1988), pp. 189-208.
References
461
[16] The approximate solvability of the inverse one phase Stefan problem, Numerical Methods for Free Boundaly Problems, pp. 33-43, P. Neittaanmaki, ed., Birkhauser 1991. [17] Null controllability of first order quasi linear equations, Diff. Integral Eqs. 4(1991), pp. 673-681. [18] The minimal time function for the nonlinear diffusion equation, Libertas Mathematica 13(1990), pp. [19] The fractional step method for a nonlinear distributed control problem, Differential Equations and Control Theory; V. Barbu, ed., pp. 7-17 Research Notes in Mathematics 250, Longman, London 1991. [20] The dynamic programming equation for the time optimal control problem in infinite dimension, SLAM J . Control and Optimiz. 29(1991), pp. 445-456. V. Barbu and N. Barron [l] Bang-bang controllers for an optimal cooling problem, Control and Cybernetics 16(1987), pp. 91-102. V. Barbu, N. Barron, and R. Jensen [ l ] The necessary conditions for optimal control in Hilbert spaces, J . Math. Anal. Appl. 133(1988), pp. 151-162. V. Barbu and G . DaPrato [ 11 Hamilton-Jacobi equations in Hilbert spaces, Research Notes in Mathematics 86, Pitman, Boston, 1984. [2] Hamilton-Jacobi equations in Hilbert spaces; Variational and semigroup approach, Annalli Mat. Pura Appl. CXLII(2X1985), pp. 303-349. V. Barbu, G. DaPrato, and R. P. Zolessio [ l ] Feedback controllability of the free boundary of the one phase Stefan problem, Diff. Integral Eqs. 4(1991), pp. 225-239. V. Barbu and A. Friedman [l] Optimal design of domains with free boundary problems, SUM J . Control and Optimiz. 29(1991), no. 3, pp. 623-637. V. Barbu and Ph. Korman [ 11 Approximating optimal controls for elliptic obstacle problem by monotone interation scheme, Numer. Funct. Anal. 12(1991), pp. 429-442. V. Barbu and T. Precupanu 111 Convexity and Optimization in Banach Spaces, D. Reidel, Dordrecht 1986. V. Barbu and S. Stojanovic [l] Controlling the free boundary of elliptic variational inequalities on a variable domain, (to appear). V. Barbu and D. Tiba [11 Boundary controllability for the coincidence set in the obstacle problem, S U M J . Control and Optimiz. 29(1991), pp. 1150-1159.
462
References
M. Bardi [l] A boundary value problem for the minimum time function, SLAMJ. Control Optimiz. 27(1989), pp. 776-785. Ph. BCnilan [ 11 Equations d’tbolution dans un espace de Banach quelconque et applications, Thbe, Orsay 1972. [2] OpCrateurs accretifs et semi-groups dans les espaces LP, 1 I p I m, FunctionalAnalysis and NumericalAnalysis, pp. 15-51, I. Fujita, ed., Japan Society for Promotion of Science, Tokyo, 1978. Ph. BCnilan, M. G. Crandall, and M. Pierre [l] Solutions of the porous medium equations in RN under optimal conditions on initial values, Indiana Uniu. Math. J . 33(1984), pp. 51-87. Ph. BCnilan and S. Ismail [ 11 Gtntrateurs des semigroupes nonlintaires et la formule de Lie-Trotter, Annales Faculte‘ de Science, Toulouse VII(1985), pp. 151-160. A. Bermudez and C. Saguez [ 11 Optimal control of variational inequalities. Optimality conditions and numerical methods, Free Boundary; Theory and Applications, Maubuisson 1984, pp. 478-487, Research Notes in Mathematics 121, Pitman, Boston, 1985. [2] Optimal control of a Signorini problem, SLAM J . Control and Optimiz. 25(1987), pp. 576-582. [3] Optimal control of variational inequalities, Control and Cybernetics 14(1985), pp. 9-30. [4] Optimality conditions for optimal control problems of variational inequalities, Control Problems for Systems Described by Partial Differential Equations and Applications. R. Lasiecka and I. Triggiani, eds. Lecture Notes in Control and Information Sciences 97, Springer-Verlag 1987. F. Bonnans [l] Analysis and control of a nonlinear parabolic unstable system, J . Large Scale Systems 6(1984), pp. 249-262. F. Bonnans and E. Casas [l] Quelques mCthodes pour le contr6le optimal de problkmes comportant des contraints sur I’ttat, An. St. Uniu. “ A l . I . Cuza” Iasi 1986, pp. 58-62. F. Bonnans and D. Tiba [ 11 Pontryagin’s principle in the control of semilinear elliptic variational inequalities, Appl. Math. Optimiz. 23(1991), pp. 299-312. H. Brtzis [ 11 PropriCtCs rCgularisantes de certaines semi-groupes nonlintaires, Isreal J . Math. 9(1971), pp. 513-514. [2] Monotonicity methods in Hilbert spaces and some applications to nonlinear partial differential equations, Contributions to Nonlinear Functional Analysis, E. Zarantonello, ed. Academic Press, New York 1971.
References
463
[3] Problkmes unilattraux, J . Math. Pures Appl. 51(1972), pp. 1-168. [4] Opirateurs Maximam Monotones et Semigroupes de Contractions duns un Espace de Hilbert, North Holland 1973. [5] Integrales convexes dans les espaces de Sobolev, Isreal J . Math. 13(1972), pp. 9-23. [6] New results concerning monotone operators and nonlinear semigroups, Analysis of Nonlinear Problems, pp. 2-27, RIMS 1974. [7] Analyse Fonctionnelle. Thiorie et Applications, Masson, Paris 1983. H. Brtzis, M. G. Crandall, and A. Pazy [l] Perturbations of nonlinear maximal monotone sets, Comm. Pure Appl. Math. 13(1970), pp. 123-141. H. Brtzis and F. Browder [l] Some properties of higher order Sobolev spaces, J . Math. Pures Appl. 61(1982), pp. 245-259. H. Brtzis and A. Friedman [ 11 Nonlinear parabolic equations involving measures as initial conditions, J . Math. Pures Appl. 62(1983), pp. 73-97. H. Brtzis and A. Pazy [l] Semigroups of nonlinear contractions on convex sets, J . Funct. Anal. 6(1970), pp. 367-383. [2] Convergence and approximation of semigroups of nonlinear operators in Banach spaces, J . Funct. Anal. 9(1971), pp. 63-74. H. Brtzis and G. Stampacchia [l] Sur la regularitt de la solution d’intquations ellyptiques, Bull. SOC. Math. France, 96(1968), pp. 153-180. H. Brtzis and W. Strauss [l] Semilinear second order elliptic equations in L’, J . Math. SOC. Japan 25419731, pp. 565-590. F. E. Browder [ 11 Problimes Nonliniaires, Les Presses de I’UniversitC de Montrtal 1966. [2] Nonlinear Operators and Nonlinear Equations of Evolution in Banach Spaces, Nonlinear Functional Analysis, Symposia in Pure Math., vol. 18, Part 2. F. Browder ed. Amer. Math. SOC.,Providence, Rhode Island 1970. P. Cannarsa and G. DaPrato [ 11 Some results on nonlinear optimal control problems and Hamilton-Jacobi equations in infinite dimensions, J . Funct. Anal. P. Cannarsa and H. Frankowska [ 11 Value functions and optimality conditions for semilinear control problems (to appear). 0. C k j5 [l] On the minimal time function for distributed control systems in Banach spaces, JOTA 44(1984), pp. 397-406.
464
References
C. Castaign and M. Valadier [ 11 Conuex Analysis and Measurable Multifunctions, Lecture Notes in Mathematics 580, Springer-Verlag, Berlin, Heidelberg 1977. P. Chernoff [ l ] Note on product formulas for operator semi-groups, J. Funct. Anal. 2(1968), pp. 238-242. F. Clarke [ 11 Generalized gradients and applications, Trans. Amer. Math. SOC. 205(1975), pp. 247-262. [2] Optimization and Nonsmooth Analysis, John Wiley and Sons, New York 1983. F. Clarke and R. Vinter [ 11 The relationship between the maximum principle and dynamic programming, S U M J . Control and Optimiz. 25(1987), pp. 1291-1311. M. G. Crandall [ 11 The semigroup approach to first-order quasilinear equations in several space variables, Isreal J. Math. 12(1972), pp. 108-132. [2] Nonlinear semigroups and evolutions generated by accretive operators, Nonlinear Functional Analysis and its Applications pp. 305-338, F. Browder, ed., American Mathematical Society, Providence, Rhode Island 1986. M. G. Crandall and L. C. Evans [l] On the relation of the operator d / d s d / d t to evolution governed by accretive operators, Isreal J. Math. 21(1975), pp. 261-278. M. G. Crandall, L. C. Evans, and P. L. Lions [11 Some properties of viscosity solutions of Hamilton-Jacobi equations, Trans. Amer. Math. SOC.282(1984), pp. 487-502. M. G. Crandall and T. M. Liggett [ 11 Generation of semigroups of nonlinear transformations in general Banach spaces, Amer. J. Math. 93(1971), pp. 265-298. M. G. Crandall and P. L. Lions [ 11 Viscosity solutions of Hamilton-Jacobi equations, Trans. Amer. Math. SOC. 277(1983), pp. 1-42. [2] Hamilton-Jacobi equations in infinite dimension. I. Uniqueness of viscosity solutions, J. Funct. Anal. 62(1985), pp. 379-396; 11. Existence of viscosity solutions, ibid. 65(1986), pp. 368-405. [3] Viscosity solutions of Hamilton-Jacobi equations in infinite dimensions. Part V. Unbounded linear terms and B-continuous solutions. J. Funct. Anal. 90(1990), pp. 273-283. M. G. Crandall and A. Pazy [l] Semigroups of nonlinear contractions and dissipative sets, J. Funct. Anal. 3(1969), pp. 376-418. [2] On accretive sets in Banach spaces. J. Funct. Anal. 5(1970), pp. 204-217. [3] Nonlinear evolution equations in Banach spaces, Israel J. Math. 11(1972), pp. 57-92.
+
References
465
[4] On the range of accretive operators, Israel J. Math. 27(1977), pp. 235-246. M. G. Crandall and M. Pierre [ l ] Regularizing effect for u , = Acp(u), Trans. Amer. Math. SOC.274(1982), pp. 159-168. C. Dafermos and M. Slemrod [ 11 Asymptotic behaviour of nonlinear contraction semigroups, J. Funct. Anal. 3(1973), pp. 97-106. J. Dautray and J. L. Lions [ 11 Mathematical Analysis and Numerical Methods for Science and Technology, Springer-Verlag, Berlin, Heidelberg, New York, Tokyo 1982. E. DeGiorgi, M. Degiovanni, A. Marino, and M. Tosques [ l ] Evolution equations for a class of non-linear operators, Atti Acad. Naz. Lincei Rend. 75(1983), pp. 1-8. M. Degiovanni, A. Marino, and M. Tosques [l] Evolution equations with lack of convexity, J. Nonlinear Anal. Theory and Appl. 9, 1985, pp. 1401-1443. K. Deimling [ 11 Nonlinear Functional Analysis, Springer-Verlag, Berlin, New York, Heidelberg 1985. J. I. Diaz [ 11 Nonlinear Partial Differential Equations and Free Boundaries. Vol. I, Elliptic Equations, Research Notes in Mathematics 106, Pitman, Boston, London, Melbourne 1985. [2] Qualitative properties of solutions of some nonlinear diffusion equations via a duality argument, Semigroup Theory and Applications, H. Brtzis, M. G. Crandall, F. Kappel, eds. Research Notes in Mathematics 141, Longman 1986. G. Duvaut [l] Rtsolution d'un probBme de Stefan, C . R . Acad. Sci. Paris, 267(1973), pp. 1461-1463. G. Duvaut and J. L. Lions [ 11 Inequalities in Mechanics and Physics, Springer-Verlag, Berlin, New York, Heidelberg 1976. R. E. Edwards [l] Functional Analysis, Holt, Rinehart, and Winston, New York 1965. C. M. Elliott and J. R. Ockendon [ 11 Weak and Variational Methods for Moving Boundary Problems, Research Notes in Mathematics 59, Pitman, Boston 1982. L. C. Evans [ l ] Differentiability of a nonlinear semigroup in L', J. Math. Anal. Appl. 60(1977), pp. 703-715. [2] Some mini-max methods for the Hamilton-Jacobi equations, Indiana Uniu. Math. J. 33(1985), pp. 31-50.
466
References
H. 0. Fattorini [l] The time-optimal control problem in Banach spaces, Appl. Math. Optimiz. 1(1974), pp. 163-188. [2] The time optimal problem for boundary control of heat equation, Calculus of Variations and Control Theory, pp. 305-320, D. Russell, ed. Academic Press, New York 1976. [3] A unified theory of necessary conditions for nonlinear nonconvex control problems, Appl. Math. Optimiz. 15(1987), pp. 141-185. H. 0. Fattorini and S. S. Sritharan [ l ] Optimal control theory for viscous flow problems, Arch. Rat. Mech. Anal. (to appear). A. F. Filipov [ 11 Differential Equations with Discontinuous Right Hand Side, Kluwer Academic Publishers, Dordrecht, Boston, London 1985. P. M. Fitzpatrick [ l ] Surjectivity results for nonlinear mappings from a Banach space to its dual, Math. Annalen 204(1973), pp. 177-188. A. Friedman [ 11 Variational Principles and Free Boundary Problems, John Wiley and Sons, New York, Chichester, Brisbane, Toronto, Singapore 1982. [2] Optimal control for variational inequalities, SLAM J . Control and Optimiz. 24(1986), pp. 439-451. [3] Optimal control for parabolic variational inequalities, SLAM J . Control and Optimiz. 25(1987), pp. 482-497. [4] Optimal control for free boundary problems, Control Problems For Systems Described by Partial Differential Equations, pp. 56-63, I. Lasiecka, R. Triggiani, eds. Lecture Notes in Control and Information Sciences 97, SpringerVerlag, Berlin, Heidelberg, New York, Tokyo 1987. A. Friedman, S. Huang, and J. Yong [ l ] Bang-bang optimal control for the dam problem, Appl. Math. Optimiz. 15(1987), pp. 65-85. [2] Optimal periodic control for the two phase Stefan problem, SLAMJ. Control and Optimiz. 26(1988), pp. 23-41. J. Goldstein [ 11 Approximation of nonlinear semigroups and evolution equations, J . Math. SOC. Japan 2409721, pp. 558-573. P. Grisvard [ 11 Elliptic Problems in Nonsmooth Domains, Pitman Advanced Publishing Program, Boston, London, Melbourne 1984. M. E. Gurtin and R. C. MacCamy [ 11 Nonlinear age-dependent population dynamics, Arch. Rat. Mech. Anal. 54(1974), pp. 281-300.
References
467
A. Haraux [ 11 Nonlinear Evolution Equations-Global Behaviour of Solutions, Lecture Notes in Mathematics 841, Springer-Verlag, Berlin, New York, Heidelberg 1981. J. Haslinger and P. Neittaanmaki [ 11 Finite Element Approximation for Optimal Shape Design. Theory and Applications, John Wiley and Sons, Chichester, New York, Brisbane, Toronto, Singapore 1988. J. Haslinger and P. D. Panagiotopoulos [ 11 Optimal Control by Hemivariational Inequalities, in Control of Boundaries and Stabilization, pp. 128-139, J. Simon, ed. Lecture Notes in Control and Information Sciences 125, Springer-Verlag, New York 1989. T. HavPrneanu [l] A semigroup approach to a class of Hamilton-Jacobi equations with nonconvex Hamiltonians, Nonlinear Anal. (to appear). [2] An approximation scheme for the solutions of the Hamilton-Jacobi equation with ma-min Hamiltonians in Hilbert spaces, Nonlinear Anal. (to appear). L. I. Hedberg [ l ] The approximation problems in function spaces, Ark. Mat. 16(1978), pp. 51-81. E. Hille and R. S. Phillips [ l ] Functional Analysis and Semigroups, h e r . Math. SOC.Coll. Publ., vol. 31, Providence, Rhode Island, 1957. I. Hlavacek, I. Bock, and J. Lovisek [l] Optimal control of a variational inequality with applications to structural analysis. Optimal design of a beam with unilateral supports, Appl. Math. Optimiz. 11(1984), pp. 111-143. K. H. Hoffmann and J. Haslinger [ l ] On identification of incidence set for elliptic free boundary value problems, European J . Appl. Math. (to appear). K. H. Hoffmann and M. Niezgodka [ 11 Control of parabolic systems involving free boundaries, Free Boundary Problems, Theory and Applications, vol. 2, pp. 431-462, A. Fasano and M. Primicerio, eds., Pitman, London, Boston 1983. K. H. Hoffmann and J. Sprekels [ l ] On the automatic control of the free boundary in an one-phase Stefan problem, Applied Nonlinear Functional Analysis, pp. 301-310, K. Gorenflo and K. H. Hoffmann, eds., Verlag P. Lang, Frankfurt a. M. 1983. [2] Real time control of the free boundary in a two phase Stefan problem, Numer. Funct. Anal. and Optimiz. 5(1982), pp. 47-76. A. D. Ioffe and V. I. Levin [ l ] Subdifferential of convex functions, Trud. Mosk. Mat. Obsc. 26(1972), pp. 3-13.
468
References
J. W. Jerome [ 11 Approximation of Nonlinear Evolution Systems, Academic Press, New York, London 1983. F.Kappe1 and W. Schappacher [ 11 Autonomous nonlinear functional differential equations and averaging approximations, J . Nonlinear Analysis; Theory Methods Appl. 2(1978), pp. 391-422. T. Kato [ 11 Perturbation Theory For Linear Operators, Springer-Verlag, New York 1966. [2] Nonlinear semigroups and evolution equations, J . Math. SOC.Japan 19(1967), pp. 508-520. [3] Accretive operators and nonlinear evolution equations in Banach spaces, Nonlinear Functional Analysis, pp. 138-161, F. Browder ed., Amer. Math. SOC.,Providence, Rhode Island 1970. [4] Differentiability of nonlinear semigroups, Global Analysis, Proc. Symposia Pure Math. ed. Amer. Math. SOC.,Providence, Rhode Island 1970. N. Kenmochi [ l ] The semidiscretization method and nonlinear time-dependent parabolic variational inequalities, Proc. Japan Acad. 50(1974), pp. 714-717. N. Kikuchi and J. T. Oden [l] Finite element methods for certain free boundary value problems in mechanics, Moving Boundary Problems, pp. 147-164, D. J. Wilson, ed. Academic Press, New York 1978. D. Kinderlehrer and G. Stampacchia [ 11 An Introduction to Variational Inequalities and Their Applications, Academic Press, New York 1980. K. Kobayashi, Y. Kobayashi, and S. Oharu [ l ] Nonlinear evolution operators in Banach spaces, Osaka Math. J . 26(1984), pp. 281-310. Y. Kobayashi [ 11 Difference approximation of Cauchy problem for quasi-dissipative operators and generation of nonlinear semigroups J . Math. SOC. Japan 27(1975), pp. 641-663. [2] Product formula for nonlinear semigroups in Hilbert spaces, Proc. Japan Acad. 58(1982), pp. 425-428. [3] A product formula approach to first order quasilinear equations, Hiroshima Math. J . 14(1984), pp. 489-509. Y. Kobayashi and I. Miyadera [11 Convergence and approximation of nonlinear semigroups, Japan-France Seminar, pp. 277-295, H. Fujita, ed. Japan SOC.Promotion Sci., Tokyo 1978. Y. Komura [l] Nonlinear semigroups in Hilbert spaces, J . Math. SOC. Japan 19(1967), pp. 508-520.
References
469
[2] Differentiability of nonlinear semigroups, J . Math. SOC.Japan 21(1969), pp. 375-402. Y. Konishi [ l ] On the nonlinear semigroups associated with u, = A p ( u ) and p ( u , ) = A u , J . Math. SOC.Japan 25(1973), pp. 622-628. G. Kothe [ 11 Topological Vector Spaces, Springer-Verlag, Berlin 1969. S . N. Kruikov [ 11 First order quasilinear equations in several independent variables, Mat. Sbomik 10(1970), pp. 217-243. 0. A. Ladyzhenskaya, V. A. Solonnikov, and N. N. Uraltzeva [ 11 Linear and Quasilinear Equations of Parabolic Type, AMS Translations, Providence, Rhode Island 1968. J. M. Lasry and P. L. Lions [ l ] A remark on regularization in Hilbert spaces, Isreal J . Math. 55(1986), pp. 257-266. J. L. Lions [ 11 Quelques Mkthodes de Resolution des Problthes a m Limites Nonlinkaires, Dunod-Gauthier-Villars, Paris 1969. [2] Optimal Control of Systems Governed by Partial Differential Equations, Springer-Verlag, Berlin, New York, Heidelberg 1971. [3] Contr6le Optimale de S y s t h e s Distribub Singuliers, Dunod, Paris 1983. [4] Various topics in the theory of optimal control of distributed parameter systems, Optimal Control Theory and Mathematical Applications, pp. 166-309, B. J. Kirby, ed., Lecture Notes in Economics and Mathematical Systems, Springer-Verlag, Berlin, Heidelberg 1974. J. L. Lions and E. Magenes [ 11 Non-Homogeneous Boundary Value Problems and Applications, T. I., Springer-Verlag, Berlin, Heidelberg, New York 1972. P. L. Lions [ 11 Generalized Solutions of Hamilton-Jacobi Equations, Research Notes in Mathematics 69, Pitman, Boston, London 1982. W. B. Liu and J. E. Rubio [ 13 Optimal shape design for systems governed by variational inequalities, JOTA 69(1991), pp. 351-396. E. Magenes [ l ] Topics in parabolic equations; some typical free boundary problems, Boundary Value Problems for Linear Euolution Partial Differential Equations, pp. 239-312, H. G. Garnir, ed., D. Reidel Publishing Company, Dordrecht 1976. [2] Remarques sur l’approximation des probltmes non lintaires paraboliques, Analyse Mathkmatique et Applications, Gauthier-Villars, Paris 1989.
470
References
E. Magenes and C. Verdi [l] The semigroup approach to the two phase Stefan problem with nonlinear flux conditions, Free Boundary Problems. Application and Theory, vol. 111, pp. 121-140, A. Bossavit, A. Damlamian, M. Fremond, eds., Pitman 1985. R. H. Martin [l] Differential equations on closed subsets of a Banach space, Trans. Amer. Math. SOC.179(1973), pp. 399-414. [2] Nonlinear Operators and Differential Equations in Banach Spaces, John Wiley and Sons, New York 1976. F. J. Massey [l] Semilinear parabolic equations with L’ initial data, Indiana Univ. Math. J . 26(1977), pp. 399-411. A. M. Meirmanov [l] The Stefan Problem (in Russian), Izd. Nauka, Novosibirsk 1986. F. Mignot [ 11 Controle dans les iniquations variationelles elliptiques, J . Funct. Anal. 22(1976), pp. 130-185. F. Mignot and J. Puel [I] Optimal control in some variational inequalities, S U M J . Control Optimiz. 22(1984), pp. 466-476. G. Minty [l] Monotone (nonlinear) operators in Hilbert spaces, Duke Math. J . 29(1962), pp. 341-346. [2] On the generalization of a direct method of the calculus of variations, Bull. Amer. Math. SOC.73(1967), pp. 315-321. St. Mirica [ 11 Optimal Control. Sufficient Conditions and Synthesis (in Romanian), Editura Stiintifica, Bucharest 1990. I. Miyadera and S. Oharu [ 11 Approximation of semigroups of nonlinear operators, Tohoku Math. J . 22(1970), pp. 24-47. J. J. Moreau [l] Proximitt et dualitt dans un espace hilbertien, Bull. SOC. Math. France 93(1965), pp. 273-299. [2] Fonctionnelle Conuaes, Seminaire sur les equations aux dtrivtes partielles, Collkge de France, Paris 1966-1967. [3] Retraction d’une multiapplication, Seminaire d’Analyse Conuexe, Montpelier 1972. Ch. Moreno and Ch. Saguez [l] Dependence par rapport aux donntes de la frontikre libre associte certaines iniquations variationnelles d’Cvolution, Rapport de Recherche 298, IRIA, Rocquencourt 1978.
References
471
G. MoroSanu [ 11 Nonlinear Evolution Equations and Applications, D. Reidel Publishing, Dordrecht, Boston, Lancaster, Tokyo 1988. G. MoroSanu and Zheng-Xu He [l] Optimal control of biharmonic variational inequalities, An. St. Univ. “ A l . I . Cuza” la$, 35(1989), pp. 153-170. P. Neittaanmaki, J. Sokoilowski, and J. P. Zolesio [ 11 Optimization of the domain in elliptic variational inequalities, Appl. Math. Optimiz. 18(1988), pp. 85-98. P. Neittaanmaki and D. Tiba [ l ] On the finite element approximation of the boundary control for two-phase Stefan problems, Analysis and Optimization of Systems, A. Bensoussan and J. L. Lions, eds., Lecture Notes in Control and Information Sciences 62, pp. 481-493, Springer-Verlag, Berlin, Heidelberg, New York, Tokyo 1984. J. W. Neuberger [ l ] Lie generators for one parametric semigroups of transformations, J . fiir die reine und angewandte Math. 258(1973), pp. 133-136. [2] Generation of nonlinear semigroups by a partial differential equation, Semigroup Forum 40(1990), pp. 93-99. L. Nicolaescu [ l ] Optimal control for a nonlinear diffusion equation, Richerche di Mat. XXXVII (1988), pp. 3-27. M. Niezgodka and I. Pawlow [ 11 Optimal control for parabolic systems with free boundaries, Optimization Techniques, K. Iracki, ed., Lecture Notes in Control and Information Sciences 22, pp. 23-47, Springer-Verlag, Berlin 1980. M. Otani [ 11 Nonmonotone perturbations for nonlinear parabolic equations associated with subdifferential operators; Cauchy problem. J . Di8. Eqs. 46(1982), pp. 268-299. P. D. Panagiotopoulos [ 11 Inequality Problems in Mechanics and Applications. Convex and Nonconvex Energy Functions, Birkauser, Boston, Basel, Stuttgart 1985. [2] Necessary conditions for optimal control governed by hemivariational inequalities, Proceedings of a Conference of Distributed Parameter Systems, J. L. Lions and A. Jay, eds., pp. 188-190, Perpignan 1989. A. Papageorgiou [ 11 Necessary and sufficient conditions for optimality in nonlinear distributed parameter systems with variable initial state, J . Math. SOC. Japan 42(1990), pp. 387-396. N. Pave1 [11 Nonlinear evolutions generated governed by f-quasi dissipative operators, Nonlinear Analysis 5(1981), pp. 449-468.
472
References
[2] Differential Equations Flow Inuariance and Applications, Research Notes in mathematics 113, Pitman, Boston, London, Melbourne 1984. I. Pawlow [ 11 Variational inequality formulation and optimal control of nonlinear evolution systems governed by free boundary problems, Applied Nonlinear Functional Analysis, K. Gorenflo and K. H. Hoffmann, eds., pp. 230-241, P. Lang Verlag, Frankfurt a. Main 1983. A. Pazy [ l ] The Lyapunov method for semigroups of nonlinear contractions in Banach spaces, J . Analyse Math. 40(1982), pp. 239-262. [2] Semigroups of Linear Operators and Applications to Partial Differential Equations, Springer-Verlag, New York, Berlin, Heidelberg 1983. J. C. Peralba [ 11 Un probltme d’tvolution relatif I? un optrateur sous-diffkrentiel dtpendent du temps, C.R.A.S. Paris 275(1972), pp. 93-96. C. Popa [ 11 Trotter product formulae for Hamilton-Jacobi equations in infinite dimension, J . Diff. Integral Eqs. 4(1991), pp. 1251-1268. [2] The relationship between the maximum principle and dynamic programming for the control of parabolic obstacle problem, SLAM J . Control and Optimiz. (to appear). M. H. Porter and H. F. Weinberger [ 11 Maximum Principle in Differential Equations, Springer-Verlag, New York, Berlin, Heidelberg, Tokyo 1984. M. Reed and B. Simon [ l ] Methods of Modem Mathematical Physics, T. 3, Academic Press, New York, San Francisco, London 1979. S. Reich [ 11 Product formulas, nonlinear semigroups and accretive operators in Banach spaces, J . Funct. Anal. 36(1980), pp. 147-168. [2] A complement to Trotter’s product formula for nonlinear semigroups generated by subdifferentials of convex functionals, Proc. Japan Acad. 58(1982), pp. 134-146. R. T. Rockafellar [ 11 Conuex Analysis, Princeton University Press, Princeton, New Jersey 1969. [2] On the maximal monotonicity of subdifferential mappings, Pacific J . Math. 33(1970), pp. 209-216. [3] Local boundedness of nonlinear monotone operators, Michigan Math. J . 16(1969), pp. 397-407. [4] On the maximality of sums of nonlinear operators, Trans. Amer. Math. SOC. 149(1970), pp. 75-88. [5] Integrals which are convex functional 11, Pacific J . Math. 3!2(1971), pp. 439-469.
References
473
[6] Integral functionals, normal integrands and measurable selections, Nonlinear Operators and the Calculus of Variations, pp. 157-205, J. P. Gossez, E. Dozo, J. Mawhin, and L. Waelbroeck, eds. Lecture Notes in Mathematics, Springer-Verlag 1976. [7] The theory of subgradients and its applications to problems of optimization, Lecture Notes, University of Montreal 1978. [8] Directional Lipschitzian functions and subdifferential calculus, Proc. London Math. SOC.39(1979), pp. 331-355. P. H. Rodriguez [l] Optimal control of unstable nonlinear evolution systems, Ann. Faculte' Sci. Toulouse VI(19841, pp. 33-50. Ch. Saguez [ 11 ContrGle optimal d'intquations variationnelles avec observation de domains, Raport Laboria 286, IRIA 1978. [2] Conditions ntcessaires d'optimalitt pour des problkmes de contr6l optimal associts 2 des intquations variationnelles, Rapport Laboria 345, IRIA 1979. [3] ContrGle Optimal de Systemes 2 Fronti2re Libre, T h b e , L'Universitt de Technologie Compikgne 1980. E. Schecter [ l ] Stability conditions for nonlinear products and semigroups, Pacific J. Math. 85(1979), pp. 179-199. J. Schwartz [l] Nonlinear Functional Analysis, Gordon and Breach, New York 1969. Th. Seidman [l] Some control-theoretic questions for a free boundary problem, Control of Partial Differential Equations, pp. 265-276, A. Bermudez, ed., Lecture Notes in Control and Information Sciences 114, Springer-Verlag, Berlin, Heidelberg, New York, Tokyo 1989. Shuzong Shi [l] Optimal control of strongly monotone variational inequalities, SLAM J. Control and Optimiz. 26(1988), pp. 274-290. E. Sinestrari [ l ] Accretive differential operators, Boll. UMI 13(1976), pp. 19-31. M. Slemrod [l] Existence of optimal controls for control systems governed by nonlinear partial differential equations, Ann. Scuola Norm. Sup. Pisa 3-4(1974), pp. 229-246. D. Tgtaru [ 11 Viscosity solutions of Hamilton-Jacobi equations with unbounded nonlinear term, J. Math. Anal. Appl. (to appear). [2] Viscosity solutions for the dynamic programming equation, Appl. Math. Optimiz. (to appear).
474
References
[3] Viscosity solutions for Hamilton-Jacobi equations with unbounded nonlinear terms; a simplified approach (to appear). D. Tiba [ 11 Optimality conditions for distributed control problems with nonlinear state equations, SLAM J . Control and Optimiz. 23(1985), pp. 85-110. [2] Boundary control for a Stefan problem, Optimal Control of Partial Differential Equations, K. H. Hoffmann and J. Krabs, eds., Birkhauser, Basel, Boston, Stuttgart 1984. [3] Optimal control for second order semilinear hyperbolic equations, Control 7'heory and Advanced Technology 3(1987), pp. 274-290. [4] Optimal Control of Nonsmooth Distributed Parameter Systems, Lecture Notes in Mathematics, Springer-Verlag, Berlin, Heidelberg, New York, Tokyo, 1991. D. Tiba and Z . Meike [l] Optimal control for a Stefan problem, Analysis and Optimization of Systems, A. Bensoussan and J. L. Lions, eds., Lecture Notes in Control and Information Sciences 44, Springer-Verlag, Berlin, Heidelberg, New York, 1982. L. Vtron [l] Effets rtgularisant de semi-groupes non IinCaire dam des espaces de Banach. Ann. Fac. Sci. Toulouse 1(1979), pp. 171-200. I. Vrabie [ 11 Compactness Methods For Nonlinear Evolutions, Longman Scientific and Technical, London 1987. J. Watanabe [l] On certain nonlinear evolution equations, J . Math. SOC.Japan 25(1973), pp. 446-463. G. F. Webb [ 11 Continuous nonlinear perturbations of linear accretive operators, J . Funct. Anal. 10(1972), pp. 181-203. J. Yong [ 11 Pontryagin maximum principle for semilinear second order elliptic partial differential equations and variational inequalities with state constraints (to appear). K. Yosida [ 11 Functional Analysis, Springer-Verlag, Heidelberg, New York 1978. D. Zeidler [ 11 Nonlinear Operators, Springer-Verlag, Berlin, New York, Heidelberg 1983. Zheng-Xu He [ 11 State constrained control problems governed by variational inequalities, SLAM J . Control and Optimiz. 25(1987), pp. 1119-1144. J. P. Zolesio [l] Shape controllability of free boundaries, J . Struct. Mech. 13(1985), pp. 354-361.
Index
Closed loop system, 408 Cone tangent, 94 normal, 61, 94 Control feedback, optimal feedback, 407,412 optimal, 151 problem, 149 time optimal, 365 Convergence strong, 1 weak, 1 weak star, 1 Convex function, 57 integrand, 72
Generalized gradient, 91 Leray-Schauder degree, 5 Mapping, compact, 5 duality, 2 measurable, 408 upper-semicontinuous, 7 Operator coercive, 37 demicontinuous, 37 elliptic, 130 hemicontinuous, 37 Problem Cauchy, 25 elasto-plastic, 142 free boundary, 132 obstacle, 131 Signorini, 85, 147 Stefan, 284, 292
Directional derivative, 31, 59 Domain effective, 87 Dynamic programming principle, 420 Epigraph, 57 Equation dynamic programming, 421 Hamilton-Jacobi, 421 law conservation, 300 Free boundary, 85, 130 Function absolutely continuous, 10 Bochner integrable, 9 conjugate, 58 finitely valued, 9 FrCchet differentiable, 59 G2teaux differentiable, 59 indicator, 60 indicator of A , 60 lower semicontinuous, 57 optimal value, 417 proper convex, 57 strongly measurable, 10 support, 60 weakly measurable, 10
Regularization of a function, 65 Saddle point, 8 Schauder fixed point theorem, 6 Semigroup analytic, 23 of class C,, 18 of contractions, 18, 22 differentiable, 22 oquasi contractive, 229 Set accretive, 100 closed, 103 demiclosed, 103 maximal monotone, 36 monotone, 36 m-accretive, 100 w-accretive, 100 om-accretive, 100
475
476
Index
Solution classical to Cauchy problem, 25, 200 mild to Cauchy problem, 25, 202 mild to Hamilton-Jacobi equation, 440 strong to Cauchy problem, 25, 202 variational to Hamilton-Jacobi equation, 434 viscosity to Hamilton-Jacobi equation, 428 Space strictly convex, 2 uniformly convex, 2
Subdifferential, 59, 421 Subgradient, 60 Superdifferential, 421
Variational inequality elliptic, 126 parabolic, 270
Yosida approximation, 48
Mathematics in Science and Engineering
Edited by William F. Ames, Georgia Institute of Technology
Recent titles
Anthony V. Fiacco, Introduction to Sensitivity and Stability Analysis in Nonlinear Programming Hans Blomberg and Raimo Ylinen, Algebraic Theory for Multivariate Linear Systems T. A. Burton, Volterra Integral and Differential Equations C. J. Harris and J. M. E. Valenca, The Stability of Input-Output Dynamical Systems George Adomian, Stochastic Systems John O’Reilly, Obsemers for Linear Systems Ram P. Kanwal, Generalized Functions: Theory and Technique Marc Mangel, Decision and Control in Uncertain Resource Systems K. L. Teo and Z. S. Wu, ComputationalMethods for Optimizing Distributed Systems Yoshimasa Matsuno, Bilinear TransportationMethod John L. Casti, Nonlinear System Theory Yoshikazu Sawaragi, Hirotaka Nakayama, and Tetsuzo Tanino, Theory of Multiobjective Optimization Edward J. Haug, Kyung K. Choi, and Vadim Komkov, Design Sensitivity Analysis of Structural Systems T. A. Burton, Stability and Periodic Solutions of Ordinary and Functional Differential Equations Yaakov Bar-Shalom and Thomas E. Fortmann, Tracking and Data Association V. B. Kolmanovskii and V. R. Nosov, Stability of Functional Differential Equations V. Lakshmikantham and D. Trigiante, Theory of Difference Equations: Applications to Numerical Analysis B. D. Vujanovic and S. E. Jones, VariationalMethods in Nonconsematiue Phenomena C. Rogers and W. F. Ames, Nonlinear Boundary Value Problems in Science and Engineering Dragoslav D. Siljak, Decentralized Control of Complex Systems W. F. Ames and C. Rogers, Nonlinear Equations in the Applied Sciences Christer Bennewitz, Differential Equations and Mathematical Physics Josip E. PeEariC, Frank Proschan, and Y. L. Tong, Convex Functions, Partial Ordering, and Statistical Applications E. N. Chukwu, Stability and Time-Optimal Control of Hereditary Systems E. Adams and U. Kulisch, Scientijic Computing with Automatic Result Verification Viorel Barbu, Analysis and Control of Nonlinear Infinite Dimensional Systems
I S B N 0-12-078145-X