GEOMETRY OF FEEDBACK AND OPTIMAL CONTROL
PURE AND APPLIED MATHEMATICS A Program of Monographs, Textbooks,and Lecture ...
39 downloads
1579 Views
29MB Size
Report
This content was uploaded by our users and we assume good faith they have the permission to share this book. If you own the copyright to this book and it is wrongfully on our website, we offer a simple DMCA procedure to remove your content from our site. Start by pressing the button below!
Report copyright / DMCA form
GEOMETRY OF FEEDBACK AND OPTIMAL CONTROL
PURE AND APPLIED MATHEMATICS A Program of Monographs, Textbooks,and Lecture Notes
EXECUTIVE EDITORS Earl J. Taft Rutgers University New B m i c k , New Jersey
Zuhair Nashed University of Delaware Newark, Delaware
EDITORIAL BOARD M. S. Baouendi Ani1 Nerode Cornell University University of California, San Diego Donald Passman Jane Cronin University of Wisconsin, University Rutgers Madison Georgia Institute
Fred S. Roberts Jack K. Hale of Technology Rutgers University
S. Kobayashi University of California, Berkeley
Gian-Carlo Rota Massachusetts Instituteof Technology
Marvin Marcus David Universityof California, Santa Barbara
L. Russell Virginia Polytechnic Institute and State University
W. S. Massey University Yale Universitlft Siegen
Walter Schempp
Mark Teply Universityof Wisconsin, Milwaukee
MONOGRAPHS AND TEXTBOOKS IN PURE AND APPLIED MATHEMATICS 1. K. Yano, Integral Formulas in Riemannian Geometry (1970) 2. S.Kobayashi, Hyperbolic Manifolds and Holomorphic Mappings (1 970) 3. V. S. Vladimirov, Equations of Mathematical Physics (A. Jeffrey, ed.; A. Littlewood, trans.) (1970) 4. B. N. Pshenichnyi, Necessary Conditions for an Extremum (L. Neustadt, translation ed.; K. Makowski, trans.) (1971) 5. L. Nariciet al., Functional Analysis and Valuation Theory ( 1 971) 6. S.S.Passman, Infinite Group Rings ( 1 971) 7. L. Dornhoff, Group Representation Theory. Part A: Ordinary Representation Theory. Part B: Modular Representation Theory ( 1 971, 1972) 8. W. Boothby and G. L. Weiss, eds., Symmetric Spaces (1972) 9. Y. Matsushima, Differentiable Manifolds (E. T. Kobayashi, trans.) (1 972) 10. L. E. Ward,Jr., Topology (1972) 11. A. Babakhanian, Cohomological Methods in Group Theory (1 972) 12. R. Gilmer, Multiplicative Ideal Theory (1 972) 13. J. Yeh, Stochastic Processes and the Wiener Integral (1 973) 14. J. Berros-Neto, Introduction to the Theory of Distributions (1973) 15. R. Larsen, Functional Analysis (1973) 16. K. Yano and S.lshihara, Tangent and Cotangent Bundles ( 1 973) 17. C. Procesi, Rings with Polynomial Identities ( 1 973) 18. R. Hermann, Geometry, Physics, and Systems (1 973) 19. N. R. Wallach, Harmonic Analysis on Homogeneous Spaces ( 1 973) 20. J. Dieudonnd, Introduction to the Theory of Formal Groups ( 1 973) 21. l. Vaisman, Cohomology and Differential Forms (1 973) 22. B.-Y. Chen, Geometry of Submanifolds ( 1 973) 23. M. Marcus, Finite Dimensional Multilinear Algebra (in t w o parts) (1 973, 1975) 24. R. Larsen, Banach Algebras (1 973) 25. R. 0. Kujalaand A. L. Vitter, eds., Value Distribution Theory: Part A; Part B: Deficit and Bezout Estimates by Wilhelm Stoll (1 973) 26. K. B. Stolarsky, Algebraic Numbers and Diophantine Approximation (1974) 27. A. R. Magid, The Separable Galois Theory of Commutative Rings (1974) 28. B. R. McDonald, Finite Rings with Identity (1 974) 29. J. Satake, Linear Algebra (S.Koh e t al., trans.) (1 975) 30. J. S.Golan, Localization of Noncommutative Rings (1 975) 31. G.Klambeuer, Mathemetical Analysis (1 975) 32. M. K. Agosfon, Algebraic Topology ( 1 976) 33. K. R. Goodearl, Ring Theory (1976) 34. L. E. Mansfield, Linear Algebra with Geometric Applications (1 976) 35. N. J. Pullman, Matrix Theory and Its Applications (1 976) 36. B. R. McDonald, Geometric Algebra Over Local Rings (1976) 37. C. W. Groetsch, Generalized Inverses of Linear Operators (1 977) 38. J. E. Kuczkowski and J. L. Gersting, Abstract Algebra (1 977) 39. C. 0.Christenson and W. L. Voxman, Aspects of Topology ( 1 977) 40. M. Nagata, Field Theory (1 977) 41. R. L. Long, Algebraic Number Theory (1977) 42. W E Pfeffer, Integrals and Measures ( 1 977) 43. R. L. Wheeden and A. Zygmund, Measure and Integral (1 977) 44. J. H. Curtiss, Introduction to Functions of a Complex Variable (1978) 45. K. Hrbacek and T. Jech, Introduction to Set Theory (1 978) 46. W. S.Massey, Homology and Cohomology Theory (1978) 47. M. Marcus, Introduction to Modern Algebra ( 1 978) 48. E. C. Young, Vector and Tensor Analysis (1 978) 49. S.B. Nadler, Jr., Hyperspaces of Sets (1978) 50. S.K. Segal, Topics in Group Kings (1 978) 51, A. C, M. van Roo# Non-Archimedean Functional Analysis (1 978)
C. Sadosky, Interpolation of Operators and Singular Integrals (1 979) J. Cronin, Differential Equations (1 980) C. W, Groetsch, Elements of Applicable Functional Analysis (1 980) l. Vaisman, Foundations of Three-Dimensional Euclidean Geometry (1 980) H. l. Freedan, Deterministic Mathematical Models in Population Ecology (1 9801 S. B.Chae, Lebesgue integration (1 980) C. S. Rees et al., Theory and Applications of Fourier Analysis (l 9811 60. L. Nachbin, Introduction to Functional Analysis (R. M. Aron, trans.) (1 981) 61, G. Orzech and M. Orzech, Plane Algebraic Curves (1 981 ) 62. R. Johnsonbaugh and W. E Pfaffenberger, Foundations of Mathematical Analysis (1 981) 63. W.L. Voxman and R. H. Goetschel, Advanced Calculus (1 981) 64. L. J. Corwin and R. H. Szczarba, Multivariable Calculus (1 9821 65. V. l. /str&scu, Introduction to Linear Operator Theory (1 9811 66. R.D. Jsrvinen, Finite and Infinite Dimensional Linear Spaces (1981) 67. J. K. Beem and P. E Ehrlich, Global Lorentzian Geometry (1 981) 68, D. L. Armacost, The Structure of Locally Compact Abelian Groups (1 9811 69. J. W. Brewer and M. K. Smith, eds., Emmy Noether: A Tribute (1 981) 70. K. H. Kim, Boolean Matrix Theory and Applications ( 1 982) 71, T. W. Wieting, The Mathematical Theory of Chromatic Plane Ornaments (1 982) 72. D. B.Gau/d, Differential Topology (1 982) 73. R. L , Faber, Foundations of Euclidean and Non-Euclidean Geometry (1983) 74. M. Carmeli, Statistical Theory and Random Matrices (1 983) 75. J. H. Carruth et al., The Theory of Topological Semigroups (1 983) 76. R. L. Faber, Differential Geometry and Relativity Theory (1 983) 77. S. Barnett, Polynomials and Linear Control Systems (1 983) 78. G. Karpilovsky, Commutative Group Algebras (1 983) 79. F. Van Oystaeyen and A. Verschoren, Relative Invariants of Rings (1 983) 80. l. Vaisman, A First Course in Differential Geometry (1 984) 81. G.W. Swan, Applications of Optimal Control Theory in Biomedicine (l 984) 82. T. Petrie and J. D. Randall, Transformation Groups on Manifolds (1 984) 83. K. Goebel and S. Reich, Uniform Convexity, Hyperbolic Geometry, and Nonexpansive Mappings (1 984) 84. T. Albu and C. NdsMschpcu, Relative Finiteness in Module Theory (1 984) 85. K. Hrbacek and T. Jech, Introduction to Set Theory: Second Edition (1 984) 86. F. Van Oystaeyen and A. Verschoren, Relative Invariants of Rings (1 984) 87. B.R. McDonald, Linear Algebra Over Commutative Rings (1 984) 88. M. Namba, Geometry of Projective Algebraic Curves (1 984) 89. G. F. Webb, Theory of Nonlinear Age-Dependent Population Dynamics (1 985) 90. M. R. Bremner et al., Tables Dominant of Weight Multiplicities for Representations of Simple Lie Algebras (1 985) 91, A. E. Fekete, Real Linear Algebra ( 1 985) 92. S. B.Chae, Holomorphy and Calculus in Normed Spaces (1 985) 93. A. J. Jerri, Introduction to Integral Equations with Applications (1 985) 94. G. Karpilovsky, Projective Representations of Finite Groups ( 1 985) 95. L. Narici and E. Beckenstein, Topological Vector Spaces (1 985) 96. J. Weeks, The Shape of Space (1 985) 97. P. R. Gribikand K. 0. Kortanek, Extrema1 Methodsof Operations Research
53. 54. 55. 56. 57. 58. 59.
(1 985) 98. J.-A. Chao and W. A. Woyczynski, eds., ProbabilityTheory and Harmonic Analysis (1 986) 99, G.D. Crown eta/., Abstract Algebra (1 986) 100. J. H. Carruth et al., The Theory of Topological Semigroups, Volume 2 (1 986) 101 R. S. Doran and V. A. Be/fi, Characterizations of C*-Algebras ( 1 986) 102. M. W. Jeter, Mathematical Programming (1 986) 103. M. Altman, A Unified Theory of Nonlinear Operator and Evolution Equations with Applications (1 986) 104. A. Verschoren, Relative Invariants of Sheaves (1 9.87) 105. R. d. Usmani, Applied Linear Algebra (1 987) 106. P. Blass and J. Lang, Zariski Surfaces and Differential Equations in Characteristic p > 0 (1 987) I
107. 108. 109. 110. 111. 112. 113. 114. 115. 116. 117. 118. 119. 120. 121. 122. 123. 124. 125. 126. 127. 128. 129. 130. 131. 132. 133. 134. 135. 136. 137. 138. 139. 140. 141. 142. 143. 144. 145. 146. 147. 148. 149. 150. 151. 152. 153. 154. 155. 156. 157. 158. 159. 160. 161.
J. A. Reneke et al., Structured Hereditary Systems (1 987) H. Busemann and B. B. Phadke, Spaces with Distinguished Geodesics (1 987) R. Harte, Invertibility and Singularity for Bounded Linear Operators (1 988) G. S. Ladde etal., OscillationTheory of Differential Equations with Deviating Arguments (1 987) L. Dudkin et al., Iterative Aggregation Theory (1 987) T. Okubo, Differential Geometry (1 987) D. L. Stancl and M. L. Stancl, Real Analysis with Point-Set Topology (1 987) T. C. Gard, Introduction t o Stochastic Differential Equations (1 988) S. S. Abhyenkar, Enumerative Combinatorics of Young Tableaux (1 988) H. Strade and R. Farnsteiner, Modular Lie Algebras and Their Representations (1 988) J. A. Huckaba, Commutative Rings with Zero Divisors (1 988) W. D. Wallis, Combinatorial Designs (1 988) W. Wlfsfaa~,Topological Fields (1 988) G. Karpilovsky, Field Theory (1 988) S. Caenepeel and E Van Oystaeyen, Brauer Groups and theCohomologyof Graded Rings (1 989) W. Kozlowski, Modular Function Spaces (1 988) E. Lowen-Colebunders, Function Classes of Cauchy Continuous Maps (1989) M. Pave/, Fundamentals of Pattern Recognition (1 989) V. Lakshmikantham et al., Stability Analysis of Nonlinear Systems (1 989) R. Sivaramakrishnan, The Classical Theory of Arithmetic Functions (1 989) N. A. Watson, Parabolic Equations on an Infinite Strip (1 989) K. J. Hastings, Introduction to the Mathematics of Operations Research (1 989) B. Fine, Algebraic Theory of the Bianchi Groups (1 989) D. N. Dikranjan et al., Topological Groups (1 989) J. C. Morgan l/, Point Set Theory (1 990) P. Biler and A. Witkowski, Problems in Mathematical Analysis (1 990) H. J. Sussmann, Nonlinear Controllability and Optimal Control (1 990) J.-P. Florens et al., Elements of Bayesian Statistics (1 990) N. Shell, Topological Fields and Near Valuations (1 990) B. E Doolin and C. F. Martin, Introduction to Differential Geometry for Engineers (1 990) S. S. Holland, Jr., Applied Analysis by the Hilbert Space Method (1 990) J. Oknirfski, Semigroup Algebras (1 990) K. Zhu, Operator Theory in Function Spaces (1 990) G.B. Price, An Introduction to Multicomplex Spaces and Functions (1 9911 R. B. Darst, Introduction to Linear Programming (1 991) P. L. Sachdev, Nonlinear Ordinary Differential Equations andTheir Applications (1991) T. Husain, Orthogonal Schauder Bases (1991) J. Foran, Fundamentals of Real Analysis (1 991) W. C. Brown, Matrices and Vector Spaces (1 9911 M. M. Reo and.?. D. Ren, Theory of Orlicz Spaces (1 991) J. S. Golan and T. Head, Modules and the Structures of Rings (1 9911 C. Small, Arithmetic of Finite Fields (1 991) K. Yang, Complex Algebraic Geometry (1 991) D. G. Hoffman et al., Coding Theory (1 991) M. 0.Gonzdlez, Classical Complex Analysis (1 992) M. 0.Gonzdlez, Complex Analysis (1 992) L. W. Baggett, Functional Analysis (1 992) M. Sniedovich, Dynamic Programming (1 992) R. P. Agarwal, Difference Equations and Inequalities (1 992) C. Brezinski, Biorthogonality and Its Applications to Numerical Analysis (1 992) C. Swartz, An Introduction to Functional Analysis (1 992) S. B. Nadler, Jr., Continuum Theory (1992) M. A. A/-Gwaiz, Theory of Distributions (1 992) 6 Perry, Geometry: Axiomatic Developments with Problem Solving (1 992) 6 Castillo and M. R. Ruiz-Cobo, Functional Equations and Modelling in Science and Engineering (1 992)
160. E. Perry, Geometry: Axiomatic Developments with Problem Solving (1 992) 161 E. Castillo and M. R. Ruiz-Cobo, Functional Eauations and Modelling- in Science and Engineering (1 992) and Discrete Transforms with Applications and Error Analysis 162. A. J. Jerri,. lntearal .. (l 992) 163. A. Charlier et al., Tensors and the Clifford Algebra (1 992) 164. P. Biler and T. Nadzieja, Problems and Examples in Differential Equations (1 992) 165. E. Hansen, Global Optimization Using Interval Analysis (1 992) 166. S. Guerre-Delabrihre,Classical Sequences in Banach Spaces (1 992) 167. Y. C. Wong, Introductory Theory of Topological Vector Spaces (1 992) 168. S. H. Kulkarni and B. V. Limaye, Real Function Algebras (1 992) 169. W. C. Brown, Matrices Over Commutative Rings (1993) 170. J. Loustau and M. Dillon, Linear Geometry with Computer Graphics (1 993) 171. W. V. Petryshyn, Approximation-Solvability of Nonlinear Functional and Differential Equations (1 993) 172. 6 C. Young, Vector and Tensor Analysis: Second Edition (1 993) 173. T. A. Bick, Elementary Boundary Value Problems (19931 174. M. /Javel, Fundamentals of Pattern Recognition: Second Edition (1 993) 175. S. A. Albeverio et al., Noncommutative Distributions (1 993) 176. W. Fulks, Complex Variables (1 993) 177. M. M. Rao, Conditional Measures and Applications (1 993) 178. A. Janicki and A. Weron, Simulation and Chaotic Behavior of a-Stable Stochastic Processes (1 994) Nonlinear Parabolic Systems 179. P. Neittaanmski snd D. Tiba, OptimalControlof (1 994) 180. J. Cronin, Differential Equations: Introduction and Qualitative Theory, Second Edition (1 994) Lakshmikantham, V. Monotone Iterative Techniques for 181. S. Heikkila and Discontinuous Nonlinear Differential Equations (1 994) 182. X. Mao, Exponential Stability of Stochastic Differential Equations (1 994) 183. B. S. Thomson, Symmetric Properties of Real Functions (1 994) 184. J. E. Rubio, Optimization and Nonstandard Analysis (1 994) 185. J. L. Bueso et a/., Compatibility, Stability, and Sheaves (1 995) 186. A. N. Michel and K. Wang, Qualitative Theory of Dynamical Systems (1 995) 187. M. R. Darnel, Theory of Lattice-Ordered Groups (1 995) 188. 2,Naniewicz and P. D. Panagiotopoulos, Mathematical Theory of Hemivariational Inequalities and Applications (1 995) 189. L. J. Corwin and R. H. Szczarba, Calculus in Vector Spaces: Second Edition (1 995) 190. L. H. Erbe et al., Oscillation Theory for Functional Differential Equations (1 995) 191. S. Agaian et al., Binary Polynomial Transforms and Nonlinear Digital Filters (1 995) 192. M. 1. Gil’, Norm Estimations for Operation-Valued Functions and Applications (1 995) 193. P. A. Griller, Semigroups: An Introduction to the StructureTheory (1 995) 194. S.Kichenassamy, Nonlinear Wave Equations (1 996) 195. V. F. Krotov, Global Methods in Optimal Control Theory (1 996) 196. K. /. Beidar et al., Rings with Generalized Identities (1 996) 197. V. l. Amautov et al., Introduction to the Theory of Topological Rings and Modules (1 996) 198. G. Sierksma, Linear and Integer Programming (1 996) 199. R. Lasser, Introduction to Fourier Series (1 996) 200. V. Sima, Algorithms for Linear-Quadratic Optimization (1 996) 201 * D. Redmond, Number Theory (1 996) 202. J. K. Beem et al., Global Lorentzian Geometry: Second Edition (1996) 203. M. Fontana et al., Prufer Domains (1 997) 204. H. Tanabe, Functional Analytic Methods for Partial Differential Equations (1 997) 205. C. Q. Zhang, Integer Flows and Cycle Covers of Graphs (1 997) 206. E. Spiegel and C. J. O’Donnell, Incidence Algebras (1 997) 207. B. Jaitubczyk and W. Respondek, Geometry of Feedback and Optimal Control (1998) I
Additional Volumas in Prepamtion
GEOMETRY OF FEEDBACK AND OPTIMAL CONTROL edited by Bronistaw Jakubczyk Witold Respondek Polish Academyof Sciences Warsaw, Poland
MARCEL
MARCELDEKKER, INC. D B K K B R
NEWYORK BASEL HONGKONG
ISBN 0-8247-9068-5
The publisher offers discounts on this book when ordered in bulk quantities. For more information, write to Special SalesProfessional Marketing at the address below. This book is printed on acid-free paper. Copyright Q 1998 by MARCEL DEKKER, INC. All Rights Reserved.
Neither this book nor any part may be reproduced or transmitted in any form or byany means, electronic or mechanical, including photocopying, microfilming, and recording, or byany informationstorage and retrievalsystem,without permission in writingfrom the publisher. MARCEL DEKKER, INC. 270 Madison Avenue, New York, New York 10016 http:/lwww.dekker.com Current printing (last digit): 1 0 9 8 7 6 5 4 3 2 1
PRINTED INTHE UNITED STATES OF AMERICA
Preface As inotherfields,especiallymathematicalphysics,geometricmethods
provideapowerfultoolforanalysis
of nonlinearcontrolsystems.The
subject has been developing quickly since the 1980s and the first monographs toappearwere 1989) and
A. Isidori,NonlinearControlSystems(Springer,
H. Nijmeijerand A. ,J. vanderSchaft,NonlinearDynamical
ControlSystems(Springer, methodsin
1985 and
1990).
Therapiddevelopment
controltheory,togetherwiththebroadvariety
of geometric of problems
treated by those methods, resulted in a need to collect the most important and. most illustrative results .devoted to particular subfields of geometric control theory in separate volumes. We believe that optimal control, nonlinear feedback, and the geometry arising in both, form a "triangle"of ideas and results which deserveto be the content of such a volume. We have attempted to present methods and results of geometric control theory in a way that is accessible to a graduate student and to an applied mathematician who is not a specialist in nonlinear control. Ontheotherhand,suchavolumeshould
also be attractive to some pure
mathematicians,includingthosewhoworkinthefieldandthosewhoare lookingfornewproblems.
Our goalhasbeentopresentcontributions
of
geometric methods to optimal control and feedback transformations in a way which is available to nonspecialists and attractive for experts. One part of the volume is devoted to applications of geometry to optimal control and exhibits nice links between the Pontriagin Maximum Principle, symplectic geometry, and the geometry of reachable sets (together with their singularities). The second theme
of the volume concerns feedback
transformations and coverssuch problems as feedback stabilization, feedback
Preface
iv
classification, and feedback invariants. Some presentations and many results and examples are devoted'to small dimensions (n = 2,3). This is because many structural properties are already fairlywellunderstoodandanalyzedinlowerdimensionalcases feedback stabilization, the structure
(e.g.,
of time-optimal trajectories and that
reachable sets, feedback classification in the plane, structural stability.)
of All
those problems provide a wide spectrum of results, thus exhibiting in a very illustrativewaywhatgeometriccontroltheorydealswith.Ontheother hand, manyofthe
difficulties of thesubjectalreadyappearInsmall
dimensions,therebyshow.ingthecomplexityof
the questionsstudiedand
suggestingnewproblemstobesolved.Wehopethisvolumewillbea stimulus to researchas well as a useful reference work. TheTEX-typesettingofthisvolumewasprepared
by Ms. Agnieszka
Swiatkiewicz. Wewould like to express our gratitude for her professional work and kind cooperation.. . Bronisiuw Jakubczyk Witold Respondek
Contents Preface Contributors
vii
Introduction
1
Symplectic Methods for Optimization and Control A. Agrachev and R. Gamkrelidze Singular Trajectories, Feedback Equivalence, and the Time Optimal Control Problem B. Bonnard Controllability of Generic Control Systems on Surfaces Aleksey Davydov Recent Advances in the Stabilization Problem for Low Dimensional Systems W. P.Dayawansa
iii
19
79 111
165
Asymptotic Stabilization via Homogeneous Approximation Henry Hermes
205
Critical Hamiltonians and Feedback Invariants Bronislaw Jakubczyk
219
Optimal Control Problems on Lie Groups: Crossroads Between Geometry and Mechanics V. Jurdjevic Nonlinear Control and Combinatorics of Words Matthias Kawski Feedback Classification of Nonlinear Control Systems on Rz and R3 Witold Respondek
257 305
347
vi
Contents
10 Time-Optimal Feedback Control for Nonlinear Systems: A
Approach
Geometric Heinz Schlittler 11 Qualitative Behavior Control Problem and Stabilization of Dynamical Systems A . N. Shoshitaishvili
1,
383
423
12 An Introduction the to Coordinate-Free Maximum Principle H.J. Sussmann
463
Index
559
Contributors
A. Agrachev Steklov Institute, Moscow, Russia B. Bonnard Laboratory of Topology, University of Bourgogne, CNRS UMR 5584, Dijon, France Aleksey Davydov Vladimir State University, Vladimir, Russia
W.P. Dayawansa Texas Tech University, Lubbock, Texas R. Gamkrelidze Steklov Institute, Moscow, Russia Henry Hemes University of Colorado, Boulder, Colorado Bronishw Jakubczyk Institute of Mathematics, Polish Academy of Sciences, Warsaw, Poland
V. Jurgjevic University of Toronto, Toronto, Ontario, Canada M.Kawski Arizona State University, Tempe, Arizona Witold Respondek Warsaw, Poland
Institute of Mathematics, Polish Academy of Sciences,
Heinz Scuttler Washington University, St. Louis, Missouri A. N. Shoshitaishvili Institute of Control Sciences, Moscow, Russia H. J. Sussmann Rutgers University, New Brunswick, New Jersey
GEOMETRY OF FEEDBACK AND OWIVIALCONTROL
?
Introduction
What are the main problems of nonlinear control theory and how are they related to other domains of mathematics? We hope that 12 surveys presented in the volume will help to answer this question. We start the introductory chapter with an overview of the field of nonlinear control theory as such. The overview presents the areas covered bythis volume and introduces the reader to its subject. In thesecond part of the Introduction we present the contents of 12 Chapters-surveys which form this book. 1. Control systems
Generally speaking, finite dimensional control systems are underdetermined systems of ordinary differential equations. A control system in the most general autonomous form is a system II:
x =m
,U ) ,
where s ( t ) are elements of X ,called the state space, and u(t) belongs to U, the control space. Usually one assumes that the state space X is a finite dimensional differentiable manifold or W . The control space U is taken a subset of a differentiable manifold or JP. The variable s represents the state of the system and its role is analogous to that of the state of a dynamical system (i.e., the memory of the system). The variable U represents an external influence on the system which depends on a particular problem. It is the presence of the variable U which makes the system underdetermined. 1
Introduction
2
Only when the control U is specifiedas a function of time or a function of 2, solutions of the system II may become completely determined by the initial condition for s. Therefore, one usually aasumes regularity of f and regularity of U which guarantee (local) existence and uniqueness of solutions called trajectories. Very often the dynamics f exhibits a special structure, affine or linear with respect to U , and then the control set U is assumed to be (a subset of) RmI In the former case the system reads .(a),
m
c: where f , g1 . . gm are vector fields on X ,and it is called a control-aflne system. In the latter case the system takes the form m i=l
and is called control-hear system. A special roleisplayed by systems whose dynamics f is linear with respect to both the state and thecontrol (we additionally assume that X = W).Then IT is called a linear system and is of the form
A:
h=Az+Bu,
with A and B being matrices of appropriate sizes. Control systems II, C,and A can also be viewed at more geometrically. One natural way is to represent II as a family of vector fields
If the parametrization with respect to controls is of secondary importance then even more geometric way of representing differential inclusion h E F ( z ) , where F(.)
II is to consider it as a
= f(s,V ) .
Observe that F ( z ) is the set of all velocities admissible at s and thus the dependence on control U is suppressed. In this setting the control system
Introduction
3
is represented by a subset F of the tangent bundle TX,where
F = U,EXF(Z). In this way ,we can also define a control system as a trivializable subset of the tangent bundle TX. In the control-linear case of system A the field of velocities F becomes a distribution
F(z) = D ( 4 = sPan{gl(z), ' * ' ,gm(z)), and the system can be regarded as a trivial subbundle D c T X of the tangent bundle. For control-affinesystems C one gets an affine distribution
= fb-9 + W ) ,
+
which can be treated as an affine subbundle f D of the tangent bundle. (The condition of global triviality in our definition is often replaced by local triviality.) The trajectories of the above systems are, respectively, integral curves of the distribution D or of the affine distribution f+D. This inherently relates the theory of nonlinear control systems with problems of differential geometry. 2. Open loop and closed loop controls
There are two natural ways of making the system II a determined ) gives system. The first is to choose U as a function of time U = ~ ( twhich the following non-autonomous differential equation
W ) = f(z(t),U ( t ) ) .
If an initial condition z(0) = zo isgiven then the trajectory z = z(t) is uniquely determined for t sufficiently small, provided the system and the control are sufficiently regular. Usually, one assumes that f is at least Lipschitz with respect to z and continuous with respect to U. For many problems, including most of the Chapters of this book, one assumes f to be smooth or analytic with respect to both its arguments. The clas U of admissible controls is chosen depending on the problem. In most of the cases it includes all piecewise constant controls with values
Introduction
4
in U, and is contained in the class of all measurable, essentially bounded, U-valued functions. Under these assumptions solutions of j. = f(s,U ) exist and are unique when an initial condition is given. The second way of specifying the control is to choose it as a function of the state U = U(.). Then we obtain a dynamical system of the form
S = f(s,U(.)). Also in this case in order to get existence and uniqueness of trajectories one has to impose regularity conditions on f and on U = U(.). The first way of choosing controls, when U is taken a function of time, U = u ( t ) ,is called open loop control. In the second case, i.e.,when U ischosen a function of state, U = ~(s), one speaks about closed loop control. This terminology is suggested by applications. In the latter cme the information about the instantaneous state of the system is fed back to the system (hence the name “closed loop”), while in the former no information on the states(t)is used when choosing the control u(t)(“open loop’’ control).
3. Control problems Three basic control problems will be considered in this book. To describe the first one observe that for a dynamical system S = f(s)initial condition s(0) = 20 uniquely determines the trajectory starting from it. On the contrary, for a control system I1 there is a whole family of trajectories starting from 50,parametrized by all admissible controls. The set of all points reachable by all trajectories starting from 20 is called the reachable set from 10 and is denoted by R(z0).This set can have a complicated structure and, generally speaking, controllability problems concern various aspects of this structure. In particular, complete controllability problem is to characterize systems whose any two states can be joined by an admissible trajectory. Another problem is that of accessibility, meaning that the reachable set R(z0)has a nonempty interior. Especially important is the problem of local controllability, i.e., the problem of determining whether R(s0)contains so in its interior. It is clear that open loop controls are natural in controllability problems.
Introduction
5
The Kalman rank condition [5] for complete controllability of a linear system A was one of the results which gave birth to control theory. Attempts to generalize this rank condition have led to considering natural Lie algebras of vector fields associated to the system 17, Let
L = Lie{T} be the Lie algebra generated by the vector fields of F = {fu}ocEu.In terms of the Lie algebra L,and the family of its generators, various nonlinear controllability properties can be characterized. The stabilization problem is to find a control U = u(z), called stabilizing feedback, such that the closed loop system ri: = f(z,u(z)) becomes (asymptotically) stable at 5 0 .Various versions of the problem are studied like local or globalstabilizability properties and regularity of stabilizing feedback. Stated in this way the stabilization problem uses naturally closed loop controls. From its very statement the stabilizability problem leads to classical problems of stability theory which goes back to Lyapunov [S]. Hence it is natural that concepts and tools from the theory of dynamical systems are used [21. It is a classical result of linear control theory that for a linear system A complete controllability is equivalent to asymptotic stabilizability with arbitrary exponential decay. One of the goals of nonlinear control theory is to establish a similar correspondence for nonlinear systems. Optimal control problems are naturalgeneralizations of problems considered in the calculus of variations. Besides a control system 17 one specifies a functional on the space of trajectories and controls which may be of the
tYPe
5
J = JXdt),
dt,
I
where either the time interval I = [ O , T ] is fixed or T is not fixed and an end-point condition for z ( T ) is imposed. One fixes a class U of admissible controls and an initial condition. The optimal control problem is the problem of minimizingthe functional J over the class of controls U ( . ) in U.
Introduction
6
In particular, in the time-optimal problem one wants to find a control which steers the system from an initial point 20 to a terminal point z1 (or a terminal set) in a minimal time. In this case one takes L E 1. The Lagmngeproblem is to find a control which steers 20 to 21 in a given time T and minimizes the functional J. A widely studied version of this problem is to minimize J, where L is quadratic with respect to U (which corresponds to minimizing energy). The problem as stated above involves open loop controls, not using any information about the current state. However, optimal controls can often be expressed through a function of the state (not regular, in general) and thus give rise to closed loop control U = U(.). Such a way of expressing optimal controls is called optimal synthesis. Studying optimal control problems since the late fifties led to the discovery of the Maximum Principle by Pontryagin and co-workers [g] and development of mathematical control theory. 4. Natural groups, feedback equivalence
Attempts to solvespecific control problems, as the ones mentioned above, have been one of the main early motivations of developing control theory, and they remain as such. Later a need of understanding the structure of classes of control systems and their geometry appeared as it is usual in the development of any mathematical theory. This need is realized by defining natural groups of transformations and, more generally, equivalence relations, and studying their invariants. The simplest group used in nonlinear control theory is the group of diffeomorphisms of the statespace. It maps trajectories of the system into trajectories corresponding to thesame controls U(.). Therefore, this group is natural for open loop control, and for those problems where parametrization with respect to control is important. The group of diffeomorphisms acts naturally on the family F . = {fu}vEuof vector fields, preserving the parametrization with respect to U E U. This leads to a complete description of invariants in terms of the vector fields in F.and their iterated Lie brackets (elements of the Lie algebra L).This set of invariants is very rich
Introduction
7
since the group of diffeomorphisms of X is “small” compared with the class of all systems II. Indeed, the group is parametrized by n functions of n state variables (21, . . . , E,) while the class of systems is parametrized by n functions of n m variables (n state variables and m control variables
+
( m ,* ’ * ,%Td). A larger group leading to deeper invariants is that of invertible transformations x = ($, $) of the state and control of the form
called feedback transformations (the name comes from the fact that the relation between the transformed control and the original control U uses information on the stateE ) . This group of transformations, called feedback group, is natural for the problems whose solutions are of closed-loop type. In the case of control-linear systems A and control-ffie systems C the transformation $ is taken, respectively, linear or affine with respect to U. The problem of feedback equivalence reduces then to equivalence of the corresponding distributions D, or of the affine distributions F = f D, under the group of diffeomorphisms. This is a classical problem in geometry going back to PfafT, Darboux and E. Cartan [l].
+
It turns out that invariants of the feedback group are also infinite dimensional (functional moduli) if m < n. Therefore, one also considers weaker equivalence relations called dynamical (feedback) equivalence. A similar equivalence was already considered by E. Cartan in his work on absolute equivalence of systems of differential equations. 5. Hamiltonian lift
At an early stage of development of mathematical control theory it turned out fruitful to consider a Hamiltonian lift of the original system II (cf.[8]).This lift is important for optimal control problems and also, as it has turned out recently, for static feedback equivalence problem. The idea is to consider additionally at every point 2 E X a cotangent vector p E T,*X and to replace the original system II by the system on the
Introduction
8
cotangent bundle written in coordinates as rI* :
Sf
x = f ( x c , 4 , P = -P+u),
with (p,x ) E T * X , called the Hamiltonian lift of IT. A delicate point in defining the second equation of the system rI* (called the adjoint equation)is to make sure that its definition does not depend on the (canonical) coordinates as a priori we do not have a connection on the cotangent bundle which would allow us to define p in a coordinate independent way. This is established by the fact that Hamiltonian system (HS)can be defined in a coordinate free way usingthe canonical symplectic form on T * X . To do it let us introduce the Hamiltonian H : T * X x U + R of IT defined aa
H(P, x, U> = Pf ( 5 ,U ) , where p f is defined byduality of cotangent and tangent vectors. Then the system IT* can be equivalently written (in canonical coordinates (p,z))
( H S ): i.e., it is the Hamiltonian system corresponding to H(., * , U ) via the standard symplectic structure on T * X . It is clear that r I * is another control system, with the state space of dimension 2n. Its basic advantage is .that it is Hamiltonian and it allows to analyze the original system II microlocally(Le,locally with respect to point x and "direction" p ) . Using the Hamiltonian H one can analyze some properties of the system rI via properties of the function H(p, x , .). In particular, critical points of the function H ( p , x , are crucial for optimal properties of II. The critical values of this function are basic invariants of static feedback. Let us describe more closely these two features of the Hamiltonian H . m)
6. Maximum Principle
To illustrate the role of the Hamiltonian H and thatof the Hamiltonian lift II* in optimal control problems we will state a simple version of the Maximum Principle for the timeoptimal problem.
Introduction
9
Suppose that an initial point x0 E X and a target point x1 E X me fixed. Maximum Principle. I. 2(*) and Z(-) are an admissible control and the corresponding trajectory joining x0 with x1 in a minimal time T , then thereexistsanabsolutelycontinuouscurve F(t) E T & ] X , f l t ) # 0 on [0,TI,such that the triple (AZ, G ) ( - ) satisfies the equations (*S) and the following maximum condition
( M C ):
Z(t),G(t))= $yw5-(t),w),?l)
for almost all t E [0,TI,i.e., G(t) mmimizes the Hamiltonian with respect to the control variable. The same principle holds for the Lagrange problem, except that the Hamiltonian should be taken in the form
H =P f ( X , U ) +q w ,U ) and instead of f i t ) # 0 one claims that (p^(t),q)# 0, with q a constant. Maximum Principle, together with its various generalizations, was a corner-stone in developping mathematical control theory. It relates optimal control with calculus of variations but is more general since the set of control values U needs not be open and optimal controls often take values at extreme points of U ("bang-bang" controls). If U is open and we control all derivatives of x ( t ) ,i.e., the dynamics f ( x , u ) is given as j:= U , Maximum Principle yieldsEuler-Lagrange equations of the calculus of variations.
7. Optimal control and feedback invariants It has recently been revealed that thefeedback equivalenceproblem and the time optimalproblem are closely related. Namely, using the formalism of the Maximum Principle and taking into consideration all critical trajectories defined by this formalism (possibly including the complex ones) one can find a complete,set of feedback invariants. In order to explain this let us assume that the control set U is an open subset of a manifold. The maximum condition (MC) clearly implies the
Introduction
10
following equality
BH
-(p,z,u) = 0 621 for critical points of H as a function of U . If (C) is solvable with respect to U , i.e., there exists U = G(p,s) satisfying (C), then we may define a critical Hamiltonian
The crucial, although simple, observation is that
fi is feedback invariant.
In the analytic case we may consider the equation (C) in complex domain, then the critical Hamiltonians (which are nonunique) are complex valued, in general. The trajectories of the Hamiltonian vector fields onthe cotangent bundle, definedby the critical Hamiltonians, can be used to construct a complete set of feedback invariants. Among these trajectories there are time optimal trajectories of control system II (which are real). In the case of control-affine system C the critical condition (C) takes the form
It is therefore impossible to derive the critical controls directly from this condition. In this case in order to compute them one has to keep differentiating ( E ) along the system R* till controls appear explicitely. Again, it can be shown that so computed critical controls and the corresponding critical (singular) trajectories are feedback invariants. Vice versa, feedbackequivalence can beusedfor analyzing optimal properties of control systems. This is especially useful when preliminary normal forms can be obtained so that the optimal properties of the system become more transparent. Finding feedback invariants responsible for optimal properties of a system is a crucial problem here. The above overview does not exhaust the subject of geometric nonlinear control theory. The reader who wants to learn more systematically foundations of this theory may consult the books [3], [4], [l, [g], and [lo].
Introduction
11
THE VOLUME: A DESCRIPTION OF THE CONTENTS The chapters are arranged alphabetically. However, we have made an attempt to present them by topics and we hope that this will help to exhibit links and relations between the chapters.
1. Optimal control The survey of Schattler deals with the most basictime-optimal problem for systems of the form
5 =m
) +W(%),
Mt)l
5 1,
where U is scalar. Since time-optimal trajectories are necessarily boundary trajectories, i.e., for all times t they satisfy ~ ( tE )ORt(zo),where O7Zt(z0) denotes the boundary of the reachable set at time t , a natural approach used inthis chapteris to analyze directly the boundary of the reachable set. As shown by the author this approach turns out to be fruitful in low dimensions. The idea is to construct the small-time reachable sets as stratified CW-complexes by successiveattaching cells of increasing dimension to the0-dimensional cell consisting of the initial point. For nondegenerate 2- and 3-dimensional cases it is enough to consider submanifolds obtained by concatenating bang-bang trajectories, i.e., the ones corresponding to the control u(t) = f l . In higher dimensions one has to consider also singular trajectories. A precise description of these geometric constructions is the content of the survey. The survey of Jurdjevic discusses a few basic problems from classical mechanics and geometry which can be considered in a uniform framework as Lagrange optimal control problems (the Lagrangian L in these problems is quadratic with respect to control). These are the dynamic equations of the rigid body, the ball-plate problem, various versions of Euler elastica problem (the shape of curves with minimal integral of the square of curvature) and a related Dubbin's problem. The state spaces M for each of those problems are Lie groups. Using the Maximum Principle and invariance of the problems with respect to a natural action of the Lie group it ispossible to compute
Introduction
12
explicitly the optimal solutions for these problems. The geometry of the solutions is analyzed and striking connections between solutions of different problems are revealed. This stresses a unifying role of the Maximum Principle as a tool for understanding of underlying geometry of different optimal problems. The survey of Agrachev and Gamkrelidze explains effectiveness of the Hamiltonian approach and the symplectic formalism in analysis of optimization problems and, in particular, optimalcontrol problems. It startswith a general constraint optimization problem: given two smooth functions
#:U+R, f : U + M , find u g E U whichminimizes #(U) under the constraint f(u) = q, with a fixed q E M . It is shown in the survey that the necessary conditions of Lagrange for optimality can be interpreted geometrically in the cotangent bundle T * M , using its natural symplectic structure. The notions of Lagrange submanifold and Lagrange embedding appear naturally. The Maslov and Arnold-Maslov index are then used in the analysis of optimality, analogously as the Morse index appears in the analysis of variational problems. The authorsdevote a special section to various definitions and description of properties of the Maslov index. Then theyshow its role in obtaining sufficient conditions for optimality of trajectories of control systems. The article of Sussmann concentrates on the Maximum Principle. It presents a version of this principle which in many respects is the strongest known at present, among first order conditions. The word “strongest” concerns three features. The author imposes the weakest assumptions needed for validity of a theorem of the type of maximum principle. The second feature is that the systems are considered on differential manifolds and coordinate free notions are used. Finally, the usual definition of a control system as a family of vector fields parametrized by a finite-dimensional control parameter is weakened to a parametrized family of time depending vector fields. This allows to avoid unnecessary regularity conditions with respect to the control parameter.
Introduction
13
The article begins with a description how the Maximum Principle generalizes the classical Euler-Lagrange necessary conditions in the calculus of variations. The formulation of the Maximum Principle particularly stresses its differential geometric aspects and shows the role of such geometric objects like Lie brackets, connections along curves and symplectic form& lism. The survey of Bonnard discusses the time-optimal problem for controlaffine systems and its relations to feedback equivalence. As no constraints on control are imposed (i-e., the control set U is R”) the time-optimal problem is invariant under feedbackequivalence.Also the time-optimal trajectories are singular trajectories and are invariant under feedback. In the survey feedback transformations areused to bring the system to a normal form so that optimality status of the trajectoriescan be studied in detail. In particular, a method of describing conjugate points on an optimal trajectory is described (the point where the optimal trajectory ceases to be optimal). On the contrary, the optimal trajectories and singular curves can be usedto describe a complete set of feedback invariants. This is shown under certain assumptions in the second part of the survey. 2. Controllability
The survey of Kawski describes how some basic properties of a nonlinear control system are related with algebraic properties of Lie brackets of vector fields generated by the system. This leads to a combinatorial analysis of words and properties of bases of free Liealgebras. The unifying object is the Chen-Fliess series which gives an algebraic way to represent (formal) solutions of a control system. The survey starts with a discussion of the small time local controllability property whichis the ability of covering a neighborhood of an initial point by the trajectories of the system in arbitrarily small time. Several criteria in terms of the iterated Lie brackets from the Lie algebra C = Lie{f,gl,, . . ,gm} are described. Then nilpotent control systems (i.e. systems with nilpotent Lie algebra C) are discussed together with their relevance to controllability and optimal stabilizability. The author presents
Introduction
14
an algorithm to produce a nilpotent approximation of a given system. Then he illustrates the role of the Chen-Fliess series showing a product expansion formula and an application of the series to a path planning problem. In the second part of the survey the main emphasis is put on algebraic and combinatorial aspects of the problems, related to various choices of bases forfree Lie algebras. The shuffle product and itsrole in the characterization of Lie elements and of exponential Lie series isexplained. Finally, the chronological product, which plays an important role in control theory, is discussed from an algebraic point of view. The chapter written by Davydov deals with controllability properties and their stability under small perturbations of the system. Control systems of the local form 5 = f ( x , u ) are considered, where x(t) E X, a smooth surface. One says that a point x E X has the local transitivity property if for any neighborhood V of x one can find a neighborhood of x such that any two points of are attainable one from another without leaving V. The local transitivity zone is the set of all points of X which have the local transitivity property. The first group of results describes generic singularities of local transitivity zones. The second group of results concerns generic singularities of the (positive time) reachable set and its boundary, for control systems on closed orientable surfaces.
v
v
In order to consider some global controllability problems the author defines the nonlocal transitivity zone as the intersection of the positive and negative orbits of any point. RRsults concerning generic singularities of the boundary of nonlocal transitivity zones are given for systems on closed orientable surfaces. It turns out thatall these singularities are stable under small perturbations of the system. Finally, the author defines a structurally stable control system as a system forwhich its positive and negative orbits are homeomorphic to those of any close system. It turns out that a generic control system on a closed orientable surface is structurally stable.
Introduction
15
3. Stabilization The survey ofDayawansa is devoted to thestabilization problem. Contrary to thelinear case, where controllability is equivalent to stabilizability with an arbitrary exponential decay, for nonlinear systems (local) controllability does not imply (local) asymptotic stability. In the first part of the survey the author discusses necessary conditions for that implication to hold. Although the stabilization problem is of fundamental importance in control theory its complexity implies that for nonlinear systems only low dimensional cases are relatively well understood. The survey gives a detailed analysis of the 2-dimensional case (in its full generality) and the 3-dimensionalcase (for homogeneous systems). Finally, some open problems are stated. The chapter written by Hermes concerns the stabilization problem and its relation to optimal control. A control system in Rn of the form j! = f(x) ug(z) with scalar control U is considered. The goal is to find a stabilizing feedback 'U = iL(x) so that the closed loop system becomes asymptotically stable at 0 E ]Wn. This goal is achieved by considering the problem of finding a control which minimizes a cost functional J(u) = L(s,U ) & with a specified positive L. An optimal control in the form of closed loop, U = u(x),becomes a solution of the stabilization problem. An important issue in this method is that the original system is replaced by a homogeneous (with respect to a dilation) approximation. A method of constructing an approximation is presented which is baaed on a filtration of the Lie algebra Lie{ f,g } generated by f and g. The paper of Shoshitaishvili is an attempt to treat the stabilization problem and the optimal control problem using a unified approach based on the so called Ashby relation. Most of the paper is devoted to theformer problem whichis considered as a qualitative behavior control problem, shortly QBC-problem, defined as follows. For a given control system j! = f(z,U ) and a dynamical system f = c$(%) find a feedback U = .(x) such that there exist a map z 4 x transforming the trajectories of the latter system into trajectories of the closed loop system j! = f ( s , a ( s ) ) .
+
:S
Introduction
16
The author shows a correspondence of the QBC-problem with the Ashby relation whose application allows to construct a stabilizing feedback (a branching feedback, in general). In particular, he studies in detail the stabilization problem in the plane. In the final part the author considers the optimal control problem in terms of the Ashby relation. Instead system in the case of the stable dynamical system i = ~$(z)’added to the of the stabilization problem the adjoint equation is added in the case of optimal control problem. In bothcases the existence of a finitely branched integral manifold of the completed system is of crucial importance. 4. Feedback equivalence
The chapter of Respondek deals with the feedback classification of control-&ne systems of the form 5 = f(z) Cuigi. Most of results, methods, and interesting phenomena of the feedback classification in the general case are present already in the low-dimensional case and thus the chapter provides an illustrative introduction to the subject. A complete local classification of generic systems on Rz and R3 is given and lists of models and normal forms (including parameters) are provided. It turns out that already among generic systems functional moduli appear. Such a functional module is analyzed for the planar case and its geometric and control-theory interpretation is provided. A basic object for the classification is a pair ( E ,S) consisting of two curves, in the planar case, or two hypersurfaces, in the 3-dimensional case. In both cases E is the set of equlibria while S is a “singular” set: for planar systems it consists of points, where the vector fields g1 and [f,g1] are linearly dependent whereas for 3-dimensional case it consists of points where the distribution spannedby g1 and 92 fails to be contact. Geometry of singularities is described in terms of E , S, and their relations. In the paper of Jakubczyk the static feedbackequivalence problem is studied for systems x = f(z,u),. The geometry of this problem and its inherent relation with the time-optimal control problem is revealed. More precisely, a construction of a complete set of feedback invariants is presented which shows this relation.
+
Introduction
17
Critical Hamiltonians are defined in the same way as for the timeoptimal control problem, allowing additionally complex valued controls. These Hamiltonians contain all the information about feedback equivalence classes of systems. The same holds for their symmetric functions, called symbols, which are real analytic functions. It isshown that the iterated Poisson brackets of them evaluated at a point form a set of feedback invariants. Under a rank assumption these invariants together with an additional invariant, determine the feedback equivalence classes (i.e., they are complete invariants). The symbols can be computed effectively using complex logarithmic residua. In thecase of systems polynomial with respect to control the symbols are computed explicitly.
REFERENCES
PI [31 [41
[51
PI 171
R. L. Bryant, S. S. Chern, R. B. Gardner, H. L. Goldschmidt, and P. A. Griffiths, Exterior Differential Systems, Springer Verlag, New York, 1991. W. Hahn, Stability of Motion, Springer Verlag, New York, 1967. A. Isidori, Nonlinear Control Systems, 2nded. , SpringerVerlag, Berlin, 1989. V. Jurdjevic, Geometric Control Theory, Cambridge Studies in Advanced Mathematics, Vol. 52, (to appear). R. E. Kalman, P. L. Falb, and M. A. Arbib, Topics in Mathematical System Theory, McGraw-Hill, New York, 1969. M. A. Lyapunov, Stability of Motion, New York, 1996. H.Nijmeijer and A. J. van der Schaft, Nonlinear Dynamical Control Systems, Springer Verlag, New York, 1990. L. S, Pontryagin, V. G. Boltyanski, R. V. Gamkrelidze, E. F. Mischenko, The Mathematical Theoryof Optimal Processes,Wiley, New York,1962, (translation from the Russian edition, Fizmatgiz, Moscow, 1961).
18
[g]
Introduction
E. D. Sontag, MathematicalControlTheory:DeterministicFinite
Dimensional Systems, Springer Verlag, New York, 1990. [lo] H. J. Sussmann ed. , Nonlinear Controllability and Optimal Control, Marcel Dekker, New York and Basel, 1990.
1 Symplectic Methods for Optimization and Control A. Agmchev and R. Garnkrelidze Steklov Inst., U1. Gubkina 8, Moscow GSP-1, 117966, Russia
Abstract. The goal of this paper is to demonstrate the power and productivity of the symplectic approach to optimization problems and to draw attention of specialists interested in Control Theory to this promising direction of investigations. We start from the classical problem of conditional extremum and then turn to the optimal control. All basic notions and facts from symplectic geometry we use, are introduced in the paper. Geometry of Lagrange Grassmannian is studied in greater detail.
1. Introduction 1. The language of Symplectic Geometry is successfully employed in many branches of contemporary mathematics, but it is worth to remind that theoriginal development of Symplectic Geometry was greatly influenced by variational problems. In Optimal Control crucial role was played by the Hamiltonian system of Pontryagin’s Maximum principle, which itself is the object of Symplectic Geometry. In further development of Optimal Control priorities weregiven to ConvexAnalysis. Though Convex and Functional Analysis are very helpful in developing the general theory of 19
20
Gamkrelidze
Agrachev and
Extrema1 problems, they are notat all effective forinvestigating essentially non-linear problems in higher approximations, when the convex approximation fails. Therefore, since the discovery of the Maximum Principle, there were always attempts of introducing geometric methods of investigation, though not as universal as the Convex and Linear methods. These new geometric methods were applied mainly for obtaining optimality conditions of higher orders and constructing the optimal synthesis, and today we already have many ingenious devices and beautiful concrete results. It seems veryprobable that there should be a general framework which could unify differentdirections of these geometric investigations and merge the Maximum Principle with the theory of fields of extremals of the classical Calculus of Variations. We are convinced that the appropriate language for such unification can be provided by Symplectic Geometry, and as a justification for such a conviction we consider the statement, according to which “the manifold of Lagrange multipliers in the problem of conditional extremum is a Lagrangian manifold”. Thus two “Lagrangian” objects-Lagrange multipliers, the main object of the theory of Extremal problems, and Lagrangian submanifolds, main objects of Symplectic Geometry, which existed independently for a long time, can be unified. 2. The present article has an expository character. Its main aim is
to demonstrate the power and productivity of the “symplectic” language in optimization problems and to draw attention of specialists interested in Control Theory to this promising direction of investigations. All basic notions and facts from Symplectic Geometry, needed in the sequel, are introduced in the article. A big part of our exposition is devoted to reformulation of well-known results into symplectic language, many of which became a folklore. In these cases it is almost impossible to give accurate references, and we do not give them, which should certainly not mean that the authors claim any originality. We also do not claim that we have indicated all essential connections of Optimal Control with Symplectic Geometry. For example, we omitted matrix Riccati equations, which play essential role in linear-quadratic optimalproblems. These equations define flows on Grassmannians, and in case of symmetric matrices on Lagrange
Symplectic Methods for Optimization and Control
21
Grassmannians. Such flows axestudied in detail in many publications. We do not consider in the article such a big and important theme as the variational methods of investigation of Hamiltonian systems - a good example of a feedback influence of Optimization on Symplectic Geometry. In the sequel smoothness always means differentiability of appropriate order, a smooth mapping of manifolds is called submersion (immersion)if its differential at every point is surjective (injective). Let M be a smooth manifold. We call a smooth submanifold an M an arbitrary immersed submanifold, i.e. every one-to-one immersion of a manifold into M . We call a Lipschitz submanifold in M an arbitrarylocally-Lipschitzone-to-one mapping 0 : W + M of a smooth manifold W into M . A Lipschitz curve on a Lipschitz manifold is a curve t + O(w(t)),where W(-)is a Lipschitz mapping of a segment into W . To simplify the exposition we shall indicate in the sequel only the image @(W)assuming that the smooth or Lipschitz mapping 0 is given. We assume that every space of smooth mappings of smooth manifolds is always endowed with the standard topology of uniform convergence of derivatives of all orders on arbitrary compact sets. We say that a generic smooth mapping has a given property if the set of all mappings with this property contains a countable intersection of open everywhere dense subsets in the space of all mappings. Weusein this article standard notations. T,M denotes the tangent space to M at x E M, T,*M is the cotangent space (conjugate to thespace T,M). the tangent bundle to M is denoted by T M and is represented as a smooth vector bundle with base M , total space UzEMT,M and the canonical projection v + x,v E T,M. Correspondingly, T*M is the cotangent bundle, which plays a special role in Symplectic Geometry. Therefore we introduce a special symbol for the canonical projection of the total space U,,"T*M onto the base:
Let A : E + E' be a linear mapping of linear spaces, then ker A denotes the kernel of the mapping, imA is its image and rank A = dim(im A ) , A
Agrachev and Gamkrelidze
22
quadratic form q : E + R is represented as q(e) = b(e, e),where b(e1, e 2 ) , e l , e2 E E is a symmetric bilinear form on E. In this case kerq = {e E E 1 b(e, e')= 0 Ve' E E).We write q > 0 (< 0) and we say that the form q is positive (negative), if q(e) > 0 (< 0) for nonzero e E E. If we substitute symbols > (<) by 2 ( S ) we obtain nonnegative (nonpositive) forms. 3. The remainder of this section is devoted to some initial facts from Symplectic geometry; for details we recommend [13]. Let C be a finite-dimensional real vector space. A symplectic form on C is an arbitrary real nondegenerate skew-symmetric bilinear form on C, i.e. a bilinear mapping Q : C x C + R such that o(z1,zz) = -Q(Zz,Z1) VZl,Z2
E C,
and the relation ~ ( zz'), = 0 Vz' E C implies z = 0. The space C with a given symplectic form Q on it is called symplectic. It is easily seen that symplectic forms exist only on even-dimensional spaces and all such forms are transformed into each other by linear substitutions of variables. More precisely, let dim C = 2n, then there exists a basis el,. , , ,en, f1,. , , ,fn in C such that g ( e i ,e j )
(1)
= P(f i , fj) = 0 V i , j ;
o ( e i ,fj) = 0 V i # j ,
o(ei,fi) = 1,
i = 1,. . . ,n.
Every basis of a symplectic space which satisfies (1) is called a canonical basis. Let S C C,the subspace
S~={ZECIQ(~,~)=OV~ES)~C. is called the skew-orthogonal complement to S.For every subspace E C C the relations dimEL = 2n - dimE, (EL)L = E hold. The subspace E is called isotropic if E C EL.Every one-dimensional subspace is isotropic, and the dimension of every isotropic subspace does
Symplectic Methods for Optimization and Control
23
not exceed n. A subspace E is called Lagrangian if E = EL.Thus Lagrangian subspaces in C are exactly the n-dimensional isotropic subspaces. The symplectic group Sp(C) is the group of all linear transformations of the symplectic space C which preserve the symplectic form:
+
It is a connected Lie group of dimension n(2n 1).The elements of this group are called the symplectic transformations of the space C. The Lie algebra of the symplectic group is given by the expression sp(C) = {A E gl(C) I o ( A z ~ , z ~ ) = Q ( A zV~Z, z~~, )EZ C}. ~ Let h be a real quadratic form on C and d,h be the differential of h at the point z E C. Then d,h is a linear form on C which depends linearly on z. For every z E C there exists a unique vector K(z) E C which satisfies the condition cr(Z(z), .) = d,h.
It is easy to show that the linear operator K : C + E belongs to sp(E), and the mappings h + K is an isomorphism of the space of quadratic forms onto sp(C). We obtain the linear Hamiltonian systemof differential equations L = 6 ( L ) corresponding to the quadratic Hamiltonian h. Let e l , , . , ,e,, f l , , . . ,f n be a canonical basis in C and let us write z = (xiei + tifa). The Hamiltonian system takes the standard form in coordinates xi, ti:
cy=,
4. Let N be a 2n-dimensional smooth manifold. A smooth nondegene-
rate closed differential 2-form cr on N is called a symplectic structure on this manifold. The nondegeneracy of the form : y + uy,y E N , means that cry is a symplectic form on the tangent space TUNVy E N ; “closed” means that da = 0, where d is the exterior differential. A manifold N with a given symplectic structure cr on it is called a symplectic manifold.
24
Gamkrelidze
Agrachev and
An immersion (9 : W 4 N is called isotropic if @*U = 0. An isotropic immersion (9 is calledLagrangian if dim W = n. Correspondingly is defined an isotropic (Lagrangian) smooth submanifold of a symplectic manifold N . It is defined by the condition that its tangent space at every point p must be an isotropic (Lagrangian) subspace of the space T,N provided with the symplectic form cy. The most important symplectic manifolds inmany situations arecotangent bundles which carry a natural symplectic structure. To define it suppose M is an n-dimensional smooth manifold and let RM : T * M + M be its cotangent bundle. Let 19 E T * M , v E Tfi(T*M),then T M * W E T T M ( 6 ) M . Denote the pairing of the vector TM*V with the covector 19 E T,,(fi)M by S M ( W ) = 19(n~,v).The correspondence W + S M ( W ) , v E T(T*M),defines a differential l-form S M on T * M . The closed 2-form
defines the standard symplectic structure on the 2n-dimensional manifold T * M .
Remark. To avoid ambiguities we emphasize that the covector 19 E T * M is an element of the 2n-dimensional manifold T * M , (the covector defines the fibre to which it belongs). Often we omit the lower index in the symbols S M , U M , if the manifold M is determined from the context.
A Lipschitz submanifold (9 : W "t T * M is called isotropic if Sa(,) S M = 0 for every closedLipschitz curve y which is contractible in W . It is called Lagrangian if, additionally, dimW = n. An immersion (9 : W + T * M is isotropic iff @ * S M is a closed form on W . An isotropic (Lagrangian) immersion is called exact if the form @ * S M is exact on W . Correspondingly, a Lipschitz isotropic submanifold (9 : W 4 T*M is called exact if S*(r) S M = 0 foreveryclosed Lipschitz curve 7 on W . Among n-dimensional submanifolds in T * M the smooth sections, i.e. differential l-forms on M , are singled out. Such a section (l-form) is a Lagrangian submanifold iff the form is closed. It is an exact Lagrangian submanifold iff the l-form is exact, i.e. is a graph of a differential of a I
Symplectic Methods for Optimization Control and
25
smooth function. The fibres TZM, x E M, of the bundle T*M are exact Lagrangian submanifolds as well. 6, Suppose Ni is a 2n-dimensional symplectic manifold with the sym-
plectic form ai, i = 1,2. The diffeomorphism P : NI + is called symplectomorphism if P*q = 61. A well-known theorem of Darboux states that all symplectic manifolds of equal dimension are locally symplectomorphic:
For 'dzi E Ni thereexistneighbourhoods 0,, of thepoints zi in Nd, i = 1 , 2 and a symplectomorphism P : 0,, + 0,,, P(z1) = z2. Suppose C is an embedded Lagrangian submanifold of a symplectic manifold N . (An immersed submanifold is embedded if its topology is induced by the topology of N ) . It turns out that in this case a certain neighbourhood of C in N is symplectomorphic to a neighbourhood of the trivial section in T*C. Functions on symplectic manifolds are called Hamiltonians. Let h be a, smooth Hamiltonian on C and dh be its differential (which is an exact l-form). Since Q is a nondegenerate 2-form there exists a uniquely defined vector field h' on N, satisfying the condition ~'JQ =~
4
( h*), = dh.
The field h' is called a Hamiltonian field corresponding to the Hamiltonian h, and the differential equation on N , i = h'(i) is the corresponding Hamiltonian system. According to Darboux's theorem symplectic manifold is locally symplectomorphic to symplectic space: in the neighbourhood of an arbitrary point of the manifold we can introduce local coordinates such that in these coordinates the form Q has constant coefficients. If in addition the coordinates correspond to a canonical basis of the symplectic space then the Hamiltonian system in these coordinates with the Hamiltonian function h takes the form (2). Let u7, T E [0,t ] , be a fmily of smooth vector fields, measurable in T and uniformly bounded on every compact in N . Consider the nonstatio-
Agrachev and Gamkrelidze
26
nary differential equation
and suppose that all its solutions can be extended to the whole interval [O,t]. Then the equation (3) defines a (nonstationary) flow on N , i.e. a locally Lipschitz, with respect to r , family of diffeomorphisms P, : N + N, r E [0,t ] ,which satisfies the conditions
We denote Symp N the group of all symplectomorphisms of N. It is easy to show that P, E Symp N VT E [0,t] iff the l-form v,Ja is closed for almost all r E [0, t].At the same time (3) is a (nonstationary) Hamiltonian system iff the form w,]a is exact for almost all r E [ O , t ] . Thus the flow generated by a Hamiltonian system consists of symplectomorphisms. The Poisson bracket of smooth Hamiltonians h1 , h2 is the Hamiltonian
The Poisson bracket defines the structure of a Lie algebra on the space of all Hamiltonians: the operation is skew-symmetric and satisfies the Jacobi identity:
{hl, {h29 h 3 ) ) - (h2, { h ,h 3 ) ) = { { h , h219 hS)Furthermore
{ h , h z ) 0 P = { h , op,h2 0 P) for VP E SympN, where h o P ( z ) = h ( P ( z ) ) ,z E N. Let P, E SympN, 0 5 r 5 t , be a flow defined by the nonstationary Hamiltonian system
and
'p
be a smooth Hamiltonian. Then
Inparticular, the function {h,, 'p) 0.
=
'p
is the first integral of the system (4) iff
Symplectic Methods for Optimization and27Control
Concluding this introductory section we give the variation fornula for a pair of nonstationary Hamiltonians h,, g,.
F, E SympN , 0 5 r 5 t , be flows defined by the Hamiltonians
Let P,, hr, h, g r :
+
Then F, = P, o R,, where R, is the flow generated by the Hamiltonian 97.0 p,:
To prove this relation it is sufficient, according to (5), to show that
a
-('POP~oR~)={h,+gr,cp}oProRr
Sr for an arbitrary smooth function p on N . Using again ( 5 ) we obtain
Propositions, theorems, formulas and figures are numbered independently in each section. References to other sections use double numbering.
2. Lagrange Multipliers and Lagrangian Submanifolds 1. Consider a standaid problem of conditional extremum. Let U, M be smooth manifolds, f : U + M be a smooth mapping, and let p : U + R be a smooth real-valued function. We have to minimize cp on a level set of the mapping f Put N = R x M and define the mapping F : U + N by the relation F(u)= (p(u),f (U)), U ' € U.If at a given point'u thefunction cp attains its minimum on the level set of f then imF and the ray {(p(u) - t, f (U))E I
28
Agrachev and Gamkrelidze
N I t > 0) have an empty intersection. In particular, F(u) is a boundary point of im F. Let FA : T,U -+ TF(,)N be the differential of the mapping F at U (which is a linear mapping of the corresponding tangent spaces). We remind that a point of the manifold U is calleda regular pointof the mapping F if the differential of F at this point is surjective. If the point is not regular it is called a critical point of the mapping. The image of a critical point of F is called a critical value of F. The implicit function theorem implies that theimage of a regular point of the mapping F belongs to the interior of the set im F. Thus if F(u) is a boundary point of im F then im F; # TF(,)N.Hence there exists a nonzero covector E T&,,N which is orthogonal to im F;. Let V be an arbitrary linear space. We shall denote the pairing of a covector I9 E V * with a vector v E V simply by I9v considering the expression as a product of a row by a column. In particular, the relation wlimFA can be written as WFLV= 0 Vv E T,U,or simply as wFL = 0. Thus we obtained the simplest form of the Lagrange multiplier rule: ifthe function cp attains at U anextrema1valueonthe level set of the mapping f then there,e&ts a nonzero W E Ti+.,N such that wFL = 0. Definition 2. Let U,N be arbitrary smooth manifolds 'and F : U -+ N be a smooth mapping. We call a Lagrangian point of the mapping F an arbitrary pair ( W , U ) , where U E U and W E Ticu,N\Osatisfies the equality wFL = 0.The covector W is called a Lagrange multiplier and U is called a critical point corresponding to the Lagrangian point ( w , ~ )The . set of all Lagrangian points of the mapping F is denoted by CF. Let F * ( T * N )be a vector bundle over U, induced by the bundle T*N under the mapping F : U -+ N . As usually, we shall denote the totalspace of a bundle and the bundle itself with the same letter. According to the definition of the induced bundle we have
F * ( T * N )= ( ( 8 , ~I U) E U,I9 E T&,)N} C T * N X U. We identify the manifold U with the trivial section in the bundle F*(T*N):
U = ( ( 0 , ~I U ) E V } C F * ( T * N ) .
Symplectic Methods for Control Optimization and
29
Then, CF C F * ( T * N )\ U . Let (19, U ) E F * ( T * N ) ,hence 29Fi E T*U.
Definition. The mapping F is called a Morse mapping if the mapping (29, U ) + 29FL, (29, U ) E F * ( T * N )\ U is transversal to the trivial section in T*U. In other words, the mapping F is said to be a Morse mapping if the system of equations dFL = 0 is regular at 29 # 0. For N = R, i.e. in case F is a real-valued function, the condition that F is a Morse mapping is equivalent to the assertion that the Hessian of the function F is a nondegenerate quadratic form at every critical point, If the mapping F is a Morse mapping then CF is a smooth submanifold in F * ( T * N )for every N . Since the dimension of the total space of the bundle F* (T*N ) is equal to dim U +dim N and the codimension of trivial section in T*U is equal to dim U we obtain dim CF = dim N . From Thorn's transversality theorem now easily follows
U
Proposition 1. For arbitrary manifolds U , N ,a generic mapping F is a Morse mapping.
;
+N
Let dim N = n and suppose the mapping F : U + N is a Morse mapping. If ( W , U ) E CF then (tw,u) E CF Vt E W \ 0.Hence the ndimensional submanifold CF C F * ( T * N )defines an (n - 1)-dimensional submanifold W Fin the projectivization
PF*(T*N)= F * ( T * N ) / { ( d , u ) (td,.), t E R\O> of the bundle F * ( T * N ) . The projection ( W , U ) c) U maps the manifold CF onto the set of critical points of F . The latter set is the main object of investigation in the singularity theory of smooth mappings. According to Thom-Bordman for every typical F the set of its critical points is a finite union of submanifolds in U of dimensions 5 ( n - 1). At the same time, the set of critical points is not necessarily a smooth submanifold and has, in general, highly complicated singularities even for generic F. Proposition 1 implies that all these singularities are resolved by simply adjoining the Lagrange multipliers.
30
Gamkrelidze
Agrachev and
3. Let F : U -+ N be a smooth mapping, U E U. We shall define the notion of the second derivative of F , which isnot quite trivialif we attempt to obtain aninvariant notion, independent of the choice of local coordinates in U and N , and which should reflect the local structure of F “of the second order”. For example, if U is regular for F then, according to the implicit function theorem, F is represented in some local coordinates as a linear mapping, and thereis no senseto’speak about the second derivative. Todefine ‘the second derivative at a critical point it is appropriate to complement it, as above, by Lagrange multipliers.
Thus let ( W , U ) E CF,W E ker FA, and suppose g and 2 are smooth sections of vector bundles F * ( T * N )T,U , respectively, such that g(u) = W ,
-
= W. Consider a smooth function wF’2 : G e g(G)FAy(G)an U.It is easily seen that the differential (gF’2); of this function at U depends anly on W , W and does not depend on the sections g, 2.
).(W
Definition. The second derivative of a smooth mapping F at a Lagrangian point ( W , U ) is the linear mapping
defined by the relation wF:w = (gF’g)L,v E kerF4. The Hessian of F at a Lagrangian point ( W , U ) is defined to be the real-valued quadratic form wF,h on ker F;, which is defined by the relation wF,h(v) = (wFlw)v, W E ker F :. It is easily seen that the bilinear form (211, W Z ) I+ (wF:wl)wz is symmetric, hence it i s restored by the quadratic form wF,h. The following test for being a Morse mapping is established by a straightforward computation. Proposition 2. A smooth mapping’Fis a Morse mapping iff the linear mapping wF$ is injective at every Lagrangian point ( W , U ) . Suppose ( W , U ) E CF.If the Hessian wF,h is a nondegenerate quadratic form then wF; is injective. The opposite is not always true. For example,
Symplectic Methodsfor Optimizationand Control
-
31
for the following Morse mapping
(ti)
U1
(U1uz+(ul)S
)
U'
E R, i = 1,2,
for which the origin is a cusp point, the Hessian is equal to zero for (0;l), 211 = 212 = 0.
W
=
4. Denote by
Fc : CF + T * N the mapping ( W , U ) t+ manifold.
W , (W, U )
Proposition 3. If F : U exact Lagrangian immersion.
E CF.We remind that T * N is a symplectic
+M
is a Morse mappingthen FC is an
Proof. We shall use local coordinates and, to simplify the exposition, we shall suppose that U,N are vector spaces. Hence we can assume that T*U = U* X U , T * N = N* X N , CF = { ( < , U ) E N * X V I < $ =O},
Fc : K, 4 t+ (5, F ( U ) ) . According to Proposition 2 the property of F to be a Morse mapping is equivalent to the relation &(<%v) # 0 for (<,U) E C F ,W E ker v # 0. Suppose that Fc is not an immersion at ( E , U ) . Then 3(q,v ) E T ( t I u ) C ~ such that q = 0, U E ker $, The definition of T ( t I U ) Cimplies ~ that &(<%v) = 0. We come to the contradiction with the assumption that F is a Morse mapping. It is left to show that the immersion FC is Lagrangian. We have that S N = d y , ( E , U) E N* X N = T * N , hence F ~ S = N
E,
<
kgrachev and Gamkrelidze
32
We have proved that T N o CF defines a smooth mapping of a (dim N - 1)dimensional manifold EFinto N , The following assertion formulates conditions under which the latter mapping is an immersion. Proposition 4. Let F be a Morsemappingand ( W , U ) E C F . The digerential of the mapping T N o F c has rankdim N - 1 at @,U) if and only if rank FA = dim N - 1 and the Hessian wF,h of the mapping F at ( w , ~ is ) a nondegenerate quadratic form.
Proof. We use the notations from the proof of Proposition 3. We have ker(m 0 Fc)tWtu)= (N* x ker F:) n T ( € , , ) ~ F ,
(2)
where W = (5, F ( u ) ) ,cf. (1). Let v E ker FA. According to (1)the existence of a pair (v,W ) contained in the space (2) is equivalent to the relation W E ker wF,h. Moreover the pair ( ~ , 0 )belongs to the space (2) iff 71 im F:. 5. We return to the situation considered in nol,,when N = Wx M , F ( u ) = (cp(u),f ( U ) ) . Let ( W , U ) be a Lagrangian point, W E T&u,N, U E U. Then W = (a,X),a E R, X E T;cu)M,0 = wF: = Xf; +ap$.According to
the usual terminology in the theory of extremal problems the Lagrangian point ((a, X), U ) will be called noma1 if a # 0, and will be called abnormal if a = 0..Consider the set of normal Lagrangian points. Since the Lagrange multipliers W = (a, X) are defined up to a nonzero multiplier we can normalize them by fixing the value of Q arbitrarily. This procedure reduces the dimension and permits to consider the normal Lagrangian points as elements of the space f * ( PM ) rather then of F * ( T * N ) .We shall use the normalization Q! = -1. Put Cf,p
{(X,U)
E
f * ( T * M )[ U E V, X
fc : 0, U ) l+ X,
E Tj,,)M,
Xf;
= 0},
(X, U ) E Cf,p.
The following assertions are easy modifications of the results of n04. Proposition 5. If F = (p, f ) is a Morsemapping then is a smooth submanifold in.f * ( P M ) ,and fc : C,,,-+ T * M is a Lagrangian immersion, where f 5 S M = d p .
Symplectic Methods
forControl Optimization and
33
Proposition 6. Let F = (cp, f) be a Morse mapping and ( & U ) E Cj,cp. The differential of the mapping T M o fc at (X, U) is invertible i f f : is surjective and the Hessian of the mapping F at (-1, A), U ) is a nondegenerate quadratic form. Let ( X , U ) E Cj,cp, W = ( - l , A ) , and w F t be a Hessian of the mapping F at the Lagrangian point ( w , ~ ) If. the quadratic form wFt is negative definite (positive definite) then it is easily seen that U is a point of strong local minimum (maximum) of the function cp on the level set of the mapping f . On the other hand, if f; is surjective and the quadratic form w F t is indefinite then U is not a point of a local extremum of the function cp on the level set of the mapping F . Combining these assertions with Propositions 5 and 6 we come to the
Corollary. Let F = (v, f ) be a Morse mapping and W be a connected open subset in C,,, such that T M o fclw is a diffeomorphismof W onto f ( W )C M . If there exists a point (Ao, U O ) E W such that uo is a point of a local minimum (maximum) of the function cp on the level set off then V(A, U ) E W U is a point of strong local minimum (maximum) of c p . on the level set o f f . Furthermore,
1
(o('h) - (P(U0) = sM Y
for V(Ai,ui) E W , i = 0 , l and for every smooth curve 7 : [O, l]+ fc(W), satisfying the condition T M ( Y ( ~ )= ) .f(ui), i = 0,l.
3. The Problem of Optimal Control 1. Among many similar formulations of the optimal control problem we choose the problem with the optimized integral functional, free time, and fixed end-points. Let M be a smooth manifold and V a subset in R?', We call admissible controls locally bounded measurable mappings v(*) : W, + V ,where W, = { t E W 1 t 2 0). Let go : M x V + P be a continuous function, smooth in the first variable, and let g : M x V + TM be a continuous mapping, smooth
Agrachev and Gamkrelidze
34
in the first variable, and subject to the condition g(z, W ) E T,M VI E M , W E V . In particular, foreveryfixed W the mapping I C ) g(z, W ) is a smooth vector fieldon M . We consider an initial. point OI E M which will not change in the sequel. For every admissible control W(-)there exists a unique absolutely continuous curve T c) I(T; W(-)) in M , defined on a half-interva1.7 E [0, t w ) which , satisfies the condition ~ ( 0W(.>) ; = ICO and is a solution of the differential equation I
.
(1) Denote by.U the set of pairs (t,W(.)), such that Z ( T ; W(-)) is defined.for T E [Ojt]. Define a function cp : U -+ B and a mapping f : U -+ M by relations t
cp(t,V('))
1
= go(+;
9
W(*)),W ( T ) ) d T ,
f(t,W(')) = 4 t ; 4)).
0
Since the infinitedimensional space U is not necessarily a smooth manifold we can not apply directly to cp and f the results of the previous section. Nevertheless we have in the given situation a reasonable substitute of a smooth structure for U.In order to define it we have to consider generalized controls, cf. [g]. We shall not give here the appropriate definitions which would leadus too far aside. We only indicate that therole of the differential at (t,W(.)) of f is taken by the mapping t
f [ t , w ): (0, 4 ' ) )
1
c) e
*
(g(4T;W), 4 7 )
+ 4 7 ) ) - g ( 4 7 ;4 4 T ) ) ) d T
0
+g(+;
+
@,
+
where (t B, W W) E U,(and assuming that t is a Lebesgue point for W(-)).Here P: is a diffeomorphism of a neighbourhood of the point Z ( T ;W ) on a neighbourhood of z(t; W ) which is uniquely defined by the conditions that P,' z and that the curves T C ) PS("), T E [ ~ ' , t are ] , absolutely continuous solutions of the differential equation (1).
=
Let F = (9,f ) : U + B x M . Substituting M by R x M , the point zo by (0, $0) e R x M , and the differential equation (1) by the equation
Symplectic Methods for Optimization and Control
35
d -(zO, 3) = (gO(z, W ( T ) ) ,g(z1V ( T ) ) ) , dt we obtainan explicit expression for = f[t,,,). We call the point ( t ,W) E U a critical point of F if the image of the mapping F(,,v), which belongs to P x T,(t,v)M,does not contain a neighbourhood of the
(~i~,~),
origin. It is easily seen that the image of is convex, hence criticality of ( t ,W) is equivalent to theexistence of a nonvanishing element W = (a,X) E Rx T&ulM such that wFl,,+)(e,W ) 5 0 for V(e, W )satisfying the condition (t 8, W W ) E U.We call W the Lagrange multiplier and the triple W , ( t ,W). a Lagrangian pointfor F. If ( t ,W ) is a critical point for F then (7,v) is also a critical point for F, for VT 5 t. Put X, = P:*X E T,*(,,v)M,then (a, X), is a Lagrange multiplier corresponding to thecritical point (7,W). It is easily seen that the curve T C ) X, in T * M is a trajectory of a nonstationary Hamiltonian system on T * M corresponding to a nonstationary Hamiltonian
+
(2)
+
hT(E)= &7(nMs1W(T)) +W0(TM<,w(T)),
< E T*M, 0 5
5 t.
7
An elementary calculation leads to the.following
Proposition 1. The system (a,X), ( t ,W ) is a Lagrangian point of the mapping F = ( V , f ) i f for this systemthe Pontryagin Maximum Principle holds: 0 = h,(X,) = F E y ( X T g ( " ( T ; v),U )
+ ago("(T;v), U))),
05
5t,
where h, is given by ( 8 ) andthecurve T C ) X, is a trajectory of the Hamiltoniansystem in T * M defined b y thenonstationaryHamiltonian h,, T E [O,t],with the boundary condition At = X. 2. A Lagrangian point (a, X), ( t ,W ) is callednormal if a # 0 and abnormal in the opposite case. As in S2 we normalize the Lagrange multipliers for normal points by putting Q = -1. Let
Agrachev and Gamkrelidze
36
Put
Proposition 1 implies that im fc C H-l(O). Let (X,t,W ) E Cf,,, then there exists an absolutely continuous curve X, E T ' M , 0 5 T 5 t , such that (X,,T, W ) E Cf,, VT, and Xt = X. Without any regularity conditions it isdifficult to expect that C,,, could be provided with the structureof a Lagrangian manifold, and that fc is a Lagrangian immersion. Still it turns out thatif a Lagrangian manifold iscontainedin H"(0) and contains the curve X, 0 5 T 5 t , we can make some essential conclusions about the optimality of the control W(-) independently from any assumptions about the analytic nature of Cf,, and fc. Theorem 1. Let C C H-'(O) be an exact Lagrangian Lipschitz submanifold in T * M such that the preimageof an arbitrary pointin ?TM(C)under the mapping ~ ~ l : l C : + M is a connected Lipschitz complex in C , and the preimage of an arbitrary admissible trajectory in M under the mapping ?TM(L:is a Lipschitz complex in C. Let X, E C , 0 5 r 5 t , be an absolutely continuous cu'rwe such that (X,,r, W ) E C,,, for some admissible control W(-). Then for V(
<
9
t
j g 0 ( 4 7 ;W), 4.))
dT
5 j g 0 W ; $1, W ) )
0
0
holds.
Proof. We denote Z ( T ) = X ( T ; w ( T ) ) , O(T) = x(T;G(T)). Under the assumptions of Theorem 1 one can show that there exists a Lipschitz curve X, E C and a nondecreasing Lipschitz function O(T), 0 5 T 5 1, such that the following conditions are satisfied A
n
(1) X0 = Xo,
(2)
A
X1
= X;
e(o) = 0,e(1) = 6
(3) ?TM(X,) = q e ( T ) ) ,
o 5 T 5 1.
Symplectic Methods for Optimizationand Control
where
denotes the curve r
c)
IT.(Weused
37
here the relations 0 =
H(%)= m ~ E v ( ~ , g ( d ( T )U) ), - gO(z(e(T)),U))). Denote by 7 the curve T c) X .,
Since the form S M is exact on C we have
1S M = 5 S M CV
7
t
=
t
&Z(T)& 0
t
1
5
0
0
= X r g ( 5 ( 7 ) ,u(7))dT =
g o ( Z ( T ) ,V ( 7 ) ) d T .
Remark. The exact Lagrangian submanifold C evidently satisfies conditions of Theorem 1 if the projection TMIL is Lipschitz invertible, fig. 1; “vertical pieces” can be also permitted, fig. 2, but “folds” are not allowed, fig. 3.
Fig. 1 Fig. 2 Fig. 3 3. Let (X,t,v) E C,,, and X, 0 5 r 5 t , be a trajectory of the Hamiltonian system defined by the nonstationary Hamiltonian
with the boundary condition Xt = X. We call the curve X, a norrnal Pontryagin extrema1corresponding t o the control v(*).According to Proposition 1 (X,,r,v) E Cf,, for 0 5 T 5 t.
Agrachev and Gamkrelidze
38
The simplest case when a Lagrangian manifold can be constructed, which contains a given Pontryagin extrema1 X, is given when the Hamiltonian (3)
H ( [ ) = y$tg(n(t),4
- g0(.(t)14)9
t E T*M
is smooth. It is easy to show that in this case X, is a trajectory of the Hamiltonian system defined by the Hamiltonian H . The following assertion is a geometric formulation of the classical method of characteristics for solution of differential equations in partial derivatives of first order.
Proposition 2. Let H : T*M -+ R be a smooth function and assume that CO C T * M is a smooth Lagrangian submanifold. Suppose that H i I TACO# 0 VX E CO n H-l(O). Let t .I+ p(t,X) Be a trajectory of theHamiltoniansystemwithHamiltonian H andthe initialcondition p ( 0 , X) = X E COn H-'(O). Then the mapping p , which is defined on an open set in W x (COn H-'(O)) and with values in H-'(O), is a Lagrangian immersion.
z(X)
Proof. Condition H i I TACOis equivalent to the statement that is not skew orthogonal to TACOin the symplectic space TA(T*M).Since CO is a Lagrangian submanifold the last statement is equivalent to g(X) not being tangent to CO,Hence p is indeed an immersion. Since the Hamiltonian flow preserves the symplectic structure it is sufficient to check that the immersion ( t ,X) t ) p(t,X) is Lagrangian only for t'= 0. We have
Proposition 2 can be used to construct a Lagrangian submahfold from Theorem 1 ifwe take for CO a Lagrangian submanifold in T&M, or more generally, ifwe take a Lagrangian submanifold (4
{ X E T,,M
I5
E
x,XLTzX),
,,,
, ,
where X is a smooth submanifold in M . The submanifold (4) is often used
Symplect,fcMethods for Optimization and Control
39
in problems of optimal control with a variable left end-point z(0) E X , and an obvious generalization of Theorem 1 isvalidfor this case. For nonsmooth Hamiltonians (3) there might not exist even a nonsmooth flow consisting of Pontryagin extremals - the extremals are inevitably intersecting and branching near any singular extremal. Therefore it is important to emphasize that to apply Theorem 1 it is not at all necessary to have a Hamiltonian flow of extremals: the corresponding Lagrangian manifold can be constructed in a different way. It is often possible to construct an auxiliary Morse mapping, cf. 52, for which the Lagrange multipliers coincide with the Lagrange multipliers of the optimal problem in consideration and hence constitute a Lagrangian manifold in the level set of the Hamiltonian (3) corresponding to the value 0. We shall return to this problem later. After the appropriate Lagrangian submanifold C C T + M is constructed we have to examine its projection on M . The local properties of the projection are defined by a mutual disposition of the Lagrangian subspaces TxC and Tx(T,*(,)M)in Tx(T*M),A E C. The next section contains some basic information about the manifold of Lagrangian subspaces of a symplectic space. This information turns out to be useful not only for investigation of the projections T I L , but in many other cases as well.
TIC
4. Geometry of Lagrange Grassmanians 1. Let C be a symplectic vector space with a symplectic form U with dim C = 271. We denote by &(C) the set of all Lagrangian subspaces in C and call it the Lagrange Grassmannian. The subspaces Ao, AI E &(C) are transversal iff A0 nA, = 0. The set of all Lagrangian subspaces transversal to a given A0 E L(C)will be denoted by A$. If p : C + C is a linear symplectic transformationand A C C is a Lagrangian subspace then pA is also Lagrangian. Thus the symplectic group of all symplectic'transformationsacts naturallyon L@). This action automatically defines an action of Sp(C) on the sequences of k points from
Agrachev and Gamkrelidze
40
L@):
Proposition 1. The group Sp(C) acts transitively on the set
{(Ao,Al)I A o , h E W ) ,
n A1 = 0 )
of pairs of transversalLagrangiansubspaces.The restriction p I+ PIA, defines an isomorphism of stablesubgroups Cp E Sp(C) 1pAi = Ai, i = 0,l} on GL(A0).
Proof. The bilinear form (1)
0 1 1 x01 l+ Q
( h 1
x011
xi E Ai,
i = 0, 1,
defines a nondegenerate pairing of spaces A0 and Al. Let el,. .. ,en be a basisinhland f l , ...,f, thedualbasisinAo.Thene1, ...,e n , f l , ...,f, is a canonical basis in C.Proposition 1 follows from the assertion that a linear transformation in C is symplectic iff it maps a canonical basis into a canonical basis. Proposition 1 implies that L(C)is a homogeneous space of the group Sp(C); in particular, L(C)has the structure of a Cw-manifold.We shall indicate a standard family of coordinate neighbourhoods on L(C)defined by pairs of transversal Lagrangian subspaces. Let Ao, A1 E L(C ) , A0 n A1 = 0. The pairing (1) defines an isomorphism A0 W A i . Correspondingly C = A0 61A1 FY A i 6I Al. The indicated is,omorphism identifies0 with the standard symplectic form
(2)
( ( t l , X I ) , K 2 1 2 2 1 1 I+ t 2 Z l
E A,, ti E A:, i
-tlX2, 1,2.
,
The form (2) will be also denoted by Q. Every m-dimensionalsubspace H C hi @,A1W C transversal to A i , (in particular, every subspace sufficiently close to A I ) , is a graph of a linear
Symplectic Methods for Optimization and Control
mapping QH : A1
-+
41
Ai:
It is easy to show that H is a Lagrangian subspace in A i @A1 iff Q& = QH. Let Io : C + hi @ A1 be the isomorphism of symplectic spaces defined above, which sends A0 into A i . Then A I+
(3)
Q ~ A ,
A E A$
is a diffeomorphism of A$ onto the space of selfadjoint mappings of A1 into Ai. Thus A$ is a coordinate neighbourhood in L(C),and the mapping (3) defines local coordinates. Selfadjoint transformations from A1 into A i are actually equivalent to quadratic forms on AI: to a mapping;Q : A1 + Ai there corresponds the form q : z (Qz)z, z E Al. The space of all real-valued quadratic forms on A1 is denoted P(A1).We have
A$
E
P(A,),
dimL(C) = dimP(A1) =
n(n
+ 1)
2
'
It is easily seen that L(C)= @. The manifold L(C)is compact. Taking into account the isomorphism A$ I P(A1) we can say that L(C)is a compactification of the space of quadratic forms of n real variables. We shall nowshow that the geometry of the Lagrange Grassmannian considered as a homogeneous space of the group Sp(C) is intimately connected with the geometry of the space of quadratic forms, which explains the effectiveness of symplectic methods in many problems where we have to deal with families of quadratic forms. Consider a subgroup in Sp(C) which preserves A$. A linear transformation of the space C preserves A$ iff it preserves Ao. The isomorphism IOpermits to consider correspondingly L(Ai @AI)and Ai instead of L@), and Ao. A linear transformation of A i @ A1 is symplectic and preserving AT iff it is represented aa
(E, z) (4)
< E Ay,
2 E
(A*(
+ BA-lz, A"z)
A i , A E GL(Al), B : A1 + h;, B* = B .
<
The mapping (4) transforms the subspace {((,S)I = Qz} C A i @ A1 into subspace {(E,z)I< = (A*QA B)z}. In other words, the Lagran-
+
Agrachev and Gamkrelidze
42
gian subspace corresponding to the quadratic form q(o) = (Qo)z, o E A1 is transformed into the subspace corresponding to the quadratic form q(Az)+ ( B z ) z ,obtained from q by coordinate transformation and translation. Thus the sympIectic transformations which preserve A$’ P P(A1) are “variable substitutions” and translations in the space of quadratic forms of n variables. It turns out that the group Sp(C) is generated already by translations and a single transformation which interchanges the subspaces A, and A l . Suppose that a scalar product (.I.) is defined on A1 which identifies Af with A1 and Af @ A1 with AI @ AI, so that
Proposition 2. The symplectic group of the space A1 @ A1 P C with the symplectic form ( 5 ) is generated b y transformations
and the tramfornation
Suppose Q : A1 subspace
”t
AI, Q = Q*. The intersection of the Lagrangian
with 0 @ A1 coincides with the subspace 0 @ ker Q. In particular, the subspace (6) is not transversal to O@Al iff Q is degenerate. If it is nondegenerate then the symplectic mapping J transforms the subspace (6) into the subspace { ( g , z)I y = Q-lz}, corresponding to the operator -8-l. But, contrary to theoperation of matrix inversion, J is defined fordegenerate Q as well. Speaking not quite formally, we can say that the Lagrange Grassmannian of a 2n-dimensional symplectic space is a compactification of the space of symmetric n x n-matrices (the space of quadratic forms of n variables) for which the inversion of all symmetric matrices, including the degenerate matrices, is possible: the cone of the “ideal matrices”, which
Symplectic Methods for Optimization and Control
43
are inverses to degenerate matrices, is "attached at the infinity" to the space of symmetric matrices. Repeating in the opposite order the identifications of the symplectic spaces we have made, we obtain
A$
\ A?
W
{q E P
( h )I ker q # 0).
2. Let A'"@) be the subspace of k-linear skew-symmetric forms on C,
k = 0, l , ,. . ,2n;
E A2(C). If w E A'"(C), then kerw gf{x E C I ZJW = 0). It iseasy to show that dimkerw 5 2n - k for every nonzero form
form w is called decomposable if dim ker W = 2n - k. A decomposable form is restored by its kernel up to a nonzero scalar multiplier.
W
E Ak (C). The
Let P Ak (C) = (iik(C) \ O ) / { w E QW, w E C, Q! E R, QW # 0) be a projectivization of the space Ak(C), and denote by G the image of a nonzero form w under the canonical factorization Ak (C) 0 + P Ak (C). The mapping
(8)
ker W
c)G,
w is decomposable in Ak (C),
-
is a standard projective Plucker embedding of the Grassmannian of (2n k)-dimensional subspaces in C. It turns out that for k = n the image of the Lagrange Grassmannian under the embedding (8) is an intersection of the image of the standard Grassmannian with a projective subspace in P Ak (C). Namely, the following assertion is valid.
Proposition 3. Let
W
E An@) be a decomposable form. Then
kerwEL(C)wuAw=O. We consider in more detail the Lagrange Grassmannians for n = 1,2. Every one-dimensional subspace in R2 is Lagrangian, hence L(R2) = RP1. Furthermore Sp(R2) = SL(R2), therefore symplectic transformations coincide with the orientation preserving projective transformations. Thus ,!,(R2) is an oriented projective line, topologically - an oriented circle. To describe L(R4) we use the Plucker embedding. The form w E A2(R4)
Gamkrelidze
44
Agrachev and
is decomposable iff wAw=O.
(9)
The equation (9) defines a quadric of signature (+++- - -) in PAa(R4)= R P 6 . To obtain the image of L(R4) under the Pluckerembedding we must intersect the quadric with the hyperplane, defined by the equation o Aw = 0, As a result we obtain a quadric of signature (+ - -) in W . Topologically this quadric, and hence also L(R4),are represented as a quotient of S1x S2relative to the equivalence relation (21, 22) M (-21, -%a), zi E S i , i = 1 , 2 . This is three-dimensional nonorientable manifold, cf. [lo], where two “proofs” are given of the relation L@*) M S1x S2.
++
3. Proposition 1 asserts that the symplectic group acts transitively on pairs of transversal Lagrangian subspaces. Nowwe shall consider the action of this group on triples of Lagrangian subspaces. Let Ai E L@), i = 0,1, where A0 n A1 = 0. The isomorphism introduced in nol, 10 : C + AT CB A I , transforms A0 into A i , hence for VA E A$ we have a selfadjoint linear mapping of A1 into A i :
I o A = { ( € , X ) E A;
Al I € = Q I O A ~ : ) .
The subgroup in Sp(Ai CB A I ) which preserves A1 and AT consists of transformations of the form
((,x)
c)
(A*€,A-lx),
A E GL(A1).
The Lagrangian subspace defined by the equation 6 = Qz is transformed by this mapping into the subspace defined by the equation E = A’QAx. We assign to each A E A0 the quadratic form Q P A ( ~ ) = (&rpnX)z,
2
Eh .
The given considerations imply that the existence of a symplectic transformation which carries the triple of Lagrangian subspaces (Ao, AI, A)into the triple (Ao, A,, A‘) is equivalent to the existence of a linear change of coordinates transforming the form qIOA into the form qrOA]. If q is a real-valued quadratic form on a vector space E we denote by sgnq the difference between the number of positive and negative squares
Symplectic Methodsfor Optimization and Control
45
in the diagonal form of q: sgnq = max{dimH I qIH
> 0, H c E) - max(dimH I qIH < 0, H C E}.
Hence the forms q and q' are transformed into each other by a linear change of variables iff sgn q = sgn q', dim ker q = dimker q'. Note that ker qIOA = A n A l . Denote P(A0, AI 1 A) = sgn qloh.
The number p(Ao,A1, A) is called the Maslov indez of the triple of the Lagrangian subspaces Ao, AI, A.We shall give nowanother, more invariant definition of the Maslov index, which does not presupposes the assumption about the transversality of the subspaces A and A1 to Ao. Let Ai E L@), i = 0,1,2. Define a quadratic form q on AI n (ho+A2) by relations q(A1)
= u(X0, Xz),
A1
= X0
+ A2,
X i E Ai, i = 0,1,2.
+
The vector X1 E AI n(A0 A2) is in general represented as a sum of vectors from A0 A2 not uniquely, but the skew-scalar product of these vectors depends only of XI, which is a direct consequence of the isotropy of Ao, A2, The Maslov index of the triple Ao, 111, A2 is called the number
+
1 . 0 0 , A I , A21
= sgn q.
It is easily seen that q = qI0Al if A2 n A0 = 0. The given definition of the Maslov index uses only the symplectic structure of the space, therefore the index is a symplectic invariant of the triple of Lagrangian subspaces. We can give still another definition of the Maslov index, in which the subspaces Ai, i = 0,1,2,enter symmetrically. Define on the 3n-dimensional space A0 @ A1 @ A2 a quadratic form @ by the relation
q x o + x1 + X 2 ) = a(Xo,h) - ope, x 2 1 + u ( h ,A2). One can show, cf. [ll],that &Io,
....... ..
.
I
A I , A2) = sgn?.
..".. ../.,. . I . . . . ,...... .,. .._l .
,.
... . ..,
,
..,.,. ,.,...._.
. .
.
.
..
,
I
. ...... .
Agrachev and Gamkrelidze
46
The last representationimplies the skew-symmetry of the Maslov index in all three variables: p(Ao, h , Aa) = - p ( h , Ao, ha) = -p(Ao, h , AI).
Somewhat more difficult is,to prove the following identity rule, cf. [U]:
- the
chain
p(Ao,A1,Az) - p ( A o , A l , A 3 ) + p ( A o , A z I A ~ -) p ( A 1 , A a 1 A 3 ) = O f
(10)
VAi E L(C), i = 011,2,3.
Except the Maslov index there are the following trivial invariants of the triple Ao, A I , Az:
(n a
dim(Ai n Ai),
0 5i
< j 5 2,
dim
Ai).
i=O
We have proved that there are no other invariants if A o n A l = A0nA.a = 0. It turns out that this is true without any assumptions.
Proposition 4. A triple of Lagrangian subspaces (Ao,Al,A,) can be transformed into the triple (Ab, A i , Ab) by a symplectic mapping ifl p(A0, A I , 112) = p(AL,A i , A;),
dim(Ai n Ai) = dim(A: n Ai),
Consider the case n = 1 in more detail. Since L(Ra) is an oriented circle the Maslov index is an invariant of a triple of points on the oriented circle. If two of the three pointscoincide the index is zero. LetSO, SI,82 be three different points located on S1in such an order that if we move along S1in the positive direction we pass consecutively through the points sil, s i p , S i 3 . The parity of the substitution (il,i z , is) does not depend on the choice of the initial state of the movement.The Maslov index p(el,salss) is equal to 1 if this substitution is even and is equal to -1 if it is odd. 4. We consider in more detail the tangent spaces TAL(C),A E L ( C ) . To every quadratic form h E P@) there corresponds a linear Hamiltonian field h' and a one-parameter subgroup t C) etiEin Sp(C). Consider the linear
Symplectic Methods for Optimization and Control
47
of the space of quadratic forms to TAL(C).The set of all linear Hamiltonian fields isa Lie algebra of the group Sp(C). At the same time the action of the group Sp(C) on L(C)is transitive. Hence the mapping (11) is surjective. This mapping is certainly not invertible since dimP(C) = n(2n + 1) and dim L(C)= It is easy to show that the kernel of the mapping (10) consists of all quadratic forms which vanish on A. Thus to two different forms from P(C)there correspond equal vectors from TAL(C)iff the restrictions of these forms on A coincide. We obtained a natural identification of the space TAL@)with the space P ( A ) of the quadratic forms on A. The correspondence TAL(C)+ P ( A ) could be described more explicitly, without considering quadratic forms on C.Suppose A(t) is a smooth curve in L@), A(0) = A. We assign to every smooth curve At E A(t) the number $a(% X,). The isotropy of the spaces A(t) imply that In other words, tothe tangent this number depends onlyon XO,
W.
I t = O,
vector
dt
L
O
E TAL@)there
corresponds the quadratic form
It is not difficult to show that this correspondence coincides with the isomorphism TAL(C)W ?(A) defined above. We shall use this identification in the sequel without any further mentioning. The cone of non-negative quadratic forms defines a partial ordering in P ( A ) , We call a curve A(t) E L(C)monotone non-decreasing, (monotone non-increasing) if 2o 5 0)Vt. Suppose that thecurve A ( t ) is contained in a coordinate neighbourhood of the manifold L(C)W L(Ay €B A,) considered in nO1.Thus
v (v
At = ( ( 5 , .) E A; €B A1 I E = Qt.),
where Qt : A1 + AT is a selfadjoint mapping smoothly depending on T.To the tangent vector corresponds a quadratic form on A l . It is easily
%
Agrachev and Gamkrelidze
48
seen that this is the form
x I-) -(%x)x,
x E Al.
Thus the curve A, is non-decreasing (non-increasing) iff
*
5 0 (32
0)* We know that A1 is isomorphic to the space of all quadratic forms on W , though not canonically isomorphic. Consider the remaining part of the Lagrange Grassmannian
which accordingto V. Arnold is calledthe train of the Lagrangian subspace A l . The relation (7) implies that theintersection of Mhl with an arbitrary coordinate neighbourhood A$, where Ao, is transversal to AI, coincides with the set of all degenerate quadratic forms on R". To a subspace A, which has a k-dimensional intersection with AI, there corresponds a form with a k-dimensional kernel. Degenerate forms constitute an algebraic hypersurface in the space of This hypersurface has singularities: its singular points are all formsP(Rn). all the forms which haveat least two-dimensional kernel. At the same time the forms with at least two-dimensional kernelconstitute an algebraic subset of codimension 3 in P(Rn), cf. fig. 1, which represents the hypersurface of the degenerate forms in the three-dimensional space P(Ra).
Fig. 1
Symplectic Methods forControl Optimization and
49
&om this we obtain that M A , is an algebraic hypersurface in L@), and its singular points constitute an algebraic subset of codimension 3 in M A , . Hence M A , is a pseudo-manifold. Let A be a nonsingular point of the hypersurface M A . It is not difficult to show that vectors from TAL&) corresponding to the positive definite and negative definite quadratic forms on A are not tangent to the hypersurface M A , , cf. fig. 2, where the dispositions of the positive and negative cones in TAL@)relative to M A , are given for n = 2.
Fig. 2 We define a canonical coorientationof the hypersurface M A , in L(C) at a non-singular point A, considering as positive that side of the hyperplane towards which the positive definite elements of TAL@) are directed and as negative - towards which the negative definite elements are directed. The defined coorientation of the train permits to define correctly the intersection index . A ( . ) :M A , of an arbitrary continuous curve A(t) in L @ ) , with endpoints outside of M A , , with the hypersurface M A , , If A(t) is smooth and transversally intersecting M A , in nonsingular points the index is defined in the usual way: every intersection point of h(i)adds +l or -1 into the value of the intersection index according to the direction of the vector %lt=;. respectively to the positive or negative side of MA,, At the same time, since the singularities of M A , are of codimension 3 in L@), not only the generic curves, but as well aa generic homotopies of such curves, do not intersect the singularities of Mhl. Thus with a small change of an arbitrarycontinuous curve with endpointsoutside of Mhl we
50
Agrachev and Gamkrelidze
can bring it into a transversal position with M A , , with the intersection index not depending on the perturbation. Furthermore, the intersection index is constant under an arbitrary homotopy which leaves the endpoints outside M A , . Let A ( t ) , t E S1, be a closed curve. Thenthe intersection index A(.) M A , does not depend on A l . Indeed, for VA' E L(C)there exists a P E Sp(C) such that A' = PAl. Since the definitions of a train and of the intersection index are invariant under symplectic transformations we have P M A , = M p h , , (PA(-)) M P A , = A(.) ' M A , . The group Sp(C) isarcwise connected, hence there exists a continuous curve Pt E Sp(E) such that PO = id, P1 = P. Taking into account the homotopic invariance of the intersection index we obtain
A(.) Mp,n, = (PCIA(*)) M A , = A(.) M A , . Definition. The intersection index A(.) M A , of a closed curve A(.) with M A , , which does not depend on A,, is called the Maslov index of the closed curve and is denoted Ind A(.). a
There is a close connection of the described intersection index with the Maslov index of the triples of Lagrangian subspaces. The latter definition permits to express explicitly the intersection index without bringing the curve into general position or solving nonlinear equations. If B segment of the curve A ( t ) for to 5 t 5 tl belongs to thecoordinate P ( A l ) , qt is the quadratic form corresponding to neighbourhood A$ A ( t ) , and to the subspace A1 corresponds the vanishing form, then it is easily shown that 1
(AI[to,tl1) "A,
= 5(sgnqtO- sgnqt,).
Since sgnqt = p(A0, A I , A ( t ) ) then 1
*MA,= Z(,4ho,Al,A(to)) - p(Ao,Al,A(tl))).
(AI[to,t1])
We can subdivide an arbitrary curve A ( t ) into segments A J[ti,ti+l~,to tl < ,.. < tl+l forwhich h(t) is transversal to some Ai E L(C) for
Symplectic Methods for Optimizationand Control
51
where the relation (12) is valid also in case A(ti) n A1 # 0, 1 5 i
5 1.
5. For a global study of C W R"* R, it is convenient to use a special complex structure C" on R,* CB R". Todo this we put z = iz,6 E W * , 2 E R,. The structure C" has a standard Hermitian form h ( z , ~=) C;=, z j d . The real part of h is a usual scalar product
+
n
(13)
(21
I z2) = C(S!Ei+ &), j=l
and the imaginary part coincides with the symplectic form 6.Thus
+
h ( z ,W ) = ( z I W ) io(%, W).
The unitary group UJ(C") preserves h, hence it preserves 6 ,and U(Cn) C Sp(Rn* CB R,) = Sp(C). We shall show that U ( P ) acts transitively on
LO=). It is enough to show that an arbitrary Lagrangian subspace A can be obtained by a unitary transformation from the real subspace A0 = ( E + io I E R"*}, Indeed, suppose el, . . ,e, is an orthonormal basis relative to the real scalar product. Since A is a Lagrangian subspace we have a ( e j , e h ) = 0, hence the basis is orthonormal also relative to theHermitian form h. Therefore the transformation which carries over the standardbasis of the arithmetic space C" into e l , . . . ,e, is unitary. Furthermore, the unitary transformation U : C" + C" is carrying over the real subspace A0 C C" into itself iff its matrix is real, in other words, when U belongs to the orthogonal group: O(R") C U(Cn). Thus the Lagrange Grassmannian is the homogeneous space
.
L(C)W U(C,)/O(R,). Using the representation we can obtain an embedding of L(C)into the space of complex symmetric n x n-matrices as a Lagrangian submanifold. We emphasize that the space of complex symmetric (not selfadjoint) m&
52
Gamkrelidze
Agrachev and
trices is considered. A symplectic structure on this space is given by the imaginary part of the Hermitian form
Bj' = Bj,
(B1,B2) c)tr(B1,&),
j = 1,2,
where T denotes the transposition of a matrix. The imbedding of
L(C) U(C!")/O(C") into the indicated space of matrices is given by the relation
UO(R")
c)
UUT,
U E U(C").
We compute now the fundamental group nl(L(E)). Since m(O(R")) = %,
.l(U(C")) = Z,
we have 7rl(U(Cn)/O(Rn)) = Z. The mapping UO(W") c) detU2 from LJ(C")/O(W") into S1 C C! induces an isomorphism of fundamental groups. Thus if with every closed curve A(t) = U(t)O(IW"),t E S1 from L(C)M U(C")/O(C!") we associate the degree of the mapping t I+ detU2(t) from S1 into S1we obtain an isomorphism of nl(L(C)) onto Z. There is a simple explicit formula for this isomorphism:
1
deg(det U(-)')= xi
1 tr S'
We have introduced in the previous no the Maalov index of a closed curve, IndA(.), which is a homotopy invariant and induces a homomorphism of the fundamental group xl(L(C)) into 2. It turns out that this homomorphism coincideswith the isomorphism (14).To prove this we can compute the Maslov index and the right-hand side of (14)for an arbitrary nontrivial curve. We omit this simple calculation. Thus we have 1
IndA(.) = xi
1 tr(U(t)U(t)-l) dt,
A ( t ) = U(t)O(R").
S'
We give now another integral formula for Maslov index which does not use the representation of L(E) as a homogeneous space.The expression A(t) E TA(~,L(C) is interpreted as the quadratic form A(t) : At e ia(it,At)AtE A(t) on A(t).,The restriction of the scalar product (13)on the subspace
Symplectic Methods for Optimization and Control
53
A(t) determines a representation of this form as
A(t)(X)= (Qh(t)X l X), where Q A ( ~ :) A(t)
X E Nt),
+ A(t) is a symmetric operator. We have 2
IndA(-)= lr
tr Qh(t)dt. S‘
Since the tangent space TAL(C)is identified with the space of linear symmetric operators Q : A + A a Riemannian structure is defined n
( Q 1 1 Q 2 ) e t r ( Q 1 9(2Q)I, Q ) = t r Q 2 = C a j ( Q ) ’ , j=1
where a1(Q), . . . , a n ( & ) are the eigenvalues of the linear operator Q : A + A. Let l(A(.)) be the length of the curve A(.). Then
Monotone nondecreasing curves in L(C)are characterized by the condition a j ( Q ~ ( ~2)0,) j = l , ,. . ,n. For nonnegative aj the inequality n
I
n
n
holds. Hence for a nondecreasing curve A(-) the inequalities
are obtained. 6, Concluding thus survey of the geometry of Lagrange Grassmannians we shall prove a multidimensional generalization of Sturm’s classical theorems about the zeros of the solutions of differential equations of second order,
Proposition 5. Let A(t), to 5 7 5 t l , be a continuous curve in L@), (not necessarily closed), and suppose that AI, A2 E.L(C)satisfy the rela-
Agrachev and Gamkrelidze
54
tions hi n A(t0) = Ai n A(t1) = 0 , i = 1,2. Then
In(-)MA, - A(*) MA?I5 n. *
Proof, Since A? isarcwise connected we can complement the curve h(.)to a closed curve joining A(t1) and A(to) by a curve A C A?. Then
a(.),
-
h(.) M A , = A(.) Mhl = Indx(.) MA? a
= h ( u ) . M ~+, A *M A , . At the same time
1 A * M A ,= 5(p(Al,Az,A(t1)) - p(Al,Az,A(to))). Hence IA MA?I 5 n. Note that we not only estimated the difference of intersection indices, but expressed this difference explicitly as a function of the endpoints of h ( * ) .
Corollary. If A(.) is a monotone curve, nondecreasing or nonincreasing, then the differencebetweenthenumbers of its intersection points with Mal and M A , is not greater then n. Indeed, every intersection point of a monotone curve with MA* gives an increment into the index of the same sign. Proposition 6. Let PT E Sp(C), 0 5 T 5 t , be a continuous curue in Sp(C), PO = id, andsuppose ho,Ab E L@). Put A(T) = P&, A’(T) = P&. Then for ‘#h1 E L(C)the inequality (14)
I N . ) M A , - A’(*) - Mhl l 5 n
holds. Proof. We join h0 and Ab with a continuous curve A and construct a curvilinear quadrangle The closed curve A(.) o PtA o h’(-)-1 o A-l, which is obtained by a successive passage of h(.),Pt A, 7 H h‘(t - T ) , and the reversed curve of A, is contractible. Indeed, the homotopy ( 0 , A ) H P(i-,qJ, 0 C [0,l],
Symplectic Methods for Optimization andControl
55
Fig. 3
A E L(C),contracts the considered closed curve onto the curve A o A-l. Hence
At the same time PtA M A , = A M p;1Al and hence, according to Proposition 5 , ( A M p , - l A , - A Mhl I 5 n. Remark. Suppose P, is an absolutely continuous curve. Then P, can be represented as a flow generated by a nonstationary linear Hamiltonian system in C:
a
“ P , z = &(P,Z), z E C, 87 where is a linear Hamiltonian field on C associated with the quadratic Hamiltonian Q,. If q, is nonnegative (nonpositive) then for VA E L(C)the curve r r-) PTAis monotone nondecreasing (nonincreasing), and the inter-
a
section index in (14) could be substituted by the number of the intersection points.
Theorem 1. Let qr, h, be quadratic nonstationary Hamiltonians on C , where h, 2 0, 0 5 r 5 t , and let PT, FT E Sp(C) be linear Hamiltonian flows on C , generated by the Hamiltonian fields 4 , q, 6,:
+
a
-P, 87
= &P,,
= (gr
+ &)F,,
-
Po = Po = id.
Agrachev and Gamkrelidze
56
Finally, let A ( T ) , X ( T ) be trajectories of the Corresponding flows o n L(C): A ( r ) = P,A(O),
X ( T ) = FrX(0), 0 5 T 5 t.
Then forVA1 E L , which is, transversal to the endpoints of the curves A(.), X(.),the inequality A(-) M A , - n 5
x(.) Mhl'
is valid. Proof. The variation formula, given in Introduction, implies that Ft = PrR,, where R, is a flow corresponding to thenonnegative nonstationary Hamiltonian r, : z I-+ h,(P,z),z E C. In other words,
8 " R ,= ?,R,, 8r
0 5r
5 t,
=id.
Consider the monotone nondecreasing curve A(T)= R,X(O) and the curve A'(T) = P,A(t), 0 5 T 5 t , in L(C).The identity p, e P,R, implies that the closed curve A(.) o A'(.) o @ - ) - l is contractible. Hence Ind(A o A' o
X-') = 0 , X
M A , = A M A , + A' MA,. m
At the same time, A - M A ,2 0, and,according to Proposition 6, A'sMA,1 A - Mhl - n.
5. The Index of the Second Variation and the Maslov Index 1. We shall consider l-cocycles on manifolds with half-integer values, and start with definitions. We call a real-valued l-cochain on the manifold M an arbitrary real function c defined on the set of 4 continuous curves on M subject to the condition
C(Y I [ t o , t , ] ) = C(Y I [ t o , t ] ) + 47 I[t,tl])
vt E (tO,,tl),
where y : [to,tl] + M is an arbitrary continuous curve on M . A l-cochain is a l-cocycle if for every 2 E M there exists a function d, : 0, + R, defined on a neighbourhood 0, of 2,such that C(?) = d , ( y ( t 1 )-) d, ( $ t o ) )
Symplectic Methods for Optimization and Control
57
for Vy : [to, tl] + 0,.Every l-cocycle vanishes on all singular cycles, homologous to zero, (in particular, on all contractible closed curves.) A l-cocycle is called ezact or cohomologous to zem if there exists a function d : M + B such that 47) = d(r(t1)) - d(y(t0))
forevery continuous curve y : [to,t13 + M., Evidently, exact cocycles vanish on every closed curve. Two cocycles are cohomologow if their difference is exact. Suppose ll E L(C). We define a cocycle Indn on L(C) such that Indn h(.) = A(.) Mn foreverycurve in L(C)with endpoints outside on Mn,in particular, Indn A ( - )= Indh(.) for every closed curve h(.).It is sufficient to define Indn on parts of the curve, which belong to some coordinate neighbourhoods. Let A ( , ) be an arbitrary continuous curve in L(C)and suppose that h(t)E Amfor to 5 t 5 tl, for some A E L(C).Put (1)
1 Indn(A I[to,tl1) = s ( p ( A , n ,A(to))- p ( A , n ,A(t1)).
We have to prove that the right-hand side of (1) does not depend on the choice of A. Using the chain rule (4.10) we obtain (2)
1 Indn(h I [ t 0 , t l ] )= ;Z(PP,WO),"tl))
- P(A,h(tO>,Ntl)).
Hence it is remained only to prove that p(A, A(to),h(t1)) does not depend on the choice of A. Let A(t) E AmnA'*, to 5 t 5 tl. The chain rule (4.10) and the equality (4.12) imply
Thus formulas (1)-(2) define a cocycle Indn on L(C)correctly. Formula (4.12) .implies that if the ends of the curve A(.) are outside of Mn then Indn h(.)coincides with the intersection index A(.) Mn.The cocycles Indn are cohomologous for different n E L(C).Indeed, the equality (2) implies that
Agrachev and Gamkrelidze
58
1
= -(P(nl,II12,A(tl)) 2
- P(nl,n2,qto)).
Let ( s , t ) c) A B ( t ) ,S E [0,l],t E [ C Z , , ~be ] a homotopy of continuous curves lII)do not depend on in L ( C ) , where dim(A,(cu) n n) and dim(A,(p) r 8 E [0, l].It is easy to show that in this case Indn A B ( - is ) also independent of S. 2. Vector bundle is called symplectic if every fibre carries a symplectic
structure continuously depending on the fibre. A subbundle of a vector bundle is calledLagrangian if its fibres are Lagrangian subspaces. Cocycles on a Lagrange Grassmannian, considered in the previous section, permit to assign to every pair of Lagrangian subbundles a “characteristic l-cocycle” in the base. We shall consider here the most important particular case of this procedure: we describe the Maslov cocycleof a Lagrangian immersion. Let C be a smooth manifold, dimC = dim M , and 0 : C + T * M be a Lagrangian immersion. For I E C we denote
C, = T@(,)(T*M),n, = % ( z ) ( q M ( * ( z ) ) M ) , A z = @ * ( W ) .
I ,is the tangent Then C, is a symplectic space, TI,, A, E L(&), where I space at $(I) to the fibre in T * M , and Az is the tangent space to @(C) at the same point. Let I(.) be a continuous curve in C, and [to,t~] is a segment in the domain of definition of the curve such that there exists a continuous family of Lagrangian subspaces At E C(X,(t)), to 5 t 5 tl, satisfying conditions (4)
At n nz(t) = At n A,(t) = 0,
vt E [to,h ] .
It is clear that for sufficiently small segments such families exist. Put (5)
1
m(4[to,t1])
= ~ ( P ( A t o , n z ( t o ) ! ~ , , o-) CL(Atl,~I,(tl),n,,tl,>>.
The expression ( 5 ) does not depend on the choice of the family At. Indeed, the symplectic group acts transitively on pairs of transversal Lagrangian
Symplectic Methods for Optimization and Control
59
subspaces, hence there exists a continuous family of symplectic mappings At : &(t) + & ( t o ) ) such that AtA,(t) = Az(o)l At&(t) = &(o)- Therefore, p(AtlJL(t),L(t))= cl(Ato,~,(t0),Ath,(t)). Hence the right-hand side of (5) coincides with Indn,,,,,(Ah, I[to,tll). Suppose that A: E is another family of Lagrangian subsp& ces satisfying conditions (4), and suppose A: : &(t) + C,(to) is a family of symplectic mappings such that A: A;,,, = Al,,,), A;II,(t) = ll,(o). Then Ai = PtAt, where P ( t ) E Sp(C,(o)), P(0) = id, P(t)lI,(o) = II,(o),
5 t 5 t l . Furthermore1 P ( A 3 - L ( t ) A ( t ) ) = cl(Ab,~,(o)lP(t)Ath,(t))l therefore, ifwe substitute in ( 5 ) the family At by the family Ai, we obtain for the corresponding index the expression Indn,(to,( P ( - ) A . A , to
I[to,tl~).
Put A"(t) = P(st)AtA,(t),S E [0,l],t E [to,tl].Since the transform& tion P ( T )preserves II,(o) V r the value of the expression dim(h"(t) n &,) does not depend on S. Hence Indn,(tl A"(.) also does not depend on S. In particular,
Thus the right-hand side of (5) does not depend on the choice of A, and hence defines a l-cocycle mip on C mip is called the Maslov cocycle of the Lagrangian immersion 9 : C + T " M . Consider the composition ~ ~ of the 0 immersion 9 9 with the canonical projection of T * M on M . The critical points of the mapping ?TM o 9 are those z E C for which h, n I f ,# 0. For a generic immersion the set
is a pseudomanifold of codimension 1 in C with a natural coorientation, cf. [5]. In this case the intersection index of the hypersurface (6) with an arbitrary curve in C, with endpoints outside of (6), is correctly defined. This index is called the Maslov-Arnold cocycle. The results of nO1imply that it coincides with mip, At the same time, the cocycle ma isalways defined - for every immersion and every continuous curve, and is compu-
Agrachev and Gamkrelidze
60
ted according to simple explicit formulas, which do not require either the general position considerations nor the location of intersection points.
S. We shall pass now from arbitrary Lagrangian immersions to manifolds of Lagrangian points described in $2. Let U, M be smooth manifolds, f : U + M be a smooth mapping and cp : U + W be a real-valued function. Suppose that F = (p,f) : U + W x M is a Morse mapping. Let C,,,be the manifold of (normed) normal Lagrangian points and fc : C,,,+ T*M be the corresponding Lagrangian immersion, cf. $2, n05. Furthermore, let (X,U) E W = (-1, X) E W 93 TicU,M.We remind that wF,h denotes the Hessian of the mapping F at the Lagrangian point (W, U). Thus wF,h is a real-valued quadratic form on the space ker F: = kerf:.
Theorem 1. Let ~ ( t=) (Xt,ut) E C,+,,t E [0, l] be anarbitrary continuous curve in Cj,,and wt = (-1, X,). Then (7)
sgn(w&)
- sgn(woF,h,) = 2qJc(T(*)).
In other words, the Maslovcocycle of the Lagrangian immersion f c : C,,,+ T*M is the coboundary of the function ( ) ( , U ) e sgn((-1, X)F,h) on Cj,,with half-integer values. Note that the right-hand side of (7) depends only on the dim M dimensional manifold of normal Lagrangian points, at the same time the left-hand side contains the signatures of quadratic forms, defined on spaces of dimensions not less than dim U - dim M . In the extrema1 problemsdimM represents the “number of relations”, dimU is the number of “variables”, and the quadratic form wF,h is the “second variation of the functional”. Usually the number of variables .is much greater than the number of relations, therefore Theorem 1 gives an effective method to compute the signature of the second variation. We considered the finite-dimensionalcase as,apreparation to the study of the .optimal control problem, cf. $3, in which U is substituted by the infinite-dimensional space of admissible controls. Therefore it is reasonable to rewrite the equation (7) in a form which is meaningful,at least,formally, in case of an infinite-dimensional U & well. We have to rewrite only the left-hand side of (7) since right side contains the Maslov cocycle of the
4
Symplectic Methods for Optimization and Control
61
Lagrangian immersion into T ' M , which arise in optimal control problems naturally, as it was shown in $3. Let q be a quadratic form ona linear space E.Positive (negative)index of inertia of q is given by the expression ind+ q = sup{dim E' I E' C E, q [E'
> 0), (ind- q = sup{dimE' I E' C E, q [ E ! < 0)), hence sgn q = ind+ q - ind- q. If E is infinite-dimensional, ker q is finitedimensional, then ind' q or ind' q is infinite and the expression for sgn q has no sense. At the same time, the left-hand side of (7)is meaningful if at least one of the indices ind+ q, ind- q is finite. Corollary. Under the conditions of Theorem 1 we have (8)
(inds(WIF,h,) + -1 dimkerWlF,h, - -21 corank fAl 2
- (ind+(WoF,h,) + 51 dim
l kerwoF,h,- 2 corank
fA0)
= rnf.
( ~ ( e ) ) .
Returning to the optimal control problem of 53 we suppose that theHamiltonian (3.3) is smooth and satisfies to the conditions of Proposition 3.2 for CO = TioM.The Lagrangian immersion in Proposition 3.2
( t ,X)
C)
p ( t , X),
t > 0,
X E to nH-~(o)
substitutes in this case the immersion fc. Let X0 E COn H-l(O). If we put ~ ( 7 = ) (T,XO), 7 > 0, then the equality (8) turns into a direct generalization of the classical Morse formula stating that the increment of the inertia index of the second variation of a regular integral functional along an extremal equals to the sum of multiplicities of conjugate points of the Jacobi equation. Indeed, the curve X, = p(7,Xo) is a Pontryagin extremal. The solutions of the Jacobi equation along this extremal are the curves < =,( & p ( ~ X)IA-Ao)<~, , < E, TA,(T*M).The time-instant t > 0 is conjugate to zero forthe Jacobi equation, if there exists a nonzero solution t7.of the equation satisfying conditions Hio& = 0, TM,
62
Gamkrelidze
Agrachev and
solutions. Employing notations of n02 for the considered Lagrangian immersion we obtain that the multiplicity of a conjugate point t is equal to dim(A,(t) n This is equal tothe contribution of the point y ( t ) into the intersection index of the curve y(.) with the hypersurface ((774 E
h.x .CO I H ( P ( T , X))
= 0, A(,,A)
n rI(,,X) # 01,
in case when the intersection point is isolated and the intersection has the positive sign. In the regular case of a variational problem the intersection points, i.e. the conjugate points of the Jacobi equation, areindeed isolated, but intersections take negative sign ifwe adopt the orientations of this paper. Hence the sum of multiplicities of the conjugate points is equal -m,y(.). In more general cases the conjugate points are not necessarily isolated, but the explicit formulas for the Maslovcocyclegivenin this section permit to ignore this phenomenon. In addition, the Maslov index can be computed along any curve, and not necessarily along extremals. Concluding this section we note that if the index of the second variation is infinite, formula (8) read from right to left, defines the “increment of the index along a curve”, which turns out tobe quite useful for developing of:the analogs of the Morse theory for the indefinite functionals. . ,
6. Bang-Bang Extremals
1. We return to the Optimal Control problem of 53 and consider the case when the Maximum principle generates a nonsmooth Hamiltonian. The problem of description of (possibly nonsmooth) Lagrangian submanifolds contained in the level sets of such Hamiltonians should play a central role for the optimal synthesis. Here will be given some preliminary results in this direction, more detailed results will be published elsewhere. We start with bang-bang controls. Let V(r) = vi, ~ i - 1 < T < ri, i = 1,. . . , l , where 0 = TO < TI < . . . < 71, V(r) = v1+1 for r > 71. Suppose g(z0, VO) # 0 and let Z(T) = z ( T ; ~ ( . )be) a trajectory of (3.1) corresponding to the control V(.). Suppose E Ti(,)M,0 5 T 5 tl, A, # for T # T ‘ , is a normal Pontryagin extremal, corresponding to
x+,
xT
Symplectic Methods for Control Optimization and
63
the control C(.). Thus i T , O 5 T 5 t l , is a trajectory of the Hamiltonian system in T * M defined by the Hamiltonian
Furthermore, 0 = hT(x7)= H&),
0 5T
5 tl,
where, according to (3.3), we have
~ ( 5= ~max(iTg(Z(T),u) ) - go(Z(T),u)). UEV Since the control C(-)is piece-wiseconstant the Hamiltonian h,(X) depends . on T alsopiece-wise constantly: hT(X)= hi(A), 76-1 < 7 < ~ i Denote 8 = (e', , , .,e l ) , where gi are real numbers, eo = 0. If the vector 8 is sufficientlyclose to T = (71,. , . ,n) then the control
is well defined. The control ve(-)defines a Hamiltonian
h!(X) = hi(X) for
t < ei, i = 1, .. . ,l.
In particular, ht(X) = h: (A). Put
The mapping F is a Lipschitz mapping. Furthermore, it is smooth in the region
v q t , e ) l t # e i , ea-1 <ei, i = 1 , . . . , l ) . Proposition 1. Let ( t ,8 ) E V ,t E (&-l,&),A t E T;(,,,$V. Then (X!, t , 8 ) E Cf,cpif hj(X&)= 0 , j = 1 , . . . ,i, where T I+ X$ is a trajectory of the Hamiltonian system defined by the Hamiltonian h!,
Agrachev and Gamkrelidze
64
Proposition 2. Let t E (ri,Ti+l). The restriction of the mapping F to some neighbourhood of the point ( t , T ) is .a Morse mapping if
.
{hj+l,hj}(X,) # 0, j = 1,. . ,i. Propositions 1,2 together with the Proposition 2.5 imply the following Theorem 1. suppose that H(X)= m={hi(X)
I i = 1, . . , l }
xr,
for all X E T * M suficiently close to the points of the curve 0 5 r 5 ti. Let, furthermore, hj(&) < 0 for ~ i - 1 < r < ~ i j, # i; hj(1,) < 0 for j # i , i + 1, and {hi+l, hi}(iri)# 0, i = 1,. , l . Then the% exists a neighbourhood of 10 5 T 5 t l } in T * M such that the set
{xr
(1)
..
{X,“ E 0 I H(X:) = 0, 0 5 7 5 t }
is a Lagrangiansubmanifold in T * M . (We supposehere, as well as in Proposition 1, that &X$ = @(X:).) According to Theorem 3.1 the trajectory Z(r),r E [0,t]is locally optimal if the submanifold (1) is “well-projected” onto M. To construct the manifold (1)is muchharder than toproof its existence. Neither is it simple to investigate how it is projected onto M . In case of a smooth Lagrangian submanifold one can avoid these difficulties by the following assertion:
‘If the Maslov cocycle vanishes on every part of a given curve then some neighbourhood of this curve is well projected onto M . At the same time, to compute the value of the Maslov cocycle it is sufficient to know the tangent spaces to the Lagrangian submanifold only at several points of the curve. Since the Lagrangian submanifold (1) is a Lipschitz manifold, (not everywhere smooth,) hence the Maslov cocycle is not defined on an arbitrary curve as the tangent spaces does not exist at every point of the curve. Nevertheless, it turns out that thecorresponding function with half-integer values can be defined in a natural way, at least for the extremals X.: In accordance with the results of $5 the doubled value of this function on the extremal X$, r E [to,tl],coincides with the diffe-
Symplectic Methods forControl Optimization and
65
rence of the signatures of the Hessians of the mapping F in the Lagrangian points Al! , (tl ,e) and ,X,! (to,0). 2. We shall need a modification of the Maslov index of a triple of
Lagrangian subspaces. Suppose Ai E L@), i = 0,1,2. Put (2)
1 indA,(h, h ) = ~ ( P ( A Oh , , A d
- dim(A1 n h ) + n),
where dimC = 2n. According to the definition indA, (AI, ha) is a symplectic invariant of the triple of Lagrangian subspaces with half-integer values.One can show, cf. [2], 53, that the invariant (2) is nonnegative and satisfies the triangle inequality: indA,(hl,Aa)
I i n d ~ ~ ( A l , A+ind~,,(A,,A,) 2)
VAi E L(C),i = 0,1,2,3.
A continuous curve A(T) E L @ ) , to I t l , is called simple if 3A such that A(T)n A = 0 VT E [to,t l ] .
E
L(C)
Proposition 3 ([2], 53). I f h ( ~ )T ,E [to,tl],is a simple nondecreasing curve in L(C)and ll E L @ ) , then Indn(A(*))= indII(h(to),4 ) ) . In particular, the value of the cocycle Indn on the simple nondecreasing curve depends only on II and the endpoints of the curve, cf. the expression (5.1) valid for an arbitrary simple curve. Now under the assumptions of Theorem 1 suppose that X! belongs to the manifold (1).If, in addition, (t,e) E D then the manifold (1) is smooth near the point A$ Let A! C TA:(T*M)be the tangent space to the manifold (1) at X!. These spaces can be described more explicitly. Let P: E Symp(T*M), T 1 0 be a piecewise smooth curvein Symp(T*M), which is smooth on the intervals (di-l,ei), i = 1,. . , l , (01, +W) and defined by conditions
.
Agrachev and Gamkrelidze
66
The subspaces A! are uniquely determined by the conditions e
A-0
= I~A;
(4)
where I I A = spaces given in (4) can be considered as a linearization of the method of characteristics described in Proposition 3.2. Note that P,*IIA= I I I ~ , ( A ) "7,X. Hence the Mwlov cocycle vanishes on the curves Ase l(e,,ei+l), i.e. rn(Ame[(ei,ei+L)) = 0, i'= 0,1,. . .. Define
m(ASe I [ t 0 , t l ) )=
(5)
c
indn,& (A!i-o,A;i+o),
Vt0,tl.
togi
In other words, to find the value of m on the curve 7 c) A! we must first paste the discontinuities of the curve of tangent spaces r ++ A$ with simple nondecreasing curves in Lagrange Grassmannians and then compute the Maslov cocycle in the usual way. Proposition 4. Let A t be contained in the manifold (l),and suppose l3 n A t o = 0. ( W e use here and in the sequel the abbreviated notation Il = ISx!). Then Hessian of F at the Lagrangian point A!, (t,O), is nondegenerate and its positive index of inertia is computed according to the formula
where
W
= (-I.,X!).
Corollary. Undertheassumptions of Proposition 4 and p&tided rn(h.' Ip,t)) > thecontrol ve isnot locally optimal.
Since dim(A;,-o r lA:,+o) = n - 1 every summand in the right side of (2) is 0, or or 1. At the same time indn(A;i-o,A$$+o) = iff dim(n n # dim(Il fl AZG+o).Note also that
4,
dim(A: n Il)2 n - i
for Oi-l
< 7 < Oi,
Symplectic Methods for Optimization and Control
67
and for a local injectivity of the mapping X c) n(X)of the manifold (1)into M at the point X! it is necessary that he f l ll = 0. Thus local injectivity the mapping X c) n(X), can hold only in case t > B n - l . For t 5 though not locally injective, is still "good" (in the sense of Theorem 3.1) near the point X!, if the intersection A!+, n ll has the minimal possible dimension.
Theorem 2. Suppose that under the assumptions of Theorem 1 and for every ri 5 t the relations indn (A:< -o, A:i +o) =
{ 0,
51 , O 5 i l n - l ,
izn,
hold, then there exists a neighbourhood C of the curve (1) satisfying the conditions of Theorem 3.1.
x)[O,t~ in the manifold
Remark. It is easy to show that under the condition A;-o n l 3= AT,, n IT = 0 the local injectivity of the mapping X c) .(X) of .the Lagrangian manifold (1) into M near the point & is equivalent to the equality indn(&, AT+o) = 0, Typical locations of the trajectories z(., ve) = n(Xe) for different values of indn(AT-o,A;+o) are represented on the figure.
ind 0
ind=1
Fig. 1 Standard topological considerations lead to thefollowing global version of Theorem 2. Suppose W is a closed subset in
{ ( t , e ) a +x ~ ! ~ e ~ - , < ei ~=,l , ...,I, eo=o),
Gamkrelidze
68
where ( t , e )E W
=$
Agrachev and
( ~ ~ E0W) VT E [O,t],and put
To every X f E Cw we assign a Lagrangian subspace At in T p ( T * M ) defined by the relations (3), (4). Theorem 3. Suppose for every X! E LW,t9i 5 t the following relations hold:
If C is arcwise connectedand .(LW) is simplyconnected then there exists a Lagrangian submanifold C 3 &W in T'M satisfying the conditions of Theorem 3.1.
7. Jacobi Curves 1. The results of $6 can be applied, first of all, to the case when the
I
set V of control parameters is finite. In this case the sets of admissible velocities g(z, V ) are also finite, and hence the optimal control problem is badly formulated: the set of admissible trajectories is not closed in the uniform metric, (except the trivial case when g(z,V) is a single point), though V is.compact. As is well knownthe natural completion (relaxation) of the initial system is the system with the sets of admissible controls convg(z, V ) ,z E M . All Pontryagin extremals are preserved under the relaxation, but new ones appear, the so-called singular extremals. After evident changes innotations the relaxed problem takes the form
Symplectic Methodsfor Optimization and Control
69
The functional
5c t ,r
d t , 4'))=
(2)
dT
d(T)&2(7))
0 j=O
is minimized on the level set of the mapping f : (t,v(-)) I+ z(t,v(.)).Here v(') = ( v o ( ~ ) , v l ( ~ ).,..,vr(-)) is an admissible control. The space of all admissible controls, i.e. of measurable vector-functions on R+with values in
Ar = {(vo,.
. . , v r ) l d 20,
= l},
j=O
denote by V . Every problem with right-hand side affinein controls and with a convex polyhedron as the set of control parameters can be represented (l),(2). 0 5 T 5 t l , be a normal Pontryagin extremal for the problem Let (l),(2), corresponding to an admissible control V(*) = ( V " ( , ) , ,TT(.)). Then 1, is a trajectory of the nonstationary Hamiltonian system generated by the Hamiltonian
x,,
. ..
r
&(A)
-
= c d ( T ) ( x g j ( T ( x ) ) g!(T(x))),
x E T'M.
j=O
Additionally, we have "
0 = h,(&) = H p T ) ,
0
5 7 5t,
where H ( A ) = m a z o < j < v ( X g j ( T ( X ) ) - $(.(X))). The mapping'@: JRk -+ V is called a smooth famil9 of variations of the control g(-)if there exist smooth mappings
A :J P -+ L'(&; A'), a:
+L~(R+;&), .
A(0) = V(.), a(O)(t)= 1 (t E [ O , t , ] ) ,
such that O ( z ) ( t ) = A ( z ) ( $a ( ~d )~ )Vz , E Rk,t 1 0, The dimension of the family k can be arbitrary.If 0 is a smooth family of variations of V(.) then x ( t l ) ,( t l , 0) is a normal Lagrange point of the mapping
F@ : (t,z) I+ (v@, @(z>),f ( 4 @(z)>),
t
> 0, z E JRk.
Agrachev and Gamkrelidze
70
x,,
Definition. Positive index of an extremal T E [0, t l ] ,is called the supremum of the positive indices of inertia of Hessians of the mappings F+ at theLagrange point x(t,), ( t l ,0), aver all smooth families @ of variations of the control F(.).
x.
The positive index of the extremal 1 , is denoted by ind+ It is a nolinegative integer or +m. 0 5 T 4 t l . Denote by @(V) the set of all Let Z(T) = z ( T ; V ( - ) )= Pontryagin extremals X, satisfying the relation (X.), = E ( T ) , T E [O,tl]. Then @(F) is a convex closed subset of dimension not greater than n in the space of sections of the bundle T * M ( q . ) .
..(x,),
Proposition 1. Suppose V(.) is locally optimal control in the L1-norm . = then ind+x'= of the problem (l), (2) on the segment [0,t ~ ]#*(F) 0; if @(F) is compact and dim @(F) = m > 0 , then there exists a X E @(V) such that ind+ X, 5 m - 1.
{x,}
Remark. If dim@(F)> 1 then there exist deeper conditions of optimality which take into account the dependence of ind+ X. from X, E @(V), cf. [2]. , e
2. According to a procedure already tested, the index of the extremal should be computed through the Maslov index or its corresponding generalization for the case of a possibly nonsmooth Lagrangian submanifold, which contains and is contained in HV1(0).All we need to know about the Lagrangian submanifold to compute the index is the knowledge of its tangent spaces at thepoints For the particular case of bang-bwg controls the corresponding computations were done in 56,n02. Note that for tangent Lagrangian spaces were dependent explicit formulas (6.1), (6.2) only on linearizations of Hamiltonian flows corresponding to Hamiltonians h, along the extremal. Furthermore, these formulas correctly define a family in T of Lagrangian subspaces, independently from the existence of the appropriate Lagrangian submanifold: we remind that the existence of a Lagrangian submanifold was proved under sufficiently strong conditions of regularity. We can not guarantee that an arbitrary (not necessarily a bang-bang)' extremal is contained in an appropriate Lagrangian subma-
x.
x.
x,.
x
Symplectic Methods.for Optimization and Control
71
nifold in H-' (0). But it turns out thatif ind+ 5; < +W then there exists a corresponding family of Lagrangian subspaces KT c Tx7( P M ) "tangent" to H-'(O). Construction of these subspaces and an explicit expression for ind+ 3. generalize formulas (6.3)-(6.6). Let Pt E Symp(T*M),0 5 t 5 t l , be a Hamiltonian flow defined by a nonstationary Hamiltonian E t , PO = id. Instead of constructing the Lagrangian Subspaces Et directly, we shall describe subspaces At = PG1& contained in the fixed Lagrange Grassmannian L(TA,(T*M))for Vt E [0,t l ] .Denote
- go(.(X)),
hj(X) = Agj(.(A))
X E T * M , j = 0,1,. . ., T ,
-rt = span{&(&) Ivj(t) > 0, o 5 j
5 7);
The subspace Tt is contained in Txt( T * M ) ,0 5 t 5 t l . Let 7 C [0, t l ] be the set of density points of the measurable vectorfunction 5 ( ~on ) the interval (0, t l ) , hence the set [0, t 1 ] / 7is of measure zero. Proposition 2. If ind'x, Tit( T * M )for Vt E 7 .
< +COthenisanisotropicsubspace
in
From here on we suppose that rt, t E 7 are isotropic subspaces; Put rt = P;'f;t C Tx,(T*M).Since the transformations Pt. are symplectic rt is isotropic for Vt E 7 . h r t h e r developments will take place in a fixed symplectic space C = Ti, ( T * M ) .Among the Lagrange subspaces of C a special role is plaid by the tangent spaces to the fiver at the.point TO.We shall denote it by I'I = Ti,(T&M). Let A be a Lagrange subspace, l? an isotropic subspace in C. Put
hr=(A+r)nrL=hnrL+r. It is easily seen that Ar is a Lagrange subspace in C, and the mapping A H Ar is a projection of L ( C ) on the submanifold in L ( C ) consisting of all Lagrange subspaces containing. l?. The mapping A c) Ar is discontinuous on L@), butits restriction onevery submanifold of the form {A E L ( C ) 1 dim(h n I') = const} i s smooth. '
Gamkrelidze
72
Agrachev and
We go now to the construction of Lagrangian subspaces At, We shall describe the curve t I+ At in L(C)using special piecewise-constant approximations of the curve. Let D = {TI,.. .t Q} C 7, where 7 1 < . , < T k , Tk+1 = tl. Define a piecewise-constant curveA@),, 0 5 t 5 tl, in L(C)
.
bY
and put
It is easily seenthat 0 5 r ( D ) 5 $. The expression (3) coincides with Indn of a continuous curvein L(C),which isobtained by successively connecting the values of A ( D ) .with simple nondecreaaing curves, cf.Proposition 6.3. Denote by D the directed set of finite subsets of 7 with inclusions of subsets as the partial order. Theorem 1. The following relations hold: (1)
(2)
Indn A(D1) - .(Dl) 5 Indn A(D2).- r ( D z ) , VD1 C D2 E ind+X, = supD,,(Indn A ( D ) .- r(d)).
'D.
Theorem 2. Suppose that ind+ X. < +m. Then (1) (2)
(3)
For V t E [0,tl] the limit D-limA(D)t = At existe. The curve t c) At in L(C) has at most denumerableset of points of discontinuity and for every t E (0,t ~(t] E [0,t l ) ) the limits lirn,+t-o A,, (lim,+t+o AT) e&t. The curve A. is differentiablealmosteverywhere on [O,tl], and at every point of differentiability 9 2 0. I
.
.Definition. Suppose ind+X, -c +m. The curve At in L@), which exists..accordingt o Theorem ?) is called a Jacobi curve corresponding to the extrema1
x,,
Symplectic Methods Control Optimization andfor
73
It follows from Theorem 2 that a Jacobi curve has properties similar to those of a monotone real-valued function. We already have dealt with smooth monotone curves on L@). Using the properties of the invariant (6.2), it is possible to describe a wider class of curves for which a theory could be developed verysimilar to thatof monotone real-valued functions, For example, the assertion (1) of Theorem 2 is based on a "Lagrange" analogue of compactness principle of Helly. Basic facts of this method are briefly described in [4]. We call At a Jacobi curve since it generalizes solutions of the Jacobi equation of the classical calculus of variations. Under sufficiently weak assumptions of regularity every Jacobi curve turns out to be piecewise smooth and on the intervals of differentiability it satisfies the differential equation for which the right-hand side can be explicitly expressed through I't , cf. [2], [3]. Put Kt = Pt*ht. If V(.) is a bang-bang control, i.e. if O(T) E we(7) for some 8, cf. $6, we obtain E A!. 3. All our basic constructions until now were invariant under smooth coordinate transformations in M . As a final theme we shall discuss the action on Jacobi curves of another important class of transformations of Control systems, the so-called feedback transformations. We remind the basic definition. If the inequalities w j 2 0 are omitted in (1)we come to the system T
(4)
X =C
T
dgj(x),
j=O
C W= ~ 19.
X(O) =EO,
j=O
for which the admissible velocities form affine subspaces. Let b i j ( s ) , E E M , i, j = 0,1,. . , ,T , be smooth functions on M , where CLob+j(z) E 1, j = 0,1,. . , , T , and the (1 + r ) x (1 r)-matrix b ( x ) = ( b i j ( z ) ) T , j is nondegenerate for tlx E M . Put w j = C"3 -0 b i j u j , j = 0,1, . . ,r , where the uj are considered as new control parameters, we come to the system
+
I
c
The system ( 5 ) is said to be obtainedfrom (4) by feedbacktransformation. It is clear that the admissible trajectories of systems (4) and ( 5 ) coincide, so that they are equivalent indeed. After the feedback transformation the
Agrachev and Gamkrelidze
74
functional (2) takes the form
It is easily seen that every (normal) Pontryagin extremal of the problem (4),(2) is a (normal) Pontryagin extremal of the problem (5), (6) and conversely. Let 0 5 t 5 t l , be a normal Pontryagin extremal, E(t) = n(1t). Then h j ( x t ) = hj"(&)= 0 , 0 5 t 5 t l , j = O , l , . . . , T , where hj(X) = Xgj(.rr(X)) - gO(.rr(A)),h$(X) = bijhi(X). An elementary calculation shows that K$(&) = CLobij(Z(t))hi(X). Put
x,,
-
"
r, = span{hj(Xt) 1 j
= 0,.
. .,T } = ~pm{Z;(&) I j
= 0,.
..
,TI.
We suppose that, as in n02, Ft is an isotropic subspace in T J ~ ( T * Mi.e. ), {h&}(&) = 0, 2,j = 0, * . * , T , t E [O,tl]. Suppose r
T
r
U "z = p ( t ) g j ( E )= C E j ( t )&(E)g@),
dt
j=O
j=O
j=O
and put Et = c i = o V j ( t ) h j , = C j ' = o ~ j ( t ) hLet ; , Pt,P," E Symp(T*M), t 5 t l , be Hamiltonian flows generated by nonstationary Hamiltonians -0ht5and 4 h,, PO = P: = id, and supposet'I = PG'Tt, I ' != (P,")r1Ttare isotropic subspaces in Tx,(T*M)= E,0 5 t 5 t l . Applying to the families of isotropic subspaces the same procedure as in n02 we can correspond to every finite subset D C (0, t l ) locally-constant curves A ( D ) t and A(D),bin L@). It is every probable that the following assertion holds:
If At = D-limA(D)t exists for eve4.y t E [0,t] then A! = D-limA(D),b also exists for W E [0,t ] ,and
P,*& = P&Ai, i.e. the curve
if,e' Pt.:&
t E [0,t i ] ,
is preserved by the feedback tmnsfomation.
We cannot prove the assertion in the formulated generality, but un-
Symplectic Methods for Optimization and Control
75
der some additional assumptions of regularity it is possible not only to prove the assertion, but also represent At as a solution of an explicitly written linear Hamiltonian system. We shall give here the corresponding calculations under sufficiently strong conditions of regularity.
-
Put hjt = hj o Pt, ht = ht o Pt. Then
+
Finally, let h; = hjt = { ht ,hjt }, Consider the family of (r 1) x ( r+ 1)t E [O,tl],where matrices A(t) = Ilaij(t)(J,
6
Differentiating with respect to t of the identity {hi, hj}(xt) = 0 gives the relations aaj(t) = aji(t), V i , j , A(t)T(t) 0. Hence thematrix A(t) is symmetric and of rank not greater than r. We call an extremal x t nondegenerate if rank A ( t ) = r , 0 5 t 5 t l . It is easily seen that the property of an extremal to be nondegenerate is preserved under the feedback transformations. Proposition 3.If the extremalxt is nondegenerate thenfor Qt E [0,t l ] the limit At = D-limA(D)t exists, wherethecurve t H At in L(E) is Lipschitz on the half-interval(0,t l ] ,and the curve & = Pt*At is preserved under the feedback transformations.
We call the curve At the Jacobi curve associated with the nondegenerate extremal 'T;t of the problem (4),(2). To find the Hamiltonian -system whichis satisfied by the Jacobi curve At we remark that since At is nondegenerate the kernel of the symmetric matrix A ( t ) coincides with the straight line in R'+' through the vector V(t).Hence a symmetric (T 1) x (r+ 1)-matrix d ( t ) = Ilaij(t)ll exists which satisfies the condition (d(t)A(t)w- W ) E E ( t )for Vw E R'+1.
+
Let, as above, ll = Tx,(T&M) be a Lagrangian submanifold in the symplectic space C = Tx,(T*M) with the symplectic form 6.
76 Gamkrelidze
and
Agrachev
Proposition 4. Under the assumptions of Proposition 3 we have
o
},
ZoEnrO
t E (O,tl], A0 = 17. I n other words, At = Q t I I r O , where Qt E Sp(C) is a linear Hamiltonian flow in C corresponding to the quadratic nonstationary Hamiltonian qT(Z)
C .ij(T)(dhz)Z(dhyT)Z,
l T
=5
Q0
= id.
i,j=O
Let A! be a Jacobi curve associated with the same extremal It for the problem ( 5 ) , (6), which is obtained from the problem (4), (2) by the feedback transformation. Proposition 3 implies that P !& = P&, 0 t 5 t1. Thus At = (P;’ o P,”),,A,”. Observe that (P;’oP,”),, is a symplectic transformation of C which preserves II for V t E [0,tl].Therefore the following Corollary holds.
<
Corollary. Let It be a nondegeneratePontryaginextremal and At, 0 t 5 t l , be the associated Jacobi curve. The expressions Indn(Al[r,tl), 0 < T < t < t l , are invariants of feedback transformations, as well as of
<
arbitrary smooth variable substitutions in M .
REFERENCES
[l] R.Abraham and J. Marsden, Foundations of Mechanics, 2-nd Ed., The Benjamin/Cummings Publ. Comp., London, 1978. [2] A. A. Agrachev, Quadraticmappings in geometric control theory, Itogi Nauki, Problemy Geometrii 20 (1988),VINITI, Moscow, 111205; English translation in J. Soviet Math. 51,no. 6 (1990).
Control Optimization and Symplectic for Methods
77
A. A. Agrachev and R. V. Gamkrelidze, The Morse index and the Maslov index for the extremalsof control systems, Dokl. A M . Nauk SSSR 287 (1986), 521-524; English translation in Soviet Math. Dokl., 33 (1986). A. A, Agrachev and R. V. Gamkrelidze, Symplectic geometry and necessary conditions for optimality,Matem. Sbornik 182 (1991), 3654; English translation in Math. USSR Sbornik 72 (1992). V. I. Arnold, Characteristic class entering in conditions of quantization, F'unkcjonal. Anal. i Prilozen. 1 (1967), 1-14; English translation in Functional Anal. Appl. 1 (1967). V. I. Arnold, Mathematical methods of classical mechanics, Springer, New York, 1978. V. I. Arnold, S t u r n ' s theorem and Symplectic geometry, F'unkcional. Anal. i Prilozen. 19 (1985), 1-14; English translation in Functional Anal. Appl. 19 (1985). V. I. Arnold and A. B. Givental, Symplectic geometry, Itogi Nauki, Sovr. probl. matem., Fundamentalnye napravleniya 4 (1985),VINITI, Moscow, 5-139; English translation in Encyclopaedia of Math. Scien., vol. 4, Springer. R. V. Gamkrelidze, Pt-incipples of optimal control,Plenum Press,New York, 1978. V. Guillemin and S.Sternberg, Geometric asymptotics, Amer. Math. Soc., Providence, R.I., 1977. G. Lion and M. Vergne, The Weil representation, Maslov index and theta series, Birkhauser, Boston, Mass., 1980. H. Sussmann, Ed., Nonlinearcontrollabilityandoptimalcontrol, Marcel Dekker, New York, 1990. A. Weinstein, Lectures on symplectic manifolds, Amer. Math. Soc., Providence, R.I., 1977. M. I. Zelikin and V. F.Borisov, Optimal synthesis containing chattering arcs and singular arcs of the second order, in Nonlinear Synthesis. Proc. IIASA Workshop, Sopron, Hungary, June 1989 (1991), Birkhauser, Boston, Mass..
2 Singular Trajectories, Feedback Equivalence and the Time Optimal Control Problem B. Bonnard Universit6 de Bourgogne, Laboratoire de Topologie - CNRS UMR 5584, 9, Avenue Alain Savary - B.P. 400, 21011 Dijon Cedex, France
Abstract. In this article we recall the equivalence between the feedback classification and the time optimal control problem, for affine control systems. Using examples we show how this identification is useful in computing feedback invariants, Conversely, one can use the action of the feedback group to analyze the time optimal control problem, for instance constructing normal forms to evaluate the accessibility set in a neighborhood of a reference trajectory.
1. Introduction Let X,Y1,. . . ,Y, be analytic vector fields on Rn,we consider systems of the form
dx
(1)
= X(x(t)) + Y(x(t))u(t) dt Rm, Y = (Y1,. . . ,Y,), they are
where x E R", U E called @ne. Let (X, and (X', Y) beY') two affinesystems These systems are called feedback equivalent if there exists a C" diffeomorphism cp of R" and a feedback U = .(x) + @(x)u', where Q! E Cc.(Rn,Rn), p E Cu(Rn,GL(rn,R)) such 79
Bonnanl
80
that
(9
x'= cp*x+ cp*Y.a,
(ii)
Y' = (p*y.p,
where cp acts ona vector field Z according to the rule,p*Z = dcp-l(Z 09). This action defines a group stucture on' the set of triplets ((p,a,p ) and this group, called the (affine) feedback group, is denoted by G). The set Am of affine m-inputs systems, endowed with the G) action, defines a geometry whose understanding is a key problem in system theory.For instance the controllability and the stabilizability properties are invariant properties. It is a generalization of the well-understood problem of classification of linear systems with respect to linear changes of coordinates and linear feedback [6]. Also it can be extended to analyze more general = f(z,U ) , localized around an equilibrium control systems of the form point or a reference trajectory, but in this article everything will be kept at the heuristic level. The first objective of this article is to relate the feedback classification problem with a classification problem of a family of constrained Hamiltonian vector fields.Let us briefly explain how. Assumethat (1)is initialized be the trajectory corresponding to a bounded by z(0) = zo and let zu(.) measurable input U ( . ) . Endow the set of inputs with the L"-norm topology and consider the input/state mapping U ( . ) + z(.,u).This mapping has singularities which are called singular trajectories. One can show that they are parametrized by the Maximum Principle (in brief PMP),applied to the time optimal control problem of system (l),as follows, Introduce the hamiltonian H , definedby H ( z , p , u ) = ( p , X ( z ) Y ( s ) u ) ,where p EJ P \ IO}, U E Rm and ( , ) denotes the standard inner product. The singular trajectories are the projection on the z-space of the solutions of the constrained Hamiltonian equation
+
where E1 is the surface { ( x , p ) ;(@, Y (z)) = 0). This equation encodes two objects, the surface E1 and the solutions that stay in El,One can prove
Singular Trqjectories Time the and Optimal Control Problem
81
that they are the solutions of a vector field 2 defined on a maximal subset C1 of Cl. Moreover one can show that a singularity of the input/state mapping is feedback invariant. Now, let us define the action of G; on (2) as follows: (p,a,P) E G; acts on (Cl,2) as the symplectic diffeomorphism p' given by z = p(g) and p = q( where p , q are row vectors. Now, in [4] we prove that under mild assumptions, two systems (1) are feedback equivalent if and only if if their associated equations (2) are G; equivalent.
S),
The objective of this article is to indicate how to apply this connection. It is organized as follows. In Section 2, we recall some well-known results concerning singular trajectories. In Section 3, we present the results from [5]. Using the action of the feedback group, we compute semi-normal forms in a neighborhood of a given singular trajectory. This allows to evaluate the accessibility set and toanalyze the optimality problem. In particular, it will clarify the problem of computing conjugate points in the time optimal control problem. Conversely, in Section 4,feedback invariants are computed and geometrically interpreted as invariants of the time optimal control problem. We shall indicate how to proceed for systems in small dimensions because to write a complete dictionary is an inextricable problem. Ourworkis related to similar efforts in understanding (locally) the feedback equivalence problem. In particular, we must point out the following contributions. Earliest works deal with the problem of classifying distributions: Darboux [12], Gardner [g]. This problem is also connected to sub-Riemannian geometry. Singularity theory was used by Jakubczyk in [l31 to study the feedback classification problem. See also the contribution from Respondek [l91 to this volume. Elie Cartan's moving frame and equivalence method was applied by Gardner and Shadwick in several publications to classify systems, see for instance [lo]. A variant ofthis approach was developped by I. Kupka in [15]. The connection between the feedback classification problem and the time optimal control problem was exploited by Jakubczyk in [l41 to compute feedback invariants. This approach is close to our point of view, although it is exploited for a different class of systems for understanding the (local) problem.
Bonnard
82
2. Preliminaries
2.1. Definitions. Consider a system on Rn of the form
where U(.) is a bounded measurable map from an interval [O,T] into R"' and f is an analytic mapping from R" x Rm into Rn. Let zo E Rn,and denote by z(t,2 0 ,U ) (briefly z ( t ) )the solution of (3) corresponding to U ( . ) such that z(0) = 50. Fix zo E Rn,T > 0 and let U( ,) be a control defined on [O,T] such that x(.,Q, U ) is defined on the whole interval [O,T]. Let us endow the set of controls defined on [O,T] with the Loo-norm i.e., [ U [ = SUP,,[,,,^ Iu(t)l. Let EXOlT denote the input/state mapping defined so,W). The control U and the on a neighborhood V of U by W E V + s(T, corresponding trajectory are called singular on [O,T]if the Frkchet derivative of ExOtT,denoted by dExolT and evaluated at U is not of full rank. 2.2. Taylor expansion of
The input/state mapping is in fact C" and its Taylor series can be computed as follows. Let us write x(.) v(.) the trajectory corresponding to the control U(.) W(.). Developping f we have: EXOlT.
EXOlT
+
+
f(z+ v, U + v) = f(z,U ) + fac (5,U)V
+ fu (2,U)V + f x u (2,U ) ( % v) + 1/2facx(x,U)(Y, V) + 1 / 2 f u u ( S , U ) ( V , W ) + * * *
+ +
Since s(0) y(0) = z(0) = 50, we have y(0) = 0. Morerover y can be written Slz 62s . ., where 61s is linear in W , 62s is quadratic etc., and using the constraint 9 = f(s,U ) we get
+.
j . + ~ , s82x+ + +...=f(x+b l s + b z s +
...,U+W).
Identifying we get &z = f X ( 2 , (4)
822
U)&Z
= fx(.,U)SZa:
+ fu(z,u)v + fzu(xC1 4 (
h v )
+ 1/2fxac(z,U)(dls, 61s) + l/2fuu(Z,~)(~,W)r which are integrated with the initial conditions b 1 s ( 0 ) = 62s(O) = 0.
Singular Trajectoriesand the Time Optimal Control Problem
83
Let us set
4 4 = fx(x(t,xo,U ) , 4 t ) ) ,
= f d d t ,S O , U ) ,
and let M ( t ) be the n x n matrix solution of
h ( t )= A ( t ) M ( t ) , M ( 0 ) = identity. &om (4),the R4chet derivative is T
(5)
5
dEXogT(v) = M ( T ) M-'(t)B(t)v(t)dt. 0
2.3. Proposition. The following assertions are equivalent: (i) ( x ( . ) ,U ( . ) ) is singular on [ & T I ; (ii) Thelinearsystem = f x ( x , u ) & z + f u (u)v x , is notcontmllable (iii) (S(.),U ( , ) ) is theprojectiononthe space ( s , u ) of a solution (S(.),p ( .),U ( .)) of the constrained Hamiltonian equation
dx = H p ,
dP = -Hx, H, = 0 dt dt where the Hamiltonian is H(x,p,U ) = ( p , f ( x ,U ) ) , and p is non zero.
Proof. By definition we have T
dim
{ 5 M-l(t)B(t)v(t)
dt;v E LW} < n.
0
Hence there exists a non zero row vector p' such that p'M-l(t)B(t) = 0 holds for almost every t. Let p ( t ) be p'M-l(t)B(t).Hence we have that $f = -Hx, and p ( t ) B ( t )= 0 almost everywhere. 2.4. Singular Trajectories and Time Optimal Control. Let us write the Maximum Principle (PMP)for the problem of controlling (3) in minimum time. We get that if (S*(.),U * ( . ) ) is optimal on [0,t*]then there exists p * ( . ) E Rn \ (0) such that a.e.
(8)
H ( s * , ~ * , u *=) ' M a u e ~ mH ( E * , ~ * , u )
H(s* , p * ,U * ) >, 0 and constant.
Bonnard
84
Equation ( 8 ) implies H, = 0. Hence an optimal trajectory is singular. 2.5. Definitions. Using the previous remark a singular trajectory
(x(.), U ( . ) ) will be also called an eztremal and a triplet (x(,),p(.),U ( . ) , ) , an extremal lift. The surface C1 : H, = 0 is called the constraints set. An extremal lift is called totally singular if HuU(x(t),p ( t ) , u ( t ) )= 0. If we are given an extremal (I(.), U ( . ) ) on [O,T],the order of abnormality k ( t ) 2 1, for t E ]O,T],is the codimension of the image of LW by dEzolt. Let p' E Wn \ (0) such that (p', dE"o**(v)) = OVv E LW.The second order intrinsic derivative is the mapping v + (p',& x ( t ) ) ,where v E Ker dExolT and 62 is defined by (4).
2
= f(x,U ) and = g(y, U ) are called feedback equivalent if they are related by a transformation of the form I = cp(g), U = $(g, v ) where the maps y + cp(y) and v + $(., v ) are P-diffeomorphism. These transformations define a group action on the set of systems and the associated group Gf is called the feedback group. The group G; defined in the introduction is its natural restriction to the class of affine control systems (1). 2.6. Feedback group. Two systems (3)
2.7. Computations of Singular Trajectories. To compute explicitly we have to solve equations (6) i.e., H, = 0, takinginto account = Hp, = -H,. The implicit function the differential constraints
9
3
g
theorem tells us that if the Hessian matrix restricted to H, = 0 is of full rank, then a singular control can be locally computed aa a mapping ( q p ) + .^(.,p). This rank is a feedback invariant. For affine systems a2H/au2 = Q and geometrically it means that at each point x, the space {f(x,U ) ; U E Wm } is an affine space in ?Rn.From now on we shall restrict our attention to &ne systems (l),and moreover we shall consider only the single input case: U E W,see [4]for a more complete study. We shall prove that in order to compute the singular controls, one needs only to solve linear equations with respect to U and as quoted in [l41 the main difference between the affine and non &ne case is the numbers of solutions of H, = 0. This multiplicity generates the complexity of the behaviors of
Singular Trajectories Time the and Optimal Control
Problem
85
extremals for the time optimal control problem and it is fully exploited in [l41 to compute a complete set of feedbkk invariants. 2.8. Notations and Definitions. From now on we shall consider
only single input affine systems ,(l),written as (X, Y) , where X and Y are vector fields and let A be the set of such systems. We have H(x,p,U ) = ( p , X+uY) and the constraintsset H, = 0 is identifiedwith C1 = { ( % , p )E Itz"; (p,Y(z)) = 0). The Lie bracket of two vector fields V, W is computed with the convention [V,W] = W,V - V,W and we set ZZ=, { ( % , p ) E Cl;(p,[X, Y](x)) = 0) and S = { ( % , p ) ;< p , [Y, [X, Y]](s) >= 0). Let G be the restriction of (x,p)-+ 1to &\S and let fT = (p,X+W). An extremal lift is said of minimal order if it is contained in \ S. 2.9. Proposition. The extremals 1i.s of minimal order
are the solu-
tions of:
contained in &\S, the singular control being definedby u(t)=G(z(t),p(t)).
2
Proof. An extremal lift (x,p,u) is a solution of = HP' L!?dt = -H, satisfying (p(t),Y(z(t))) = 0, Vt. Differentiating twice this equation with respect to t, we get:
+ 4w 1x3YIl(z:(t)))= 0.
( p ( t ) ,[X, [X, Yll(s(t))
Hence, the extremal is contained in E2 and one can define the singular control in CZ \'S by the dynamic feedback:
= ';i(z(t>,p(t)>. On the other hand in C2 \ S we have gp= Hp and H, = H,.
+ (p,GP(q p)Y) = Hp
A
2.10. Remark and Notations. On C2 \ S, a singular control U(.) is uniquely definedby the dynamic feedback G. The extremal lifts of minimal order are the solutions of an analytic differential equation, denoted by 2. Let X be the map (X, Y)+ (2,E l ) ,
Bonnard
86
2.11. G)-action on ( 2 , C l ) . Let cp be a diffeomorphism of Rn and we lift cp into the symplectic transformation c p'defined by x = cp(y), p = q s . We define the action of (p,a,P ) on (2,C,) m the action induced by the change of coordinates defined by p'. In particular the feedback acts trivially. 2.12'.Definitions. Let E and F be two R-vector spaces and let G be a group acting on E and F. A homomorphism x : G + R \ (0) is called a character. A semi-invariant of weight x is a map S : E + R such that Vg E G,Vz E E,S(g.z) = x(g)S(z). It is an invariant if x = 1. A map 6 : E + F is called a semi-covariant, of weight x, if Vg E G,V x E E, d(g.x) = x(g)g.G(x). It is called a covariant if x = 1. (N.B.: the concept of invariant and covariant does not require E, F to be vector spaces). Now, we can formulate the following result, see [4]for the proof. 2.13. Theorem. The map X : ( X , Y ) + ( 2 , C l ) is a covariantfor the respective G;-actions. Let A, be the class of single input a f i n e systems such that (i) Y never vanishes, (ii) Y ,[X, Y ] and [Y, [ X ,Y ] ]are almost everywhere linearly independent (in particular n 2 3). Two elements ( X , Y ) and ( X ' , Y ' ) of A, are feedback equivalent if and only if A ( X , Y ) and X ( X ' , Y ' ) are G; equivalent. 2.14. Applications. The previous theorem tells us that ifwe substract from the set of systems a bad set, X is a complete covariant. This property which identifies two geometries is important because G) acts on the constrained Hamiltonian differential equations as changes of coordin& tes. In particular all the classical invariants of the vector field 2 related to the behaviors of trajectories: equilibrium points, limit cycles etc. are feedback invariants. Moreover we shall compute other invariants connected to the time optimality problem for singular trajectories, mainly related to the spectral properties of the second order intrinsic derivative. 2.16. I-D Transformation. A system of the form 9 = f(x,U ) can be = v. In control theory, this kind of related to an affine system ifwe set transformation is very important for practical and theoretical reasons. In
9
87
Singular Trqjectories andTime the Optimal Control Problem
particular, as observed in [13],it allows to relate the general classification problem to the classification of affine systems where the distribution x + SpanY(x) is integrable. In optimal control, the inverse transformation, called Goh's transformation;plays an important role. We shall discuss the main properties of this transformation. 2.16. Definitions. Let n I: 2, and consider a single input system (X, Y).Let x0 E RrLbe such that Y (to) # 0 and U be an open neighborhood of 10 such that therestriction of Y to U is &, where ( x 1 ,. . . ,x.) are the coordinates of x E R". The restriction of ( X ,Y ) to U can be written
dx' = X'(x',t"), dt
dx" - X"(X') + U ,
dt where x' = ( x 1 , .. , E The system = X ' ( x ' , x n ) , defined on an open subset U' of R"" and where the control variable is x", iscalled the reduced system associated to ( X , Y ) (restricted to U).Let H ( x , p ,U ) = (p,X u Y ) and let H'(x',p',tn) = (p',X'(x', x")) be the reduced hamiltonian where p' = (PI,. . . ,pn-l) is the vector dual to X'.
.
%
+
2.17. Lemma. For the restriction of ( X ,Y )to U,( x l p , u ) is an extremal lift if and only if (x',p',xn) is an extrema1 lift of the reduced system.
Morever, we have OH' (i)
d BH --(x,p,u) = --(x',p',t"); dt Bu ax" B d2 BH Ba "- (s,p,u)= - w ( H' (ii) X ' , P ' , X ~ ) . au dt2 au Proof, The concept of singular trajectory is feedback invariant, hence = U. Since themap U ( . ) + x"(.) isreone may set X" = 0, and gular, singular trajectories of both systems are in correspondence. Now, computing, since (p,Y ( x ) )= 0,we have p, = 0 and clearly
2.18. Remark. The relations are in fact coming from the connection between the implicit function theorem and the Cauchy-Lipschitz theorem
Bonnard
88
about the.existenceof solutions for differential equations. Indeed if (x,p,U ) is an extrema1 lift of minimal order, the computation of U as U^ in Proposition 2.9 is in fact equivalent to the computation of z" as a function of ( x / , p / by ) solving = 0, using the implicit function theorem.
3. Feedback Action and Time Optimal Control In this section we present the main techniques from [5] using the feedback action, in order to clarify the time optimality problem for single input f f i e systems (X, Y). 3.J.Assumption HO.Consider a system (X,Y) and let (-/,U)be a reference trajectory defined on [O,T].Since the control domain is P, only the singular trajectories are candidate for absolutly continuous time optimal trajectories. Moreover, in order to be time optimal, 7 cannot be a periodic solution. Hence, we shall make assumption HO:7 is a oneto-one analytic singular trajectory. Therefore in a sufficiently small COneighborhood of 'y, it can be identified with t + (t,O,.. ,0) and using a proper feedback, U can be identified with the zero-input. Rom now on we shall assume (7, U ) of this form.
.
3.2. Planar case. Consider a system in R2 and let v = (z,y) be the coordinates. Assume Y transverse to y : t + ( t , O ) , then locally one may set Y = L ,The singular trajectory is contained in S : det(Y, [X, = 0,Y]) 8Y which is identifiedto y = 0. An adjoint variable p = (p1,pz)satisfies p2 = 0 and if (y,p,U ) is of minimal order we have (p,a d 2 Y.XI,)# 0. The system can be written for y small:
dx
dt = 1 +
c
ai(z)yi
a22
and if p is oriented according to the convention < p , X(,> I 0, the sign of ( p , ad2 Y.X)),at 0 is given by the sign of a2. Clearly we have:
Singular Trajectories and the
Time Optimal Control Problem
89
3.2.1. Lemma. If a2 < 0 (resp. > 0) then 7 is time minimizing ( r a p . maximizing) with respect to all solutions contained in a suflciently small neighborhood of y. This examples illustrates the powerof using the feedback group to analyze the optimality problem. Conversely, for planar systems, the assumptions in Theorem 2.13 are not satisfied, and the pair (2, Cl) doesn't contain enough information to classify systems. Take for instance the two systems:
g
For both systems the distribution W + R Y ( v ) and the singular flow = x2 are the same, but they are notfeedback equivalent in any neighborhood of 0. Indeed because in the first case, a non-trivial singular arc is time maximizing and in the second case minimizing. Hence, the time optimality, Cl) has to be taken into account to classifg. which is not encoded in (2, An additional covariant has then to be used. For that, we consider 'the one-form W defined on the set where X and Y are not colinear by w ( X ) = 1 and W ( Y )= 0.This form has the following properties:
:1
(i) If yl is a solution of the system defined on [O,tl],'then dt = t l ; (ii) dw = 0 on the singular trajectory; (iii) For y small, the sign of dw is the sign of az(z)y.
S.,l
W
=
A more complete classification can be obtained by developping this approach. For instance, the set S can have singular points and around such points the normal form is more complicated, see 1191.Now, we shall extend our approach to then-dimensional case. First, we recall a standard result. 3.3. Lemma. The image of P [ O , t ] ,T 1 t > 0 by dEXOlt computed along (7,U = 0 ) is K ( t ) = Span{adk X . Y ( r ( t ) ) ;k E N}, which coincide8 with the first-order Pontryagin's cone defined in [16].For every extrema1 lift (y,u,p),the vectorp(t) is orthogonal to K ( t ) .
Bonnard
90
3.4. Definitions. Assume that foreach t > 0, the codimension of K ( t ) is one i.e., the order of abnormality is k ( t ) = 1 (minimal). Choose an extrema1 lift ( y , u , p ) such that HI, = @,XI,) 2 0. The trajectory 7 iscalled ezceptional if HI, = 0, and hyperbolic if HI, > 0 and < p , ad2Y.XJ, < 0, and elliptic if HI, > 0 and < p , ad2Y.XI, > 0.
3.5. Definition. Let ( y , u ) be a singular trajectory, defined on [O,T].
:
We shall denote by t,,if existing, the first t E ]O,T[such that y is time optimal on ]O,t,[ and ceases to be optimal if t > t,, for all solutions of the system, with same initial and terminal points, and contained in each CO-sufficientlysmall neighborhood of y. The point y ( t c )is called the (first) conjugate point t o $0). (This corresponds to the concept of strong minimum, in classical calculus of variations.) , The main problem when analyzing an optimal control problem is to compute the conjugate points. For the time optimal control we shall prove that there is no general algorithm, contrary to the Riemannian case. 3.6. Assumptions. Let (?,U) be a HO-singular trajectory on [0,T ] which is normalized by y : t + ( t ,0,. , ,0) and U = 0. Since the planar case has been already analyzed, one may assume n 2 3. Moreover,we have the equality K ( t ) = Span{adkX.Y(y(t));k E N),for each t E ] O , T ] . We assume that
.
(Hl) (H2) (H3)
Vt E [O,T],ad2Y.X(y(t))9 Span{adk X.Y(y(t)); k E N) V t E [O,T],the (n - 1) vectors {ad'X.Y(y(t)); k = 0,. . ,n - 2) are linearly independent (Hence K ( t ) is of codimension one). Therefore X(, can be written as g ad2Y.X(,+Cyzt hi addXx.Y(,, where g , ho, . . . , h,-2 are analytic functions from y into R. '
.
3.7. Lemma. g = 0 along y or g ( x ) # 0,Vx E y. In the second case h%-,g-' is a feedback invariant if n 2 4. ,
.
Proof.X can be written in a neighborhood of 7 n-2
Singular Trajectories Time the and Optimal Control Problem
91
where g' and hi are analytic functions whose respective restrictions to y are g and hi. Moreover the restriction of 2 to y is zero. Applying adX to both sides and I'estricting the equation to y we get 0 = g ad X. ad2Y.X(,
- 8 ( X ) ga d 2 XXI,
mod Span{adi X.Y; i = 0,.
. . ,n - 2}/,,
where 8 is the Lie derivative. Now since ad2Y.X and the vectors adiXX.Y, a = 0, . , . , n - 2 are independent along y, there exists an analytic mapping j such that I
adX. ad2Y.XI, = - j
ad2
Y.XI, mod Span{adi X.Y; i = 0,. .. , n- 2}ly.
Hence we get
gj
+ 8x9 = 0
and since along y, X = &, we have t
g ( d ) = g(0)exp
- I j ( t )dt. 0
Hence the first assertion is proved. In order to prove that is a feedback invariant, one consider around y the action of triplets (p,cy,p) which preserves the normalizations on (7, U ) , p(y) = y and the restriction of CY to y is zero. The proof is straightforward and is left to the reader. 3.8. Remark. The previous result shows how to compute feedback invarimts in the neighborhood of a reference singul&r trajectory ( ? , U ) . This trajectory is normalized at the origin, and then feedback invariants are related to the Lie algebraic structure along y. Under our assumptions HO-H2, the first order Pontryagin's cone along y doesn't provide feedback invariants. This is due to the lack of integrabilityconditions along the curve y. If these assumptions are not satisfied, invariants associated to
the classification of non-autonomous linear systems corresponding to the linearized system along y can be obtained, one trivial being the order of abnormality.
Bonnard
92
3.9. Proposition. Let ( 7 , ~be) a trajectory which is hyperbolic or elliptic. Then, under assumptionsHOthe H2,system isfeedback equivalent in a suficiently small neighborhood of 7 to a system of the form
where ann is strictly positive (resp. negative) on[0,T ] if 7 is elliptic (resp. = hyperbolic)and Zi= o , ~(Ix'l), where tx' = (x2,. . ,xn) and lim 0 when x' -+ 0.
.
Proof. The proof of this result is given in [5]. 3.10. Geometric Interpretation. The trajectory 7 is identified to t + (t,0,.. . , 0) and the following conditions are satisfied
(9
adk X.YI,= (-l)k-,
8
..
k = 0,. , n- 2
and is equal'to 0 if k (ii)
> n - 2,
8
XI, = 821'
(iii)
A,.
Hence KI, = Span{ ,.,&}l,. being in standard Brunovsky's form,
The linearized system along 7
.
Let (7,u , p ) be an extremd lift, then one may set p = ( E , 0,. , ,O), where E = +l ,in the elliptic case and E = -1 in the hyperbolic case. The Hamiltonian is HI, = E , Morever (p,ada'Y.XJ,) = Eann, The intrinsic second-order derivative along 7 is identified to:
93
Singular TqjectoriesTime the and Optimal Control Problem
3.11. Definition. System
(X,,,, Y,,,), where
will be called a model. It will be used to evaluate the input/statemapping. 3.12. Self-adjoint Differential Operators. We briefly recall some results from [18]. 3.12.1. Definitions and Notations. We assume n 2 3. Let t E ] O , T ] and C2(n-2)([0, t ] )be the set of maps y : [0,t] + R, of class (C2('"') and U?("-') ([0,t],0) those which satisfy the boundary conditions
.
y ( ~= ) , . = p - 3 ) ( 0 ) = y ( t )=
. . . = y(7+")(t)= 0.
We endow C2(n-2)([0, t ] )with the scalar product
Let bdj, i,j = 0,. . . ,n - 2 be in C('"') ([0,t ] )and such that V i , j. Let q be the map defined on C2(n-2)([0, t])by
bij
= bji,
n-2
i,j=O
which can be written ty'Sy' where ty' = (g1,. . , If 2,y E C2(n-2)([0,t ] )we set b(z,y) = tx'Sy' and
and S =
(bij).
t
B@,I d)= j b(x(s)',€/(a)) fils. 0
Hence we have q ( y ) = b(y, y) and moreover we set Q(y) = B(y, g). Let a, b E a = (a1,. . . , an-'), b = ( b l , . . , and consider ([0,t]) the problem of minimizing Q(g) among all the curves of satisfying the boundary conditions y(i)(0) = ai+1, ~ ( ~ )=(bi++'. t ) Let Dt be the 2(n - 2) differential operator defined on (C2("-2).([0,t ] )by
.
Bonnard
94
This operator is called the Euler-Lagrange operator, associated to the minimization problem and can be written:
In the remaining of this section, we shall assume that Dt satisfies the strong Legendre condition bn-2,n-z > 0 on [0,TI. (Hence it is a non singular differential operator.) Let Dlt be the restriction of D?,to.C2(n-a)([0,t], 0). Integrating by parts we get 3.12.2. Lemma. If x E"C'(~-~)([O, t ] )lind y E (C'(n-z)([O,t], 0 ) , we have B(x,y) = ( D t x ,y). I n particular D"\ is self-adjoint. 3.12.3. Definition. Let t €10,TI, t will be said conjugate to 0 if there exists a non trivial solution y of D' t y = 0. 3.12.4.Proposition. Foreach t E ] O , T ] , there exists a sequence cy = +l, ,.. ,+W svch that
(e,,t, A,,t),
(i) ea,t are elements of C ' ( n - a ) ( [ ~ , t ] , ~~ ,),, t E W satisfying: (e,,t, ep,t) = 1 if cy # P, 0 otherwise and Dttea,t = (ii) . ..Aa,t 2 . . . 2 Xlt; 1 (iii) Each y E ( [0,t ] ,0) can be written as anuniformly conuergent series:
a=l
,
Now, one can state Morse's theorem concerning the spectrum of D't. 3.12.5.Proposition. Let yEE2(n-2)([0,t],0), written as y,ea,t. Then Q(y) = C;t=", A,ty:. The first timetlCconjugate to 0 is the smallest t such that = 0. If t < tic, the only curve minimizing Q is a, = 0 and if t > tic, the minimum of Q is -&l 3.13. TimeOptimality. Now we can outline the method of analyzing the optimality of a reference trajectory (7,U ) , satisfying assumptions HOH2, in the hyperbolic or elliptic case, see [5]for the technical details. One
Singular Trqjectodes andTime the Optimal
Control Problem
95
can assume the system in the normal form (9). First let us consider the model (lo), xi being idenhfied with t: n
dxi = 1 + C aij(t)zix’, dt
dt
i,j=2
Let us set
E
= ( t ,0,.
dx2 dxn = z 3 , ., . , - = U. dt
.. ,0) + 5, hence we have
We let y = t2,
and
and recall that bn-2,n-z. < 0 (resp. elliptic) case. Now clearly we have: . .
> 0) on [ O , T ] in the hyperbolic (resp.
3.13.1. Lemma. The reference trajectory 7 is time minimizing (resp. maximizing) on [O,T],for themodel, if andonly if Vt E ] O , T ] , t -+ ( t ,0,. . . , 0 ) is not accessible from 0, in a time t’ < t (resp. t’ > t ) . 3.13.2. Lemma. The reference trajectory 7 is time minimizing (resp. maximizing),on [O,T],for the model, if and only if the quadratic form t
&(v)
5
= q(v(s)) ds 0
satisfies Q(y) 5 0 (resp. 2 0 ) whenevaluatedontheset of curves v satisfying the boundary conditions y(0) = . . ~ ( “ - ~ ) ( 0=) y(t) = . . . p - y t ) = 0.
.
Now, since U E R, the direction RY = R& is a jump direction, and the variable = xn can be considered as the control variable (this corresponds to Goh’s transformation introduced in 2.15). We have to study
Bonnard
96
the sign of Q on the set of curves y satisfying the boundary conditions:
l d ( ~= ) .
.., p - 3 ) ( 0 )
..
= y ( t )= . = y(n-s)(t)= o
(the constraints in the jump direction y(n-2) are omitted). The extrema of Q correspond to smooth solutions and using Section 3.12 we get:
3.13.3. Proposition. If we eqvand y into CLz.ycrea!,t, ea,t being eigenvectors of theoperator D't associated to Q and X,,t the corresponding eigenvalues, we have Q(g) = C;t=", Aa!,tg:. Let tlCbe the first time conjugate to 0 for D', if t < tic, we have X,,t < 0 (resp. > 0 ) , Va, in the hyperbolic (resp. elliptic) case and y is time minimizing (resp. maximizing). If t > tic, y ceases to be minimal (resp. mwirnal). We can represent in the ( t , z ' ) plane the set of points z ' ( t ) , accessible from 0 when the boundary conditions ai(t) = 0, i = 2, . ,n-l are satisfied (it is a projection of the accessibility set). The d-coordinatecorresponding to y ( t ) is t and every point above (resp. below) the diagonal is accessible, in the elliptic (resp. hyperbolic) case if t < tic.
..
3.14. Intrinsic Computations of Conjugate Points 3.14.1. Definitions and Notations. Let (?,U) be a singular trajectory defined on [0,T] and msume (7,U ) of minimal order. Then from Proposition 2.9, there exists an extrema1 lift such that (?,p) is a solution of g = Z ( z ) , contained in c = 0, where z = (%,p)E Ran, 2 = (Rp, and c : ( % , p ) + ((p,Y ( z ) )(p, , [ X ,Y])) (here Z is considered as a vector field defined a.e. on R2").Let us assume Y and [ X ,Y]linearly independent along y. Let 6a be a solution of the variational constrained differential equation, computed along y : = Z,(y(t))Gz,c,.& = 0. For t E ]O,T],let P ( t ) be the vector space generated by all the vectors dz(t),where (dz(t), 6p(t))is the (n - 2)-space generated by the solutions ,of the variational equation 6z(t)satisfying h ( 0 ) E RY ( ~ ( 0 ) ) . From [17],we have:
-Rz)
3.14.2. Proposition. Let m ( t ) be the dimension of the vector space generated by P ( t ) , Y ( r ( t )and ) X('y(t)).If (?,U) is a singular trajectory satisfying HO-H2, then the first conjugate time, defined in Section 3.13,
Singular Trqiectories and the Time Optimal Control Problem
97
coincides with the first t E IO, TI such that m ( t ) < n. If 7 is exceptional then Vt E ]O,T],m ( t ) < n. 3.15. Conclusion. Using standard results concerning differentialoperators, one can compute the input/state mapping for the model, in particular it is a fold. This allows to decide about time minimality (hyperbolic case) or maximality (elliptic case) of a reference trajectory satisfying assumptions HO-H2 and to compute conjugate points, for the model. This computation requires only integrating the variational equation (it is a linear equation). One can prove, see [5], that the same is true around the reference trajectory, for the original system. At tic, the reference trajectory is still minimizing or maximizing for the model, although it is not any more the unique optimal solution. For the original system, the optimality status at tl, is coded in the &'S occuring in (9). This generates additional feedback invariants. When assumptions HO-H2 are not satisfied, different models haveto be used to analyze the optimality properties, see for instance the analysis developped in [5] concerning the exceptional case. The problem becomes intricate, because the accessibility set can be muchmore complicated. In our case the reference trajectory satisfying HO-H2 is CO-isolated i.e., it is the only trajectory joining ~ ( 0to ) y(T)in a time T, ifwe restrict the system to a sufficiently small neighborhood. This has the following consequence. For each cost function ;1 fo(z,U ) d t , the trajectory 7 is locally optimal. The existence of conjugate points is detectable in terms of the behaviors of extremals in the neighborhood of the reference trajectory. This will be clarified in the next section.
4. Feedback Invariants as Geometric Invariants
in Time Optimal Control in W3 4.1. Notations. Consider the following system
dv
dt = X ( v )+ uY(v), where v = @,glz) E R3.Let D f S y= det(Y, [X, Y], [Y, [X, Y]]), D f P y= det(Y, [X, Y], [X, [X,Y]]), and D f I y = det(Y, [X, Y], X ) (the dependence
Bonnard
98
with respect to X and Y will be omitted when no mistake is possible). Let Il be the set of points where X and Y are dependent and 12 the set where X and [X, Y]are dependent. Theyare clearly feedback invariants. For the remainder of this section, we consider only systems (X,?')such that D1 is not identically 0. By singular trajectory, we mean a singular trajectory contained in R3\ {Dl = 0). 4.2. Lemma. The singular trajectories are the solutions of:
restricted to R3 \ {Dl = 0 ) . Proof. Since p # 0, the relations ( p ,Y)= ( p ,[ X ,Y]) = (p,[X, [X, l']])+ u(p,[Y, [X, Y]]) = 0, defining the singular controls imply D2 + uD1 = 0. Thus, on the set R3\ {Dl = 0}, the singular control is given by a feedback
S be the vector field defined on R3 \ (01= 0) Y )+ S. Observe that S is the by X - e Y and let X, be the map (X, restriction of r*Z to R3 \ {Dl = 0}, where Z is the Hamiltonian vector 4.3. Definitions. Let
field whose solutions are the extremals lifts of minimal order, and T is the projection ( z , p ) + 2. The action of G ) on Z induces the following action on S : (p,cu,p).S= p e s , and from Theorem 2.13, we have the following proposition: 4.4. Proposition. The map X= is a covariant. Moreover the feedback Y),D1 being non identically zero,is equivalent t o classification of pairs (X, the Gf-classificationof ( Z ,RY),(RI' represents the distribution associated to Y).
Now we shall describe feedback invariants related to the time optimal control problems. 4.5. Lemma. Let ( p ,CY,p ) E G;, then:
(i)
F) D x p y ( p ( w ) ) , for i = 1,2,3;
DY*ys'*y(w) = (det 6p"
Singular Trajectories and the Time Optimal Control Problem
= (det
99
g)
det(Y, [X, Y], [Y, [X,Y]](cp(v))etc.
f : R3 + R and define the action of(cp, a,0) E G) o n f as follows: (cp,a,P).f = f o cp. Then, we have the following serni4.6. Corollary. Let
covariants
+ x 3 : (X,Y) -+ DfIY.
(i)
A1
(ii)
: (X,Y)
4.7. Proposition. The exceptional trajectories are contained in D3 = 0, the hyperbolic (resp. elliptic) trajectories in D1D3 > 0 (resp. DlD3 < 0). The sets defined by D3 = 0, 0 1 0 3 > 0 and DlD3 < 0 are invariant
sets. Proof. On R3 \ { D l = 0}, Y and [X, Y] are independent. Let 7 be a singular trajectory, an associated adjoint vector p satisfies (ply) = (p,[X,Y]) = 0, along y. If y is exceptional, then HI, = @,X)\, = 0, hence they are contained in D3, which is an invariant set. Now D 1 0 3 > 0 and 0 1 0 3 < 0 are also invariant, because in R3 \ { D l = 0}, the Lie bracket [Y, [X, Y]] cannot cross the linear span of Y and [X,Y]. By definition, these sets contain respectively, hyperbolic and elliptic trajectories. 4.8. Time Optimality. In thie section we shall describe in details the
optimality results concerning singular trajectories given in [5], and shortly described in Section 3 of this article, in the hyperbolic and elliptic case. We consider only singular trajectories contained R3 \ { D l = 0) and one
! .
100
Bonnard
may assume y one-to-one. Hence 7 can be taken as t + (t,O,O) and by setting U' = U + y is the trajectory corresponding to U' = 0.Using the action of the feedback group around y, one can transform the system into one of the following systems. In the exceptional case we may take the system in the form
3,
where a > 0 on [O,T],and in the hyberbolic or elliptic caae we transform it to theform
+
+
where L(t,g,z ) = a ( t ) z 2 2b(t)yz c ( t ) y 2 , a < 0 (resp. a 3 0) on [ O , T ] in the hyperbolic (resp. elliptic) case and R is a vector field which can be neglected i.e., one can set R = 0 and analyze only the problem for the models. First, we have. 4.8.1. Lemma. I n the exceptional case, the reference trajectory iden-
tified with t + (t,0,O) is CO locally time optimal. Proof, This is clear for the model, since a > 0 andthe equation z ( t ) = a(s)g2(s)ds = 0 imply g = 0, almost everywhere. Hence 7 is the only trajectory joining y(0) to y ( t ) , for T 1 t > 0, in time t, for the model. It is still valid for the system if it is restricted to a sufficiently small neighbourhood.
$i
4.8.2. Proposition. Assyme y hyperbolic or elliptic. The time tl, b conjugate to 0 if there exists a non trivial solution ,$ of Euler-Lagmnge equationon [0,tl,] : - = 0 , with p(0) = p ( t l c ) , whichcan be
$B
written as
Singular Tqjectories and the Time Optimal Control Problem
101
in the canonical form d2 J + K ( t )J dt2
= 0.
By analogy with the Riemaniann case K is called first cuwature, associated to the time optimal control problem. It is an invariant describing the distribution of conjugate points (see for instance Sturm's theorem). 4.8.4. Geometric interpretation. Let y be a hyperbolic or elliptic
singular trajectory, identified with t + ( t ,0, 0),defined on [0, and corresponding to thezero control. First, let us assume that thesystem coincides with the model
dt
B B 8 (l+L(t,y,z))~+z-++sld 8.2 and the associated reduced system defined in Section 2.16 is then dx dV -=l+L(t,y,z), -=z, dt where z is the control variable. By definition of tl,, there exists a curve 9' such that = 1, ~ ' ( 0 )= g'(t1,) = 0, y'(t) # 0 on ]O,tl,[ and $:c L(t,y', dt = 0. Hence the corresponding solution initiating from (0,O)satisfies x'(t1,) = tl, and ( X ' , V') intersects (]O,t1,],0)only at (tl,, 0).
c)
Let E E R and x: be the solution of (17) starting from 0 and corresponding to the controls z = cy'. From our previous analysis the family of curves (zL,~y')intersects. (]O,tl,],O)only at tl,. As in the Riemaniann case, one can show that for system (lli),7 being identified with t + (t,0,O) and Y to (tlc,O)is the limiting point of the intersections of the projection of singular trajectories on the reduced space (they concide with singular trajectories of the reduced system).
g,
4.8.5. Conclusion. Differential equation (12),whose solutions are the singular trajectories'encodes invariants connected with the time optimdity status. Given a singular trajectory the conjugate point along this trajectory can be detected in terms of the behaviors of the neighboring singular trajectories, 4.9. Feedback Invariants for Quadratic Control Systems. Clas-
sical invariant theory studies the actions of Gl(n,R) on the spaces often-
Bonnard
102
sors: vectors, covectors, etc. Computing a complete set of invariants for such actions is the main problem when analyzing the associated geometries. Thus numerous algorithms have been described to achieve this task, see for instance [8].It is interesting to connect this theory with the feedback classificationproblem by using a specific classof polynomial systems. 4.9.1. Preliminaries. We consider the set C of control systems in iR3,
of the form
dv
= &(V) dt
+~ 6 ,
where Q = (Q1,Q z , Q 3 ) , each Qi being a quadratic form and 6 a constant vector field. Let G”f be the subgroup ofG;of triplets (P,a l p ) ,where P E Gl(n,W), a is a quadratic form and p a non zero constant. G”! is a Lie group and acts on system (Q,b) by the action induced by G). The family C is stable for this action. n o m Lemma 4.2, the singular trajectories which are not contained in It3 \ {Dl= 0) are the solution of
and it is a homogeneous differential equation of degree 2. Let 2 be a vector field on R3 and let f be a map from R3 into W. The action of G”f on 2 and f is the action defined by: if (P,a,p) E G”f, then (P,a,~).Z=P*Z=P-l(ZoP)and(P,a,~).f=f~P. By Proposition 4.4,the G”!-classification of pairs (Q, b) is equivalent to theG;-classification of pairs (S,W), where S designs the vector field d& fined on R3 \ (Dl= 0) by equation (19) and D1 is assumed not identically zero. Nowwe shall relate the G”f-classification of pairs (Q, b) to the linear classification of the vector field S. The computations, which are lengthy, are given in [2]. The aim of this section is to give the geometric interpretati ons of the various semi-covariants. 4.9.2. Notations. Themap v + -[Q, 6](v) islinear and the associated matrix is denoted by A . Let ad A be the adjoint matrix corresponding
Singular Trajectories Time and the Optimal Control Problem
103
to A. Set w = adA(b) and observe that [Q, b](w)iscolinear to b. Let L1 = Iwb, L2 = Rw and let S' be the analytic vector field of R3 given by S' = D1Q - D2b. From Lemma 4.4, we have the following results: 4.9.3. Lemma.
For the G"f-actions we have the following semi-co-
variants
4.9.4. Remarks. All these maps are semi-covariants, not covariants.
Thus, only the sets D1 = 0, D3 = 0, and D1 = OnD2 = 0 have an invariant meaning. This is due to the following property. Since S is homogeneous, with degree 2, then the map v + E V , E # 0 transforms S into &S.Thus, in our classification, we must identify S with ES and we are dealing in fact with projective geometry, in which we have no non-constant polynomial invariants. In particular, the Xi's cannot be covariants. 4.9.6. Geometric interpretation of S'. Consider equation
gb.
8=
We set do = and we get g = S'(v). Hence S' is a time reparametrization of S,depending upon the semi-covariant Dl,its trajectories are reparametrized singular trajectories. Observe that S' is a homogeneous cubic vector field of Et3.
Q-
4.9.6, Geometric interpretation of (D1= 0). Computations show that D1 = 0 is the plane generated by L1 = Iwb and L3 = Rw.In particular Adt! = Dl& - D2b = -Dzb, in D1 = 0. Since b is tangent to Dl,this plane is an invariant set for the solutions of = S'(w).This set is the union of two types of sirigularities. First the set of points where b and [Q,b] are colinear, which are the projections on R3 of the singularities of the surface (p,6) = (p,[&,b])= 0. Secondly, the points where [b,[Q, b]] crosses the
2
Bonnard
104
linear span of .b and [Q,b]. This is related to the hyperbolic-elliptic status of singular trajectories. 4.9.7. Geometric interpretation of ( 0 3 = 0). This set is outside
{Dl = 0) formed with the exceptional trajectories. In particular ( 0 3 = 0) = S’(v). Now observe that D3 is an invariant set for the solutions of is a cubic form. Linear classification of cubic forms on C is well known, in particular they have a n o n trivial mtional invariant, called the modulw. This invariant is very important in our classification problem.
8
{Dl = 0) n {D2 = 0). First, observe that the map W + &(v) restricted to the plane D1 = 0 is a cubic form in two variables. Computing we get that the solutions of D1 = 0 n D2 = 0 are the lines L2 = Iww and if a discriminant S, which will be computed later , is positive, two lines denoted by L3 and L4. We have the 4.9.8. Geometric interpretation of
following nice properties. Property 1. In control theory, a system is called weakly controllable if for all W E Et3, the rank of {Q, ~)A.L.(w)is 3 , where {Q, ~ ) A . L is . the Lie algebra generated by the two vector fields Q and b. This propertyis clearly feedback invariant. Let us introduce the following’(constant) vector fields: 211 = b, v2 = [[&,v11,4 , v3 = [[Q,v1], vz] and v4 = [ [ Q , v z ]~, 2 1 , From 131, the system is weakly controllable if and only if the rank of th ese vectors is 3. Now, computing, one can check that it is the case if and only if DZ restricted to D1 = 0 is not identically 0. In other words, the semi-covariant A 2 maps the set of non weakly controllable pairs onto zero. Property 2, Here, we restrict our study to systems (Q, b) such that Span{vl, ~ 2 , 2 1 3 )= Et3. By convention, in this section a singular trajectory is a solution of (19) contained in Iw3 \ {Dl = 0). One may ask the following question: when does a system (Q, b) admit non zero singular trajectories, contained in D1 = 0 ? An associated extremal lift has to satisfy the equations:
(P,b) = (P,[Q, bl) = (P,[b,[Q, bll) = b,[Q, IQ,
bll) = 0
and is then contained in { D1 = 0) f l { D2 = 0). Further computationsshow
Singular Trajectories and
the Time Optimal Control Problem
105
the following. There exists a non trivial singular trajectory in (Dl= 0) if and only if L3 = L4 (L3 and L4 are the two lines previously defined) i.e., 6 = 0. Moreover, such a trajectory is supported by the lines L3 = L4.
3
4.9.9, Definitions and Notations. Since the equations = S’(v) is homogeneous, the distribution W -+ W’(v) is invariant with respect to the transformations W + E W , E # 0 and can be projected onto the sphere S’. More precisely, if we set r = (z2+g2 .z2)l/’, v’ = v / r and r’dt = d a (reparametrimtion), equation = ~ ‘ ( v is ) equivalent to
6
dr da
+
- (w’S’(v’))r
”
dw’ = S’(V’) - (v‘, S‘(w‘))v’ da
(21)
Equation (21) isdefined on S2 and iscalled the projectedequation associated with = S’(w).Clearly,thisequationencodesmoat of the behaviors of singular trajectories and has to be camfully studied. This will be the objective of the remaining part of this article. Let v0 E R3\ {0}, a line RWOsuch that S‘(v0) is colinear to v0 is called a ray. If S’(w0) = 0, a ray is a set of singular points for = S‘(v), otherwise a ray is an asymptoticdirection for solutions of this equation. Clearly a ray corresponds to a singular point for the projected equation and conversely. Now observe that S’(w)can be written as Sc‘(v) 1/5 div (S’(w)).v, where ,Sc‘ is a cubic vector field such that div Sc‘ = 0. Both S’ and Sc’ have the same projection on S2 and thiscorresponds to thedecomposition of = S’(v) into (20) and (21). We have the following result.
9
9
+
9
4.9.10. Lemma. The maps
X 4 : ( Q ,b)
-+ diu S’ and XS : (Q,b) -+ Sc’
are semi-covariants. Now, we are going to parametrize the G”j-orbits and relate the parameters with invariants describing the behaviors and the optimality status of singular trajectories.
4.9.11.Lemma. For an open dense setof pairs (Q,b ) , a G”j-orbit can be parametrized by: Q = ( a l z 2 + a ~ y 2 + a 4 z y + y z ,b~zC2+b2y2+.z2/2+22/,0), b = (O,O,1).
Bonnard
106
Proof. Let e l , ea, e3 be R3-canonical basis, Q = (91,&a, Qs),where Q1 = a1z2 + azy2 + a32' a42y a521 agyz and Qz, Q 3 are respectively defined by changing ai into bi and C i . We set b = e3 and hence applying a feedback one may assume Q3 = 0. Now suppose that the vectors V I , V Z , v3 defined in 4.9.8 are independent. Equivalently it means that V I , v2, W is a basis of R3.We compute Q in the basis el = W , e2 = v2 and e3 = b. This induces the following normalizations:
+
+
as = a5 = b5 = 0 ,
+
ag = 1, b3 = 1 / 2 ,
and we get a pseudo-normal form. In order to get a G"f-representation with a minimal number of parameters, we proceed as follows. We consider the action on the two first components of Q of the linear tranformations P E Gl(3,R) such that P preserves We3 andthe pseudo-normalform. An easy computation shows that these transformations coincide with the aubgmup of matrices of the form
(5 + i),
azo.
Using the action of p, one of the coefficients a2, bz or be can be set to 0. The parameter cy allows to normalize a1 or b4 to 1, if they are non vanishing. We choose be = 0 and b4 = 1 if b4 # 0. Nowwe have to check that each element of a G"f-orbit has the same representation. For that, let (Q, e3) and (Q', e3) be two elements parametrized respectively by the coefficients a l , aa, a4, bl, ba and a:, a i , a i ,b:, bi and let us assume that they are feedback equivalent. Hencethere exists P E G1(3,R), leaving e3 invariant, such that Q' = P * Q mod e3 (this means that the last component of Q' and P * Q is omitted). Computing we get P = identity. This proves the assertion. Proposition 4.9.12. I n the representation of ( Q ,b) given above we have:
Singular Trajectories Time and the Optimal Control Problem
107
+
+
+
+
(iii) 0 3 = -b2y3 - blx2y - zy2 alx2z a2g2z 1/2yz2 a 4 q z (iv) Using the projectivecoordinates U = x / y and W = z/y in which the set D1 = 0 is sent at the infinity, the projected system becomes: = S ( u , w ) ,$ = P z ( u , v ) ,whereP1 = a z + ( a 4 - b 2 ) u + w + ( a 1 - 1 ) - b l u 3 1/2uw2, P2 = 1 2blu (2b2 - a4) - 2a2v2 (I - 2a1)uw - w3 - a&; (v) diu S’ = 2b1z2 6b2v2 - z2 4x9 - 2a4xz - 4azyz.
6
+
+ +
+
+
Now,we shall indicate how to compute a complete set of feedback invariants. In fact, we compute semi-invariants which have to be combined rationally to get rid off the weights and providing invariants. 4.9.13. Singular points. The first step when analyzing the behaviors of the solutions of = S’(w)is to compute the rays and the behaviors of the neighboring solutions, by linearizing. Computing we have:
2
Property 1. If N is the numbers of rays it satisfies generically the inequality 13 2 N 2 3. Indeed in D1 = 0, we have 4 2 N 2 2 and in Dl # 0, 9 2 N 2 1. They are located in the set where b and Q are colinear. (Observe that for a general cubic equation, one has 16 2 N 2 1). Property 2. The behaviors of the solutions near 0 1 = 0 has been classified in [2]in the generic and codimension one case. In particular we have: Near Lz. The two eigenvalues of the linearized projected system me equal to bl. It is a node. Near L3, L4. We set U = a,/x and W = z / x . By definition La, L4 are the roots in U = 0 of equation w2/2 a421 - bl = 0. Hence if 6 = ai 2b1 > 0, we have L3 = -a4 4,L4 = -a4 - d.Computing, we get that the eigenvalues of the linearized projected systems are (X, -X), where 1x1 = 12bl - a4L1, L = L3 or L4. It is a saddle.
+
+
+
Near L1. Recall that L1 is the line wb. By setting U = y/z, W = x / z and W = l/z, the system is near L1, CO-equivalent to = U , = w/2, = w/2. The eigenvalues of the linearized projected system are 1 and 1 / 2 (it is a node) and each line in a, = 0 parallel to e3, is an asymptotic direction.
9
9
9
Bonnard
108
Conclusion. From this analysis we deduce the following. The two parameters a4 and bl are describing the behaviors of singular trajectories near D1 = 0. The line Rb is a blowing-up direction for the solutions, in particularthedistribution Rb is encoded in Q = S'(v). Other semiinvariants can be computed similarly, connected to the behaviors near the rays outside D1 = 0. 4.9.14. Classification of Ternary Forms.Classical invariant theory can be usedin order to compute feedback invariants connected to the linear classification of the following forms: D1 (linear), D3 (cubic), div S' (quadratic) and D1 = 0 n D2 = 0. We briefly indicate how. First the set D3 = 0 provides an invariant which is the modulus. Now, we can compute the invariants givenby the combinations of these forms. For example, consider D2, div S', D3,all restricted to D1 = 0. In D2 = 0 n D1 = 0, there is a root given by Rw,which has a feedback invariant meaning: b and [Q, b](w)are colinear. Hence the cubic form D2 can be factorized as zK1 where K1 = z2/2-b1z2+a4zz, where a/ = I = 0 is the line Rw.Hence K1 is a semi-covariant. Now, div S' and D3 restricted t o a/ = 0 are respectively K2 = 2b1x2 - z2 - 2a4zz and zK3, K3 = a1z2. The eigenvalues of the pencil associated to the two quadratic forms K1 and K2 are depending upon bl and a4. The parameter a1 can be recovered from the eigenvalues of the pencils formed from K3 and K1 or K Z .Further invariants can be computed using the quadratic form div S' and the cubic form D3.In the general case it provides 7 invariants, plus the modulus.
REFERENCES [l] B. Bonnard, On singular extremals in the time minimal control problem in R3,SIAM J. Control Optim., 23, 1985, 794-802.
[2] B. Bonnard, Contribution d l'dtude des trajectoires singudidres; Rapport L.A. Grenoble, 1987.
Singular Trqjectories and the Time Optimal Control Problem
109
B. Bonnard, Quadratic control systems, Math.Contro1 Signals Systems, 4, 1991, 139-160. B. Bonnard, Feedback dquivalence for nonlinear systems and the time optimal control problem, SIAM J. Control Optim., 29, 1991, 13001321. B. Bonnard, I. Kupka, Thtorie des singularitds de l'application entr6e Forum Mathematicum 5, 1992, 111-159.
/ sortie et optimalitt des traje ctoires singulibres,
P. Brunovsky, A classification of linear controllable systems, Kybernitika, 6, 1970, 173-183. E.Cartan, Oeuvres complhtes, Gauthier-Villars, Paris 1953. A. Dieudonnd, J.-B. Carrel,Invariant theory: old and new,Academic Press, New York, 1971. R. B. Gardner, Differential methods interfacing control theory, in Differential Geometric Control Theory, Brockett, Millman and Sussmann, eds., Birkhauser, Boston 1983. R. B. Gardner, Lectures on the method of equivalence with applications to control theory, CBMS-NSF Regional Conference Series in Applied Mathematic, 58, SIAM, Philadelphia, 1989. R. B. Gardner, W.-F. Shadwick, G.-R. Wilkens, A geometric isomorphism wath applications to closed loop control systems, SIAM J. Control Optim., 27,1989, 1361-1368. C. Godbillon, Gtomdtrie diffdrentielle et mtcanique analytique, Herman, Paris, 1969. B. Jakubczyk, Equivalence and invariants of non linear control systems, in Nonlinear Controllability and Optimal Control, H.J. Sussmann ed., Marcel Dekker, New York, 1990. B. Jakubczyk, Microlocal feedback invariants, preprint 1992. I. Kupka, O n feedback equivalence, Canadian Math. Society Conf. Proceedings, 12,1992. E.B, Lee, L. Markus, Foundations of optimal control theory, John Wiley, New York, 1967.
110
Bonnard
[l71 J. de Morant, ContrSleentempsminimaldesr6acteurs chirniques discontinus, Phd. Thesis, U.of ROuen, 1992. [l81 M. A. Naimark, Lineardifferentialoperators,Part I , Frederick Unga. Pub. Co., New York, 1967. [l91 W. Respondek, Feedback classification of control systems ori Ita, R3, this volume. [20] K. S. Sibirsky, Introduction to the algebraic theory of invariants of differential equations, Manchester U. Press, Manchester, 1987.
Controllability of Generic Control Systems on Surfaces Alelcsey Davydov * Steklov Institute of Mathematics, ul. Vavilova 42, GSP-1, 117966 Moscow, Russia
Abstract. We present a complete classification of singularities of controllability boundaries for generic control systems on surfaces. This classification includes three lists of singularities. Namely, Tables 1-3 (given below) describe the generic singularities of boundaries for local transitivity zones, attainable sets and nonlocal transitivity zones, respectively. It turns out thatfor a generic control system all these singularities are stable under small perturbations of the system. These results were proved using the tools and results of singularity theory, theory of dynamical systems and control theory. Our aim here is to explain these results and to illustrate them by examples. For the full proofs we refer the reader to [l,2, 3,41.
1. Classes of control systems Here we define a space of control Bystems considered below.
* Permanent address: Department of Mathematics, Vladimir State University, Gorkii street 87, 600026 Vladimir, Russia 111
Davydov
112
1.1. Space of control systems
We will only investigate control systems on smooth surfaces. We assume that a control .system can be locally described by an equation of the form
where z is a point of the phase space M of our system (the surface M), U is a control parameter belonging to a smooth closed manifold U (or to a disjoint union U of finitely many smooth closed manifolds) which has at least two distinct points, f is a smooth mapping and 2 = &/Bt. Let P be a bundle space over M with fiber U. On the whole surface a control system can be defined bya mapping F of P into the tangent bundle space TM such that 7r o F = r , where r : P + M is the bundle projection and 7r : TM + M is the canonical projection. We identify the space of control systems with the set of such mappings and endow it with the fine Ck(Whitney) topology. The value of k will be separately specified for each class of control systems considered below. A generic control system or a control system in geneml position is a system from a subset of this space, open in the fine Cktopology and dense in fine CO”topology. All the results formulated below are valid fork 2 4 but for somespecial type of control systems they are also true for some smaller IC,
1.2. Polydynamical systems
A control system is called polydynamical if the set of values of the control parameter consists of finitely many points. In the simplest case this set has only two distinct points, and such systems are bidynamical. Example 1. Bidynamical system. Suppose that in the flat sea R&, there are a stream of water with a velocity field v($, y) and a stream of air over the water with a velocity field w(z,y). Our ship without inertia has lost control h d its movement takes place according to one of the two velocityfields. It is easy to see that the ship’s possiblemovements are
Controllabilityof Generic ControlSystems on Surfaces
113
described by the control system
(& ,i) = U+,
Y) + (1 - u)w(z,P)
where an admissible control is a piecewise continuous function U on the real line with two possible values 0 and 1. So the movement of the ship is described by a bidynamical system. For polydynamicd systems all the results formulated below are valid if k 2: 2. Remark. Here and henceforth, unless otherwise specified, 2, 21 are standard plane coordinates and zero is the origin.
1.3. Simplest differential inequalities
Example 2. In the plane RE,a,consider a swimmer driven by a smooth flow of water with a velocity field v(%, 3). In standing water the swimmer can swim in any direction with a velocity bounded by the value of a positive function g. The possibilities of the swimmer can be described by the differential inequality ( k - 211 (z,
+ (0 - v a ( 5 , ~ ) )5~g2(z,Y)
or by the control system
+
(h,0) = ‘U(%,?/l P ( 4
+ +
where U is a point of the two-dimensional sphere U: U; U: = 1, and p maps the point (211, u2,US) of this sphere to the velocity (g(2, y)ul, g ($9
Yb2)
For such systems all the results formulated below are valid if k 2 2.
2. Stability of sets of points with the same local
controllability properties Usually, states in the phase space may have different local controllability properties. Near (the word ‘hem ” means here and everywhere below
Davydov
114
“in a sufficiently small neighborhood of”) some of them control system stays for any positive time period under a suitable choice of an admissible control, and near other ones it is not possible to prevent an unwished evolution of the system. Here we define different notions of local controllability and, for a generic two-dimensional control system, we study the regions of the phase space consisting of all points with the same local controllability properties. We show that these regions are stable under small perturbations of the system.
2.1. Local transitivity zones and the steep domain
An admissible control is a piecewise continuous mapping U : t I+ u(t) E U of the time axis into the set of values ofthe control parameter. Choosing an initial point, an initial time and an admissible control we can define an admissible motion of the control system, at least for times sufficiently close to the initial time. A state of a control system is attainable in a time t from some state of this system if there exists an admissible motion of this system steering the second state to the first one in this time. A point z of the phase space has the local transitivity property (LTP) if for any neighborhood V of z there exist T > 0 and a neighborhood of z such that any two points of are attainable from one an other in a positive time less than T without leaving V . A point z of the phase space has the small time local transitivity p m perty (SLTP) if for any neighborhood V of z and any T > 0 there exists a neighborhood of z such that any two points of are attainable from one an other in a positive time less than T without leaving V . The local transitivity (respectively the smalltime local transitivity) zone is the set of all points of the phase space which haveLTP (respectively SLTP). We denote these zones by LTZ and SLTZ, respectively.
v
v
v
v
Theorem 1 ([l]). L T 2 and SLTZ of a generic control system have the same interiors and the Same closures, and the closures coincide with the closures of the interiors.
Controllabilityof Generic Control Systems
on Surfaces
115
The proof of Theorem 1 is based on investigation of singularities of the field of limiting directions defined below. Obviously, SLTZ E L T 2 but very often these zones are different.
Example 3. For the control system of Example 1, SLTZ = { (3, v) I z = 0 < y}, L T 2 = { ( s l y ) 1 z = 0 5 y} if w(z,y) = (1,O) and w(z, y) = (z - y, x). Indeed, at each point outside the set z = 0 < y there is a drift because both admissible velocities at this point are nonzero and make an angle not exceeding 180'. So this point does not have LTP and SLTP. Further any point z of the positive y-axis has SLTP (and hence LTP). At z we can observe the following phenomenon. The point z belongs to the collinearity line of the velocity fieldsW and W .At z these velocity fields have opposite directions and are not tangent to this line. At any point of this line except the origin, the phase curves of W and W have first order tangency. So near z the velocity fields W and W have first integrals I(z,y) = y and J ( z ,y) = y - s 2 h ( zy), , respectively, where h ( z ) > 0. In thenew coordinates = y and P = z ( h ( z y))lI2 , near z , these integrals take the forms (tildes omitted) I(s,y) = y and J ( z ,y) = y - z2, respectively. Now it is easy to see that in any neighborhood of z there is an admissible cyclic motion surrounding this point with two switchings from one admissible field to theother during one cycle and with any sufficiently small period (Fig. 1; in Figures 1 and 2 the boundary of the steep domain (SD-boundary) is indicated by the thin double line, and the phase curves of the fields are depicted by dashed and solid lines, respectively). Hence any two points of the region bounded by this cycle are attainable from one an other. In fact, using at the beginning the field (1,O) to reach the cycle, then the field W for the motion along the cycle, and, finally, the field (1,O) again to reach the end point, we can steer any initial point to any end point. The time of such transfer is bounded by some value tending to zero together with the period of the cyclic motion. So any point of the positive y-axis has SLTP. Finally, the origin has LTP. Indeed, in any of its neighborhoods there is an admissible cyclic motion surrounding this point with two switchings from one admissible field to the other during one cycle and with some period. This cycle is attainable from every point of the region bounded by
c
116
Davydov
"
Fig. 1.
t
Fig. '2.
Controllabilityof Generic Control Systems
on Surfaces
117
it by using the field v and conversely, any point of this region is attainable from some point of the cycle by using the same field (Fig. 2). This implies LTP for the origin. But the origin does not have SLTP because the point (0, -a) is attainable from ( a ,0) (where a > 0 is sufficiently small) in time no less than a quarter of the period of a revolution around the origin with the vector field W . Example 3 shows that, in general, S L T Z # L T Z . The velocity indicatrix at a point of the phase space is defined to be the set of admissible velocities at this point. The positive linear hull of the velocity indicatrix at a point is called the cone of this point. The steep domain of a control system is defined to be the set of all points of the phase space whose cone does not contain the zero velocity. The sides of the cone of a point of the closure of the steep domain are called limiting directions at this point. An integral curve of the field of limiting directions is called a limiting curve.
Theorem 2 ([l]).The steep domain of a generic control system is the complement of the closure of LTZ (SLTZ), and its boundary is exactly the set of all points for which the convex hull of the velocity indicatrix contains the zero velocity on its boundary. The proof of Theorem 2 is also based on investigation of singularities of the field of limiting directions. Example 4. The steep domain of the polydynamical system given by the three fields of admissible velocities ( H , -y+x2) and (0,+l)coincides with the region y < x 2 . The cone of any point in 21 > x2 coincides with the tangent plane, and so this point belongs to SLTZ [5]. All points of the parabola y = x z except the origin belong to SLTZ (the argument is the same as in Example 3 for points of the positive y-axis). The origin does not have LTP because for any a > 0 the point (0,-a) is not attainable from the origin. In the steep domain two branches of the field of limiting directions are defined by the first two fields of admissible velocities. Thus the limiting curves coincide in this region with the phase curves of these two fields. Figure 3 illustrates the behavior of the net of limiting curves
Davydov
118
near the origin. The SD-boundary is indicated by a thin double line, the interior of LT2 (andSLTZ) is shaded,and the integral curves of the two different branches of the field of limiting directions are depicted by dashed and solid lines, respectively. It is easy to see that the steep domain coincides with the complement of the closure of LT2 (SLTZ).
Fig. 3.
2.2. Types of points of the boundary of the steep domain
It is easy to see from Figure 3 that the behavior of the net of limiting curves (LC-net) near the origin isdifferentfrom its behavior near any other point of the SD-boundary. In other words, the singularity of the LC-net at zero is different from its singularity at any other point of the boundary. It was shown above that zero does not have LTP and any other point of this boundary has SLTP. Hence the singularities of the LC-net have some influence onlocal controllability. To classify the singularities of a generic control system on its SD-boundary it is useful to introduce some new notions, in particular, different types of SD-boundary points.
Controllabilityof Generic Control
Systems Surfaces on
119
An admissible velocity at a point is called limiting at this point if it belongs to a limiting direction at this point. A value of the control parameter is called limiting at a point if it defines a limiting velocity at this point. A point of the SD-boundary will be called a &turning point (respectively a +passing point) if at this point 1) there are exactly two distinct limiting values of the control parameter, 2) the corresponding limiting velocities are nonzero and 3) they have opposite directions and are (respectively are not) tangent to the SD-boundary. Example 5. The SD-boundary of the control system given by the two y - X') is the parabola y = z2. All points admissible velocity fields (&l, of the parabola except the origin are &passing points, and the origin is a 8-turning point.
A point of the SD-boundary will be called a double B-passing point if at this point 1) there are exactly three different limiting values of the control parameter, and 2) the corresponding limiting velocities are nonzero. Example 6. The SD-boundary of the control system givenby the three admissible velocity fields (1,0),(-1,z - g ) , (-1,g z) is the set y2 - z2 = 0. All points of this set except the origin are &passing points, and the origin is a double &turning point.
+
A point z of the SD-boundary will be called a zero-passing point if, at z , there is an isolated limiting value of the control parameter giving the
zero limiting velocity. Example 7. The SD-boundary of the control system givenby the three admissible velocity fields (3, -2y), (1,l), (-1,l) is the set 29 = lzl. All points of this set except the origin are B-passing points, and the origin is a zero-passing point. A point z of the SD-boundary will be called a nonzero-passing point if, at z , 1) there are exactly two different limiting values of the control parameter, and 2) one of them gives a nonzero velocity, while the other gives a zero velocity, and is a nonisolated value of the control parameter.
Davydov
120
A point x of the SD-boundary will be called a black (respectively regular) zero-point if, at x , 1) there is a unique limiting value of the control parameter, and 2) the limiting directions are (respectively are not) tangent to the SD-boundary. Example 8. Consider the control system in the plane given by the velocity fields(y+cos U, sin U ) , where u E S1is an angle. The steep domain of the system is the region 1y1 > 1. In this region the field of limiting velocities is ( g - l / y , &(l- l / y 2 ) 1 / 2 ) Let , us add one more admissible field of velocities, namely (z,1). It is collinear with the field of limiting velocities of the previous system on the hyperbola g2- x’ = 1. The SD-boundary of the new system is the closure of the union of the parts of this hyperbola lying in the second and fourth quadrants and the parts of the lines g2 = 1 lying in the first and third quadrants. Thepoints (0,f l ) of this boundary are nonzero-passing points, and (-a, a’) where a = -((l f i ) / 2 ) 1 / 2 is a &turning point. The other points of this boundary belonging to the hyperbola (respectively to the set y2 = 1 ) are B-passing points (respectively regular zero-points).
+
Example 9. The steep domain of the control system in the plane given by the velocity fields (z+ cos U, Icy + sinu) (where k > 1 and U E S1 is an angle) is the region z2 + k2y2 > 1. Its boundary points ( f 1 , O ) and (0,f l / k ) are black zero-points, and all other points of the boundary are regular zero-points. Theorem 3 ( [ l ] )For . a generic ‘control system any point of the SDboundary is of one of the following seven types: a zero-passing point, a B-passing point, a 6-turning point, a double &passing point, a nonzeropassing point, a regular zero-point, or a black zero-point.
2.3. Singularities and local controllability on the boundary
of the steep domain First we introduce a notion of “singularity”. Two objects of the same nature (sets, mappings, vector fields, .) are called equivalentat a point
Controllabilityof Generic Control Surfaces Systems on
121
if they coincide in some neighborhood of this point. An object’s germ at a point is defined to be its equivalence class at this point. T w o germs of objects of the same nature are called Ck-di#eomorphic if there exists a germ of Ck-diffeomorphism that maps one of the germs to the other. A Ck-singularity(or singularity) is defined to be a class of Ck-diffeomorphic germs.Words‘‘An object A has a singularity B at some point” means “the class of Ck-diffeomorphicgerms defined by the germ of this object at this point is the singularity B”.
Example 10. The set g 2 1s’ - 11 has the same C”-singularity at the two points (h1,O).The function f : s I-+ 1s’ - 11 has the same Cm-singularity at fl (Fig. 4).
Fig. 4. Now we have all tools to describe the singularities of a generic control system on ,the SD-boundary. First we investigate such singularities in a simplest case, namely for a generic bidynamical system (#V = 2), next for a generic polydynamical system (#V E N), then for a generic simplest differentialinequality, and finally fora generic control system (with any admissible U). We will showwhat alterations takeplace on the SD-boundary of a generic control system when changing the set of control parameters from the simplest case to a general one. For simplicity we suppose that our phase space is RE,,.
Davydov
122
Bidynamical systems. Admissible velocitiesV=(VI, v 2 ) and w = ( w 1 , 2 0 2 ) of a generic bidynamical system do not vanish simultaneously, and zero is a noncritical value of the function ~ 1 - ~ 2 2 021 .Hence these velocities are collinear on a smooth curve, and admissible velocities define a field of straight lines along it. In general, last field rotates along the curve and may be tangent to it at some points. In a generic case each such tangency is of the first order. Moreover, all singular points of admissible fields of velocities are nondegenerate and different from any such point of tangency. So any such tangency point lying on the SD-boundary is a 6-turning point, and any singular point of an admissible field of velocities isa zero-passing point. All other points of the SD-boundary are &passing points. The following theorem gives a complete classification of singularities on the SD-boundary for a generic bidynamical system. Theorem 4 ([l,6 , 71). Let z be a point of the boundary of the steep domain of a generic bidynamical system. Then: 1. The point z is either a) a zero-passing point, b) a &passing point, or c) a &turning point,
and the C"-singularity at z of thesteepdomain Cm-singularity at zero of the set, respectively,
a) (Y # 0) U (c.01,
is thesame as the
w-4 9 # 0.
2, The C"-singularity at z of the LC-net is the same as the Cm-singu1a-
rity atzero of the LC-net of the bidynamical system given by one of the following three pairs of vector fields: a)
(*L.),
-
b) (&l,%/
c)
( f b 2
- v)
according as z is, respectively, a) a &passing point, b)-c) a &turning point. 3. If z is a zero-passing point, then the Co-singularityat z of the LC-net is
Controllabilityof Generic Surfaces Control Systems on
123
the same as the CO-singularity at zeroof the LC-net of the bidynamical system given b y vector field ( 1 , l ) and one of the following vector fields:
4 (5,-g),
b) (-5,-2Y) or (5,2Y),c)
-
(-. !/,S)07- (5- Yr .),
according as the corresponding singular point of the admissible field of velocities is, respectively, a saddle, b) a stable or an unstable node, c) a stable or an unstable focus. a)
4. The point z has S L T P (respectively LTP) if and only if it is a &passing point (respectively either a &passing or a focal zero-passing point). 5.
If z is a singular point of a field v1 of admissible velocities then the ratio of the eigenvalues of the linearization of this field at z is different from +l, and the value of the other admissible vector field at this point is not an eigenvector of the linearization of the field w1 at z .
2a
Fig. 5 (parts 2a, 2b, 2c)
Davydov
124
Figure 5 illustrates the singularities described in Theorem 4. The thick line represents the boundary of the steep domain, the double line represents the rest of the line v1202 - v2wl = 0 (the collinearity line of the admissible vector fields), the dashed and solid lines represent limiting curves of the two branches of the field of limiting directions, and thepoint z is indicated by a small triangle if it has LTP, and with a small circle if not. Subcaaes are labeled according to the statement of Theorem 4.
3a
on
3b
on
3c Fig. 5.
Controllabilityof Generic Control Systems
on Surfaces
125
Remark. The bidynamical systems pointed out in statements 2 and 3 of Theorem 4 represent stable realizations of the corresponding singularities. Polydynamical systems. Adding to U one more value of the control parameter and considering three-dynamical systems, we get a wider list of generic singularities on the boundary of the steep domain. Note that according to Theorem 2 for a generic three-dynamical system any point of the SD-boundary is the point of the SD-boundary of some bidynamical subsystem. According to Theorems 3 and 4 for a generic bidynamical system the SD-boundary is the union of all zero-passing points, B-passing points and B-turning points. It is not difficult to prove the following fact. Proposition. For any bidynamical subsystem of a generic three-dynamica1 system all statements of Theorem 4 are valid. firtherrnore, the boundaries of the steep domains of any two bidynamical subsystems can only havetransversal intersections, and suchan intersection canonly occur either at a zero-passing point or at a B-passing point for both subsystems simultaneously. The following theorem gives a complete classification of singularities on the SD-boundary of a generic three-dynamical system. This theorem is a simple consequence of the Proposition and Theorem 4.
Theorem 5 ([l]).Let z be a point of the boundary of the steep domain of a generic three-dynamical system. Then: 1. The point z is either a) a zero-passing point,
b) a &passing point, c) a &turning point, or d) a double B-passing point,
and the C*-singularity at z of the steep domain is the same as the C*-singularity at zero of the set, respectively,
Davydov
126
2. The Cm-singularity at z of the LC-net is the same as the COO-singularity at zero of the LC-net of the three-dynamical system given by one of the following five triplesof vector fields: a) ( f 1 , z ) and ( 0 , l ) (family of semiparabolus), b ) ( f l , y - z 2 ) and eitherbl) ( 0 , l ) (folded focus) orb2)(0, -1) (folded
saddle), c ) ( f l , z 2 - y ) and eithercl) ( 0 , l ) (folded saddle) o r 4 (0, -1) (folded focus) , according as z i s , respectively, a &passing point, b)-c) a &turning point. a)
3. If z is a zero-passing point, then the Co-singularity atz of the LC-net is the same as the Co-singularity of the LC-net of the three-dynamical system given by one of the following eight triples of vector fields: 81) (5, -g),
( 1 , l ) and either (2, -1) or (-2,l) (folded saddle);
a2)
(5, -y),
(-1,2) and ( 2 , l ) (family of semiparabolus);
as)
(2,- g ) ,
( 2 , l ) and (1,2) (folded monkey saddle);
bl) (1, & l ) and either (-z, -2y) or (z, ay) (folded saddle); b2) ( f l , 1) and either (-z, -2y) or (z,2y)(folded node); b3)
(-1,2), (2, -1) and either
(-3,
-29) or (z, 2y) (family of semipa-
mbolas); b4)
(1, l ) , (2,3) and either (-z, -29) or (z, 2y) (folded saddle-node);
c ) (l,O), (0,l) and (z - y,z) (family of semipambolas), according as the corresponding singular point of the admissible field of velocities is, respectively, a saddle, bl)-b4) a node (stable or unstable, which is clear from the kind of a triple), c ) a focus, &1)-83)
and (except case c ) )
Controllability of Generic Control Systemson Surfaces
127
al) onlyone eigendirection, a2) both eigendirections, as) neither eigendirection, bl) only the eigendirection with eigenvalue smaller in modulus, b2) only the eigendirection with eigenvalue larger in modulus, b3) both eigendirections, b4) neither eigendirection
can be given by velocities of the cone of z . 4.
If z is a double &passing point, then the CO-singularityat z of the LCnet is the same as C’=”singudarity of the LC-net of the three-dynamical system given b y one of the following three triples of vector fields: a) (-1,O) and either (1, -9 f z) or (l, f 2); b) (0, -1) and ( y f q1).
if it is either a &passingpoint (maybe double) or a &turning point with the “foldedfocus” singularity of the LC-net (see 2b1) and 2 ~ 2 ) )and has LTP if and only if it either has SLTP or is a zero-passing point with the ‘?family of semiparabolas” singularity of the LC-net (see 3a2), 3b3) and 3c)).
5. Thepoint z has SLTP if andonly
Remarks. 1. Folded nodes, foci and saddle-nodes may be stable or unstable. In the case of a zero-passing point the stability of a folded node and a folded saddle-node is defined to be the stability of the corresponding node of the field of admissible velocities. For a folded focus the kind of stability is clear from the directions of the motion along limiting curves with limiting velocities, namely we have a stable (respectively an unstable) folded focus if the motion is directed towards (respectively away from) the singular point. 2. The three-dynamical systems exhibited in statements 2, 3 and 5 of Theorem 5 represent stable realizations of the corresponding singularities. 3. The topological classification of singularities of the LC-net of a control system on the plane given by finitely many analytic vector fields was found in [8].
Davydov
128
For polydynamical systems with #U > 3, we get the same list of generic singularities on the SD-boundary with the same nature except those at double B-passing points. Theorem 6 ([l]). Let z be a double B-passing point of a generic control system with #U > 3. Then: 1. The C”-singularity at z of the steep domain is the same as the Coosingularity at zem of the set y > 1x1, and z has SLTP. 2. The C’-singularity at z of the net of limiting curves is the same as the CQ-singularityat zem of the net of limiting curves of the polydynamical system given by one of the following two quadruplesof vector fields:
either a) ( - l , O ) , (1,l) and (1,-y/fz),
or b) (0, -l), (1,l) and (yfz,1).
For more general control systems with U including some smooth closed manifold of values of the control parameter, we get topologically the same list of generic singularities on the SD-boundary as for #U = 4.But there may appear folded saddles, nodes and foci of other nature. To see this we will consider a simplest differential inequality. Simplest differential inequality.Consider a differential inequality of the form (5 - v ( w ) ) 2
+ (0- w(z,2/))2 5 1
where ( v ,W )is a smooth vector field. Note that theinequality has the same local controllability properties as the control system
S = v(z, y) + cos U ,
Q = w(z,y) + sinu
where U E S1. Their steep domains coincide with the region v 2 + w2 > 1. In a generic case, 1 is a noncritical value of the function v2 + w2 (or, in other words, d(v2 w2) # 0 if v2 w2 = 1). So the SD-boundary is a smooth curve (v2 w2 = 1). On this curve the field of limiting directions can be defined by the vector field (-W,v). In general, the last field rotates along this curve and may be tangent to it at some points. In a generic case any such tangency is of the first order. Any such tangency point is a black zero-point, and the other points of this curve are regular zero-points,
+ +
+
Controllability of Generic Control Systems on Surfaces
Theorem 7. For a generic simplest differential inequality control system) the following two statements are valid:
129
(a generic
1 ([l]). By means of a n appropriate Coo-diffeomorphism of the phase space and by multiplication with some positive function the germ at a point x of the field of limiting velocities can be transformed to the germ at zero of the vector field
either a)
(v, fy'/')
or b) ( f y ' / ' , y b ( z ,y) F y 1 / 2 a ( z g, ) )
where a , bare smoothfunctions,b(0,O) = &l, a(0,O) = 0 # a,(O,O) # 1/8, if z isrespectively a) aregular zero-pointor b) a black zero-point, and near z the SD-bounday is smooth. 2 ([3]). Any regular zero-point has SLTP. No black zero-point has S L T P , but it has L T P if and only if it gives a "folded focus" singularity of the LC-net (precisely, this happens when 1/8 a,(O,O)). Remark. At a black zero-point the LC-net of a generic control system has a folded saddle, a node, or a focus for a,(O, 0) < 0 , 0 < a,(O,O) 1/8, and 1/8 < a,(O,O), respectively [g]. Topologically, all folded saddles are the same, as well as all nodes, and all foci. In Figure 6 the four singularities of Theorem 7 are depicted. In addition to the marking of Fig. 3, a point is marked by a small triangle if it has LTP and by a small circle if it does not. Consider now the generic case with any possible set U. If the set has no isolated values of the control parameter (for example, it is the n-dimensional sphere, n E N) then for a generic control system each boundary point of the steep domain is either a &passing point, a &turning point, a double &passing point, a black zero-point, a regular zero-point, or a nonzero-passing point. Furthermore, at a point of each of the first five types the control system has the respective singularities described above (in Theorems 5 , 6) [l]. To understand the generic behavior near a nonzero-passing point it is useful to introduce some new notions. Locally a control system can be written in the form (1). Denote by L(z,u) the subspace Rf ( z ,U ) f,,(z,u)T,U of T,M. A value U of the control parameter iscalled singularat a point z if L ( z , u ) # T,M (a
+
130
Davydov
singular value of the control parameter gives a singular velocity). The union of all points ( z , U ) with a singular control U at z is called the singular surface of the control system. The restriction of the projection (z,U ) I+ z to thesingular surface is called the folding of the system. The restriction of a control system to its singular surface gives the field of singular velocities of the system.
Remark. The field of singular velocities and the singular surface play an important role in the investigation of the field of limiting directions. Each limiting velocity is singular. But very often a singular velocity at a point belongs to the interior of the cone of the paint, and so it is not limiting at this point.
Controllabilityof Generic Control Surfaces Systems on
131
According to the definition, at a nonzero-passing point z there are exactly two different limiting values of the control parameter. One of them(denoteit by u l ( z ) ) gives a nonzero velocity at thispoint, and the other u ~ ( z gives ) a zero velocity and is a nonisolated value of the control parameter. In a generic case the points (z, ul(z)), ( z , uz(z)) of the singular surface of the system are a regular point and a critical point of Whitney fold type of the system’s folding, respectively. The restriction of the control system to the germs of its singular surface at these points gives the germs at z of two vector fields v1,v2, respectively. Near z the field v1 is a smooth branch of the field of singular velocities, but the field v2 is not. In the generic case v2 has the same singularity at z as the field of limiting velocities of a generic control systemhas at a regular zero-point (see Theorem 7). The germ at ( z , u ~ ( z ) of ) the set of critical points of the folding is mapped by this folding into the germ at z of a smooth curve y. Near z the field v2 is identically zero on this curve, but by means of the subspaces L(., .) it defines a smooth field L2 of straight lines on this curve. The field v1 also defines a smooth field L1 of straight lines near z (Fig. 7; velocity indicatrices are depicted by double thinlines). The fields L1, Lz rotate along the curve, and in general they may be tangent at some points. In the generic case the nonzero-passing points are exactly those points of such tangency where the fields have limiting directions. The following theorem describes the singularities of a generic control system at its nonzero-passing points. Theorem 8 ([l]). Let z be a nonzero-passing point of a generic control system.Then: 1. The steep domain has the same Cm-singularity at z as the set g
> 21x1
has at zero. 2. The limiting directions at z do not lie in the tangent space of the SD-
boundary at a. 3. The LC-net has the same CO-singularity at z as the LC-net of threedynamical system given by the vector fields (It1,x) and ( 0 , l ) has at
Davydov
132
any of its &passing points (see 2a) of Theorem 5 ) , and the point z has SLTP. 4. The corresponding points ( . z , u ~ ( z ) and ) ( z , u ~ ( z ) are ) a regular point and a critical point of Whitney fold type of the folding of this system, respectively.
Fig. 7. Table 1 contains a complete list of generic singularities which can appear on the SD-boundary of a generic control system. Types of points are indicated in the first column, and the corresponding possible subcases are indicated in the second column. The list of the corresponding singularities of the SD-boundary and the LC-net are indicated respectively in the third and fourth columns (the abbreviation, for example, 5 . 2 ~means “singularity 2a) from Theorem 5 ” ) . Finally, local controllability properties of a point with such singularity are indicated in the fifth column, and the singularity is possible when the number of different values of the control parameter is as indicated in the last column.
Theorem 9 ([l]).The singularities listed in Table 1 are the only singularities that can appear on the boubdary of the steep domain of a generic control system, and they all are stable under small perturbations of the system. Namely, for any control system suflciently close to the original system the steep domainsof these systems and pointsof boundaries of their
Controllabilityof Generic Control
Systems on Surfaces
133
steep domains with the same singulardies canbe mapped into each other by a Ccz-diffeomorphism of the phase space that is C1-close to the identity. Table 1. Singularities of the field of limiting directions on the boundary of the steep domain,
I
I
I
I
I
The following fact is an immediate consequence of Theorem 9. According to the typeof the singular point of the corresponding field of admissible velocities in the case of a zero-passing point and to the type of the corresponding folded singular point of the limiting curves net in the other cases. “-”, “LTP” and “SLTP”mean respectively “fails LTP”, “has LTPbutnot SLTP” and “has SLTP”.
Davydov
134
Corollary. For a generic control system the sets of points with the same local controllability properties are stable under small perturbationsof the system.
2.4. Singularities of the field of limiting directions
in the steep domain These singularities do notinfluence the local controllability near points of the steep domain because at a point of this domain we have a drift. Namely, any admissible motion starting from this point leaves its small neighborhood in a time close to zero. So points of the steep domain fail LTP. But these singularities are important in the investigation of nonlocal controllability which will be done below. Nowwe are going to describe generic singularities of the field of limiting directions in the steep domain. Assume that the phase space is oriented, and a smooth reference direction for measuring angles in the tangent planes is fixed (all results of this subsection automatically carry over to the case of an unorientable phase space), Denote by n1(.) and n2(.) the angles corresponding to theminimal L1(.)and maximal L2(.) limiting directions, respectively. A limiting control at a point z will be called an i-limiting control if the velocity it gives at E lies on the straight line RLi(z), i = 1,2.The i-passing set is defined to be the union of all points having at least two different i-limiting controls. The passing set is the union of the l-passing set and the 2-passing sets. A point z in the steep domain is called an i-nonsingular (respectively, i-passing, i-turning, double i-passing, or a - c u t o f ) point if a) the number of different i-limiting controls at this point is equal to 1 (respectively, 2, 2, 3, l),b) the order of contact of the indicatrix at the point with the line RLi((z) is < 2 at each of the common points (respectively, < 2, < 2, < 2, = 3), and c) only in the case of an i-turning point this line is tangent to the closure of the i-passing set. Remarks. 1. The order of contact of a straight line and a set at their common point is defined to be 1 less than the order at this point of the zero of the function “distance from a point on the line to the set”,
Controllabilityof Generic Control Systems
on Surfaces
135
2. Here and henceforth, unless otherwise stated, the indices i and j take values 1 and 2, and, if they occur simultaneously, then i # j.
Example 11. The i-passing set of the bidynamical system in the plane given by the velocity fields (l,k ( y - z2))is the parabola y = z2. All points of the parabola except the origin are i-passing points, and the origin is a i-turning point (compare with Example 5 ) . Example 12. The passing set of the three-dynamical system in the plane given by the velocity fields (1,0), (1,y - s),(1,s y ) coincides with the set z(s2-y2) = 0. The i-passing set is the union of the set y =1 . 1 and the negative y-axis for i = 1, and is the union of the set y = -131 and the positive y-axis for i = 2 (the positive direction being counterclockwise). All points of the i-passing set except the origin are i-passing points. The origin is a double i-passing point (compare with Example 6).
+
Example 13. The origin is a l-cutoff point of the control system in z cos U y sin U and the plane defined by the equations j. = "(cos U = 1 sinu where U E S'.
+
+
+
Theorem 10 ([l]).Let z be a point of the steep domain of a generic control system. Then: 1. The point is of one of the following types: a) an i-nonsingular point,b) an i-passing point, c) an i-turning point, d) a double i-passing point, e) an i-cutoff point. 2. The Cw-singularity of the net of i-limiting curves at x is the same as the Cw-singularity at zero of the family of integral curves of the equation, respectively, a) y' = 0, b) y' = zsgns, c) y' = ( y - s2)(1 sgn(y - z2)),d) y' = max(0; zY1 (z, y); (x y ) Y 2 ( s , y ) }where , YIand Y2 are smooth functions with Yl(0,O) > yZ(0,O)> 0, e) y' = Y(s,y), where the function Y is continuous and continuously differentiable in y, with Y ( 0 , O ) = 0 , andthederivative Y, iscontinuouseverywhere except the positive y-axis. 3. Thepassingsetanditssubsets of points of thesametype are stable under small perturbations of the system. Namely, for any control
+
+
Davydov
136
system suflciently close to the original system the passing sets of the two systems and their subsets of points of the same typemapped to one another by a C"-diffeomorphism which is C'-close to the identity. In particular, any i-turning (respectively, double i-passing) point is j-nonsingular if #U > 2 (respectively #U > 3). Obviously, singularities of the i-limiting curves net are connected with the singularities of the function ni. This function is the maximum (i = 2) or the minimum (i = 1) of a family of functions depending on a parameter (here the parameter is a point of the steep domain). The generic singularities of such functions are studied in [lo, 11, 121.In our case for a generic control system and any point of its steep domain the germ at this point of the function ni can be mapped (by means of a C"-diffeomorphism and adding a smooth function) the germ at zero of one of the following four functions: 0,
(-1)ilzl,
I
( - ~ ) i ( ~ ~ + ~ ~ (-1)immax{-w4+w2y+wz ~ ~ + / ~ ~ ) , W
E R)
according as this point is, respectively, an i-nonsingular point; either an ipassing point or an i-turning point; a double i-passing point; or an i-cutoff point.
Remark. In the analytical case the normal forms of the germ of the net of i-limiting curves at an i-turning point and the germ of the LC-net at a &turning point contain functional moduli connected with the moduli described by Ecalle [l31 and Voronin [14].
3. The attainable set and its singularities Here and henceforth, unless otherwise stated, control systems on a closed orientable surfaces are considered. In this section we investigate the attainable set ,(= the positive orbit of some initial set) of such systems. We will show that for a generic control system the attainable set is stable under small perturbations of the .system and its boundary is either empty or a smoothly embedded curve with singular points of finitely many types.
Controllabilityof Generic Control Systems
on Surfaces
137
3.1. Asymptotic stability of the attainable set Sometimes a control system may beginan admissible motion from some chosen set of the phase space. This set will be called here the start set. By the attainable set of the control system we understand the positive orbit of the start set. Example 14. Consider the bidynamical system in the plane given by the velocity fields(fl, z2-v). If a start set S lies in the region y > z2 then the attainable set is the open region situated above the union of the phase curves of the fields (or the limiting curves) outgoing from zero (Fig. 8; i-limiting lines are indicated by either solid or dashed lines, the attainable set is shaded, and its boundary is depicted by the respective thick lines). The boundary of attainability is the smoothly embedded curve near any of its points except the origin. At the origin the boundary (respectively the attainable set) has the same Cm-singularity as the set y = (%l3 (respectively y > [ . l 3 ) has at zero. It is easy to see that these singularities are stable under .small perturbations of the system. Namely, the attainable set of any system sufficiently closeto the original system has the same singularities at some point that is close to the origin. A subset A of the phase space is called stable (with respect to a system) if for any E > 0 there exists a 6 > 0 such that each trajectory of the system with initial point z ( t o ) in the &neighborhood of A exists for t o 5 t < 00 and lies in the +neighborhood of A. If, in addition, the distance from the point z ( t ) of this trajectory to A tends to zero as t + 00, then A is called asymptotically stable [15]. Henceforth we will suppose that a start set is the union of finitely many points and some closed one-dimensional submanifold in the phase space. Theorem 11. Theattainableset of agenericcontrolsystemona closed orientable surface is asymptotically stable. Theorem 12 ([2]). For a generic control system on aclosed orientable surface, if a closed set belongs to the interior of its positive orbit, then the orbit is asymptotically stable.
138
Davydov
3'"
Fig. 8.
Fig. 9.
2
Controllability of Generic Control
Systems on Surfaces
139
Remark. Theorem 11 can be proved analogously to Theorem 12.
Example 15. Consider the bidynamical system in the plane given by the velocity fields (-z - 1;- 2 . 1 ~- 2.1) and ( - S 1; -2.1~2.1). These fields drive everything to the points (-1, -1)and (1,l), respectively. The positive orbit of the origin is bounded by the union of the phase curves of the fields outgoing from their singular points. It is easy to see from Fig. 9 (the marking in this figure is the same as in Fig. 8) that the orbit is open and asymptotically stable.
+
+
3.2. Structure of the boundary of the attainable set Obviously SLTZ does not intersect the boundary of the attainable set, nor does L T Z . Hence the boundary is contained in the union of all points failing LTP. Moreover, in the generic case the boundary of the attainable set has a definite structure, and we are going to describe it. Let a point z of the start set belong to the boundary of attainability. Then z will be called an ordinary start point if either z is an isolated point of the start set or near z the boundary coincides with the start set, and z will be called a breakdown (respectively, return) start point if z is a nonisolated point of the start set and the germ of the boundary at z contains the germ of a limiting curve outgoing from z (respectively, incoming to z). Example 16. Consider the bidynamical system in the plane given by the velocity fields (1,H ) . If the startset is ( O , O ) U ( ( S - ~ ) ~ + ( ~ - ~=) ’8) then the attainable setcoincides with theclosed set shadedin Fig. 10 (with the same marking &S in Fig. 8). The points A and B(= (1,4)) are a return start point and a breakdown start point, respectively.
Theorem 13 ([4]).For a generic control system on a closed orientable surface the following three assertions hold: 1. Any point z of the start set belonging to the boundary of the attainable set is either a) an ordinary start point, b) a breakdown start point, or c) a return start point.
Davydov
140
as the C"singularityatzero of, respectively,theset a) either al) p 0 or a2) p 2 1x1 (if z is a nonisolated start point or an isolated start point, respectively), b) g 2 x [ ~ [and , c) either cl) p 5 1x1 or CZ){p < )1.1 U {{v = x) n {Z 2 0))3. The germ of the bounday! of attainability at z is respectively the germ 2. The P-singularity at z of the attainable set is the same
a1) ( s , z ) ,
212)
(17l+(z)w,+(z),z),
>
b) (s+u17W,.z), 4 (s+u17i(.z),z),
where S and S+ are respectively the start set and its part contained in the bounday! of attainability, and q F ( z ) ,$ ( z ) are limiting curves also contained, near this point, in the boundary. Remarks. 1. The singularity 2c2) (or 3c)) of Theorem 13 has a stable realization on the boundary of the attainable set for the bidynamical - p), if the start system in the plane given by the velocity fields (fl,s2 set is the circle (x + + (g - 2 - 2e-l)' = 1 (Figure 11; in addition to the marking of Figure 10, singular points of the boundary of attainability are marked by natural numbers according to their types defined below). 2. By (V,z ) we denote the germ of the set V at the point z, and BV is the boundary of the set V . Outside the start set the boundary of attainability of a generic control system has the same structure (and so the same singularities) as the boundary of the positive orbit of a closed subset lying in the interior of its orbit. To describe this structure we introduce some new notations. Fix a continuous reference direction for measuring angles in the tangent planes of the phase space. Just as above, for z in the closure of the steep domain we denote by L1 ( z ) and L2 ( z ) the minimal and maximal directions, respectively, of the admissible velocities at z. By vi(%) ( q t ( z ) and q;(z), respectively) we denote the limiting curve of the branch Li of the field of limiting directions with the point z included and passing through z (leaving z and incoming to z , respectively). Denote by O+(S)and O-(S) the positive and negative orbit, respectively, of a subset S of the phase space.
Controllabilityof Generic ControlSystems on Surfaces
Fig. 10.
fl
141
2
(x-3) +
Fig. 11.
.. .
. ..
..
_,
.
.... ,.., I
. I .
.... ... .....
I
....... ..... .
,
.
..I
.
. .. . ..
Davydov
142
It is known that for a generic control system the closure of the positive (negative) orbit of any subset of the phase space coincides with the closure of the interior of that orbit and is a manifold with boundary. Moreover, the boundary is a CO-hypersurface in the phase space [lS].
Theorem 14 ([2]). For a generic control system on a closed orientable surface, let S be aclosed subset contained in the interior of its positive orbit. Then: 1. The boundary of that an orbit is contained in the union of the steep domain and the set of folded singular points of saddle, stable node,
monkey saddle, and stable saddle-node type. 2. The germ of the boundary at any of its points lying in the steep domain coincides with one of the following three germs: ai)
(rlik),
z);
b)
(771(4U va(4, 2).
If (qa(z),z) = (OO+(S),z),then: 3. The limiting curveqi(z) is an incoming separatrix for no folded singular point, and one of the following two assertions holds: 4. qa(z) is a cycle contained in 6O+(S), and (qi(z),A ) = (BO+(S), A ) for
each A
E qi(z);
5 . qi(z) is an outgoingseparatrix of a foldedsingularpoint
of saddle,
monkey saddle or stable saddle-node type. Theorem 15 ([2]). For a generic control system on a closed orientable surface, let S be a closed subset contained in the interior of its positive orbit, and let z be any point of the intersection of the boundary of this orbit with the boundary of the steep domain. Then: 1. The germ of this orbit at z contains the germ of S L T Z ( L T Z ) at z. 2. The germ at z of the boundary of the orbit coincides with one
of the
following germs: a folded singular point of saddle type; in this case near z the outgoing separatrices $ ( z ) and $ ( z ) separate the incoming sepamtrices q; ( z ) and q ; ( z ) from S L T Z ( L T Z ) ;
a) ( $ ( z ) U q $ ( z ) , z ) if z is
Controllabilityof Generic Control Systems on Surfaces
143
b) (qi( z ) U qg ( z ) ,z ) if z is a folded singular point of stable node type; in this case the curves q,(z) and q g ( z ) are not separatrices of this node; c) (qf(z) U q$(z),z ) if z is a folded singular point of monkey saddle type; in this case the curves qf(z) and $ ( z ) are outgoing sepamtrices of this singular point, as well as outgoing sepamtrices of a viewed as the singular point of saddle type of the admissible field of velocities determined by the corresponding isolated value of the control parameter; d) eitherdl) ( q ; ( z ) U q g ( z ) , z ) ordz) (qJz)Uq+(z),z) i f z is a folded singular point of stable saddle-node type; in this c w e only the curve $ ( z ) is a separatria: of this saddle-node.
Remarks. 1. If #V = 2, then for a generic control system a folded saddle and a focus occur simultaneously at a &turning point. Thus in this case a folded focus can also appear on the boundary of attainability. 2. In the case of the germ 2b) of Theorem 14 the point z will be called a point of fusion. 3. When changing the direction of movement, positive orbits become negative and vice versa. Hence, Theorems 14 and 15 also hold for negative orbits, butit is necessary to change the upper indices “+” of limiting curves to ‘$-”and vice versa, and the words “incoming”, “outgoing”, and “stable” to the words “outgoing”, “incoming”, and “unstable”, respectively. Figure 12 illustrates the structure of the boundary of attainability described in Theorems 14 and 15. In addition to themarking of Figure 8 the interior of the attainable set is shaded by slanted lines and the interior of SLTZ (LTZ) by vertical lines. 3.3. Singularities on the boundary of the attainable set
In Theorem 13 we have described the generic singularities on the boundary of the attainable set at its points belonging to the start set. Here we deal with the singularities on the boundary of attainability outside the start set.
..
. ,.
.
..... ... ,.
,_,.. jC*:LL.Y1”,,.“,.”“..~......_...,.,
“...,.,.......,..‘._..*.*~,,I
.I
I
,
,
. .... . ... . , . . .-.,
.,”.
...,...,_..
144
Davydov
14.2a
14.2b
15.2a
15.2 b
1Sd, Fig. 12
Controllabilityof Generic Surfaces Control Systems on
145
A point of the boundary of attainability will be called a singular point of type p , 1 5 p 5 6 , if the germ of the interior of the attainable set at that point is C"-diffeomorphic to the germ at zero o f l+)y > (1 or 1-) y < 1 3 1 for p = 1; y > I ~ l z p -for ~ p = 2,3; < y < z, where E = f l , for p = 4; y < ( E c(sgnz - l))lzla,where E = f l and e/2 # c E R,for p = 5 ; y < h(z)for p = 6 , where the germ at zero of the graph of y = h(z) is the germ at zero of the closure of the union of two nonsingular phase curves of a folded node
+
y = (dy/dz
+ a(a + 1)-2z/2)2,
entering zero in opposite directions; everywhere a > 1 is not an integer.
Remark. A singular phase curve of a (folded) node is a phase curve incoming to or outgoing from the corresponding singular point which is extendable through the singular point as a smoothly embedded curve; for noninteger exponent of the node there are exactly four such phase curves. The exponent of a singular point of node or saddle type is the ratio of the largest (in modulus) to the smallest eigenvalue of the linearization of the field at the point. The exponent of a folded singular point is equal to the exponent of the singular point of the preimage. We observe singularities of type 1 at the points (0,O)and A and of type 2 at B in Fig. 10, of type 3 at zero in Fig. 8 and of type 4 at ( 1 , l ) and (-1, -1) in Fig. 9. All these singularities are stable under small perturbations of the considered systems. The following examples give stable realizations of the singularities of types 1, 2, 4, 5 and 6 (see also [2, 9, 171). Example 17. Consider again the bidynamical system in the plane given by the velocity fields (-S - 1; - 2 . 1 ~- 2.1) and (-z+ 1; -2.lyf2.1) (see Example 15). If the start set is the union of the point (0, -2) and the + (y - = 1 thentheattainable set isshownin Fig. 13 circle (z + (Figs. 13, 14 have the same markings as Fig. 8). On its boundary one can see singularities of types 1, 2, 4 and 5 labeled with the respective numbers. Example 18. Consider the control system in the plane with velocity indicatrices consisting of the fields (z cosu, ky sinu), where u E S1 and k > 2 is not an integer. The steep domain is the region za k2y2 > 1
+
+
+
Davydov
146
I
Fig. 13.
Fig. 13
Fig. 14.
Controllabilityof Generic Control Systems
on Surfaces
147
and has four black zero-passing points on its boundary (see Example g), namely, at (&l, 0) we have folded saddles with exponent (1 - k)“k, and at (0, &l/lc)folded nodes with exponent a = k - 1. A start set consisting of two points A and B (Fig. 14) may be chosen in such a way that the attainable set has (the same) singularity of type 6 at the two nodes. A point of the boundary of the attainableset will be called a nonaingular point or a singular point of type p = 0 if near this point the boundary is a smoothly embedded curve. Table 2 contains a complete list of generic singularities which can appear on the boundary of attainability of a generic control system. Types of points which can lie on that boundary are indicated in the first column, and the corresponding possible subcases of types of singularities at those points are given in the second column. The list of the corresponding singularities of the LC-net and the germs of the boundary of attainability are given in the third and fourth columns, respectively. In the fifth and sixth columns we indicate whether the attainable set contains the parts of limiting curves lying on the boundary near the singular point, and thispoint itself, respectively (“+” , “-” and “f” mean respectively “yes”, “no”, “sometimes yes, sometimes no”; the number of signs is equal to the number of those parts). Note that the attainable set contains only those parts which are contained in the limiting curves outgoing from either ordinary isolated start points or breakdown start points.
Theorem l6 [2,4]. For a generic control system ona closed orientable surface, the following three assertions hold: 1. The closure of attainable set coincides with the closure of its interior. 2. The singularities listed in Table 2 are the only ones which may appear on the boundary of the attainable set. 3. All these singularities are stable under small perturbations of the system. Namely, for any control system suflciently close to the original systemtheattainablesets of the two systems can be transformed to each other by a homeomorphism of the phase space which is closeto the identity; the homeomorphism canbe chosen tobe a C“-diffeomorphism everywhere except possibly at singular points of types 4,5, 6.
Davydov
148 Table 2. Singularities on the boundary of attainability.
“SD”= “a point of the steep domain has no folded type”; monkey saddle, saddlenode and saddle types for zero-passing points give singularities of the net from Theorem 5 if #V > 2; here stable folded singular points of node and saddle-node type are admitted only. ‘h++” = “1- and Z--nonsingular”, ‘h&” = “the point is either an i-nonsingular point, i = 1,2,or a passing point of one of the two branches (and if #U = 2 of both of them) of the field of limiting directions and a nonsingular point for the other”. “no” = “near such a point the boundary of attainability coincides with the start set”; in the “i-nonsingular (i-passing) point” or “fusion point” case, in the last column we have <‘+”if there is at least one l‘+” in the preceding column.
-
Controllabilityof Generic Control Systems
on Surfaces
149
Remarks. 1. The exponent a, of a singular point of type 4, 5 , or 6 is invariant under Cm-diffeomorphisms.It can change under small perturb& tions of the control system. So in general the transforming homeomorphism will not be smooth. 2. Theorems 11, 13, 14, 15, 16 automatically carry over to the case of the unorientable phase space [4]. The following fact is an immediate consequence of Theorems 10 and 16. Corollary. For a generic control system any point of the boundary of attainability belonging to thesteepdomaincanonlg be one of two types, namely, either an i-nonsingular point or an i-passing point.
4. Stability of nonlocal controllability Here we investigate nonlocal controllability properties (that have no connection with the startset) for genericcontrol systems on a closed orientable surface. In particular, we study open domains D in the phase space with property that D coincides with the intersection of the positive and the negative orbit of any point of D. It will be shown that for a generic control system, such domains are stable under small perturbations of the system. Finally, we will show that the family of trajectories (or, in the other words, family of orbits of points) of a generic control system are structural stable in the classical sense like the family of phase curves of a generic differential equation on a closed orientable surface. 4.1. Structure of boundaries of nonlocal transitivity zones
An open subset of the phase space coinciding with the intersection of the positive and the negative orbits of any of its points is called a nonlocal transitivity zone (NTZ). It is easy to see that any two points of a NTZ are attainable from each other, and hence a N T Z either does not intersect the positive or negative orbit of a point or is contained in that orbit.
150
Davydov
Example 19. Consider again the control system in the plane with velocity indicatrices consisting of the fields (z+cos U, ky+sinu), where U E S” and k > 2 is not an integer (see Example 18). Its nonlocal transitivity zone is the open region bounded by the closure of the union of the outgoing separatrices of folded saddles (Fig. 15; here in contrast to the marking in Fig. 11 the N T Z is shaded and its boundary is depicted by the respective thick lines). Here the positive orbit of N T Z is the zone itself, and the negative orbit is the whole plane.
Fig. 15. The following theorem describes the structure of the boundary of a N T Z in the generic case.
Theorem 17 [2]. Let Z be a nonlocal transitivity zone for a generic control system on a closed orientable surface. Then: 1. The germ of Z at each point a of its boundary is equal to the germ at z of O + ( Z ) (O-(Z), respectively) if z E O - ( Z ) ( a E O + ( Z ) , respecti2.
. .
. ..
vely). If z E BO+(Z)t l BO-(Z)(angular point), then either
Controllabilityof Generic Control Systems Surfaces on
151
a) z is a point of the steep domain, and then the germ at z of 6 2 is equal to the germ ( q i ( z ) U q:(z),z), in this case ( 8 O + ( Z ) , z ) = ( q i ( z ) ,2) and (aO-(z),z) = ( ~ j ( z )z); , or
b) z is a folded singular point of monkey saddle type and the germ at z of az is equal to (177( z ) U ;7 (z),z). 3. The germ of Z at each point of the intersection of its boundary with the boundary of the steep domain contains the germ of LTZ at this point.
4.2. Singularities on boundaries
of nonlocal transitivity zones It is easy to see fromTheorem 17 that in the generic casethe boundary of N T Z can exibit all singularities that the attainability boundary does. We define a singular point of type p , 0 5 p 5 6, of the boundary of N T Z in the same way as for the boundary of attainability. It turns out that, generically, these are the only singularities that may appear on the boundary of N T Z . Precisely:
Theorem 18 [2]. For a generic control system on a closed orientable surface, the following four assertions hold: 1. O n the boundary of any of i t s N T Z there can only appear singularities listed in Table 3. 2, All these singularities are stable under small perturbations of the system. Namely, for any system suficiently close to the original system its nonlocal transitivityt zones aremapped over to the corresponding zones of the original system by a homeomorphism of the phase space that is close to the identity; the homeomorphism can be chosen to be a Coo-diffeomorphism everywhere except possibly at singular points of types 4, 5 , 6 . 3. The closures of different nonlocal tmnsitivity zones a= disjoint. Remark. As discussed above, singular points of types 4, 5, 6 have exponents preserved under C*-diffeomorphisms. But the exponents can
152
Davydov
Table 3. Singularities on the boundaries of nonlocal transitivity zones.
change under small perturbations of the system. So, in general, the transforming homeomorphism will not be smooth. The following examples give the stable realizations of type 1-5 singularities on the boundary of N T Z . Example 20. Consider the three-dynamical system in the plane given by the velocity fields(-z-l; -2.ly-2.1), (-a+l; -2.ly+2.1) and (-(z2 ) , - 2 . 1 ~(compare ) with Examples 15,17) . The fields havesingular points (1, l), (- 1, -1) and (2,0), respectively. The boundary of NTZ consists of these points, of the phase curve of the first field outgoing from the point (2,O) and of the phase curves of the second field outgoing from (-1, -1) and (2,O) (Fig. 16; the marking of Fig. 16, Fig. 17 is the same as Fig. 15). The boundary has singular points of type 1, 4 and 5 at (2,0), (-1,-l) and (1, l ) , respectively.
Controllabilityof Generic Control Systems on Surfaces
153
Fig, 16.
Example 21. The nonlocal transitivity zone of bidynamical system in the plane given bythe velocity fields(y-2z, -32) and (y-22+1, -3(z-l)) (having the “absorbing” focus funnel at (0,O)and (1, l), respectively) is bounded by a limit cycle of one of the branches of the field of limiting directions, encircling singular points of the fields. This cycle, which is the boundary of the zone, has singular points of type 2 at its intersection with the line y = z (Fig. 17). Example 22. The nonlocal transitivity zone of the bidynamical system in the plane given bythe velocity fields( H , z2-p) coincides with the positive orbit of any point lying over the parabola y = z2. The boundary has a singular point of type 3 at zero (Fig. 8; compare with Example 14). Remark. A singularity of type 6 has a stable realization in a control system which is a suitable perturbation of the system from Example 18. Moreover, the perturbation can be chosen arbitrarily small and localized in any neighborhood of folded singular points of node type.
Davydov
154
5. Structural stability of generic control systems Here we consider control systems on a closed orientable surface and introduce a notion of structurally stable control system. The notion is similar to the classical concept of structurally stable (rough) vector field introduced by A. A. Andronov and L. S. Pontryagin. We will show that for a generic control system its family of trajectories (= family of positive and negative orbits of points) is stable under small perturbations of the system. This means that with respect to orbit equivalence a generic control system behaves like a generic vector field [18,191.
5.1. Stability of systems We call a control system structurally stable if the family of the positive and negative orbits of points of any system which is sufficiently close to the original one can be transformed to the corresponding family for the original system by a homeomorphism of the phase space that is close to the identity.
S ,i
Example 23. Let an object on the torus (= x S$ where 4 and $ are an angles on the circle) admit motions with two smooth structurally stable velocity vector fields both of modulus one. One field of velocities has two simple cycles c j = fn/4, the +component of the field depends only on q5 and has a graph looking as in Fig. 18. The other field of velocities is the image of the first under the diffeomorphism (+,$) ts (-4 n,$).
+
This control system has two nonlocal transitivity zones whichare annuli n/4 < 141 < 3n/4. The zones are separated by two annuli in which the behavior of the phase curves of the fields istopologically the same, namely, the phase curves of one field of admissible velocities are $ = const and the phase curves of the other field spiral away from one cycle of this field and to the other cycle (Fig. 19; marking is the same as in Fig. 15). What do the orbits of points of the torus look like? For a point of any nonlocal transitivity zone, the. positive orbit coincides with the zone, and the negative orbit is the entire torus.
Controllabilityof Generic Control Systems on Surfaces
E Fig. 17.
-* t Fig. 18.
155
156
Davydov
Fig. 19.
Fig. 20.
Controllabilityof Generic Surfaces Control Systems on
157
Consider an interior point of one of the annuli. Through this point we draw the phase curves of the fields of admissible velocities and take two segments of the positive and negative semitrajectory of each of these curves: the segments lie between our point and the nearest two points of intersection of these curves. The positive (respectively negative) orbit of our point is located between the union of two of the four segments lying on the positive (respectively negative) semitrajectories and one of the stable (respectively unstable) cycles which is not nearest to the point (Fig. 20; here in contrast to Fig. 8 the orbits are shaded and their boundaries are depicted by thick lines). Moreover, the union of these two segments is contained in the orbit but the cycle is not. For a point of the boundary of the annulus we have practically the same picture of orbits, except that on the boundary of the orbits we have the corresponding limit cycle (containing the point) instead of the union of the two segments. Apparently, the structure of orbits will be the same for any control system sufficiently close in the Cl-topology (and hence also for any system sufficiently close in the C4-topology) to the original one; by a home omorphism CO-close to the identity the orbits of one of these systems are mapped to orbits of the other one. Thus, our control system is structurally stable.
Theorem 19 [2]. A generic control system on a closed orientable surface is structurally stable. Theorem 19 is an analog of classical theorems of Andronov, Pontryagin and Peixoto [19,201 about structural stability of a generic vector field.
5.2. Sufficient conditions for stability
Usually the classical structural stability theorems for a generic vector fieldgivenecessary and sufficient conditions for such stability. Here we describe some similar conditions for control systems. For a generic control system (namely, for a system whose field of limiting directions has only generic singularities described above) its limit
Davydov
158
curve is called singular if it is either a closed curve lying entirely in the steep domain (such a curve is called a cycle) or the separatrix of at least one folded singular point of the field of limiting directions. Aswe saw above, for a generic control system the separatrices are observed in folded singular point of saddle, node, monkey saddle, and saddle-node type. It is easy to see from Figs. 6.2b1, 6.2b2, 5.3a, and 5.3b, that at such singular point 4, 2, 6, and 4 separatrices are “born”, respectively. The set of singular limiting curves of a generic control system is called structurally stable if for each sufficiently close system its set of singular limiting curves is carried over to the original set by a homeomorphism of the phase space that is close to the identity. Similarly, one defines the structural stabilityof the net of i-limiting curves (or the field of i-limiting directions),
Theorem 20. For a generic control system on a closed orientable surface, the structural stability of the set of singular limiting curves implies the structural stability of the system. Remarks. 1. In Theorem 20 (and in Theorems 21 and 22 below) under a generic control system we understand the one whose field of limiting directions has only generic singularities (this also includes the transversality of jet and multiple jet extensions of.the system to the corresponding submanifolds). 2. The structural stability of the set of the singular limiting curves is not necessary for the structural stability of the system itself.
Example 24. A bidynamical system on the torus given in standard coordinates 4 and 1/1 (see Example 22) by the vector fields (1,O) and ( 0 , l ) is structurally stable, but itsset of singular limiting curves is not. Indeed,the positive (negative) orbit of any point is the entire torus bothfor this system and for any sufficientlyclose system. Hence the system is structurally stable. Anyof its limiting curvesis a cycle (either 4 = const or @ = const) which is not simple. Hence the set of singular limiting curves is not structurally stable [19,203.
.
..
.
..
.
Controllability of Generic Control Systems on Surfaces
159
Theorem 21 [2]. For #U > 3 f o r a generic control system ona closed orientable surface, the structural stabilityof the fieldof i-limiting directions is equivalent to the following three conditions being satisfied:
A. There are no double separatrices, i.e., no limiting curves of the field that are separatrices of folded singular points both f o r increasing and descreasing time. B . Any closed limiting curve of this field lying in the steep domain is a simple cycle. C. Any limiting curve of this field diffeerent from a cycle, if extended to either side, ends at a boundary point of the steep domain or spirals onto a cycle of this field. Theorem 22 (21. For a generic control system on a closed orientable of the set of singularlimitingcurvesis surface, the structural stability equivalent to the following four conditions being satisfied: conditions A C of Theorem 21 f o r each of thetwobranches of thefield of limiting directions, and the condition
D. Only one singular limiting curve can enter each point
of the boundary
of the steep domain that is not a folded singular point.
Remark. Conditions A-C of Theorem 21 are analogues of the corresponding conditions for the structural stabilityof a smooth vector field on a closed orientable surface [19,201. Theorem 23 [2]. For a generic control system on a closed orientable surface, the set of singular limit curves and, for #U > 2, each of the two branches of the field of limiting directions are structurally stable. The following fact is an immediate consequence of Theorems 23 and 9.
Corollary. For a generic control system on a closed orientable surface, no singular limiting curve contains i-cutoff points, double i-passing points, or i-turning points, and any intersection point of such curves is a nonsingular point of each of the branches of the fields of limiting directions.
Davydov
160
6, Appendix: open problems
Here we will briefly discribe some open problems in the theory of controllability of control systems. There are many fundamental results concerning local controllability near a point. Some of them are provedby using the techniques of Lie commutators and special variations of controls (see papers [21, 22, 23, 241 and the references in these works), others are based on geometrical considerations and the theory of normal forms (see [l, 6, 25, 26, 27, 28, 291). But there are rather fewer papers dealing with the sets of points with the same local controllability properties and with stability of such sets under small perturbations of systems (see [l, 6, 71). It seems that problems concerning these sets and their stability are completely not solved even for polydynamical systems on a k-dimensional manifold with k > 2. Probably the same problems for general control systems (for example, like the systems considered in this paper) are more difficult. The nonlocal controllability, transitivity and limit behavior of control systems axe extensively studied topics in the theory of control systems 32, 33, 34, 35, In 361). particular, the results about NTZ (see [2,7, 30, 31, formulated above imply a complete description of the (chain) control sets (defined in [35])for a generic control system on a closed orientable surface. I have the resonable arguments that Theorems 17,18and 19 are also valid in the case of a unorientable phase space, and I hope that proofs of these results will be found. Finally, the singularities of time in time optimal problems is one more topic attracting the attention of reseachers. If the start set is a smoothly embedded closed submanifold, if the indicatrices of admissible velocities are strictly convex and if the interior of the convex hull of each of them contains zero velocity, then these singularities have a fairly complete d e 381). question is what are the genescription (see [lo,11, 12, 17, 37, The ric singularities of the time minimum function without these assumptions about either the zero velocity or the convexity?
Controllabilityof Generic Control Systems on Surfaces
161
REFERENCES A. A. Davydov, Singularities of field of limiting directions of twodimensional control systems, Math. USSR Sbornik 64 (1989), No. 2, 471-493. A. A. Davydov, Structural stability of generic control system on the orientable surface, Math. USSR Sbornik 72 (1992), No. 2, 1-28. A. A. Davydov, Qualitative Theory of Control Systems, Submitted to Mir-AMS. A. A. Davydov, Singularities in two-dimensionalcontrol systems, Thesis, Moscow State University, Moscow, 1982 (in Russian). N. N. Petrov, Controllability of autonomous control systems, Differential Equation 4 (1968), 606-617. J. B. Goncalves, Local controllability of nonlinear systems on surfaces, preprint Porto University, 1990. M. M. Baitman, Controllability regions in the plane, Differential equations 14 (1978), 407-417. A. F. Filippov, Singular points of differential inclusion in the plane, Moscow Univ. Math. Bull. 40 (1985), No. 6, 54-61. A. A. Davydov, Thenormal form of diferential equationthat is not solved for derivative, in a neighbourhood of a singular point, Functional Anal. Appl. 19 (1985), No. 1, 81-89. L. N. Bryzgalova, Singularities of the maximum function of a parametrically dependent jbnction, Functional Anal. Appl. ll (1977), 49-51. L. N. Bryzgalova, Maximum functions of a family of functions depending on parameters, Functional Anal. Appl. 12 (1978), 50-51. V. I. Matov, Topologicalclassification of germs of function of the maximum and minimax of families of functions in general position, Russian Math. Surveys 57 (1982), No. 4, 127-128 J. Ecalle, Theorieiterative:introductiona la theorie des invariants holomorphes, J. Math. Pures Appl. (9) 54 (1975), 183-258.
162
Davydov
S. M. Voronin, Analitic classification of pair of involution and its applications, Functional Anal. Appl. l0 (1981), No. 2, 94-10. P 51 A. F.Filippov, Stability for differential equations with discontinuous and multivalued right-hand sides, Differential Equations 16 (1979), NO.6, 720-727. A. A. Davydov, The quasi-Holder nature of the boundary of attainability, Selecta Mathematica Sovietica 9 (1990), No. 3, 229-234. V. I. Arnol'd, Catastrophe Theory,2nd edition, Springer-Verlag, 1988. V. I. Arnol'd, Geometrical Methods in the Theory of Ordinary Differential Equation, Grundlehren 250, Springer, 1983. J. Palis, W. De Melo, Geometric Theory of Dynamical Systems, An Introduction, Springer, New-York, 1982. M. M, Peixoto, Structural stability on two-dimensional manifolds, Topology, 1 (1962), NO.2, 101-120. H.Sussmann, A generaltheorem o n local controllability, SIAM J. Control Optimization, 25 (1987), No. 1, 158-194. A. A. Agrachev, R. V. Gamkrelidze, Local controllability for families of diffeomorphisms, System and Control Letters 19,1992, A, A. Agrachev, R. V. Gamkrelidze, Local controllability and semigroups of diffeomorphisms, to appear in Acta Appl. Math. M. Kawski, High-order small-time local controllability, in "Nonlinear controllability and optimal control (Ed. H. Sussmann), Marcel Dekker, 1990, 431-467. 1251 J. B. Goncalves, Local controllability in 3-manifold, Systems and Control Letters 14 (1990), No. 1, 45-49. J. B. Goncalves, Geometric condition for local controllability, J. Differential Equations, 89 (1991), No. 2, 388-395. J. B. Goncalves, Local controllability of scalar input systems on 3manifolds, System and Control letters, to appear. B. Jakubczyk, F. Przytycki, Singularities of Ic-tuples of vector fields, Dissertationes Math., 213 (1984). A. Babichev, A. Butkovskii, N. Lepe. Singular sets on phase portraits
Controllability of Generic Control
Systems on Surfaces
163
of dynamical systems with control,Aut. Rem. Control 47 (1986), No, 5 , 607-614, NO.7, 912-919. J. M. Gronski, Classification of closed sets of attainability in the plane, Pacific J. Math. . 77 (1978), No. 1. C. Lobry, Controllability of nonlinear systems on compact manifolds, SIAM J. Control 12 (1974), No. 1, 1-3. H.Sussmann, Some properties of vector field systems that are not altered by small perturbation, J. Differential Equations, 20 (1976), NO. 2, 292-315. M. Sieveking, A generalization of the Poincare-Bendixson theorem, The Institute of Applied MathematicsandStatistics, Vancouver, Technical Report No. 88-11, December, 1988. F. Colonius, W. Klieman, Limit behaviour and genericity for nonlinear control system, Schwerpuktprogramm der Deutschen Forschungsgemeinschaft “Anwendungsbezogene Optimierungund Steuerung”, Report No. 305, Institut fiir Mathematik, Universitat Augsburg, 1991,1-27. F. Colonius, W. Klieman, Controltheoryanddynamicalsystems, Schwerpuktprogramm der Deutschen Forschungsgemeinschaft “Anwendungsbezogene Optimierung und Steuerung”, Report No. 328, Institiit fur Mathematik, Universitat Augsburg, 1991, 1-49. A. Bacciotti, Complete controllability and stabilizability,in “Dynamical systems and Microphysics, Control theory and Mechanics” (Proceedings of Third International Seminar on Mathematical Theory of Dynamical Systems and Microphysics, Udine, Italy, September 4-9, 1983). Ed. A. Blaguere, G. Leitmann. Academic Press, 1984, 1-12. V. I. Arnol’d, Singularities in calculus of variations, in “J. of Soviet Math. ” 27, 1984. V. M. Zakalyukin, Metamorphoses of fronts and caustics, depending on parameter, versality of mappings, J. of Soviet Math. 27 (1984), 2713-2735.
Recent Advances in the Stabilization Problem for Low Dimensional Systems W.P. Dayaluansa Department of Mathematics, Texas Tech University, Lubbock, Tx 79409
Abstract. We survey recent advances on the stabilization problem for two and three dimensional, single input, affine nonlinear systems.
1. Introduction There has been a tremendous interest in the nonlinear stabilization problem in the recent past, as evidenced by numerous research articles, and the recent book byBacciotti [Ba]. One of the main contributing factors has been the realization that modern robotic systems and advanced aircraft etc cannot be analyzed by using linear techniques alone, and more advanced theories are necessary in order to meet these design challenges. This has lead to thegeneralization of well known lineartheories such as stabilization of passive systems (see [BIW], [HMI, [KS], [MA], [MO]etc.) and generali-
This paperwas written while the authorwas at the department of Electrical Engineering and Systems Research Center, University of Maryland, College Park, MD 20742; Supportedin Part by NSF Grants #ECS 9096121, #EID 9212126 and the Engineering Research Center Program Grant #CD 8803012.
165
166
Dayawansa
zation of the notion of minimum phase systems to the nonlinear setting (see [B121 etc.). On the other hand, it has been pointed out that there are interesting classes of highly nonlinear, nongeneric systems which arise as low dimensional subsystems after various types of dimension reduction techniques such m center manifold reduction (see [Ay], [Ba]), modification of zero dynamics by redefining the output function (see [Ba]), and partial feedback linearization (see [Mars], [Ba] etc.). Analysis of the stabilization problem for these latter classes of systems require innovative techniques which have no counterparts in the theory of linear systems. Our focus in this paper will be on this latterclass. Due to thecomplexity of the problem we will only consider this problem in the two and three dimensional cases. We will consider a single input, &ne, nonlinear system given by,
where, IC E W , ( n = 2 or 3), U E 8,and f , g are Ck (k > 0) vector fields. Wewill assume that the originis an equilibrium point of the unforced system, i.e. f ( 0 ) = 0, and that g(0) # 0. Our aim here is to review recent developments on the stabilization problem for (1.1),when it describes a highly nonlinear system, and give a flavor of some of the techniques that have been developed in order to study this problem. Even though there has been much interesting work done on bilinear systems in low dimensional cases, we will not discuss this class here. Interested reader is referred to [Ba] for a recent account on the stabilization problem for bilinear systems. It has been recognized for quite some time now that there is a strong relationship between the stabilizability and various notion of controllability. Indeed, local asymptotic stabilizability clearly implies that thesystem is locally asymptotically controllable to the origin (see section 2 for the definition). First modern attempts to relate stabilizability to controllability seems to be contained in the work of Sussmann (see [Su]), where he proved that for real analytic systems, a certain notion of controllability implies the existence of a piecewise analytic feedback control law which steers all points in the state space to the origin. He also gave an example
Stabilization Problem for
Low Dimensional Systems
167
to illustrate that , in general there may not exist an analytic stabilizing feedback control law. However, it was Brockett (see [Br]) who dispelled the myth that small time local controllability (see section 2 for the definition), implies stabilizability. Brockett showed in [Br] that there are obstructions to stabilizability which are topological in nature. Zabczyk (see [Za]) pointed out that this obstruction is closely related to a necessary condition for stabilizability due to Zabreiko (see [KZ]). A similar result wasused by Byrnes and Isidori (see [BIl]) to prove that the attitude stabilization problem for a rigid body controlled by gas jets can be solved if and only if there are three independent control torques exerted along independent axes. Coron (see[Cor]) used Zabreiko’s theorem to strengthen Brockett’s necessary condition. Brockett’s necessary condition showed for the first time that asymptotic stabilization problem for highly nonlinear systems is much more complex than it was anticipated. This has lead to a renewedeffort to understand the stabilization problem, and in particular focus shifted to low dimensional cases for which there is a variety of topological and analytical tools available. Ayels (see[Ay])pointed out the relevance of the center manifold theorem in order to extract “the highly nonlinear” part of a given control system. This now leads to the problem of stabilizing a nonlinear system in which the linear approximation of the drift vector field is identically equal to zero. Kawski showed (see [Kal]) thatfor a two dimensional real analytic system given by (1.1), small time local controllability implies stabilizability by using a Holder continuous feedback function. This is a landmark result in several respects. On one hand, itshowed oncemore that there is a strong relationship between the controllability property and the stabilizability property. On the other hand, it emphasised the fact that one should not be confined to the class of smooth feedback functions in seeking a solution for the stabilization problem, a statement that has already been made by Artstein (see [Ar]), Sontag and Sussmann (see [SSl]) etc. Boothby and Marino (see [BM3]) gave an obstruction to the stabilizability of such systems by using C1 feedback. Dayawansa, Martin and Knowles showed (see [DMK], [DM31 etc.) that in the two dimensional real
168
Dayawansa
analytic case, local asymptotic controllability to the origin is a necessary and a sufficient condition for the local asymptotic stabilizability of (1.1) by using continuous feedback. They also gave some necessary conditions and sufficient conditions for the asymptotic stabilizability of (1.1)by using C kfeedback for 0 5 IC 5 m. In the three dimensional case, we will restrict out attentionto homogeneous and weighted homogeneoussystems. An example of the former type is the angular velocity control system of a rigid body (see [AS],[SSZ]).However, our primary motivation for studying this class is that if the leading homogeneous part of a system of differential equations is asymptotically stable, then the addition of the higher order terms does not destroy the local asymptotic stability of such a system (see [Ha]). Thus, a theorem due to Coleman (see [Col]) on the asymptotic stability of three dimensional homogeneous systems is of relevance to our problem. Coleman attributes the two dimensional version of this theorem to Forster [Fo] whichhas been discovered iudependently by Haimo (see [Hail) (see Samardzija [Sa] also). Kawski (see [Ka2], [Ka3]) and Hermes (see [Hell) pointed out that the nilpotent approximation of certain three dimensional small time locally controllable systems are dominated by a weighted homogeneous system (instead of a homogeneous part), and showed that the local asymptotic stability of a weighted homogeneous system is preserved if one adds “higher order” terms. They also extended Coleman’s theorem in [Col] to the weighted homogeneous setting. These considerations have motivated the asymptotic stabilizationproblem for homogeneous,and weighted homogeneous systems, and some of their generalizations. Stabilization problem in the case of two dimensional homogeneous systems is relatively straightforward, aa was observed by Samardaija (see [Sa]) and Dayawansa, Martin and Knowles (see [DMK]). However, three dimensional case turns out to be quite challenging. There are well known examples of small time locally controllable systems which do not satisfy Brockett’s necessary condition (see section 3 for an example). It has been pointed out by Coron that there are small time locally controllable three dimensional systems which satisfy Brockett’s necessary condition, but violate a necessary condition
Stabilization Problem for Low Dimensional Systems
169
given in [Cor]. Dayawansa and Martin (see [DMl]) and Kawski (see [Ka2], [Ka3]) have given additional necessary conditions and sufficient conditions for the asymptotic stabilizability of three dimensional homogeneous and weighted homogeneous systems. Hermes has shown (see [He2],[He3]) that for certain classes of weighted homogeneous systems one can derive an asymptotically stabilizing feedback control law by solving a regulator problem. More recently, Dayawansa and Martin and Samelson have shown in hitherto unpublished work (in [DMS2], [DMS3]) that single input, three dimensional, homogeneous polynomial systems of a given odd degree are generically asymptotically stabilizable (a sketch of the proof is given here in section 4). They have also given necessary and sufficient conditions for the asymptotic stabilizability of a generic classof homogeneous polynomial systems of a given even degree (see [DMSl]). This paper is organized as follows. In section two we will give the basic definitions applicable to the problems discussed here. In section three, we will discuss Brockett's, Zabczyk's and Coron's necessary conditions and givesome examples. In sections four and fivewe willreview the work on the asymptotic stabilization problem fortwo and three dimensional systems respectively. In section six, we will conclude the paper by stating a few challenging unsolved problems in the context oflow dimensional stabilization.
2. Basic definitions and notation Throughout the paper I(.([ denotes the Euclidean norm, and B,denotes the open ball of radius E in an Euclidean space. An overlineOver an already defined set denotes the closure of the set and 8 before a set denotes its boundary. Here, we will consider a nonlinear control system having the structure, (2.1)
k = F(z,u),
where, z E W , U E !Rm, F is a family of Ckvector fields. We will assume
Dayawansa
170
that the origin of !JP is an equilibrium point of the unforced system, i.e. F(0,O) = 0. Sometimes, we will assume that (2.1)has the affine structure,
(2.2)
= f (x)+ S(Z>U,
where, IC E W , f and g are smooth and U E f (0) = 0, and that f and g are Ck.
!Rm,
and we will aasume that
W.
Definition 2.1. Let 20 and 21 be elements of Then in (2.1) 11 is reachable from x0 at time T with control bound M if there exists a piecewise continuous control input, U : [O,T]+ R"' where Ilu(t)ll IM for all t E [O,T], such that the corresponding solution of (2.1) starting at a0 at t = 0 passes through I C ~at t = T . The set of points which are reachable from ICO at a fixed time T with control bound M is called the reachable set from x0 at time T with control bound M ,and it is denoted by RM(T,X O ) . The system (2.1) is small time locally controllable at x0ifx0 belongs to the interior of RM(T,ICO) for all M,T> 0. The system (2.1)is small time locally controllable if (2.1) is small time locally controllable at the origin. Definition 2.2. The system (2.1)is locally asymptotically controllable to the origin if for an arbitrary open neighborhood U of the origin there exists an open neighborhood W C U of the origin such that for all 20 E W there is a piecewise continuous control input U : [O,oo) -+ 8 ' with the property that the solution of (2.1) starting at ICO at t = 0 stays in U at all positive times, and converges to the origin as t -+
03.
Definition 2.3. The system (2.1) is locally continuously stabilizable if there exists a continuous feedback control law U = U(.) defined on a neighborhood U of the origin such that the following properties hold: (i) For each ICO E U ,the closed loop system admits a unique solution in forward time. (ii) The closed loop system is locally asymptotically stable at the origin. Such a feedback control law will be called a locally continuously stabilizing feedback control law. Such a control lawis an almost Cp locally
Stabilization Problem for Low Dimensional Systems
171
stabilizing control law, and correspondingly the system (2.1) is locally almost C ' stabilazable if in addition to (i) and (ii) above, U ( . ) is C' on U \ (0). The system (2.1) is locally C ' stabilizable if a C' feedback control law, which satisfies (ii) above, can be found. If a continuous feedback control law can be found on U\{O} which satisfies (i) and (ii) above, then the system is said to be locally almost continuous stabilizable, and such a feedback control law will be called a locally almost continuously stabilizing feedback control law. An important concept that plays a vital role in some of the work on the stabilization problem is that of a control Lyapunov function.
Definition 2.4. Let V : U + 8 be a positive definite smooth function, where U is an open neighborhood of the origin in 8".V is called a control Lyapunov function if at each x E U there exists U, such that v V ( z ) F ( zU,) , < 0 (here no requirements on the continuity of z + U, are stipulated). Control Lyapunov functions have playeda key role in some recent work on the asymptotic stabilization problem (see [CP],[PNC], [TK], [Tsl], [Ts2] etc). Key result in this direction is a Theorem due to Artstein (see [Ar]), which states that if a control system admits a control Lyapunov function, then the system is locally almost continuous stabilizable. Sontag has given (see [Sol], [So21 etc.) explicit constructions for finding such feedback laws,and has analyzed the problem of finding almost C", stabilizing, feedback control laws. An excellent survey was given by Sontag in [SoZ]. Due to the limitations in space we will not discuss this wpect any further. For the sake of self containment of this paper, we will now define the notions of degree and index. The interested reader is referred to [GP], [De], [Sp] etc. for a the validity of the definition, and general details. Let q5 : M + N be a C' map, where M and N are oriented manifolds of the same dimension and M is compact. Then the oriented degree of 9, (denoted by deg(q5, M , N ) ), is defined as follows. According to Sard's theorem (see [GP]) almost all points in the codomain are regular values. Pickone such value yo. It can be seeneasily that A := (q5)-'{yc1} is
.,
.. . .
L
....
......,
,..,.
...
"
....._
."
,.., _...._.... , ,
.
,
...
.
. . ... ,.
. .,
. ,, ..
,,
Dayawansa
172
.
either empty or else it is a finite set. Let A = {z1,q,. . ,zk}(if A = 0 we take k = 0). Now, at each zi,the derivative of 4 is nonsingular. If the determinant is positive at xi then 4 is orientation presemring at xi, and else it is orientation reversing. If 4 is orientation preserving at zi, assign the algebraic multiplicity 1 to zi,and otherwise assign -1, Now, the degree of 4 is defined to be the sum of the algebraic multiplicities at 4 at xi,i = l , ., , ,IC. It can be shown that this integer does not depend on the choice of the regular value. One of the important properties of the degree is that it is homotopy invariant. Now,if 4 is merely continuous, then one can approximate it by a smooth map, and compute the degree. As a consequence of the homotopy invariance property it follows that this integer does not depend on the choice of the approximation, as long as the approximation is closeenough with respect to the uniform metric topology. The integer obtained this way is referred to as the oriented degree of 4.
A closely related notion is that of the topological degree. Let, 4, M and N be as before except that M may not be compact. Let U be a relatively compact open subset of M and let y E N be such that y 6 BU. Then, the degree of f with respect to (6,y) (denoted by d ( 4 , 8 , y) ) is defined sgn(det c$*zi) where { X I , . . . ,zk} = 4-'(2 , where @ is a regular as value of 4 and @ is arbitrarily close to y. As described in the previous paragraph, this notion is homotopy invariant as well, and thus can be extended to continuous maps also.
c:=,
Notion of index is a local version of the degree, defined in the following way. Let 4, M , N be as in the previous paragraph. Let y E N ,and let K C $-l{y} be a closed subset such that there exists an open neighborhood U of K in M with the property that an$-'{y} = K.Then, index of4 with respect to (K, y) (written aa ind(4, K,y)) is defined aa d(4, 8,~)). If K is a singleton {z}, then we write ind(4, z, y) instead of ind(4, {z},v). Let us now consider a system of differential equations,
Wewill assume that $ is continuous, and that 0 E
Rn is an isolated
Stabilization Problem for Low Dimensional Systems
173
equilibrium point. Now, for small e > 0 we may define a map, (2.4) (2.5)
e, : S"-' + S"-' e,@:>= ~ ~ ~ ~ ~ / l l ~ ~ ~ ~ ~ l l *
Definition 2.5. Index of (2.3) at the origin is deg(e,, Sn-l, small enough E > 0.
for
,Sn-l)
As a consequence of the homotopy invariance property it follows that this number does not depend on the choice of e as long as thereare no other equilibrium points of (2.3) inside a closed ball of radius E. It is possible to show that the index of (2.3) at the origin is equal to ind($,O,O). We will now define several notions associated to homogeneous and weighted homogeneous systems, which willbe used in the proceeding sections.
Definition 2.6. System (2.2) is called a homogeneous system (respectively, a positively homogeneous system) of degree p if g ( x ) is a nonzero constant n x m matrix, and f (3)is a vector field which is homogeneous of degree p , i.e., f ( h ) = (X)Pf(z)for all X E R (respectively, positively homogeneous of degree p , i.e., !(A.) = ( X ) P f (x)for all A > 0). Stabilization problem for homogeneous systems arise naturally as that of stabilizing the leading set of terms in a system with null linear part. It is well known that (see [Ha] and the discussion in the proceeding sections) that addition of higher order terms will not affect the stability of a homogeneous system. A very important recent observation made by Kawski (see[Ka2], [Ka3]) and Hermes (see [Hell) is that for certain highly nonlinear systems, one can select coordinates of the state space in such a way that the leading terms form a weighted homogeneous system. This is done by considering a certain nilpotent approximation of the system (see [Ka2], [Hell, [He2], [He31 etc. for details). We will define this notion below ( for the most part we will follow [Ka3] here). Let P = { T I , . . , ,rn}, where ri are positive integers. Let (XI,.. . ,S,,) be a fixed set of coordinates on R". A one parameter family of dilations parametrized by E > 0 is AT : R+ X R" + !Rn, defined by, Af (x) =
Dayawansa
174
(erlxl,,, , ,epnxn).A function 4 : !Un if 4 o Ar = E"#. A vector field
+ Q is A'-homogeneous
of order p
is A' - homogeneous of order p if Xj (x)is A' - homogeneous of order p+rj. Corresponding to theusual Euler field C xj the A'-homogeneous Euler field is defined as C rjxj Solution curves of the A' - homogeneous Euler field will be called A'-homogeneous rays. Anosov and Arnold [AA] use the term, quasihomogeneous, instead of weighted homogeneous, or A'-homogeneous. Also, according to the terminology of Hermes in [Hell etc., the above definition refers to a A'homogeneous of order -p object (instead of order p ) .
&.
&,
Definition 2.7. Let r = {rl, . . . , m } , where rpi are positive integers. The system (2.2) is a A'-homogeneous system of order p if f is a A'homogeneous vector field of order p, and g(x) is a constant n x m matrix. In this paper we will only consider single input systems and in the case of A"-homogeneous systems, we will asume that g(%) = [0, .,0,1IT. Let r = (r1,. . , ,rn},and let us denote R := diag{rl,. ,T,,}. Let G denote the one parameter group generated by the A'-homogeneous Euler field, i.e. G = {exp(sR) I s E R}. By definition, G acts on Rn and the G orbits are just A'-homogeneous rays. We say that two points in R" are G equivalent, if they lie on the same G orbit. Let us consider a A'-homogeneous vector field in Rnl
.. ..
(2.6)
k = X(X).
One can "almost" project (2.7) onto the orbit space R"+\ {O}/G.This follows from the observation that (2.7)
X(t1Xo) = exP(qx(exP(-sP)tl exP(-smso),
for all s E R where, x(t, 20) denotes the solution of (2,6) at time t starting at x0 at zero time. But, this just means that, if two solutions start at G-equivalent points, then it is possible to rescale the time in one of the solutions in such a way that the two solutions will remain G-equivalent at
Stabilization Problem for Low Dimensional Systems
175
all times. In other words, the phase portrait of a "projected system" is well defined on the orbit space. In particular, we can obtain a representation of the "projected system" on any sphere as long as the A'-homogeneous Euler field is transversal to it. Here we will consider the projected system on the unit Euclidean sphere P " , and call it projected dynamics of X , and denote it by .(X).
3. Necessary conditions for the asymptotic stabilization
of nonlinear systems In this section, we will consider a nonlinear control system having the structure, (3.1)
X
= F(s, U ) ,
where, 5 E W , U E W , F is a family of Ckvector fields. We will assume that the origin of .!Rn is an equilibrium point of the unforced system, i.e. F(0,O) = 0. Sometimes, we will assume that (3.1) has the affine structure, (3.2)
li: = f ( x )+ g(x)u,
where, 2 E W , f and g are smooth, and U E W , and we will assume that f(0) = 0, and that f and g are C kvector fields. We will assume that 8F 0 0 # 0 in (3.1) (respectively, g ( 0 ) # 0 in (3.2)). It is clear that local smooth stabilizability of (3.1)implies that the OF00 linear approximation O F 0 0 +) is a stabilisable pair, and that (3.1) islocally asymptotically controllable to the origin. Brockett showed in [Br] that there is a more interesting topological obstruction to asymptotic stabilizability.
(,e,
Theorem 3.1 [Br]. Suppose that (3.1) is locally C1 stabilizable. Then the following are satisfied. (Bl:) The uncontrollable eigenvalues of the linearized system are in the closed left half of the complex plane. (B2:) (1.1) is locally asymptotically controllable to the origin.
176
(B3:) The function (x,U ) c+ F ( x ,U ) : 8" x (0,O).
Dayawansa
R* + Rn is locally onto at
Zabczyk [Za] observedthat an intermediate step in Brockett's proof is already contained as a theorem in [KZ].This theorem is commonlyreferred to as Zabreiko's theorem in the control theory literature.
Theorem 3.2 [KZ]. Considerthesystem of diflerentialequations, 6 = X ( x ) ; x E !Rn, where X is continuous.Supposethatthesystemis locally asymptotically stable at the origin, and that it has unique solutions in forward time for all initial conditions in anopenneighborhood of the origin. Then, the index of the system at the origin is equal to (-1)".
A simple way to prove this theorem (see [KZ], [Za] etc. for details) is to consider the homotopy,
where 4: denotes the flow of X. As r + 00, we get the antipodalmap onwhich has the degree (-l)n.Hence, it follows that theindex of X at the origin is equal to (-l)* as well. Zabreiko's theorem can be used to prove (B3) of Brockett's theorem in the followingway. Let U = U(.) be any smooth stabilizing feedback function. Then, the vector field F ( x , U(.)) has index (-l)n at the origin. In particular, this is nonzero. Hence, it follows from Sard's theorem that x c) F ( x ,~ ( x )is) locally onto at the origin (otherwise, since regular values are dense, it follows that thereexists a regular value with empty preimage). Thus (B3) has been established. Brockett gave the following example (see [Br]) which satisfies (Bl) and ,u~) (B2) but not (B3). Let n = 3 and m = 2 and F ( x 1 , x ~ , 2 9 , ~ 1= (ul,u2,x1u1 - ~ 2 ~ 2 Clearly, ) . (O,O,a ) is in the preimage only if a = 0. Byrnes and Isidori essentially used (B3) in [B111 to prove' that the attitude stabilization problem for a rigid body by using gas jet controls is solvable if and only if the system is feedback linearizable.
Stabilization Problem
for Law Dimensional Systems
177
More recently Coron (see [Cor]) has strengthened (B3). Coron's theorems still depend on Zabreiko's theorem. Let M be a topological space, and let F ( M ) denotes either the singular homology functor with real or integral coefficients, or the homotopy functor, and for a continuous map B : M + N , let T(B): 3 ( M ) + T ( N ) denotes the induced map. Theorem 3.3 [Cor]. For small E
> 0 define,
C€:= {(~,u)lll(z,u)ll c E and F ( z , u )# 0). Supposethat (3.1) is continuous feedback stabilizable.Thentheinduced map 3 ( F ) : 3(C,) + 3 (R" \ (0)) is onto. The idea of the proof given by Coron (see [Cor]) is the following. Let U = a ( . ) be a continuous, locally stabilizing feedback control law. Let, Me := {z E W" I ]l(z,a(z)llC E } . Then, the map z I-) F ( z , a ( z ): M, + W" \ 0 has degree equal to (-l)", and hence it induces an isomorphism F(F(., a(.))) : F(Me)-+ T ( R n\ (0)). But, this map can be factorized as, F(F(.,a(.)))= F(F)oT((id,a)). Now it follows that T ( F )is onto for all small enough E. Coron also derived (see [Cor]) a corollary of this theorem, whichis applicable for (3.2).Let, us assume without any loss of generality that the system has been transformed into the form, & = [fb"']
+
[;l
U
by using a change of coordinates, and a feedback transformation. For small E > 0 let be defined &S {z E S"-llf(z) # 0). Let H, denotes the singular homology functor. Coron established the following: Corollary 3.1. 3(f) : H,-2(%)
+ H,-2(9?"-' \ (0))
is onto.
Proof of this corollary is relatively straightforward by using the MayerVietoris sequence to the pair, (E,X (-€,e), B, x ((-E,€) \ (0))). Details c m be found in [Cor]. Now we describe another necessary condition, which we believe is equivalent to the condition in the corollary. It is trivial to see the equivalence
Dayawansa
178
for homogeneous and weighted homogeneous systems, but it is less clear in the general case. This is an expansion of a necessary condition given for homogeneous systems in [DM11(Theorem 3.7). Theorem 3.4. There exists a continuos function a defined on a neighborhood of the origin in %" such that the index of [f'(x),a(x)]' is equal to (-1)" ifandonly if for small e > 0 there exist closed subsets C1 and C2 of B,(O)\ (0) such that the following hold: (i) Ci C (f)-'{~}. (ii) K1 U K2 = ( f / & , ~ ~ ( ~ ~ ) - 'whew { 0 } , Ki = Ci naB,(O). (iii) ind(f18Bc(0),K1,0)= 1.
A sketch of the proof goes along the following lines(details of the proof will be given in [DMS2]). Suppose that U = a(.) is a continuous function such that the index of [f'(s),a(z)]' is equal to (-1)".Let E > 0 be small enough such that [ f ' ( z ) , a ( ~ #) ]0~for all x E B,(O) \ (0). Now, a # 0 on (fleBc(o)\{o})-'{O). Let Cl := .{ E aB€(O)\ {O)la(4 > 0) and C2 := {x E aB,(O) \ {O)lcr(x) < 0). Let Ki = Ci nBB,(O). The problem of computing ind((f, a),0,O) can be considered as that of counting the number of points in the preimage of (f,a) of a point near (0,l)E Sn-l with appropriate multiplicities. But, this is the same as the problem of computing ind(flsB,(o), K',0). Conversely, suppose that (i)-(iii) of the theorem are satisfied. Then, itis possibleto define a continuous function on B,(O)such that a l ~=, (-l)",a l =~ (-l)n+l, ~ and crl~~l-)-l~o} # 0. Be (