Springer Complexity Springer Complexity is a publication program, cutting across all traditional disciplines of sciences as well as engineering, economics, medicine, psychology and computer sciences, which is aimed at researchers, students and practitioners working in the field of complex systems. Complex Systems are systems that comprise many interacting parts with the ability to generate a new quality of macroscopic collective behavior through self-organization, e.g., the spontaneous formation of temporal, spatial or functional structures. This recognition, that the collective behavior of the whole system cannot be simply inferred from the understanding of the behavior of the individual components, has led to various new concepts and sophisticated tools of complexity. The main concepts and tools – with sometimes overlapping contents and methodologies – are the theories of selforganization, complex systems, synergetics, dynamical systems, turbulence, catastrophes, instabilities, nonlinearity, stochastic processes, chaos, neural networks, cellular automata, adaptive systems, and genetic algorithms. The topics treated within Springer Complexity are as diverse as lasers or fluids in physics, machine cutting phenomena of workpieces or electric circuits with feedback in engineering, growth of crystals or pattern formation in chemistry, morphogenesis in biology, brain function in neurology, behavior of stock exchange rates in economics, or the formation of public opinion in sociology. All these seemingly quite different kinds of structure formation have a number of important features and underlying structures in common. These deep structural similarities can be exploited to transfer analytical methods and understanding from one field to another. The Springer Complexity program therefore seeks to foster cross-fertilization between the disciplines and a dialogue between theoreticians and experimentalists for a deeper understanding of the general structure and behavior of complex systems. The program consists of individual books, books series such as “Springer Series in Synergetics", “Institute of Nonlinear Science", “Physics of Neural Networks", and “Understanding Complex Systems", as well as various journals.
Springer Series in Synergetics Series Editor
Hermann Haken Institut für Theoretische Physik und Synergetik der Universität Stuttgart 70550 Stuttgart, Germany and Center for Complex Systems Florida Atlantic University Boca Raton, FL 33431, USA
Members of the Editorial Board Åke Andersson, Stockholm, Sweden Gerhard Ertl, Berlin, Germany Bernold Fiedler, Berlin, Germany Yoshiki Kuramoto, Sapporo, Japan Jürgen Kurths, Potsdam, Germany Luigi Lugiato, Milan, Italy Jürgen Parisi, Oldenburg, Germany Peter Schuster, Wien, Austria Frank Schweitzer, Zürich, Switzerland Didier Sornette, Nice, France and Zürich, Switzerland Manuel G. Velarde, Madrid, Spain SSSyn – An Interdisciplinary Series on Complex Systems The success of the Springer Series in Synergetics has been made possible by the contributions of outstanding authors who presented their quite often pioneering results to the science community well beyond the borders of a special discipline. Indeed, interdisciplinarity is one of the main features of this series. But interdisciplinarity is not enough: The main goal is the search for common features of self-organizing systems in a great variety of seemingly quite different systems, or, still more precisely speaking, the search for general principles underlying the spontaneous formation of spatial, temporal or functional structures. The topics treated may be as diverse as lasers and fluids in physics, pattern formation in chemistry, morphogenesis in biology, brain functions in neurology or self-organization in a city. As is witnessed by several volumes, great attention is being paid to the pivotal interplay between deterministic and stochastic processes, as well as to the dialogue between theoreticians and experimentalists. All this has contributed to a remarkable cross-fertilization between disciplines and to a deeper understanding of complex systems. The timeliness and potential of such an approach are also mirrored – among other indicators – by numerous interdisciplinary workshops and conferences all over the world.
L.M. Pismen
Patterns and Interfaces in Dissipative Dynamics
With a Foreword by Y. Pomeau
With 163 Figures and 1 Table
ABC
Professor L.M. Pismen Department of Chemical Engineering Technion - Israel Institute of Technology Technion City, Haifa 32000, Israel E-mail:
[email protected]
Library of Congress Control Number: 2005939040 ISSN 0172-7389 ISBN-10 3-540-30430-4 Springer Berlin Heidelberg New York ISBN-13 978-3-540-30430-2 Springer Berlin Heidelberg New York This work is subject to copyright. All rights are reserved, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilm or in any other way, and storage in data banks. Duplication of this publication or parts thereof is permitted only under the provisions of the German Copyright Law of September 9, 1965, in its current version, and permission for use must always be obtained from Springer. Violations are liable for prosecution under the German Copyright Law. Springer is a part of Springer Science+Business Media springer.com c Springer-Verlag Berlin Heidelberg 2006 Printed in The Netherlands The use of general descriptive names, registered names, trademarks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use. Typesetting: by the author and techbooks using a Springer LATEX macro package Cover design: design & production GmbH, Heidelberg Printed on acid-free paper
SPIN: 10822705
54/techbooks
543210
Foreword
Nature is full of marvels, be they in the inanimate world or in the realm of life. Quite often their beauty and attractive power come from the regularity of some sort of “pattern,” or – more subtly – from some obvious or hidden irregularity (as the French poet Verlaine said, “always favour the uneven”). Obvious natural patterns are found in the stripes of sea-shells or on the fur of mammals, such as our domestic cats. Stones such as malachites or agathes also show finely crafted layers of matching or contrasting colors. A less obvious case of “pattern” is seen in the opals, whose opalescence reflects wonderfully regular arrays of spheres of silica. Civilizations of the Far East highly praised these miraculous examples of beauty in minerals. The way things and living beings are made or have been made began to attract the interest of scientists of the Classical Age, particularly after Newton in the query 31 at the end of his Opticks claimed that the microscopic world, made of atoms, follows the same kind of laws as the Universe at large. The first instance of a “regular pattern” produced artificially was by the spontaneous modulation of the surface of a liquid vibrated vertically. It was first believed that this Faraday instability was a kind of linear resonance of the capillary waves at the frequency of the excitation. It was Rayleigh who first explained the striking fact that actually the dominant frequency of the surface oscillations is half that of the exciting acceleration, a result that is not obvious. Rayleigh’s theory gave rise to a whole field of research, the study of ordinary differential equations with time periodic coefficients. Once transformed into maps of the circle this class of problems has been a major source of mathematical progress over the years. The next example of an artificial pattern in experiments was the famous (and first very poorly understood) B´enard cells. Henri B´enard, one of the first great experimentalists in fluid mechanics, showed that a thin layer of whale oil heated from below set itself spontaneously in motion in a remarkably regular array of hexagonal cells. B´enard himself did explain this phenomenon in a rather confused way and another 50 years passed before Scriven and Sterling showed that the instability is due to the Marangoni effect, that is the temperature dependence of the surface tension. It took another 10 years to see the explanation of the hexagonal pattern by Palm, who proved that hexagons are the generic structure to expect beyond a bifurcation yielding wavy patterns with an arbitrary orientation in a plane. The Rayleigh–B´enard instability due to buoyancy (instead of the
VI
Foreword
Marangoni effect) of a fluid layer heated from below does show rolls, because of a particular, nongeneric symmetry. Over the years an almost infinite number of “pattern-forming” bifurcations in physical systems have been discovered, as well as many kinds of instabilities. The famous Brusselator explained the oscillating chemical reactions in the well-known Belousov–Zhabotinsky system. The Turing instability shows up in driven systems with widely different diffusion coefficients. Quite often the scientists responsible for the discoveries and/or the theory of patternforming systems saw in a more or less explicit way a relationship between their observations and the structures of living beings. Such a rather close connection surely exists for patterns on sea-shells that can be explained by simple reaction–diffusion equations without any recourse to a detailed “program” written in the DNA of the snails. May be less noticed than discoveries in the experimental field, there has been a tremendous progress in our rational understanding of what I would call loosely the qualitative behavior of solutions of partial differential equations and/or ordinary differential equations. A very crucial idea, first developed by Poincar´e and by Andronov, is the one of “robustness.” Loosely speaking, it allows us to describe a dynamical system (= the equation(s) of motion of the system we consider) independently of their detailed form. This is of course a “topological theory” in the deepest sense, as it amounts to consider that two systems are “the same” if one can deform one smoothly into the other. Except at “bifurcation” value this holds true for almost all values of the parameters into the equation(s) of motion: changing a bit a parameter value changes only numerical values typical of the solutions, not their structure. The study of the qualitative properties of dynamical systems has experienced an explosive growth in the late 1970s and early 1980s. This is very nicely presented in the present book. The mathematicians managed later on to prove many results that had only been guessed by physicists in this field. Emboldened by the success of this notion of “structural stability,” some scientists, Len Pismen among them, tried to deal in the same way with the pattern-forming systems. This amounted to summarizing the properties of the system at hand into a set of equations as simple as possible, but with all the relevant symmetries. This method traces back its origin in Poincar´e’s normal forms; near a bifurcation point, one can reduce the complexity of the equations by keeping as variables a few time-dependent amplitudes only, with simple polynomial nonlinearities. This reduction of the complexity is, after all, what we do spontaneously when we see a set of rolls in aligned clouds or chaos and turbulence in a cloud painted by Tiepolo or Corot. The question is posed by this reduction: Can we obtain a picture of the phenomena general enough to yield the most obvious features of the solutions we would like to describe, although the mathematics remain simple enough to be amenable to our methods of analysis? Of course, such a reductionist view is at the heart of our physical description of the world. To take an example, the Navier–Stokes equations of a viscous fluid reduce all the complex motion of an
Foreword
VII
almost infinite number of atoms and molecules to the knowledge of the value of the shear viscosity of this fluid and, eventually, to the pressure–density relation. Len Pismen starts from quite general equations, kind of generalized reaction–diffusion equations for an arbitrary number of chemical species. He shows masterfully how to reduce them to simpler forms near bifurcation points (the famous Newell–Withehead–Segel amplitude equation, the Kuramoto– Sivashinsky equation, the Ginzburg–Landau equation to name just a few). He then follows this general scheme of reduction, but with very little “hubris.” Reading his text, I am amazed by the conciseness and efficiency of his presentation. Only a few lines of text and some very clever mathematical steps bring all the necessary light in very messy questions, in the great tradition of scientists such as Zel’dovich, Kolmogorov, and Landau. He balances very finely the logical step, the development of a new intuition, with the help of classical analysis at its best. This text has the double interest to introduce the reader to a whole fascinating new field, still in a stage of fast development, and to show how to sort out quite complex issues in an efficient way. Besides its obvious pedagogical aspects, this monument of scholarship is also the very first one to cover in a fully unified way an extremely wide range of topics. It reaches quite often the cutting edge of present-day research. For instance, it gives a very thorough review of everything known about the spirals in excitable media, including the instabilities of the center of the spiral that may oscillate, meander, and so on. Although the amplitude equations have been known for a number of years, this is – as far as I can tell – the first time all their properties are discussed in a unified text. As the title shows, part of the book is devoted to fronts and interfaces. This is done in Chap. 2, which is very welcome as it puts in a single framework topics such as the Maxwell–van der Waals theory of liquid–vapor interface, the growth of a stable pattern in an unstable medium (the so-called KPP problem), and other “phase field models” that have been lately very thoroughly studied. The amplitude equation section (Chap. 4) is an exposition by a master of the field. Everything is covered in a smooth way, including the very tricky question of the motion of defects, where the distortion brought to the phase field by the motion is analyzed in depth. The latest progress in pinned fronts, grain boundaries, etc. is well covered. The advantage of a single book is most evident here, because the discussion relies on a rather delicate analysis of bifurcations of trajectories in a 3D space. The final chapter is about wave patterns and spirals, with all their instabilities, interactions, etc. This book follows another one by the same author, on vortices in nonlinear fields, and the two bring a unified view of an extremely active and interesting field of modern research.
Paris, France
Yves Pomeau
Preface
This book involved considerable rewriting and reshuffling, despite the fact that I thought when I started it that I knew the material well. As usual, it was difficult to decide what to include and what not. A monograph should not imitate a journal review; it is too easy to send readers to find their own way in the thick of the woods. However, the narrative may expand without limit when attempting to be self-contained. The final compromise may sometimes be subjective and imperfect. Few appreciated the hard labor of Procrustes, who had to fit all kinds of strangers into his infamous bed. The author finds himself in a somewhat similar position, with an additional constraint on the use of violent means and an obligation to keep his customers alive and well, while resizing them to common logic and notation. This is not easy even when processing one’s own work of yesteryear. One wishes to give up and write another paper instead, but this becomes impossible after a critical point has been passed and the invested effort has grown too heavy to discard. The result is before the reader. Patterns and interfaces live in space; I could not avoid, nevertheless, to include a long chapter on dynamical systems, which live in time only, but provide both technical means and examples to follow for more robust spatial structures. Ardent students of dynamical systems may find it almost sacrilegious to see a variety of bifurcations and endless abyss of chaos crowded into a few dozen pages, still shared with the dynamics of regular patterns (which imitate far simpler systems by forfeiting their imperfections and natural variability). These are, of course, pure essentials that are needed to understand further material. The core of the book lies in various applications of perturbation theory, which attempts to tackle nonlinear spatiotemporal structures that, at first sight, are likely to break our modest analytical tools. A modern paradox is that these structures are often easier to simulate numerically than to carve analytically. Simulation is, however, not a substitute for understanding, and one hopes that analytical skills will not fade away with the change of generations.
X
Preface
Just imagine a feeble knight-errant, armed only with a paper sword – and, perhaps, a laptop with symbolic computation software: can he dare to overcome a horde of nonlinear beasts? There are, essentially, two tricks known from ancient times: separate them or try to surprise them while they are still waking up. The first method is called scale separation and is the principal tool in Chaps. 2 and 3, where we study first fronts, and then structures built up by their combinations in reaction–diffusion and related equations. The second method, called amplitude expansion, deriving and analyzing universal equations near symmetry-breaking transitions, prevails in Chaps. 4 and 5. Reaction–diffusion systems, with their plethora of chemical and biological applications and common but versatile structure, provide the bulk of material of the book. Other common pattern-forming systems rooted in fluid mechanics and nonlinear optics are not considered explicitly, but they converge to the same universal equations of amplitude and phase dynamics. I am indebted to many colleagues and friends of our “nonlinear community”, which has forged during the late decades of 20th century our basic understanding of pattern formation far from equilibrium. The new century, that seems to be interested, in its youth, in the particular more than in the universal, may still find this knowledge useful for building up future biomorphic technologies based on bottom-up self-organization rather than top-down manufacturing.
Technion – Israel Institute of Technology Haifa, November 2005
L.M. Pismen
Contents
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Quest for Complexity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Conservative and Dissipative Systems . . . . . . . . . . . . . . . . . . . . . . Closed and Open Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Field Variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Historical and Bibliographical Notes . . . . . . . . . . . . . . . . . . . . . . .
1 1 2 3 4 6
Dynamics, Stability and Bifurcations . . . . . . . . . . . . . . . . . . . . . . 1.1 Basic Models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.1.1 Dynamical Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.1.2 Reaction–Diffusion System . . . . . . . . . . . . . . . . . . . . . . . . . 1.1.3 Vertical Structure and Representative Equations . . . . . . 1.1.4 Spectral Decompositions . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.1.5 Trajectories and Attractors . . . . . . . . . . . . . . . . . . . . . . . . 1.2 Linear Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.2.1 Instabilities of Stationary States . . . . . . . . . . . . . . . . . . . . 1.2.2 Turing and Hopf Instabilities . . . . . . . . . . . . . . . . . . . . . . . 1.2.3 Dispersion Relations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.2.4 Instabilities of Periodic Orbits . . . . . . . . . . . . . . . . . . . . . . 1.3 Weakly Nonlinear Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.3.1 Multiscale Expansion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.3.2 Bifurcation of Stationary States . . . . . . . . . . . . . . . . . . . . 1.3.3 Derivation of Amplitude Equations . . . . . . . . . . . . . . . . . 1.3.4 Hopf Bifurcation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.3.5 Degenerate Bifurcations . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.4 Global Bifurcations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.4.1 Global Dynamics: An Overview . . . . . . . . . . . . . . . . . . . . . 1.4.2 Systems with Separated Time Scales . . . . . . . . . . . . . . . . 1.4.3 Almost Hamiltonian Dynamics . . . . . . . . . . . . . . . . . . . . . . 1.4.4 Bifurcation Diagrams . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.5 Deterministic Chaos . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
9 9 9 13 15 17 19 21 21 23 24 25 27 27 29 32 35 38 39 39 42 45 46 51
1
XII
Contents
1.5.1 Chaotic Attractors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.5.2 Shilnikov Bifurcation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.5.3 Period Doubling Cascade . . . . . . . . . . . . . . . . . . . . . . . . . . 1.5.4 Lorenz System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.6 Dynamics of Planforms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.6.1 Interaction of Turing Modes . . . . . . . . . . . . . . . . . . . . . . . . 1.6.2 Resonant Planforms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.6.3 Degenerate Wave Modes . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.6.4 Biscale Resonances . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
51 54 57 61 66 66 69 74 77
Fronts and Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83 2.1 Planar Fronts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83 2.1.1 Space-Dependent Amplitude Equations . . . . . . . . . . . . . . 83 2.1.2 Propagating Front as a Heteroclinic Trajectory . . . . . . . 85 2.1.3 Computation of the Propagation Speed . . . . . . . . . . . . . . 87 2.1.4 Maxwell Construction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89 2.1.5 Unstable Nonuniform States . . . . . . . . . . . . . . . . . . . . . . . 90 2.1.6 Front Interactions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91 2.2 Weakly Curved Fronts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94 2.2.1 Aligned Coordinate Frame . . . . . . . . . . . . . . . . . . . . . . . . . 94 2.2.2 Expansion Near Maxwell Construction . . . . . . . . . . . . . . 97 2.2.3 Burgers Equation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98 2.2.4 Ripening under Global Control . . . . . . . . . . . . . . . . . . . . . 100 2.3 Propagation into an Unstable State . . . . . . . . . . . . . . . . . . . . . . . . 103 2.3.1 Continuum of Propagating Solutions . . . . . . . . . . . . . . . . . 103 2.3.2 Asymptotic Theory of the Leading Edge . . . . . . . . . . . . . 105 2.3.3 Stability of the Leading Edge . . . . . . . . . . . . . . . . . . . . . . 106 2.3.4 Pulled and Pushed Fronts . . . . . . . . . . . . . . . . . . . . . . . . . . 108 2.4 Cahn–Hilliard Equation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110 2.4.1 Order Parameter and Energy Functional . . . . . . . . . . . . . 110 2.4.2 Conservative Gradient Dynamics . . . . . . . . . . . . . . . . . . . 111 2.4.3 Inner and Outer Equations . . . . . . . . . . . . . . . . . . . . . . . . . 112 2.4.4 Solvability Condition and Matching . . . . . . . . . . . . . . . . . 114 2.4.5 Propagation and Coarsening in 1D . . . . . . . . . . . . . . . . . . 117 2.4.6 Ostwald Ripening . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121 2.5 Phase Field Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123 2.5.1 Variational Principle for Phase Field Model . . . . . . . . . . 123 2.5.2 Sharp Interface Limit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124 2.5.3 Mobility Relation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 126 2.6 Instabilities of Interphase Boundaries . . . . . . . . . . . . . . . . . . . . . . 127 2.6.1 Instabilities due to Coupling to Control Field . . . . . . . . . 127 2.6.2 Mullins–Sekerka Instability . . . . . . . . . . . . . . . . . . . . . . . . . 129 2.6.3 Instability of a Curved Interface . . . . . . . . . . . . . . . . . . . . 132 2.6.4 Directional Solidification . . . . . . . . . . . . . . . . . . . . . . . . . . . 134 2.6.5 Long-Scale Instability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137
Contents
XIII
3
Systems with Separated Scales . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141 3.1 Stationary Structures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141 3.1.1 FitzHugh–Nagumo System . . . . . . . . . . . . . . . . . . . . . . . . . 141 3.1.2 Stationary Structures in 1D . . . . . . . . . . . . . . . . . . . . . . . . 143 3.1.3 Solitary Disk and Sphere . . . . . . . . . . . . . . . . . . . . . . . . . . 145 3.1.4 Migration-Enhanced Structures . . . . . . . . . . . . . . . . . . . . . 148 3.1.5 Quasistationary Dynamics . . . . . . . . . . . . . . . . . . . . . . . . . 150 3.2 Symmetry Breaking Instabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . 152 3.2.1 Stability of a Straight-Line Front . . . . . . . . . . . . . . . . . . . 152 3.2.2 Stability of a Solitary Band . . . . . . . . . . . . . . . . . . . . . . . . . 153 3.2.3 Stability of a Striped Pattern . . . . . . . . . . . . . . . . . . . . . . . 154 3.2.4 Stability of a Solitary Disk and Cylinder . . . . . . . . . . . . . 157 3.3 Dynamic Instabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160 3.3.1 Propagating Fronts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160 3.3.2 Traveling Instability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 162 3.3.3 Oscillatory Instability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163 3.3.4 Phenomenological Velocity–Curvature Relation . . . . . . . 165 3.3.5 Long-Scale Evolution Equations . . . . . . . . . . . . . . . . . . . . . 170 3.4 Locally Induced Motion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 172 3.4.1 Intrinsic Equations of Motion . . . . . . . . . . . . . . . . . . . . . . 172 3.4.2 Steadily Rotating Spiral . . . . . . . . . . . . . . . . . . . . . . . . . . . 174 3.4.3 Propagation into a Quiescent State . . . . . . . . . . . . . . . . . 177 3.4.4 Spiral Band near Ising–Bloch Bifurcation . . . . . . . . . . . . 179 3.5 Advective Limit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 181 3.5.1 Inertial Scaling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 181 3.5.2 Dispersion Relation for Wave Trains . . . . . . . . . . . . . . . . 183 3.5.3 Chaotic Wave Trains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 185 3.6 Rotating Spiral Waves . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 188 3.6.1 Advective Limit for a Rotating Spiral . . . . . . . . . . . . . . . . 188 3.6.2 Propagating Finger . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 191 3.6.3 Slender Spiral Band . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 195 3.6.4 Tip Meandering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 197 3.6.5 Phenomenology of Complex Spiral Motion . . . . . . . . . . . 200 3.6.6 Scroll Waves . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 204
4
Amplitude Equations for Patterns . . . . . . . . . . . . . . . . . . . . . . . . 209 4.1 Spatially Modulated Patterns . . . . . . . . . . . . . . . . . . . . . . . . . . . . 209 4.1.1 Ginzburg–Landau Equation . . . . . . . . . . . . . . . . . . . . . . . . 209 4.1.2 Newell–Whitehead–Segel Equation . . . . . . . . . . . . . . . . . . 211 4.1.3 Variational Formulation . . . . . . . . . . . . . . . . . . . . . . . . . . . 212 4.1.4 Stationary Solutions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 213 4.1.5 Stability of Stationary Solutions . . . . . . . . . . . . . . . . . . . . 216 4.2 Phase Dynamics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 218 4.2.1 Universal Form of Phase Equations . . . . . . . . . . . . . . . . . . 218 4.2.2 Variational Formulation . . . . . . . . . . . . . . . . . . . . . . . . . . . 219
XIV
Contents
4.3
4.4
4.5
4.6
5
4.2.3 Long-Scale Expansion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222 4.2.4 Covariant Phase-Amplitude Equation . . . . . . . . . . . . . . . 223 Defects in Striped Patterns . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225 4.3.1 Natural Patterns . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225 4.3.2 Phase Field of a Dislocation . . . . . . . . . . . . . . . . . . . . . . . . 227 4.3.3 Dislocations in NWS Equation . . . . . . . . . . . . . . . . . . . . . 229 4.3.4 Dislocation Core . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 232 4.3.5 Disclinations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 234 4.3.6 Domain Walls . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 235 Motion of Dislocations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 238 4.4.1 The Nature of the Driving Force . . . . . . . . . . . . . . . . . . . . 238 4.4.2 Phase Field of a Moving Defect . . . . . . . . . . . . . . . . . . . . . 239 4.4.3 Dissipation Integral and Peach–K¨ ohler Force . . . . . . . . . 241 4.4.4 Matched Asymptotic Expansions . . . . . . . . . . . . . . . . . . . 244 4.4.5 Interaction of Dislocations . . . . . . . . . . . . . . . . . . . . . . . . . 247 4.4.6 Motion in a Supercriticality Ramp . . . . . . . . . . . . . . . . . . 252 Propagation of Pattern and Pinning . . . . . . . . . . . . . . . . . . . . . . . 254 4.5.1 Wavelength Selection in a Propagating Pattern . . . . . . . 254 4.5.2 Self-Induced Pinning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 257 4.5.3 Geometry of Pinned States . . . . . . . . . . . . . . . . . . . . . . . . . 260 4.5.4 Crystallization Kinetics . . . . . . . . . . . . . . . . . . . . . . . . . . . . 263 4.5.5 Pinning of Defects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 267 Hexagonal Patterns . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271 4.6.1 Triplet Amplitude Equations . . . . . . . . . . . . . . . . . . . . . . . 271 4.6.2 Skewed Triplets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 273 4.6.3 Penta-Hepta Defects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 275 4.6.4 Domain Boundaries . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 279 4.6.5 Propagation of the Hexagonal Pattern . . . . . . . . . . . . . . . 283
Amplitude Equations for Waves . . . . . . . . . . . . . . . . . . . . . . . . . . . 287 5.1 Plane Waves . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 287 5.1.1 Complex Ginzburg–Landau Equation . . . . . . . . . . . . . . . 287 5.1.2 Perturbations of Plane Waves . . . . . . . . . . . . . . . . . . . . . . 289 5.1.3 Phase Equations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 292 5.1.4 Propagation of Wave Pattern . . . . . . . . . . . . . . . . . . . . . . . 294 5.1.5 Coupled CGL Equations . . . . . . . . . . . . . . . . . . . . . . . . . . . 295 5.2 One-Dimensional Structures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 297 5.2.1 Classification of 1D Solutions . . . . . . . . . . . . . . . . . . . . . . . 297 5.2.2 Holes and Wavenumber Kinks . . . . . . . . . . . . . . . . . . . . . . . 299 5.2.3 Modulated Waves and Phase Turbulence . . . . . . . . . . . . . 302 5.2.4 Transition to Defect Chaos . . . . . . . . . . . . . . . . . . . . . . . . . 305 5.2.5 Sources and Sinks in Coupled CGL Equations . . . . . . . . 307 5.3 Spiral Waves . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 310 5.3.1 Symmetric Spiral . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 310 5.3.2 Asymptotic Relations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 312
Contents
XV
5.3.3 Nondissipative Limit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 316 5.3.4 Acceleration Instability . . . . . . . . . . . . . . . . . . . . . . . . . . . . 318 5.4 Interaction of Spiral Vortices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 320 5.4.1 Nonradiative Limit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 320 5.4.2 Weakly Radiative Vortices . . . . . . . . . . . . . . . . . . . . . . . . . 322 5.4.3 Strong Radiation and Shocks . . . . . . . . . . . . . . . . . . . . . . . 326 5.4.4 Multispiral Patterns . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 329 5.4.5 Period Doubling in Spirals . . . . . . . . . . . . . . . . . . . . . . . . . 333 5.5 Line Vortices and Scroll Waves . . . . . . . . . . . . . . . . . . . . . . . . . . . 336 5.5.1 Curvature-Driven Motion . . . . . . . . . . . . . . . . . . . . . . . . . . 336 5.5.2 Nondissipative Motion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 339 5.5.3 Dissipative Nonradiative Line Vortex . . . . . . . . . . . . . . . . 343 5.5.4 Instability of Line Vortices . . . . . . . . . . . . . . . . . . . . . . . . . 344 5.6 Resonant Oscillatory Forcing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 347 5.6.1 Broken Phase Symmetry . . . . . . . . . . . . . . . . . . . . . . . . . . . 347 5.6.2 Forcing at Double Frequency . . . . . . . . . . . . . . . . . . . . . . . 348 5.6.3 Ising and Bloch Fronts . . . . . . . . . . . . . . . . . . . . . . . . . . . . 350 5.6.4 Higher Resonances . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 354 References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 357 Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 365
Introduction
Quest for Complexity Human eye is bored by monotonous landscape. We are depressed by gray skies, unending plain under the wing of an airliner, featureless urban sprawl, geometric canvasses in empty museum halls. Having evolved to meet the challenges of a complex world, we enjoy complexity. Stormy sea entertains us by a spectacle of spatio-temporal complexity. It is imitated by entertainers overwhelming us by the information deluge of blinking images in video clips. We also do enjoy, however, the calm of spatial complexity: a mountain landscape, a forest, a meadow, a mosaic. Complexity is particularly appealing when it arises spontaneously, rather than by design. This is where nature and industry differ most: nature starts from a simple form and builds complexity by evolution and differentiation, while industry manufactures objects according to a preconceived form. As products of modern technology become increasingly complex, and the size of details goes down to micro- and nanoscale, industrial methods may become biomorphic as well. They would then make use of natural processes of spontaneous structure formation to grow complex entities in the way they are nurtured by nature itself. Our aim is to understand how relatively simple nonlinear systems obeying symmetric equations may generate a dazzling variety of forms. We shall be mostly concerned with distributed systems dependent on spatial coordinates as well as on time. The standard physical setting for our study is an extended (ideally, infinite) homogeneous isotropic system, and the description will invariably be on a macroscopic (mean field, or hydrodynamic) level. A much simpler dynamical system arises when the spatial dependence is suppressed. Dynamical systems may still exhibit complex temporal behavior, and serve as an indispensable tool for understanding more complex spatially distributed systems when a few dominant modes are sufficient for adequate approximate description of spatio-temporal dynamics.
2
Introduction
Conservative and Dissipative Systems Earliest dynamical models have originated in classical mechanics. These models contain one or more integrals of motion, which are conserved in the course of evolution. Systems of this kind, called conservative, may exhibit persistent motion without relaxing to a stationary equilibrium state. Until the end of 19th century, classical mechanics was preoccupied with integrable systems, which can be separated into an ensemble of oscillators and display periodic or quasiperiodic behavior, depending on whether the oscillation periods are commensurate or not. Henri Poincar´e was the first to realize that even such a simple system as two interconnected pendula may already exhibit far more complex aperiodic dynamics. It took, however, another half-a-century or more for the notion of deterministic chaos to establish itself in the scientific community. Paradoxically, it was quantum mechanics that destroyed the belief in classical determinism. The latter’s ultimate expression was the famous Laplace’s maxim: a “supreme intelligence” capable of solving dynamical equations for all particles in the universe and knowing all initial conditions could predict the future in its entirety. Quantum mechanics showed this to be impossible, introducing chance into physics. Many scientists and philosophers, including the great Einstein, who detested God playing dice, regretted this. The paradox is that throwing dice, a symbol of chance game, follows the laws of classical mechanics. Its determinism is illusory, as precision in fixing the initial conditions needed for predicting the future state rapidly increases with the growing length of the prediction interval. Quantum mechanics with its indeterminism actually smoothes out chaotic classical dynamics, and so prediction of averaged expectations becomes easier in quantum theory. The advent of computers played a crucial role in understanding complex chaotic dynamics, or at least in making the notion of deterministic chaos familiar to the wider scientific community and the general public. Before the computer age, research was concentrated on a tiny and nonrepresentative minority of mechanical systems described by analytically solvable models, and it took imagination of men of genius to understand the complexity of behavior that is transparent nowadays to an ordinary person observing a trajectory on a computer screen. An extension of conservative dynamical systems is field theory studying conservative dynamics of spatially extended systems with infinite number of degrees of freedom. Nonlinear fields described by nonlinear partial differential equations possess the richest mathematical structure and are capable of generating infinite variety of spatio-temporal structures, both ordered and chaotic. The first and perhaps most widely studied nonlinear field theory was classical hydrodynamics of ideal fluids. The phenomenon of turbulence has been first studied in fluid-mechanical context, and only later extended to a wider class of distributed systems displaying spatio-temporal chaos. Fascinating analytical theory has been developed to describe the behavior of a
Introduction
3
special class of completely integrable nonlinear partial differential equations that possess an infinite number of integrals of motion. The most prominent feature of these models is the existence of particle-like localized solutions, called solitons, which are able to preserve their identity in interactions and collisions. Completely integrable field equations are as nongeneric as completely integrable dynamical systems. They give, however, the only chance to study nonlinear structures analytically, and the results of this study, besides their mathematical beauty, are useful for the analysis of more realistic systems where the conservation laws are weakly broken, so that integrals of motion do not remain strictly constant but slowly evolve in time. As conservation laws are woven into the canvas of physics, dissipative (nonconservative) models always appear as approximate or coarse-grained models describing the averaged behavior of complex systems. Dissipation may appear in a mechanical system as an additional term taking account of friction, which is, in fact, the result of disordered motion of a great number of microscopic particles lumped by a macroscopic model characterized by few degrees of freedom. Mean field models of thermodynamic or chemical origin are always dissipative, as they describe averaged dynamics characterized by a small number of thermodynamic variables. In fluid mechanics, dissipation is brought in by viscosity and diffusion, stemming, like friction, from disordered motion on microscopic level. It should be noted that dissipative mean field models are also usually derived from a mass, energy, or momentum conservation law, but contain sources or sinks that destroy conservation of the respective integrals. Besides dissipation in the common sense of the word – loss of energy, momentum, etc. – nonconservative systems may include sources due to external pumping, or “antidissipation.” Behavior of such systems, constrained neither by conservation laws nor by the boring laws of thermodynamics, is particularly rich and interesting; most pattern-forming systems we shall study belong to this class. From a formal point of view, conservative systems are nongeneric: a randomly generated set of equations will have no conservation laws. Closed and Open Systems We shall mostly deal here with macroscopic dissipative systems. A system of this kind can either be closed or open, i.e., exchanging mass and energy with the environment. The former case is less interesting, since, by the second law of thermodynamics, a closed physical system has to relax to a state of thermodynamic equilibrium. Since thermodynamic free energy decreases in the course of evolution, any system of equations modeling a closed system should possess an integral F monotonically decreasing with time1 . 1
In some models, existence of a monotonically decreasing integral, called a Lyapounov functional can be established ad hoc even when not supported by thermodynamics
4
Introduction
Although this restricts dynamics in a severe way, behavior of closed systems may still be far from trivial, since they may possess multiple equilibria. Any equilibrium state can be characterized by a certain value of free energy, and so, generically, there will be a single state of absolute equilibrium with the lowest value of F, while the other equilibria will be metastable. Evolution to the state of absolute equilibrium may be, however, hindered by high activation barriers, and so various metastable equilibria may persist indefinitely. An open system is sustained in a nonequilibrium state by external fluxes. Such a system, generally, can be assigned no energy functional; its dynamics is more interesting, since it is not restricted by a priori rules. There is, however, a restriction imposed on the geometry of an open system. While a closed system may be isotropic in three dimensions, the direction of external fluxes sets a preferred axis in an open system; we shall tentatively call this direction “vertical.” The system may retain isotropy in the normal “horizontal” plane, provided neither the properties of the system itself nor the strength of external fluxes depend on spatial coordinates explicitly and the influence of lateral boundaries can be discarded. A suitable geometric setting is an infinite plane normal to the direction of external fluxes (Fig. 1.1). The system may be truly two-dimensional (Fig. 1.1a) if the process is taking place on a surface and all relevant field variables are surface densities. Otherwise, the system would possess some “vertical structure” in the direction of fluxes (Fig. 1.1b) but retain isotropy in horizontal directions. Field Variables The level of detail on which the physical system is described is always a compromise between faithfulness and transparency, between available tools and desired results. The physicist may be satisfied by the simplest description that catches the essence of the phenomena, while the engineer strives for quantitative precision, often illusory. Either one sees (or prefers not to see) that the quest is open-ended, and any problem is solvable only in an imperfect way, on a level that shifts with time, or with changing circumstances and aims. The level on which we operate here is one of macroscopic classical theory. The physical system is described by a certain set of mean field variables, which characterize the thermodynamic state of the system. The list of variables may include temperature, density or pressure, concentrations of chemical species, magnetization, electric polarization or potential, etc. It might be convenient to organize these variables in an n-dimensional array u, which should completely determine the state of the physical system in question. The mean field description is sufficient in very large ensembles, under conditions when fluctuations are negligible. In some cases, fluctuations may be reintroduced phenomenologically through random inputs to mean field equations. The same set of thermodynamic variables also serves to characterize a nonequilibrium system. All these variables should be then defined locally and are, generally, functions of spatial variables and time, u(x, t). The aim of
Introduction
5
the mean field theory is to formulate and solve evolution equations describing the dynamics of state variables. Since nonequilibrium processes usually involve mass transport, it might be necessary to complement the set of thermodynamic variables by the velocity field . The set of evolution equations will then include coupled hydrodynamic equations for flow velocity and transport equations for thermodynamic variables. The mean field description of a spatially inhomogeneous and temporally evolving system is, in some way, self-contradictory. Averaged state variables and flow velocities can be defined in a macroscopic volume only, which is formally at odds with the notion of an infinitesimal volume used in derivation of continuum equations. The contradiction is resolved by the requirement that all state variables should vary on spatial and temporal scales far exceeding all relevant “microscopic” scales, such as intermolecular distances or free path length and molecular relaxation times. This requirement is, unfortunately, too stringent in many situations, especially near interphase boundaries or at particular values of parameters (in the vicinity of critical points) when the scale of fluctuations reaches macroscopic dimensions. The crossover from microscopic to mean field description is one of “internal frontiers” of modern physics, where problems are challenging and answers are few and incomplete. Even as the mean field description is oversimplified from the fundamental point of view, it may be, at the same time, too complex and technical. A more transparent theory may help to elucidate the most important qualitative features of the system under study. For this purpose, Landau has coined the notion of “order parameter.” The order parameter may distinguish between alternative equilibria, which correspond to different phases. When the phases coexist, the order parameter changes continuously across the interphase boundary. Thus, we should speak of an order parameter field (with some regret for misuse of the word “parameter” that commonly denotes a fixed coefficient rather than a field variable). It may be either one of the physical fields or a fictitious field that lumps the effect of all changes accompanying the phase transition. The free energy should be expressed through the order parameter and its derivatives in such a way that its minima correspond to stable phases. The hierarchy of simplified descriptions ascending to larger scales and more complex phenomena is a common structure of knowledge. Even the order parameter field may be subject to further averaging and coarsening on the next hierarchical level if it develops its own elaborate spatio-temporal structure. Composite entities play a role of elementary objects in diverse applications, from dynamics of granular media to motion of galactic clusters. In biology and social sciences, a mean field theory may operate with still more complex and coarse-grained variables, such as population densities, while applying equations and techniques not much different from those of chemical physics.
6
Introduction
Historical and Bibliographical Notes Study of dynamics and pattern formation far from equilibrium (a major branch of “nonlinear science”) is now a mature discipline that has passed a common sequence of development stages. The following is an incomplete view from the perspective of this book2 : Prehistory: Faraday instability (Faraday, 1831) of the free surface of a vibrated fluid layer was the first example of spontaneous pattern formation; it had to wait, however, for more than a century for theoretical explanation. Dawn: study of particular phenomena; lack of connections (1900s–1960s). Spontaneous symmetry breaking was known in fluid mechanics since the experiments of B´enard (1900) and their forceful, though factually incorrect, explanation by Rayleigh (1916). In chemical and biological applications, the awareness of this phenomenon had to wait another half-a-century till the famous work of Turing (1952), far weaker analytically, though philosophically charged. Chemical oscillations were considered taboo because of thermodynamical misconceptions well into the 1960s, while electrochemical oscillations and waves were known since the turn of the century (Ostwald, 1900). Landau (1944) treated turbulence as a field theory with a very large number of degrees of freedom, while wide implications of chaotic behavior of simple mechanical systems, known already to Poincar´e, were not understood. A paradigmal model of chaotic flow by Lorenz (1963) remained unnoticed for 15 years. Development: general theory comes of age (late 1960s to early 1980s). Synergetics of Haken (1983) and the self-organization principle of the Brussels school (Nicolis & Prigogine, 1977) offer paradigms of dynamics far from equilibrium. Belousov–Zhabotinsky reaction (Zhabotinskii, 1974) is explored as a spectacular example of chemical oscillations, prompting theoretical studies of chemical waves and diffusion fronts (Ortoleva & Ross, 1974; Kuramoto & Tsuzuki, 1976; Fife, 1979, and many others). Nonlinear theory of convective patterns is firmly established (Busse, 1978; Normand, Pomeau & Velarde, 1977) and tested in precision experiments (Ahlers, 1974). Other input comes from combustion theory (Zeldovich, 1985; Buckmaster & Ludford, 1983; Sivashinsky, 1977) and the theory of solidification (Langer, 1980). Simple patternforming models – Brusselator, Kuramoto–Sivashinsky, Swift–Hohenberg equations – are brought forward and explored. Chaos theory is transformed by the discovery of period-doubling sequence and other generic routes of transition to chaos. Summit (mid-1980s to early 1990s): acme. Common techniques are applied to nonequilibrium structures of different physical origin. Space-dependent amplitude equations and phase dynamics lead to understanding of genesis and behavior of realistic patterns, constrained by boundaries and blemished by defects. Chemical patterns are studied under controlled conditions (Ouyang & Swinney, 1991), and the theory of spiral waves, prompted by chemical and 2
This list omits references to original work described in detail elsewhere in the book.
Introduction
7
physiological applications, attracts great attention. The NATO Special Program on Chaos, Order and Patterns did much to unify physicists’ approach and diffuse the knowledge, and it might not be by accident that its end coincided with the publication of the review by Cross and Hohenberg (1993), which remains to this day the most comprehensive survey of the field. Other monographs, emphasizing different aspects of nonequilibrium dynamics and pattern formation were published by Manneville (1990), Mikhailov (1991), Nicolis (1995), and Walgraef (1997), while the books by Berg´e et al (1984) and Ott (1993) concentrated on problems of chaos and turbulence. Specific problems of patterns and fronts in reaction-diffusion equations were treated in (very dissimilar) books by Murray (1989) and Fife (1988) – one geared to biological applications and the other to combustion problems. On a different front, theory of bifurcations in dynamical systems was formalized in mathematical monographs, with the emphasis on dynamic behavior (Guckenheimer & Holmes,1983; Hale & Kocak, 1991, and many others) or group-theoretical aspects (Golubitsky & Schaeffer, 1985). Maturity (mid-1990s to now): a more detailed look at complexity. Attention returns to specific applications; among them, nonlinear optics and studies of granular media come to the forefront. Forcing and control of patterns, either enhancing or suppressing the complexity of behavior, are studied in detail. As a humble laptop turns into a supercomputer, more fascinating patterns, envy of abstract expressionists, are generated by model equations of increased complexity run by friendly Matlab programs. Whether or not new ideas will emerge as the new century comes of age, this discipline, dealing with ubiquitous problems of order and chaos, is bound to find its way into basic curricula and wealth of practical applications.
1 Dynamics, Stability and Bifurcations
1.1 Basic Models 1.1.1 Dynamical Systems A general dynamical system is just a set of ordinary differential equations (ODEs) that can be written as a system of first-order equations resolved in respect to the time derivatives: dui = fi (u). dt
(1.1)
It is convenient to arrange the dependent variables as components ui of the n-dimensional state array u. It is often advantageous to describe the dynamics in geometric terms, and refer to u as a state array, i.e. a vector in the n-dimensional phase space. Respectively, the right-hand sides (r.h.s.) are presented as components fi of a nonlinear vector-function f (u). In chemical and biological models, the dependent variables ui may be concentrations of chemical species or population densities; then (1.1) represents the balance of the respective species in a spatially homogeneous (e.g., well mixed) system, and fi (u) combine the net production rates and exchange with the environment. Similar equations can be written for other variables, e.g., temperature. Stationary states, or fixed points of (1.1), u = us , are zeros of f (u); they are also often called equilibria, although, of course, they do not coincide with thermodynamic equilibria when exchange with the environment is present. Multiple equilibria are possible even in a closed system, where they are, generally, characterized by different values of free energy. Therefore, one can define the state with the lowest energy as absolutely stable, other states corresponding to local minima of free energy as metastable, and states corresponding to saddle points or maxima as unstable. A closed system relaxing to thermodynamic equilibrium should be described by a gradient dynamical
10
1 Dynamics, Stability and Bifurcations
system that possesses a potential V (u), such that fi (u) = −∂V /∂ui . The potential decreases monotonically in the course of evolution, until a minimum is reached: ∂V dui ∂V 2 dV = =− ≤ 0. (1.2) dt ∂ui dt ∂ui i i Open systems, generally, lack this property, so that one cannot distinguish in this case between absolutely stable and metastable states. Particular chemical or biological models are often constructed on the basis of the mass action law , which stipulates that reaction rates are proportional to concentrations of reactants. The functions fi (u) defined in this way are necessarily polynomials, which, of course, may seem unduly restrictive. On the other hand, the dynamic behavior of a polynomial system may not differ qualitatively from that of a more algebraically complicated system. The mass action principle has been used to construct a number of artificial easily solvable models specifically designed to illustrate certain features of dynamics. Thus, if one wishes to illustrate a transition between two alternative equilibria, each of them being stable in a certain range of parameters, the simplest form is u˙ = µu − u3 ,
(1.3)
where the dot denotes the time derivative. The stable stationary state is u = 0 √ at µ < 0 and u = µ at µ > 0. This model can be disguised as a chemical scheme including a monomolecular and a trimolecular reaction, known as the Schl¨ ogl model. This disguise would be dismissed by a physicist, who would call u an “order parameter” and use (1.3) to describe a transition between a “disordered” phase with u = 0 and an “ordered” phase with u = 0. For a mathematician, (1.3) is a “normal form” satisfying the condition of inversion symmetry (see Sect. 1.3.2). This symmetry can be broken by adding a constant term. A simple extension of (1.3) to two-dimensional (2D) phase space is the FitzHugh–Nagumo model (FitzHugh, 1961); its rescaled symmetric form cotaining two parameters µ, γ is γ u˙ = u − u3 − v,
v˙ = −v + µu.
(1.4)
This model is far more interesting, as it generates oscillatory behavior as well as multiplicity of stationary states (see Sect. 1.4.2). The most celebrated artificial “chemical” system is the Brusselator model (Prigogine and Lefever, 1968). It can be constructed as mass conservation equations describing two fictitious chemical reactions 2A + B → 3A,
B → A,
It is further assumed that the species A, but not B, is supplied from and removed to the environment.1 This leads, after appropriate rescaling, to the 1
In the original derivation, two more reactions were added in lieu of the exchange. The interpretation in the text, mathematically indistinguishable from the original model, is also known as Gray–Scott model.
1.1 Basic Models
11
system of equations u˙ = ν − (µ + 1)u + u2 v,
v˙ = µu − u2 v,
(1.5)
where µ, ν are parameters. The real purpose of the construction is to have an “autocatalytic” system, which always has a unique and easily computable stationary state u = ν, v = µ/ν; this state can be made by additional rescaling independent of the parameters of the system. This is, of course, rather unrealistic, but very convenient, as it allows one to forget about the cumbersome task of finding the equilibria and to concentrate upon more interesting questions of symmetry breaking and dynamics. Continuing this trend, R¨ ossler (1976) designed several three-variable dynamical systems with simple algebraic r.h.s to illustrate various aspects of chaotic dynamics. Various models of population dynamics are also based on the mass action law and have a general form µij uj . (1.6) u˙ i = νi ui + ui j
The common feature of these models is the presence of trivial “extinction” states with vanishing ui . The interactions are competitive when both µij and µji are negative, cooperative when both are positive, and prey–predator when µij and µji are of the opposite sign. Many realistic chemical models have a more complicated form. The source of complexity is in multistage chemical mechanisms, which may have characteristic rates differing by many orders of magnitude. Some chemical stages rapidly reach equilibrium, which enforces certain algebraic relations among the concentrations of reacting species. Using these equilibrium relations in kinetic equations of slower stages leads to dynamic equations with nonpolynomial functions fi (u) even when all original equations are based on the mass action law. This is characteristic to catalytic or enzyme reactions, where the fast stage is adsorption of reactants on the catalyst surface or attachment to an enzyme molecule and the slow stage is the chemical reaction proper. For example, a bimolecular reaction may proceed according to the following mechanism: Ai + E A∗i ,
A∗1 + A∗2 → P + 2E,
where E is a catalytic site, P is a nonadsorbing product, and asterisks denote adsorbed forms of the reactants Ai . Assuming adsorption equilibrium, the kinetic equations for the concentrations ui of the reactants Ai in an open system reduce to the form u˙ i = −
ku1 u2 + νi (1 − ui ). (1 + µ1 u1 + µ2 u2 )2
(1.7)
An interesting feature of this system is its “autocatalytic” character made apparent under conditions when strong adsorption of one of the reactants
12
1 Dynamics, Stability and Bifurcations
reduces the reaction rate by suppressing adsorption of the other reactant; thus, if µ1 u1 far exceeds both µ2 u2 and unity, the nonlinear term in (1.7) is approximately proportional to u2 /u1 , so that ∂f1 /∂u1 > 0. Both multiple stationary states and oscillations are possible under these conditions. In nonisothermal reactions, one of the dependent variables is temperature; a typical temperature dependence of reaction rates is exponential, stemming from the Arrhenius law. If the reaction is exothermic, this dependence has an autocatalytic character, as the reaction rate grows with temperature causing its further increase. The simplest dynamical system describing a monomolecular exothermic reaction in a well-stirred vessel and allowing for exchange of both material and heat with the environment is u˙ = −ev u + µ(1 − u),
γ v˙ = ν ev u − v,
(1.8)
where u is the reactant concentration, v is the reduced temperature, µ, ν, γ are parameters, and an approximate exponential temperature dependence, replacing the Arrhenius law, is used. This system, as well as (1.7), generates multiple stationary states and oscillations. Another (historically earliest) source of dynamical systems is classical mechanics. Dynamical systems of classical mechanics can be presented as a combination of pairs of equations for conjugate variables: coordinates ui and momenta pi : ∂H ∂H dui dpi = =− , . (1.9) dt ∂pi dt ∂ui The Hamiltonian H is conserved in the course of evolution: ∂H dui ∂H dpi dH = + = 0. dt ∂ui dt ∂pi dt i
(1.10)
The general form of a Hamiltonian derivable from the Newton law is p2i + V (u). (1.11) H = 12 i
The minima of the potential V (u) correspond to stable equilibria. Other levels of H correspond to persisting motion along a certain orbit lying on the manifold H = const in the phase space; the dimensionality of this manifold can be further reduced by applying additional conservation laws. The motion can be periodic, quasiperiodic, or chaotic. As we have already noted in Introduction, the latter behavior is actually more typical for a system with a large number of degrees of freedom, and the notion of a classical mechanical system as wellbehaved as a clock had been caused by a bias to exactly solvable models in precomputer days. Hamiltonians of different structure may appear in other applications. A well-known example is the Volterra–Lotka system: u˙ = u(1 − v),
v˙ = v(u − µ).
(1.12)
1.1 Basic Models
13
This is a particular form of (1.6) describing the dynamics of a prey–predator system. The Hamiltonian structure is revealed by transforming to the variables x = ln u, y = ln v, which turn out to be conjugate variables of the Hamiltonian H = ex + ey − µx − y. A more general system conserving a certain function H(u) may lack Hamiltonian structure but be presentable in the form dui ∂H = Mij , dt ∂uj j
(1.13)
where Mij = −Mji form an antisymmetric matrix. “Accidental” conservative systems, such as the Volterra–Lotka system where there is no “natural” Hamiltonian structure dictated by the physics of the problem or innate symmetry, are structurally unstable, so that the conservation law is destroyed by any small modification of the system. Conservation of energy is also destroyed in a nonideal mechanical system by dissipation and compensating energy input. The Hamiltonian structure remains, however, useful for the study of weakly dissipative systems described by (1.9) with added small nonconservative terms, which may stabilize certain orbits selected from the available continuous family of orbits parametrized by the value of H. This provides a powerful tool for the study of transitions between different stationary states and periodic orbits (see Sect. 1.4.3). 1.1.2 Reaction–Diffusion System A simple but general distributed model involving transport and nonlinear interactions but no advection is the reaction-diffusion system (RDS). It arises in different contexts from conservation laws of a general form γ ∂t u = −∇ · j + f (u).
(1.14)
Commonly, the field variables u are concentrations of chemical species or population densities; then (1.14) represents the balance of the respective species, with f being the production rate, j the flux, and γ the capacitance factor. Equations of similar structure can be written for other thermodynamic variables, such as temperature and electric potential, stemming, respectively, from conservation of energy and electric charge. Equations (1.14) have to be closed by assigning a dependence of f on the field variables and a dependence of j on the field variables and their gradients. Generally, there will be a number of interdependent equations for several field variables arranged, as in (1.1), as components ui of an n-dimensional state array u. Respectively, the production rates are presented as components fi of a nonlinear vector-function2 f (u; p), which is also dependent on an array of parameters p. 2
Both vectors in phase space, such as u or f , and vectors in real space, such as j, are set in boldface, but there should be no way to mix them up.
14
1 Dynamics, Stability and Bifurcations
The fluxes j i may, generally, depend on gradients of all field variables: Dij ∇uj . (1.15) ji = − j
The diffusivity matrix Dij is, generally, nondiagonal, and may depend on the local values of the state variables. This dependence can be expressed in a less formal way by separating diffusion proper (which originates in random motion of noninteracting particles) from migration under the action of combined molecular interaction forces. If the latter can be expressed through the gradient of a thermodynamic potential U , we obtain: j i = −Di ∇ui − Mi ∇U.
(1.16)
If the dependence U (u) is local , one can express ∇U through ∇ui explicitly, recovering the form (1.15) with Dij = Di δij + Mi ∂U/∂uj . Explicit migration fluxes can also be written for strongly nonequilibrium transport processes, such as chemotaxis, which may not be derivable from a potential. Equation (1.15) or (1.16) excludes any externally imposed flow, although transport processes may involve net mass flux. Presuming the diffusivities to be constant, an RDS can be written in the form Dij ∇2 uj + fi (u; p), (1.17) γi ∂t ui = j
where γi are elements of a diagonal capacitance matrix. If all capacitances γi differ from zero, one can always eliminate them by rescaling Dij and fi , so that (1.17), rewritten in the vector notation, becomes ∂t u = D∇2 u + f (u; p).
(1.18)
It might be advantageous, however, to retain the capacitance matrix in order to distinguish among three types of parameters: • elements of the array p influence stationary states as well as dynamics; • capacitances γi influence dynamic behavior but not equilibria; • elements of the matrix Dij affect spatially inhomogeneous solutions only. The full form (1.17) is essential in systems with widely separated time scales where some (fast) components are quasistationary. An RDS can describe a truly 2D open system, such as the one shown in Fig. 1.1a, either when both diffusion and interactions are taking place on a surface or when the thickness of a bulk layer in the direction of external fluxes is so small that the composition can be assumed uniform in the “vertical” direction. Then the nonlinear functions in (1.14) should account for both internal interactions, e.g., chemical reaction rates, and external (“vertical”) fluxes due to exchange with the environment. We shall suppose here that these functions do not depend on time and spatial variables explicitly. Then
1.1 Basic Models
15
(a)
(b)
Fig. 1.1. An open system isotropic in two dimensions. (a) A truly two-dimensional system. (b) A cut through a system with vertical structure (shown symbolically by varied shading). Arrows indicate the direction of external fluxes
an RDS always has one or more “trivial” homogeneous stationary solutions (HSS) coinciding with fixed points of a respective dynamical system. This solution may become unstable in a certain parametric domain, giving way to spatially inhomogeneous and/or persistently time-dependent states. 1.1.3 Vertical Structure and Representative Equations More generally, a “trivial” state of a distributed nonequilibrium system will be uniform only in the plane normal to the direction of external fluxes, but dependent on the “vertical” coordinate, as in Fig. 1.1. This is necessarily so in the presence of fluid flow when hydrodynamic equations should be solved together with transport equations to determine a vertical structure satisfying appropriate boundary conditions. Other systems with vertical structure include directional solidification, propagation of light in nonlinear media, and orientation textures in liquid crystals. The set of variables u describing systems of this kind may include vector as well as scalar fields, and the applicable equations will typically include differential nonlinear terms instead of or in addition to algebraic nonlinearities of an RDS. The most general form is an array of nonlinear operators of the type H(u, ∂t u, ∂z u, ∇u, . . .) = 0,
(1.19)
where we distinguish between the derivatives in the “vertical” direction ∂z and the derivatives in “horizontal” directions, expressed by the 2D gradient operator ∇. Vertical structure can often be eliminated when it remains almost constant in the horizontal plane. More precisely, the reduction is possible when
16
1 Dynamics, Stability and Bifurcations
the characteristic horizontal scale is much larger than the characteristic vertical scale, say, ∂z = O(1), ∇ = O(), 1. Another possibility is slow modulation of a structure periodic in the horizontal direction. This involves multiscale expansion of the gradient operator ∇ = ∇0 + ∇1 (Sect. 4.1.1). Equations obtained as a result of elimination of vertical or periodic structure have, as a rule, a relatively simple form, which is determined by symmetries of the underlying system. Equations of identical structure may emerge therefore in different physical applications. Such representative equations are often most suitable for study of typical dynamic phenomena in nonlinear systems. A substantial part of the material of this book is based on the study of such equations. The following equations for a single scalar field u(x) can be written simply by requiring spatial isotropy as well as a specified symmetry to transformations of u, and restricting to a certain order in u and ∇; they can also be written by scaling both u and ∇, as indicated in brackets, and retaining the lowest order terms: • Cubic reaction-diffusion equation – second order in ∇, third order in u, symmetry to inversion of u: ut = ∇2 u + u(1 − u2 )
[u = O(), ∇ = O()]
(1.20)
• Swift–Hohenberg (SH) equation (Swift and Hohenberg, 1977; Pomeau and Manneville, 1980) – fourth order in ∇, third order in u, symmetry to inversion of u: √ (1.21) ut = −(1 + ∇2 )2 u + u(µ − u2 ) [u = O(), ∇ = O( )] • Burgers equation (Burgers, 1948) – second order in ∇, second order in u, symmetry to translations of u (which permits the dependence on derivatives of u only, rather than u itself): ut = ∇2 u + |∇u|2
[u = O(1), ∇ = O()]
(1.22)
• Kuramoto–Sivashinsky (KS) equation (Kuramoto and Tsuzuki, 1976; Sivashinsky, 1977) – fourth order in ∇, second order in u, symmetry to translations of u: √ (1.23) ut = −∇2 u − (∇2 )2 u + |∇u|2 [u = O(), ∇ = O( )] • Proctor–Sivashinsky equation (Chapman and Proctor, 1980; Gertsberg and Sivashinsky, 1981) – fourth order in ∇, third order in u, symmetry to translations and inversion of u: √ ut = −∇2 u − (∇2 )2 u + ∇ · (∇u|∇u|2 ) [u = O(1), ∇ = O( )] (1.24) All these equations are written in a rescaled – and mostly parameterless – form, with the sign chosen in a way ensuring stability to short-scale perturbations and preventing runaway to infinity. The SH equation (1.21) is perhaps
1.1 Basic Models
17
the simplest pattern-forming system. Its linear part is designed to produce a dispersion relation with a maximum at a finite wavenumber, normalized by rescaling to unity. The height of the maximum is controlled by the single parameter of the model, µ. The cubic term serves to saturate the instability developing at µ > 0. Similar equations can be written for a complex scalar variable. Equations of this kind often appear as envelopes of periodic structures, and will be studied in detail in Chaps. 4 and 5. The lowest-order form analogous to (1.20) is the complex Ginzburg–Landau (CGL) equation ut = η∇2 u + u(µ − ν|u|2 ).
(1.25)
The coefficients η, µ, ν are generally complex, but the particular cases when they are either all real or all imaginary are important in their own right. In both cases, all coefficients can be reduced to unity by rescaling; the resulting parameterless forms are called, respectively, the real Ginzburg–Landau (RGL) equation (1.26) ut = ∇2 u + u(1 − |u|2 ), and the nonlinear Schr¨ odinger (NLS) equation −iut = ∇2 u + u(1 − |u|2 ).
(1.27)
Equations (1.20), (1.21), and (1.24), as well as (1.26), are gradient systems, and are derivable from an appropriate “energy” functional: ut = −δF/δu, F = L(u, ∇u, . . .) dx. (1.28) The essential property of gradient dynamics is that it ensures dissipative temporal evolution. Indeed, the energy integral must decrease until a minimum is reached: 2 δF dF δF ∂u = dx = − dx ≤ 0. (1.29) dt δu ∂t δu The gradient property may only be approximate and appear in reduced equations even when the original equations describe an open system and lack gradient structure. On the other hand, although RDSs are commonly associated with nonequilibrium systems, they can also be used for the description of equilibrium phase transitions. In particular, the gas–liquid equilibrium in the van der Waals fluid (van der Waals, 1894) is described in the mean field approximation by a single reaction-diffusion equation with u standing for density and a function f (u) with two stable zeros corresponding to equilibrium densities of two stable phases. 1.1.4 Spectral Decompositions Spatially extended nonequilibrium systems are capable, in principle, of exhibiting extremely complex dynamics. With a great number of degrees of
18
1 Dynamics, Stability and Bifurcations
freedom present, one could expect turbulent behavior of unfathomable complexity to be a norm. This, however, does not always happen. More often than not, the latent complexity of behavior is not realized, and a homogeneous state or an ordered or weakly distorted pattern prevails. This suggests that a dynamical system involving a limited number of variables might be sufficient to faithfully describe the dynamic behavior in lieu of the full partial differential equation (PDE) system, at least approximately and within a certain range of parameters. The choice of such a set of variables is by no means obvious. In the absence of other hints, one can expand the variables in a Fourier series, say, aj ei(kj ·x−ωj t) . (1.30) u(x, t) = j
The amplitude aj of the mode with the wave vector kj and frequency ωj defined by a dispersion relation ω(k) is complex, unless both kj and ωj vanish. When the expansion is used in the original PDE, different modes couple through nonlinear terms, and, generally, no finite number of modes would ever suffice, as, given two modes with wave vectors ki , kj , their sum will always be generated. The expansion can be, however, truncated, leaving only a small number of modes and neglecting the rest. The resulting ODE system with polynomial functions fi (a) dependent on the array a of amplitudes aj of the chosen modes may look like “chemical” systems of Sect. 1.1.1 derived from the mass action law. Of course, one can never be sure which, if any, features of the original system are preserved by such a bold action, but, with good luck, it may bring success. In this way, Lorenz (1963) constructed a threevariable dynamical system (see Sect. 1.5.4) by retaining three modes of the Navier–Stokes and convective diffusion equations describing Rayleigh–B´enard convection. The resulting system was not actually faithful to the original, but turned instead (after some 15 years of obscurity) into a celebrated paradigm of chaotic dynamics. A more systematic (though empirical) approach to spectral truncation is offered by the Karhunen–Loewe method used, in particular, for compressing images and discerning “coherent structures” in turbulent flow (Sirovich and Everson, 1992). This method employs statistical analysis of measured or computed data to find out an optimal combination of modes sufficient to reproduce the data in a faithful but economic way. This combination would, of course, change when the underlying system is modified or driven to a different regime. It is far more appealing to be able to discern relevant modes analytically; this may, indeed, be possible under favorable conditions. The key is given by scale separation: some modes may evolve on far longer characteristic times than do the others. Fast modes relax to their quasistationary values dependent on the current values of slow modes, which remain virtually unchanged during this relaxation period. Following this, slow modes evolve on a longer time scale, while fast modes follow them quasistationarily, being bound by
1.1 Basic Models
19
quasiequilibrium algebraic relations – much in the same way as rapidly reacting chemical species reaching a partial equilibrium (Sect. 1.1.1). This is expressed by Haken’s (1983) slaving principle: “fast modes are slaved by slow modes.” Clearly, only slow modes are relevant for long-time evolution. Therefore, the original PDE system, however complex it might be, can be reduced to a set of ODEs for the amplitudes of slow modes. Their general form can be predicted on the basis of scaling and symmetry considerations. Exact derivation connecting ODE parameters with parameters of the underlying PDE is possible when the amplitudes of slow modes are small, so that the state of the system deviates only slightly from a known “trivial” homogeneous stationary state – see Sect. 1.3. Amplitude equations or “normal forms” derived through this approach can reproduce the dynamics of the original underlying system faithfully only in a limited range of parameters and in a limited region of the phase space, since slow modes would, generally, be modified or cease to be slow when either parameters or values of dependent variables change. Nevertheless, they may reproduce dynamics correctly in a qualitative sense even outside the domain where their derivation can be justified formally. 1.1.5 Trajectories and Attractors Both (1.1) and (1.17) or (1.19) may be called evolutionary systems. A distributed system, such as an RDS, can be viewed as an infinite-dimensional dynamical system. Qualitative methods of analysis of dynamical systems can be applied to distributed systems as well in many situations when all but few degrees of freedom are essentially suppressed. Particular solutions, or trajectories of a dynamical system u(t), can be obtained by numerical integration starting from certain initial conditions. In standard cases, finding a numerical solution is an easy task if one uses any of modern software systems, which require no programming. Moreover, more advanced systems are able to choose an optimal integration algorithm suitable for the given problem, so that even stiff equations are well handled. Solving a PDE, such as an RDS, requires, in addition, defining appropriate boundary conditions. This might be a hard decision to make in a situation when one is interested in studying dynamic behavior in an extended region and wishes to reduce the influence of the boundaries to a minimum. Quite often, periodic boundary conditions are chosen, which allows one to implement most efficient spectral or quasispectral integration routines. Numerical simulation of RDSs in one or two dimensions, using widely available C- or Fortran-based programs with graphical interfaces, is also becoming routine, except in more difficult cases involving internal boundary layers and widely separated scales. Simulation can be, however, no more than a tool for preliminary exploration: a numerical experiment. Even when such an experiment is carried out, one is usually interested in asymptotic behavior at long times, which may be either totally or to a certain degree independent of initial conditions. On a
20
1 Dynamics, Stability and Bifurcations
deeper level, both a researcher trying to understand the global structure of solutions and a designer (in a broader sense) looking for ways to control the system in order to achieve optimal performance would like to explore longtime behavior in a wide parametric region, which requires a systematic study. An asymptotic state approached by an evolutionary system in the limit t → ∞ is called an attractor . An attractor of a dynamical system may be a stationary state, a periodic, quasiperiodic, or chaotic orbit. The defining property of a periodic orbit is u(t) = u(t + T ), where T is the period. A quasiperiodic orbit never returns to the same point of the phase space and covers a 2D or higher-dimensional torus. A chaotic orbit covers a manifold of fractal dimension; trajectories starting from neighboring points lying on a chaotic attractor diverge with time. The last two types are possible when the dimension of the phase space is at least three. An attractor of an RDS, as well as of any other nonlinear spatially distributed system, may be, in addition, a stationary periodic pattern, a wave train, a quasiperiodic pattern, or a disordered (turbulent) state. In any case, the dimension of the attractor is less than the dimension of the dynamical system itself, so that some degrees of freedom are essentially suppressed after a relatively short relaxation period. Out of an infinite number of degrees of freedom of a distributed system, only few may be relevant in most situations (except in the state of developed turbulence). By definition, an attractor is an asymptotically stable stationary state or orbit. The property of asymptotic stability implies that the system removed from the attractor by a sufficiently small perturbation returns hereto asymptotically at t → ∞. Any attractor must therefore have a finite attraction basin. If there are two or more alternative attractors, each of them attracts trajectories starting from initial conditions lying within its basin. Trajectories starting from points lying precisely at a basin boundary cannot reach any attractor and should approach at t → ∞ a saddle point or an unstable saddle orbit lying on the basin boundary. Such trajectories are, of course, themselves unstable, as any infinitesimal perturbation would deflect them into one of the bordering attraction basins. Basin boundaries may be as simple or as convoluted as the attractors; thus, a basin boundary of a chaotic attractor would be a fractal object as well. As the parameters of the system change, so do its attractors and basins. Generically, the changes are only quantitative, but at certain values of parameters qualitative changes take place: attractors change their character or disappear, and new attractors emerge. These qualitative changes are called bifurcations. It is advantageous to view bifurcations in geometric terms by considering a p-dimensional parametric space. Qualitative changes of behavior of a dynamical system take place when certain boundaries are crossed. These boundaries are called bifurcation manifolds. The dimension of a boundary of a p-dimensional domain is p − 1, and its codimension is one; thus, a generic bifurcation manifold is a codimension one hypersurface in the parametric space.
1.2 Linear Analysis
21
The vicinity of a bifurcation manifold is of special interest, since the behavior characteristic to the two neighboring parametric domains can be studied there; moreover, if the structure of the attractor(s) in one of the domains is more complicated, it might be more amenable to rational analysis close to bifurcation. One can advance further and look for degenerate, or singular , bifurcations, which require two or more conditions to be satisfied simultaneously and occur at bifurcation manifolds of higher codimension. Singular bifurcations are hubs of complexity: a variety of behaviors can be observed in their close vicinity, and different kinds of transitions are possible there.
1.2 Linear Analysis 1.2.1 Instabilities of Stationary States A comprehensive study of a distributed system, such as an RDS or a general form (1.19), may start in a parametric domain where the dynamic behavior is most simple. The system should possess an HSS – a trivial solution that retains all symmetries of the equations. Close to thermodynamic equilibrium, when the driving fluxes are weak, this state is expected to be stable and be the only attractor of the system, i.e., the state approached asymptotically starting from any initial condition. When the system is driven farther from thermodynamic equilibrium, its behavior may become far more complicated. The trivial solution may become unstable, and the system may tend asymptotically to attractors of different nature: oscillatory, inhomogeneous (patterned), or chaotic (turbulent) states. The first step in a search for nontrivial states is therefore to find the locus of a primary bifurcation where the trivial state first becomes unstable. This transition is indicated by local linear analysis in the vicinity of the HSS. As an example, consider the general RDS (1.18) in the infinite plane and suppose that it has an HSS u = us satisfying f (us ) = 0. Without loss of generality, we can assume us = 0, since the stationary values can be taken as the origins of the respective variables. Thus, we assume that the vector-function f (u) vanishes at the origin. We shall now suppose the deviations from the trivial state to be arbitrarily small, and linearize (1.18) to obtain (1.31) ∂t u = D∇2 + F u, where F is the Jacobi matrix of the vector-function f (u) with the elements Fij = ∂fi /∂uj evaluated at u = 0. Solutions of (1.31) are sought for in the harmonic form u = U eλt+ik·x .
(1.32)
Using this in (1.31), we see that nontrivial solutions are obtained when λ(k 2 ) are eigenvalues of the matrix
22
1 Dynamics, Stability and Bifurcations
L = F − k 2 D.
(1.33)
Because of the isotropy, the eigenvalues depend only on the absolute value k = |k| rather than on the direction of the wave vector k. In a spatially infinite system, each eigenvalue λj (0) of the Jacobi matrix F is blown up into a continuous3 spectral band λ(k). The stationary state at the origin is stable when all spectral bands lie entirely in the left complex half-plane, i.e, for any j, k, (1.34) Re λj (k) < 0. Let the source function f (u) = f (u; µ) depend on some parameter µ. Suppose for simplicity that f (u; µ) vanishes at the origin for all values of µ, and assume that the stability condition (1.34) is satisfied when µ is sufficiently small. Increasing µ sets the spectral bands λj (k; µ) into motion. We shall refer to a band containing the eigenvalue with the largest real part as the leading band and label the eigenvalues from this band as λ0 ; this band will be responsible for the onset of instability when it first occurs at some µ = µ0 . At this value of the parameter, the spectrum of the linearized system (1.31) satisfies for some k0 the condition of marginal stability Re λ0 (k0 ) = 0,
Re λj (k) < 0
otherwise.
(1.35)
One has to distinguish among four possibilities, depending on whether the eigenvalues from the leading band are real or complex and whether the rightmost edge of this band corresponds to k0 = 0 or k0 = 0. We shall call the mode at the right edge of the leading band the leading mode. The leading mode, which becomes marginally stable at the critical point µ = µ0 , is • • • •
stationary homogeneous when k0 = 0, Im λ0 (0) = 0, oscillatory homogeneous when k0 = 0, Im λ0 (0) = 0, stationary inhomogeneous when k0 = 0, Imλ0 (k0 ) = 0, and oscillatory inhomogeneous when k0 = 0, Im λ0 (k0 ) = 0.
When the parameter µ further increases beyond the point of marginal stability, one can expect that the growth of perturbations in the leading mode would lead (provided it saturates at a certain amplitude) to a new steady state of the same character, i.e., stationary at Im λ0 (k0 ) = 0, oscillatory at Im λ0 (k0 ) = 0, homogeneous at k0 = 0, and inhomogeneous at k0 = 0. The linear analysis, of course, gives but a hint at the existence of this “nontrivial” state in the postcritical region, and further nonlinear analysis is required to assure that this state does actually exist. In the case λ0 = k0 = 0, the determinant of the Jacobi matrix F vanishes. This means that it is impossible to continue the branch of stationary solutions 3
If the region is finite, each spectral band includes only a discrete (infinite countable) set of eigenvalues. These eigenvalues come closer when the characteristic spatial scale L increases, and the band becomes continuous in the limit L → ∞.
1.2 Linear Analysis
23
in a unique way when the parameters of the problem are changed. Most commonly, this is a fold , or saddle-node bifurcation point where two stationary states, one stable and one unstable, “collide” and disappear (Sect. 1.3.2). For a scalar (one-component) RDS, the leading mode is always stationary and homogeneous. Indeed, it is easy to see that in this case there is only one band of real eigenvalues λ = fu − Dk 2 , where fu = (df /du)u=0 , and its right edge is always at k = 0 inasmuch as D > 0. But already for two coupled equations (n = 2), different kinds of leading modes are possible. 1.2.2 Turing and Hopf Instabilities Two principal symmetry-breaking instabilities can be obtained already in a two-component RDS. We shall write a general two-component RDS with a constant diagonal matrix of diffusivities in the form ut = D1 ∇2 u + f (u, v), vt = D2 ∇2 v + g(u, v),
(1.36)
where f (u, v), g(u, v) are source functions depending on the state variables u and v. The explicit form of the matrix L in (1.33) is fu − D1 k 2 fv , (1.37) L= gu gv − D2 k 2 where all derivatives fu , etc. are computed at u = v = 0. Two conditions of marginal stability are provided by vanishing trace and determinant of (1.37): tr(L) ≡ fu + gv − (D1 + D2 )k 2 = 0, det(L) ≡ D1 D2 k 4 − (D2 fu + D1 gv )k 2 + ∆ = 0,
(1.38)
where ∆ = fu gv −fv gu is the Jacobian of the source vector-function. The trace condition corresponds to the onset of oscillatory instability (Hopf bifurcation). It is clear that this instability can occur only in the homogeneous mode.4 The determinant, however, may have a minimum at k02 =
D2 fu + D1 gv . 2D1 D2
(1.39)
This minimum occurs at a real k0 only in the presence of positive feedback, or, in chemical terms, when at least one of the species is autocatalytic (fu > 0 or gv > 0). Under these conditions, a stationary inhomogeneous mode is excited, leading to spatial symmetry breaking. This can actually occur, however, only 4
One would have to increase the number of state variables to three to obtain inhomogeneous oscillatory instability, which would lead to an emergence of a wave pattern directly from the trivial state; nevertheless, as we shall see in Chap. 3, stable wave patterns also exist in two-component systems.
24
1 Dynamics, Stability and Bifurcations
if the condition of the Hopf bifurcation has not yet been satisfied. We have to presume therefore fu + gv < 0, which means that spatial symmetry breaking would occur when only one of the species is autocatalytic. To be definite, let fu > 0 and gv < 0. Then the spatial symmetry breaking (Turing bifurcation) preempts the Hopf bifurcation at D1 < D2 , i.e., when the autocatalytic species is less diffusive. Thus, for spatial symmetry breaking in a two-component system, one needs a combination of a slowly diffusing activator and a rapidly diffusing inhibitor. 1.2.3 Dispersion Relations In a general case, the linearization of (1.19) can be written as L1 (∂t , ∂z , ∇)v = 0.
(1.40)
where v = u − u0 is a deviation from some known solution u = u0 . If this solution is stationary and homogeneous, the operator L1 does not contain explicit time and coordinate dependence (except, perhaps, on the “vertical” coordinate z). Then the eigenfunctions verifying L1 ψ = 0 can be presented in the form (1.41) ψ(x, z, t; k) = ei(k·x+λ(k)t) U (z; k). where λ(k) are eigenvalues. The dependence λ(k) is called a dispersion relation. In the absence of vertical structure, the dispersion relation is obtained by direct substitution ∂t → λ, ∇ → ik and finding the eigenvalues of the matrix L1 (λ, k) grouped in n spectral bands. In the case of a single field u, the dispersion relation in an implicit form is given directly by L1 (λ, k) = 0. When z-dependence is present, the dispersion relation is obtained by solving a boundary problem for an ODE in z with appropriate boundary conditions. The overall evolution of an initial perturbation is described by the Fourier integral (1.42) aj (k) eλj (k)t+ik·x U j (z; k) dk, v(x, z, t) = j
where aj (k) is the amplitude of the mode with the wave vector k from the jth spectral band. This cumbersome formula is of little use as it stands, but becomes practical if one is able to identify physically relevant modes, e.g., slow modes in the vicinity of a bifurcation point. After choosing a relevant set of modes, one can further assume that their amplitudes are slowly changing with time and are modulated on an extended spatial scale, i.e., depend on extended temporal and spatial coordinates T, X rather than being constant: aj (X, T ; kj ) eλj (kj )t+ikj ·x U j (z; kj ). (1.43) v(x, z, t; X, T ) = j
Summation over bands and integration are replaced here by summation over the chosen set of modes. Because of a weak spatial and temporal dependence
1.2 Linear Analysis
25
of the amplitudes, this expression incorporates band segments centered on kj , rather than isolated modes. In an isotropic system, the eigenvalues λj and the eigenfunctions U j (z) depend on kj = |kj | only. As a consequence, an entire ring of slow modes appears near a symmetry-breaking bifurcation in two dimensions. This seems to indicate that integration over angular directions of kj should be reintroduced in (1.43). This is, however, not necessary, since, as a result of competition among differently directed modes caused by nonlinear interactions, only a small number of modes would survive (more on this in Sect. 1.6.1). While linear analysis is the necessary tool for detecting instabilities and identifying slow modes, one can question the utility of linear theories for the study of actual dynamic behavior: indeed, the dynamics is not interesting in stable situations when the system just relaxes back to the basic state, while in unstable situations exponential growth of perturbations promptly makes nonlinear terms essential. Nevertheless, linear theory can sometimes be used beyond the instability limit. One such case is the retreat of an unstable state under an onslaught of an alternative stable solution. It turns out that the speed of the retreat and even the character of the eventually established stable state is determined by the dynamics at the leading edge of the propagating front where linear theory is still useful (see Sect. 2.3). Another case is convective instability in systems of finite spatial extent. The instability is called convective when the band of unstable eigenvalues does not encompass k = 0. If the instability is observed at a finite wavelength and frequency, the relevant eigenfunctions close to criticality are waveforms a(T ) ei(k·x−ωt) , where ω = Im λ. Under these conditions, all perturbations are washed out with a characteristic speed equal to the group velocity dω/dk. Therefore, while Re λ remains small, perturbations may not succeed to grow to a finite amplitude, provided the spatial extent of the system is sufficiently small. Under these conditions, the unstable state may persist, provided the intensity of external perturbations is not too large, and dynamics of deviations from the unstable state presented by (1.42) or (1.43) can be reasonably well described in the linear approximation. This will not happen when a mode with k = 0 is unstable, and the instability is absolute. 1.2.4 Instabilities of Periodic Orbits Periodic orbits or nonuniform stationary states emerging at a primary bifurcation may in turn lose stability at secondary bifurcation points. Stability of a T -periodic orbit u0 (t) = u0 (t + T ) to infinitesimal perturbations is determined by linearizing the underlying equation in the vicinity of this solution. Consider a general dynamical system (1.1) and look for solutions in the form u(t) = u0 (t) + v(t), where v(t) is a small deviation from the periodic solution u0 (t). The linearized system for v(t) is ∂t v = F (t)v.
(1.44)
26
1 Dynamics, Stability and Bifurcations
The fundamental solution of (1.44) is a matrix A(t), such that v(t) = A(t)v(0) for any initial condition v(0). Stability of the T -periodic solution u0 (t) is determined by eigenvalues Λj of the monodromy matrix A(T ), called Floquet multipliers. The periodic orbit is stable when all Λj are less than unity by their absolute value. Alternatively, solutions of (1.44) can be sought for in the form v(t) = eiλj t w(t), where w(t) is T -periodic and λj = T −1 ln Λj are Floquet exponents, which should all have nonpositive real parts for a stable orbit. Among the Floquet multipliers, there is always one equal to unity, which reflects neutral stability to a shift along the periodic orbit. The respective eigenvector is v 0 = u0 (t). One can see, indeed, that the r.h.s. of (1.44) with v = u0 (t) equals the time derivative of f (u0 (t)), and therefore integrating it over the period yields v 0 (T ) − v 0 (0) = f (u0 (T )) − f (u0 (0)) = 0. Additional neutrally stable eigenvectors exist in the presence of conservation laws. Other Floquet multipliers should lie within the unit circle in the complex plane when the periodic orbit is stable. The loss of stability can occur in three distinct ways, depending on whether the value of the multiplier with the largest absolute value at the critical point of marginal stability is 1, −1, or a complex number Λ = eiω . As in the case of stationary states in Sect. 1.2.1, one can expect that the growth of perturbations in the leading mode would lead (provided it saturates at a certain amplitude) to a new orbit of a kind indicated by the instability mode. At Λ = 1 (i.e., λ = 0), this might be another periodic orbit; most commonly, this indicates a saddle-node bifurcation of periodic orbits where two orbits, one stable and one unstable, collide and disappear. A transition at Λ = −1 (i.e., λ = iπ) indicates period doubling. A complex Floquet multiplier on the unit circle signals emergence of a new frequency. The expected new state is a periodic orbit with the period 2nT if ω/π = m/n is rational, or a quasiperiodic orbit covering a torus if ω/π is an irrational number. A quasiperiodic orbit is usually frequency-locked at larger amplitudes, turning into an orbit with a finite period. For an RDS, the Floquet stability problem reduces to the form (1.44) with F (t) replaced by F (t) − k 2 D after substituting v(x, t) = V (t; k) eik·x . As in Sect. 1.2.1, each Floquet exponent then expands into a spectral band λj (k). Instabilities breaking spatial symmetry, leading to propagating waves, are possible when λj (k) in the leading band is at maximum at k = 0. As a rule, Floquet multipliers can be computed only numerically. In some special cases, stability can be determined analytically using scale separation, as it is done for time-periodic orbits in Sect. 1.4.3 and for space-periodic solutions in Sect. 3.2.3, or taking advantage of a particularly simple form of a periodic solution as in Sect. 4.1.5. Stability of nonstationary and nonuniform states in the vicinity of a primary bifurcation is determined in a systematic way by weakly nonlinear analysis as described in Sects. 1.3 and 1.6.
1.3 Weakly Nonlinear Analysis
27
1.3 Weakly Nonlinear Analysis 1.3.1 Multiscale Expansion In the vicinity of a bifurcation manifold, the original system of equations can be reduced to a simple universal form that is characteristic to the particular type of bifurcation and retains the qualitative features of dynamic behavior of the underlying system in an adjacent parametric domain. The reduced equations are called normal forms in the mathematical literature, while the term preferred by physicists is amplitude equations. Normal forms are ODEs describing dynamics of the amplitudes of slow modes (cf. Sect. 1.1.4), while amplitude equations may include differential terms operating on an extended spatial scale. The approach to their derivation also differs: mathematicians base it on “near-identity transformation,” while the favorite tools of physicists is multiscale expansion. The advantage of the latter approach lies in a possibility to connect directly the parameters of amplitude equations and the characteristic time of their evolution to parametric regions of the underlying dynamic system and its time scale. A more abstract mathematical approach may be preferable when one wishes to obliterate these details and concentrate on the qualitative features of the dynamics. The formal procedure of multiscale expansion starts with expanding both variables u and parameters p in powers of a dummy small parameter near some known HSS u = u0 (p0 ). All nonlinear terms are expanded in powers of deviations u − u0 ; e.g., the general nonlinear operator (1.19) is expanded as H(u, ∂t u, ∂z u, ∇u) = L1 (∂t , ∂z , ∇)(u − u0 ) + L2 (∂t , ∂z , ∇)(u − u0 )2 + · · · (1.45) No zero-order term appears here, since u0 (p0 ) must verify (1.19). The operator L1 is the linearization of H; slow modes appear in the spectrum of this operator at p close to p0 if p0 lies on a bifurcation manifold of the original system, so that L1 has an eigenfunction with an eigenvalue with vanishing real part, L1 Φ = iω. It is always assumed that all fast modes are decaying, so that at p = p0 there are no eigenvalues with a positive real part. Next, one introduces a hierarchy of time scales tk rescaled by the factor k and expands the time derivative in a series of partial derivatives ∂/∂tk . The hierarchy of equations approximating the dynamics near the reference point in successive orders is obtained in the consecutive orders of the expansion of (1.19). These equations are solved in turn, and normal forms appear as lowestorder nontrivial solvability conditions. Additional restrictions on parametric deviations may be imposed when needed to make the orders of magnitude of different terms compatible. Multiple spatial scales may also be introduced to describe weak spatial modulations of slow modes. Practical computation of the coefficients of the amplitude equations is a tedious task, but simple examples can be worked out explicitly. Since the problem is fully formalized, it can be easily handled by symbolic computation programs (Pismen and Rubinstein, 1999a).
28
1 Dynamics, Stability and Bifurcations
Consider a general dynamical system (1.1) written in a vector form du = f (u; p), dt
(1.46)
where the nonlinear vector-function f (u) of the n-dimensional state array u is also dependent on the array of parameters p. Suppose that we know the location of a zero of the function f (u; p) at a certain point p = p0 in the parametric space, i.e., a solution u = u0 satisfying f (u0 ; p0 ) = 0. Near this point, f (u; p) can be expanded in Taylor series in both variables and parameters. Since we do not know beforehand what are relative orders of magnitude of all deviations, it is convenient to start with expanding both u and p in powers of a dummy small parameter : u = u0 + u1 + 2 u2 + · · · ,
p = p0 + p1 + 2 p2 + · · ·
(1.47)
Then we have f (u; p) = f (u0 ; p0 ) + (f u u1 + f p p1 ) (1.48) 2 1 1 + f u u2 + f p p2 + 2 f uu [u1 , u1 ] + f up [u1 , p1 ] + 2 f pp [p1 , p1 ] + · · · , where the arrays of first (f u , f p ), second (f uu , f up , f pp ), etc. (e.g., f uuu ) derivatives with respect to variables and parameters are evaluated at the reference point u = u0 , p = p0 . Higher derivatives are defined as arrays of a higher tensor rank: thus, mth derivative acts at m vectors (state arrays) written to the right of it in brackets. We shall also need to expand the time derivative in a series of partial derivatives ∂k ≡ ∂/∂tk : d = ∂0 + ∂1 + 2 ∂2 + · · · . dt
(1.49)
The hierarchy of equations approximating the dynamics near the reference point in successive orders is obtained in the consecutive orders of the expansion of (1.46). The first-order equation is ∂0 u1 = fu u1 + fp p1 .
(1.50)
The homogeneous linear equation Lu1 ≡ (fu − ∂0 )u1 = 0
(1.51)
obtained here by setting p1 = 0 governs the stability of the stationary state u = u0 to infinitesimal perturbations. Stability of a fixed point is determined by the location of the leading eigenvalue in the complex plane, i.e., that with the largest real part. It is usually possible to detect a parametric domain sufficiently close to thermodynamic equilibrium where there is a single stable stationary state, and follow changes of dynamics along a certain path in the parametric space. In this case, all eigenvalues of L will have negative real parts
1.3 Weakly Nonlinear Analysis
29
on the one side of the bifurcation manifold, while the real part of the leading eigenvalue vanishes on the codimension one bifurcation hypersurface. The only two types of codimension one bifurcations that can be located by local (linear) analysis are a monotonic bifurcation where a real leading eigenvalue vanishes and a Hopf bifurcation where the leading pair of complex conjugate eigenvalues is purely imaginary. Additional conditions may define bifurcation manifolds of higher codimension. On consecutive stages of the expansion, we shall arrive at inhomogeneous equations of the type Lu + Ψ = 0, (1.52) where the operator L has a zero eigenvalue. By Fredholm alternative, an inhomogeneous equation is solvable if the inhomogeneity Ψ does not project on the corresponding eigenfunction Φ. This solvability condition is expressed as Φ† , Ψ , where . . . is an appropriate scalar product and Φ† is the eigenfunction with zero eigenvalue of the adjoint operator L† = fu † + ∂0 ,
(1.53)
where fu † is the transpose of the real matrix fu . For dynamical systems, we have Φ = eiωt U , where U is the eigenvector of L with zero eigenvalue. The scalar product of two vectors, say, U † and U , is defined simply as † U † , U = U · U , where the overline denotes the complex conjugate. Since the eigenvectors are defined up to a constant, one can impose a normalization † condition, e.g., U · U = 1. 1.3.2 Bifurcation of Stationary States A single real mode with unbroken symmetry corresponds to k = 0, ω = Im λ = 0 and describes homogeneous time-independent deviations from a known homogeneous stationary state. The equation for the amplitude a of this mode truncated at the order n should have the form. a˙ =
n
µj aj .
(1.54)
j=0
A bifurcation at zero eigenvalue is also a bifurcation of equilibria of the dynamical system. The number of distinct equilibria equals to the order n of the polynomial on the r.h.s. In the absence of symmetries, one has to fix n − 1 parameters to arrive at the nth-order form. In this and other dynamic equations of this section, the coefficient at the highest-order term is dependent only on the position of the reference point p0 on the bifurcation manifold, while all other coefficients depend on parametric deviations. Different parametric deviations, e.g., in the directions parallel and normal to the bifurcation manifold, may be scaled differently to balance the orders of magnitude of different terms. One of these coefficients, most conveniently, µn−1 , can be eliminated
30
1 Dynamics, Stability and Bifurcations
by shifting the amplitude by a suitable constant, a → a − c. If a = O(), the slow time variable in (1.54) is extended by the factor n−1 . By choosing the time scale, the highest coefficient, µn , can be rescaled to ±1. With n odd, µn = −1 ensures that the amplitude always remain finite. Equation (1.54) has a gradient structure with the potential a˙ = −
∂V , ∂a
V =
n
j −1 µj aj+1 .
(1.55)
j=0
This structure also appears when the original equations do not possess it; thus it may characterize the dynamics in the vicinity of the bifurcation point only, rather than globally. Setting in (1.54) n = 2, µ1 = 0 yields the lowest-order quadratic equation describing dynamics near a point in the parametric space of the original system where two equilibria, one stable and one unstable, bifurcate. The dependence of the ampitude on the parameter µ0 (shown in Fig. 1.2a for µ2 = −1) has the form of a fold; hence, the name fold bifurcation. If all other eigenvalues of the original system have negative real parts, the unstable state is a saddle; the stable state is a node in the simplest case when the original system is a two-variable dynamical system. The transition is therefore also called a saddle-node (sn) bifurcation. Two fixed points a = ± −µ0 /µ2 exist when the parameters µ0 , µ2 have opposite signs, and none when the signs are the same. In the latter case, the absolute value of the amplitude grows indefinitely with time. Physically, it indicates escape of the original system from the region in its phase space where dynamics is slow to another attractor, which is not described by the reduced one-mode system. This attractor cannot be affected by the change of the parameters µ0 , µ2 and keeps attracting some trajectories repelled by the unstable fixed point, but other trajectories are attracted, following the bifurcation, to the newly created stable fixed point. The same equation with n = 2, µ0 = 0, µ1 = 0 describes a transcritical bifurcation where stability is interchanged between the two fixed points a = 0 and a = −µ1 /µ2 (Fig. 1.2b). Forms of this kind naturally appear in systems with a persistent trivial state, e.g., an extinction state in equations of population dynamics. Inasmuch as negative values of ui are nonphysical and are never reached by trajectories starting in the positive domain, also even-order polynomials are suitable in this case for the description of global dynamics. Equation (1.54) with n = 3 presents parametric unfolding of dynamics in the vicinity of a cusp singularity. Generically, it can be attained by fixing an additional parameter of the underlying system, i.e., at a codimension two manifold in the parametric space. The dynamics is restricted to small amplitudes, provided µ3 < 0. Assuming this to be true, this parameter can be rescaled to −1, while µ2 can be set to zero by an amplitude shift. The resulting cubic equation, a˙ = µ0 + µ1 a − a3 ,
(1.56)
1.3 Weakly Nonlinear Analysis (a)
31
(b) a
a
Μ0
Μ1
(c)
(d)
Μ0
a
Μ1
Μ1
(e)
(f) a
a
Μ1
Μ1
Fig. 1.2. Dependence of the real amplitude on a bifurcation parameter for elementary bifurcations. (a) Fold (saddle-node). (b) Transcritical. (c) Cusp (no symmetry); the region of multiple stationary states in the parametric plane µ0 , µ1 is shown in (d). (e) Supercritical pitchfork, Hopf or Turing bifurcations. (f) Subcritical pitchfork, Hopf or Turing bifurcations described by a symmetric fifth-order normal form. Solid lines denote stable states, and dashed lines denote unstable states
has at µ0 = 0 a bifurcation diagram shown in Fig. 1.2c. Three equilibria – two stable and one unstable – exist in the cusped region µ1 > 0, |µ0 | < 2(µ1 /3)3/2 (Fig. 1.2d). Outside this region, there is a unique stable equilibrium. As the coefficient µ1 increases, a fold bifurcation takes place, creating a pair of stationary states, one stable and one unstable. One branch of solutions is not affected by the bifurcation, and solutions belonging to this branch remain stable. With µ1 decreasing, the system residing initially on the lower branch
32
1 Dynamics, Stability and Bifurcations
of stable solutions jumps to the upper branch; this is a first-order transition involving a finite change of the amplitude. A reverse transition to the lower branch of stable solutions at µ1 exceeding the critical value can take place only as a result of a finite perturbation, which would bring the system within the attraction basin of the alternative stable state. In systems with inversion symmetry, µ0 must vanish; then the bifurcation diagram is symmetric, as in Fig. 1.2e. In this case, a second-order transition, called a pitchfork bifurcation, takes place: the trivial state a = 0 persists through the bifurcation point but becomes unstable, and the two symmetric stationary states that exist at µ1 > 0 have infinitesimal amplitudes when they emerge at the bifurcation point. Continuing to higher orders, one can obtain equations with a larger number of fixed points, which present unfoldings of higher order singularities attained on manifolds of higher codimension. A symmetric bifurcation diagram obtained at µ3 > 0, µ5 = −1, and even-order coefficients vanishing is shown in Fig. 1.2f. This diagram combines a subcritical bifurcation of a pair of unstable nontrivial solutions at µ1 = 0 and a fold bifurcation at µ1 = −µ23 /4. The nontrivial stable stationary states appear in this case via a first-order transition. Singularities of fourth and fifth order have flamboyant names: “butterfly” and “swallowtail.” General nonsymmetric forms already generate a variety of bifurcations. The procedure of the analysis of parametric dependence of multiple stationary states, though rather straightforward, has been a subject of a huge body of mathematical literature. A catchy term catastrophe theory was coined (Thom, 1975) to describe the sequence of bifurcations of equilibria. The philosophical balloon growing from this theory was ridiculed by Arnold (1984). Numerous studies of bifurcation of equilibria classified in minute detail a variety of cuts that can be made through bifurcation manifolds (containing differently inclined folds, isolas, etc.), as well as their modification due to innate or accidental symmetries of the underlying system. 1.3.3 Derivation of Amplitude Equations Formal derivation of amplitude equations is carried out following the multiscale expansion procedure outlined in Sect. 1.3.1. Setting in (1.50) u1 = const, i.e., ∂0 u1 = 0, we find the shift of the stationary solution due to a small variation of parameters u1 = −fu −1 fp p1 .
(1.57)
The rectangular array fu −1 fp is recognized as the parametric sensitivity matrix. Continuous dependence on parameters can be used to construct a branch of equilibria as long as the matrix fu has an inverse. This branch terminates at a bifurcation manifold where the matrix fu has zero eigenvalue and, consequently, its determinant vanishes.
1.3 Weakly Nonlinear Analysis
33
Suppose now that p0 is a point on this bifurcation manifold. Then one can neither construct a stationary solution at values of parameters close to this point nor characterize stability of the equilibrium in the linear approximation. The dynamics in the vicinity of the bifurcation manifold is governed by a nonlinear amplitude equation to be obtained in higher orders of the expansion. Generically, the zero eigenvalue is nondegenerate. Let U be the corresponding eigenvector satisfying fu U = 0. Then u1 = a(t1 , t2 , . . .)U
(1.58)
is the solution of the homogeneous linear equation (1.51) that remains stationary on the fast time scale t0 . The amplitude a is so far indeterminate and can depend on slower time scales. The inhomogeneous equation (1.50) has solutions constant on the rapid time scale, provided its inhomogeneity does not project on the eigenvector U . This condition is (1) (1.59) µ0 ≡ U † · fp p1 = 0, where U † is the eigenvector of the transposed matrix satisfying U † fu = 0 normalized by U † · U = 1. Equation (1.59) defines the tangent hyperplane to the bifurcation manifold at the point p = p0 . Before writing up the second-order equation, we require that the secondorder deviation u2 remain constant on the rapid time scale (otherwise it might outgrow u1 at long times). The dependence upon slower time scales must be expressed exclusively through the time dependence of the amplitude a. Using (1.58), we write the second-order equation as fu u2 = ∂1 a U − fp p2 − afup [U , p1 ] − 12 a2 fuu [U , U ].
(1.60)
The solvability condition of this equation is (2)
(1)
(0)
∂1 a = µ0 + µ1 a + µ2 a2 ,
(1.61)
where the slow time derivative ∂1 is indexed according to (1.49). The parameters of (1.61) are µ0 = U † · fp p2 + 12 U † · fpp [p1 , p1 ], (2)
µ1 = U † · fup [U , p1 ], (1)
µ2 = 12 U † · fuu [U , U ]. (0)
(1.62)
The superscripts correspond to the scaling of respective parametric deviations from the bifurcation point. The parameters with the superscript zero are characteristic to the particular point on the bifurcation manifold. Generically, these parameters differ from zero but may vanish on a manifold of higher codimension that corresponds to a degenerate bifurcation. In a generic case, one can consider only parametric deviations transverse (1) to the bifurcation manifold and set p1 = 0 to satisfy (1.59); then µ1 = 0, and the generic equation for slow dynamics near the bifurcation manifold becomes
34
1 Dynamics, Stability and Bifurcations (2)
(0)
∂1 a = µ0 + µ2 a2 .
(1.63)
This equation can also be obtained by shifting the amplitude in (1.61). Its solutions have been already discussed in the preceding subsection. Nongeneric situations may arise either because of intrinsic symmetries of the system or “accidentally” on a manifold of higher codimension. It may happen that the matrix fp , as well as higher derivatives with respect to parameters, vanish identically. This would be the case when u0 is a “trivial” solution that remains constant at all values of parameters. Then (1.59) is satisfied identically, and (1.61) reduces to (1)
(0)
∂1 a = µ1 a + µ2 a2 .
(1.64)
This equation, describing a transcritical bifurcation, has two solutions on both sides of the bifurcation manifold, but the two solutions interchange stability when this manifold is crossed. (0) If µ2 = 0, the expansion should be continued to the next order. The (0) coefficient µ2 may vanish identically because of the symmetry of the original problem to inversion of u. Otherwise, it can be equal to zero at certain values of the parameters of the problem. Generally, the two conditions, vanishing (0) of both the determinant of fu and µ2 , are satisfied simultaneously on a codimension two manifold in the parametric space that corresponds to a cusp singularity. In order to continue the expansion, we restrict parametric deviations in such a way that the dependence on t1 be suppressed. Deviations transverse to the bifurcation manifold have to be restricted by the second-order condition (2) µ0 = 0, which is stronger than (1.59). First-order parametric deviations p1 parallel to the bifurcation manifold, which are still allowed by (1.59), should (1) now be restricted by the condition µ1 = 0. If the array p contains two para(1) (1) meters only, the conditions µ1 = 0 and µ0 = 0 imply, in a nondegenerate case, that first-order parametric deviations should vanish identically. When more parameters are available, parametric deviations satisfying both these conditions are superfluous, since they correspond just to gliding into a closer vicinity of another point on the codimension two bifurcation manifold in a higher-dimensional parametric space. Further on, we shall therefore set p1 to zero identically. The dynamics unfolding on a still slower time scale t2 should be determined from the third-order equation fu u3 = ∂2 a U − fp p3 − afup [U , p2 ] − afuu [U , u2 ] − 16 a3 fuuu [U , U , U ]. (1.65) The second-order function u2 has to be found by solving Eq. (1.60), now reduced to the form fu u2 = −fp p2 − 12 a2 fuu [U , U ].
(1.66)
1.3 Weakly Nonlinear Analysis
35
Only the solution of the inhomogeneous equation, which does not project on the eigenvector U , is relevant. It can be expressed as a quadratic form in a containing two suitable vectors: u2 = U 22 + a2 U 20 .
(1.67)
The solvability condition of (1.65) is obtained then in the form (3)
(2)
(0)
∂2 a = µ0 + µ1 a + µ3 a3 ,
(1.68)
where µ0 = U † · fp p3 , (3)
µ1 = U † · fup [U , p2 ] + U † · fuu [U , U 22 ], (2)
µ3 = 16 U † · fuuu [U , U , U ] + U † · fuu [U , U 20 ]. (0)
(1.69)
This equation presents parametric unfolding of dynamics in the vicinity of a cusp singularity. The dynamics is confined to the vicinity of u0 , provided (0) µ3 < 0. Assuming this to be true, (1.68) reduces to (1.56) by rescaling. (0) The condition µ3 = 0 defines a singular bifurcation manifold of codimension three. Again, it is possible to fix parametric deviations to suppress the dynamics on the scale t2 , and obtain in the next order a quatric equation that represents the unfolding of the butterfly singularity. The procedure can be continued further if a sufficient number of free parameters are available, arriving in the nth order at the general form (1.54) with the parameters µj dependent on parametric deviations of O(n−j ). 1.3.4 Hopf Bifurcation The symmetry of the slow mode determines the structure of the normal form in a crucial way. At the Hopf bifurcation point where the frequency ω0 = Im(λ) differs from zero, the amplitude is complex and even-order terms are forbidden by symmetry to phase shifts. The lowest-order normal form involving a single complex amplitude a is then a˙ = a(µ1 + µ3 |a|2 ),
(1.70)
where the coefficients µj are complex. The dynamics is restricted to small amplitudes when the real part of µ3 is negative. Then the Hopf bifurcation is supercritical , and the bifurcation diagram has the form shown in Fig. 1.2e. The stationary state a = 0 is stable at Re(µ1 ) < 0, while at Re(µ1 ) > 0 it is unstable and the trajectories are attracted to the periodic orbit with the amplitude a = ρ eiΩT , where ρ2 = |a|2 = −Re(µ1 )/Re(µ3 ) and Ω = Im(µ1 )+Im(µ3 )ρ2 is an O(2 ) frequency shift. For Re(µ3 ) > 0, the bifurcation is subcritical . An unstable periodic orbit exists then at Re(µ1 ) < 0, i.e., under conditions when the trivial solution is stable. This orbit defines the boundary of the attraction basin of the trivial state.
36
1 Dynamics, Stability and Bifurcations
The coefficients µj can be obtained, as in the preceding subsection, by applying the multiscale expansion procedure. At the Hopf bifurcation point, the parametric dependence of the stationary solution u = u0 (p) remains smooth; a linear correction can be obtained from the stationary equation (1.57). In order to simplify derivations, one can eliminate this trivial parametric depen = u−u0 (p). The resulting dynamic dence by transforming to a new variable u 0 = 0. system has the same form as (1.46) but has a persistent trivial solution u This way to eliminate parametric dependence is, however, not convenient for practical computations, since the stationary solution hardly ever can be computed explicitly. It is more convenient to present the dynamical system in the form du = f (u; p). (1.71) γ dt Then one can keep the entire set of parameters p fixed, but vary only dynamic parameters entering the capacitance matrix γ, which do not affect the fixed points; this would usually be sufficient to locate a Hopf bifurcation point. At a Hopf bifurcation point, the Jacobi matrix J = γ −1 0 fu has a pair of imaginary eigenvalues λ = ±iω0 . In the vicinity of this point, we set γ = γ 0 + γ 1 + · · ·. The first-order equation Lu1 ≡ (fu − γ 0 ∂0 )u1 = 0
(1.72)
has a nontrivial oscillatory solution u1 = a(t1 , t2 , . . .)Φ(t0 ) + c.c.;
Φ(t0 ) = eiω0 t0 U
(1.73)
with an arbitrary complex amplitude a(t1 , t2 , . . .) changing on an extended time scale; U is the eigenvector of J with the eigenvalue iω0 : J U ≡ γ −1 0 fu U = iω0 U .
(1.74)
The vector Φ(t0 ) and its complex conjugate Φ(t0 ) are two eigenfunctions of the linear operator L defined by (1.72) with zero eigenvalue. The operator L acts here in the space of 2π/ω0 -periodic complex-valued vector-functions with the scalar product defined as ω0 2π/ω0 u, v = u(t) · v(t) dt. (1.75) 2π 0 The eigenfunctions of the adjoint operator L† = J † + vecγ0 ∂0 are Φ† (t0 ) = eiω0 t0 U † and its complex conjugate; U † is the eigenvector of J † with the † eigenvalue iω0 , and a suitable normalization condition is U γ0 U = 1. The second-order equation is Lu2 = (γ 0 ∂1 + γ 1 ∂0 )u1 − 12 fuu [u1 , u1 ].
(1.76)
The inhomogeneity of this equation contains both the principal harmonic eiω0 t0 contributed by the linear terms and terms with zero and double frequency stemming from the quadratic term. The scalar products of the latter
1.3 Weakly Nonlinear Analysis
37
with the eigenfunction Φ† (t0 ) and its complex conjugate vanish, and the solvability condition of (1.76) is obtained in the form: (1)
†
(j)
where µ1 = −iω0 U · γ j U .
∂1 a = µ1 a,
(1.77)
This equation has a nontrivial stationary solution only if the real part of (1) µ1 vanishes. This condition defines a hyperplane in the parametric space of the capacitance matrix tangential to the Hopf bifurcation manifold. The shift along this manifold can be safely eliminated as in the preceding section by setting γ1 = 0. Then (1.77) reduces to ∂1 a = 0, so that the amplitude may evolve only on a still slower scale t2 . The second-order function u2 has to be found by solving (1.76), now reduced to the form Lu2 = − 12 (a2 e2iω0 t0 fuu [U , U ] + |a|2 fuu [U , U ] + c.c).
(1.78)
The solution of this equation is u2 = −|a|2 V 0 − 12 a2 e2iω0 t0 V 2 + c.c. V 0 = fu −1 fuu [U , U ],
V 2 = (fu − 2iω0 )−1 fuu [U , U ].
(1.79)
The third-order equation is Lu3 = (γ 0 ∂2 + γ 2 ∂0 )u1 − fuu [u1 , u2 ] − 16 fuuu [u1 , u1 , u1 ].
(1.80)
The amplitude equation is obtained as the solvability condition of this equation. Only the part of the inhomogeinity containing the principal harmonic contributes to the solvability condition, which takes the form coinciding with (1.70): (2) (0) (1.81) ∂2 a = µ1 a + µ3 |a|2 a, (0)
†
†
†
µ3 = 12 U · fuuu [U , U , U ] − U · fuu [U , V 0 ] − 12 U · fuu [U , V 2 ]. (1.82) The expansion can be continued to higher orders, after readjusting the scaling of parametric deviations, near a parametric point where the real part (0) of µ3 vanishes. This leads to a quintic equation on a slower O(−4 ) time scale describing dynamics in the vicinity of a subcritical Hopf bifurcation: (4)
(2)
(0)
∂4 a = µ1 a + µ3 |a|2 a + µ5 |a|4 a.
(1.83)
Although, generally, Im(µ3 ) = 0, this term can be cancelled by adding the respective O(2 ) frequency to the basic frequency ω0 at the Hopf bifurcation. Provided Re(µ5 ) < 0, the bifurcation diagram has the form shown in Fig. 1.2f. Since (1.83) retains the symmetry to phase shifts, all transitions depend only on real parts of the coefficients µj . The only difference with the description of this diagram in the preceding section is that the saddle-node bifurcation creates a pair of periodic orbits (one stable and one unstable) rather than two symmetric pairs of stationary states.
38
1 Dynamics, Stability and Bifurcations
1.3.5 Degenerate Bifurcations More than one mode is necessary for the description of slow dynamics near a manifold in the parametric space where the underlying linearized system has more than one eigenvalue with vanishing real part. The degeneracy may be either “accidental” (attained at certain values of the parameters of the underlying system) or due to symmetry. Two real modes with unbroken symmetry (k = 0, ω = 0) interact in the vicinity of a singular bifurcation at double zero eigenvalue. In the absence of special symmetries, the bifurcation manifold is of codimension two, and the eigenvalue is degenerate geometrically as well as algebraically. Geometric degeneracy means that there is only one eigenvector U satisfying L0 U = 0. The orthogonal basis spanned by this vector and the rest of eigenvectors of L0 should be then complemented by an additional vector V satisfying L0 V = U . The matrix representation of L0 is reduced 01 in this basis to the normal Jordan form where the cell corresponds 00 to the double zero eigenvalue. This singular bifurcation is known as Takens– Bogdanov (TB) bifurcation. It is particularly interesting since in its vicinity one can study analytically global bifurcations that otherwise can be detected only numerically (see Sect. 1.4.1). If a1 , a2 are, respectively, the amplitudes of the modes with the eigenvectors U , V , a straightforward expression for a normal form with the specified linear part would be a˙ 1 = a2 + f1 (a1 , a2 ),
a˙ 2 = f2 (a1 , a2 ),
(1.84)
where the polynomials fi (a1 , a2 ) account for nonlinear interactions as well as small parametric deviations from the codimension two bifurcation manifold. This expression can be obtained by projecting the original equations on the eigenvectors U , V , expanding in Taylor series and truncating at a certain order; the formal orders of magnitudes of various terms would not, however, match. Equation (1.84) can be further simplified by choosing new variables x = a1 , y = a2 + f1 (a1 , a2 ). Taking note that the time variable in (1.84) should be slow, we observe that the two amplitudes x, y should be of different orders of magnitude, so that y x. One can therefore neglect all terms nonlinear in y. Then (1.84) is rewritten as x˙ = y,
y˙ = f (x) + y g(x),
(1.85)
where f (x), g(x) are, respectively, nth and mth order polynomials. If the amplitude x is scaled as x = O() and the slow time variable as T = O(−(n−1)/2 ), the first term on the r.h.s. of the second equation balances its left-hand side (l.h.s.), and the ratio of the second to the first term is δ = O(m−(n−1)/2 ). If m > 12 (n − 1), (1.85) is a perturbed Hamiltonian system with weakly dissipative corrections, which is particularly convenient for analysis (see Sect. 1.4.3).
1.4 Global Bifurcations
39
Other codimension two degenerate bifurcations may involve “accidental” coincidence of monotonic and Hopf or of two Hopf bifurcations with different frequencies. The amplitude equations are constructed in a straightforward way as combinations of the amplitude equations for the respective elementary bifurcations with added interaction terms allowed by symmetry. For example, the pair of amplitude equations for the Hopf-monotonic degeneracy truncated at the third order is a˙ 1 = µ0 + µ1 a1 − a31 + µ2 |a2 |2 + µ3 a1 |a2 |2 , a˙ 2 = a2 λ0 + λ1 a1 + λ2 a21 − λ3 |a2 |2 ,
(1.86)
where the amplitude a1 and parameters µi are real, while the amplitude a2 and parameters λi are complex. This equation system, as well as a similar one for a nonresonant double Hopf degeneracy, is not interesting by itself, since, although the phase space dimension is formally, respectively, three and four, the phase of the complex amplitude falls out, and dynamics is essentially two-dimensional. Chaotic behavior can be, however, generated under the influence of weak phase-dependent perturbations. Near the Hopf-monotonic degeneracy, chaos is likely to arise when a homoclinic orbit exists (see Sect. 1.5.2). Near the double Hopf degeneracy, phase dependence can be caused by resonance between the two oscillatory modes. If the ratio of the frequencies is a fraction with a denominator n, the phase-dependent resonant term is of O(n ) when ai = O(). At n ≤ 3, the resonance is strong and enters the lowest order amplitude equation; otherwise, it acts as a perturbation. Since, because of nonlinear frequency shift, resonances may appear in “Arnold tongues” beyond the bifurcation point, transition to chaos turns out to be a generic phenomenon under these conditions (Ruelle and Takens, 1971).
1.4 Global Bifurcations 1.4.1 Global Dynamics: An Overview There are only two kinds of generic (codimension one) bifurcations in dynamical systems that can be detected by local linear analysis: a saddle-node bifurcation at zero eigenvalue that creates a pair of equilibria – a saddle and a node – and a Hopf bifurcation at imaginary eigenvalue creating a periodic orbit. Other kinds of transitions, which cannot be detected by local analysis alone, are, however, necessary to reconstruct a global generic picture of qualitative changes of behavior including bifurcation of stationary states and periodic orbits. Global analysis of a dynamical system aims at defining all kinds of bifurcations affecting either the number of attractors or their basin boundaries. While the local analysis in the preceding section started from a stable stationary state and concentrated on finding other attractors in its vicinity, both
40
1 Dynamics, Stability and Bifurcations
stable and unstable states are important for global analysis. A fixed point in n-dimensional phase space has, generically, m eigenvalues with positive real parts and n − m eigenvalues with negative real parts. The subspaces spanned by the respective eigenvectors form an m-dimensional unstable manifold and an (n − m)-dimensional stable manifold . Trajectories of the dynamical system approach the fixed point along its stable manifold and escape from its vicinity along its unstable manifold. For a stable fixed point, m = 0, while at a bifurcation point, when this state becomes marginally unstable, there is a center manifold spanned by eigenvectors with vanishing real part. The dimension of the center manifold is one for a bifurcation at zero eigenvalue and two for a Hopf bifurcation. This dimension may be higher for degenerate bifurcations. A periodic orbit in n-dimensional phase space has, generically, an m-dimensional unstable manifold (m = 0 for a stable orbit) and an (n − m − 1)-dimensional stable manifold. The remaining direction is tangential to the trajectory. The system is neutrally stable to tangential displacements, i.e., phase shifts of the periodic motion. Complete global analysis is possible for two-variable systems, which have two kinds of attractors only: fixed points or periodic orbits. The fixed points may be of three kinds only: nodes (either stable or unstable), which have two real eigenvalues of the same sign, saddles, which have two real eigenvalues with opposite signs, and foci (either stable or unstable), which have two complex conjugate eigenvalues. The three types of global codimension one bifurcations in a two-variable dynamical system are saddle-loop(sl), or homoclinic bifurcation; saddle-node infinite period (sniper , or Andronov) bifurcation; and saddle-node bifurcation of periodic orbits (snp). A saddle-loop bifurcation occurs when a trajectory going out of a saddle point along its unstable manifold returns to the same point along its stable manifold. Such a trajectory, called homoclinic, does not exist generically but (a)
(b)
Fig. 1.3. Parametric evolution of a periodic orbit through a saddle-loop (a) and sniper (b) bifurcation
1.4 Global Bifurcations
41
Fig. 1.4. A sketch of a bifurcation diagram for a two-variable dynamical system (top) and phase portraits in different parametric domains (bottom) (Reichert et al., 2001, reproduced with permission. Copyright by the American Institute of Physics). Loci of local bifurcations – supercritical (h) and subcritical (h ) Hopf and saddlenode (sn) – are shown by solid lines, but the sn locus is shown by a dash-dotted line when both bifurcating states are unstable; loci of global bifurcations – saddle-loop (sl), saddle-node of periodic orbit (snp), and sniper – are shown by dashed lines. The codimension two points are cusp C, degenerate Hopf bifurcation DH, Takens– Bogdanov point TB, saddle-node loop SNL, and neutral saddle loop NSL. In the phase portraits, asymptotically stable periodic orbits are indicated by solid lines and unstable ones by dashed lines.
42
1 Dynamics, Stability and Bifurcations
may be found by adjusting a single parameter of the system. A homoclinic trajectory can be viewed as a periodic orbit with infinite period. Starting from a supercritical Hopf bifurcation in a system with at least two fixed points (one of which is a saddle) and changing a suitable adjustable parameter, one can follow the parametric evolution of the emerging periodic orbit and observe that both the amplitude and period increase, until the orbit hits the saddle point and turns into a homoclinic (Fig. 1.3a). Beyond the bifurcation, all trajectories are deflected to a faraway attractor. An unstable periodic orbit emerging at a subcritical Hopf bifurcation may also undergo an saddle-loop bifurcation, which now affects, however, only basin boundaries, rather than the attractors themselves. An unstable orbit forms the boundary of the attraction basin of the fixed point it surrounds. Following the saddle-loop bifurcation, this basin opens up, and the fixed point may now attract trajectories starting from far removed points in the phase plane. This picture can be read from the same Fig. 1.3a with inverted direction of flow. A sequence going through formation of either stable or unstable homoclinic orbit can be traced by changing a dynamic parameter that does not affect the fixed point, e.g., a parameter entering the matrix γ in (1.71). A sniper bifurcation occurs when a pair of stationary states – a node and a saddle – emerges on a periodic orbit. The orbits in the phase plane at the bifurcation point are shown in Fig. 1.3b. Like in the case of a saddle-loop bifurcation, the period diverges at the bifurcation point; the sequence going through this bifurcation should be traced, however, by changing one of the parameters affecting the stationary states, since an emerging pair, rather than a “preexisting” saddle, is involved here. The third kind of a global bifurcation, snp, is a birth or annihilation of a pair of periodic orbits, one stable and one unstable. A practical example (Reichert et al., 2001) of a bifurcation diagram for a two-variable dynamical system showing all kinds of local and global codimension one bifurcations lines, as well as degenerate bifurcations at their junctions, is shown in Fig. 1.4. This diagram is schematic; some parametric domains terminate in cusps at codimension two junctions, and are too small to be detected in typical experiments. The codimension two points, as well as behavior in different parametric domains, will be discussed in more detail in Sect. 1.4.3. Bifurcation diagrams of this kind can also appear, of course, in dynamical systems with more than two variables. When the phase space dimension is at least three, chaotic dynamics is possible (more on this in Sect. 1.5), and the variety of behavior becomes inexhaustible, but in many practical systems these possibilities are never realized, since some degrees of freedom remain essentially frozen. 1.4.2 Systems with Separated Time Scales Global behavior can be easily understood when the characteristic time scales associated with the two variables are widely separated. As an example, con-
1.4 Global Bifurcations (b)
0.4
0.4
0.2
0.2
0
v
v
(a)
0
0.2
0.2
0.4
0.4
1.5 1 0.5 0 u
0.5
1
1.5 1 0.5 0 u
1.5
0.5
1
1.5
0.5
1
1.5
(d)
0.4
0.4
0.2
0.2
0
v
v
(c)
0
0.2
0.2
0.4
0.4
1.5 1 0.5 0 u
43
0.5
1
1.5
1.5 1 0.5 0 u
Fig. 1.5. Null-isoclines of the system (1.87), (1.88). (a) Oscillatory system; gray line shows the periodic orbit. (b) Excitable system; gray line shows a trajectory starting from the perturbed stationary state. (c) Bistable excitable system. (d) Bistable system
sider the two-variable FitzHugh–Nagumo model (1.4) with a fast activator u and a slow inhibitor v, which we rewrite here in a rescaled asymmetric form5 γ u˙ = u − u3 − v, v˙ = −v − ν + µu,
(1.87) (1.88)
where γ 1 is the ratio of the characteristic time scales. In the limit γ → 0, the dynamics can be read directly from the plot of null-isoclines, i.e., loci of zeros of the r.h.s. of the system (Fig. 1.5). The null-isocline of (1.87) is S-shaped, while that of (1.87) is a straight line with a position and incline fixed by the parameters µ, ν. The fixed points are intersections of the null-isoclines; three solutions (no more than two of which can be stable) exist within the cusped region in Fig. 1.6. The parametric expression of its boundary is µ = 1 − 3u2 , ν = −2u3 . The fast variable u is slaved to v and is attracted to either of the stable (descending) branches of the S-shaped curve. Once it has attained a certain branch, it slips alongside following slow evolution of the inhibitor until reaching a fixed point. If, however, there is no fixed point on this branch, a jump 5
This is a space-independent version of the RDS that will be studied in detail in Chap. 3.
44
1 Dynamics, Stability and Bifurcations 0.6 0.4
1
Ν
0.2 0
O
2
-0.2 1
-0.4 -0.6 -0.5 -0.25
0
0.25
0.5
0.75
1
Μ
Fig. 1.6. Bifurcation diagram of the system (1.87), (1.88). The solid line is the locus of saddle-node bifurcation. The dashed lines mark transitions of the fixed point from a stable to an unstable branch and serve as the boundaries of the regions of relaxation oscillations O, a single stable stationary state 1(±), and bistability 2
on the alternative stable branch takes place after the turning point of the S-shaped curve is reached. If there is no fixed point on this branch as well, as in Fig. 1.5a, the system slips again to another turning point and jumps back to the alternative branch. This is the regime of relaxation oscillations characteristic to oscillatory systems with separated time scales. As the parameters µ and ν change, transition to oscillatory behavior is observed when a stable fixed point moves through an extremum of the S-shaped curve to the unstable (ascending) branch. √ For the fixed points on the two branches, this happens at ν = ±( 23 −µ))/ 3 (dashed lines in Fig. 1.6). This is not a Hopf bifurcation, which could have been reached by varying the dynamic parameter γ and would generate a small-amplitude (either stable or unstable) periodic orbit in the vicinity of the bifurcation point. Neither is it a saddle-loop bifurcation, since it is a stable, rather than an unstable, fixed point, which “collides” with the periodic orbit. The transition is, in fact, highly degenerate, and can be resolved by varying the ratio of the two small parameters: γ and the deviation of the fixed point from the extremum6 . The periodic orbit always has a large amplitude; it cannot coexist with a stationary state and, as long as it exists, is insensitive to changes of µ and ν. Within the stable region but not far from the locus of oscillatory transition, the system is excitable. A typical disposition of null-isoclines is shown in Fig. 1.5b. The fixed point lying close to the turning point is stable, but a small finite perturbation displacing the phase point below the minimum of the S6
This analysis may resolve a transition from small-amplitude to large-amplitude (relaxation) oscillations taking place within a narrow parametric range – the so called canard phenomenon.
1.4 Global Bifurcations
45
shaped curve initiates transition to the alternative branch. The system returns to the stationary state only after a very long excursion, following a circumferential route along both branches, as seen in the figure. In the case shown in Fig. 1.5c, both stationary states are excitable, and the system switches between them following a weak perturbation. A much stronger perturbation is needed to initiate a switch when the null-isoclines are arranged as in Fig. 1.5d. 1.4.3 Almost Hamiltonian Dynamics Global bifurcations can be studied analytically with the help of the amplitude equations (normal forms) obtained as an unfolding of the TB bifurcation (Sect. 1.3.5). We have seen that these equations can take the form of perturbed Hamiltonian systems with weakly dissipative corrections. We shall rewrite (1.85) as x˙ = y, y˙ = f (x) + δ y g(x), (1.89) where f (y), g(y) are, respectively, nth and mth order polynomials and δ is a small parameter. At δ = 0, the system is conservative. The conserved quantity is “energy” V (y) = − f (x) dx. (1.90) E = 12 y 2 + V (x), The minima of the potential V (x) correspond to stable stationary states and the maxima to saddle points. The equation of motion can be obtained by varying the action integral 1 2
S= (1.91) 2 y − V (x) dt. Equation (1.89) at δ = 0 can be easily resolved by eliminating time to obtain trajectories in the phase plane spanned by x and its time derivative (or “momentum” y): y 2 = 2[E − V (x)]. (1.92) Trajectories at different levels of E may be qualitatively different (see Fig. 1.7). At low energies, each trajectory surrounds one of stable stationary states only; at energies exceeding those of both stationary states, the level E = const would consist of two disconnected parts. At high energies, each trajectory surrounds both stable stationary states. The boundary between the two types corresponds to the energy of the intermediate unstable state. This is a homoclinic trajectory passing through the unstable state. At δ = 0, the energy changes with time: ∂E ∂E x˙ + y˙ = δ y 2 g(x). E˙ = ∂x ∂y
(1.93)
46
1 Dynamics, Stability and Bifurcations 1
0.5
y
0
-0.5
-1 -1.5
-1
-0.5
0 x
0.5
1
1.5
Fig. 1.7. Trajectories of a Hamiltonian system with two stable fixed points
When δ is small, the energy changes slowly, so that it remains nearly constant during an oscillation period T along a particular trajectory. We can then compute the rate of change of energy by averaging over the period T : xmax t+T xmax dx ˙ ≡ ∆E = δ y 2 g(x) dt = δ y(x)g(x) dx E
T T t y(x) xmin xmin (1.94) The integration limits in the last integrals are values of x at turning points where y vanishes, i.e., the suitable roots of E = V (x). For a specific system, the computed “dissipation rate” ∆E/T can be expressed as a function of energy7 , and may vanish on a certain trajectory. We can observe that even arbitrarily weak dissipation brings about a qualitative change of dynamic behavior. A conservative system can move along any available trajectory, depending on its energy. On the contrary, a weakly dissipative system evolves to a certain energy level where the average change of energy vanishes. A trajectory becomes stationary when the dissipation integral vanishes: xmax √ xmax y(x)g(x) dx = 2 g(x) E − V (x) dx = 0. (1.95) xmin
xmin
1.4.4 Bifurcation Diagrams In order to construct a global bifurcation diagram, we have to focus attention on the values of parameters when special (nongeneric) trajectories, such 7
Dissipation, of course, can be negative only in a system sustained far from equilibrium. Then it is sometimes called “antidissipation”.
1.4 Global Bifurcations
47
as homoclinics, become stationary. Strictly speaking, the above derivation, assuming that the energy change during a single oscillation period is small, fails for an infinite-period homoclinic trajectory. Nevertheless, the stationarity condition for a homoclinic trajectory correctly indicates the location of the saddle-loop bifurcation in a weakly dissipative system of the type (1.89). As an example, consider (1.89) with a cubic f (x) and quadratic g(x): f (x) = µ0 + x − x3 ,
g(x) = µ1 + µ2 x − x2 .
(1.96)
0 The roots of f (x) = 0 are two stable fixed points x± s and the unstable one xs ; they can be found explicitly using a convenient trigonometric expression for the roots of a cubic polynomial: √ √ x0s = (2/ 3) sin ψ, x± s = −(2/ 3) sin(ψ ∓ π/3), √ ψ = 13 arcsin( 32 3µ0 ). (1.97)
Local analysis gives immediately the location of a saddle-node bifurcation µ0 = 2/33/2 . The condition for Hopf bifurcation on the branches of fixed ± points y = 0, x = x± s (µ0 ) is g(xs ) = 0. In order to determine whether this bifurcation is supercritical or subcritical, one can obtain an analytic approximation of the dissipation integral for small-amplitude orbits with E slightly above V (x± s ) taking into account that these orbits are almost harmonic. The homoclinic orbit corresponds to the energy level E = V (x0s ). It is shaped as the figure eight, with its two loops surrounding each of stable fixed points. The stationarity condition (1.95) evaluated separately for each loop defines sl± bifurcation on the branch of periodic orbits surrounding the respective point, while the condition evaluated for the entire figure-eight defines sl0 bifurcation on the branch of “large” orbits surrounding all three fixed points. Figure 1.8a shows a 2D section of the bifurcation diagram in the 3D parametric space for a typical value µ0 = 0.1 in the domain where three fixed points exist. The loci of Hopf and saddle-loop bifurcations in the parametric plane µ1 , µ2 are straight lines, and each fixed point is stable to the left of the respective Hopf locus. The snp loci are not shown in this figure, but one involving “large” orbits is seen in Fig. 1.8b, which presents a blow-up near the intersection of the three sl lines. One can observe that the loci of Hopf and sl± bifurcations intersect (as they also do in Fig. 1.4), so that at positive and weakly negative values of µ1 the saddle-loop bifurcation occurs while the fixed point is still stable. This suggests that the Hopf bifurcation might be subcritical at these values of the parameters and the sl bifurcation takes place on the branch of unstable periodic orbits. This is not precisely so, since the intersection of these loci has no particular significance, while the dynamically important codimension two points in the parametric space are those where the third-order coefficient in the expansion at Hopf bifurcation vanishes (DH) and where the homoclinic orbit is neutrally stable (NSL). These points do not generically coincide and should be connected by an snp branch. The snp loci (not discernable on the
48
1 Dynamics, Stability and Bifurcations (a) 2
1.5
000
001
1
Μ2
0.5
0
001
000
-0.5 -1
-1.5
000 -1
-0.5
001
0
1
0.5
1.5
Μ1
(b) 0.75
0.5
000
002
001
0.25
101
010 012 011 002 111 102 101
0 Μ2
000 -0.25 100
-0.5 -0.75
00 1
011
002
000 NSL 0.6
001 0.7
0.8
0.9
1
1.1
Μ1
(c)
Μ2
0.04
NSL
000
100
0.02 snp 0 -0.02
200
h
h’
DH
100 -0.3
sl -0.2
000 -0.1 Μ1
0
0.1
Fig. 1.8. (a) Loci of Hopf (solid lines) and saddle-loop(sl) (dashed lines) bifurcations in the parametric plane µ1 , µ2 at µ0 = 0.1. (b) Blow-up near the intersection of the three sl lines, showing also an snp locus (gray line). (c) Blow-up of the loci of Hopf (h or h ), sl, and snp bifurcations for the orbits surrounding the lower fixed point. See the text for explanations
1.4 Global Bifurcations
49
scale of Fig. 1.8a) can be computed by requiring both the dissipation integral (1.95) and its derivative with respect to E to vanish. The blow-up of bifurcation loci for the lower state is shown separately in Fig. 1.8c where, to get a clearer picture, the difference ∆µ2 between the values of µ2 for snp or sl and Hopf bifurcations is plotted against µ1 , so that the locus of Hopf bifurcation is mapped onto the axis ∆µ2 = 0. The phase portraits corresponding to different domains are denoted by a code including either one or three numbers equal to the number of periodic orbits enclosing a fixed point. In the case when there are three fixed points, the numbers refer, in this order, to the lower and upper states and all three fixed points together. The first two digits are written with an overbar when the respective fixed point is unstable. This code allows us to reconstruct the changes in phase portraits quite easily.8 The code digit changes by one at the Hopf and sl bifurcations, and by two at snp. The snp line approaches the other two tangentially, forming cusps at the points DH and NSL. The fixed point is stable above the Hopf line (the axis ∆µ2 = 0). An unstable periodic orbit surrounds this point in the region 100, confining its attraction basin to its close vicinity. As µ2 further increases, this orbit opens up at the saddle-loop bifurcation locus to the right of the point NSL bordering the region 000. This, however, cannot happen to the left of the point NSL where the homoclinic orbit is stable. What really happens at this line segment is bifurcation of a stable periodic orbit surrounding both the fixed point and the unstable orbit that serves as the boundary of their attraction basins. Both attractors coexist with the stable upper state in the region 200. At the snp locus, the stable and unstable orbits annihilate, and in the region 000 the fixed point attracts trajectories originating beyond the homoclinic loop. In the region ¯100 there is a stable periodic orbit surrounding the unstable fixed point. To the left of the point DH, this orbit is formed as a result of a supercritical Hopf bifurcation, while to the right of this point it is just continuing from the region 200, being unaffected by the subcritical Hopf bifurcation annihilating the unstable orbit. The stable orbit opens up at the saddle-loop bifurcation, and in the region ¯000 all trajectories are deflected to a faraway attractor. The dynamics near the higher fixed point is similar, the only difference being that the fixed point is stable below the Hopf line. Both fixed points are attractors in the region 000, while in the regions ¯100 and 0¯10 either higher or lower fixed point is replaced as attractor by a surrounding stable orbit. The boundary between the attraction basins, formed by a highly convoluted stable manifold of the saddle point, cannot be well resolved in the weak dissipation approximation. Since all trajectories spiral down along the orbits of the corresponding conservative system, slowly approaching either an attractive orbit or a fixed point, the attraction basins are neatly rolled around each other, so 8
For the phase portraits in Fig. 1.4, the codes are 0 (1), ¯ 1 (2), ¯ 000 (3), ¯ 100 (4), 000 (5), 2 (6), ¯ 0¯ 01 (7), ¯ 011 (8), ¯ 001 (9), ¯ 002 (10), ¯ 200 (11), 100 (12).
50
1 Dynamics, Stability and Bifurcations
1 0.5 y
0 -0.5 -1 -1.5 -1.5
-1
-0.5
0 x
0.5
1
1.5
Fig. 1.9. An example of trajectories attracted to two alternative stable fixed points
that either higher or lower attractor might be reached starting from nearby points lying outside the homoclinic figure eight (Fig. 1.9). Next, the “large” orbits surrounding both fixed points have to be brought into picture. A stable “large” orbit exists to the right of the line formed by the segment of the line sl0 to the left of the point NSL (where the homoclinic orbit is stable) and the respective snp locus. This orbit opens on the sl0 line, while on the snp line it annihilates with an unstable orbit. The latter lies within the stable one but still outside the homoclinic loop and opens up on the unstable segment of the sl0 locus. To the left of the sl0 –snp line, all trajectories are attracted to the higher state in the region ¯ 000 and to the lower state in the region 0¯00; in the regions 100 and 010, outlying trajectories behave in the same way, but the trajectories lying within an unstable orbit spiral down to the nearby fixed point. In the region 000, both fixed points are attractors, as described above. When the snp line is crossed, the dynamics remains qualitatively the same within the emerging “large” unstable orbit, which now forms the basin boundary of the “old” attractors; outside this orbit, the trajectories are attracted to the “large” stable orbit. We observe that three attractors coexist in the regions 002, ¯102, and 0¯ 12, and two in the regions ¯002 and 0¯02. Following the breakdown of the unstable orbit at the unstable segment of the sl0 line, the attraction basins of the “large” orbit and the surviving stable fixed point become intertwined in the regions ¯ 001 and 0¯ 01, being separated by a convoluted stable manifold of the saddle point. The “large” orbit becomes the sole attractor only in the region ¯ 0¯ 01. If the parameter µ0 increases above the critical value µc = 2/33/2 , the phase portraits 000, ¯ 000, 0¯ 00 transform to 0, the portraits ¯100, 0¯10, ¯001, 0¯01, ¯ ¯ ¯ ¯ ¯ ¯ 001 to 1, and 002, 002, 011, 1¯01 to 2. Some of these transitions are seen in Fig. 1.10, presenting the parametric plane µ1 , µ0 at µ2 = 0, as well as in
1.5 Deterministic Chaos
51
0.5 0
2
1
0.4 000 002
Μ0
0.3 0.2
001 101 012 011 111
010 000
0.1
0.2
0.4
0.6
0.8 Μ1
1
001
1.2
1.4
Fig. 1.10. Loci of Hopf (solid lines), saddle-loop (dashed lines), and snp (gray line) bifurcations in the parametric plane µ1 , µ0 at µ2 = 0
Fig. 1.4. The saddle-node bifurcation is, however, impossible in the regions 100 and 010, and therefore they have to terminate in a cusp at a TB point on the sn locus. The sniper bifurcation line cannot appear in this diagram, since at δ 1 the stable fixed points are foci rather than nodes, unless in a close vicinity of the saddle-node locus. The latter’s intersection with the saddle-loop loci is not well resolved in the weakly dissipative approximation and depends on the ratio of two small parameters: δ and λ = µ0 − µc . Using this ratio as an additional parameter, one can resolve, e.g., the point in Fig. 1.4, where the 0¯ 01 region terminates on the sn locus, into a sniper bifurcation line.
1.5 Deterministic Chaos 1.5.1 Chaotic Attractors Chaos is a fascinating phenomenon that prompted scientists and philosophers in the last third of the 20th century to rethink fundamental questions of determinism, predictability, and randomness (see Introduction). It had always been a commonplace knowledge that complex phenomena, influenced by a great number of different factors, are unpredictable (at least, from a practical point of view) and are amenable to statistical methods only. Statistics gives, however, little consolation when one has to live through a single decisive event, as gamblers, market traders, and weather forecasters know too well. Predicting the future has been a preoccupation of people of different walks of life, from clairvoyants to investment bankers, using no less diverse methods. It was therefore a kind of cultural shock (at least for those who
52
1 Dynamics, Stability and Bifurcations (a)
(b)
1
1
0.8
0.8
0.6
0.6
0.4
0.4
0.2
0.2
0.2
0.4
0.6
0.8
1
0.2
0.4
0.6
0.8
1
Fig. 1.11. Triangular (a) and Bernoulli shift (b)maps. Thin lines show successive iterations
were able to comprehend it) that systems as simple as a three-variable ODE or even a single-variable discrete mapping could be capable of unpredictable – chaotic – behavior. As we have briefly noticed in Sect. 1.1.5, an attractor of a chaotic system covers a manifold of fractal dimension , and trajectories starting from neighboring points lying on the attractor diverge with time. This is the source of unpredictability: if initial conditions are measured or assigned with a finite precision, the uncertainty of the values of the dynamic variables grows with time in such a way that after a finite time interval, the system may be found in a vicinity of any point within the attractor. This would happen if the phase space is stretched locally in a certain direction in the course of evolution. The stretched volume can remain in a finite volume of the phase space if it folds upon itself. This is known as baker’s transformation: it is, indeed, exactly what the baker does with a piece of dough. In its simplest form, it is expressed by either of the one-dimensional (1D) maps in Fig. 1.11. In both of them, the unit interval is stretched twice over and the second part is mapped back on the same interval by either bending or cutting (i.e., either inverting or preserving its direction). If the position of a point on the unit interval is expressed as an infinite binary string, the leading digit 0 or 1 would mean, respectively, that it is located in either the first or the second half of the interval. Following the transformation, the second digit of the original string will classify the position; thus, the mapping in Fig. 1.11b is equivalent to removing the first digit and shifting the remaining sequence to the left (Bernoulli shift). It is clear that however close the two points be originally, they will eventually be separated and sent to the two alternative half-intervals: if the difference in the original positions
1.5 Deterministic Chaos
(a)
(b)
53
(d)
(e)
(c) (f)
Fig. 1.12. Smale horseshoe. See the text for explanations
was in nth digit, this will happen after nth iteration. The transformation in Fig. 1.11a will separate nearby points and effectively “mix” the 1D phase space in the same way. In both cases, the total length of the interval, i.e., the 1D phase volume, is conserved. When the system is dissipative, as most systems we are interested in are, the phase volume decreases with time. It may, however, stretch in a certain direction while shrinking in the others. Shrinking of the phase volume combined with local stretching leads to the formation of an attractor of fractal dimension . This mechanism is explained qualitatively by the Smale horseshoe map. The unit square (Fig. 1.12a) is stretched vertically and shrunk horizontally in such ratios that its total area decreases. It is folded and mapped back in such a way that the bended area remains outside the square (Fig. 1.12b). The part of the original square that is mapped back onto it following the transformations is restricted to two horizontal stripes (Fig. 1.12c), and its image is the two vertical stripes shown in Fig. 1.12b. The area that remains invariant following
54
1 Dynamics, Stability and Bifurcations
the transformation, i.e., is mapped upon itself, is confined to the four squares shown in Fig. 1.12d. Next iteration restricts the invariant area to the 16 small squares shown in Fig. 1.12e. Upon successive iterations, the invariant area shrinks further, all but fading from view in Fig. 1.12f, and turns eventually into a fractal object of zero 2D volume, parts of which, nevertheless, can be found in far-removed locations within the original unit square. The structure of the attractor, though topologically complex, is well defined, but predicting the location of the image of a certain point after a large number of iterations would require ever-increasing precision in defining the initial data. 1.5.2 Shilnikov Bifurcation Motion in the vicinity of a homoclinic orbit is particularly sensitive to perturbations when it slows down as it passes close to a saddle point. In a three-variable nonlinear dynamical system, a saddle point may have either a 1D stable and a 2D unstable manifold or the other way around. A particularly interesting case is when two eigenvalues are complex conjugate; then the fixed point is called a saddle-focus. Shilnikov (1965) showed that a horseshoe map and, consequently, a chaotic attractor can be generated by a threevariable nonlinear dynamical system when it has a homoclinic passing through a saddle-focus. If the complex pair of eigenvalues µ = γ ± iω has a positive real part γ, while the real eigenvalue λ is negative, a trajectory starting from the vicinity of the fixed point spirals out, as in Fig. 1.13a, but, lacking other attractors, eventually returns along the stable direction. If, on the opposite, γ > 0, while λ < 0, the same picture can be read in the opposite sense: the trajectory ejected along the stable direction returns and spirals in toward the fixed point. (a)
(b)
(c)
Fig. 1.13. (a) A typical trajectory close to the homoclinic. (b) Mapping of the shaded strip upon the top of the cylinder by flow with γ > 0, λ < 0, γ < |λ| and a typical trajectory in the vicinity of the fixed point. (c) Mapping of the shaded sector upon the rim of the cylinder by flow with γ < 0, λ > 0, λ < |γ|
1.5 Deterministic Chaos (a)
55
(b)
Fig. 1.14. Construction of a Smale horseshoe near the homoclinic. (a) Mapping of the shaded strip into the “Shilnikov snake.” (b) Mapping of the “snake” back upon the strip by global flow
Close to the fixed point, the dynamical system can be linearized. Suppose that the coordinate system spanning the 3D phase space has been transformed in such a way that the fixed point is placed at the origin, the eigenvector corresponding to the real eigenvalue is directed along the z-axis, and the 2D manifold spanned by the eigenvectors corresponding to the complex conjugate pair spans the plane z = 0, which we parametrize by the polar coordinates r, φ. Then, the trajectory of the linearized system can be presented as z = z0 eλ(t−t0 ) ,
r = r0 eγt ,
φ = φ0 + ωt,
(1.98)
where t0 , z0 , r0 , φ0 are integration constants. A typical trajectory close to the homoclinic looks as in Fig. 1.13b. Take a small cylinder 0 < ζ0 < z < z0 , 0 < r < r0 and consider the map of the line r = r0 , φ = 0, ζ0 < z < z0 upon the top of the cylinder z = z0 , r < r0 generated by flow with γ > 0, λ < 0. Then, t0 in (1.98) is recognized as the traversal time of a trajectory starting at the point r = r0 , ζ = z0 e−λt0 . Eliminating t0 , we see that the image in question is a logarithmic spiral: r = r0
z0 ζ
γ/λ ,
φ=
ω z0 ln , λ ζ
(1.99)
or, in a parametric form, r = r0 exp
γ φ , ω
0<φ<
ω z0 ln . λ ζ0
(1.100)
56
1 Dynamics, Stability and Bifurcations
The length of the spiral, as estimated by the total span of the angular variable, grows without limit as ζ0 → 0. The mapping of a narrow section of the rim of the cylinder (the shaded area in Fig. 1.13b) upon its top is a fattened spiral (“Shilnikov snake”) seen in the same figure. The mapping reduces the total area when γ < |λ|. Take now a small segment of the rim close to the entrance of the homoclinic trajectory into the vicinity of the fixed point. The “snake” image of this segment (Fig. 1.14a) is mapped back upon the area encircling the fixed point by global flow, as seen in Fig. 1.14b. Inasmuch as the global flow is nonsingular (e.g., similar to that in Fig. 1.13a), it rotates and extends or shrinks the image but does not affect its topology. The transformation by the global flow can be assumed to be linear, as long as the image is small. The points of the segment mapped back upon it by the combined transformation due to the flow near the fixed point and global flow lie within several strips seen in Fig. 1.14b. This invariant area is further cut, shrunk, and dispersed upon successive iterations, turning eventually into a fractal object of zero 2D volume. This is qualitatively similar to the Smale horseshoe mapping discussed in the preceding subsection and should result likewise in the formation of a fractal chaotic attractor. The essential difference is that the number of strips increases without limit as the lower edge of the segment comes closer to the entrance point of the homoclinic trajectory. Thus, an infinite number of horseshoes are formed in the course of an infinite series of bifurcations as the homoclinic orbit is approached. In the opposite case γ < 0, λ > 0, one can construct in a similar way the map of the line z = z0 , φ = 0, ρ0 < ρ < r0 upon the rim of the cylinder generated by flow going down toward the fixed point and spiraling out: λ/γ r0 ω r0 z = z0 (1.101) , φ = ln , ρ γ ρ or, in a parametric form, z = z0 exp
λ φ , ω
0<φ<
ω r0 ln . γ ρ0
(1.102)
The mapping is a helix, which again stretches without limit at ρ0 → 0. The mapping of the shaded sector in Fig. 1.13c upon the rim is a fattened helix, and the total area shrinks when λ < |γ|. The Smale horseshoe is constructed in this case in the same way as before. The Shilnikov bifurcation can be found in the unfolding (1.86) of the degenerate Hopf-monotonic bifurcation, but simpler ad hoc dynamical systems can reproduce it as well. A simple dissipative system that generates global flow returning trajectories into the vicinity of a saddle-focus was devised by R¨ossler (1976): x˙ = −y − z,
y˙ = x + µy, z˙ = ν + (x − λ)z. √ Two fixed points exist at |λ| > λc = 2 µν:
(1.103)
1.5 Deterministic Chaos (a)
(b) 5
y y
57
0
2
-5
0 -2 -4
15 6 z
z 10
4 2
5
0
0 -5
-2.5 0 x
0 2.5
x
5
5
10
Fig. 1.15. Attractors of the R¨ ossler system. (a) A period two orbit at µ = ν = 0.2, λ = 2.9. (b) Chaotic attractor at µ = ν = 0.2, λ = 5 ± ± x± s = −µys = µzs =
1 2
λ±
λ2 − 4µν
(1.104)
Under certain conditions, e.g., in the particular case µ = ν, both fixed points are unstable. The “upper” one (marked by the plus sign) has a 1D unstable and a 2D stable manifold and the “lower” one, the other way around. At sufficiently small µ, both are saddle-foci, and the real eigenvalue is larger by its absolute value than the real part of the complex pair. Thus, a nearly homoclinic orbit spiraling out of the lower fixed point and returning to it along its 1D stable manifold satisfies the conditions required to form Smale horseshoes. At |λ| λc , we have zs− 1, and the unstable manifold of the lower fixed point is close to the plane z = 0 where the flow is almost linear, so that the linearized equations used in the above proof also remain valid outside the immediate vicinity of a homoclinic. The R¨ossler model is not realistic; its trajectories escape to infinity from a larger fraction of the phase space but may be trapped in the region adjacent to the lower fixed point. A periodic orbit found in this region at appropriate values of parameters undergoes a series of period doubling bifurcations. An example of a period two orbit is shown in Fig. 1.15a. The bifurcation sequence results in an apparently chaotic orbit seen in Fig. 1.15b. 1.5.3 Period Doubling Cascade Straightforward integration of ODEs is ill-suited for studies of chaotic dynamics, since proper characterization of chaotic attractors and distinguishing them from periodic orbits with long periods or long transients requires exceedingly
58
1 Dynamics, Stability and Bifurcations (a)
(b)
2
y
10
0
-2 -4
8
-6 6
4 z
2 4
0 2
-2 0 x
2 4
2
4
6
8
10
Fig. 1.16. (a) Construction of a Poincar´e map. (b) The Poincar´e map of the R¨ ossler system at µ = ν = 0.2, λ = 5. The sign of the coordinates is inverted, and the added segment is shown by the dashed line
long integration times. A better way is to convert an ODE into a Poincar´e map, which presents the relation between successive intersection points (in the same direction) of the trajectories with a given surface, called Poincar´e section. The surface should be transversal everywhere to the flow generated by the ODE. When its position is properly chosen, a period n orbit will produce exactly n intersection points in a given direction (see Fig. 1.16a). The dimension of a Poincar´e map is one less than that of the corresponding dynamical system. In dissipative systems, stretching in a certain direction is, however, compensated by strong shrinking of the phase space in other directions, so that the phase volume tends to zero, as we have seen in the construction of the Smale horseshoe in the two preceding subsections. As a result, the Poincar´e map thins out, e.g., becomes almost 1D for a 3D continuous dynamical system. An example is shown in Fig. 1.16b, presenting the Poincar´e map generated by the chaotic R¨ossler attractor with the plane x = 0 used as the Poincar´e section. It is very close to a 1D map and, when supplemented by a segment connecting it to the origin, looks very much similar to a simple logistic map f (x) = µ x(1 − x). (1.105) xj+1 = f (xj ), At the maximum value of the parameter µ = 4, the logistic map acts in a way similar to the triangular map in Sect. 1.5.1 and satisfies the conditions for the formation of a Smale horseshoe. As the parameter µ increases, the route to chaos goes through a period doubling cascade (May, 1976). The first stages of the cascade are illustrated in Fig. 1.17. The logistic map has, besides the unstable trivial equilibrium, a single fixed point x = x0 , which is stable
1.5 Deterministic Chaos
59
(a) f x
f x 0.7 0.6
0.6 0.5
0.4
0.4 0.3 0.2
0.2
0.1 0.2
0.4
0.6
0.8
1
x
0.2
0.4
0.6
0.8
1
x
0.2
0.4
0.6
0.8
1
x
(b) f1 x
f1 x 0.8
0.6
0.6
0.4
0.4
0.2
0.2
0.2
0.4
0.6
0.8
1
x
(c)
(d)
f2 x
0.8 0.7 0.6
0.6 0.5 0.4
0.4 0.3 0.2
0.2
0.1
0.2
0.4
0.6
0.8
1
x
0.2
0.4
0.6
0.8
1
Fig. 1.17. (a) The logistic map before (µ = 2.8) and after (µ = 3.1) the period doubling bifurcation; gray lines show an iteration sequence. (b) The composite map f1 (x) before (µ = 3.1) and after (µ = 3.5) the repeated period doubling. (c) The composite map f2 (x) at µ = 3.5. (d) The rescaled central segment of f2 (x) at the third period doubling, compared to f (x) (gray line)
60
1 Dynamics, Stability and Bifurcations (a)
x 1 0.8 0.6 0.4 0.2
3.2
(b)
3.4
3.6
3.8
4
Μ
3.84
3.86
3.88
3.9
Μ
x
0.8 0.6 0.4 0.2
3.82
Fig. 1.18. Points on the attractor at different values of µ
as long as the slope f (x) is less than one by its absolute value. At µ = 3, a Hopf bifurcation takes place: above it, f (x0 ) < −1, so that the fixed point is unstable, and the system approaches a period two sequence, alternating between two values x = x± 1 upon each iteration (Fig. 1.17a). Both points are the stable fixed points of the composite map f1 (x) = f (f (x)), while x0 is an unstable fixed point of this map with f1 (x0 ) > 1 (Fig. 1.17b). As µ further grows, |f2 (x± 1 )| increases, and a new period doubling takes place at µ ≈ 3.4495. A period four orbit emerges at larger values of µ, where the four alternating values of x are stable fixed points of the composite map f2 (x) = f1 (f1 (x)) = f 4 (x) (Fig. 1.17c). This sequence of bifurcations continues ad infinitum. One of the stable n fixed points of the composite map fn (x) = f 2 (x) approaches the maximum of the logistic map at xm = 1/2 as n increases, and the form of the composite
1.5 Deterministic Chaos
61
map in the vicinity of this point becomes indistinguishable from the rescaled original logistic map. This similarity is apparent already in the map f2 (x), as seen in Fig. 1.17d , where the rescaled central segment of f2 (x) at the period eight bifurcation point µ ≈ 3.5441 is compared to f (x). On the basis of this self-similarity, Feigenbaum (1978) applied the renormalization group to prove universality of the period doubling sequence. Asymptotically at n → ∞, the period 2n bifurcation point approaches the accumulation point µ∞ = 3.5699456 . . . as µ∞ − µn ∼ δ −n , with the exponent δ = 4.6692016 . . .. The chaotic attractor emerges at µ = µ∞ . The attractor undergoes an infinite number of bifurcations beyond µ∞ . Figure 1.18a shows the points on the attractor at different values of µ up to the upper limit µ = 4. This picture still gives a little idea of the true complexity of behavior and can be enlarged to reveal finer structures at smaller scales. The sequence contains an infinite number of periodic “windows” and repeated cascades. A prominent feature is a rather wide period three window seen in the blow-up in Fig. 1.18b. The universality of the period doubling sequence explains its wide applicability to a variety of dynamical systems, which was confirmed in numerous experiments and simulations. As long as the map is continuous and has a maximum, its exact form is irrelevant, since only the vicinity of the maximum, which can always be approximated by a parabola, is relevant at late stages of the period doubling cascade. This is true, e.g., for the Poincar´e map of the R¨ossler model seen in Fig. 1.16b. The period doubling route to chaos, though frequently encountered, is in no way unique. A complicated system containing a number of parameters can enter the chaotic region in different ways along different parametric paths, e.g., proceeding first into the period three region. A still wider variety of routes to chaos is possible for discontinuous maps and ODEs that can be approximated by maps of this kind (see the next subsection). 1.5.4 Lorenz System Historically, the first example of chaos in a dissipative system was given by Lorenz (1963). The Lorenz system was originally derived as a qualitative model of thermal convection and included the amplitudes of just three modes in the Fourier expansion of equations of thermal convection: x˙ = σ(y − x),
y˙ = ρ x − y − x z,
z˙ = x y − β z.
(1.106)
At ρ = 1, the system undergoes a pitchfork bifurcation: the trivial equilibrium becomes unstable, and two stable symmetric nontrivial equilibria, xs = ys = ± β(ρ − 1), zs = ρ − 1, emerge. This models the situation when a quiescent convection cell becomes unstable; two nontrivial states correspond to two opposite directions of circulation, which are totally equivalent but exclusive. The trivial equilibrium at ρ > 1 is a saddle with a 1D unstable and 2D stable manifold. The nontrivial equilibria undergo a Hopf bifurcation at
62
1 Dynamics, Stability and Bifurcations
σ = 1 + β,
ρ=
σ(3 + σ + β) . σ−1−β
(1.107)
Beyond the Hopf bifurcation locus, the nontrivial fixed points are saddle-foci. We shall further fix the commonly adopted values β = 8/3, σ = 10 and follow the parametric evolution at increasing ρ. One expects dynamic behavior to be interesting in the parametric region where all equilibria are unstable. In fact, the dynamics becomes nontrivial even at lower values of ρ. A homoclinic orbit exists at ρ ≈ 13.9265. Below this value, trajectories going out of the trivial equilibrium along the unstable direction approach the closest nontrivial equilibrium. Above this point, the trajectories turn around and converge to the nontrivial equilibrium of the opposite sign, as shown in Fig. 1.19a. At larger values of ρ, trajectories starting from some initial conditions may wander around for a long time in an apparently chaotic manner and do not approach any equilibrium point for a considerably long time (see Fig. 1.19b), while starting from other initial conditions, trajectories start spiralling to an equilibrium point immediately. Above the Hopf bifurcation at ρ ≈ 24.7368, trajectories coming to the vicinity of nontrivial equilibria spiral out. The dynamics is chaotic, as trajectories switch erratically between circling either positive or negative stationary point. Being a meteorologist, Lorenz put forward the results of his numerical study of chaos in this apparently simple system as a proof of unpredictability of weather. His colleagues were not impressed, and the work (a)
b 20 y
10
10
y
0
0
-10 -20
-10 20
30 15
z 20
z 10
10
5 0 -10
0 -5
-10
0 x
0
5 10
x
10
Fig. 1.19. Trajectories of the Lorenz system at β = 8/3, σ = 10, and ρ = 14 (a) and ρ = 24 (b)
1.5 Deterministic Chaos (a)
63
b x
8
7.5
6 4
5
2 f x
2.5 0
100
200
300
400
500
n
-2
-2.5
-4
-5
-6
-7.5
-5
-2.5
0 x
2.5
5
7.5
-7.5
Fig. 1.20. (a) The Poincar´e map of the Lorenz system in the chaotic region (β = 8/3, σ = 10, ρ = 28). Gray line shows the approximate map (1.108). (b) A chaotic sequence generated by the map (1.108)
remained obscure for 15 years until studies of chaotic behavior came into fashion. Long-time chaotic behavior should be studied with the help of a Poincar´e map. An appropriate Poincar´e section is the plane z = zs = ρ − 1. As in the case of the R¨ossler model, the map turns out to be almost 1D. It is, however, very much different from both logistic and R¨ ossler map, as it has a discontinuity corresponding to the point where the orbit switches between the two parts of the attractor encircling the two alternative saddle-foci (Sparrow, 1982). The map shown in Fig. 1.20a has been made more compact by measuring the positions relative to the nearest equilibrium point; in this way, the segment |x| < |xs | where upwardly moving trajectories never cross the Poincar´e section is excluded. The map is well approximated by the function f (x) = x − [(γ n − xn )1/n − γ]sign x,
(1.108)
where, for the parameter values in Fig. 1.20, n = 4 and γ = 4.726. All computations can be carried out very efficiently with the help of the approximate map. One can compute very long sequences in this way, as the one in Fig. 1.20b, and study the statistics of the output. One can see, e.g., that the number of consecutive points in either part of the attractor, dependent on the proximity of the “injection point” to xs , forms a random sequence, and build up statistics of this sequence. The disadvantage of this approach is, of course, that one has to build up an approximate map anew for each combination of the parameters by integrating the original equations. Essential features of the dynamics of the Lorenz system can be demonstrated, however, with the help of a simple model map, much in
64
1 Dynamics, Stability and Bifurcations (a) 0.5 0.4 0.3 Γ
0
0.2 1
0.1
2T 2 1
0
2 Μ
4
3
(b) 0.8
x
0.6 0.4 0.2 0 1 1.5
2T 2
2 2.5 Μ
0 3
3.5
Fig. 1.21. (a) The bifurcation diagram of the map (1.109). (b) Evolution of the attractor along the line γ = 0.08. The number of fixed points on each half-interval is indicated in each parametric region
the same way as the dynamics of the R¨ossler model is imitated by the logistic map. A suitable map defined on the unit interval is the following discontinuous map antisymmetric relative to the point x = 1/2: at x < 12 γ − µx2 (1.109) f (x) = 2 1 − γ − µ(1 − x) at x > 12 . The number of fixed points in either half-interval is shown in Fig. 1.21a. On the boundary between the regions 0 and 2, γ = 14 µ−1 , µ > 1, a saddle-node bifurcation occurs, while on the other boundary, γ = 14 (2−µ), one of the fixed points touches the discontinuity. The parametric evolution of the attractor (for trajectories originating just above x = 1/2) at γ = 0.08 and changing values of µ is shown in Fig. 1.21b. This particular line γ = const passes through all four regions. Proceeding
1.5 Deterministic Chaos f x 1
65
f x 1
escape
0.8
0.8
0.6
0.6
0.4
0.4
0.2
0.2
0.2
0.4
0.6
0.8
1
x
0.2
0.4
(a)
0.6
0.8
1
x
100
n
(b) x
x
0.8
0.9 0.8
0.6 0.7
0.4
0.6 0.5
0.2 0.4 20
40
60
80
100
n
20
40
60
80
Fig. 1.22. Positions after successive iterations of the map (1.109) in the case of long chaotic transients (a) and intermittency (b)
along this line, the trajectories are consecutively attracted to the nearest fixed point (1), to a chaotic attractor of limited extent (2T), to the fixed point in the opposite half-interval (2), and to a chaotic attractor covering almost the entire unit interval (0). In region 1, a single fixed point found in each half-interval is always stable, and the trajectories converge to the nearest fixed point. When the second pair of fixed points appears (region 2), it is unstable. Under these conditions, convergence to the stable fixed point lying in another half-interval is possible, similar to the behavior of the Lorenz system following the homoclinic connection. A trajectory may be trapped in the region between the two unstable fixed points for a considerable time before escaping to the attraction region of one of the stable fixed points, as shown in Fig. 1.22a. The trapping of trajectories originating sufficiently close to the point x = 1/2 becomes permanent when the edge of the left segment of the map at f ( 12 − 0) goes below the unstable fixed point on the right segment, which happens at γ < 32 − 14 µ − 2µ−1 , 2 < µ < 3. In this region, denoted as 2T in Fig. 1.21, a chaotic attractor coexists with stable fixed points attracting
66
1 Dynamics, Stability and Bifurcations
trajectories originating farther from the point x = 1/2; the unstable fixed point marks the boundary between the two attraction basins. Finally, chaotic dynamics prevails in region 0, though narrow periodic windows may exist in this region. Near the border of the chaotic region, just after the saddle-node bifurcation, some trajectories may be trapped for a long time in the “shadow” of a former fixed point where dynamics slows down, even though the stable fixed point has already disappeared. The positions after successive iterations of the map are shown in Fig. 1.21b. This is known as the intermittency route to chaos (Manneville and Pomeau, 1979).
1.6 Dynamics of Planforms 1.6.1 Interaction of Turing Modes Space-independent amplitude equations describing regular patterns effectively turn underlying PDEs into dynamical systems for amplitudes of the constituent modes. The amplitude of a mode with k = 0, ω = 0 excited at a Turing bifurcation point, like the amplitude of a Hopf mode, is complex. In one dimension, the amplitude equation describing dynamics in the vicinity of the bifurcation point cannot contain quadratic terms and should have the same form as (1.70), with a substantial difference that its coefficients must be real. The inhomogeneous solution bifurcates supercritically, provided µ3 < 0; this coefficient can then be set by rescaling to −1. The bifurcation diagram for the real amplitude has the same form as in Fig. 1.2e: the attractor is the trivial state a = 0 at µ1 < 0 and a harmonic stationary pattern with the √ amplitude |a| = µ1 at µ1 > 0. The phase of a is arbitrary, and its shift leads just to shifting the pattern along the wave vector k. In the case when µ3 is positive but small, the expansion can be continued to the fifth order, yielding the bifurcation diagram seen in Fig. 1.2f. Symmetry breaking bifurcations in more than one dimension are degenerate due to spatial symmetries. In an isotropic system, an arbitrary number of differently directed modes with k = 0 can be excited beyond the bifurcation point. A combination of these modes can give a variety of distinct planforms. Competition among the modes that determines the pattern selection is governed by nonlinear interactions. The product of the amplitudes aj , ak , etc. (where the overline denotes the complex conjugate) may appear in the equation for the amplitude ai if the respective wave vectors add up to zero, ki + kj + kk + . . . = 0. This condition ensures that the modes in question are in resonance. Otherwise, the product of these modes rapidly oscillates and is averaged out when the amplitude equation is derived using the multiscale expansion procedure. Interaction coefficients between different modes can be computed similarly to the computation in Sects. 1.3.3 and 1.3.4. This formalism automatically
1.6 Dynamics of Planforms
67
chooses in each order of the expansion combinations of modes satisfying the resonances conditions. We start with a general RDS in the form (1.18). For simplicity, we shall fix, as in Sect. 1.3.4, the parameters p affecting homogeneous equilibria but vary only diffusivities entering the matrix D. This would usually suffice to locate a Turing bifurcation point where the Jacobi matrix J = fu − D0 k 2 has a zero eigenvalue for a certain value of the wavenumber k. We assume that this eigenvalue is nondegenerate and that all other bands of eigenvalues λ(k) lie entirely in the complex half-plane Re(λ) < 0, and present the diffusivity matrix as D = D 0 + D 1 + · · ·. The first-order equation u1 ≡ (fu + D0 ∇2 )u1 = 0 has a nontrivial spatially harmonic solution
u1 = U ai (t1 , t2 , . . .) eiki ·x + c.c. .
(1.110)
(1.111)
i
Here ai (t1 , t2 , . . .) is an arbitrary complex amplitude of the ith mode dependent on slower time scales tn , n > 0; all wave vectors ki have the same magnitude, |ki | = k, and U is the eigenvector of the matrix J = fu − D0 k 2 with the zero eigenvalue. The eigenvector of the transposed matrix J † is U † , and the normalization condition is U † · U = 1. The second-order equation is (fu + D 0 ∇2 )u2 = ∂1 u1 + k 2 D 1 u1 − 12 fuu [u1 , u1 ].
(1.112)
The first two (linear) terms on the r.h.s. contain the principal harmonics e±iki ·x , while the last (quadratic) term contains composite harmonics e±i(kj ±kk )·x . The solvability conditions of this equation are evaluated by taking the scalar product with the eigenvector U † , multiplying by e∓iki ·x and taking the spatial average. In one dimension, where a single symmetry-breaking mode exists, the contribution of the quadratic term vanishes, and the solv(1) ability condition just requires µ1 = U † · D 1 U to vanish, thereby freezing evolution on the time scale t1 . Restricting for the time being to one dimension, we set D 1 = 0 and compute the second-order function u2 by solving (1.112), which is now reduced to the form
(fu + D 0 ∇2 )u2 = − |a|2 + 12 a2 e2ikx + c.c. fuu [U , U ]. (1.113) The solution of this equation is
u2 = − |a|2 fu −1 + 12 a2 e2ikx (fu − 2D 0 k 2 )−1 + c.c. fuu [U , U ]. (1.114) The third-order equation is (fu +D 0 ∇2 )u3 = (∂2 −D 2 ∇2 )u1 −fuu [u1 , u2 ]− 16 fuuu [u1 , u1 , u1 ]. (1.115)
68
1 Dynamics, Stability and Bifurcations
Using here (1.111), (1.114) and collecting the terms in the inhomogeinity containing the principal harmonic eikx , we compute the solvability condition, which has the same form as (1.70) but contains real coefficients: (2)
(0)
∂2 a = µ1 a + µ3 |a|2 a,
µ1 = U † · D 2 U , (2)
(1.116) µ3 = 12 U † · fuuu [U , U , U ]
− U † · fuu U , fu −1 + 12 (fu − 2D 0 k 2 )−1 fuu [U , U ] . (0)
In higher dimensions, the solvability condition of the second-order equation is trivial only if the system is invariant to the sign change u → −u and, consequently, the quadratic terms vanish identically. In this case, u2 = 0, and the amplitude equations obtained in the third order are νij |aj |2 . (1.117) ∂2 ai = µai − νii |ai |2 ai − 2ai i=j
Here the interaction coefficients between all modes −νij are identical and are (0) equal to the first term of the expression for µ3 in (1.116), which should be negative for a supercritical bifurcation. The inversion symmetry never appears in realistic RDSs, while in other models that contain nonlinear differential terms and, possibly, vertical structure, the interaction coefficients are, generally, distinct. In an isotropic system, the coefficient νij depends only on the angle α between the two modes. A two-mode pattern is preferred if the mutual suppression of the waves directed at a certain angle is weaker than self-suppression. A single-mode striped pattern is preferred a priori, since, if the interactions do not depend on the angle at all, mutual suppression is stronger due to the combinatorial factor 2 in (1.117). If the interaction weakens with growing α, the minimum may be reached, by symmetry, at α = π/2. Then a square pattern comprising both modes will be selected, provided the minimum is sufficiently deep. In an unlikely case when a deep minimum is reached at a smaller angle9 , a combination of more than two modes will be preferable. It may also happen that the solvability condition of the second-order equation is satisfied in the absence of inversion symmetry, either “accidentally” at a certain codimension two manifold in the parametric space or due to some less obvious innate symmetry. The latter cancellation mechanism works in the classical problem of Rayleigh–B´enard convection in a fluid layer heated from below where the source of symmetry is conservation of energy and momentum by nonlinear terms in the commonly used Boussinesq approximation (Gershuni and Zhukhovitsky, 1976). In this case, u2 does not vanish, and solving the second-order equation is required for derivation of the amplitude equation. 9
This may happen when a weakly damped mode with a different wavelength is present.
1.6 Dynamics of Planforms
69
1.6.2 Resonant Planforms In a general asymmetric case, the quadratic nonlinearity in (1.113) contains a harmonic with the basic wavenumber k if the excited modes include a triplet with the wave vectors directed at the mutual angle 2π/3. Then, retaining first-order deviations in (1.113), and collecting resonant terms, we write the solvability condition of this equation as (1)
(0)
∂2 aj = µ1 aj + µ2 aj−1 aj+1 ,
(1.118)
where µ2 = −U † · fuu [U j , U j ] and aj±1 are amplitudes of the modes with the wave vectors kj±1 turned by ±2π/3 relative to the wave vector of the jth mode. Presenting the complex amplitudes in the polar form aj = ρj exp(iθj ) and separating the real and imaginary parts reduces three complex equations (1.118) to four real equations, since the phases appear only in the combination Θ= θj : (0)
(1)
(0)
ρ˙ j = µ1 ρj + µ2 ρj−1 ρj+1 cos Θ, (0) Θ˙ = −µ2 sin Θ
3 ρj−1 ρj+1 j=1
ρj
,
(1.119) (1.120)
where the time derivative is denoted by the dot and the amplitudes aj are numbered modulo three. The remaining two phase degrees of freedom are translational Goldstone modes, since shifting phases in an arbitrary way while keeping their sum constant is equivalent to shifting the entire pattern in the plane. The total phase Θ is, however, dynamically important, since it determines the action of the quadratic term in (1.119). According to (1.120), Θ (0) relaxes to zero when µ2 > 0, thereby rendering the quadratic term desta(0) bilizing. If, on the opposite, µ2 < 0, the stable equilibrium is Θ = π, and the term is destabilizing again! This is why the hexagonal pattern comprising three resonant modes always bifurcates subcritically, and why the hexagonal planform is ubiquitous in 2D pattern-forming systems (Palm, 1960). Since quadratic terms are always destabilizing, cubic terms are necessary to obtain a stable finite-amplitude solution. In order to obtain a cubic ampli(0) tude equation with balanced orders of magnitudes, the coefficient µ2 should be assumed small. Generically, this requires restricting the system parameters to the vicinity of a codimension two manifold in the parametric space. Deviations of diffusivities should be again reduced to O(2 ), and the evolution on the O(−1 ) time scale frozen, as in the preceding subsection. Solving the second-order equation (1.113) then gives the function√u2 containing composite harmonics e±i(kj ±kj±1 )·x with the wavenumbers 3k and 2k, as well as a constant term and terms proportional to e±ikj ·x V , where V is a vector normal to U , i.e., satisfying U † · V = 0. All these terms are fed into the
70
1 Dynamics, Stability and Bifurcations
third-order equation, which yields as its solvability condition the system of amplitude equations. We shall write this system in a rescaled form
(1.121) a˙ j = aj µ − |aj |2 − ν |aj−1 |2 + |aj+1 |2 + aj−1 aj+1 . The three amplitudes aj are again numbered modulo three; the coefficient at the quadratic term and the cubic self-interaction coefficient have been normalized, respectively, to unity and −1 by choosing the time and amplitude scales. If the former was negative in the unscaled equations, the sign can be reversed by shifting all phases by π/3. Self-interaction is assumed to be suppressing; otherwise, expansion to higher orders would be needed. The polar form of (1.121) is
(1.122) ρ˙ j = ρj µ − ρ2j − ν ρ2j−1 + ρ2j+1 + ρj−1 ρj+1 cos Θ, Θ˙ = − sin Θ
3 ρj−1 ρj+1 j=1
ρj
.
(1.123)
The stationary amplitude of the hexagonal pattern can be computed after setting Θ = 0, ρj = idem = ρ by solving the equation µ + ρ − (1 + 2ν)ρ2 = 0. The solution is ρ=
1+
(1.124)
1 + 4µ(1 + 2ν) . 2(1 + 2ν)
(1.125)
It exists at µ ≥ −[4(1 + 2ν)]−1 (encroaching on the subcritical region µ < 0) and is stable at µ < (ν + 2)/(ν − 1)2 . A single-mode (striped) pattern ρ1 = √ µ, ρ2 = ρ3 = 0 is also a solution of (1.119) in the supercritical region µ > 0 and is stable at ν > 1, µ > (ν − 1)−2 . The dependence of both solutions on µ is shown in Fig. 1.23. Both patterns have been observed in experiments with pattern-forming chemical reactions (Fig. 1.24). Equation (1.121) has a gradient structure a˙ j = −∂V /∂aj
(1.126)
with the potential V =
3 j=1
−µ|aj |2 + 12 |aj |4 + ν |aj |2 |ak |2 − a1 a2 a3 − a1 a2 a3 .
(1.127)
j=k
This representation is most transparent, since every term can be associated with a triangle or rhombus formed by the respective wave vectors. It can be easily extended to higher dimensions, as we shall see below. One can use (1.127) to compare the energy of different solutions: the trivial one (all aj = 0), a single-mode (striped) pattern, and the hexagonal pattern |aj | = idem = 0. Stability regions of these solutions overlap, as shown in Fig. 1.23.
1.6 Dynamics of Planforms
Ρ 3
71
Ρ 0.25
2.5 0.1 2 -0.05
0.05
Μ
striped
1.5 1 hexagonal 0.5 1
2
3
4
5
Μ
Fig. 1.23. Nontrivial solutions of (1.122): dependence of the real amplitude of the striped and hexagonal patterns on the bifurcation parameter µ for ν = 2. Stable solutions are shown by thick lines and unstable solutions are shown by thin lines. The inset shows a blow-up near the origin
The general interaction potential also valid in higher dimensions is V = −µ
N
|aj |2 −
ai aj ak +
νijkl ai aj ak al + · · ·
(1.128)
j=1
= −µ
N
ρ2j −
ρi ρj ρk cos Θijk +
νijkl ρi ρj ρk ρl cos Θijkl + · · · ,
j=1
where the summation is carried out over all closed polygons formed by the wave vectors of extant modes, and Θijk = θi +θj +θk , Θijkl are sums of phases around the respective triangles or rhombi. This expression may also include resonant quartic terms combining the wave vectors forming nonplanar rhombi. The dynamic equations for aj follow from the gradient principle (1.126). All cubic terms in (1.128) are based on identical equilateral triangles, which may differ only by orientation; they are therefore universal and all come with the same coefficient that can be taken as unity. The cubic terms are phasedependent, and the potential is at minimum when the sum of the phases of modes forming an equilateral triangle is zero (modulo 2π). When phases adjust in this way, the triplet interactions are destabilizing; this is why symmetrybreaking transitions leading to the formation of stationary patterns are always subcritical and of the first order. The emerging pattern is stabilized by quartic terms, which depend on angles between interacting modes and are specific for particular systems. The quartic terms are phase-dependent only when the rhombus formed by the respective wave vectors is nonplanar.
72
1 Dynamics, Stability and Bifurcations
Fig. 1.24. Striped and hexagonal patterns in the Belousov–Zhabotinsky reaction (Ouyang and Swinney, 1991, reproduced with permission). In the hexagonal patterns in the upper row, the total phase Θ differs by π. The distorted pattern in the lower right picture represents a state intermediate between hexagons and stripes
In three dimensions, triplet interactions favor a combination of modes forming one of regular polyhedra with triangular faces – tetrahedron, octahedron, or icosahedron (Alexander and McTague, 1978). The former two correspond to the same body-centered cubic crystalline lattice, and the latter correspond to a quasicrystalline structure. One could expect that these structures are likely to have the lowest energy close to the bifurcation point, especially in the subcritical region, in the same way as the hexagonal structure is preferable in two dimensions. Since the pattern boosted by the resonant terms can be stabilized only by nonuniversal higher-order interactions, other structures can be actually chosen by the evolving system, and both experiment and numerical simulations show that the face-centered cubic structure is usually favored (Groh and Mulder, 1999). The special character of the icosahedral combination of modes is apparently responsible for the formation of quasicrystals with pentagonal symmetry (Shechtman et al., 1984), which was once seen as a sensational discovery contradicting the dogma of classical crystallography. Quasicrystalline structures in D dimensions can be, generally, formed by a combination of D + 2 or more modes. In two dimensions, a most likely
1.6 Dynamics of Planforms
73
40
20
0
-20
-40 -40
-20
0
20
40
Fig. 1.25. Two resonant triangles and the respective dodecagonal quasicrystalline pattern
(but still exotic) possibility is a “dodecagonal” pattern formed by a combination of two resonant triangles turned by π/6 relative to each other (Malomed et al., 1989). A piece of such a six-mode pattern, comprising almost symmetric dodecagonal and pentagonal “flowers” but never repeating itself, is shown in Fig. 1.25. Fixing two phase relations to satisfy resonance conditions in the two resonant triangles still leaves four phase degrees of freedom. Thus, in addition to the two translational modes, there are two Goldstone “phasons” modifying the pattern in a nontrivial way. Quasicrystalline structure may be lost when some constituent modes are suppressed by higher-order interactions. Various transitions among possible patterns (one-mode striped, two-mode squared, three-mode hexagonal, and six-mode dodecagonal) in the six-mode system of amplitude equations, dependent on the angular dependence of stabilizing quartic interactions, were studied by Echebarria and Riecke (2001). Resonant interactions enhancing a triplet of modes forming an equilateral triangle may also become possible in the presence of inversion symmetry due to interaction with a homogeneous mode (Price, 1994; Hilali et al., 1995). If a homogeneous mode with the amplitude a0 is included, (1.121) is replaced by an enlarged equation system
74
1 Dynamics, Stability and Bifurcations
a˙ j = aj µ − |aj |2 − ν0 a20 − ν |aj−1 |2 + |aj+1 |2 + a0 aj−1 aj+1 , 3 |aj |2 + σ(a1 a2 a3 + a1 a2 a3 ). (1.129) a˙ 0 = a0 µ0 − β0 a20 − β j=1
This system has no gradient structure, unless β = ν0 , σ = 1, which would be assured automatically only when the underlying system has a gradient structure. The polar form of (1.129) is
(1.130) ρ˙ j = ρj µ − ρ2j − ν0 a20 − ν ρ2j−1 + ρ2j+1 + a0 ρj−1 ρj+1 cos Θ, 3 ρ2j + 2σρ1 ρ2 ρ3 cos Θ, (1.131) a˙ 0 = a0 µ0 − β0 a20 − β j=1
Θ˙ = −a0 sin Θ
3 j=1
ρj−1 ρj+1 . ρj
(1.132)
The equation for the sum of phases Θ = θj is very similar to (1.120) but now Θ may relax to either 0 or π, depending on whether a0 is positive or negative. In view of the symmetry to simultaneous inversion of the sign of a0 and the phase shift by π, both possibilities are totally equivalent. Thus, the system can relax to two alternative stationary states, which correspond to “up” and “down” hexagonal patterns with either maxima or minima forming a triangular grid, as in the two upper panels of Fig. 1.24. An interesting possibility arises at σ < 0 when both states, a0 > 0, Θ = 0, and a0 > 0, Θ = π, may be unstable, and the attractor is a heteroclinic orbit passing through these states. Chaotic behavior is likely to be observed when this orbit is weakly perturbed. 1.6.3 Degenerate Wave Modes In wave patterns emerging when modes with both k and ω differing from zero are excited beyond the bifurcation point, the degeneracy is possible already in one dimension. The two symmetric forms correspond to waves propagating in the opposite directions. If a± are the complex amplitudes of the two waveforms, ei(kx±ωt) , two symmetric amplitude equations are derived similarly to Sects. 1.3.4 and 1.6.1. As in the case of the Hopf bifurcation, the solvability condition of the second-order equation is satisfied automatically. Evolution equations on an O(−2 ) time scale T are obtained as solvability conditions of the third-order equation. They are similar to the form (1.117) derived for coupled Turing modes in the presence of inversion symmetry but contain complex coefficients: (1.133) a˙ ± = a± µ − ν+ |a± |2 − ν− |a∓ |2 .
1.6 Dynamics of Planforms
75
These equations, like (1.70), do not have gradient structure. The nontrivial stationary solutions that exist at Re(µ) > 0 have the form a± = ρ± eiΩT . As in the case of a single equation, the imaginary parts of all coefficients do not affect the real amplitudes ρ± and influence only the phase shift. If Re(ν+ ) < Re(ν− ), the stable solution is a single propagating wave, coinciding with the respective solution of (1.70). Otherwise, the stable solution is a± = idem = [Re(µ)/Re(ν+ + ν− )]1/2 , which corresponds to a standing wave. One can expect the dynamic equations to have a similar structure also in two dimensions, since triplet interactions of waveforms with (ω = 0) are forbidden. Indeed, the resonance condition now requires, besides vanishing sum of kj , that the sum of ωj also vanish for the waves forming a resonant triangle. Since all ωj are equal, this is evidently impossible, and the lowestorder nonlinear terms appearing in the amplitude equation are cubic. These terms can be, however, resonant when they involve interaction of pairs of ± waves propagating in the opposite directions. Let a± 1 , a2 be the amplitudes of the four waves with identical ω and k propagating in the opposite directions along, respectively, the x-axis and the y-axis. Then, the amplitude equation of a+ 1 is
+2 + + 2 − 2 − 2 + − + γa− a˙ + 1 = a1 µ − ν+ |a1 | − ν− |a1 | − β |a2 | + |a2 | 1 a2 a2 . (1.134) Other three equations are symmetrical. One can check that both wave vectors and frequencies add up to zero along the rectangle formed by all four modes that corresponds to the last term. This term is resonant, being dependent on the combination of phases Θ = θ1+ + θ1− − θ2+ − θ2− (Pismen, 1986; Hoyle, 1994). Only standing waves are enhanced by the resonant interactions that impede their decay into single propagating waves. Further on, we concentrate therefore on standing wave solutions with equal real amplitudes of the counterpropagating waves ρj = |a± j |. After transforming to the polar form, the realpart of (1.134) takes the form ρ˙ 1 = ρ1 µr − νr ρ21 − 2βr − Re γ e−iΘ ρ22 , ρ˙ 2 = ρ2 µr − νr ρ22 − 2βr − Re γ eiΘ ρ21 , (1.135) where ν = ν+ + ν− and the complex coefficients are presented as ν = νr + iνi , etc. These equations can be rearranged by transforming to new variables p = ρ21 − ρ22 , q = ρ21 + ρ22 : q˙ = 2µr q − νr (q 2 + p2 ) − (2βr − γr cos Θ) (q 2 − p2 ), p˙ = 2µr p − 2νr pq − γi sin Θ(q 2 − p2 ).
(1.136)
The imaginary part of the polar form of (1.134) gives the equation of Θ: Θ˙ = −2γr q sin Θ − 2(νi − 2βi − γi cos Θ)p.
(1.137)
76
1 Dynamics, Stability and Bifurcations (a)
(b)
Γi 2
0.8 q p
0.6 0.4
1.5
Π
0.2 0
1
-0.2
0.5
-0.4
0.5
1
1.5
2
Γr
-0.6 t
Fig. 1.26. (a) Stability regions of the synphase square pattern (hatched ) and a single standing wave (shaded ) in the complex plane γ. (b) Oscillations at γr = 0.4, γi = 2. Other parameters: µ = ν = β = 1
Two easily computable stationary solutions of (1.136), (1.137) are synphase and antiphase locked states, which exist in the supercritical region µr > 0: p = 0,
cos Θ = ±1,
q=
2µr . νr + 2βr ∓ γr
(1.138)
Another solution is q = µr /νr , p = ±q, which corresponds to a single standing wave; the phase Θ is indefinite in this case, since the resonance is switched off. To be definite, we further assume γr > 0, since changing the sign of this coefficient just interchanges both solutions. The real part of other interaction coefficients should be positive in a standard case when cubic interactions are stabilizing. Moreover, we restrict to conditions when one of the two standing waves would be suppressed in the absence of resonance and require νr < 2βr . The square standing wave pattern is then stabilized in the synphase configuration, provided γr > βr −νr /2. The stability condition for a single-mode pattern is |γ| < 2βr . The bifurcations at both stability limits are of the Hopf type. A typical configuration of stability regions in the complex plane γ is shown in Fig. 1.26a. In the overlap area, where both single-wave and synphase patterns are stable, both bifurcations should be subcritical; the unstable periodic orbit emerging at both points lies on a surface separating the attraction basins of both states. On the opposite, if the Hopf bifurcation takes place in a parametric domain where the alternative state is unstable, it should be supercritical. A stable periodic orbit emerging under these conditions corresponds to a “twinkling” square wave pattern with the amplitudes of both waves oscillating on the long time scale of (1.134), as shown in Fig. 1.26b. For γr = 0, the attractor is a heteroclinic orbit connecting the fixed points q = 1, p = ±1, Θ = ±π/2.
1.6 Dynamics of Planforms
77
1.6.4 Biscale Resonances Other resonant structures may appear “accidentally” at degenerate bifurcations of a higher codimension when planforms with different wavenumbers k are excited simultaneously. This can be achieved in a most natural way in two-layer systems where the wavelength of the excited pattern depends on the thickness of each layer, as in convection (Proctor and Jones, 1988), or different diffusivities, as in a pattern-forming chemical system (Yang et al., 2002). More possibilities arise in nonlinear optics where spatial symmetry breaking may occur on different wavelengths at rather close values of a control parameter (Pampaloni et al., 1997; Pismen and Rubinstein, 1999b). The resulting coupled amplitude equations can generate a variety of composite planforms. Various “superposition” patterns with nonresonant wave vectors of different magnitude may be quite picturesque (Yang et al., 2002), but the amplitude dynamics can be nontrivial only when the excited modes are in resonance. A resonant triangle may include either three Turing modes or one Turing and two wave modes with ω = 0. In one dimension, the strongest resonance, appearing already in the second order of the bifurcation expansion, exists when the two wavelengths are in the 2:1 ratio, with the wave modes, if they are present, being the shorter ones. Taking into account the necessity to fit the wavenumbers at two degenerate bifurcations to ensure resonance, the codimension of the bifurcation manifold rises to three. In two dimensions, no rigid fitting of wavenumbers is required, since the resonant modes can form an isosceles triangle, as shown in Fig. 1.27a. When both excited modes are of Turing type, proliferation of resonances on equilateral triangles could make, however, the picture quite √ messy. An exceptional case, also requiring exact fit of wavenumbers, is 3:1 resonance. Two reso√ nant triplets with the wavenumber ratio 3 form three additional resonant triangles when the wave vectors of the two triplets are turned at π/6 relative to each other (Fig. 1.27b). Two relations connecting the phases of each triplet are fixed by resonance conditions around the two equilateral triangles. The three isosceles triangles give three more relations, only two of which are independent, leaving two translational degrees of freedom. Depending on the sign of the interaction coefficients, the phases around each resonant triangle should sum up to either 0 or π (modulo 2π). For each case, there are several combinations of phases satisfying these conditions, and there is a possibility that, due to mutual frustration, runaway to infinity may be prevented even without suppression by higher-order interactions. Superposition of all resonant modes yields a superlattice pattern, such as the one shown in Fig. 1.27c. Resonant interaction coefficients can be computed starting from a general RDS in the same manner as described in Sect. 1.6.1. Let U j be eigenvectors of the two excited modes satisfying (fu − D0 kj2 )U j = 0, j = 0, 1. A resonant isosceles all-Turing triangle containing two modes with the wavenumber k1 and amplitudes a± and a mode with the wavenumber k0 and amplitude a0 contributes to the second-order equation of a+ and a− the terms, respectively,
78
1 Dynamics, Stability and Bifurcations (c) (a)
k
20
k 10
k0 (b)
0
-10
-20 -20
-10
0
10
20
Fig. 1.27. (a) A resonant isosceles triangle. (b) Resonant triangles formed by two √ triplets of modes with the scale ratio 3. (c) The respective hexagonal superlattice
ν1 a0 a− and ν1 a0 a+ with the coefficient ν1 = −2U †1 · fuu [U 1 , U 0 ] and to the equation of a0 the term ν0 a+ a− with the coefficient ν0 = −2U †0 · fuu [U 1 , U 1 ]. Generally, all interaction coefficients are distinct, and, unlike generic Turing bifurcation, the system does not have gradient structure, which would exist only in a special case ν1 = ν0 . For a triangle formed by one Turing and two wave modes, the interaction coefficient ν1 entering the equations of wave modes is complex, while the interaction coefficient entering the equation of Turing modes ν0 = −2U †0 · fuu [U 1 , U 1 ] is real. Because of the absence of gradient structure, persistent nonstationary behavior is possible even in the case of all-Turing degeneracy but is most pronounced when wave–Turing resonance is realized. As an example, we shall consider the simplest wave–Turing resonant structure including two wave modes a± eik± ·x−ωt with |k± | = idem, and a Turing mode a0 eik0 ·x , with the wave vectors satisfying the resonance condition k+ − k− + k0 = 0, as shown in Fig. 1.27a. Under these conditions, the amplitudes may remain finite even when higher-order damping interactions are switched off (Pismen and Rubinstein, 1999b). The general form of the lowest order amplitude equations is
1.6 Dynamics of Planforms
79
a˙ 0 = µ0 a0 + ν0 a− a+ , a˙ + = µ1 a+ + ν1 a− a0 , a˙ − = µ1 a− + ν1 a+ a0 .
(1.139)
where µ0 < 0 and ν0 are real, while µ1 and ν1 are complex. Since the imaginary part of µ1 can be absorbed in frequency, this parameter will also be viewed as real, while ν1 will be presented in a polar form ν1 = ν eiα . Using the polar representation of the complex amplitudes, a0 = ρ0 eiθ0 , a± = ρ± eiθ± , (1.139) can be reduced to a system of four real equations including a single phase combination Θ = θ0 + θ+ − θ− . Three out of five real parameters of this system can be eliminated by rescaling the amplitudes and time. To be definite, we assume ν0 > 0; changing the sign of this parameter can be compensated by turning the composite phase Θ by π. Clearly, the amplitude of the Turing mode can be finite only in the subcritical region, µ0 < 0. Using √ |µ0 |−1 as a time scale, |µ0 |/ν as a scale of ρ0 , and |µ0 |/ νν0 as a scale of ρ± , we transform (1.139) to a polar form containing just two parameters µ = µ1 /|µ0 | and α: ρ˙ ± = µρ± + ρ∓ ρ0 cos(Θ ∓ α), (1.140) ρ˙ 0 = −ρ0 + ρ+ ρ− cos Θ, ρ ρ ρ ρ− + − + Θ˙ = − sin Θ − ρ0 sin(Θ + α) + sin(Θ − α) . (1.141) ρ0 ρ− ρ+ The stationary values of the amplitudes ρ0 , ρ± obtained by resolving (1.140) are 1/2 |µ| µ , ρ = − . ρ0 = ± 1/2 cos(Θ ± α) cos Θ [cos(Θ − α) cos(Θ + α)] (1.142) The composite phase Θ should be such that the above expressions be real. Plugging (1.142) in (1.141) brings the equation defining stationary values of Θ to the form sin(Θ − α) sin(Θ + α) + tan Θ + |µ| = 0. (1.143) | cos(Θ + α)| | cos(Θ − α)| A simple solution of this equation ensuring a positive value of ρ0 is Θ = 0, and the condition required to keep ρ± in (1.142) real is either µ < 0, α < π/2, or µ > 0, α > π/2. This defines a symmetric solution with equal amplitudes of the wave modes: µ (1.144) Θ = 0, ρ0 = ρ2± = . cos α The symmetric solution merges at µ = 0 with the trivial solution ρ0 = ρ± = 0. The eigenvalues of (1.140), (1.141) linearized near this solution are
1 1 (1.145) −1 ± 1 − 8µ , 4µ − 1 ± 1 − 16µ2 tan2 α . 2 2
80
1 Dynamics, Stability and Bifurcations
The first pair of eigenvalues is always negative at µ > 0, while the second pair defines the stability conditions π 3π <α< . 2 4
1 1 cos2 α < µ < , 2 4
(1.146)
A supercritical secondary Hopf bifurcation takes place on the branch of symmetric solutions at µ = 1/4, while a pitchfork bifurcation to a pair of asymmetric solutions occurs at 2µ = cos2 α. The latter is also supercritical at µ < 1/4. For cos(Θ ± α) having the same sign, (1.143) reduces to tan Θ −
|µ| sin 2Θ = 0. cos(Θ − α) cos(Θ + α)
(1.147)
A nontrivial root of this equation leads to an asymmetric solution that exists at 2µ < cos2 α: (a)
(b) Μ 1
Μ 0.25
0.8
0.2 0.15
Ρ
0.6
S
0.1
0.4
0.05
0.2
A
Ρ0 Α Π 0.05 0.1 0.15 0.2 0.25
Α Π 0.55 0.6 0.65 0.7 0.75
(c)
(d) 1.6 1.4 1.2
1
Ρ
Ρ
1.2
0.8
1 0.8 0.6
0.6 t
t
Fig. 1.28. Dynamics near the wave–Turing resonance. (a) Stability regions of the symmetric (S) and asymmetric (A) solutions. Solid line denotes the pitchfork and dashed lines denote the Hopf bifurcations. (b) Dependence of amplitudes on µ for α = 0.6π. (c) Oscillations of ρ± (solid lines) and ρ0 (dashed line) at α = 0.65π and µ = 0.27. (d) The same for µ = 0.28, showing loss of symmetry between the two wave modes
1.6 Dynamics of Planforms
µ (1 − 2µ) sin2 α 2 , ρ0 = √ , cos Θ = 1 − 2µ 2 sin α
−1/2 µ(1 − 2µ) . ρ± = cos α ± cos2 α − 2µ sin α
81
(1.148)
The two asymmetric solutions are transformed one to the other by switching the sign of Θ and interchanging the amplitudes of the wave modes. At still lower values of µ, the asymmetric solutions undergo a supercritical Hopf bifurcation. The bifurcation locus in the plane (α, µ) is given implicitly by the relation − (1 − 4µ)(1 − 5µ + 8µ2 ) sin4 α + 3(4 − 7µ + 4µ2 )(cos2 α − 2µ)2 + [3 − 8µ(2 − µ)(1 − 2µ)] (cos2 α − 2µ) sin2 α = 0. (1.149) The resulting bifurcation diagram in the plane µ, α is presented in Fig. 1.28a and an example of solution branches is shown in Fig. 1.28b. Above the Hopf bifurcation at µ = 1/4, the amplitudes ρ± oscillate out of phase (Fig. 1.28c), and the symmetry between the two wave modes is lost as µ is further increased (Fig. 1.28d). The amplitude of oscillations grows without limit as µ is further increased; runaway occurs as well when α draws closer to π. Confinement to the small-amplitude region by quadratic interactions is possible only when the Turing mode is subcritical and the wave mode is supercritical but not too strongly. When runaway to large amplitudes is observed, the actual pattern may be stabilized by nonresonant higher-order interactions.
2 Fronts and Interfaces
2.1 Planar Fronts 2.1.1 Space-Dependent Amplitude Equations If the amplitude is allowed to vary in space, a diffusional term is added to the respective amplitude equation. For a bifurcation at zero eigenvalue in a general RDS, spatial dependence can be incorporated in the formal expansion of Sect. 1.3.2 by scaling the spatial derivatives as ∇ = O((n−1)/2 ) when the expansion proceeds to the nth order. Starting from a general RDS (1.18), one obtains then the term D∇2 a with the amplitude diffusivity D = U † · DU added to the solvability condition in the respective order, yielding a single (scalar ) diffusion equation with a polynomial nonlinearity of degree n. We shall write this equation in a general form ∂t u = D∇2 u + f (u),
(2.1)
where the function f (u) has two or more zeroes that correspond to either stable or unstable homogeneous stationary states (HSS). This function may depend on a number of parameters modifying its shape. In particular, a cubic equation obtained at the cusp singularity (n = 3) can be seen as the simplest model describing coexistence and competition of alternative stationary states. The √ diffusivity D can be removed by rescaling the coordinates x → lx, where l = Dτ is the characteristic scale of spatial inhomogeneities in the system u) for and τ is a characteristic time scale, which can be chosen as τ −1 = f ( some nominal u = u . We shall further recognize l as the characteristic width of a front separating alternative states. Equation (2.1) can also model, of course, an actual physical system when a single variable or “order parameter” is sufficient for its description. It belongs to a wide class of equations of gradient dynamics (Sect. 1.1.3) and is derivable from the “energy” functional F = L dx, L = V (u) + 12 D|∇u|2 . (2.2) ut = −δF/δu,
84
2 Fronts and Interfaces (a)
(b) fu
Vu
u
u
Fig. 2.1. A function f (u) with three zeros (a) and the respective double-well potential (b)
In thermodynamic models the functional F is identified with free energy decreasing in the course of evolution to equilibrium. The first term in the La grangian L is potential energy V (u) = − f (u)du; the second term is distortion energy taking into account the “costs” of the gradients of the order parameter. The coefficient D is called in this context rigidity rather than diffusivity. In nonequilibrium systems, the energy functional lacks direct physical interpretation, but can be defined formally as stated above. It is remarkable that gradient structure emerges near a bifurcation point even when it is not present in the underlying system, such as a general RDS (1.18), which cannot be assigned an energy functional unless the functions fi = −∂V /∂ui are derivable from a potential V (u). In this and next sections, we shall consider fronts between two HSS which are both stable to infinitesimal perturbations and correspond to two alternative minima of the potential V (u). A typical suitable function f (u) sketched in Fig. 2.1a has three zeros, two of which, u = u± s (with ∂f /∂u < 0), correspond to stable HSS and the middle one, u = u0s (with ∂f /∂u > 0) to an unstable state. The respective double-well potential is shown in Fig. 2.1b. The position and depth of the minima can be regulated by shifting some parameter of the model. Suppose that two stable HSS with different energy are approached in spatially removed parts of an extended system. The boundary between them, also called a front or a kink , is a narrow region of a characteristic width l where the dependent variable changes between the two alternative values u = u± s . The state with a higher energy is metastable, and the overall energy of the system will decrease when the boundary between the alternative states propagates in such a way that the area occupied by this state decreases. Since both HSS are attractors, small perturbations of u± s tend to decay. This serves as a localization mechanism, which ensures that the front would retain its stationary form as it propagates. We shall see that the front separating two stable HSS can be characterized by a unique propagation speed. The situation is different when the retreating state is unstable; this case will be considered in Sect. 2.3.
2.1 Planar Fronts
85
2.1.2 Propagating Front as a Heteroclinic Trajectory Consider the front propagation in one dimension or, equivalently, propagation of a straight-line front in 2D or a planar front in 3D along the normal direction z. Assuming that the propagation is stationary, (2.1) can be rewritten in the comoving frame propagating with the front velocity c, as yet unknown. By convention, c is positive when the down-state advances. The steadily propagating solution depends on a single coordinate x = z − ct, and (2.1) reduces to an ordinary differential equation cu (x) + Du (x) + f (u) = 0,
(2.3)
subject to the boundary conditions u = u± s at x → ±∞.
(2.4)
Here u = u± s (with ∂f /∂u < 0) are two stable HSS, to be called up and down state. This problem is overdetermined, so that the solution exists only at a single value of c; thus, the propagation speed is obtained as a solution of a nonlinear eigenvalue problem. This is made transparent when (2.3) is viewed as a damped mechanical system, where the coordinate x is playing the role of time. In this interpretation, diffusivity is replaced by mass; −f (u) is a force with the potential −V (u), and c is the friction coefficient. Since the sign of the potential is interchanged, stable equilibria of the reaction-diffusion equation are mapped onto unstable mechanical equilibria and vice versa; the energy integral of a one-dimensional reaction-diffusion system corresponds to the action integral of a mechanical system. The front solution corresponds to a heteroclinic trajectory connecting the equilibria u = u± s . In mechanical terms, this would be a trajectory of a particle starting from the higher maximum of the potential −V (u), dissipating a part of its energy through friction, and stopping precisely at the lower maximum. This can be made possible only by adjusting the friction coefficient in a unique way. A more precise proof is based on a “counting” argument. Linearize (2.3) in the vicinity of either stable solution to obtain the equation with constant coefficients (2.5) cu (x) + Du (x) − αu = 0. The coefficients α = −f (u± s ) are negative, in view of the presumption that both equilibria are stable. The solutions of (2.5) are combinations of exponents u ∝ exp(λ± x), with the eigenvalues
c (2.6) λ± = −1 ± 1 + 4αD/c2 . 2D For α > 0, both pairs of eigenvalues λ± are real and of different sign, so that both HSS are saddles when viewed as equilibria of (2.3). There is a
86
2 Fronts and Interfaces
p
(b)
p
(a)
u
u
Fig. 2.2. Generic trajectories in the phase plane u, p = u (x) (a) and a nongeneric set of trajectories containing a heteroclinic orbit (b)
single trajectory leaving or entering the saddle point. The front solution is a heteroclinic trajectory connecting both equilibria. Such a trajectory does not exist generically (Fig. 2.2), but can be only obtained by adjusting a single parameter of the equation. The adjustable parameter is the propagation speed c which is unknown a priori. Since the motion slows down near the equilibrium, the heteroclinic trajectory takes infinite time to traverse; accordingly, the kink solution exists, strictly speaking, only on an infinite line. The equilibrium is, however, approached exponentially, and therefore, for all practical purposes, the deviation from a HSS becomes negligible at distances of several basic length units. The sign of c can be determined by multiplying (2.3) by u (x) and integrating over the infinite axis: ∞ ∞ − [u (x)]2 dx = − f (u)u (x)dx = V (u+ (2.7) c s ) − V (us ). −∞
−∞
Since the integral on the l.h.s. is positive, the sign of c coincides with the sign of the difference between the energies of the two competing states. The state with the lower energy advances, and the energy of the entire system is lowered due to increasing area occupied by the more favorable state. The potential difference equals to the derivative of the energy with respect to the front position ζ(t) = ζ0 + ct, which can be interpreted as a “thermodynamic force” acting on the fronts. The speed can therefore be presented as the ratio of the thermodynamic force and the dissipation integral : ∂F dζ = I −1 , dt ∂ζ where p(u) = u (x).
I=
∞
−∞
[u (x)]2 dx =
u+ s
u− s
p(u)du,
(2.8)
2.1 Planar Fronts
87
2.1.3 Computation of the Propagation Speed As a rule, the exact value of the propagation speed can be only computed numerically. Equation (2.3) is solved most easily in phase plane variables, using u as an independent, and p = u (x) as a dependent variable. Then it is rewritten as (2.9) cp + Dpp (u) + f (u) = 0. Since p vanishes when a HSS is approached, this equation has to be integrated − with the boundary conditions p(u+ s ) = p(us ) = 0. In this formulation, it is obvious that the first-order ODE with two boundary conditions is overdetermined. One could argue that a simple transformation to the form (2.9) might have replaced lengthy arguments from the preceding subsection; this transformation is, however, possible only when the unknown function u(x) is monotonic. The propagation speed can now be found by integrating (2.9) starting − from either u+ s or us and finding the value of c by shooting. This nonautonomous equation is, however, singular at u = u± s , since the coefficient at the derivative vanishes there. The numerical solution cannot start precisely at the equilibrium point. Instead, the initial point should be slightly shifted along the unstable manifold of the saddle point of (2.9). Taking as a starting point u = u− s + δ with δ 1 and choosing the sign of p to be positive, we set the initial condition − (2.10) p(u− s + δ) = λ+ (us )δ, − where the eigenvalue λ+ (u− s ) is defined by (2.6) with α = −f (us ). Using some chosen starting value of c, we continue the integration until either u reaches the maximum value u+ s or p vanishes. In the former case, the guessed value of c is too small and in the latter, too large (see Fig. 2.3). An efficient numerical procedure may start with the upper and lower a priori bounds of c and converge to the true value by iteratively subdividing the interval, until is found, p(u+ s ) drops below a set small target value. Once the function p(u) the profile u(x) is computed (in an implicit form) by quadrature: x = p−1 du. The propagation speed can be computed analytically when f (u) is a cubic: − 0 f (u) = −(u − u+ s )(u − us )(u − us ),
(2.11)
where u0s is the unstable middle root. The solution satisfying both boundary conditions is sought for in the form − p(u) = b(u+ s − u)(u − us ).
(2.12)
When this ansatz is substituted in (2.9), the equation factors out as − 2 0 2 − + (u − u+ s )(u − us )[(2b D − 1)u + bc + us − b D(us + us )] = 0.
(2.13)
The bracketed linear form has just enough adjustable coefficients to make it vanish. This yields
88
2 Fronts and Interfaces
p
(a) 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0
1
0.5
(b)
c D 1.2 1 0.8 0.6 0.4 0.2 0 u
0.5 0.1
0.2
0.3
Μ
Fig. 2.3. (a) Curves p(u) with an underestimated (upper curve) overestimated (lower curve) and exact (middle curve) values of propagation speed (b) The dependence of the propagation speed on the parameter µ for the cubic function f (u) = u − u3 − µ
√ b = ±1/ 2D,
c=
√
+ 2D u0s − 12 (u− s + us ) .
(2.14)
The speed is assumed to be positive when the lower state advances. The two signs of b correspond to the two alternative orientations of the front. For the cubic in the form f (u) = u − u3 − µ, the speed can be written explicitly using convenient trigonometric expressions for the roots: √ √ u± u0s = (2/ 3) sin ψ, s = −(2/ 3) sin(ψ ∓ π/3), ψ=
1 3
arcsin
√ 3 2 3µ .
(2.15)
Using (2.15) in (2.14) yields c=
√
6D sin
1 3
arcsin
√ 3 2
3µ .
(2.16)
The dependence of the propagation speed on the parameter µ is shown in Fig. 2.3b. Note that the curve becomes vertical at the bifurcation point µ = 2/33/2 wherethe roots u0s and u+ s merge, terminating there at the maximum value cm = 3D/2. The curve continues antisymmetrically into the region µ < 0. The good luck does not extend to higher order polynomials. Take f (u) of order 2n − 1; the order should be odd to prevent runaway to infinity in the dynamical system u (t) = f (u). Then p(u) must be of order n to match the orders of f (u) and p(u)p (u). After the boundary conditions are satisfied, n − 1 free parameters are left in the polynomial p(u). Those should be used, together with c, to cancel 2(n − 1) terms of the polynomial remaining after factoring. The numbers match only for n = 2, i.e. for a cubic f (u).
2.1 Planar Fronts
89
2.1.4 Maxwell Construction In the special case when both energies V (u± s ) are equal, called Maxwell construction, the propagation speed is zero, so that both states coexist at equilibrium. This may be achieved by adjusting some parameter µ at a certain level µ = µ0 , e.g. µ = 0 for the cubic form. The resulting nonuniform stationary state carriesinterfacial energy, which, according to (2.2), consists of the potential energy V (u) dx and the distortion energy 2 1 1 u (x) dx = 2 D p(u)du. (2.17) 2D Equation (2.3) with vanishing propagation speed, Du (x) + f (u) = 0
(2.18)
is rewritten in phase plane variables as Dpp (u) + f (u) = 0.
(2.19)
Denoting T = 12 Dp2 , this can be expressed as T (u) = V (u). The value of V (u± s ) can be taken as zero, and T evidently vanishes for any HSS; hence, integrating the latter relation proves that the distortion energy equals the potential energy at any point. This is formally equivalent to the virial theorem of classical mechanics (where distortion energy is replaced by kinetic energy). Thus, the surface energy per unit area, or surface tension 1 of the stationary front can be computed as
∞
2
u (x) dx = D
σ=D −∞
u+ s
u− s
p(u)du =
u+ s
u− s
2DV (u)du.
(2.20)
Note that surface tension is proportional to the dissipation integral (2.8), σ = DI. The stationary front profile can be computed in quadratures. Integrating (2.19) yields 2 V (u) − V (u− (2.21) p(u) = ± s ), D and the front profile is expressed in an implicit form u D du x(u) = . (2.22) 2 u0s V (u) − V (u− ) s
The origin x = 0 may be arbitrary, but, to be definite, we have placed it at the location of the unstable intermediate HSS u0s . 1
This term stresses the analogy to phase transitions in equilibrium systems – see Sect. 2.4.1.
90
2 Fronts and Interfaces
A useful analytical form is the kink solution of the symmetric cubic equation with f (u) derived from the quartic potential 2 V (u) = 14 1 − u2 . (2.23) This lowest order symmetric form appears as a result of expansion near a pitchfork bifurcation, or a second-order phase transition. The universal parameterless form obtained after rescaling is the cubic reaction-diffusion equation (1.20). The inhomogeneous stationary solution of this equation dependent on a single coordinate x normal to the front is elementary: √ √ u(x) = tanh x/ 2 . (2.24) p(u) = 1 − u2 / 2, 2.1.5 Unstable Nonuniform States In addition to the heteroclinic (front) solution, (2.3) with a correctly chosen speed has a continuous family of periodic solutions. The respective trajectories in the phase plane (u, p) shown in Fig. 2.4a lie within the heteroclinic loop and surround the unstable equilibrium u = u0s . For an incorrectly chosen speed, (2.3) has a homoclinic trajectory approaching at x → ±∞ the metastable HSS, interpreted as a propagating pulse, and a continuous family of periodic solutions (Fig. 2.2a), corresponding to wave trains of varying wavelength. A family of pulses propagating with different speeds is shown in Fig. 2.9b. All these solutions are dynamically unstable when viewed as solutions of the evolution equation (2.1). Stationary periodic patterns (c = 0) can be computed in quadratures as in the preceding subsection, though expressions are rather more complicated. The solution of (2.19) should be written as (2.25) p(u) = ± 2/D V (u) − V (umin ) (a)
(b)
p
p
u
u
Fig. 2.4. (a) Phase plane trajectories p(u) corresponding to unstable wave trains. (b) A family of homoclinic trajectories corresponding to unstable pulses propagating with different speeds. Only half-trajectories are shown. The limiting heteroclinic trajectory is shown in both figures
2.1 Planar Fronts
x(u) =
D 2
u
umin
du V (u) − V (umin )
91
(2.26)
where umin and umax are the minimum and maximum values of u satisfying the condition V (umin ) = V (umax ). The last formula gives in an implicit form the profile u(x) for a half-period of the solution. The admissible values of V lie between the potential of the unstable state V (u0s ) and the potential of the metastable state, i.e. the larger of V (u0+ ) and V (u0− ). The lower bound of this interval corresponds to a homoclinic orbit (a critical nucleus) when the two minima are unequal and to a heteroclinic orbit (a static front) when V (u0+ ) = V (u0− ). The total wavelength is umax √ du L = 2D . (2.27) V (u) − V (umin ) umin One can see that it diverges when V (u) is extremal, i.e. for umin = us± . For a cubic f (u), the profiles u(x) can be expressed in elliptic functions; in particular, for the symmetric f (u) = u − u3 and D normalized to unity, the solution is u(x) = r sn(αx|k), (2.28) where 0 < r < 1, α2 = 1 − r2 /2. The modulus of the elliptic Jacobi function sn(x|k) is k = r2 /(2 − r2 ) and the spatial period of the pattern (2.28) is L = 2K(k)/α, where K(k) is the complete elliptic integral of the second kind. All periodic patterns have finite mean energy density. Instability of stationary periodic patterns is proven easily, since the linearization of (2.18) is a Sturm–Liouville problem. Presenting, as usually, small perturbations from a stationary solution as u = u1 (x)eλt , we arrive at the eigenvalue problem (2.29) Du1 (x) + f (u0 (x))u1 = λu1 . The left-hand side is the linearization of (2.18) near the stationary solution, which we denote now as u0 (x). It is annulled by the derivative u1 = u0 (x), as proven by differentiating (2.18). Thus, u0 (x) is the eigenfunction of (2.29) with zero eigenvalue. If u0 (x) is a monotonic stationary front, this eigenfunction, corresponding to translations of the front, is sign-definite, and therefore zero is the largest eigenvalue, and the solution is stable to all perturbations modifying its shape. For all other solutions, the translational eigenfunction is sign-changing. According to the general theorem on Sturm–Liouville systems, there must exist a sign-definite eigenfunction with a larger eigenvalue, and therefore all nonmonotonic solutions are unstable. 2.1.6 Front Interactions Consider two fronts of opposite polarity, to be called a kink and an antikink, centered at x = ±L/2 (Fig. 2.5). One can see in this figure that each front
92
2 Fronts and Interfaces
is only weakly perturbed by the exponential tail of its counterpart when the fronts are removed at a distance of several characteristic diffusional lengths. In the absence of interaction, each front would be described by the respective stationary solutions, u0 (x + L/2) and u0 (L/2 − x). As the separation L decreases, the energy F of the kink/antikink pair, equal to 2I at L → ∞, decreases as well. The derivative ∂F/∂L can be interpreted as a “force” bringing the two fronts together. In nonequilibrium thermodynamics this is known as Peach–K¨ ohler force. The drift velocity can be computed in a most transparent way starting from the expression for dissipation rate (1.29). The computation is possible when the drift is slow, so that the profile of u always remains quasistationary and can be expressed by a certain function depending on the current value of L as a parameter and independent of the history of motion. Under these conditions, (1.29) can be rewritten as ∂F dL =− ∂L dt
δF δu
2 dx.
(2.30)
An approximate solution describing a quasistationary kink/antikink pair can be obtained by matching the inner solution near the front and the outer solution in the region between the two fronts where u is close to u+ s (see Fig. 2.5). The inner solution is the standard front profile u(i) = u0 (L/2 ± x), , where the deviation u verifies the while the outer solution is u(o) = u+ s −u linearized equation u = 0, (2.31) u (x) − α with α = −f (u± s ) > 0. A symmetric solution is √ u = A cosh( αx),
(2.32)
where the constant A should be chosen to match the outer asymptotics of the inner solution. For the kink centered at x = −L/2, the latter has the form (a)
(b)
u
u
1
1.5 1 0.5 0.99
0.5 10
5
1
1
1.5
Ζ
0.98 5
0.5
0.5
10
Ζ
0.97 0.96 0.95 0.94
Fig. 2.5. (a) The profile of interacting fronts. (b) The blow-up of the matching solution (2.32)
2.1 Planar Fronts
lim u(o)
x→∞
√ = u+ s − a exp[− α(x + L/2)].
93
(2.33)
For example, for a cubic, a = α = 2, as can be seen by computing the asymptotics of (2.24) at x → ∞. Thus, we have − u(o) = u+ s − 2ae
√
αL/2
√ cosh( αx).
(2.34)
By symmetry, this also matches the antikink centered at x = L/2. Combining the inner and outer solutions matched at some position x = √ ±X, such that exp[ α(X − L/2)] 1, we compute the energy F =2
L/2−X −∞
= 2I −
∞
[u0 (x)]2 dx +
X
{[ u (x)]2 + 2V [u(o) (x)]}dx X √ √ √ a2 αe− α(2x+L) dx + 2 a2 αe− αL cosh(2 αX)dx
L/2−X √ √ = 2I − a2 αe− αL .
0
0
(2.35)
The transformation of the outer integral takes into account that the potential 1 can be presented near u = u+ u2 . The result is independent of s as V = 2 α the matching position √ X, provided the above condition is satisfied, so that √ cosh(2 αX) ≈ 12 exp(2 αX). As expected, ∂F/∂L > 0, and the dependence on separation is exponential as long as separation is large compared with the effective front thickness. Differentiating the final expression in (2.35) with respect to L gives the thermodynamic force on the l.h.s. of (2.30). This force can be compensated by shifting the parameters to lower the energy of the state in the segment between the two fronts. Since the total energy gain is proportional to the length of the region occupied by the preferred state, the stationarity condition + is ∂F/∂L = ∆V = V (u− s ) − V (us ). For example, for a simple parametric shift f (u) → f (u) + µ with µ 1, the energy gain for the upper state is − ∆V = µ(u+ s − us ). Using (2.35), we see that the domain with the width L is stationary at √ a2 α −√αL e . (2.36) µ=µ = + us − u− s The equilibrium is unstable, but can be maintained if the parameter µ is adjusted dynamically, for example by maintaining the ratio of domain lengths of the alternative states (see Sect. 2.2.4). Returning to the dynamical problem, it remains to evaluate the r.h.s. of (2.30). According to the gradient dynamics principle (2.2), the variation δF/δu equals in the evolving system to the time derivative ut ≈ u0 (x)dL/dt with an inverted sign. Thus, (2.30) can be rewritten as ∞ √ dL ∂F =− [u0 (x)]2 dx = − 12 I −1 a2 αe− αL . (2.37) dt ∂L −∞
94
2 Fronts and Interfaces
The dissipation integral is replaced here by twice the standard value for two noninteracting fronts, since the correction due to interactions is exponentially small. This formula can be extended to an arbitrary array of interacting fronts centered at x = ζj . Since interactions decrease exponentially with separation, only nearest-neighbor interactions are relevant. The generalization of (2.37) − for a symmetric case α = f (u± s ) = f (us ) is √ √ dζj = 12 I −1 a2 α e− α(ζj+1 −ζj ) − e− α(ζj −ζj−1 ) . dt
(2.38)
In an asymmetric case when α± = f (u± s ) differ, one should replace in this formula α by α+ in the first term and by α− in the second term if the front at the jth position is a kink, and the other way around if it is an antikink. The system (2.38) has a family of stationary solutions ζj = jL, j = 0, ±1, ±2, . . . corresponding to an infinite array of equidistant fronts (or to a finite array on a ring), i.e. to a stationary periodic pattern. We have already argued in the preceding subsection that such a pattern is unstable. The instability is easily proven by linearizing (2.38) in the vicinity of this solution. Equation (2.38) does not describe the last stages of interaction at short distances and the annihilation of the colliding kink and antikink, but it is clear that the duration of these stages is much shorter than the time of slow approach of fronts originally separated at distances far exceeding the characteristic diffusional length.
2.2 Weakly Curved Fronts 2.2.1 Aligned Coordinate Frame The front solution is neutrally stable to translations along the x-axis. This Goldstone mode is weakly perturbed when the translation is weakly nonuniform, so that the front becomes curvilinear but the curvature radius still far exceeds the characteristic front thickness. Propagation of a weakly curved front should be studied using a coordinate frame aligned with its deformed shape. First, we have to define the nominal front position, replacing a diffuse transitional region by a planar curve C. The most natural choice is to fix it as the locus of the unstable zero of the function f (u). The curve chosen in this way can be approximated locally by a circular segment, and (2.3) rewritten in polar coordinates r, φ. The local coordinates transverse and parallel to the front can be expressed as x = r − R and y = Rφ, and since the curvature radius R far exceeds the characteristic diffusional scale, x R in the transitional region where u differs significantly from both alternative HSS. Then the 2D Laplacian can be approximated as ∇2 = r−1 ∂r (r∂r ) + r−2 ∂φ2 = ∂x2 + κ∂x + ∂y2 + O(κ2 ),
(2.39)
2.2 Weakly Curved Fronts
95
where κ = R−1 1 is the local curvature. Generally, any planar curve C can be defined at any moment of time t in a parametric form X(s; t), where s is the arc length. The tangent to C at any point is the derivative X s = l. Since l, by construction, is a unit vector, the vector ls must be orthogonal to l. By definition, the direction of ls is the normal n, and its absolute value is the curvature κ. Alternatively, the curve can be parametrized by any coordinate y; the infinitesimal arc length ds is defined as ds = g dy, where g = |X (y)| is the metric factor. Then the unit tangent vector is computed as l = X (s) = g −1 X (y). The coordinate frame aligned at any point of the curve with the tangent and normal vectors is set up in the following way. By convention, the x-axis has its origin on the curve and is directed from the region occupied by the down state to the region occupied by the up state, so that the boundary conditions (2.4) are approached asymptotically far from the front location. The vector n is directed, by definition, toward the local center of curvature removed at the distance |κ|−1 . In view of these direction conventions, the curvature κ should be considered positive when the normal is directed toward the down state, and negative otherwise. The coordinate lines x = const are obtained by shifting the curve along the normal by a constant increment, as shown in Fig. 2.6. Evidently, this shift causes the length to increase on convex, and to decrease on concave side of the curve. The length element is computed as ds2 = dx2 + (1 + κx)2 dy 2 .
(2.40)
Reading the metric tensor from this expression, the Laplacian is expressed as
∇2 = (1 + κx)−1 ∂x (1 + κx)∂x + ∂y (1 + κx)−1 ∂y . (2.41)
us
x
n n
us –
Fig. 2.6. Construction of the aligned coordinate frame. The coordinate lines are shown in gray. Arrows show the local directions of the normal n and the x-axis. Note of a singularity developing on the concave side
96
2 Fronts and Interfaces
The aligned system is well defined only sufficiently close to the curve, due to a singularity developing on the concave side at a distance of O(κ−1 ). If the curvature radius far exceeds the diffusional range l, the aligned system remains regular in the region where u changes between the alternative equilibria u = u± s . If the thickness of this transitional region is l = O(1), the curvature correction can be treated perturbatively when κ 1. We set κ = O(), expressing the order of magnitude through a book-keeping small parameter . The state variable(s) should change slowly in the tangential direction. The appropriate scaling compatible with the scaling of curvature can be estimated by computing the curvature of a slightly bended curve defined in the Cartesian coordinates X, Y by the equation X − ζ(Y ) = 0. Assuming ζ (Y ) 1, the components of the normal vector are, in the leading order, nX = 1, nY = in the leading order, as κ = −ζ (Y ), and the curvature is computed, again √ ζ (Y ). Thus, one should assume ∂Y = O( ) to obtain κ = O(). Adopting the same scaling for the derivatives with respect to the transverse coordinate in the aligned frame, we rewrite the Laplacian (2.41) as (2.42) ∇2 = ∂x2 + (κ∂x + ∂y2 ) − 2 x κy ∂y + 2κ∂y2 + κ2 ∂x + O(3 ). Up to the first order, the general derivation is equivalent to the simplified version using the local polar coordinates, but in the second order there is an additional term due to transverse variation of curvature. In 3D, one can define in a similar way a coordinate system aligned with a surface X(y i ; t) parametrized by coordinates y i , i = 1, 2. The surface metric tensor is defined as γij = (∂i X)(∂j X), where ∂i = ∂/∂y i . As in 2D, the surface frame is extended into a neighboring layer by translating the surface along the normal. The length element in the aligned frame is expressed as (2.43) ds2 = dx2 + γij + xκij + x2 κki κkj dy i dy j , where κij are elements of the curvature tensor; the indices are raised and lowered with the help of the surface metric tensor γij and summation over repeated lower and upper indices is presumed. An orthogonal frame can be constructed on the surface by choosing coordinate axes directed locally along the principal directions of the curvature tensor. Then the Laplacian is expressed as 1 + κ2 x 1 + κ1 x 1 √ 2 ∂1 + ∂ 2 ∂2 , (2.44) ∇ = √ ∂x g ∂x + ∂ 1 g 1 + κ1 x 1 + κ2 x √ where κi are the two principal curvatures and g = (1 + κ1 x)(1 +√κ2 x). The approximate expression employing the scaling κi = O(), ∂i = O( ) is ∇2 = ∂x2 + (κ∂x + ∇2⊥ ) + O(2 ),
(2.45)
where κ = κ1 + κ2 is twice the mean curvature and ∇2⊥ = ∂12 + ∂22 is the transverse Laplacian. The second-order term in this expansion is computed as
2.2 Weakly Curved Fronts
97
−2 x (κ21 + κ22 )∂x + ∂1 (κ1 − κ2 )∂1 + ∂2 (κ2 − κ1 )∂2 + 2(κ1 ∂12 + κ2 ∂22 ) . The general covariant form of the transverse part of the bracketed expression is 2∂i κij ∂j − ∂ i κ∂i . 2.2.2 Expansion Near Maxwell Construction Near the Maxwell construction µ = µ0 , a curvature correction may become comparable to a slow speed of a straight-line front. Both the deviation µ − µ0 and the propagation speed must be of O() to match the orders of magnitude. The difference between the energies of both stable uniform states should be − small, V (u+ s )−V (us ) = V1 . Thus, we set f (u) = f0 (u)+f1 (u). Transforming the time derivative in the comoving frame as ∂t → ∂t − c∂x and expanding the state variable as u = u0 (x) + u1 (x, y) + . . . yields, in the zero order Du0 (x) + f0 (u0 (x)) = 0.
(2.46)
This equation is verified by a stationary front solution u0 (x) satisfying the asymptotic condition (2.4). The first-order equation is Du1 (x) + f0 (u0 (x))u1 + Ψ (x, y) = 0,
(2.47)
which contains the inhomogeneity Ψ (x, y) = (c + Dκ)u0 (x) + f1 (u0 (x)).
(2.48)
The term containing curvature κ of a planar curve or mean curvature of an interface in 3D comes from the expansion of the Laplacian (2.42) or (2.45). The propagation speed is determined by the solvability condition of (2.47). The inhomogeneity Ψ (x, y) should be orthogonal to the Goldstone eigenmode u0 (x) that corresponds to the translational symmetry of a stationary front: ∞ u0 (x)Ψ (x, y)dx = 0. (2.49) −∞
This yields the eikonal equation c = c0 − Dκ,
(2.50)
where c0 = V1 /I is the speed of the straight-line front (cf. (2.7) applied in the vicinity of Maxwell construction). The dissipation integral I defined by (2.8) is proportional to the interfacial energy per unit length (surface tension) σ = DI, as shown in Sect. 2.1.4. At the Maxwell construction (f1 = V1 = 0), the motion is driven exclusively by curvature: c = −Dκ. The front propagates along the curvature vector in such a way that a convex region occupied by one of the alternative equilibria shrinks. The stationary condition c0 = Dκ defines the radius of a critical
98
2 Fronts and Interfaces
nucleus of a preferred state; this stationary state is, evidently, unstable, as the droplet with the curvature larger than critical shrinks, while beyond the critical radius it grows indefinitely. A more explicit form of the stationary − condition, V (u+ s ) − V (us ) = σκ, is linked to the Gibbs–Thomson law relating the equilibrium pressure or temperature with the radius of a droplet (see also Sect. 2.4.3). The speed of the curvature-driven motion can be derived directly from the variational principle (2.2). We observe that both the standard profile of the order parameter across the front u0 (x) and the distortion energy per unit length of a weakly curved front are, in the leading order, independent of curvature. Therefore, the energy functional is proportional to the length (in 2D) or area (in 3D) of the front. In 3D it is computed as √ g dy1 dy2 . (2.51) F = DI dS = DI Since energy is totally determined in this approximation by geometry of the interface, its variation with respect to the order parameter can be expressed in purely geometrical terms. Consider a Cartesian frame (X, Y ) where the X-axis is aligned with the normal at a chosen point and Y spans the tangent plane at the same point. An adjacent segment of the interface can be defined by the equation Φ(X, Y ) ≡ X − ζ(Y ) = 0. (2.52) In this parametrization, the metric factor is g = |∇Φ|2 = 1 + |∇⊥ ζ|2 and the normal vector is n = g −1/2 ∇Φ. We take note that only displacements normal to the front are significant, while parallel displacements lead only to reparametrization. The variation can be therefore computed as √ δF = δ g d2 Y = g −1/2 ∇⊥ ζ · δ∇⊥ ζ d2 Y (2.53) = ∇⊥ n δζ d2 Y = κ δX d2 Y . One can add here a shape-independent gain δF = −V1 δX due to advancement of a more favorable state, which is proportional to a weak deviation from the Maxwell construction. The relaxation equation (2.2) can be rewritten therefore, introducing also a mobility coefficient Γ , as c=
δF dX = −Γ = Γ (V1 − DIκ). dt δX
(2.54)
This coincides with (2.50) if one sets Γ = I −1 . 2.2.3 Burgers Equation For a weakly distorted planar front defined by (2.52), the eikonal equation (2.50) can be rewritten explicitly in the Cartesian frame (X, Y ) propagating
2.2 Weakly Curved Fronts
99
with a constant speed c0 . In accordance to the scaling of the transverse coordinates in the preceding subsection, we presume that the transverse gradients compared with those in the propagadenoted by a 2D operator ∇⊥ are small √ tion direction, and scale ∇⊥ = O( ). The extended time variable is scaled accordingly as ∂t = O(). The projection of the normal displacement on the X-axis is expressed as −1/2 = c0 1 − 12 |∇⊥ ζ|2 + O(2 ), c0 1 + |∇⊥ ζ|2 and the curvature is computed as κ = −∇2⊥ ζ + O(2 ). Using this in (2.50) transformed to the moving frame yields in the leading order the Burgers equation (2.55) ∂t ζ = D∇2⊥ ζ − 12 c0 |∇⊥ ζ|2 . The diffusional term acts in such a way that convex segments retreat and concave ones advance, so that the front tends to relax to a straight line or planar shape. The nonlinear term is purely advective and reflects the tendency of the interface to propagate normal to itself. This term is responsible for asymmetry due to the propagation direction, since segments with a larger slope lag behind, the front tends to be smoother on the onward and steeper on the back side as seen in Fig. 2.7. At the Maxwell construction (c0 = 0), (2.55) degenerates into a linear diffusion equation. Otherwise, it can be linearized with the help of the Hopf– Cole transformation (2.56) ζ = −(2D/c0 ) ln χ, transforming it to a linear diffusion equation ∂t χ = D∇2⊥ χ.
(2.57)
The “hydrodynamic” form of the Burgers equation obtained by applying the gradient operator is ∂t v + v · ∇v = D∇2 v,
(2.58)
where v = c−1 0 ∇ζ is interpreted as “velocity”, and the ⊥ sign is omitted. This form bears superficial resemblance to the Navier–Stokes equation, but lacks
Fig. 2.7. Successive positions of a front propagating upward with a constant normal velocity. Dots mark successive positions of chosen points. Note a singularity developing on the concave segment
100
2 Fronts and Interfaces
pressure and is not coupled to the continuity equation. One can say that the Burgers equation describes a “supercompressible” fluid with pressure independent of density (and therefore irrelevant). The Burgers equation has been originally introduced (Burgers, 1948) in this form as a model replacement of the Navier–Stokes equation. It is, however, ill suited for studies of hydrodynamic phenomena, especially turbulence, as the velocity field defined in this way is potential , while the heart of hydrodynamic turbulence is vorticity. In the “inviscid” limit D = 0, which is approached far from the Maxwell construction when the front propagates with a constant speed and the effect of curvature is negligible, (2.58) degenerates into a first-order PDE that generates moving discontinuities – “shocks” forming boundaries between front segments with different slopes.√A small diffusional term with D = O() resolves discontinuities on an O( ) scale. The characteristic equation of the first-order PDE is dv/dt = v, which means that segments with a higher slope propagate faster and thus conquer and obliterate segments with a lower slope. To compute the propagation speed of a shock, to be denoted as q, we rewrite the degenerate form of (2.58) in a 2D frame comoving with the shock as q dv/dz =
1 2
d|v|2 /dz,
(2.59)
where the z axis is directed normally to the shock. Integrating this across the shock and taking into account that the component of v parallel to the shock must be continuous, while the normal component may jump between the values vz = v± , yields q = 12 (v+ − v− ), i.e., the shock propagates with the speed equal to the arithmetical mean of the slopes on the two sides. The dynamics of shocks is in fact a simple geometrical consequence of normal propagation of the interface with a constant speed masked by a chain of mathematical transformations of the eikonal equation (2.50). The Burgers equation is one of the most extensively studied universal equations. A question of interest is the law of decay of originally imposed inhomogeneities (see e.g. Bec et al., 2000). Another well-studied topic is dynamics in the presence of noise described by the Burgers equation with an added random term, commonly called Kardar–Parisi–Zhang (KPZ) equation (Kardar et al., 1986). 2.2.4 Ripening under Global Control Dependence of the front propagation speed on curvature plays a primary role in long-scale evolution of patterns. Consider a pattern consisting of twodimensional “droplets” of a minority phase (say, u = u− s ) immersed in a continuum of an alternative majority phase. Since the front interactions decay exponentially with separation, their influence on the dynamics of fronts that bound droplets separated at a distance much larger than the characteristic diffusional length should be negligible compared to the influence of curvature.
2.2 Weakly Curved Fronts
101
Thus, well-separated droplets will relax to the circular shape and evolve according to (2.50) that gives preference to growth of larger droplets. For any value of c0 > 0 (i.e. under conditions favoring growth of the minority phase), there is a critical radius Rc = D/c0 , such that the droplets with larger radii R > Rc grow, while droplets with R < Rc shrink and eventually disappear. If c0 remains fixed, the initial minority phase eventually conquers the entire plane. This can however, be, prevented if there is an additional global variable, which is dynamically adjusted to maintain the total area occupied by the minority phase constant. This variable should act to reduce the value of c0 in the course of evolution in order to compensate the decrease of average curvature. As a result, the critical radius grows and, as it overtakes the radius of growing droplets, the latter start to shrink and eventually disappear. The final result of evolution minimizing the total energy of the system under the constant area constraint would be a single circular droplet. This ripening process (similar to Ostwald ripening in two-phase systems, see Sect. 2.4.6) may, however, take exceedingly long time at its later stages, when the radii of the majority of surviving droplets become very large compared to the thickness of the interfacial layer. It is interesting therefore to compute the distribution of droplet sizes at late stages of ripening when the system has been evolving sufficiently long to obliterate the initial size distribution, but the number of droplets still remains sufficiently large to justify statistical approach. The asymptotic analysis follows the classical work by Lifshitz and Slyozov (1958) who have considered ripening in 3D with a growth rate different from that used here. We shall return to this case in Sect. 2.4.6; see also a generalized analysis by Giron et al. (1998). Let f (R) be the number density of droplets with radius R; this function is not normalized, since the total num ber f (R)dR decreases in time as smaller droplets collapse. The evolution equation for f (R) is ∂(cf ) ∂f + = 0, (2.60) ∂t ∂R where the growth rate c(R) is expressed, using (2.50) and denoting c0 = D/Rc (t), as 1 1 c(R) = D − . (2.61) Rc R An asymptotic distribution, if it exists, should admit some quasistationary representation. Quasistationarity may be preserved relative to the timedependent critical radius. A suitable variable, replacing R, is therefore the dimensionless radius ρ = R/Rc . The growth of the respective dimensionless area is proportional to D 1 d(ρ2 ) ρ2 dRc = 2 (ρ − 1) − . 2 dt Rc Rc dt
(2.62)
This expression is further simplified by using Rc as a measure of time. A convenient transformed time variable is τ = ln(Rc /R0 )2 , where R0 is any
102
2 Fronts and Interfaces
suitable length scale. Denoting q(t) =
1 d(Rc2 ) , 2D dt
(2.63)
we rewrite (2.62) as ρ−1 1 d(ρ2 ) = − ρ2 . 2 dτ q(τ )
(2.64)
It turns out that there is a unique asymptotic value of q at τ → ∞ compatible with the area conservation condition. The r.h.s. of (2.64) is negative at both small and large values of ρ, but becomes positive in an intermediate range when q < 1/4 (see Fig. 2.8a). If such a range existed, the area covered by droplets with respective radii would grow with time without limit, which is forbidden, as it contradicts the area conservation condition. Conversely, if q were negative everywhere, the area occupied by all droplets would keep shrinking, which is again incompatible with the area conservation. The only remaining possibility is that the asymptotic value is q∞ = 1/4; then the r.h.s. of (2.64) reaches the zero maximum at ρ = 2. This defines the maximum dimensionless radius in the asymptotic distribution. Indeed, if droplets with a larger radius are present in the initial distribution, their radius, notwithstanding their continuous growth, draws closer to the critical radius, until they are swept to the vicinity of the point ρ = 2. The function q(τ ) should approach its limiting value q∞ = 1/4 from above in such a way that a small gap decreasing with time remain between the maximum of the r.h.s. of (2.64) and the ρ axis. The droplets from the tail of the distribution filter slowly through this gap in the course of evolution. The time-dependent correction to the asymptotic value affects the form of the distribution near the point ρ = 2, but this does not affect the rest of the distribution, since, as we shall see, the contribution of the vicinity of this point to the total area is negligible. (a)
vΡ 2
(b)
1
2
3
4
2
14
4
13
6
Ρ
1.25 1 0.75
ln
1.5
15
0 40 80 1.9 1.95 Ρ
0.5 0.25 0.5
1
1.5
2
Ρ
Fig. 2.8. (a) Plot of the r.h.s. of (2.64); the values of q are indicated at the respective curves. (b) The normalized distribution function. Inset: the tail near ρ = 2 drawn on a logarithmic scale
2.3 Propagation into an Unstable State
103
The asymptotic size distribution can be obtained now by solving (2.60), which is rewritten in the transformed variables as ∂(cf ) ∂f + = 0, ∂τ ∂ρ
2 c(ρ) = − (2 − ρ)2 . ρ
(2.65)
The general solution of (2.65) is f (ρ, τ ) = −
χ(τ + ψ) , c(ρ)
ψ(ρ) = −
dρ , c(ρ)
(2.66)
where χ(. . .) is an arbitrary function that has to be obtained from the normalization condition Rmax
R2 f (R)dR = S0 ,
π
(2.67)
0
or, in dimensionless variables, 2 S0 eτ ρ2 f (ρ)dρ = y ≡ . πR02 0
(2.68)
It is clear from the latter expression that the only choice making the l.h.s. independent of τ is χ(τ ) = Ae−τ with an appropriate constant A. Computing the integrals yields f (ρ, τ ) = 12 Ae−τ −1/(2−ρ) ρ(2 − ρ)−5/2 , A = 2y
2
ρ3 (2 − ρ)−5/2 e−1/(2−ρ) dρ = 1.159y.
(2.69) (2.70)
0
The distribution becomes independent of τ when it is normalized to unity, f (ρ, τ ) = Be−τ ϕ(ρ), where ϕ(ρ)dρ = 1 and B is a normalization constant. The normalized distribution is shown in Fig. 2.8b. To translate the result back to physical variables, √ one has to keep in mind that Rc increases asymptotically proportionally to t and e−τ ∝ t−1 . Convergence to the asymptotic distribution may be, however, impaired for initial distributions with a very long tail (Niethammer and Pego, 1999).
2.3 Propagation into an Unstable State 2.3.1 Continuum of Propagating Solutions The problem of front propagation into an unstable state arises naturally in population dynamics. A stationary state where competitively advantageous specie is absent is formally unstable to infinitesimal perturbations but will be nevertheless preserved at any location until this specie is introduced there. This will typically happen as the habitat boundary propagates outward, i.e.,
104
2 Fronts and Interfaces
via a propagating front connecting the stable and unstable states. The difficulty of this problem, which has motivated the pioneering work of Kolmogorov et al. (1937), lies in the nonuniqueness of a solution describing a steadily propagating front. The propagation speed therefore cannot be computed in a straightforward way by solving an ODE. It is selected dynamically, and the full nonstationary problem should be considered to understand the selection mechanism. If the receding state is unstable, the coefficient α in the linearized equation (2.5) √ is positive. Then both eigenvalues (2.6) are real negative at c > cmin = 1 2 αD; below this value they are complex with a negative real part. This means that at c > cmin the unstable state, viewed as an equilibrium point of (2.3), is a stable node, and the unstable manifold of the advancing stable HSS connects generically to this point (see Fig. 2.9). The generic connection persists also at smaller positive velocities, but the approach to the equilibrium is oscillatory. Thus, there is a continuum of one-dimensional front solutions, and restricting to monotonic solutions gives only a lower bound c = cmin . The question is, which speed is actually chosen by the dynamically evolving system. Moreover, it is not evident a priori that transition from an unstable to a stable state should be carried by a propagating front retaining its quasistationary shape. Any perturbation of an unstable state is destined to grow; therefore, dynamics of transition from an unstable to a stable state should strongly depend on initial conditions. The kind of an initial condition that is likely to generate a propagating front is a perturbation localized in a narrow region. This kind of a perturbation is typical for many physical problems. When a perturbation of this kind is introduced into a system that had been rapidly quenched into an unstable state, the transition into a stable state is effected locally, and a sharp front propagating into the unstable state is formed. In problems of population dynamics (which historically were the first to prompt the interest in front propagation dynamics), a localized perturbation corresponds to a lo(a) u’x 0.12
(b) u’x
ccmin
0.3
ccmin
0.1 0.08
0.2
ccmin
0.06
0.1
0.04 0.02 0.2
0.4
0.6
0.8
1
u
0.2 0.1
u 0.2
0.4
0.6
0.8
1
Fig. 2.9. Trajectories in the phase plane connecting a stable and an unstable equilibrium
2.3 Propagation into an Unstable State
105
cally introduced successful mutant population that displaces an old genom. In other systems, the stable state may nucleate at the boundary or at a local inhomogeneity. In the absence of other perturbations, the global transition to the stable state is effected through front propagation. 2.3.2 Asymptotic Theory of the Leading Edge The method developed for the reaction-diffusion equation by Kolmogorov et al. (1937), and later generalized to pattern-forming systems (Dee and Langer, 1983, Ben-Jacob et al., 1985; see Sect. 4.5.1), is based on the asymptotic linear analysis of the leading edge of the propagating front. The front is called “pulled” when its propagation speed is determined by growth of perturbations at its leading edge. Consider the growth of a perturbation of an unstable state u = u0s . While the perturbation remains small, the linear theory applies, and the solution can be presented as a Fourier integral ∞ u (k)ei[kx−ω(k)]t dk. (2.71) u(x, t) − u0s = −∞
The dispersion relation ω(k) follows from a linearized evolution equation. If the latter has a general form ut = L(∂x2 )u + α(u − u0s ), the dispersion relation obtained in the vicinity of u = u0s is
ω = i α + L(−k 2 ) .
(2.72)
(2.73)
In particular, for the linearized reaction–diffusion equation, we have L = −Dk 2 . To determine the front speed c, we evaluate (2.71) asymptotically for large x, t, such that ξ = x − ct = O(1). This solution should describe the leading edge of the front (where the linear theory still applies), advancing with the speed c, as yet undetermined. The integral (2.71) now takes the form ∞ u (k)ei[kξ+h(k)t] dk, (2.74) u(ξ, t) − u0s = −∞
with h(k) = ck − ω(k). If the original perturbation is sufficiently localized, all Fourier modes are present, and u (k) can be considered to be a smooth O(1) function. The integral (2.74) can be evaluated using the method of steepest descent in the complex k-plane. We require h(k) to be maximal, h (k) = 0, and the imaginary part of h(k) to vanish, so that the solution expressed by (2.74) neither grow nor decay in time. This yields ci (k) = 0, c= cr (k),
c = ωi /ki .
(2.75)
106
2 Fronts and Interfaces
where c = ω (k) is the group velocity, and the subscripts r and i denote the real and imaginary parts respectively. Equation (2.75) is satisfied at a certain point k = k in the complex k-plane. The approximation implies that the Fourier integral is dominated at late stages of evolution by this particular value of k, so that the leading edge of the front can be presented as u − u0s ∼ ei[k−ω(k)t] = e−ki (x−ct) ei[kr x−ωr (k)]t .
(2.76)
The imaginary part of k determines the rate of decay in the direction of propagation. According to (2.75), the selected propagation speed coincides with the real part of the group velocity, which determines the speed of propagation of perturbations. In a frame moving with a speed faster than c, the solution would appear to be decaying in time; thus, one can say that propagation plays a stabilizing role, in a sense that one can outrun a growing perturbation by moving sufficiently fast. If cr were larger than the speed c with which the front moves, perturbations would run ahead of the front and cause the profile to be unstable. The selected speed is such that the perturbation neither grows nor decays, i.e., it satisfies the condition of marginal stability (Dee and Langer, 1983). 2.3.3 Stability of the Leading Edge In order to gain more physical understanding of the stability of the leading edge of the propagating front and of the way the leading edge of the propagating front evolves to a marginally stable profile, we generalize (2.76), following van Saarloos (1988, 2003), to u = eiθ(x,t) , where k = ∂θ/∂x is allowed now to change slowly in space and time. The evolution equation of θ, rewritten in a frame propagating with the velocity c, has a general form θt = ck − ω(k) + M(∂x , ∂x2 , . . .)k,
(2.77)
where M is a nonlinear differential operator derivable from L. One can easily see that the imaginary part of this equation is indeed verified by θi = const with k = k when the propagation speed is defined by (2.75). To check the stability of this solution, we linearize (2.77) to obtain the equation for a perturbation θ: k) − cr ( k)]θx + M∂x ( k)θxx + . . . . θt = [c(
(2.78)
Omitted terms contain higher derivatives with respect to x. The profile is stable if perturbations bounded at x → ∞, that have the form θ ∼ eikx with k, only the first term in (2.78) is relevant, ki > 0, decay with time. For small and therefore the necessary condition for stability is Re{i[c( k) − c( k)] k} < 0 for all k 1, ki > 0.
(2.79)
2.3 Propagation into an Unstable State
107
Separating the real and imaginary parts gives the necessary stability conditions k), ci ( k) = 0. (2.80) c> cr ( The first condition coincides with the intuitive statement in the preceding subsection that the velocity c of a stable front must exceed the propagation speed of small perturbations that is determined by the real part of the group velocity c. Vanishing imaginary part of the group velocity is the condition, that has appeared already in (2.75), insuring stability to changes of a local wave number of the emerging pattern. A nonlinear analysis of (2.77) is required to describe the evolution to the marginally stable profile. This analysis has also been carried out by van Saarloos (1988) in the long-scale approximation, assuming a slow spatial variation of k. Suppose that the amplitude of the propagating solution is monotonically decreasing, so that ϑ = θi is a monotonically increasing function of x. It is advantageous then to write the evolution equation of k taking ϑ, instead of x, as an independent variable changing in the direction of propagation. The transformation to the new variable is carried out using the relations (∂x )t = ki (∂ϑ )t ,
(∂t )x = (∂t )ϑ + (ϑt )x (∂ϑ )t ,
where (∂x )t denotes the differentiation with respect to x at t = const, etc., and the imaginary part of the right-hand side of (2.77) should be substituted for (ϑt )x . Then differentiating (2.77) with respect to ϑ yields kt = [c(k) − cr (k)] ki kϑ + (higher order terms).
(2.81)
The bracketed combination, that we denote now as C(k), is the same as in (2.78), except that it is now computed at a variable rather than constant value of k. When small terms, containing higher order derivatives with respect to ϑ and powers of kϑ , are omitted, we are left with what appears to be a standard first-order quasilinear PDE, but is generally a system of equations for ki , kr that is not even hyperbolic. The standard case is, however, recovered when the stability condition ci = 0 holds. Using this condition to fix the relation between kr and ki , C, which is now real, can be written as a function of ki only. Then it follows from (2.81) that k is conserved along a characteristic ϑt = −ki C(ki ). Since ki > 0, and C must be positive for a stable profile, the characteristics are directed toward decreasing ϑ. This supports our notion that the leading edge plays the premier role in shaping the emerging pattern: the causal propagation along the characteristics is directed toward the stable state. When C (ki ) < 0, steeper parts of the profile propagate back slower, and therefore dominate the leading edge of the front. Under these conditions, the front steepens in the course of evolution, and approaches the slope ki corresponding either to a minimum of C(ki ) or to the marginal value C(ki ) = 0.
108
2 Fronts and Interfaces
2.3.4 Pulled and Pushed Fronts The leading edge analysis allows us to predict with a high precision both the propagation velocity and the wavelength of the emerging pattern. Some caveats are, however, in order. The above analysis has all common drawbacks of both linear and long-scale theories. The front stable according to the leading edge criteria can be destabilized by some “invasion” mode involving rapid changes of the slope, or modified by nonlinear interactions to give way to a more rapidly propagating front, as shown below. The dispersion relation for the reaction–diffusion equation is ω(k) = i(α − Dk 2 ), so that c = −2iDk. The second condition (2.75) yields simply kr = 0; thus, as expected, no oscillations arise here, and both ω and k = iq are purely imaginary. Using c = ω/k= α/q + Dq and c = 2Dq, we see that C(q) = α/q − Dq vanishes at q = α/D, which coincides with the minimum on √ the dependence c(q). Thus, the marginally stable propagation speed c = 2 αD turns to be in this case also the slowest speed satisfying the stability condition (2.80). This simple result of the leading edge theory becomes, under certain circumstances, rather unlikely. Consider equation (2.3) with the standard cubic nonlinearity f (u) = u−u3 −µ. There is an exact solution determining the propagation speed or the front separating two stable states (Sect. 2.1.3). As one of the competing states approaches the bifurcation point µ = 2/33/2 where it becomes marginally stable, the propagation speed grows (see Fig. 2.2b), reaching the maximum value c = 3D/2 at the bifurcation point itself. On the other hand, the propagation speed into the same marginally stable state can be computed, as above, by approaching it along the branch of unstable states. Along this √ branch, the propagation speed predicted by the leading edge theory, c = 12 αD decreases with the decreasing derivative α = f (u0s ) and vanishes at the marginally stable point. The clue to this apparent contradiction is that the special propagating solution obtained in Sect. 2.1.3 is also applicable to a front separating a stable and an unstable state. Such a front, determined by the full nonlinear solution, is called “pushed”, as it is “pushed ahead” by an advancing stable state rather than “pulled along” by perturbations growing at the leading edge. If, say, the state u = u+ s is approached at x → −∞, this solution is expressed as √ 0 − u (x) = −(u − u0s )(u+ c = D/2(u+ s − u)/ 2D, s + us − 2us ), (2.82) 0 where u± s , us are defined by (2.15). The asymptotic value of the slope at the leading edge following from (2.82) is 0 d ln(u − u0s ) p(u0s ) u+ s − us √ q = , (2.83) = = dξ u − u0s 2 ξ→∞
2.3 Propagation into an Unstable State
109
which increases when u0s is shifted toward the marginally stable point µ = −2/33/2 ≈ −0.3849, contrary to a decrease of q = f (u0s ) predicted by the leading edge theory. At µ > µ ≈ −0.2078, the slope q exceeds q (Fig. 2.10a). The system chooses the propagating solution with the steepest slope, which now, unlike the generic situation in the linear leading edge theory, is also moving faster (Fig. 2.10b). The plot of the propagation speed defined by (2.82) against µ is tangential at µ = µ to the plot of the generic propagation speed c = 2Dq. The transition between the generic pulled front and the pushed front determined by the special nonlinear solution (2.82) occurs at µ = µ (Ben Jacob et al., 1985). Beyond this value, the pushed front, which is still faster but has a lower slope than the pulled one, has no physical significance. The reason why competition with nongeneric pushed fronts has not surfaced in the mathematically rigorous theories of Kolmogorov et al. (1937) and Aronson and Weinberger (1978) is that the special nonlinear solution (2.82), apparently, cannot be attained as a result of evolution starting from localized initial condition with u ≥ u0s . In problems of population dynamics, which gave motivation to the early theories, states with u < u0s = 0 are nonphysical, and, in any case, solutions of (2.5) with α > 0 starting from strictly nonnegative u initial conditions remain nonnegative at all times. On the other hand, if deviations from u = u0s of any sign are allowed, evolution to the pushed front can be understood in the following way (van Saarloos, 1989). Consider a propagating front of the state u = u− s , which is metastable at µ, slightly above the bifurcation value µ = −2/33/2 , into the unstable state u = u0s , being trailed by a transition front from u− s to , as shown in Fig. 2.11a. Sufficiently close to the the globally stable state u+ s bifurcation point, (actually, at |µ| > 0.3730 – see Fig. 2.10b), the trailing front moves faster, and catches on. As a result, the intermediate metastable state is exterminated, and u becomes a monotonically decreasing function of ξ, while the front evolves to the non generic profile (2.82). A more complex mechanism of relaxation to a pushed front is required at 0.2078 < |µ| < 0.3730 (a)
q D 1.2
(b)
c D 2
1 1.5
0.8 0.6
1
0.4 0.5
0.2 0.1
0.2
0.3
Μ
0.1
0.2
0.3
Μ
Fig. 2.10. Asymptotic slope (a) and velocity (b) of a pulled (solid c