A Concret e Approac h to Mathematica l Modellin g
This page intentionally left blank
A Concret e Approac h to Mathematica l Modellin g
Mike Mesterto η-Gibbons Department of Mathematics Florida State University, Tallahassee
A
W i l e y - l n t e r s c i e n c
e
P u b l i c a t i o n
JOHN WILEY & SONS, INC. N e w
Y o r k
•
C h i c h e s t e r
•
B r i s b a n e
•
T o r o n t o
•
S i n g a p o r e
Copyrigh t '
1995, 2 0 07 by John W i l e y & Sons, Inc. Al l rights reserved.
Published by John W i l e y & Sons, Inc., Hoboken, N ew Jersey. Published simultaneously in Canada. N o part of thi s publication may be reproduced, stored in a retrieval system, or transmitted in any for m or by any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except as permitte d under Section 107 or 108 of the 1976 United States Copyright Act , without either the prio r writte n permission of the Publisher, or authorization through payment of th e appropriat e per-copy fee to th e Copyright Clearance Center, Inc., 2 22 R o s e w o od Drive, Danvers, M A 0 1 9 2 3, (978) 7 5 0 - 8 4 0 0, fax (978) 7 5 0 - 4 4 7 0, or on the w eb at w w w . c o p y r i g h t . c o m. Requests to the Publisher for permission should be addressed to the Permissions Department, John W i l e y & Sons, Inc., 111 River Street, Hoboken, NJ 0 7 0 3 0, ( 2 0 1) 7 4 8 - 6 0 1 1, fax ( 2 0 1) 7 4 8 - 6 0 0 8, or onlin e at http://www.wiley.com/go/permission. Limi t of Liability/Disclaime r of Warranty : Whil e the publisher and author have used their best effort s in preparin g thi s book, they make no representations or warrantie s wit h respect to the accuracy or completeness of the contents of thi s book and specifically disclaim any implie d warrantie s of merchantabilit y or fitness for a particula r purpose. No warrant y may be created or extended by sales representatives or writte n sales materials. Th e advice and strategies contained herein may not be suitable for your situation. Y ou should consult wit h a professional where appropriate. Neither the publisher nor author shall be liabl e for any loss of profi t or any other commercial damages, includin g but not limite d t o special, incidental, consequential, or other damages. For general informatio n on our other products and services or for technical support, please contact our Customer Care Department withi n the United States at (800) 7 6 2 - 2 9 7 4, outside the United States at (317) 5 7 2 - 3 9 93 or fax ( 3 1 7) 5 7 2 - 4 0 0 2. Wile y also publishes it s books in a variety of electronic formats. S o me content that appears in prin t may not be available in electronic format . For informatio n about Wile y products, visit our w eb site at w w w . w i l e y . c o m.
Library
of Congress
Cataloging-in-Publication
ISBN 9 7 8 - 0 - 4 7 0 - 1 7 1 0 73-
10
9 8 7 6 5 4 3 21
Data is
available.
To thre e cherishe d nonmathematicians : t o my Mother who once said, "I f they pay you to do all those squiggles, small wonder the world’ s i n a mess."
t o my Father who said it was better than workin g in a factory.
and to Karen who says if you want to know the meaning of infinity , just ask someone whose spouse is writin g a math book.
This page intentionally left blank
PREFACE
Controversy has persisted in recent years over how to teach mathemati› cal modelling. There are two extreme schools of thought. One believes that a modelling course should have littl e structur e and be dominated by "case studies," open-ended exercises requirin g data collection and research. These might lead students down a great many unforeseen avenues of cre› ativit y but might also lead them nowhere. Th e other school believes that a modelling course should be highly structured and dominated by what, for want of a better phrase, I wil l refer to as "modellin g exercises." These are exercises that involve formulatio n and interpretatio n but bear a more certain relationship to the principa l content of the course. Between these tw o extremes, of course, li e many compromises, one of which form s the basis for thi s textbook. Before describing it, however, let me argue that there is an importan t sense in which the second school of thought should take precedence over the first . Most college major s in mathematics do not become professional mathematicians. Rather, they joi n the graduate workforc e as businesspeo ple, as financial planners, as politicians, or in a number of other careers, and it is far more importan t that they can understand, interpret , criticize, and appreciate the mathematical models of others than that they are able to develop their own models. Just as driver s need not buil d and repair their cars but should know how they work , so consumers of mathematical models need not produce them but should understand both their useful› ness and their limitations . Naturally , it remains desirable that math major s be able to develop their own models, but thi s is essential only to the few who subsequently make model development their career. On the other hand, the capacity to understand, interpret , criticize, and appreciate models is essential to all. Wit h thi s in mind, I have writte n thi s text for the deserving many, not simply a chosen few. Yet I have not neglected the specific needs of vi i
vii i
Prefac e
those w ho aspire to buildin g their own models, although I have not explicitly addressed them unti l relatively late in the book. Thi s is deliberate. Between the two extreme schools of thought thi s book has adopted a dy› namic compromise, in which it begins by espousing the second extreme and gradually evolves toward the first. Thi s approach enables the book to emphasize both the validation of mathematical models and the rational e behind improvin g them. Each of these features is novel, as wil l be clear to anyone familia r wit h Murth y and Rodin’s (1987) review of books on mathematical modelling. Thi s is a book about the process of modelling. It s approach is heuristic but systematic an d embodies my belief that the three most fundamental ideas in mathematical modelling are transience, permanence, and optimal› l y . Because models incorporatin g these ideas may adopt either a deter› ministi c or a probabilisti c viewpoint, there are six combinations of idea and viewpoint. These define the structur e of Chapters 1-3 and Chapters 5 -7 of the text, which proceed in parallel as depicted in the followin g diagram.
View
Idea
Transience
Chapter 1 Deterministic Growth and Decay. Dynamical Systems Probabilistic
Permanence Chapter 2 Equilibriu m
Optimalit y Chapter 3 Optimal Control and Utilit y
Chapter 5 Chapter 6 Chapter 7 Birt h and Death. Stationary Optimal Decision Probabilistic Systems Distribution s and Reward
I n applying these ideas, mathematical modellers are called upon to play conflictin g roles. On the one hand, they must be creative artists, assum› in g boldly perhaps what no one has assumed before. On the other hand, they must be critics, scrupulously doubting whether their models provid e an adequate description of reality . In practice, of course, the distinctions I have drawn between ideas, roles, and even viewpoints are artificial ; but it greatly benefits a beginning student of mathematical modelling to focus on a single aspect at a time, even though the other aspects cannot be en› tirel y ignored. Accordingly, the critica l aspect of modelling is the subject of Chapter 4, it s creative aspect the subject of Chapter 9, and the inter› face between the two the subject of Chapter 8. The remainder of the book, Chapters 1 0 - 1 2, is a reinforcement of the ideas developed in the first nine chapters.
Preface
ix
Th e goal of thi s book is to let readers acquire both critica l and cre› ative modelling skill s and the confidence to use them. Al l other matters are regarded as secondary. Thus, as far as is possible, technical mathemat› ical details are explored in exercises, or occasionally in footnotes, rather than in the main body of text. To distinguish such purely technical exer› cises fro m those that are more directl y related to the goals of the book, modelling exercises are denoted by a single asterisk and case studies by a double asterisk. But not every detail has found it s way int o a footnote or exercise, and the book cannot be used profitabl y unless pencil and paper at all times accompany the reader. The book is to be studied, not simply read. Th e book’s goal is pursued through a layered approach, wit h frequent revisitations to earlier sections, so that even the most sophisticated mod› els are perceived as merely natural outgrowths of less sophisticated ones. A s proclaimed in the title , thi s layered approach is unashamedly concrete. Philosophical points are not discussed unti l several illustrator y examples have already been introduced. Even then the discussion is brief, as at the beginning of Chapter 4, or in Chapter 9, where the art of adapting, extend› ing, and combining is first discussed formally , even though it characterizes every model developed in the text. At all times, I have tried to avoid un› necessary abstractions. I have taken particular care never to introduc e a utilit y function as F(x), wit h constraints on the signs of the derivatives of F; instead, I give the dependence of F on χ explicitly , so that proper› ties of the derivatives are self-evident. The loss of generality is more than compensated by the gain in comprehension. Indeed my experience suggests that the educational value of a modelling course to the average student is decided by thi s factor more than by any other. Thi s book is primaril y intended for a senior level course that gives equal weight to deterministic and probabilisti c modelling. Accordingly, min› imal mathematical prerequisites for mastery of it s entire contents are the standard calculus sequence (includin g the Newton-Raphson method) and first courses in linear algebra, ordinar y differentia l equations, and probabil › it y and statistics. Probabilit y and statistics are reviewed in Appendix 1. A few sections requir e access to computer packages for solving linear pro› grams or ordinar y differentia l equations (now almost universally available), whil e some knowledge of numerical analysis is desirable (though by no means necessary). A modelling course need not include the book’s entir e contents, however, and alternativ e uses are described in an accompanying instructor’ s manual. I n particular , there is ample material in Chapters 1 -4 and Chapters 8 - 11 for a course that requires no probabilit y and statistics. But thi s book is designed to be also suitable for study alone, perhaps by beginning graduate students or by professionals whose background in mathematical modelling is weak. For thi s reason, if an exercise is crucial
Prefac e
to later developments and of even moderate difficulty , then it s solution (or a possible solution) appears at the back of the book. I therefore assume that my readers are matur e enough not to consult a solution until a seri› ous attempt has been made at the problem. Solutions to most other exercises appear in the instructor’ s manual. By using plural s and genderless singulars, I have thus far avoided the vexed question of whether my reader is male or female. The lack of epicene pronouns and possessiv e adjectives in the English language is regrettable, and I have long advocated the use of "their " to mean "hi s or her." But grammarians may be offended by this, and the continual use of "hi s or her" is deplorably inelegant. I therefore felt that odd-numbered chapters should have one gender, even-numbered chapters another, and the toss of a coin decided that males would be odd, females even. Thus Chapters 1, 3, 5, 7, 9, and 11 are male, and Chapters 2, 4, 6, 8, 10, and 12 are fe› male. Thi s convention is not without minor inconveniences fo r example, the forester we meet in Chapter 3 has to change his sex before she enters Chapter 4 bu t thi s is surely preferable to the alternatives. Th e reviews of the first edition of thi s book have all been very positive and pleasing. I haven’t fixed what isn’t broken. Nevertheless, for thi s revised edition I have corrected all known errors, I have added a few exercises, and I have updated both the list of references and other time-sensitive material. Finally , thi s is a substantially original book. Th e models are based on the scientific literature , specifically, on the sources identified in Appendix 2. But I have made it a point of honor to personalize each model by derivin g it fro m scratch, startin g wit h a blank piece of paper and workin g through all the details myself. Thi s has led not only to differences of emphasis and approach but also to new extensions and variations. Moreover, not only are models freely adapted, they are presented here in a fresh perspective, as the inter › lockin g fragments of a mosaic. Thi s is my mosaic of the modelling process, carefully assembled fro m my teaching experience, in which every fragment contributes to the synthesis of a coherent picture. What the pictur e shows me is that even a modest amount of mathematics n o more than should be ex› pected of every college major in business, science, or engineering i s enough to describe a wid e variety of phenomena, offer penetrating insights, and con› tribut e effectively to rational decision making. If that is also what the pictur e shows my readers, then I shall be satisfied wit h what I have written .
Acknowledgemen t I am deeply indebted to the many scientists whose mathematical models have formed a basis for thi s textbook. I wish to express my thanks to all of them, and to each in a measure proportiona l to my indebtedness.
Acknowledgemen t
xl
I wish to thank Lou Gross for constructive and valuable criticis m of the original manuscript, Steve Blumsack and Christopher Fye for discovering er› rors, and Charli e Nam for suggestions concerning the literature . I wish also to thank John Wiley & Sons for their support, cooperation, and professionalism in producing thi s revised edition. Most of all, I would lik e to express my deepest gratitud e to Karen, my wife, in whose space and tim e thi s book was written . Withou t her patience, encouragement and humor, it would never have been possible to complete the manuscript. Tallahassee, Florida
M I K E
M e s t e r t o n - G i b b o n
s
This page intentionally left blank
CONTENTS
An ABC of modelling I
xix
The Deterministi c View
1 Growth and decay. Dynamical systems 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 1.10 1.11 1.12 1.13 1.14
Decay of pollution. Lake purification Radioactive decay Plant growth A simple ecosyste m A second simple ecosyste m Economic growth Metered growth (or decay) models Salmon dynamics A model of U.S. population growth Chemical dynamics More chemical dynamics Rowing dynamics Traffic dynamics Dimensionality, scaling, and units Exercises
2 Equilibrium
3 5 7 7 8 11 13 21 23 26 29 30 32 34 35 40 46
2.1 The equilibrium concentratio n of contaminan t in a lake 2.2 Rowing in equilibrium 2.3 How fast do cars drive through a tunnel? 2.4 Salmon equilibrium and limit cycles xli i
52 53 57 58
xl v
Content s
2.5 2.6 2.7 2.8
H o w much heat loss can double-glazing prevent? Wh y are pipes circular ? Equilibriu m shifts How quickl y must driver s react to preserve an equilibrium ? Exercises
Optima l control and utilit y 3.1 3.2 3.3 3.4 3.5 3.6 3.7
H o w fast should a bir d fly when migrating ? H o w big a pay increase should a professor receive? H o w many worker s should industr y employ? When should a forest be cut? H o w dense should traffi c be in a tunnel? H o w much pesticide should a crop grower use an d when? H o w many boats i n a fishing fleet should be operational? Exercises
63 66 71 76 83 91 93 95 103 104 109 111 115 119
II Validatin g a Model 4
Validation : accept, improve, or reject
127
4.1 4.2 4.3 4.4 4.5 4.6 4.7 4.8 4.9 4.10 4.11 4.12 4.13 4.14 4.15
127 128 129 130 132 136 138 142 146 148 151 154 157 159
A model of U.S. population growth Cleaning Lak e Ontari o Plant growth Th e speed of a boat Th e extent of bir d migratio n Th e speed of cars in a tunnel Th e stabilit y of cars in a tunnel Th e forest rotatio n tim e Crop spraying H ow righ t was Poiseuille? Competing species Predator-prey oscillations Sockeye swings, paradigms, and complexity Optimal fleet size and higher paradigms On the advantages of flexibility in prescriptiv e models Exercises
161 163
Content s
xv
III The Probabilisti c View 5
Birt h and death. Probabilistic dynamics 5.1 5.2 5.3 5.4 5.5 5.6 5.7 5.8
When wil l an old man die? Th e exponential distributio n When wil l Ν men die? A pur e death process Formin g a queue. A pur e birt h process How busy must a road be t o requir e a pedestrian crossing control? Th e rise and fall of the company executive Discrete models of a day in th e lif e of an elevator Bird s in a cage. A birt h and death chain Trees in a forest. A n absorbing birt h and death chain Exercises
6 Stationary distribution s 6.1 6.2 6.3 6.4 6.5 6.6 6.7
7
Th e certainty of death Elevator stationarity . Th e stationary birt h and death process H ow long is the queue at the checkout? A first look H ow long is the queue at the checkout? A second look H ow long must someone wait at the checkout? Another view Th e structur e of the work force When does a T-junctio n requir e a left-tur n lane? Exercises
Optimal decision and reward 7.1 7.2 7.3 7.4 7.5 7.6 7.7 7.8
How much should a buyer buy? A first look H ow many roses for Valentine’s Day? H ow much should a buyer buy? A second look H ow much should a retailer spend on advertising? H ow much should a buyer buy? A thir d look Wh y don’t fast-food restaurants guarantee service times any more? When should o ne barber employ another? Comparin g alternatives On the subjectiveness of decision making Exercises
175 180 183 185 187 189 193 198 2 00 2 02
208 2 10 2 13 215 2 17 219 225 227 2 34
237 237 2 43 245 247 253 2 58 2 63 267 268
xv i
Content s
IV The Art of Applicatio n 8
Using a model: choice and estimation 8.1 8.2 8.3 8.4 8.5 8.6 8.7 8.8
9
Protecting the cargo boat. A message in a bottl e Oil extraction. Choosing an optimal harvesting model Models withi n models. Choosing a behavioral response function Estimating parameters for fitted curves: an error control problem Assigning probabilities: a brief overview Empirica l probabilit y assignment Choosing theoretical distribution s and estimating their parameters Choosing a utilit y function. Cautious attitudes to risk Exercises
Buildin g a model: adapting, extending, and combining 9.1 9.2 9.3 9.4 9.5 9.6 9.7
H ow many papers should a news vendor buy? An adaptation Whic h trees in a forest should be felled? A combination Cleaning Lak e Ontario . A n adaptation Cleaning Lak e Ontario . A n extension Pure diffusion of pollutants. A combination Modellin g a population’s age structure. A first attempt Modellin g a population’s age structure. A second attempt Exercises
275 276 279 281 285 291 2 93 304 316 322 327 328 329 334 337 345 350 360 373
V Towar d More Advance d Model s 10
Further dynamical systems
383
10.1 10.2 10.3
383 389
10.4 10.5
How does a fetus get glucose fro m it s mother? A limit-cycl e ecosystem model D o es increasing the money supply raise or lower interest rates? Linearizin g time: Th e semi-Markov process. A n extension A more general semi-Markov process. A furthe r extension
393 398 406
Content s
10.6
11
409 412
Further flow and diffusion
416
11.1 11.2
417
11.3 11.4 11.5 11.6 11.7 11.8
12
Wh o wil l govern Britai n in the twenty-firs t century? A combination Exercises
xvl l
Unsteady heat conduction. An adaptation How does traffi c move after the trai n has gone by? A first look How does traffi c move after the trai n has gone by? A second look Avoidin g a crash at the other end. A combination Spreading canal pollution . An adaptation Flow and diffusion in a tube: a generic model River cleaning. Th e Streeter-Phelps model Wh y does a stopped organ pipe sound an octave lower than an open one? Exercises
Further optimization 12.1 12.2 12.3 12.4 12.5 12.6
Findin g an optimal policy by dynamic programmin g Th e interviewer’ s dilemma. An optimal stopping problem A faculty hirin g model Th e motorist’ s dilemma. Choosing the optimal parkin g space How should a bir d select worms? A n adaptation Where should an insect lay eggs? A combination Exercises
421 423 429 433 436 440 446 4 54 458 458 465 4 70 475 479 496 507
Epilogue
514
Appendix 1: A review of probabilit y and statistics
516
Appendix 2: Models, sources, and furthe r reading arranged by discipline
531
Solutions to selected exercises
539
References
583
Index
591
This page intentionally left blank
AN AB C OF MODELLIN G
is fo r Assume . I f your mathematical experience has taught you never to assume what you are not given, then thi s book wil l startl e you. What you are given is rarel y enough, so you wil l have to make assumptions abou t what is importan t and what is not, about what is assured beyond reasonable doubt and what i s still open to question. Indeed, in a very real sense, a model is simply the assumptions you make. Mathematics enables you to deduce, fro m those assumptions, conclusions which (a) might otherwise not be so readily ap› parent and (b) can be compared wit h observations of the real phenomenon that your abstract model attempts t o explain. The degree of correspon› dence determines the value of the model. Poor agreement does not (or should not!) suggest that the mathematics is wrong, however, but rather that one (or more) of the assumptions you made is of doubtful validity . Then you modify your model (i.e., modify your assumptions), and the merry-go-roun d begins again.
is fo r Borrow . Wh y borrow ? A mathematical model is an attempt to capture, in abstract form , the essential characteristics of an observed phenomenon. Th e success of the attempt depends as much (if not more) on the modeller’s empirical xi x
xx
A n AB C of Modellin g
knowledge of that phenomenon as on her or his mathematical ability . What do you do if you have neither the knowledge nor the tim e to acquire it ? Th e answer is that you borro w your assumptions, fro m the scientific literatur e or fro m more experienced colleagues (being sure, of course, t o acknowledge your sources). Wit h due respect t o geniuses, it is much more practical t o buil d upon existing models than it is to start fro m scratch. So you must be prepared to borro w freely. Yet therein lies a danger, the danger that you wil l accept too readily the authorit y of the printe d word . Hence . ..
is fo r Criticize . You must be prepared to criticize, too; prepared t o criticiz e not only your own assumptions but also those you have borrowed fro m other people. Wh o is t o say if they are righ t or wrong? Th e answer is you! Modellin g is an iterativ e process. You begin by assuming or borrowing ; wit h the help of mathematics, you reach conclusions; you criticiz e them; if you are not satisfied then you assume or borro w again, conclude and criticiz e again, and so on, unti l eventually you are satisfied (that the model explains th e observations). Don’t forget the ABC . Assume. Borrow . Criticize .
D
is for , amon g othe r things , Decay .
Whic h bring s us nicely t o Chapter 1.
A Concret e Approac h to Mathematica l Modellin g
This page intentionally left blank
Ζί GROWTH AND DECAY I DYNAMICA L SYSTEMS
One of the most useful concepts in mathematical modelling is that of net specific growth rate. We’ll begin thi s chapter by defining and derivin g an expression for it . At the same time, we’ll introduc e two of the most useful notations in applied mathematics, namely "bi g oh" and "littl e oh." Then, in several examples, we’ll see how useful net specific growth rat e can be. Let x(t) denote an appropriat e numerical measure, at tim e t, of the size or magnitude of a certain population. Examples of population magnitudes would be the number of million s of human beings in the world , the number of million s of dollar s in a firm’s capital stock, the dr y weight in kilogram s of a plant (which is just a population of cells), the biomass in tonnes of a fish population, and so on. Let b denote the rat e at which unit s are born or added t o the population for each existing unit of population; b is called th e instantaneous specific birt h rate. Then the number of unit s actually added to the population, in an infinitesimal interval of length St, is given approximately by b • 6t x. Wh y is it not exactly b-St-χΊ We supplied the adjective "instantaneous" above because b is generally changing wit h time; i.e., b - b(t). Thus, dur › ing the infinitesimal interval [/, t + 6t), b increases fro m b{t) to b{t + St). Similarly , χ increases fro m x(t) to x{t + 6t). On the other hand, the interval [/, / + St) is so short that, durin g it , b wil l not differ very much fro m b(t) and χ wil l not differ very much fro m x(0- We are assuming, of course, that b and χ are at least continuous functions of V, and we are about to assume that χ is also differentiable. I n a pur e mathematics text, we might feel obliged t o state such assumptions explicitl y whenever they were made. I n the process of modelling, however, the repetition of such purely math› ematical assumptions is apt to be distracting. We shall therefore assume, once and for all, that all functions used in thi s text have derivatives of as high an order as is necessary, the existence of the first derivativ e implyin g 3
4
Chapte r 1 Growt h and Decay . Dynamica l System *
continuity . Hence b = b(t) + terms that tend to zero as St
0;
χ = x(t) + terms that tend to zero as St
0.
But thi s is rather clumsy, so we introduc e some new notation. We define "bi g oh" by 0.
0{St) = terms that tend to zero as St
(1.1)
Thus, in "bi g oh" notation, b - b{t) + 0(St) and = x{t) + 0(6t). W e can now be more precise about the number o f unit s actually added t o the population in th e infinitesimal interval [t, t + St). I t is {b{t) + 0(St)}
.
• St • {x(t) + 0(St)}
(1.2)
Let d denote the rat e at which unit s di e or are removed fro m the population for each existing unit of population; d is called th e instantaneous specific death rate. Then th e number o f unit s actually removed fro m the population in th e infinitesimal interval [t, t + St) is {d(t) + 0(St)}
(1.3)
• St • {x(t) + 0(6t)),
by an argument similar t o that used above. Th e difference between (1.2) and (1.3) is the net number of unit s added to the population in the infinitesimal interval [/, t + 8t). But thi s is just the amount by which x(t) increases. Hence, writin g b in place of b(t), x{t + 6t)-
x(t) ={b+
0(St)}
-6ί·{χ+
0(St)) -{d+
0(St)} -St-{x+
0(6t)}. (1.4)
W e now define the net specific growth rat e μ t o be the net rat e at which unit s are added t o the population for each existing unit . Thu s i s the difference between the instantaneous specific birt h rat e b and the instantaneous specific death rat e d; i.e., μ = b- d. But fro m (1.4) we have xit + 6t)-x(t)
=
{
b
+
o
m
{
χ
+
0
{
6
t
)
_
}
{d+
o{6t)}
{x+
0{6t)}
. (1.5)
Takin g th e limi t as St — 0 (assumed t o exist), we have ^
= bx-dx=(b-d)x.
(1.6)
Hence μ=-
1 dx χ
Τ
ι
.
. . (1-7)
N o t e that x{t) is assumed t o be differentiabl e and hence continuous. A n appropriat e unit of magnitude is therefore very much larger than a typical increase (or decrease) in population. For example, we might count th e U. S. population in millions , because a millio n people is very much
1.1
Decay of Pollution . Lak e Purificatio n
5
mor e than the (discrete) number of people that can be added (are born) or removed (die) at any given instant. Note also that (1.4), though considerably tidier than if we had writte n 0(St) in words, is still rather clumsy. We can tid y it up a littl e bit by expanding the right-han d side to obtain (b - d)xSt + (b - d + x)St • 0(St) + St • 0(St ). (I n obtaining thi s expression, you should bear in mind that 0(St) - 0(6t) i s not zero but still 0(8t); whereas 0(St) • 0(St) = 0(St ).) We can tid y it up even more by writin g it as (b - d)xSt + 0(St). Unfortunately , thi s last expression, although correct, would not enable us to deduce (1.5), because w e cannot be sure that the result of dividin g O(St) by St would tend to zero as St 0. Thi s leads us naturall y to define "littl e oh" by 2
2
. _ Terms that are so small that we can divide them by ~~ St and the result will still tend to zero as <5i 0.
. ...
I t follows immediately that 6t • 0(61) = o(6t). Thi s allows us to writ e the right-han d side of (1.5) very succinctly as (b- d)x+ o(6t) and still retain sufficient informatio n to deduce equation (1.6). Littl e oh notation wil l be very useful later, particularl y in Chapter 5. By itself, (1.7) is not a mathematical model. It is simply a definitio n of th e net specific growth rat e μ, which might be a function of x, t, and a whole host of other variables and parameters. It may become a mathematical model, however, as soon as assumptions are made about the for m of that functio n (e.g., linear or quadrati c in x, independent of t, etc.). I n thi s book, th e source of these assumptions wil l usually be either borrowed knowledge or native wit (conceptual approach); but it could just as easily be supporting data (empirical approach), or some ad hoc combination of the two. N o source is invariabl y best in the initia l stages of modelling a phenomenon, though the ultimat e test of a model’s wort h is often it s abilit y to predict observable data. We’ll discuss that last point in Chapter 4. N ow let’s see the examples.
1.1
Decay of Pollution . Lak e Purificatio n
Let’ s consider a population of particles that contaminate a lake. Assume that the lake has constant volume Kcubi c meters. I f the lake is well mixed, then contamination wil l be almost unifor m throughout, and an appropriat e measure of the extent of pollutio n at tim e t wil l be the number of grams of contaminant per cubic meter of lake. We’ll denote thi s magnitude by x(t) and follow convention by calling it the concentration (of contaminant). Let r denote the rat e at which water flows out of the lake in cubic meters per day. Because the lake volume is constant, thi s must also be the rat e at which water flows in; there might, for example, be a balance between rainfal l and evaporation. I f all pollutio n input suddenly ceases , how much tim e wil l lapse before the level of pollutio n is reduced to 5% of it s initia l
Chapte r 1 Growt h and Decay . Dynamica l Sy»tem »
value? We have Rate of Change _ Pollution of Pollution Inflow -
4-Mt)-y}
=
0
Pollution Outflow
(1.9a)
rx{t),
whence \_dx _
_r_
(1.9b)
xdt~~V
Thi s is a special case of (1.7) wit h μ = -d = -rIV < 0. Th e net specific growt h rat e is strictl y negative, corresponding t o the decay of th e pollution . Let’ s assume that r is constant. Then (1.9) becomes a model, and (1.9b) i s readily solved t o yield x(t) = x(0)e\p(-rt/V)
,-rllV
= χ(0)β'
(1.10)
where exp denotes the exponential function and e = e x p ( l ). According t o th e model, the pollutio n decays t o 0.05x(0) in tim e V V IV = - l n ( 0 . 0 5 )- = l n ( 2 0 )- w , ( 1 . —) ….05 r r r where In denotes the natural logarith m (see Exercise i . l ) . W e could apply thi s result to the Great Lakes of Nort h America. Ac› cordin g to Rainey (1967, p. 1242), Lak e Erie, Lak e Michigan, and Lak e Superior have volumes 4 58 χ 10 , 4871 χ 1 0 and 12,221 χ 1 0 cubic meters, respectively; and their respective mean outflows are 479,582,208 ; 433,092,096; and 178,619,904 cubic meters per day. (Rainey quotes the outflow s in terms of liter s per second, so you must multipl y his figures by 24 χ 60 χ 60 -f- 1 0 = 86.4 for conversion to cubic meters per day.) Thus, for Lak e Erie, we have i os « 2861 days or 7.8 years. Similarly , f .05 « 3 3 , 6 93 days or 92 years for Lak e Michigan, and i .os « 2 0 4 , 9 65 days or 5 62 years for Lak e Superior. These values must, of course, be interpreted in the light of the initia l pollutio n levels x(0). 9
9
9
3
a
0
0
Our model is riddle d wit h assumptions. We have assumed that r is con› stant; maybe it varies seasonally. We have assumed that χ does not vary across the lake; maybe mixin g is insufficient t o justif y thi s assumption. We would not expect seasonal variatio n to matter much, however (see Exer› cise 1.1), and we would expect poor mixin g t o prolong th e cleaning. It’ s therefor e reasonable to suppose that (1.11) represents a lower bound th e most optimisti c cleaning time an d we have derived thi s useful piece of informatio n fro m a very simple model. Observe that, despite th e cessation of pollutio n input , (1-10) predicts that our lake can never be thoroughly purifie d in a finite time. D o es thi s make sense t o you? Perhaps you would lik e t o thin k about that. We’ll retur n t o the subject of lake purificatio n in Chapters 4 and 9.
1.3
1.2
Plan t Growt h
7
Radioactiv e Decay
Let’ s consider the population of radioactive atoms in some isotope of a chemical element, i.e., in a for m of the element wit h a given number of neutrons in the nucleus (all form s of the nucleus have the same number of protons). The conventional measure of that population’s size at tim e t is simply the number of such atoms present. Let thi s be denoted by x(t). We borro w fro m physical chemistry the result that radioactive isotopes decay at a constant specific rate, say º . Then (1.7) becomes a mathematical model wit h μ = -d = - A . Th e number of atoms is reduced by a factor of 2 in tim e
Thi s tim e is known as the half-lif e of the isotope. For example, the half-lif e of carbon-14, the isotope of carbon wit h 8 neutrons (and the obligatory 6 protons) in it s nucleus, is about 5,700 years. Note that the models introduced in Sections 1.1 and 1.2 have a com› mon mathematical structure. They are both examples of what is often re› ferred to as exponential decay.
1.3
Plan t Growt h
Let x(t) denote the dr y weight at tim e t of a plant that feeds off a fixed amount of a single substrate. Let the weight of substrate that remains at tim e / be denoted by S(t). Th e more substrate there is, the greater the specific growth rat e of the plant; the less substrate, the slower the growth. Th e simplest hypothesis that incorporates thi s observation is that (1.13)
μ = kS,
where A: is a constant. Note that (1.13) is not the only hypothesis incorporatin g the obser› and vation. Two of the infinitel y many other possibilities are μ = kS μ = kS . I n the absence of furthe r informatio n about the plant, however, we have no way of distinguishing between these possibilities. We therefore adopt the simplest. It might be a good hypothesis; if not, then we can alter it later. Th e rational e behind thi s strategy wil l be studied in Chapter 4. Adoptin g (1.13) and substituting int o (1.7): vl
411
(1.14) Let’ s assume no material is lost when 5 is converted int o x, i.e., that dx =
8
Chapte r 1 Growt h and Decay . Dynamica l System *
•
k.t i f
Fig. 1.1 Plant growth according to (1.16). The graph has been plotted in dimensionless variables, which will be discussed in Section 1.14; see (1.91). Meanwhile note that for given values of k, Xy, and x(0), the value of χ can be deduced from thi s diagram for any value of (. and (1.7) becomes a plant growth model, wit h μ = k{Xf-x). of thi s differentia l equation (Exercise 1.2) is ,. A
t
)
Th e solution
x{0)Xf
.. -
~ MP) + (x - JC(0)) e x p (- kx t) f
f
(
-
'
and is depicted in Fig. 1.1. Note that the graph is (mildly ) 5-shaped. It bends upward toward an inflection point, where x(t) = 0.5xp and then bends downward, approaching the horizontal asymptote χ = χ/ as t —• oo. Growt h according t o (1.15) or (1.16) is generally described as logistic. Observe that a real plant actually attains it s maximum dr y weight withi n a finite time; whereas (1.16) predicts that x(t) merely approaches Xf as t -* oo. A s we remarked in our AB C of modelling, however, a model attempts only t o capture the essential features of a phenomenon, not mimi c it in every respect. Empirica l data wil l determine the ultimat e wort h of the model con› tained in (1.15) or (1.16), but we were able t o derive it fro m a purely con› ceptual approach. I n fact (1.16) gives a fairl y good description of annual plant growth for appropriat e values of k and x \ see Thornley (1976). f
1.4
A Simpl e Ecosyste m
Let x{l) denote the number of thousands (say) of individuals, at tim e t, in a population of herbivores. Let y(t) be the corresponding size of a carnivor e
1.4
A Simpl e Ecosyste m
9
population. The carnivores eat the herbivores, and the herbivores eat grass. Thi s is the simple ecosystem that we shall attempt to model. By definition , the specific growth rates for the two populations are \dx
\dy
Let’ s borro w fro m biology: populations tend t o grow exponentially, i.e., at a constant specific rate, unti l some other factor (e.g., crowding, disease, predators) interferes wit h that growth. Hence, in the absence of carnivores, we might propose the followin g model for herbivor e growth: , = fl,, where a, > 0 is a constant, thi s positive net growth rat e for the herbivor e pop› ulatio n being the difference between a positive birt h rat e and a smaller positive death rate. But there are some carnivores, whose effect wil l be t o diminish the growth rat e of the herbivor e population. The simplest as› sumption we can make is that thi s decrease wil l be proportiona l to the number of carnivores. Hence /ii=fl i - V >
(1.18)
where b > 0 is a constant. Similarly , in the absence of herbivores, the carnivor e population would di e off exponentially (assuming that carnivores don’t eat grass). Th e appro› priat e model for thi s would be μ = -a , where a > 0 is constant. But ther e are some herbivores, whose effect wil l be to enlarge the growth rat e of th e carnivor e population. Let us again make the simplest assumption, i.e., that thi s increase wil l be proportiona l t o the number of herbivores. Then t
2
2
μ = -α 2
2
2
(1.19)
+ ΰ χ, 2
where b > 0 is a constant. From (1.17) (1.19) , we obtain the followin g pair of ordinar y differentia l equations for the growth and decay of the tw o populations in our simple ecosystem: 2
1
dx
,
\dy
œ¸
,
~yTt=- *
.,
+ *-
a
b
Λ η
.
( L 2 0 )
These equations, known as the Lotka-Volterr a equations, constitute a mathematical model in which a , a are pur e growth and decay rates and b , b are interaction parameters. As simple as they look, equations (1.20) cannot be solved analytically for χ and y as explicit functions of / in the same way that we solved (1.15) to obtain (1.16). They can, however, be solved "numerically, " i.e., by utilizin g a computer package, for any given values of a , b , a , b , x{0) and y(0). For a = 3, a = 5/2, b = 2, b = 1, x(0) = 1, and j>(0) = 1, the solution is plotted in Fig. 1.2. Th e IMS L computer package D V E R K produced these graphs, and it might be a useful exercise for you t o duplicate them (your computer center wil l have th e package, or a similar one, and wil l be able to show you how to use it) . {
x
x
2
2
2
{
2
2
{
2
K
10
Chapte r 1 Growt h and Decay . Dynamica l System *
.v.
Fig. 1.2 Solutions to (1.20) when a, = 3, a = 5/2, A, = 2, and b = 1. The solid curve is x(t); the dashed curve, y(t). 2
2
N o t e that the graphs of χ and y repeat themselves every 2.4 unit s of time. W e say that χ and y are periodic or cyclic, wit h period 2.4. Pair s of values (x(t),y(t)), representing Fig. 1.2’s solution in th e x-y plane, for m the outermost of th e closed curves depicted in Fig. 1.3. Th e arrow s denote the direction in which tim e increases. Th e remaining curves were obtained by repeating the entir e procedure for different values of (x(0),y(0)), namely, ( 3 / 2 , 1 ), (2,1), ( 5 / 2 , 2 ), and ( 3 , 3 / 2 ). Th e dot denotes th e degenerate closed curve (x(t),y{t)) = ( 5 / 2 , 3 / 2 ).
Ø ο Fig. 1.3 Phase-plane topology for solutions to (1.20). Curves were drawn for a = 3, a = 5/2, b = 2, b — 1, and for various values of x(0), y(0). Tim e increases in the direction of the arrows. See Exercise 1.3 for more details. x
2
t
2
1.5
A Secon d Simpl e Ecosyste m
11
Althoug h thi s diagram was drawn for a, = 3, a = 5/2, b = 2, and b = 1, it would look the same for any other set of parameter values in th e sense that all diagrams would be topologically equivalent. That’ s rather fortunate , because the particula r values chosen for illustratio n have no eco› logical significance! Fig. 1.3 is an example of a phase-plane diagram. An › other one appears in the followin g section, and they are furthe r discussed in Chapter 2. For any values of a,, b a , and b , the phase-plane diagram contains a degenerate closed curve (x(t),y(t)) = (ατ)ύ ,α^ ), which repre› sents a possible state of the ecosystem. Mor e generally, however, the model suggests a continual cycle of growth and decay. How good is thi s model ho w realistic are it s assumptions? That’ s an interesting and importan t question, but we’ll put it aside unti l Chapter 4. Meanwhile, if you are unfamilia r wit h diagrams lik e Fig. 1.3 (or Fig. 1.4.), then tr y Exercise 1.5. 2
{
2
lt
2
2
2
1.5
χ
A Secon d Simpl e Ecosyste m
Thi s time, let x(t) and y{t) denote th e numbers of thousands (say) of in› dividuals, at tim e t, in populations of tw o species that compete for the same food supply (herbivores for grass, say). Definition s (1.17) still apply, of course, but the model wil l have t o be altered. Thi s time, each species would grow exponentially in th e absence of the other; whereas, put together, each species would have a restrainin g effect on th e food supply of the other. We would expect thi s effect t o manifest itself as a decrease in growth rate. Let’ s assume that th e decrease for one population is proportiona l t o the size of the other population. Th e model we propose is therefore μ^ = a^-b^y,
(1.21)
μ = α -^χ, 2
2
where a , a are pur e growth rates and by, b are interaction (crowding) parameters. Th e growth or decay of the tw o populations is thus described by the pair of ordinar y differentia l equations {
2
2
1 dx x T t
, =
a
^
b
^
1 dy y T t
, =
a
* -
b
^
{
L
2
2
)
often called Gause’s equations; see, for example, Pielou (1977, p. 75). Th e first of th e equations agrees wit h (1.20), but th e second is different . Again, these seemingly innocuous equations can be solved completely only by numerical means. Nevertheless, by a similar procedure t o th e one used in Section 1.4, it can be shown that pair s of values (x(t), y(t)), representing the solutions t o (1.22) in the x-y plane, for m curves lik e those depicted in Fig. 1.4 (see Exercise 1.4). Thi s phase-plane diagram was drawn for a, = 3, a - 5/2, Z>, = 2, and b = 1; but the topology would be unaltered if we changed th e parameter values. Notice that all trajectorie s below the dashed curve 2
2
12
Chapte r 1 Growt h and Decay . Dynamica l Sy»tem »
y
A
5
4
3 2
2
0
3
4
5
Fig. 1.4 Phase-plane topology for solutions to (1.22). Curves were drawn for a = 3, a = 5/2, b = 2, b = 1, and for various values of x(0), y(0). The dashed curve is known as a separatrix. As in Fig. 1.3, tim e increases in the direction of the arrows. See Exercise 1.4 for more details. t
2
{
2
ON ultimatel y approach the x-axis, whereas all trajectorie s above ON ul› timatel y approach the y-axis. Because it’ s really too remarkabl e a coinci› dence that the point (x(0),y{0)) would just happen t o li e on th e special curv e ON (isn’t it?), our model suggests the ultimat e extinction of one or other of the tw o species, depending on the initia l population magnitudes. H o w good is thi s model ho w realistic are it s assumptions? Perhaps you would lik e t o consider that question; we’ll retur n t o it in Chapter 4. Meanwhile, before proceeding, we pause to observe that our simple ecosystem model is easily generalized to describe interactions among an arbitrar y number, n, of species, which we shall label as i = \,...,n. Let xXt) denote the population in thousands (say) of species Øat tim e t, i = 1, ..., n. Then the specific growth rate of species /’ is 1 dXf
(1.23)
These η equations are still just definitions, but they become a model as soon as we make assumptions about the for m of ,< . Let’ s suppose that μ, = / ^ ( , , Æ ), where = (x x ,...,x„) is an -dimensional column vector, Æ = (a a a ) is an m-dimensional vector of parameters, and a superscript Τ denotes transpose. Then our -species model has th e T
u
r
lt
2
m
2
1.6
Economi c Growt h
13
mathematical structur e of a system of η ordinar y differentia l equations: ~
= fi(x, t, a) = , ,
, /, a),
i - 1 , . . ., η.
(1.24)
Th e generic term for growth and decay is dynamics, and therefore the model (1.24) is said to for m a dynamical system. In exceptional circum› stances, an equivalent mathematical model of the for m x,(0 = 6 ( i ; x . a ) ,
Ø= 1
(1.25)
n,
where x = x(0) is an arbitrar y vector of initia l conditions and £,• a suitable function, may be deduced fro m (1.24). We saw thi s happen in Section 1.1, wit h χι = χ, η = 1, m = 1, and cti = r/V. We also saw it happen in Sec› tion 1.3, wit h Χι = χ, η = 1, m = 2, a = k, and a = X/. In thi s and the previous section, however, wit h η = 2, m = 4, and a = {a a , b\, b ), we saw only the for m (1.24); (1.25) was implici t in Fig. 1.3 and in Fig. 1.4, but we were unable to deduce it s for m explicitly . Althoug h th e differentia l equations (1.24) always for m a dynamical system, dynamical systems need not have the for m (1.24). A nondifferential dynamical system wil l first appear in Section 1.6. Dynamical systems expressed in terms of recurrence relations wil l first appear in Sections 1.7 and 1.8. A dynamical system expressed in terms of differential-delay equa› tion s wil l appear in Section 1.13. x
2
T
h
1.6
2
2
Economi c Growt h
A s we said at the beginning of the chapter, a model’s assumptions may be suggested either conceptually (by native wit ) or empiricall y (by supporting data). Hithert o we have been followin g th e conceptual approach. N ow let’s tak e the empirical one. For th e most part , the quantit y of goods produced by a society in› creases wit h time; or, which is exactly the same thing, th e society experi› ences economic growth. Why? Because manufacturers increase their output by hirin g more worker s and acquirin g more building s and machinery for them. But if thi s increased output must be shared by an increased work force, wil l anyone really be better off? Let’ s attempt t o answer thi s question by constructing a simple mathematical model. Let L(t) denote a suitable measure of th e amount of labor employed at tim e t, where t is measured in years, in the manufacturin g sector of a certain economy; for example, th e economy of Massachusetts. Let (2(0 denote the instantaneous annual output at tim e t, i.e., th e quantit y of goods per year produced at tim e t by thi s labor force. What do we mean by goods per year at tim e f? We mean that if the production rat e could somehow be held constant for a whole year beginning at tim e t, then the amount of goods produced in that year would be QXt). Provided, as we have assumed,
14
Chapte r 1
Growt h and Decay . Dynamica l System *
that tim e is measured in years, thi s is exactly the same thin g as saying that th e amount of goods produced in the short interval [t - bill, ι + Stll] is Q£t)5t + o(6t), or that the amount of goods produced in s years beginning at tim e t is ft+S
(1.26)
QXr)dr,
j
th e error term vanishing in the limi t of integration. Because "instantaneous annual output" is rather a mouthful , we’ll refer t o Q simply as output. I n producing thi s output, worker s need buildings, raw materials, ma› chinery, tools, and a variety of other aids. We’ll refer t o these aids collec› tivel y as capital stock, or simply capital. Let K{t) denote capital at tim e t. H o w should we measure the amount of labor i n numbers of work › ers, in numbers of hours worked, or in term s of some other unit ? An d how should we measure the economy’s output? Because we are primaril y interested in how things are growing rather than how big they are, we can temporaril y avoid these questions by defining suitable indices. We define a labor index by
w Wr
"
)s
(l
27a)
I t compares the amount of labor being used at tim e t t o the amount being used at tim e zero. The index i is independent of the unit of measurement for labor. Massachusetts, for example, estimated that it s amount of labor increased by 30% between 1899 and 1905 (Douglas, 1934, p. 160; see also Table 1.1). If we assume, arbitrarily , that t = 0 corresponds t o 1899, then i {6) = 1.3, regardless of the amount of labor actually employed at either time. I n a similar vein, we can define capital and output indices by L
L
Μ
K(oy
d . 2 7 b)
i ( t ) = M lQ{l)
-Qxoy
For example, Massachusetts estimated that capital increased by 37% and output by 42% between 1899 and 1905. Thus i (6}= 1.37 and / ( 6) = 1.42. Lik e i , the indices i and iq are independent of their corresponding unit s of measurement. Al l three indices are said t o be "dimensionless" (we’ll discuss dimensionality in Section 1.14). Indices for the years 1890 t o 1926 are presented in Table 1.1. Notice fro m th e final column of thi s table that, on the whole, output increased wit h time, even though there were years lik e 1908 when it fell temporarily . Labor and capital also increased on the whole. But how was thi s increased output related to labor and capital? Were these data the manifestation of some economic law? I n the early part of thi s century, thi s question was addressed by econ› omists C. W. Cobb and P. H. Douglas, who came t o the conclusion that ther e was indeed such a law; for details, see Douglas (1934), on which thi s K
L
K
Q
1.6
Economi c Growt h
15
Table 1.1 Variatio n with tim e of capital, labor, and output indices. 1
<*«)
-9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9
0.95 0.96 0.99 0.96 0.93 0.86 0.82 0.92 0.92 1.00 1.04 1.06 1.16 1.22 1.27 1.37 1.44 1.53 1.57
’ (0
t
<*«)
'LW
i (t)
0.72 0.78 0.84 0.73 0.72 0.83 0.81 0.93 0.96 1.00 1.05 1.18 1.29 1.30 1.30 1.42 1.50 1.52 1.46
10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27
2.05 2.51 2.63 2.74 2.82 3.24 3.24 3.61 4.10 4.36 4.77 4.75 4.54 4.54 4.58 4.58 4.58 4.54
1.43 1.58 1.59 1.66 1.68 1.65 1.62 1.86 1.93 1.96 1.95 1.90 1.58 1.67 1.82 1.60 1.61 1.64
1.60 1.69 1.81 1.93 1.95 2.01 2.00 2.09 1.96 2.20 2.12 2.16 2.08 2.24 2.56 2.34 2.45 2.58
Q
0.78 0.81 0.85 0.77 0.72 0.84 0.81 0.89 0.91 1.00 1.05 1.08 1.18 1.22 1.17 1.30 1.39 1.47 1.31
Q
Data refer to the Massachusetts economy in the years from 1890 (r = - 9) unti l 1926 (r = 27); see Douglas (1934, p. 160).
section is based. We can appreciate their work most readily by defining tw o new variables: ( 0 Ξ ΐ η ( £ ) .
*(0Ξΐη( 2).
(1.28)
Th e usefulness of these definition s wil l shortly emerge. For integer values of / between - 9 and 27, ξ(ή and φ(ί) may be derived fro m Table 1.1, and these values are plotted in Fig. 1.5. N o t i ce that, wit h the exception of a few outlyin g point s such as that representing 1917, the point s in thi s diagram li e fairl y close to the lin e drawn through the origin . Now, suppose that we wish t o capture the essential features of the way in which labor and capital determined economic growth in Massachusetts i n the years between 1890 and 1926. I n other words, suppose that we wish t o have a mathematical model of that growth. Wouldn’ t it be reasonable t o approximat e the informatio n in the data point s in Fig. 1.5 by the straight lin e through the origin ? Because the lin e has slope 3/4, we would thus obtain ψ(ί) = 3 (/)/ 4 or, in view of (1.28),
' ω = {^ω} {/*ω}'· 34 /
2
4 /
α· ) 29
16
Chapte r 1 Growt h and Decay . Dynamica l System *
t
1901 & 1902
Γ
*
-0.5
- 1.0 —Γ
ι
ι
ι
ι
ι
ι
"~i
Γ"
ι
ι m
•44
Λ m
y
y ' m
•• »’ y
••
·' m m _
·
••,* φ*
•
•
my
y
-0.5
·
•1917 «
- 1.0
Fig. 1.5 Plot of φ against ζ for the data in Table 1.1; and φ are defined by (1.28). There are 36, not 37, data points because the uppermost point represents both 1901 and 1902. Indeed, (1.29) might even be a better description of overall economic growt h than th e diagram itself, because even the briefest of glances at Fig. 1.5 suggests that output is abnormal in certain years (e.g., 1917); and such abnormalities may be associated wit h the outlyin g points. We might therefor e propose (1.29) as a model of economic growth in Massachusetts. A possible criticis m of thi s proposal immediately springs t o mind. Sup› pose we accept that there is some lin e that captures the essential features of the distributio n of point s in Fig. 1.5. Then the lin e must certainly pass throug h the origin , as a direct consequence of definition s (1.27) and (1.28). But , having fitted the lin e in Fig. 1.5 to the data by eye, how do we know that slope 3/4 is the one that fits best? Th e answer is that we don’t; perhaps th e best slope is as small as 0.7 or as big as 0.8. Therefore, let’s simply call it 7, where 0 < 7 < I . Then, instead of (1.29), we have
/ (o={/L (m {/*(m'- . 7
Q
7
(1-30)
Th e tru e value of the best slope, in an appropriat e sense t o be defined in Section 8.4, and assuming that the data in Table 1.1 are exact, is actually 0.734; see (8.20). But the data in Table 1.1 are themselves only estimates, and greater accuracy than we determined by eye may not be relevant. A second criticis m might be that, however good thi s model is for Mas› sachusetts, it wil l fail t o describe economic growth in Vermont or N ew
1.6
Economi c Growt h
17
Hampshire. But if these economies were qualitativel y similar t o that of Massachusetts, then wouldn’t we still expect them to yield a diagram lik e Fig. 1.5, though the points would li e in different places and the lin e through th e origi n would have a different slope? Thus, by varyin g th e value of 7, we could use (1.30) t o describe economic growth in a variety of economies. Let us define (1.31)
a=QiO)L(0)-
Then, fro m (1.27) and (1.30), we obtain (1.32)
at)=aL(tyK{l) -\ l
I n the jargon of economics, capital and labor are factors of production, and relationships between output and it s factors are known as production functions. Thu s (2(K,L) = aL^K " is a production function. It is known as the Cobb-Douglas production function, in honor of the men who in› troduced it . Takin g logarithm s of (1.32) and differentiatin g wit h respect t o time, we find the followin g expression for the specific growth rat e of the economy’s manufacturin g sector, in term s of the specific growth rates of labor and capital: 1
1
\_dQ_l_dL .\^l_dK Qdt ~ Ldt Κ dt' ' Notice that when 7 is close to zero, the growth rate of output is much less responsive to the growth rate of labor than to the growth rate of cap› ital ; whereas if 7 is close to 1, then the output growth rate is much more responsive to the labor growth rate than to the capital growth rate. We can therefore interpret the parameter 7 as measuring the desirabilit y of labor. In the jargon of economics, if F denotes a factor, then the quantit y (F/Q)dQ/dF is called the elasticity of production wit h respect to that factor. Setting F = L in (1.32), we see that 7 is the elasticity of production wit h respect to labor. For further elaboration, see a text on microeconomics, for example Nicholson (1979). We have thus obtained an expression, namely, (1.33), for the specific growt h rat e of an economy. But what good is it ? Unless we know the spe› cifi c growth rates of labor and capital, how can we use (1.33) to obtain an explicit expression for the growth rat e of output? Before answering thi s criticism , let us first observe that (1.32) is a single relation among three functions, namely, K, L, and Q. It is because ther e are fewer relations than functions that we are unable to obtain an explicit expression for any of them. Mor e generally, thi s situation would arise if we had η relations among η + m functions. I f the word "closed" were used t o mean explicit, then such a model would not be closed, because explicit expressions could not be deduced for all n + m functions. We might +
K
18
Chapte r 1 Growt h and Decay . Dynamica l System s
therefor e call the model open. I f the η relations did not involv e derivatives of the η + m functions wit h respect t o t, then the model would also be nondifferentiai Thu s (1.32) is a special case of a nondifferential , open, dynamical system. Tw o answers t o the above criticis m are now possible. Th e first is simply that , in certain circumstances, we might wish to know how fast output would grow, if capital and output were to grow at certain rates. Or , given th e labor growth rate, we might lik e t o know how fast capital must grow t o keep output risin g at a certain rate. Mor e generally, we might lik e to know how η of the η + m functions, called the endogenous functions, would respond t o hypothetical movements of the remaining m functions, called th e exogenous ones. For these purposes, nondifferential , open, dynamical systems can be very useful, as we wil l demonstrate mor e convincingly in Chapter 10. Th e second answer is that an open dynamical system can always be closed by combining it wit h other relations (which might be either differ › ential or nondifferential) . Let’ s attempt t o close the model (1.32). Wher e does a firm obtain it s capital stock? It buys it fro m other firms, so that cap› ital stock, in a certain sense, i s part of the economy’s output. There is one crucial difference, however. Suppose that a company buys a tool that was made thi s year. Then, next year, the tool wil l still be part of the company’s capital stock bu t it won’t be part of the economy’s output, because it was counted as part of thi s year’s. Mor e generally, suppose you are standing on the bank of a river , watching it flow around a bend. Silt gathers on a bend; imagine that the silt belongs t o you. Now, most of th e silt that the rive r carries wil l flow righ t past you. It’ s lik e the output of an economy: once it’ s gone you can’t include it , but there wil l always be mor e of it . On th e other hand, some of the silt that the river carries wil l be deposited on your bend, and there it wil l remain, t o be augmented by th e later flow of th e river . It’ s lik e your capital stock, and the silt on all the bends in the rive r is lik e the capital of the whole economy. Th e part of it s output that an economy retains for it s capital stock i s said t o be invested. Let / ( /) denote th e instantaneous annual rat e of investment, i.e., the amount of goods per year retained at tim e t for capital stock. Thus, in th e short interval [t - 6til, t + of/2], the amount of goods retained is I(t)6t + o(6t). Fro m now on, we’ll refer t o / as the investment rate. Furthermore , we’ll refer to I(t)IK{t) as th e specific investment rate, i.e., th e amount retained per year per unit of existing stock. Let us make the bold assumption that capital lasts forever. Then by analogy wit h (1.9): Rate of Change of _ Capital Capital Stock ~~ Inflow
Capital Outflow
0.
(1.34)
1.6
Economi c Growt h
19
Her e is a furthe r relation, a differentia l one. But by also introducin g an extr a function, namely, / ( i ) , we have moved no nearer t o closing our model! W e must therefore devise a new relation withou t introducin g new func› tions. A new relation requires a fresh assumption. Perhaps the simplest we can make is that the economy retains a constant proportion , σ, of output for it s capital stock. Thu s (1.35)
I(t) = aQXt).
Wit h (1.32), (1.33), and (1.35), we now have three relations (one differentia l and two nondifferential ) among the four functions /(*) , K{t), L{t), and Q{t). To close our model we must devise a fourth . But that fourt h relation wil l close our model only if no new functions are introduced an d ensuring thi s is not always easy, as we have just discovered! To make matters simple, therefore, we wil l simply assume (see Exer› cise 1.6) that the labor force is growing at constant specific rat e p, i.e., L (0 = L(0K’ .
(1.36)
Then on substituting (1.32), (1.35), and (1.36) int o (1.34), we obtain the first order ordinar y differentia l equation ^
= σα{Σ(0)}
(1.37)
β"'Κ -ι.
Ί
ι
Th e solution of thi s equation (Exercise 1.7) is readily shown to be given by {K(t)y
= {K(0)} +
mO)V
j
y
- 1) •
(1.38)
We can now retur n to the question of whether economic growth makes anyone better off. Let us assume that our measure, L(t), of labor is simply th e number of worker s employed, as was actually the case for the Mas› sachusetts study summarized in Table 1.1, and define the output per worker by
® = m I f economic growth is going t o improv e the lot of the labor force, shouldn’t ˘ increase wit h time? Takin g logarithm s of (1.39), differentiating , and using (1.33), we find that: z
\dZ ˘ ¸
=
IdQ ¸ -
IdL ¸
=
(
-
1
ª
)
J Id * | ? ¸ - ˘ ¸ )
(
L
(
L
9
)
AM
N
•
3
4
0
)
Using ( 1 . 3 6H 1.38), (1.31), and (1.35) in (1.40), we now find (Exercise 1.7):
ΤΈ
=
( 1
~
7 ) { / ( 0 )
"
p
K
m
{
* ~' (0)}7
{ κ { ί ) ]
'
Ί
•
(
1
4
1
)
20
Chapte r 1 Growt h and Decay . Dynamica l System *
Thus, because 0 < 7 < 1, our model predicts that output per worker rises if (1.42) i.e., i f the specific rat e of investment is higher, initially , than that of the labor force. Earl y investment is seen t o be crucial. Because (1.41) tends t o zero as t oo (Exercise 1.7), however, our model also predicts that output per worker ultimatel y settles down t o a constant value. How good is thi s model ho w realistic are it s assumptions? Perhaps you would lik e t o consider that question, though you’ll be in a better po› sition t o answer it after studying Chapter 4. Before changing the subject, however, and in preparation for Sec› tion s 3.3, 3.4, and 10.3, we pause t o remark upon th e way i n which output is measured, a matter we have managed t o avoid unti l now by defining th e output index iq{t). Th e output of an economy may consist of products as diverse as knives, bookcases, and automobiles; therefore it would be meaningless t o count th e number of items produced. That would create th e illusion that a factory producing 1000 knives had equalled th e output of one producing 1000 cars. It would be equally meaningless t o measure th e weight of the output i n tonnes, because a factory producing 1000 glass paperweights would have equalled the output of one producing several thousand scientific calculators. I n avoiding such absurdities, the traditiona l method of incorporatin g diverse products int o a single measure of output has been t o count each according t o it s monetary value. Even here there’s a difficulty , however, because it’ s c o m m on knowledge that a dollar won’t buy as much in the year 2000 as it would have bought in 1950; or, more gener› ally, that it won’t buy as much today as it would have bought / years ago. Therefore, if we wish t o make a fair comparison between an economy’s output in one year and it s output in a different year, then we must assign t o the output of the second year the monetary value that it would have had i n the first; or vice versa; or else assign t o each th e monetary value that it would have had in some other year, which we shall call th e base year for comparison. It is usually most convenient t o take / = 0 as th e base year. N ow suppose that a dollar at tim e zero has th e buying power of P(t) dollar s at tim e t, so that P(0) = 1; and suppose that th e monetary value of an economy’s output at tim e t is Y(t). Then because each dollar at tim e t is equivalent t o lAP(f) dollar s at tim e zero, the economy’s output would have been assigned monetary value Y(t)/P(t) if it had been produced at t = 0. Thi s is a tru e measure of th e economy’s output, th e one we have been denoting by Q(t). Hence Q = YIP, or Y(t) =
P{t)Qli)-
(1.43)
You might lik e t o thin k of QXt) as being measured i n real dollar s and Υ (t) as being measured in paper dollars, wit h P(t): 1 being th e exchange rat e
1.7
Metere d Growt h (or Decay ) Model s
21
between a paper dollar and a real dollar . Economists call Y the nominal output , Q the real output, and Ρ the price index (compare wit h (1.27), remembering that P(0) = 1). Takin g logarithm s of (1.43) and differentiatin g wit h respect t o t, we obtain
i ^ - I ^ + QI^C Y dt ~ Ρ dt dt'
( 1 4 4) • ' Th e term on the left-hand side of thi s relation is called the nominal (spe› cific) growth rat e of output. Th e second term on the right-han d side is called the real (specific) growth rat e of output. Th e first term on the right hand side, the specific growth rat e of the pric e index, is called the rate of inflation. Thu s tru e output, Q(/), is measured by assigning to output it s nominal monetary value Y(t) and dividin g by the pric e index, a procedure known as deflation. Th e tru e measure of capital stock, namely K(l), is likewise obtained by assigning t o capital stock it s monetary value and dividin g by th e pric e index (and similarl y for tru e investment, /(<)). I n the present sec› tion , however, we were able t o work exclusively in terms of real measures, because th e data in Table 1.1 had already been deflated.
1.7
K
Metere d Growt h (or Decay ) Model s
Let’ s retur n to Section 1.1 ’s polluted lake, in which x(t) denotes the con› centration of contaminant at tim e , V lake volume, and r the rate at which water flows through. Suppose that, for economic reasons, the environmen› tal police measure the lake’s pollutio n level only once every unit of time. They obtain a set of readings *(0) , x(l), x(2), x(n) To test the model of Section 1.1, we could compare these readings wit h the predictions jt(l ) = x(0)e- , x(2) = x(0)e- , x(3) = x(.0)e~ ' , and so on of equation (1.10); which we can writ e more succinctly as x(n + 1) = e~' x(n), η = 0, 1, 2, If we found acceptable agreement then we’d be satisfied wit h our model. If not, we would either reject it or tr y to improv e it. (We’ll discuss thi s at length in Chapter 4.) But notice, now, that what has been happening in th e interval s 0 < t < 1, 1 < t < 2, 2 < t < 3, . . ., η < t < n+ 1, . .. is of no importance. It might happen, for example, that in every tim e unit some mischievous pol› luter dumps fresh pollutio n int o the lake but always removes it before the next measurement is taken. Then th e tru e pollutio n level would fluctuate according to the solid curve in Fig. 1.6; whereas the model’s predictions would be given by the dashed curve. I n these circumstances, the model would not be a faithfu l guide t o what was actually happening ye t we wouldn’ t be aware of this! Indeed we might as well replace the model of Section 1.1 by the discrete dynamic model r,v
2r,v
ir v
/v
JC («+ 1) = e- x(ri), rlv
n = 0,1,2,...
(1.45)
22
Chapter 1 Growth and Decay. Dynamical System»
0
1
2
3
4
5
Fig. 1.6 A mischievous polluter deceives the environmental police. Whenever integer values of t are the only relevant ones, it is customary to write x(t) as x,. Hence the more usual form of (1.45) is K
n+l
= e-«vx
« = 0,1,2,.
(1.46)
Once x0 is known, we can determine the sequence of values xu x2, x3, ..., by repeated, or recurrent, application of (1.46). Thus (1.46) is dubbed a recurrence relation. You can see that the measurable predictions of the continuous model (1.10) are exactly the same as those of the discrete model (1.46). But a cautious person—and scientists are supposed to be cautious people—would certainly prefer the model (1.46), because it says just as much with far less risk that it might actually be wrong. (Incidentally, I am unable to resist pointing out that a cautious person is also discreet.) If we're interested only in the long-term pollution dynamics of this extraordinary lake, then (1.46) suffices as a model. If we're interested in the short-term dynamics, however, then (1.46) tells us nothing—and (1.10) is false! What can we do about mis? Notice from Fig. 1.6 that the short-term dynamics appears cyclic. This raises the intriguing possibility of constructing a separate model to describe pollution dynamics within each unit of time, independently of the value of n, although the long-term dynamics would still be described by (1.46). We might regard the short-term model as imbedded in the long-term one. A possible form for the imbedded model would be y(ta) = A(xn); n
(1.47)
xn+l = B(yitb)), where y denotes pollution within a time unit and appropriate functions A, B, and g are to be defined. The time that elapses between t - ta and t = tb in (1.47) is independent of n. Perhaps it is easier to appreciate this by writing ta = n + c,, tb = n + 1 - €2, where «,,c2 > 0 and e, + «2 < 1;
1.8
Salmo n Dynamic s
23
then t - t = 1 - f, - c . Note that the possible dependence of A, B, and g on any parameters of the problem, e.g., rIV, has been suppressed in the notation of (1.47). Just suppose, for example, that our mischievous polluter achieves his goal by doubling the pollutio n level one tenth of a tim e unit after every reading, lettin g it decay at the natural rat e and then halving it again one tenth of a tim e unit before the next reading. Then (1.47) would describe thi s process if we took e, = 0.1 = e and denned A{x) = 2xe~ , g(y) = -rylV, and B(y) = 0.5ye~ . You can easily check that (1.46) is implied. (Note that the solid curve in Fig. 1.6 would no longer be smooth but would have four corners in each tim e unit ; tw o where χ rises verticall y after onetenth of the tim e unit , and tw o where χ fall s verticall y four-fifth s of a tim e uni t later.) Th e example above is very fanciful and was introduced purely for ped› agogical purposes. But the idea of modelling growth and decay by imbed› din g a short-term dynamic model lik e (1.47) in a long-term dynamic model of the for m b
a
2
0Ariy
2
0ir/v
Xn+i=F(x„)
(1-48)
can be a powerful one. We wil l follow Clar k (1976) in calling such models metered models. Th e essential prerequisite for using such models is that the system being modelled is qualitatively the same withi n each unit of time. Th e system is said t o be memoryless, because it is incapable of knowing fro m it s own behavior which unit of tim e it is in. We wil l discuss the propert y of memorylessnes s more full y in Chapter 5. N ow let’s see a more realistic example.
1.8
Salmo n Dynamic s
Suppose we wish t o know the size of a salmon population at the end of each spawning cycle. We might expect a metered model t o be useful here, because the spawning process is qualitativel y th e same withi n each cycle. Ther e are, to be sure, some quantitativ e differences. But those that are due t o initia l conditions are part of the long-term dynamics described by (1.48). Other quantitativ e differences are due t o changes in the environment. To make matters simple, let’s assume that the environment is changing so slowly as t o make such differences negligible. It is then legitimate t o ex› press the short-term dynamics in an imbedded model of the for m (1.47). Th e followin g model, due t o Ricker (1954), is adapted fro m Clar k (1976, P. 229). Let x„ be the number of hundreds of million s of salmon at the end of cycle and therefore also at the beginning of cycle « + 1. These salmon are all adults. Referrin g t o (1.47), lety(/) denote the larval population (again in hundreds of millions) durin g the subsequent cycle (i.e., cycle η + 1). H ow
24
Chapte r 1 Growt h and Decay . Dynamica l System s
is the initia l larval population, y(t ), related t o χ„Ί Th e more salmon there are, the more females there are, the more eggs they lay, and hence the more larva e there are. Th e simplest assumption incorporatin g thi s observation is that th e number of larvae is proportiona l t o the number of adult salmon at the end of the previous cycle, or a
=
(1-49)
where Æ is a constant. Hence A(x) - ax in (1.47). What happens t o these larvae? Th e adults cannibalize them. The more adult s there are, the more larvae that are eaten. Th e simplest assumption incorporatin g thi s observation is that the larval population decays at a rat e proportiona l t o the adult population which , in the short term, is fixed. Thu s 1 dy
=
(1-50)
where β is a constant. I n term s of (1.47), g{y) = -0x„y, where x„ is constant i n the embedded model. Integratin g (1.50) fro m t t o t gives the number of (hundreds of million s of) larvae that survive t o matur e int o young salmon: a
b
yih) = y[t ) e x p ( - / ? x ( / - Q) = ax„ e x p ( - / ? x ( i - t )). 6
a
6
(1.51)
a
What happens t o these young salmon? Th e ocean is fraught wit h risk for them and not all wil l survive t o breed. Let’ s assume that a fractio n 7 survives. Then, at the end of the cycle, the salmon population is yy(t ) plus the survivin g adults. How many adults survive? I n the case of Pacific salmon, we can safely assume that the answer is zero, because the adults di e soon after spawning. On the other hand, Atlanti c salmon may retur n to th e sea after spawning, spend a year or tw o in the open water, then retur n upstream t o spawn again. To keep things simple, let’s assume that we’re interested in Pacific salmon. Then b
(1.52)
Xn+i = iyih).
Thu s Hy) = yy in (1.47). On defining α = α, Ί
b =
(1.53)
fi(t -t ) b
a
and combining (1.51) wit h (1.52), we obtain x
(1.54)
= ax e- ". bx
n+l
n
I t isn’t possible t o express the solution t o thi s recurrence relation as an explicit function of n, for all values of th e parameters a and b, in th e way that the solution t o (1.46) was expressed as x„ — x e~ , for all values of the parameter VIr. We must therefore solve (1.54) numerically, for par› ticula r values of and b. Suppose, for example, that there are 1 0 salmon nrlv
0
8
1.
Salmo n Dynamic s
25
initially ; then x = 1, because we are counting in hundreds of millions. Suppose that, on average, each female lays 1 0 eggs for each individual , male or female, in the existing population (thus, when = 0, all the females together lay 1 0 eggs). Then, if we assume that eggs are just young lar› vae (salmon cannibalize both), Æ = 10 . Assume, moreover, that the effect of thi s cannibalism on the first generation is to reduce the larval popu› lation by 90%. Then, fro m (1.51), 0.1 = y(t )/y(t ) = exp(-Pxo(t - f j ) , whence b = P(t - t ) = ln(10)/jr « 2.303. For these values of α, β and 7, (1.54) was solved numerically for various values of 7 (the fractio n of young survivin g unti l the next spawning). These values were 7 = 0.5 10" \ 7 = 1.0 1 0 ~\ 7 = 1.1 1 0 ~\ and 7 = 1.5 10~ . Because a = ηα = 1 0 7 , the corresponding values of a were 5, 10, 11, and 15. Th e results are presented in Table 1.2, and you should verif y them for yourself (Exer› cise 1.9). Notice that the four values of 7 (or a) correspond t o four completely different kind s of behavior. For a = 5, the population settles down t o th e steady value x* = 0.699, 70% of the initia l value. For a = 10, the population is absolutely static. For a = 11, the population bounces back and fort h between th e values x = 0.3568 and x = 1.726. For a = 15, it 0
s
13
5
a
b
b
b
0
a
4
s
L
v
Table 1.2 Variatio n with tim e of salmon population. n 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
a=5 1.000 0.500 0.7906 0.6402 0.7329 0.6778 0.7117 0.6912 0.7037 0.6961 0.7007 0.6979 0.6996 0.6986 0.6992 0.6988 0.6991 0.6989 0.6990 0.6989 0.6990
a = 10 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000
a = 11
a= 15
1.000 1.000 1.100 1.500 0.9611 0.7115 1.156 2.074 0.8876 0.2625 2.151 1.265 0.7562 0.2278 1.458 2.022 0.5584 0.2882 1.698 2.226 0.3744 0.1983 1.739 1.884 0.3488 0.3691 1.719 2.367 0.3614 0.1526 1.730 1.611 0.3545 0.5919 1.724 2.272 0.3581 0.1821 1.727 1.796 0.3562 0.4308
n
a= 11
a= 15
21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40
1.725 0.3572 1.726 0.3567 1.726 0.3569 1.726 0.3568 1.726 0.3569 1.726 0.3568 1.726 0.3568 1.726 0.3568 1.726 0.3568 1.726 0.3568
2.396 0.1443 1.552 0.6526 2.178 0.2167 1.973 0.3147 2.287 0.1771 1.767 0.4531 2.394 0.1449 1.557 0.6481 2.186 0.2137 1.960 0.3225
The four values of Æcorrespond to four values of the survival rate of young, when b = 2.3026; x = 0.6990 for > 20 when a = 5. n
26
Chapte r 1 Growt h and Decay . Dynamica l System s
seems that the population trie s to settle int o a pattern that repeats itself every twelve unit s of time, but withou t much success . D o populations of salmon really behave in any of these ways? Perhaps you would lik e t o consider that question. We’ll retur n t o it in Chapter 4; (1.54) is furthe r discussed in Chapter 2.
1.9
A Mode l of U.S. Populatio n Growt h
Havin g discussed economic growth in Section 1.6, we now discuss a further example of the empirical approach to modelling. The number of million s in the U.S. population fro m 1790 unti l 1850 appears in the thir d column of Table 1.3. The unit of tim e is a decade, and x(t) denotes magnitude at tim e t. Notice that population increases wit h time. The simplest hypothesis that might explain thi s observation is that χ is proportiona l to t; then dxldt would be constant. But the fourt h column of Table 1.3 records values of the quantit y (1.55)
D(t)= -{x«+l)-x(t-l)}. l
Thi s is a good approximation to dx/dt if d x/dt is small, which we shall sim› pl y assume (although see Exercise 1.12). Because D also increases wit h t, we reject the hypothesis that χ is proportiona l to time. On the other hand, th e final column of Table 1.3 shows that Dlx is almost constant. Indeed 3
i
= 0.3
^
(I.5Q
is correct to one significant figure. I n other words, the data suggest that we model growth of the population by setting μ = 0.3 = constant in (1.7). Thi s empiricall y derived model predicts x{t) = x(0)e - ' 0 3
m 3.9e ’ .
(1.57)
J
Table 1.3 U.S. population in millions, 1790-1850. Year 1790 1800 1810 1820 1830 1840 1850
t
*< 0
D{t)
0 1 2 3 4 5 6
3.929 5.308 7.24 9.638 12.87 17.07 23.19
1.66 2.17 2.81 3.72 5.16
0.31 0.3 0.29 0.29 0.3
Data for x(i) are taken from Historical Statistics of the United States, Colonial Times to 1970, Bicenten› nial Edition, Part I , p. 8 (U.S. Bureau of the Census, Washington, D.C., 1975).
1.9
A Mode l o f U.S. Populatio n Growt h
27
You can easily check that (1.57) predicts the population correctly t o tw o significant figures for the years 1 7 9 0 - 1 8 4 0, except for 1810, when it pre› dict s 7.1 instead of 7.2 for x(2). Can the same model predict population magnitude in later years? I n th e thir d and fourt h columns of Table 1.4, the predictions of (1.57) are compared wit h observed values for the years 1 8 5 0 - 1 9 7 0. You can see that (1.57) soon fail s to describe population growth wit h acceptable accuracy. On the other hand, Dlx « 0.24 for the years 1 8 6 0 - 1 8 8 0, suggesting the improved model
\
3 1 i ?
0.24(/-7)
(
(
>
6
5
But although thi s is correct to tw o significant figures for the years 1 8 6 01880, and even to one significant figure for 1850 and 1890, it seriously overestimates the magnitude of the population in the present century. We must tr y again! To find a better description empirically , the values for Dlx in Tables 1.3 and 1.4 were plotted against those for x. Th e result appears in Fig. 1.7. Notice that points corresponding t o the years 1 8 0 0 - 1 9 40 are clustered around the dashed line, which intercepts the vertical axis at about 0.31 and the horizontal axis at about 198. Hence the data suggest the improved model
Table 1.4 U.S. population magnitude and related data, 1850-1970. Year 1850 1860 1870 1880 1890 1900 1910 1920 1930 1940 1950 1960 1970
t
(1.57)
AO
˘ 0
D{i)lxit)
6 7 8 9 10 11 12 13 14 15 16 17 18
24 32 43 58 78 110 140 190 260 350 470 640 860
23.19 31.44 38.56 50.16 62.95 75.96 91.97 105.7 122.8 131.7 150.7 179.3 203.2
7.19 7.68 9.36 12.2 12.9 14.5 14.9 15.4 13.0 14.0 23.8 26.2
0.31 0.24 0.24 0.24 0.2 0.19 0.16 0.15 0.11 0.11 0.16 0.15
Source of fourt h column as in Table 1.3.
(1.60) 23 30 39 49 61 75 90 110 120 130 150 160 170
28
Chapte r 1
Growt h and Decay . Dynamica l System *
DIx
-I
0
I
I
I
I
I
I
I
I
I
50
I
I
•
1
100
•
150
'
'
I
I
-’
’ hv
200
Fig. 1.7 U.S. population (horizontal axis) plotted against specific growth rate (verti › cal axis) for years 1800-1960. The unit of tim e is a decade; the unit of population, a million .
Th e solution of thi s differentia l equation, subject t o x(0) = 3.93, i s 198 * ’
)
=
l
+ 49.4
(
1
•
6
0 )
Th e predictions of (1.60), rounded t o t w o significant figures, are recorded i n the final column of Table 1.4. Notice that they are correct t o at least one significant figure unti l 1950. I n fact, the percentage error , that is, i. predicted value Ί lOOxU-^ }% , observed value J y n (
„.» (1.61)
i s less than 2.5% throughout thi s entir e period, except for the year 1860, when the error i s a littl e over 5%. But the model fail s to account for the postwar rise i n specific growth rat e (appearing i n the final column of Ta› bl e 1.4). Indeed the current population of th e United States exceeds th e least upper bound of (1.60) by about 20%. T h e model (1.60), which we derived empirically , could also have been conceptually derived by th e followin g simple argument. Assume that there i s a maximum population K, th e capacity, that the land can sustain. When th e population is x, th e unused fractio n of the capacity is 1 - xlK. Thi s i s a measure of the potential for growth, and we might expect the specific
1.10
Chemica l Dynamic s
29
growt h rat e t o be proportiona l to it . Hence 1 dx
f.
n
χ Έ = ν-κ)>
x\
^ - v
κ
(L62)
where R is a constant of proportionality . We may interpret R strictl y as an upper bound on the specific growth rate. On the other hand, if χ is much smaller than K, say xlK < e, where e is sufficiently small, then (1.62) yields 1 dx . R . T
(1.63)
t
Thu s R may be regarded more intuitivel y as the early or maximum specific growt h rate. For the U.S. population we have found t « 0.1, ¸ = 0.31, and Κ 198, as you should check for yourself. But if the capacity of the United States is 198 millio n people, why are there over 235 millio n people here today? D o es thi s mean that the model is useless o r can we improv e it to resolve the discrepancy between it and the observations? We’ll retur n t o thi s question in Chapter 4. Meanwhile, tr y t o answer the question yourself (Exercise 1.11); then tr y Exercises 1.10 and 1.13.
1.10
Chemica l Dynamic s
A chemical reaction is a process in which one or more substances, the reactants, combine or separate to for m one or more other substances, the products. Mass is conserved in such a process (energy is not). Th e conser› vation of mass in one such reaction is represented by the symbolic equation (1.64)
A + B —>P.
Thi s says that one molecule of substance A combines wit h one molecule of substance Β t o for m one molecule of substance P. For example, A could be carbon (A = C), Β could be oxygen in it s diatomi c for m (B = 0 ) , and Ρ could be carbon dioxid e (P = C 0 ) . Then (1.64) would describe mass conservation in the combustion of graphit e (which releases heat energy at th e rat e of about 0.664 Joules per molecule of P). Molecules, however, are such tin y things that we prefer to count them i n unit s of approximately 6.024 ˇ , just as we preferred to count the U.S. molecules population in unit s of one millio n people. We call 6.024 ˇ of substance X a mole of X . Then (1.64) may also be read as saying that a mole of A combines wit h a mole of Β t o produce a mole of P. N ow th e molecules are constantly whizzing about the y combine because they collide an d the more they collide, the more they combine. But the greater th e concentration of each substance, i.e., the more of it that there is, then 2
2
23
23
1
’See Supplementary Note 1.1. The Supplementary Notes sections can be found at the ends of the chapters.
30
Chapte r 1 Growt h and Decay . Dynamica l System *
th e greater the number of collisions between respective molecules. I t there› for e seems reasonable t o assume that the rat e at which A and Β are con› verted int o Ρ wil l be proportiona l t o the concentration of each. Let [X] denote the concentration of substance X, in moles per unit volume. Then we have Rate of Increase of Product = Rate of Conversion of Reactant (1-65)
k[A)[B)
where A: is a constant. Suppose that ξ(ή moles of A and Β are converted t o Ρ in tim e r, i.e., ξ(ί) moles of A plus ( ) moles of Β become ξ(ί) moles of Ρ which is perfectly consistent, because the molecules of Ρ are heavier than those of A or B. Then, if a and b denote the initia l concentrations of ¸ and B, (1.65) becomes 0
0
£ = *(Æ - (0 & - (0) .
(1.66)
Thi s may, at first , appear to be a new mathematical equation. But you can easily check that the substitutions χ = max(fl . *o) ~ £. 0
R
= (o k a
~ *o).
K = a -b 0
(1.67)
Q
convert (1.66) int o (1.62). Th e complete solution can thu s be deduced fro m Exercise 1.10, and we leave that to you. You should check that, as t oo i n your solution, th e product concentration £ tends t o m i n ( a , b ); whereas th e reactant concentrations tend to 0 and m a x ( a , b )-min(a , b ). I n other words, the less abundant of the tw o reactants i s completely converted int o a constituent of the product. Recalling Exercise 1.10, notice how many phenomena are described by a single differentia l equation. Plant growth, U.S. population growth, and a chemical reaction al l are described mathematically by (1.62). That diverse phenomena may have a c o m m on mathematical structur e is a re› currin g theme of applied mathematics, and furthe r examples wil l appear throughout the text. Th e first such example appears in the followin g section. 0
0
1.11
0
0
0
0
Mor e Chemica l Dynamic s
Th e chemical reaction (1.64) is irreversible. Ρ does not separate int o it s constituents ¸ and B. Th e simplest reversible reaction would be represented symbolically by A <—* B.
(1.68)
Thi s says that A i s converted int o B, a process known as th e forwar d re› action; at the same time, Β is converted int o A, a process known as th e backward reaction. For the sake of definiteness, we wil l continue t o call
1.11
Mor e Chemica l Dynamic s
31
th e term on the right-han d side the product and the term on the left-hand side the reactant, though, because of symmetry, thi s terminology is arbi › trar y and purely for convenience. To make matters simple, suppose that th e substances A and Β are diluted in water. Then A and Β are solutes, and water is the solvent. Suppose, moreover, that the amount of water (i n moles) per unit volume is extremely large compared wit h the amount of solute. We sometimes describe thi s by saying that the substances are i n weak solution. T h en the reaction takes place because molecules of A and Β collide wit h water molecules. Perhaps, therefore, the reaction (1.68) should really be writte n as U0 2
+ A ^ H
2
(1.69)
0 + B.
I f so then, for reasons given in the previous section, the rat e of conver› sion fro m A t o B, i.e., the forward rate, would be AT, [ ˙ 0 ] [ ¸ ] , where K i s a constant; whereas the rat e of conversion fro m Β t o A, or the backward rate, would be K [H 0][B], where K is another constant. But the concentration of H 0 in thi s weak solution is so extremely large that i t does not alter appreciably durin g the lifetim e of the reaction. Hence, as an approximation , k = / T , [ H 0] and k = / s f [ H 0] may be re› garded as constants. Th e forwar d rat e is then k [A] and the backward rat e k [B). Let a and b be the initia l concentrations of substances A and B, respectively, in number of moles per unit volume of water. Suppose that, per unit volume of water, ξ(ή moles of A are converted int o Β i n tim e t. Then 2
2
2
{
2
2
2
{
2
2
2
{
2
0
0
d ^[Product] = Forward Rate - Backward Rate
(1.70)
^[Reactant] = Backward Rate - Forward Rate (1.71)
T,{
-
-0
•
Either equation i s equivalent to
^
=
-
-(*
Ø+ *2˚ •
0• ) 7 2
Equation (1.72) is a mathematical model for the dynamics of the reversible chemical reaction that is described symbolically by (1.68). At first , thi s may look lik e a new mathematical equation; but you’ve seen it before, haven’t you? See Exercise 1.18.
32
Chapte r 1 Growt h and Decay . Dynamica l S y t e m a
1.12
Rowin g Dynamic s
What determines the speed of a rowin g boat? By pullin g on their oars the crew push against the water far fro m the boat. Thi s exerts a force, which tries to make the boat gain speed; we’ll call it the tractiv e force and denote it by T. The water adjacent to the sides of the boat, however, exerts a force that tries to make the boat lose speed; we’ll call thi s the drag force and denote it by D. If Τ exceeds D, then the boat really wil l gain speed, or accelerate; and the greater the difference between Τ and D, the greater thi s acceleration. On the other hand, if D exceeds T, then the boat wil l actually lose speed; and the greater the difference, the greater the speed loss. Let’ s tr y t o tur n these ideas int o mathematics. Let u(t) be the speed of the boat at tim e t. Then duldt is the rat e of change of speed, which we have agreed to call the acceleration. What we have found is that ^ > 0 dt
i(T>D,
^ < 0 dt
i(T
du dt
increases wit h
Th e simplest hypothesis that explains all thi s is that duldt t o Τ - D. Let us therefore assume that
37 = S < - > ’ r
\T-D\.
is proportiona l
( 1
’
7 3 )
where MM is a constant of proportionally . Notice that, for given tractiv e force and drag, large Μ is associated wit h small acceleration, and small Μ is associated wit h large acceleration. Μ is therefore a measure of the boat’s reluctance t o change speed, or inertia. We call Μ the mass. Before proceeding, we pause t o record a detail fro m physics. Heavy objects have greater reluctance t o change speed than light ones (tr y push› ing), hence greater mass. But heavier objects, by definition , have greater weight, denoted by W. Indeed the relationship between weight and mass i s a simple one of proportionality , namely, W = Mg.
(1.74)
Th e constant of proportionality , g, is known as the acceleration due to gravity. The justificatio n for thi s terminology wil l emerge in Section 1.14. Furthe r to develop our model (1.73), we borro w again fro m the science of physics. I n an infinitesimal tim e St, the boat wil l m o ve a distance uSt; and maintainin g a tractiv e force Τ for thi s distance requires mechanical energy TuSt. Where does thi s energy come from ? Fro m the muscular exertions of th e crew. Th e rat e at which energy is supplied by them is known as the power. But since humans are only about 25% efficient at converting the chemical energy of food int o mechanical energy for useful work , the power actually supplied t o the boat is only about a quarter of the rat e at which oarsmen bur n energy, the remaining three quarter s being dissipated as heat. For thi s reason, some people prefer to call the rat e of energy supply the
1.12
Rowin g Dynamic s
33
effective power. Now, assume that there are eight in the boat’s crew, and that they have entered a race. I n training , they wil l have determined empiricall y th e maximum effective power that an oarsman can sustain for the full length of the course; let’s denote it by P. To make matters simple, let’s assume that the oarsmen are identical, at least for the purpose of rowin g a boat. Then, assuming that they would lik e to wi n the race, they wil l supply power iP for the entir e length of the course. Therefore, because power is rat e of energy supply, the energy supplied in an infinitesimal tim e St wil l be SPSt. Thi s must equal TuSt. Hence Effective Power = Tractiv e Force
Velocity
— 75)
SP Txu. Fro m fluid dynamics, we borro w the result that drag is proportiona l both t o the square of the boat’s velocity and t o it s wetted surface area, i.e., the area in contact wit h the water. Let’ s denote wetted surface area by S. Then (1.76)
D=bSu , 2
where b is a constant of proportionality . From (1.73), (1.75), and (1.76): Mass
Acceleration = Tractiv e Force - Drag Force
= - bSu . Μ χ — dt u Thi s is a first order ordinar y differentia l equation for u(t), which we propose as a model for the dynamics of rowing. The solution of thi s dif › ferential equation, subject t o the initia l condition u(0) = 0, is defined im› plicitl y (Exercise 1.19) by (u
2
+ uV+V*\
π
_ (V+2u\ l
6bSVt
„ „ .
where we have defined Ρ \
1/3
Th e function u(t) defined implicitl y by (1.78) is plotted in Fig. 1.8. N o› tic e that the initia l acceleration is theoretically infinit e according t o (1.77), when in practice it must be finite; but thi s should not concern us any more than the fact that, in theory, the boat wil l actually reach speed V only as t —* oo. A model is intended only t o capture the essential features of real› ity , not t o be an identical replica. Yet how good is thi s model doe s it fit the facts? Fig. 1.8 suggests that oarsmen supplying power at a constant rat e would achieve maximum acceleration at the start of a race and subsequently reduce acceleration, unti l their speed levelled off at the constant value defined by (1.79). M y intuitio n suggests that thi s is more or less what happens in a race; except perhaps that the oarsmen slow down slightly towards the end of it . But in
34
Chapte r 1
Growt h an d Decay . Dynamica l System *
u/V
+
bSVtIM
Fig. 1.8 Speed history of a rowing boat. Both dependent and independent variables are dimensionless; see Section 1.14 and Exercise 1.20.
science it’ s generally a bad idea t o rely exclusively upon one’s intuition . Therefore, in Chapter 4, we wil l test thi s model mor e objectively.
1.13
Traffi c Dynamic s
Suppose that there are Ν vehicles i n a lane of traffic . We wil l label t h em N, wit h j = 1 corresponding t o th e leading vehicle. Let us j = 1, assume that their masses and lengths are equal. Thi s might be at least approximately tru e on a bridg e or i n a tunnel fro m which truck s have been barred . Let th e fron t bumper of th e j t h vehicle have displacement Zj(t) at tim e t, measured fro m th e beginning of th e road. Then th e j’t h vehicle whereas it s displacement and has velocity dzjldt and acceleration d z ldt ; velocity relative to the vehicle in front of it are, respectively, ,-( ) z _ (t) 1
l
j
and dzj/dt -
j
i
dz _ /dt. J
l
Suppose that the road is quit e congested, which bridges and tunnels usually are. Thu s the average value of \zj(t) - z,_ ,(/)| is not t oo large. Th e smaller it is, th e mor e congested th e road. Now, on a busy road, vehicles are prevented fro m crashing int o o ne another, at least i n theory, because driver s brak e when they see that th e gap i n fron t of them is closing. Th e faster that gap closes, i.e., the greater th e value of dzj/dt - dz _ /dt, th e harder they brake. Moreover, th e greater th e congestion, i.e., th e smaller th e value of |z,(i) - z,_ ,(r)|, th e harder they brake. Th e simplest hypothesis incorporatin g these t w o observations i s that J
BHWFw.^gg:^,,
l
c.M )
where A{>0) is a constant and a prim e denotes differentiation . Now, bor› ACCELERATION , where Μ rowin g fro m physics, th e brakin g force is -Μ i s th e mass of a vehicle. You can see thi s by identifyin g th e brakin g force wit h D i n (1.73) above and setting Τ — 0. But driver s take a certain time,
1.14
Dimensionality , Scaling , and Unit s
35
say τ, to respond to changing traffi c conditions. Hence d zj(t+r) 2
dt* or, because z _ (t) J
l
>
_
z; . ( 0 - z j _ , ( 0 - \z (t)-z _ «)\> A
j
J
( i . 8 1)
l
Zj(t),
(1.82)
(1.83) where a, is independent of t. Because thi s equation is valid for 2 < j < N, we have a system of Ν - 1 nonlinear ordinar y differentia l equations. Thi s system is even more complex than (1.20) and (1.22) because of the delay, r , in driver response t o the stimulus of changing traffi c conditions. I f we weren’t able t o solve (1.20) or (1.22) analytically, then what hope do we have of solving (1.83)? To be sure, we can always find solutions by numerical approximation. A s we shall discover repeatedly throughout thi s text, however, there is a satisfaction in the simplicit y but generality of analyti c solutions which makes them always desirable and always prefer› able, when available, t o numerical approximations. But the question still remains: how do we hope to obtain analytic solutions fro m equations as complicated as (1.83)? Th e answer lies in the observation that, in the real world , nothing can grow or decay forever: ultimately , growth or decay must cease. What hap› pens then? A n equilibriu m or steady state is reached. I n the present model, thi s steady state is a special solution of (1.83) which, as we shall see in Sec› tio n 2.3, is readily found. But already we’re talkin g about equilibrium , and thi s is th e topi c of Chapter 2.
1.14
Dimensionality , Scaling , and Unit s
Th e use of dynamic models is greatly facilitated by an understanding of thre e closely related concepts, namely, those of dimensionality, units, and scaling. We conclude our first chapter by discussing them. Suppose that a frien d of min e drove 20,000 miles last year and earned 20,000 dollars. Would I be righ t to say that he drove as much as he earned? N o, of course not, because the equation $ 2 0 , 0 00 = 2 0 , 0 00 miles
(1.84)
does not make sense. Distance is measured in miles, income is measured in dollars, and no amount of dollar s can ever equal a mile. We formaliz e thi s
38
Chapte r 1 Growt h and Decay . Dynamica l System *
idea by saying that distance has the dimension o f length or, in shorthand notation, [distance] = L; whil e income has the dimension of value, or [income] = V. I n these terms, (1.84) is dimensionally inconsistent because [$20,000] = V, and [20,000 miles] = L. If , however, my frien d spent 50p for every mil e he drove, then I would be absolutely righ t t o say that $ 1 0 , 0 00 = 2 0 , 0 00 miles χ 0.5 dollars per mile.
(1.85)
Thi s equation is dimensionally consistent, because [dollar s per mile] = VIL. Thu s the right-han d side has the dimensions of L χ VIL = V, agreeing wit h th e left-hand side. Al l parameters and variables used in thi s book have characteristic di› mensions, which are derived fro m products or quotients (or both) of the six basic dimensions listed in Table 1.5. Dimensions are given for a selection of quantities used in thi s book in Table 1.6. Al l equations between variables and parameters must be dimensionally consistent. Consider, for example, the lake purificatio n equation (1.9a), repeated here for convenience: y
^
= - >
(1-86)
r x
where ˚ denotes volume, JC concentration, / time, and r rat e of water flow. On using rows three through five of Table 1.6, the left-hand side of (1.86) has dimensions [V] • [x]/[t] - L? ML-^IT = MIT; whereas the right-han d side has dimensions [r] • [x] = L?IT • MIL? = MIT. Hence the equation i s dimensionally consistent. Similarly , y(t ) = ax in (1.49) is dimensionally consistent, because the proportio n Æ is dimensionless, and the pur e numbers y(t ) and x„ are also dimensionless. Th e fact that all equations must be dimensionally consistent can be used t o determine the dimensions of new parameters as they arise. For example, in (1.50), i.e., in the equation a
n
a
Table 1.5 The six basic dimensions and their symbols. length mass tim e
L Μ Τ
temperature value no dimensions
C V 1
Shear viscosity Kinemati c viscosity Thermal conductivity
Pressure
See Section 2.5
= [ ]/[æ]* > see Section 2.6
See Section 2.6
2
3
l
T~
2
MLT- C~
2
L /T
1
ML~
l
ML~ T~
3
ML /T
[Power] = [Energy]/[Time ] or [Power] = [Force] • [Velocity] [Pressure] = [Force]/[Area]
Power 2
MLrIT
[Energy] = [Force] • [Distance]
Energy 2
Μ LIT
[Force] = [Mass] • [Acceleration]
3
L IT MIT
[Water flow] = [Volume]/[Time ] [Pollutio n inflow] = [Water inflow] • [Concentration]
3
2
LIT LIT MIL
[Velocity] = [LengthJ/fTime) [Acceleration] = [Velocity]/[Time ] [Concentration] = [Mass]/[Volume]
1
Dimensions
Velocity Acceleration Concentration of pollutant Water flow Pollution inflo w Force
Derivation
1
-rV C
Erg-cm"
2
J-m-’
1
- 1
c m /s
gm - c m m /s
1
2
2
s
- 1
-s-’^C
Dyne/cm Newton/m (Pascal) kg • m ~ • s ~ 2
gm - cm • Is (Dyne) D y n e • cm (Erg) Erg/s 2
J
kg • m/s (Newton) Newton • m (Joule) Joule/s
2
c m /s gm/s
3
3
cm/s cm/s gm/cm
CGS unit s
m /s kg/s
2
S.I. units mis m/s kg/m
Dimensions of some quantities arising frequently in mathematical modelling.
Quantit y
Table 1.6
38
Chapte r 1 Growt h and Decay . Dynamica l S y t o m t
x„ is dimensionless, y is dimensionless, and dyldt has dimensions l / T . Hence the dimensions o f /? must also be l/T. Similarly , the quantities º and ctj appearing in (1.83) must have the dimensions of velocity, or LIT. After a quantity’ s dimensionality has been settled, the number that de› termines it s actual value wil l still depend upon the units in which those basic dimensions are measured. For example, velocity has the dimen› sions of length per unit of time. But a car that travels at 60 m.p.h., if lengths are measured in miles and tim e in hours, wil l travel at 88 feet per second if lengths are measured in feet and tim e i n seconds. Th e car’s velocity has not changed; velocity’s dimensions have not changed; only th e unit s chosen for the basic dimensions have changed. Two frequent choices for the basic dimensions of mass, length, and tim e are kilogram , meter, and second (Systeme Internationale, or S.I.) and gram, centime› ter, and second (CGS). For the quantities listed in Table 1.6, the appro› priat e S.I. unit s or CGS unit s are given next t o the respective dimen› sions. Temperature is usually measured in degrees Celsius ( C ) and value i n dollars. But other unit s are sometimes chosen for the basic dimen› sions. Moreover, unit s are sometimes mixed withi n a problem so that numbers are neither too large nor too small. I n modelling lakes, for ex› ample, we might choose t o measure flow of contaminant in tonnes per day, because tonnes per second would give too small a number, and kg per day would be too large. I n brief , unit s for the basic dimensions may be chosen arbitrarily . Once they have been chosen, however, the unit s for quantities wit h derived dimensions must always be consistent wit h them. Dimensionless parameters are useful in mathematical modelling for a variet y of reasons. First , as we shall see in Sections 4.10 and 9.5, they are importan t measures of the relativ e strengths of competing effects. Second, they are importan t in the design of experiments. Being primaril y concerned wit h the conceptual approach t o modelling, however, we shall not pursue thi s matter; i f you are interested, see Chapter 10 of Hansen (1967). Third , by using dimensionless parameters, we can reduce the number of arbitrar y constants associated wit h a mathematical model. Th e process by which we achieve thi s is known as scaling. A few examples should suffice to explain how scaling works. Equation (1.86) contains a single arbitrar y constant, namely, r = Vlr. We wil l call thi s the drainage time, because volume Voi water would take tim e r t o flow out at rat e r. Let us define a new variabl e by (1.87)
dx dt
dt dx di dt
T
dx dt
τ
{-ν) = -(Ψ) - > χ= χ
1.14
Dimensionality , Scaling , and Unit s
39
whence (1.88)
x(i) = x(0)e-'.
Th e arbitrar y constant has disappeared, because i measures the passage of tim e in unit s of drainage time. Th e expression for χ corresponds, of course, to (1.10). A dependent variabl e may also be scaled. Equation (1.15), i.e., γ
k(x -x)x,
=
f
contains tw o arbitrar y constants, namely, k and Xf. Now, if χ were so small that x could be neglected, then thi s equation would be approx› imately (\lx)dxldt - kxp an exponential growth equation for which th e doubling time, i.e., the growth equivalent of the half-life , would be h.o = (l/fcxy) ln(2); see Section 1.2. Let’ s use thi s doubling tim e to scale t and Xf to scale x, i.e., let’s define 2
i=-^-,
x
Then, on using the chain rule, we have dx
\_dx
=
di
t^dx
=
x di
x
f
= t . kXfX(l
=
dt
f
f
h^j, x
_ f
f
= ln(2)x(l - x),
-x)
2 0
(1.89)
* = - .
'2.0
(1.90)
an equation fro m which the arbitrar y constants have disappeared. The solution
corresponds, of course, to (1.16). = ax exp(-&x ) , contains tw o arbitrar y Equation (1.54), namely, x„ constants, a and b. By using a recurrence relation, we have, in effect, already scaled the tim e variable. It remains only to scale the dependent variable, x. Let us define +l
n
=
(1-92)
where x* = \n(a)/b. Th e significance of x* wil l emerge in Section 2.4. Then x is measured in unit s of x", just as was measured in unit s of Xy above. If we now define r = ln(a), then we easily obtain the dimensionless recurrence relatio n n
v
Xn-L+ 1I —
"
~
X'
~
= ax e- " Xn(a)i
n
o-bx'(x„lx")
X'
= i/"-*’ ,
which contains a single arbitrar y constant, r.
(1.93)
40
Chapte r 1 Growt h an d Decay . Dynamica l System s
A s a final example, let’s consider equations (1.20), which contain the four arbitrar y constants a a , b and b . Let’ s scale χ wit h respect t o x* = a lb and y wit h respect t o y* = a lb . Th e significance of x' and y* wil l emerge in the followin g chapter. Suppose that you cannot thin k of an appropriat e characteristic magnitude for t; then just call it T, and determine it s value later. Hence the new dimensionless variables are u
2
2
u
2
2
{
bx
χ χ
=
^
y
2
=
ΐ '
y
=
7
{
b,y
.
t
'=T
= T*
( L 9 4 )
By methods that should now be familiar , we obtain
τι Vii =
=
~*
i ( / j > ) ) =
°
i T x ( l
-
y' y
on using (1.20). Because Τ is at our disposal, we choose Τ = 1/Æ,. Th e resultant set of differentia l equations contains only a single arbitrar y con› stant, a la , instead of the original four . You should check that (1.95) would contain the same single arbitrar y parameter if we had chosen Τ = \la in› stead. Scaling variables is by no means compulsory and not always useful. Though it always simplifies the mathematics, it sometimes obscures im › portan t details of the process being modelled. Therefore, scale if it helps you; otherwise don’t. That’ s what I’v e done throughout the text. You can test your understanding of dimensionality and scaling by at› temptin g Exercise 1.20. 2
{
2
Exercise s 1.1 (i) Obtain (1.10) and (1.11). (ii ) Show that, in the lake purificatio n model of Section 1.1, an annual vari› ation of r about its mean would not significantly alter the value predicted for *o.o5- Hint: Take r(t) = p(\ + e sin(2xf))» where æis the mean outflow (and inflow) , l is the number of years since pollution input ceased, and |e| < 1 (otherwise r could be negative). 1.2 Derive (1.16). 1.3 Suppose that the phase-plane diagram in Fig. 1.3 is drawn for arbitrar y values of the parameters Æ,, a , b and b . Deduce from (1.20) that the solution curves belong to the family 2
lt
2
a ln(x) - b x + a, \n(y) -b y 2
2
x
= ln(c),
Exercise s
41
where c is a constant. To two significant figures, the values of c in Fig. 1.3 are, starting with the degenerate innermost curve denoted by a dot, c = 0.14, c = 0.13, c = 0.12, c = 0.10, c = 0.08, and c = 0.05. 1.4 Suppose that the phase-plane diagram in Fig. 1.4 is drawn for arbitrar y values of the parameters a a , b and b . Deduce from (1.22) that the solution curves belong to the family it
-a
2
2
lt
2
ln(x) + b x + a ln(y) - b y - ln(c) 2
{
{
where c is a constant. In Fig. 1.4, the value c = 0.207 corresponds to the two branches of the dashed curve (separatrix). For values of c exceeding this value, the two branches of the corresponding curve li e above and below the separatrix; for c < 0.207, to the right and left of it. 1.5 Two plants are growing independently off independent fixed supplies of sub› strate. Let x(t) be the dry weight at time t of the first plant and y(t) that of the second. Then, according to Section 1.3, we may regard x(f) = (x(t),y(t)) as the state at tim e / of a two-dimensional system governed by the equations T
dxldt
-- kx(x
f
- x),
dyldt
= ky(y
f
-
y).
(1) Writ e down the solution x(z) to these equations. (ii ) For k = 0.1, x = 7, and >y = 10, plot solution curves in the x-y plane for a variety of initia l values x(0) in the rectangle 0 < ;c < 13, 0 < y < 16. Not all initia l values are physically meaningful, but this will help you to understand the phase-plane. f
1.6 Use the data in Table 1.1 to plot ln(/ ) against /. Use your diagram to com› ment upon the validit y of (1.36). Do you consider this to be an acceptable labor growth model for the entire period 1890-1926? For part of it? If so, can you provide a rough estimate for the best value of p? L
1.7 Solve (1.37) to obtain (1.38). Verif y (1.41), and show that this expression approaches zero as t — oo. *1.8 (i) Suppose that a lake is being polluted at the rate of P tonnes per day. How must the model of Section 1.1 be modified to account for this pollution input ? Obtain a new expression for x(t), (ii ) Everyone knows that machines wear out and buildings deteriorate. Sup› pose that, if there were no investment, then an economy’s capital stock would decay in value at constant specific rate a. This decay is known as depreciation. How must the model of Section 1.6 be modified to account for de› preciation? in
1.9 Reproduce Table 1.2 for yourself by solving (1.54) on a calculator or com› puter.
42
Chapte r 1 Growt h and Decay . Dynamica l System s
1.10 Deduce the solution of the differential equation (1.62) from (1.16). ” . 1 1 According to the 1981 Yearbook of Encyclopedia Britannica, the U.S. popu› lation in 1980 was 226.5 million . Using Fig. 1.7, can you suggest a model that describes U.S. population growth from 1940 onward? Can you interpret the apparent change in the capacity of the land? 1.12 Mathematical assumptions can often be justified subsequently without re› course to data by checking the consistency of some mathematical prediction (whereas modelling assumptions can ultimately be justified only by recourse to data). We call this an a posteriori justificatio n of the mathematical as› sumption. In Section 1.9, for example, we had to assume that d x/dfi was small in order to arrive at equation (1.59). Show a posteriori that the error in approximatin g dxldt by D(t), to obtain (1.59), could not have exceede d 10~ . 3
3
"1.13 In this exercise, we will derive a model empirically and then interpret it conceptually. The model concerns the decay of a population of houseflies, not with respect to an increase in tim e but rather wit h respect to an increase in dosage of insecticide. Let φ denote the concentration in milligram s per cubic centimeter of pyrethri n insecticide. Let d denote the fraction of the population of houseflies that would be killed by that dosage. The following data are given by Finney (1952, p. 149):
φ d
0.50 0.20
0.75 0.35
1.00 0.53
1.50 0.80
2.00 0.88
(i) Let χ = 1 - d denote the survivin g fraction of the population when the concentration of insecticide is φ. Plot the values of - ln(x) against those of φ. What possible model is suggeste d by the data? (ii ) Can you interpret thi s model conceptually? Hint: Consider the effect on the survivors of an infinitesimal increase in concentration of insecticide. *1.14 In Section 1.8 we imagined that the fraction, 7 , of young salmon survivin g unti l spawning was 1 in 10 , or thereabouts. What could cause thi s fraction to be so small? A possible answer is predation. Let x(t) denote the number of units (hundreds of millions) of young salmon at tim e /, during the survival period (thus t < t < n+ 1, where n+ 1 - t = e is independent of n). Let h{t) denote the harvest rate, i.e., the number of units of young salmon captured and eaten per unit of time. Then, clearly, 4
b
b
2
Exercise s
43
(i) The more young salmon there are, the more that are captured. The more predators there are, the more young salmon that are captured. If w(f) denotes the predator population, what is the simplest form of h(t) consistent with these two observations? (ii ) The model described only short-term dynamics, because everything hap› pens withi n the salmon’s breeding cycle. What is the simplest form of «(/) consistent with this observation? (iii ) Solve the resulting differential equation for x(t) in the interval t < t < η + 1. Hence express 7 as a function of the other parameters. Does it now seem reasonable that 7 might be as small as 10" ? b
4
* 1.15 In Exercise 1.14, we introduced a short-term model for preying on fish (salmon, in that particular example). Perhaps you imagined the predator to be another species offish. It might be so, but it might just as easily be the human species. Then u(t) denotes number of fishermen. Since fishermen who hope to sustain their livelihoods will be interested mainly in the long-term dynamics of harvesting, we must modify our model to account for this. Now, in Section 1.8, the long-term dynamics were described by a recur› rence relation, but they might also be described by a differential equation witness (1.59), which describes U.S. population growth from 1790 onward. Indeed the main reason that the model of Exercise 1.14 is a short-term one is that growth of the fish population is ignored. Let’s therefore include it by writin g dx ^ = F(x(t))-h(t),
(a)
where F(x), the net productivity, is the number of units of fish added to the population per unit of tim e (and h(t) remains the harvest rate). Exercise 1.14 is the special case of (a) for which F(x) = 0. Equation (1.62) is the special case of (a) for which F(x) = Rx(\ - xlK) and h(t) = 0. (i) Suppose that in the absence of harvesting the (long-term) growth of a fish population would be given by (1.62), and observation (i) of Exercise 1.14 would remain valid. Writ e down the ordinar y differential equation that de› scribes harvesting of fish under these conditions. (ii ) Suppose that the number of fishermen, u(l), is constant (even in the long term). Solve your differential equation for x(t) as a function of / in the interval 0 < / < 0 0. *1.16 (i) We have seen in Section 1.9 that a population may adequately be described by (1.63) in the early stages of growth. Indeed this observation is implici t in (1.20) and (1.22). Let x(t) denote the size of an insect population, which acts as a pest on an agricultura l crop and is controlled by applying pesticide. Why might (1.62) actually be inappropriate? (ii ) Assume that the population dynamics would be described by (1.63) if it weren’t for the fact that, enticed by the crop, additional pests of the same species immigrat e into the area of cropland at a constant rate q per unit of
44
Chapte r 1 Growt h and Decay . Dynamica l System s
time. Writ e down a differential equation that describes the growth of the total pest population before the crop is sprayed, (iii ) Show that * W = ( 4 0 )+
I)
at least until the crop is sprayed. * 1.17 (i) In Exercise 1.15, we defined the net productivit y of a species of fish to be the number of units added to the population per unit of time. Let us suppose that the fish are not being harvested (i.e., h — 0). Then what is the relationship between net productivit y and net specific growth rate? In particular , what is the relationship of μ(χ) to the graph of F(x)? (ii ) What is the value of F(0)7 If Κ is the population’s capacity, i.e., the value that χ cannot exceed, then what must be the value of F{K)1 (iii ) In (1.62), with μ(χ) = R(\ - xlK), we assumed that specific growth rate was largest when the population was least. Why might this assumption be unrealistic? (iv) Why might it be more realistic to assume that /i(jc ) is small when χ is small, increases to a maximum and then decreases to zero as χ approaches the capacity, ΚΊ (v) In view of (i) and (ii), what is the shape of the graph of F if it embodies (iv)? (vi) Verif y that F(x) = ax (\ - xlK), where Æis a constant, embodies (ii) and (iv). 2
1.18 Show that model (1.72) for a reversible chemical reaction is mathematically equivalent to the one you developed in Exercise 1.8(i). Hence obtain an expression for £(/). 1.19 (i) Derive (1.78). (ii ) Using the relation uduldx = duldt, where χ is distance travelled, solve (1.77) for u as a function of χ and show that u approaches ˚ as distance travelled becomes infinitel y large. (iii ) Suppose that the length of the course is d. If the crew were magically able to attain speed V instantly, how long would it take them to row the course? (iv) How long does it actually take them? Call this time t and find an ex› pression of the form l = G{q)dl V, where q = MldbSd. (v) Show that G is an increasing function of q, which approaches 1 as q approaches 0 from above. (vi) If q — 0.2, by what percentage is t longer than the tim e given in (iii) ? What if q = 0.02? f
f
f
1.20 (i) What are the dimensions of the constant b in (1.77)? (ii ) By suitably defining dimensionless variables, show that (1.77) may be rewritte n in a form that does not contain any arbitrar y constants.
Supplementar y Note s
45
(ίίί) Integrate this differential equation and compare your answer with the one you obtained in Exercise 1.19. (iv ) By scaling t with respect to \IR and χ with respect to K, show that the logistic equation (1.62) may be written in the form dx There are, of course, no arbitrary constants; but note that the factor ln(2), which appeared in (1.90) has also disappeared. * 1.21 Two plants are feeding off the same substrate, whose weight at time l is 5(0· Can you adapt the model of Section 1.3 to devise a system of two differential equations that describes their growth? Can you solve these equations? What if the plants are identical in all respects but one, namely, that they were of different sizes when they began to feed off the substrate?
Supplementar y Note s 1.1 The number 6.024 ˇ , known as Avogadro’s number, was originall y chosen so that a mole of hydrogen would have a mass of 1 gram. Then the mass of a mole of any other substance could be counted in terms of hydrogen molecule equivalents (or hydrogen atom equivalents, since atoms and molecules are the same thing for elements). Masses quoted in these units are known as molecular weights. Carbon dioxide (C0 ), for example, has a molecular weight of 44 be› cause the carbon atom in each molecule has six protons and six neutrons and each of the two oxygen atoms has eight protons and eight neutrons, making a grand total of 44 protons and neutrons (each of which is counted as a hydro› gen atom equivalent). The problem with this approach is that it pretends elec› trons have zero mass, when in fact their mass is 1/1840 of a proton’s. For greater accuracy, therefore, it is customary nowadays to replace "hydrogen atom equiv› alent" by "equivalent of one twelfth of carbon atom" (in terms of mass); but if you round molecular weights to the nearest integer then it makes no difference. 23
2
2
EQUILIBRIU M
Two more of th e most useful ideas in mathematical modelling are those of equilibrium , or steady state, and stability . Th e tw o are closely related. Withou t stability , equilibriu m has virtuall y no practical significance. With › out equilibriu m (or steady state), stabilit y has absolutely no meaning, ei› ther practical or theoretical. To understand these importan t ideas, it wil l be convenient t o introduc e a littl e fiction. Imagin e that, whil e travellin g through a distant region of the universe, you have accidentally discovered an infinit e two-dimensional world . Thi s world , called Phaseplane, is inhabited by microscopic creatures who call themselves Phasies. They are so tin y that we may thin k of them as points. Because their worl d is absolutely flat, they are lik e points moving about on an infinit e page. What kin d of a worl d is Phaseplane? Th e first thin g I must tell you is that it’ s an extremely windy one! Th e wind in Phaseplane moves in curious ways; yet it s pattern never changes. Thu s maps of it are extremely useful, and every Phasie is given a wind-atlas on her first day in kindergarten. A page fro m thi s atlas appears in Fig. 2.1. It shows the wind pattern over the rectangle 0 < χ < 9 0 ,0 < y < 60; χ and y are measured in phasemiles. (The origi n was chosen by the Phaseplane government and is jocularl y known as the Big Saddle.) A curve in Fig. 2.1 shows the path along which a Phasie would get blown by the win d if she were t o stand at any point along that curve; the directio n of movement is indicated by arrows. Thi s path is known as the Phasie’s phase trajectory. Because Phaseplane is such a wind y place, a curve lik e thi s could in principl e be drawn through any point of the rectangle in Fig. 2.1. The resulting infinit y of curves would fill the entir e diagram. But nobody can draw an infinit e number of curves; and the exercise would be pointless even if possible, because a solid black diagram would give no informatio n about the wind . Thu s a page of a Phasie’s atlas shows only 46
Chapte r 2
0
10
20
30
40
50
60
Equilibriu m
70
80
47
90
Fig. 2.1 Page of a Phasie’s atlas.
a few phase trajectories. Fro m these, a Phasie can infer the entir e wind patter n by using her imagination. Because Phasies are so tin y and the wind so strong, shouldn’t they al› ways go where the win d takes them? Isn’t a Phasie’s path in lif e completely determined by where she began it? There is much trut h in this, but not the whole truth . Th e second thin g I must tell you about is the wicked monster, Perturbation . Although the wind is almost always blowing, there are times when it disappears completely, just for a few seconds. When that happens, Perturbatio n comes out of her lair and takes great delight in blowing the Phasies all over the place. But the wind always comes back withi n a few seconds and, furthermore , resumes precisely the same pattern that it had before it mysteriously disappeared. Then Perturbatio n retire s t o her lair , and the Phasies retur n t o followin g the destinies mapped out for ihem i n the atlas. Phasies have a name for these sudden experiences: they call them perturbations. Perturbation s may be either large or small, depend› in g on how far you get blown fro m where you were; and, as Phasies know well, even a small perturbatio n can be very disruptive. We’ll discuss thi s furthe r below. Though Phaseplane is such a windy world , there are points where the wind velocity is always zero. These special points are known officiall y as static equilibria ; though Phasies often omit the word static and refer
48
Chapte r 2
Equilibriu m
t o them merely as equilibria . Such points are marked on Fig. 2.1 by a small dot. There is one, for example, at the point ( 7 0 , 7) and another at (25,12). Notice how the wind pattern in the immediate vicinit y of one equilibriu m may differ fro m that in the immediate vicinit y of another. Near ( 7 0 , 7 ), for example, the wind is always blowing toward the equilib› rium . Thu s a small perturbatio n would scarcely be noticed by a Phasie at (70,7); the wind , when it returned, would blow her back toward where she came from . For that reason, the equilibriu m at ( 7 0 , 7) is called locally stable. Even a small perturbation , however, would be enough t o nudge a Phasie at ( 2 5 , 1 2) onto a path that spirals outward, toward the curve consisting of four straight-lin e segments linkin g equilibri a at (0,0), ( 5 0 , 5 ), ( 5 0 , 2 0 ), and ( 0 , 2 0 ). Because, followin g a perturbation , a Phasie at ( 2 5 , 1 2) would end up so far fro m where she began, thi s equilibriu m is called unstable. Fro m thi s point of view, the equilibriu m at ( 2 5 , 4 0) is identical t o th e one at (70,7). Both are locally stable. Fro m another viewpoint, however, they differ : a Phasie being blown toward ( 2 5 , 4 0) wil l spiral toward the equi› librium ; whereas a Phasie being blown toward ( 7 0 , 7) wil l approach it head on. We distinguish the tw o by calling the equilibriu m that is approached circuitousl y a focus but the equilibriu m that is approached directl y a node. Hence ( 2 5 , 4 0) is a (locally) stable focus, and ( 7 0 , 7) is a (locally) stable node. Then what is (25,12)? Notice that if the arrow s were reversed then th e win d current s in it s vicinit y would be the same topologically as ( 2 5 , 4 0 ). For that reason, ( 2 5 , 1 2) is called an unstable focus. Similarly , ( 8 5 , 1 5) is an unstable node. W e said that a small perturbatio n would scarcely be noticed by a Phasie who had been occupying (70,7). Nevertheless life, though not disrupted, would never be quit e th e same for her. Even if she lived forever, she would never again retur n to ( 7 0 , 7 ). Th e longer she lived, the closer she would approach; but she would never actually reach it . Why? The answer is that th e win d speed keeps droppin g as an equilibriu m is approached alway s just a littl e below the speed that would be necessary to blow the Phasie back home. (To be just a littl e more precise, the one way in which the Phasie could retur n all the way h o me before the end of eternity would be if the wicked monster blew her back durin g another perturbation ; but that never happens, because monsters are so wicked.) Th e wind in Phaseplane does vary in strength fro m place to place. Indeed the wind velocity can be described by a vector u = (u{x, y), v(x, y)) , where u is the component in the χ direction, the component in the y directio n and both u and are differentiabl e functions. Here, as throughout th e book, bold typeface wil l denote a column vector and superscript Τ it s transpose, which is a row vector. Thu s u = (u{x, y), v(x, y)) is the transpose of u. I f x(i) = (x{t),y(t)) denotes the Phasie’s phase trajectory , then her velocity is dxldt = (dxldl,dyldt) ; and, because the Phasie is carried by T
r
T
T
Chapte r 2
the wind, we have dxldt
Equilibriu m
49
- u or, which is exactly the same thing,
^
= u{x,y),
^
= v{ ,y). X
(2.1)
Let x* = ( x * , y * ) denote a static equilibriu m point. Then, because the win d velocity is zero at x*, we have u(x*,y*) = 0 = v(x*,y*). Because u and are both continuous, you can see that {dxldt, dyldt) wil l approach th e zero vector as the Phasie nears the equilibrium . Th e wind just isn’t quit e strong enough t o take her all the way back home in a finite time. Th e best it can do for her is ensure that r
l i m x ( / ) = x* , OO
li m y{t) = y'
(2.2)
t— 00
(provided there are no furthe r perturbations). However disgruntled thi s Phasie might be, she has less cause for com› plaint than one who resided at ( 6 5 , 4 0) before a (small) perturbation . N o› tice that the wind current s in thi s vicinit y for m closed curves around the equilibrium . A Phasie perturbed fro m ( 6 5 , 4 0) wil l spend the rest of her lif e circlin g it. She wil l not approach it even in infinit e time! On the other hand she at least remains in close proximit y to her old equilibrium . Her plight is not as dir e as that of the Phasie who once resided at ( 2 5 , 1 2 ). Thus ( 6 5 , 4 0) is far fro m being unstable; yet it isn’t quit e as stable as (25,40). How, then, should we distinguish between the two? Some mathematicians prefer to say that both are stable but that, in addition, (25,40) is asymp› toticall y stable. Others, and we are among them, prefer to say mat ( 2 5 , 4 0) is stable, but ( 6 5 , 4 0) is only metastable, or neutrally stable. Al l are agreed that ( 6 5 , 4 0) should be called a center, because the nearby trajectorie s for m closed curves around it. Ther e is also some disagreement as to the best description for the equilibri a at ( 5 0 , 5 ), ( 5 0 , 2 0 ), and (80,30), the neighborhoods of which have th e same topology. Th e equilibri a at ( 0 , 2 0 ), ( 0 , 6 0 ), ( 5 0 , 6 0 ), ( 8 0 , 6 0 ), and th e Big Saddle itself are also of thi s form , though some of the trajectorie s nearby fall on different pages of the Phasie atlas. What distinguishes these equilibri a is that each has tw o trajectorie s of approach; whereas all other trajectorie s emanating fro m the equilibriu m are ones of departure. Thus a Phasie who once resided at (50,20), for example, and just happened t o be perturbed in the x-direction, would have a similar experience to a Phasie perturbed fro m (70,7). For thi s reason, some mathematicians prefer t o call ( 5 0 , 2 0) only partiall y unstable; for them, ( 8 5 , 1 5) would be totall y unstable. Others, and we are among them, prefer t o call ( 5 0 , 2 0) simply unstable, because why would the wicked monster be so considerate as to pertur b the Phasie in just exactly the righ t direction? Al l mathematicians, however, agree that equilibri a lik e ( 5 0 , 2 0) are called saddle-points. We have thus far distinguished four categories of equilibri a on the basis of neighborhood topology: center, focus, node, and saddle-point. A center
50
Chapte r 2
Equilibriu m
must be metastable; a saddle-point must be unstable; and nodes and foci may be stable or unstable. Al l six form s of equilibriu m have one thin g in common, however: they are static. But a Phasie can liv e in a steady state withou t being absolutely static. Thi s is what happens to the Phasies on th e closed curves near ( 6 5 , 4 0 ). It is also what happens t o the Phasies who liv e on the closed curves through ( 1 2 , 4 0) and (43,40); these tw o points are marked by large dots, the only dots in Fig. 2.1 that do not represent static equilibria . But there is a difference. A Phasie who lived on a curve near a center, if slightly perturbed, would continue to liv e lif e on a closed curve. But a Phasie on the closed curve through ( 1 2 , 4 0 ), if perturbed, would either spiral in toward the focus at ( 2 5 , 4 0) or spiral out toward the closed curve throug h (43,40). She would never again find herself on a closed curve. Likewise, a Phasie on the closed curve through (43,40), if perturbed, would never again find herself on a closed curve; rather , depending on the natur e of the perturbation , she would spend the rest of her lif e either spirallin g i n or spirallin g out toward the steady state that she used t o enjoy. For thi s reason, the latter trajector y is called a stable equilibriu m cycle. Th e curve throug h ( 1 2 , 4 0) is called an unstable equilibriu m cycle. The more c o m m on ter m for a stable equilibriu m cycle is limit cycle. Unti l now, we have been talkin g exclusively about small perturbation s and local stability . I f the wind disappeared for quit e a while, however, then the wicked monster might blow the Phasies a long way fro m home; or, as the Phasies prefer t o say, cause them t o suffer a large perturbation . I t is clear fro m Fig. 2.1 that, even if a Phasie occupied a stable equi› librium , such a perturbatio n might land her on a trajector y that would never retur n t o it , even in infinit e time. We would say that her old equi› libriu m was locally stable, but not globally stable. For example, consider a Phasie who occupied ( 7 0 , 7) when the win d disappeared. Suppose that th e perturbatio n shifted her to (49,21). Then, when the win d came back, she would find herself being blown toward the stable limi t cycle in the upper left of Fig. 2.1. I n the conventional jargon, she would find herself in the limi t cycle’s domain of attraction (the region between the unstable limi t cycle and the upper left rectangle wit h a saddle-point at each cor› ner). Unfortunately , the mathematics associated wit h large perturbation s and global stabilit y of an equilibriu m or steady state is beyond the scope of thi s text. Therefore, we shall continue t o assume that any perturba › tio n is a small perturbation , and stabilit y synonymous wit h local stabil› ity . But the universe is an enormous place, and the worl d of Phaseplane is not unique. Rather, there are many such worlds, one for every dynamical system of the for m (2.1). Because there are so many of them, let’s drop th e capital Ρ and use phase-plane t o denote th e "wind " pattern associated wit h a pair of equations of the for m (2.1). Different choices of u(x,y) and v(x, y) wil l lead t o different patterns. Indeed we met tw o systems of the
Chapte r 2
Equilibriu m
51
for m (2.1) in Chapter 1, and it wil l be convenient now to give them a phase-plane interpretation . Fro m (1.20), the simple ecosystem of Section 1.4 corresponds t o (2.1) + b x). There is therefore wit h u(x,y) = x{a - b y) and v{x,y) = y(-a because u and both an equilibriu m at the point x* = (a /b ,a /b ) , vanish there; thi s point is marked wit h a dot in Fig. 1.3. (There is also an equilibriu m at x* = ( 0 , 0 ) , but we paid no attention to it in Section 1.4, because neither species would then exist.) From the pattern in Fig. 1.3, we immediately deduce that the equilibriu m is a center. From (1.22), the simple ecosystem of Section 1.5 corresponds to (2.1) wit h u(x, y) = x(a\ - biy) and v(x, y) = y(a - b x). There is therefore an because u and both vanish equilibriu m at the point x* = {a lb , a\lb{?, there; thi s point is marked wit h a dot in Fig. 1.4. (Again, we ignore the equilibriu m at x* = ( 0 , 0 ) . ) From the pattern in Fig. 1.4, we immediately deduce that the equilibriu m is a saddle-point. {
{
2
2
T
2
2
l
l
r
2
2
2
2
r
By drawin g the phase-plane of a dynamical system of the for m (2.1), we can always find it s (static) equilibri a and limi t cycles; we can also char› acterize them as stable or unstable. But, as we saw in Chapter 1, not every dynamical system consists of a pair of differentia l equations. A system might , for example, be governed by differential-delay equations or a recur› rence relation. It is therefore desirable to fram e more general definition s of equilibriu m and stabilit y than are afforded by the Phasie atlas. Accordingly , we define an equilibriu m (or steady state) of a dynamical system to be a state (or cycle) that wil l persist forever if undisturbed. A n equilibriu m may be unstable, stable, or metastable. It is unstable if there exists a small perturbatio n that wil l cause the system to move furthe r and furthe r away fro m equilibrium . It is stable if any small perturbatio n wil l cause the system t o spend the rest of it s lif e returnin g t o equilibriu m (in th e absence of furthe r perturbation) . And it is metastable if a small pertur › bation wil l neither send the system furthe r and furthe r away, nor retur n it t o where it was, but cause it to persist forever in a state or cycle nearby. By perturbatio n we mean a sudden change of state due t o circumstances outside the control of the system itself (i.e., a change that cannot be pre› dicted by the differentia l equations or recurrence relations that govern the system). Of these three kind s of equilibrium , a stable one is by far the most important , because equilibri a in natur e are subject t o so many random perturbation s that we would not even observe them as steady states unless they were quit e stable. The word "observe" is crucial here, because nothing is trul y constant in nature; but states that change appreciably only over very long tim e scales, such as evolutionary or geological ones, wil l appear t o be steady a t least to mere mortals an d we model things as we observe them. Moreover, even fro m a purely mathematical viewpoint, things often appear steady when in fact they are not (consider equation (1.16) for very
52
Chapte r 2
Equilibriu m
large values of t). Thu s a system that, followin g a perturbation , wil l take infinitel y long in theory t o retur n t o stable equilibriu m can be regarded, in practice, as resuming it s former state withi n a finite time. Stable equilibri a can be identified in tw o ways: either directly by solv› in g an equation or equations whose solution can only be an equilibrium , or indirectly by followin g the system through a sequence of nonequilibriu m states which converges to the equilibrium . (Unstable equilibri a can be identified only directly . Why?) Thi s is a chapter on equilibriu m models; therefor e we are primaril y concerned wit h the first of the tw o methods. But we’ll begin, in Sections 2.1 and 2.2, by understanding the interrelationshi p between the tw o methods. From Section 2.3 onward we’ll concentrate on th e direct method.
2.1
Th e Equilibriu m Concentratio n of Contaminan t in a Lak e
Suppose that, at tim e / = 0, the concentration of contaminant in a certain lak e of volume Vis x(0) = x tonnes per cubic meter. A new polluter now begins to pollut e the lake at the rat e P tonnes per day. There are no other polluters. What wil l be the equilibriu m concentration of contaminant in th e lake? First , let’s answer thi s question by using the direct method; i.e., let’s construct an equation whose solution can only be an equilibrium . Let x* tonnes per cubic meter be thi s equilibriu m concentration. Then, if water flows out at the rat e r cubic meters per day, the daily outflow of contami› nant is rx* tonnes per day. I n equilibrium , thi s daily outflow must balance th e daily inflo w P . Hence rx* = P or 0
in
i n
in
x' = ^ -
(2.3)
N ow let’s use the indirect method. From Exercise 1.8: Rate of change _ Pollution _ Pollution of pollution ~~ inflow outflow j {Vx{t)} t
=
P
in
-
rx{t).
N o t e that (2.3) is the particula r solution of thi s equation for which dxldt 0. You can easily show that the general solution i s x(l) = £ a + (x(0) -
e-
n l v
.
=
(2.5)
I f it just happens that x{0) = x*, then you can see fro m (2.4) and (2.5) that the new polluter makes no difference; the lake remains forever in the state x(0). I f x(0) φ * , however, then we can follow the sequence of states
2.2
Rowin g In Equilibriu m
53
{x(t):t> 0 } , which converges t o the equilibriu m concentration as t -> oo. I f x* < x(Q), then the pollutio n continues to fall; if x' > x(0), then th e pollutio n rises. (I f P = 0, of course, then the pollutio n just decays at th e rat e determined in Section 1.1). in
2.2
Rowin g in Equilibriu m
I n Section 1.12 we developed the followin g model for determining th e speed of a rowin g boat: , .• Tractiv e Acceleration = . force
Mass
»s M
x
8
T t
=
Drag force 3
x
A r t
^
1
τ
where ξ{ή denotes the speed of the boat at tim e t, Μ it s mass, Ρ the effective power supplied by an oarswoman, S the wetted surface area and b a constant. We may regard ξ(ή as th e state of a dynamical system. Thi s system has a "static " equilibrium , in which the boat is moving but it s speed does not change, if ξ(ί) = ξ* = constant. Then άξ/dt = 0, and th e tractiv e force exactly balances th e drag. Let us define 1
*>"37{t -"4
'>
<2 7
Then, using the direct method, the equilibriu m speed is given by /(ξ*) = 0 or ι, pΡv\ 1/3 ˆ = ^ 2 ( - ) , (2.8) 1/3
where Vis the speed denned by (1.79). Thi s equilibriu m can also be found indirectl y by solving equation (2.6) and followin g the sequence of states {ξ(():ί > 0} as t oo. We di d thi s in Chapter 1 and saw fro m Fig. 1.8 that ξ -+ V as l -* oo. But thi s result also follows fro m (2.6). For i f ξ(ή < F t h en th e righ t hand side of (2.6) is positive, implyin g that άζ/άί > 0 and ξ increases wit h t; whereas if ξ(ή > V then the right-han d side of (2.6) is negative, implyin g that άξ/dt < 0 and ξ decreases wit h /. Thu s ξ is always approaching V— even i f the oarswomen began by rowin g faster, the excess of drag over tractiv e force would soon reduce their speed to V. These arguments are sufficient to show that the equilibriu m ξ = ξ* = V i s stable. But it wil l be instructiv e to verif y thi s result by an alternativ e The speed is denoted by ξ rather than u as in (1.77) to emphasize its role as the state of a dynamical system.
54
Chapte r 2
Equilibriu m
method. Suppose that the oarswomen are rowin g at the equilibriu m speed ˚ when their boat suffers an external shock, such as a sudden gust of wind . Thi s perturb s their speed fro m ˚ t o V+ n , where n is small. Withou t loss of generality, let’s suppose that thi s all took place at tim e / = 0. Then the subsequent motion of the boat is governed by (2.6) wit h ξ(0) = V+ η . Let us define relativ e velocity η(ί) = £(f) - Κ so that »?(0) = n . Then, on using (2.6), (2.7), and the Taylor expansion of / about V, the motion is governed by 0
0
0
0
j {r+ri=AV+n)=AV)
(2.9)
+ nr(V)+ θ( ), 2
t
η
where 0(η ) is defined by (1.1). N ow dVldt = 0=f(V). Moreover, because η is small and η continuous, ??(/) must remain small at least for / close t o zero. Then 0(η ) is negligible, and (2.9) yields the approximatio n 2
0
2
fro m which you can readily deduce that rfi)
M
fV>
%
= η β-^"
Μ
0
(2.11)
= e-", no
where º = IbSVIM. Thu s η(ή remains small, not just for small t but for all t, and dies away completely as / —• oo (though note that would increase withou t bound if º were negative). Th e rapidit y of retur n t o equilibriu m i s clearly measured by the rat e |A| at which (2.11) decays t o zero. (You should verif y that |A| is indeed a rate, i.e., has the dimen› sions of I /time ). Th e larger thi s rate, the more rapi d the return . More › over, the larger thi s rate, the sooner a crew reaches equilibriu m speed fro m rest, and the better an approximation it is t o estimate their tim e i n a race by assuming they row at equilibriu m speed for it s entir e du› ratio n (see Exercise 1.20). We shall make use of thi s observation in Sec› tio n 4.4. W e have thus used analytical methods t o establish the stabilit y of the equilibriu m * = K(whereas Fig. 1.8 established thi s graphically). Likewise, we can determine analytically whether equilibri a of the system j l = u(x,y),
^
= v{x,y)
(2.12)
are stable or not (we do thi s graphically by sketching it s phase-plane). be a static equilibriu m of thi s system. Let relativ e dis› Let * = (χ',γ') where placement fro m thi s equilibriu m be defined by tj(i ) = (η(ή,ζ(ή) , r/(i ) = x{t) - x* and C(0 = y(t) - y*. Then, on using Taylor’ s theorem for 7
τ
2.2
Rowin g In Equilibriu m
55
function s of tw o variables, we deduce fro m (2.12) that j {x'
+ } = u(x' + ,y
(
η
r
+ 0
n
= u(x', / ) + ηγ {χ*,
f)
χ
+ C
,/ ) +
0(e ) 2
(2.13) ^ { / + C }
=
v
(
*
*
Ο
= v ( x * , / ) + v^ix*
/ )+
,y') +
0(Λ
where e is defined to be the maximum of η and ζ. I f η and C are small initially , then so is e. Thus, at least for a short tim e after the system has suffered the perturbatio n ij(0 ) = = (η , ζο) , the evolution of the relativ e displacement ( ) is well approximated by ignorin g the 0{t ) terms in (2.13). Moreover, x* is a static equilibrium ; therefore we have dx'ldt = 0 = dfldt and u(x*, y*) = 0 = vi** , / ) . „ , on defining τ
0
0
2
du, , 4»ii = ^ ( J C . J ' ) .
du. „ ^12= ^ r i ^ . J ' ) . 7
7
ft I = ^ ( * * . f ).
( · 2
1
4
)
#22 = ^ ( * * . f )>
th e immediately subsequent motion of the system is approximately gov› erned by the linear equations
Multiplyin g the second of (2.15) by g and using the first of (2.15) t o replace g ( by άη/dt - g q, we easily obtain n
l2
u
-
(ΖιØ
+ 822)
+
(Si
1822
= 0.
~ 812821)*}
(2.16)
Fro m the first of (2.15), and because ?j(0) = η , we must solve thi s equation for η(ή subject t o 0
,(0 ) = , *
η'(0)- η(0)
=
8ιι
8 ι 1
ζ . 0
(2.17)
I t is known fro m the theory of ordinar y differentia l equations that any solution of (2.16) must have the for m η(ΐ) = Α (ί) ηι
+ Βη (ί), 2
(2.18)
where A, Β are constants and 77, (f), η (ή are any tw o nonzero solutions that are not constant multiple s of one another; see, for example, Theorem 3.9 of Boyce and DiPrim a (1965, p. 97). It follows, in particular , that the solution satisfying (2.17) must have the for m (2.18). N ow consider the quadrati c 2
56
Chapte r 2
Equilibriu m
equation
+^22^+^11^22-^12^21 = 0 .
ø - ( £ ,, 2
(2.19)
Th e roots, u>\ and ω , of thi s equation must belong to one of the followin g three categories: 1. real and unequal; 2. real and equal, i.e., ω = ω = ω; 3. complex conjugate, i.e., ω = ρ + iq, ω p — iq, where i = You can verif y by simple substitution (Exercise 2.1) that appropriat e form s for η\ and η corresponding to the three categories are, respectively: 2
χ
2
χ
2
2
1. >,,(/) = **"’ ,
n U) =
^' 1
2
KU)=tt"
2. n,(i) =<*"’ ,
3. >?,(/) = β* cos(qt),
(2.20)
η (ί) = e 2
pl
%m(qt).
I t follows immediately fro m (2.18) and (2.20) that η(ή wil l decay t o zero oo if both ø , and ω have negative real parts, wil l increase withou t as bound as - Œ» for some η if either w, or w has a positive real part , and wil l oscillate wit h constant amplitud e if both w, and ω are purely imaginary, where ø , and ω are defined as the roots of (2.19). Moreover (Exercise 2.2), you can show that C obeys the same differentia l equation as η, so that what we have just said about n(r) is also tru e of C(0- Combinin g our results, we find that x* is (locally) stable if w, and w are both negative, metastable if w, and w are purely imaginary, and unstable if either w, or w has a positive real part . I f case (3) applies, then trajectorie s in the phaseplane near x* wil l spiral around it . I n conclusion, the natur e of the static equilibriu m x* may be classified as follows fro m knowledge of the roots of (2.19): 2
0
2
2
2
2
2
2
ROOTS OF (2.19)
EQUILIBRIUM
Real, both positive Real, both negative Real, opposite signs Complex, purely imaginary Complex, ρ > 0 Complex, ρ < 0
Unstable node Stable node Saddle-point Center Unstable focus Stable focus
(2.21)
Limi t cycles are somewhat more difficul t to identif y and classify ana› lytically . We wil l proceed ad hoc whenever we meet them. N ow tr y Exercise 2 . 3 . 2
2
See Supplementary Note 2.1.
2.3
2.3
How Fast Do C a r » Driv e Throug h a Tunnel ?
57
How Fast Do Cars Driv e Throug h a Tunnel ?
Th e more congested a tunnel is, the slower the cars move; the less con› gested, the faster. Thu s the speed of cars through a tunnel is a decreasing functio n of congestion. How does thi s function decrease? I n thi s section, we’ll attempt t o answer that question by using an equilibriu m model. First we need a suitable measure of traffi c congestion. One such mea› sure is the traffi c density, x, i.e., the number of cars per unit length of road. I n general, the density Λ: varies wit h time, /, and wit h distance, z, along th e road; hence χ = x(z, t). We measure the density by takin g aerial pho› tographs at fixed times. Let one such tim e be t = t . Then, to measure the traffi c density at a particula r station = z on the road (at tim e / ) , we use the photograph to count the number of cars in a suitable interval of th e for m z - e/2 < ζ < ζ + e/2 and divid e the answer by t; thi s is our estimate of x(z ,t ). Th e interval length e must be chosen carefully. It can› not, of course, be less than a few car-lengths; neither can it be too long, for importan t spatial variation s of density would be smoothed out. It is prob› ably best t o choose c somewhere between 30 and 50 meters, and certainly much less than a mil e (even though traffi c density is traditionall y quoted as number of cars per mile). Because z is arbitrary , and because we may repeat thi s procedure for any value of z , a single photograph wil l enable us to plot x(z, t ) as a function of z. A series of such photographs taken at different times wil l enable us t o estimate x(z, t). I f speed is a decreasing function of traffi c congestion, and if density χ is our chosen measure of congestion, then = v(x) where 3
0
0
0
0
0
0
0
0
0
Ax)
< 0.
(2.22)
At one extreme, if traffi c is very light , then cars are free to move at the speed limit , which we wil l denote by v . Thi s may be the official speed limi t if police are watching, or whatever speed driver s deem safe, if not; all that matters is that the limi t exists and may be assumed the same for all drivers. Hence there exists some critica l traffi c density x such that m a x
c
if0<x<x .
v(x)=v
(2.23)
c
max
should be interpreted as meaning that a car Th e condition v(0) = v that enters an empty road is free to driv e at the speed limit . At the other extreme, if traffi c is so heavy that cars cannot move, then traffi c density . Thus has reached it s maximum, which we wil l denote by x m a x
m a x
v(*
m a
J = 0.
(2.24)
N ow assume that x < χ < x , so that there is some degree of con› gestion; and suppose that the cars have reached an equilibrium , in which c
max
You may wish to review Section 1.13 before proceeding.
58
Chapte r 2
Equilibriu m
all are cruising at th e constant speed v, at th e same distance d fro m th e car in front . To make matters simple, we’ll also assume that all cars have th e same length, L. Then th e traffi c density is
*-7πτ
'
(2 25>
(why?). Note that, although equilibriu m density, x, and equilibriu m veloc› ity , = v(x), are independent of both ζ and r, their values may vary fro m tunnel t o tunnel. I n thi s section, we’ll assume that our equilibriu m is stable. We’ll discuss whether that assumption is reasonable or not i n Section 2.8. Let’ s assume that th e dynamics of approach t o thi s equilibriu m are governed by th e model introduced in Section 1.13. Then, fro m (1.83), dz-Xt+ J d
t
t) = º In \zj{t) - zj_ , ( 0| + aj,
(2.26)
where Zj(t) is th e displacement of the jt h car in a platoon of Ν cars, and where r is the driver response time. Now, we have just assumed that all cars are moving at th e same speed v, wit h fron t bumpers a distance d+L apart. Therefore, for a l l a n d at all times, dzj(t+r)/dt= v, \zXt)-z _ {t)\ = d+L and aj i s independent of j . Hence (2.26) yields = º \n{d + L) + a. Fro m (2.25), and on using (2.24) t o determine a, we deduce j
y(x) = A l n ( i s a * ) ,
x <χ < x . c
mM
l
(2.27)
Th e value of º i s determined fro m th e assumption that v(x) is a continuous and hence, in particular , at functio n throughout the interval 0 < χ < x χ = x . Thu s m a x
c
0 <χ < x
c
v(x) = {
» n ( W s) Mnax ,
.
.
r
, ι
Xc
<
r
<
X
(2-28)
r
_
-*max •
You can easily see that (2.22) is satisfied. H o w good is thi s model doe s it fit th e facts? A possible objection t o thi s model is that traffi c density i s not allowed t o vary across the road, as i t surely would if a road had several lanes. I n a tunnel, however, cars are invariabl y prohibite d fro m switching lanes, so that each lane behaves as though it were a separate tunnel and density varies only along the road. But does it vary along the road as predicted by (2.28)? Perhaps you would lik e t o thin k about that we’l l retur n t o thi s point i n Chapter 4. Meanwhile, tr y your hand at Exercises 2.4, 2.5, and 2.10.
2.4
Salmo n Equilibriu m and Limi t Cycle s
Th e salmon population described in Section 1.8 wil l be in static equi› libriu m i f the population (i n hundreds of millions) persists forever at th e
2.4
Salmo n Equilibriu m and Limi t Cycle s
59
level x*. Recall fro m (1.54) that the population’s dynamics are governed by the recurrence relation 4
x
(2.29)
= ax„e- ", bx
n+i
where x denotes the population at the end of cycle n. Hence, in equilib› = x„ = x* for all n. On using (2.29), we find that rium , we have x n
n+l
x* = ax'e~ ';
(2.30)
bx
whence, since * φ 0, we have (2.31)
x* = ^ln(a).
Equation (2.30) is one whose solution can only be an equilibrium . Thus (2.31) has been found by the direct method. I n principle , if x„ could be expressed explicitl y as a function of n, then we could find x* indirectl y as the limit , as η * oo, of the sequence {x }. But no such expression is known. Thu s the direct method is the only one that enables us to identif y the equilibriu m for arbitrar y values of a and b. For particula r values of a and b, however, we can identif y the equilibriu m by solving (2.29) numerically. You did thi s in Exercise 1.9 for b = l n ( 1 0 )« 2.3026 and for various values of a. Th e first value was a = 5, yieldin g x' = ln(5) + ln(10) « 0.6990; and you can see fro m Table 1.2 that thi s is the limitin g value of the sequence {x }. Now, the indirect method work s only for stable equilibria , so that (2.31) must be a stable equilibriu m for a = 5 and b - ln(10). It is pos› sible t o verif y thi s by analogous methods t o those of Section 2.2. Recall fro m (1.48) that (2.29) is just the special case of the recurrence relation n
n
(2.32)
x =F(x ) n+l
n
for which F(x) = axe~ . Any static equilibriu m x' of (2.32) must satisfy n+\ = x„ = x* for all values of n; whence x' = F(x"). Combinin g wit h (2.32) and using Taylor’ s theorem, we find that bx
x
x
-x>=
n + 1
F(x„) - F{x*) = F'ix*) • (x„ - x*) + oi\x
n
- x'\),
(2.33)
where littl e oh is defined by (1.8). I f x is very close t o x* , then o ( | x - x * | ) is so small as to be negligible; let’s therefore neglect it . Now, if |F’(x* )| < 1, then | x | - x * | < | x - x * | ; i.e., x„ is closer t o x* t h a n x . By an extension of thi s argument, we see that the sequence {x } converges to x* if n
+
+i
\F'(x*)\ < 1.
(2.34)
Thu s x* is a stable equilibriu m if (2.34) is satisfied. On the other hand, if |F’(x*) | > 1, then the sequence {x } diverges fro m x* ; i.e., the equilibriu m You may wish to review Section 1.8 before proceeding.
60
Chapte r 2
Equilibriu m
i s unstable. For F(x) = axer , we obtain \F'(x')\ = a e~ *\l - bx*\ = |1 - In(o)|, on using (2.31). Thu s (2.31) is stable or unstable according t o whether a < e («s 7.4) or a > e . I t is therefore stable for a = 5. (Moreover, it is actually unstable for a - 10, so that the slightest perturbatio n would cause x„ t o move successivel y furthe r and furthe r away fro m χ" = I . W e. identified thi s unstable equilibriu m by th e indirect method in Table i.Z only because we were fortunat e enough t o pick j t = 1 = x* ia.,the nil-* merical iteration. ) Accordin g t o (2.34), (2.31) is unstable when a = 11, because 11 > . But look at the column of Table 1.2 corresponding t o a - 11. You can see that th e sequence of values {x„} converges toward a stable equilibriu m cycle, or limi t cycle, in which the population magnitude alternates for th e rest of tim e between th e values x = 0.3568 and χ ~ 1.726. We wil l denote thi s limi t cycle by { ι,Χυ)· Thi s particula r limi t cycle was identified indirectly ; but the direct method identifies all such limi t cycles, i.e., all limi t cycles wit h a period of tw o tim e units. First , recall fro m (1.92) that, by defining bx
b
2
2
0
2
L
υ
χ
3ζ=£.
(2.35)
i.e., by measuring population in unit s of 1001n(a)/6 millions, we can scale th e parameter b out of recurrence relation (2.29) and writ e it in the dimensionless for m (2.36)
xTTi^e* -™, 1
where r = ln(fl) . Let us define y = x = bxjr and = χ = fcty/r. Then, because {y,z} constitutes a limi t cycle wit h period 2, (2.36) yields L
υ
z = ye' -'\
(2.37)
y = ze' - .
tl
il
2)
Eliminatin g ζ fro m these equations, we obtain ye^~ = 2-y. Eliminatin g y fro m these equations, we obtain ze* '^ - 2 - ζ (Exercise 2.6). T h u sy and ζ must both be roots of the equation g{w) = 2 - w, where y)
1
g(w)= we*’-*’) .
(2.38)
Th e function g(w) has a maximum (ff - X)lr at w = Mr and an inflection point at w = 2/r (verify) . Th e roots of g[w) ~ w can be found graphically as the points where the curve W = g(w) meets the straight lin e W — 2-w. I t is clear fro m (2.38) that w = 1 is always a root. Moreover, fro m Fig. 2.2, thi s i s the only root if ^ ( 1 ) > - 1 ; whereas there are tw o other root s i f ^ ( l ) < - 1 . Th e condition for an equilibriu m cycle wit h period 2 i s therefore 1 - r < - 1 or r > 2. Th e corresponding values of y and ζ can be determined fro m (2.38) for any specific value of r. When a = 11, for example, so that r - l n ( l l ) = 2.398, th e Newton-Raphson iterativ e technique finds the roots of (2.38) to be y = 0.342658, ζ = 1.65734 (and 1).
2.4
Salmo n Equilibriu m and Limi t Cycle s
61
w
2
\
Fig. 2.2 Graphical determination of equilibriu m cycle with period 2.
These values correspond to x = 0.3568 and x = 1.726 (hundreds of millions ) in Table 1.2. Let the period-2 equilibriu m cycle for arbitrar y r (> 2) be denoted by MO . z( )}- Then the functions y = y(r) and = z(r) are denned implicitl y by (2.38). For the sake of definiteness, y[f) is the smallest of the three roots and z(r) the largest (so that 0 < y(r) < 1, 1 < z(r) < 2). Th e tw o functions are sketched in Fig. 2.3. A s r becomes indefinitel y large, the smallest root approaches zero; whereas the largest approaches 2. A s r approaches 2, on th e other hand, the equilibriu m cycle collapses to the static equilibriu m x* = 1. L
v
r
y.:.
˜
- (’ )
( ι ) /
˜
v ( c)
2.0
1
1 2.2
\ / l
]
2.4
Fig. 2.3 Period-2 equilibriu m cycles {y(r),z(r)},
1
1
'Ί
l
2.6
which are limi t cycles for r < r . 2
62
Chapte r 2
Equilibriu m
W e have established th e existence of a period-2 equilibriu m cycle for all r > 2, but thi s cycle is a limi t cycle only if it is stable. Th e condition for thi s is Δ(ª)<1,
(2.39)
where A(r) = |(1 - ry(r))(i
- 2r + ry(r))\ = |(1 - rz(r))( l - 2r+rz(r))\.
(2.40)
To see this, observe that for any n, we have Xn+2 = W
K I
~
j e
"
+
’
= Χηβ* -**-**""^,
)
(2.41)
2
on using (2.36). Hence tw o recursions of (2.36) are equivalent t o a single recursion of the recurrence relation X = G(X ), where n+l
n
(2.42)
G(x) = xe' - - ' ~ ; i2 x xe {l
x,)
thi s implies (verify ) that G'(x) = (1 - rx) • (1 - rxe* - ) [ x)
(2.43)
• 'ν- - '"- \ χ χ
χ)
β
Let denote either y(r) or z(f). Then, fro m (2.38), v e = 2 - v; so that G'(v) = (1 - rv)( l - r( 2 - v)). Because the stabilit y condition is |G’(v)| < 1, fro m (2.34), we arriv e immediately at (2.39). Th e function Δ is also sketched in Fig. 2.3. It s graph appears t o be tw o straight lines but in fact has a slight curvature, upward to the left of th e cusp at r = 2.2564 and downward t o the righ t of it . (Th e cusp occurs at the root of the equation έ·'~ = 2r I and corresponds t o the value of r for which the m a x i m um of g in Fig. 2.2 is at y.) We deduce fro m the graph that the period-2 equilibriu m cycle is a limi t cycle if r < r , where Δ ( ª ) = I . It can be shown (Exercise 2.7) that r = 2.5265. Th e period-2 equilibriu m cycle is unstable if r > r , but limi t cycles wit h period higher than 2 may still exist (see Exercise 2.8). Indeed there i s a bounded increasing sequence r < r < r < r < • • •, wit h limi t point r* = 2.6924, such that the population x wil l settle down to a limi t cycle wit h period 2* whenever r < r < r ; see Clark (1976, pp. 2 1 5 - 2 1 6) or May (1976, pp. 12-14), by whom the model of Section 1.8 is denoted "For m B." The first three terms in the sequence, already found, are r = 0, = 2, and r = 2.5265. The static equilibriu m x* = 1 is regarded as a period-1 limi t cycle, so that convergence to it is guaranteed whenever 0 < r < rj . The steady state is still x* = 1 when r = r but convergence K I - v )
,}
2
2
2
2
0
x
2
3
n
k
k+i
5
0
2
u
In theory, this may not be tru e if the initia l condition just happens to place the population in an unstable equilibriu m cycle. In practice, however, there are bound to be perturbations, the slightest of which wil l destroy the unstable equilibrium ; see Exercise 2.9. 3
2.5
Ho w Muc h Heat l o s s Can Double-Glazin g Prevent ?
63
is then extremely slow. For r > r*, the population may never settle int o any finite cycle, as suggested by the columns in Table 1.2 corresponding t o Æ = 15 or r = 2.71. But what does all thi s have t o do wit h salmon? Do salmon populations fluctuate in a limi t cycle? Perhaps you would lik e t o thin k about that we’l l retur n to the matter in Chapter 4. Meanwhile, you should not proceed t o Section 2.5 before attempting Exercise 2.10.
2.5
How Muc h Heat Los s Can Double-Glazin g Prevent ?
Th e wall of a buildin g is in (thermal) equilibriu m if it transfers heat at a constant rate, in much the same way as a rowin g boat is in (mechanical) equilibriu m if it moves at a constant speed. I n winter , the air outside a buildin g is considerably colder than the air inside, so that heat energy is transferred outward; i.e., the buildin g loses heat. Muc h of the heat is lost throug h windows, and double-glazing can reduce thi s loss. By how much? I n thi s section, we’ll use an equilibriu m model t o explore that question. Let ˆ , be the temperature of air inside the buildin g and T the temper› atur e of the outside air ; it’ s winter , so ˆ , > T . Let d be the thickness of a pane of glass and L the distance between panes of a double-glazed window, as in Fig. 2.4 (a). Let x, increasing outward, measure distance perpendic› ular t o the window. It is convenient t o let the inside pane meet th e inside air at χ - 0. Then the outside pane meets the outside air at χ = 2d + JL, and air occupies the gap d < χ < d + L. Let T(x) denote the temperature at station x, so that ˆ(0 ) = ˆ , and T(2d + L) = T We’ll denote T(d) by T and T(d + L) by T . Let F{x) denote the heat flux per unit area at station x, i.e., the heat energy lost per unit tim e fro m left to righ t across unit area of the plane wit h coordinate x. Then, if F does not vary withi n any χ = constant plane, the actual heat flux across area A at station χ is AF(x). How does F(x) depend upon temperature? I f you attempted Exercise 2.10, then you have already trie d to answer thi s question. Let e be some very small number. Then the temperatur e gradient across the interval fro m χ - 112 to χ + e/2 is 2
2
v
A
B
r(x -e/2)-T(x
+
e/2)
e I f T(x - e/2) = T(x + e/2) then no heat flows across the interval . I f T{x e/2) > T(x + e/2), then heat flows fro m hot t o cold, i.e., fro m left t o righ t i n Fig. 2.4 (a); and the steeper the gradient, the more heat that flows. It therefor e seems reasonable t o assume that F(x) is proportiona l t o (2.44); i.e., that F(x)=-k^.
(2.45)
64
Chapter 2
Equilibrium
Wall
Wann inside air(T.)
Cold outside air (T 2 )
4-d-¥*-L-*4-d-¥ |
Wall
|
2d + L (a)
¥*
(b)
Fig. 2.4 (a) Cross section of window, (b) Steady temperature distribution. This approximation has been found acceptable and is used by physicists. The constant of proportionality is called the thermal conductivity and depends upon the medium through which the heat is flowing. Because F has the dimensions of energy per unit area per unit of time (say, Joules per second per cm2), it is clear from the dimensional consistency of (2.45) that k has the dimensions of energy per unit time per length per degree (say, Joules/cm · sec · °C). We will denote the thermal conductivities of air and glass by kA and kG, respectively. Let us now assume that the glass and the air between the panes are in thermal equilibrium. Then the heat flux is constant. Hence T'(x) will be constant in each of the intervals 0 < x < d, d < x < d + L, and d + L < x < 2d + L; but will be discontinuous at JC = d and x = d + L, because of the discontinuity in k. This is depicted in Fig. 2.4 (b). Thus TX-TA T Ti *- = F. Β -k = k, τΑ-τ (2.46) -KG—: ~c--M d L On solving these equations we find (verify) T[ + (p+l)T2 + Γ2 (2.47) TÀ _0>+1)7Ί = T„ = P+ 2 ' P+2 ' where koL (2.48) p = kAd· Hence kGTl-T2_kA p (2.49) :(Γ, - T2). F= d p+2 L p+2 Now, if the window were single-glazed with the same amount of glass, then the heat loss would clearly be
Fs=kfdiT{
T2).
(2.50)
2.5
Ho w Muc h Heat Los s Can Double-Glazin g Prevent ?
65
Hence the relativ e reduction of heat loss is the proportio n Α
=
1
F ρ - Ί Γ = 7ΤΪ·
( 2
·
5 1 )
Accordin g to Landau et al. (1967, p. 321), the thermal conductivity of glass at room temperature is between about 4 1 0 ~ and 8 10~ J/cm • sec • C . (Thermal conductivity varies slightly wit h temperature, but th e effect is negligible in the circumstances being considered.) According to Batchelor (1967, p. 594), the thermal conductivity of dr y air at th e same temperatur e is about 2.5 1 0 ~ J/cm - sec • C . It therefore appears that k lk lies between about 16 and 32. A manufacturer of double-glazing would surely use glass wit h the best available thermal properties, and so let’ s assume that k lk = 16. Then, defining the gap aspect rati o to be h = Lid, (2.51) reduces to ˜(¸ ) = hl{h + 1/8). Thi s heat loss reduction factor is plotted in Fig. 2.5 and clearly shows th e insulating effect of a narro w gap of air. Indeed ˜ increases so sharply wit h h that a gap of four pane-widths achieves a heat loss reduction of 97%. Thereafter, ˜(¸ ) increases very slowly; so that, t o tw o significant figures, th e reduction factor is 0.98 for all values of h between 5 and 8. It therefore appears that very littl e is t o be gained fro m increasing the separation of th e window panes beyond a value of about four pane-widths. Manufactur › ers evidently agree. Double-glazing is advertised regularl y in th e pages of Architectural Digest; and you can see fro m the diagram between pages 64 and 65 of the April , 1986 issue, for example, that the value of h is just a littl e bit bigger than 4. I f cheap air is such a good insulator, as Fig. 2.5 suggests, then why is expensive synthetic fiber used to insulate cavities in walls? Th e answer is that air is an efficient insulator only if it is both dr y and stagnant, as we have tacitl y assumed (wit h good reason, because th e cavity between th e panes of a double-glazed window is perfectly sealed). Ai r containing water vapor has a higher thermal conductivity, and air that is moving can 3
3
4
G
A
G
A
Fig. 2.5 Heat loss reduction factor as a function of the gap aspect rati o h = Lid when k = \6k . G
A
6
Chapte r 2
Equilibriu m
remove heat rapidl y by a mechanism known as convection (transport by a moving medium), which is fundamentally different fro m the mechanism of conduction (transport through a medium at rest) described in thi s sec› tion . Fillin g the gap between the inner and outer brickwor k of a building’ s external walls wit h synthetic fiber prevents convection withi n the gap fro m transportin g heat t o places that are especially vulnerable to heat loss (i.e., holes!). Mathematical models of convection wil l be explored in Chapters 9 and 11. Moreover, by introducin g a dynamic model for heat conduction i n Chapter 11, we wil l show that the indirect method can also be used t o identif y the (stable) equilibriu m temperature distributio n that we found directl y in the present section. I n preparation for this, observe fro m (2.45) that , because heat flux is constant in equilibrium , th e steady temperature distributio n must satisfy (2.52) Meanwhile, tr y your hand at Exercises 2.11 and 2.12.
2.6
Wh y Ar e Pipe s Circular ?
Th e pipes that brin g water int o your house have a circular cross section. Why ? Wh y not elliptical ? Th e answer is that, for a given cross-sectional area, a circular pip e carries a greater quantit y of water per unit of tim e than any elliptical one. To see this, we wil l have to develop a mathematical model of water flowing through an elliptical pipe. I n keeping wit h the titl e of thi s chapter, we wil l assume that thi s flow is in equilibrium . Let a typical cross section of our elliptical pipe have area A, major axis 2a, and minor axis 2b. Let Oxy be a Cartesian coordinate system, wit h Ο at the center of the pipe, Ox along the major axis, and Oy along the minor one (Fig. 2.6). Then the cross-sectional area is given by A = nab,
(2.53)
and the inner wall of the pip e has equation x y ? F = < • > Let w be the velocity of water along the pipe, perpendicular t o the cross section in Fig. 2.6 and out of the page. Th e flow is in equilibrium , and so w is independent of time. Th e velocity of flow wil l vary across the pipe, however, wit h faster flow in the center and slower flow near the wall, so that w is a function of and y. At the wall itself, the velocity wil l be zero, because the outermost particles of water adhere t o the pipe. Hence 2
2
+
w(x,y)
l
= 0 for all x,y satisfying (2.54).
2
5 4
(2.55)
2.6
Wh y Ar e æ » Circular ?
67
V
- - ^ ^
+h
D,
1
h
\
r
A'
"B
ι
ι
ο a
- a
\L
C
\
\
+
\
-
2
a
a
-
j
J Ψ
Fig. 2.6 Pipe cross section.
Th e constraint (2.55) is known in fluid dynamics as a boundary condition. Th e force that reduces th e velocity of the outermost particles t o zero is known as friction . Frictio n is present throughout th e flow, though it is stronger at th e wall than anywhere else. Th e effect of frictio n withi n the flow is that water near the walls attempts t o retar d the adjacent water; thi s water, in turn , attempts t o retar d the water adjacent t o it ; and so on across th e flow, wit h slower water exerting a drag on th e faster water adjacent t o it . But, according t o N e w t on (or, if you prefer, borrowin g fro m physics), every action has an equal and opposite reaction. Thus an equivalent pictur e is that th e water near the center of th e pipe attempts t o accelerate the adjacent water; thi s water, in turn , attempts t o accelerate the water adjacent t o it ; and so on across the flow, wit h th e faster water exerting a tractiv e forc e on th e slower water adjacent t o it . But the attempts t o accelerate are unsuccessful, because th e water is flowing in equilibrium . Another way of describing all thi s is t o say that the faster water is losing it s momentum t o slower water; that slower water is losing it s momentum, i n turn , t o slower water still ; and so on across th e pipe, wit h each layer of water losing it s momentum t o the slower water adjacent t o it . Therefore, i n equilibrium , there is a steady flux of momentum across the flow. (Each layer does not, of course, lose all it s momentum, or there would be no flow; except for the outermost layer, which loses all it s momentum t o the wall. Th e wall experiences thi s momentum transfer as a tractiv e force. Th e equal and opposite reaction is the wall’ s drag on the water, often dubbed the skin friction , which, as explained toward th e end of thi s section, is ultimatel y responsible for the pipe’s resistance t o the flow.) Thi s steady outward flux of momentum is reminiscent of the previous section, where a temperature gradient caused a steady outward flux of heat. N ow a velocity gradient is causing a steady outward flux of momentum. By analogy wit h (2.45), it seems fair t o assume that the flux of momentum
68
Chapte r 2
Equilibriu m
per unit area across the plane wit h coordinate χ is ~ ^x U
^
M
o
m
e
n
,
u m
P
er
u n i t
v
o
l
u
m
e
} .
(2.56)
where u is a constant of proportionality . We use the symbol for partia l differentiatio n rather than that for ordinar y differentiatio n as in (2.45), because the momentum flux across the plane wit h coordinate χ wil l vary wit h y. Let ρ denote the density of water, i.e., it s mass per unit volume. Then momentum per unit volume = {mass velocity} per unit volume = {mass per unit volume) velocity = pw(x,y). Hence, denoting m o m e n t um flux per unit area across the plane wit h coordinate χ by M(x,y), we have M{x,y)
(2.57)
= ~^w),
where (2.58)
μ = pv.
Similarly , the flux of m o m e n t um per unit area across the plane wit h co› ordinat e y is given by N(x,y)
(2.59)
= - ^ w ) .
Th e constant μ is known in fluid dynamics as the shear viscosity of th e fluid. Th e constant ν is known as the kinematic viscosity. It varies wit h temperatur e and (Exercise 2.13) has the dimensions of area per unit of time. At 20 C the kinemati c viscosity of water is about 1 0 ~ c m / s e c; see Batchelor (1967, p. 597). N ow suppose that L is the length of pip e over which the water pressure drop s fro m p to p . (I n practice, you would create such a pressure dro p by turnin g on a faucet, and without it there would be no flow.) Consider (Fig. 2.7) the cylinder of water, wit h rectangular cross section and length 2
2
x
Fig. 2.7 Elementary slice of flow with rectangular cross section.
2
2.6
Wh y Ar c Pipe * Circular ?
69
L, which occupies th e region Æ, < χ < a ,
(2.60)
b
2
{
2
shaded in Fig. 2.6. Pressure is just a force per unit area, which acts in all directions; but the only directions affecting the flow are perpendicular t o the faces ABCD and EFGH of the rectangular cylinder sketched i n Fig. 2.7. Hence the net pressure force on the fluid in thi s diagram is the force on EFGH in the direction of EA minu s the force on ABCD in the directio n of AE\ i.e.,
Γ Γ\Ρ2
~ Pudxdy.
(2.61)
Accordin g t o Newton, however (or again, if you prefer, borrowin g fro m physics), force equals rat e of change of momentum. Th e flow is in equi› librium , and so the water cannot speed up; so that th e rat e of change of m o m e n t um is simply the net rat e at which m o m e n t um flows out of Fig. 2.7 across the four rectangular faces that are parallel t o the direction of flow. Now, the flux of m o m e n t um across the face BCGF (in the direction of increasing x) is bi
(2.62)
M(a ,y)Ldy; 2
and the flux of m o m e n t um across the face DCGH increasing y) is
L
(i n the direction of
(2.63)
° N{x,b )Ldx. 2
2
Thu s the total flux of momentum out o / t h e rectangular cylinder is the sum of (2.62) and (2.63), i.e., ^ M{a ,y)dy 2
+ jT
N(x,b )dx\ 2
.
(2.64)
Th e total flux of m o m e n t um into the rectangular cylinder, on th e other hand, is the sum of the fluxes across EADH and EABF, i.e., L j
M{a ,y)dy x
+ £
iV(jc,*,)rfx| .
(2.65)
Th e net m o m e n t um flux out of the rectangular cylinder is th e difference
70
Chapte r 2
Equilibriu m
between (2.64) and (2.65), i.e., L 1 ^
(M(a ,y)2
M(a y))
-Att
ΛΓ(χ,Ζ>,)) < f r j
dy + j P (N(x,b )-
lt
2
dx
Ja, Jb,
dy
dydx
Equatin g (2.61) wit h (2.66) gives
But the rectangle i n Fig. 2.6 is completely arbitrary . I t could have been placed in any of the other quadrants or expanded or shrunk to any size. Provided that the integrand in (2.67) is continuous, which we shall assume, thi s can only be so if the integrand is identically zero. Hence
For suppose that (2.68) were false at (x , y ) because the left-hand side had, say, a strictl y positive value. Then, by continuity , it would remain posi› tiv e throughout some small region of the for m (2.60) surroundin g (xo,y ); so that it s integral over that region would also be positive, contradictin g (2.67). To cover the possibility that the left-hand side of (2.68) might be negative at (x ,y ), simply multipl y by - 1 . On using (2.57) and (2.59), and assuming that fluid density, p, is con› stant, we obtain 0
0
0
0
0
(d^w > \ j ?
+ +
dhv\ » ? )
m
^Pi-P L -
2 ( 2
·
6 9 )
Thi s equation, which i s usually known as Poisson’s equation, is our first ex› ample of a partial differential equation, or P DE for short. Further examples of P D Es wil l emerge in Chapters 9 and 11. You can verif y by direct substi› tutio n that a solution of (2.69) satisfying the boundary condition (2.55) is
Moreover, it can be shown that (2.70) is th e only solution of (2.69) that satisfies the boundary condition. Hence (2.70) describes th e flow of water throug h our elliptical p i p e . T h e expression for velocity, namely, w(x,y), represents the distance travelled per unit of time, perpendicular t o the cross section of the pipe, 6
6
See Supplementary Note 2.2.
2.7
Equilibriu m Shift s
71
by the particl e of fluid wit h coordinates (x,y). Hence the volume of water traversin g the cross section per unit of tim e is the integral, over th e section, of the distances travelled by all such particles. Denote thi s flux of water throug h the pipe by Q. Then (Exercise 2.14)
By setting a = b - r in (2.71), we deduce that th e flux of water through a circular pipe of radiu s r is given by
which is known in fluid dynamics as Poiseuille’s formula . From (2.53), a circular pip e wit h th e same cross-sectional area as the ellipse (2.54) must have radiu s Vab. Hence the flux reduction caused by deforming the circl e int o an ellipse wit h the same area is
_ ( Æ^ Thi s is always nonnegative and is clearly minimized by takin g a — b. But why should the circl e have thi s optimal property ? To understand this, observe fro m (2.70) that velocity is constant over any ellipse, say E, which is similar to the wall. Now, as discussed above, there are tw o entirely equivalent interpretation s of equilibriu m flow in a pipe. We can say either that the pressure drop is exactly balanced by an outward m o m e n t um flux or that the pressure drop is exactly balanced by a frictiona l (or viscous) drag. Thus, recalling our earlier discussion, the m o m e n t um flux across Ε represents the viscous drag of the water outside Ε on the water inside it . I n particular , the momentum flux int o the wall itself represents the drag of that wall on the entir e fluid . Thu s the circle, being the curve of m i n i m u m length for a given area, minimizes that outward flux at the wall an d hence the pipe’s resistance t o the flow. Th e higher the value of μ in (2.57)-(2.59), the greater the resistance; or, which is the same thing, the greater the amount of momentum that is transported toward the wall. Thu s the analogy between (2.45) and (2.57) is a perfect one, provided only that we interpre t μ not as th e viscosity, or stickiness, of the fluid but as a conductivit y of momentum. Expression (2.72) for the flux of water through a circular pip e can be obtained much more readily by exploiting the pipe’s symmetry. See Exercise 2.15.
2.7
Equilibriu m Shift s
Let’ s retur n to the lake we considered in Section 2.1 and suppose that the level of contaminant has already reached it s steady state. Thu s pollutio n
72
Chapte r 2
Equilibriu m
outflo w rx exactly balances pollutio n inflo w P , so that χ = PJr, as in (2.3). N ow suppose that the lake’s outflow is suddenly increased, at t = 0, t o r + Ar. Then, fro m (2.4), the pollutio n subsequently evolves according t o in
j
t
{ Vx(t)} = P
in
x(0) = ^ ;
- (r + Ar)x(t),
(2.74)
whence x(t) =
r+ Ar
+ (£a \ r
-
r+ Ar
J
e
-
{ r + A r ) , l v
.
(2.75)
'
v
I n the course of time, the exponential decay term wil l become so small that th e pollutio n level wil l have shifted fro m x* = P lr t o the new equilibrium , xn
(2-76) which is lower than x* . Thu s increasing r whil e P remains fixed shifts the equilibriu m pollutio n level downward. A similar analysis would show that increasing P whil e r remains fixed shifts th e equilibriu m level upward. I n other words x* , though a constant as far as it s dependence on tim e is concerned, is nevertheless a function of the tw o parameters r and P . We therefor e writ e in
i n
in
(2.77)
x*(P ,r)=?*. in
Partial differentiatio n reveals that 7 5 - = - > 0 dP r
and
-r - = dr
in
ψ < 0, r 1
(2.78)
i n agreement wit h our conclusions above. I f we were using the direct method then we would obtain (2.77) fro m th e right-hand side of (2.4) in the for m (2.79)
0 = P -rx-(P ,r). in
in
N ow suppose we were unable to solve (2.79) t o obtain (2.77) jus t suppose! Then we could differentiat e (2.79) instead t o obtain dx*
dx*
whence
as before. I n (2.75), (2.78), and (2.80), we have three different ways t o determine how shiftin g a parameter wil l shift an equilibriu m of dynamical system (2.4): 1. indirectly , fro m an expression for x{t);
2.7
Equilibriu m Shift s
2. directly , fro m an explicit expression for x";
73
(2.82)
3. directly , fro m an implicit expression for x* . Mor e generally, let Æ = (a a ,...,a ) be an w-dimensional vector of parameters, and consider the dynamical system T
i1
1
m
7
= f,(x,
a) = fi(Xi, x ,...,
x„, a a ,...,
2
u
2
a ), m
i = 1.2,..., n. (2.83)
= x * ( a ) be an equilibriu m of thi s system. Then the effect on thi s Let equilibriu m of a parameter shift fro m a, t o aj+Aoj can also be determined i n one of three ways: 1. indirectly , fro m an expression for x(/) 2. directly , fro m an explicit expression for x*
(2.84)
3. directly , fro m an implicit expression for x* . But the lake model that led t o (2.82) was a very simple one. We have already seen, in Sections 1.4 and 1.5, that an explicit expression \(t) = ζ(ί,α) for solutions t o (2.83) may simply not be available. Thi s is the rule, rather than the exception, and so ( I ) is rarel y of use. Th e equilibriu m = * ( Æ) must satisfyfj(x,a) = 0, / = 1, 2, n; or, i n vector form , f ( x * ( a ) , a ) = 0.
(2.85)
= x * ( a ) of these equations exist in principl e whenever Now, solutions th e conditions of the implici t function theorem are satisfied. But (2.85) may be impossible t o solve analytically. Then (2) is rendered useless, t o o, and only (3) remains. We shall dub thi s alternativ e th e equilibrium shift technique. Mathe› matically, it amounts t o no mor e than implici t differentiatio n of the equi› libriu m equations. Applyin g the chain rul e t o (2.85), we obtain 8
E l T T £ f dx daj J
k
i
+
T =' daj L
\
0
(2.86)
I t is just possible that these nm equations might be simple enough t o allow for some / and k. I f so, th e infor › determination of the sign of dx lda mation, though qualitative, might be very useful. Economists are frequent users of the equilibriu m shift technique because it is often helpful t o know, for example, whether a certain tax rat e should be increased or decreased t o raise, for example, the gross national product (it would be even more helpful , of course, t o know by how much). i
k
Thi s is the special case of (1.24) for which f is independent of t. The dynamical system is said to be autonomous. See Supplementary Note 2.3. 8
74
Chapte r 2
Equilibriu m
We pause t o emphasize that, when applied t o an equilibriu m of the dif › ferential dynamical system (2.83), the equilibriu m shift technique is mean› ingful only if the equilibriu m is stable. To appreciate this, let’s apply the shift technique t o the ecosystem model (2.87) first introduced in Section 1.5 and furthe r considered in Exercise 2.3 (ii) . Thi s system has th e equilibriu m (2.88) where Æ = (a ,b ,a ,b ) .
You can see directl y that
T
l
l
2
2
Thi s suggests that an increase in the parameter a wil l shift x* upward. N ow let’s see what really happens. Suppose that th e ecosystem described by (2.87) is in equilibrium . Recall th e remark in Section 1.5 that the phaseplane diagram Fig. 1.4 retains it s topology if the parameters are changed. Th e effect of an increase in a is merely t o shift the equilibriu m point x* t o th e right . Thi s shift in topology is sketched in Fig. 2.8. The old trajectorie s are dashed, the new ones solid, and the dot denotes the old equilibriu m x* . Notice that, in the new topology, the initia l point x* lies on a trajector y that veers off t o th e northwest as tim e increases. Thus, far fro m shiftin g χ upward, an increase in a wil l ultimatel y reduce it all th e way t o zero! Th e discrepancy between what (2.89) suggests and what actually happens is due t o th e equilibrium’ s instability . It illustrate s that caution is necessary i n applying the shift technique t o systems of the for m (2.83). 2
2
2
y A
.N
0
Fig. 2.8 Phase-plane topology shift for (1.22) when a is increased. 2
2.7
Equilibriu m Shift s
75
A s we saw in Section 1.6, however, not every dynamical system is a differentia l dynamical system. Indeed th e equilibriu m shift technique is probabl y most useful when applied t o nondifferential ones. Consider, for example, the economic growth model of Section 1.6, in which capital at tim e / is denoted by K(t), labor by L(t), and output by OXt). Th e economy is not in equilibrium , because K, L, and Q do not persist at fixed levels; rather , they increase wit h time. On th e other hand, according t o th e model, they increase in such a way that, at any given time, Q(t) = amrK(t) ~\
(2.90)
l
where a and 7 are constants. Thus, although K, L, and Q keep changing, the relationship (2.90) between and the quantit y aLyK ~ persists. Now, we associate persistence wit h equilibrium ; and it therefore seems that th e econ› omy of Section 1.6 has at least some of the qualities of equilibrium , even though it is not trul y in equilibriu m in the sense of thi s chapter. We wil l recognize thi s state of affair s by saying that the nondifferential dynamical system (2.90) represents a quasi-equilibrium between th e exogenous vari › ables, namely K(t) and L(t), and the endogenous variable, namely, QXt). A more general nondifferential dynamical system would consist of η relation s l
f (x (t),x (t),...,x (l),a (t),a (t),..., (t)) i
l
2
n
l
2
= 0,
am
y
i= 1 , . . . , «,
(2.91)
which we may regard as representing a quasi-equilibriu m between the η endogenous f u n c t i o n sx ( t ) , x (t),x„(t) and th e m exogenous functions «,(/), a (t),<* (t). We can use the chain rul e t o differentiat e (2.91) wit h respect t o Æ,( .) By analogy wit h (2.86), we obtain t
2
2
m
£r j dx (t) k
oajit)
d a / /)
I t is just possible that these nm equations might be simple enough t o allow for some 1 and k. We would then determination of the sign of dXj(t)/da (t) know the effect of a change in the exogenous function a (t) on th e endoge› nous function x,{t), assuming the quasi-equilibriu m (2.91) t o be maintained at all times. A s a simple example of thi s idea, observe that (2.90) yields k
k
W . t l - i m X ^ (2.93) dK(t) ~ ' \K(t), expressing th e fact that an increase in capital wil l always result in an in› crease in output (if the quasi-equilibriu m (2.90) persists throughout). Further application of the shift technique t o nondifferential dynami› cal systems is deferred unti l Chapter 10, i.e., unti l after we have had an opportunit y t o appreciate the usefulness of such models. Meanwhile, t o appreciate the limitation s of thi s technique when applied t o systems of the for m (2.83), tr y Exercise 2.16. v
76
2.8
Chapte r 2
Equilibriu m
Ho w Quickl y Mus t Driver s React to Preserv e an Equilibrium ?
Consider a platoon of cars, each of length L, drivin g in equilibriu m through a tunnel. All cars are moving at the same speed, v. The gap between cars is a constant, d. The cars will remain in equilibriu m only if they all con› tinu e to travel at exactly the same speed and hence remain a distance d apart. Now, suppose that the leading driver slows down for a moment, for whatever reason, before accelerating back to speed v. Thus she subjects the equilibriu m of the platoon to a small perturbation . Following this per› turbation , will the driver s regain their equilibrium ? In other words, is the equilibriu m stable? Intuitio n suggests that the driver s will regain equilib› riu m if they react sufficiently quickly to the first driver’ s braking, but if they react too slowly, then two or more of the cars will collide. But how quickly is quickly enough? In an attempt to answer that question, we will develop the model for a platoon of Ν cars that we introduced in Section 1.13. For the sake of definiteness, we will assume in thi s section that there are just ten cars in the platoon, but with obvious modifications, the analysis would apply just as well to any other number of cars. Let χ be the traffi c density in thi s equilibrium ; i.e., let χ = l/(d + L). Then, on using (2.28) and assuming the tunnel to be at least so congested that j c > x , we find that the speed of the platoon in the equilibriu m is 9
c
Hx Jx) m
ln(W*c>'
max
(2.94)
where v is the speed a car would have if the tunnel were empty. For rea› sons that will emerge in Section 3.5, and again for the sake of definiteness, we shall assume that the traffi c density in equilibriu m is ^ = 0.368x , (2.95) m i x
max
where e - exp(l). Then, on using (2.94), we find that the speed of the platoon is v= , / " w (2.96) ln(x /x ) Suppose that the cars have remained in equilibriu m throughout the interval t < 0 and that the first car of the platoon crosses station ζ = 0 at tim e / = 0. If thi s equilibriu m persists then, for t > 0, the displacement of the jt h car in the platoon is given by mix
c
C,(0=vf-O-l)( + L)
You may wish to review Section 2.3 before proceeding.
2.8
How Quickl y Mus t Driver s React to Preserv e an Equilibrium ?
=
10.
1 , 2 ,.
j=
v f
77
(2.97)
of the jth car. Thi s We wil l refer t o < (/) as the equilibrium displacement does not, of course, mean that the displacement is constant (it increases linearl y wit h time); rather , the speed d^ldt = of the car is constant, and
;
dzjjt + τ ) _ dt
=
In |z;(r) - zj-i (t)\ + Qj,
2 < j < 10.
(2.98)
Her e i s the driver response tim e (assumed the same for all drivers) and qj a constant. We wil l assume that for all j the constant a, takes the value implie d by the analysis of Section 2.3, namely, (verify ) a = v l n ( x ) . Then (Exercise 2.17), because Zj_i(t) > Zj(t), the subsequent displacements of cars 2 t o 10 satisfy m a x
dzjU + r )
= v l n j ^ ^ . , ^ ) - z/r))} , 2<j< 10. (2.99) dt N ow suppose that at t = 0 the first driver brakes for exactly one sec› ond, reducing her car’s speed t o v(l - ˜ ) before accelerating back to the equilibriu m speed v. Then a reasonable description of the car’s velocity for t > 0 would be (Fig. 2.9) =
^
(1-˜/,’-’) ,
(2.100)
+ ˜ { ( / + 1 ) < ˆ ’ - 1}]
(2.101)
=
whence (verify ) [
2,(/)=
v(l
- ˜ )
0
-1
I
1
L.
_ι
ι
5
Fig. 2.9 Speed history of first car in a platoon.
ι
ι
10
ι
ι
ι
ί-
15
78
Chapte r 2
Equilibriu m
Fro m (2.97), wit h j = I, thi s displacement differ s fro m th e equilibriu m displacement Cj( 0 by an amount 2,(0 - C/(0 = ˜ {(t + l)e~' - 1} e, when t > 0. Let us define th e perturbation displacement of th e leading car at tim e t, 0,(0, by 0,(0 = ,( ) - ,( ) . Then . ^ ( ’ M C + O e - ’ - i U
if’>0;
I 0
(
1
1
0
2
)
i f t < 0.
N o te that 0,(0 < 0 when t > 0 because as a result of braking , th e leading drive r is nearer t o ζ = 0 at tim e t than she would have been otherwise. Car s 2 t o 10 wil l react t o thi s perturbatio n by also braking . Let th e perturbatio n displacement of the ,/th car be denoted by 0 (O = ζ β) - £,·(/), 2 < j < 10. Then, on using (2.97) we have y
^ ) = (
˘
U
^ -
+
£
^ ˆ •
i f
’^
;
(2.103)
if / < 0.
On substituting z {t) = < (0 + 4>j(t) int o (2.99), we obtain (Exercise 2.17) }
7
d
j(t+r) —. = vln dt Replacing t by / + r , we thu s obtain (verify ) VH
J>L
d
=
vl n [l +
*ψ
{^_,(
-
τ) - φ# - τ)}} .
(2.104)
(2.105)
I n thi s equation, <$>j is identically zero whenever it s argument is negative. Thu s 0y(r - r ) = 0 whenever τ > t. Th e equilibriu m described by (2.97) is stable if, followin g th e perturba › tio n depicted i n Fig. 2.9, th e cars all regain speed withou t colliding. Now, tw o cars wil l collid e i f th e relativ e displacement of their fron t bumpers fall s below a car length, L ; i.e., if Zj_ ,(0 - z /0 < L, at any tim e i( > 0) and for any j such that 2 < j < 10. Fro m th e definitio n of 0y, th e condition zj_, (0 - Zj(t) < Lis equivalent t o 0,
^(0-^-i(0>rf .
(2.106)
For th e sake of definiteness, let’s choose a particula r value for d. Now, as we wil l discuss in Section 3.3, an appropriat e traffi c density for N ew York’ s tunnels is about 65 cars per mile, and an appropriat e equilibriu m traffi c speed is about 20 miles per hour. Workin g i n feet and seconds, therefore, it seems reasonable t o take = 20 5280 -f- 3600 = 8 8 /3 and x = mJe = 65/5280 = 13/1056. Then d + L = 1056/13. Thus, i f we choose d = 65, then th e length of a car is a littl e mor e than sixteen feet, which does not seem unreasonable. Let’ s adopt these values (i f you don’t x
2.8
Ho w Quickl y Mus t Driver s React to Preserv e an Equilibrium ?
79
lik e them, then you can easily work through the analysis again using dif › ferent ones). Then the collision criterio n (2.106) becomes - < £ ; _ , ( / ) + 0 , ( i ) > 65,
(2.107)
and on using our chosen values in (2.102)-(2.105), we find (verify ) 0 / 0 = 0,
if t<
* , ( / ) = ª ˜ { ( / + 1) < Γ < - \}e, 8 8,
άφ,
τ/ = τ
1η
0,1 <j
< 10;
if/>0;
l + To^i ^-iC- -)-^-^)}] ’ i f > 0 , 2 < ; < 1
10. (2.108)
These differential-delay equations are not especially easy t o solve. We wil l therefore approximate them by recurrence relations. Now, the quantit y d4>jldt is approximately equal t o φ Xf + c) - φ At) ' ΣΔ '
(2.109)
ψ κ
i f f is s m a l l . It wil l be convenient t o suppose that c = l/M, where Μ is a large enough integer, and measure tim e in unit s of one Mth of a second. Thu s unit s of new tim e correspond to t = nIM seconds. Let / ) denote th e perturbatio n displacement of driver j after unit s of new time; i.e., + 1 ) - / ) } , and for large / ) φ \ηΙΜ). Then (2.109) becomes ` / { / enough Μ we can approximate the last equation of (2.108) by (verify ) 10
}
Μ { /
+ 1) -
/ ) }
= y
In [l + -Ij-
{
, · _ , ( Η - σ) -
/
-
)}1
,
(2.110) where σ is the reaction tim e measured in new units; i.e., in old units, the reaction tim e is τ = σ/Μ seconds. How large should Μ be? Clearly, the larger the value of Μ we choose, th e smaller the error in approximatin g άφ^Ιάΐ by (2.109). On the other hand, you must perfor m 60Af recursions of (2.110) for each minut e of tim e durin g which you would lik e to know what happens to the platoon; and these recursions wil l be time-consuming if Μ is very large. I experimented wit h different values of Μ and decided that Μ = 8 gave an acceptable trade-off between accuracy and computing cost. Hence we use Μ - 8 in th e remainder of thi s section. (You may wish t o experiment wit h larger values, but you wil l find that they do not qualitativel y alter our conclusions fro m the analysis.) Wit h thi s value, and on replacing η by - 1 i n (2.110),
10
S ee Supplementary Note 2.4.
60
Chapte r 2
Equilibriu m
(2.108) is approximated (verify ) by ,( ) = 0 if η < 0, 1 < < 10; Ø ( ) = ª ˜ { ( / Ø + 8) < Γ
/ 8
-8}
if η > 0;
/Μ) = ;( - 1) + y ln[ l + ^{φ (η Μ
- - 1) - ,( - Æ- 1)}] if η >
0,2 < j < 10.
(2.111) These recurrence relations are easily solved by calculator or computer. Th e results are shown in Fig. 2.10 for ˜ = 0.15 and r = 1.5 seconds ( = 12). I n thi s particula r case, the leading driver reduces speed fro m 20 m.p.h. to 17 m.p.h. and then accelerates back t o 20 m.p.h. again, ac-
Ø
I
l
Fig. 2.10 Perturbation displacements of a platoon often cars in which driver s take 1.5 seconds to respond when the first car slows temporaril y to 17 m.p.h., according to Fig. 2.9, from the equilibriu m speed of 20 m.p.h. The horizontal scale is 1 inch to 14.3 seconds, the vertical scale 1 inch to 186 feet.
2.8
Ho w Quickl y Mus t Driver s React to Preserv e an Equilibrium ?
81
> ι
Fig. 2.11 Perturbation displacements of a platoon of ten cars in which driver s take 2.25 seconds to respond when the first car slows temporaril y to 17 m.p.h., according to Fig. 2.9, from the equilibriu m speed of 20 m.p.h. The horizontal scale is 1 inch to 14.3 seconds, the vertical scale 1 inch to 186 feet.
cordin g t o Fig. 2.9. Th e corresponding perturbatio n (2.102) is the upper› most graph in Fig. 2.10. The remaining graphs are (approximations to) the perturbatio n displacements {<j>j(t):t> 0 ,2 <j < 10} of the followin g cars, plotted 0.35 inches apart, which corresponds t o a real distance of 65 feet. Notice that equilibriu m is restored withi n three-quarters of a minute, wit h all cars once again moving at 20 m.p.h., but (takin g the limi t of (2.102) as t —* oo) in such a way that all cars are a fixed distance vAe « 12 feet be› hin d where they would have been if the first driver had not braked. Notice also that each of the followin g cars takes longer t o adjust t o the new equi› libriu m than the car in fron t of it . It s phase of adjustment is represented by an oscillation of decreasing amplitud e about the new equilibrium , but th e amplitud e of thi s oscillation increases wit h j as the initia l perturbatio n
82
Chapte r 2
Equilibriu m
4 Unstable
3
2
•d * = \W
D
Stable
0
1.0
0.5
Fig. 2.12 Tentative stability boundary r = r (A ) in the ˜ - ˆ plane. c
propagates backward through the platoon of cars. (From the point of view of pure mathematics, of course, the equilibriu m is never restored. Rather, the cars will move toward the equilibriu m forevermore, but will ultimately be an imperceptible distance away from it.) For the same perturbatio n but the slower response tim e of r = 2.25 seconds ( = 18), the graphs of φ ft) are plotted in Fig. 2.11. Notice that (2.107) is violated after 347 unit s of tim e (43.4 seconds), when the nint h car collides wit h the car in front of it . Thus, in the ˜ - r plane, (0.15,1.5) is a stable point for a platoon often cars; whereas (0.15,2.25) is unstable. The same analysis can be repeated for any other value of r that is a multipl e of an eighth of a second and for any other value of ˜ (between 0 and 1). Thus we discover, for example, that (0.4,1.625) is a stable point, but that (0.4,1.75) is unstable, because the ninth car collides with the car in front of it after 24.25 seconds. A selection of such points is plotted in Fig. 2.12. A square denotes stability and a dot instability , wit h the label j/n recording that the ;’th car collided wit h the one in front after η unit s of tim e (n/8 seconds). By continuing in thi s fashion, we see that there is a boundary curve r = T ( A ) in the ˜- r plane, below which the platoon is stable and above which it is unstable. On the unstable side of thi s boundary, for given ˜ , a higher value of τ (slower response time) means a sooner collision between lower numbered cars; and, for given r , a higher value of ˜ (larger perturbation ) means the very same thing. The boundary drawn (dashed) in Fig. 2.12 is a tentative one. To locate it precisely, you would have to solve C
Exercise s
83
(2.108) numerically and use a significant amount of computer time. You would find, however, a similar pictur e t o the one in Fig. 2.12. Th e analysis in thi s section is easily reproduced for a platoon that con› tain s an arbitrar y number of cars. Simply replace 10, wherever it appears, by N. Increasing Ν (higher number of cars in the platoon) wil l shift the T (A) curve downward and t o the left; whereas decreasing ˝ wil l shift it upwar d and t o the righ t (as indicated by the labels jln in Fig. 2.12). But do you consider that Figs. 2 . 1 0 - 2 . 12 yield a reasonable picture? Perhaps you would lik e t o mull thi s over, and then tr y Exercise 2.18. C
Exercise s 2.1 Verif y (2.20). 2.2 Verif y that ζ, as well as η, satisfies the differential equation (2.16). 2.3 By findin g the roots of (2.19), classify the static equilibri a encountered in (i) Section 1.4, (ii ) Section 1.5, (Hi) Exercise 1.5. *2.4 What would be the form of v(x) in Section 2.3 if, in Section 1.13, we had assumed that brakin g driven do not respond to the size of a gap but only to the rate at which it’ s closing? *2.5 Suppose that we stand at a fixed point zo on a road and count the number of vehicles that pass that point in e units of time, say durin g the interval t - e/2 < t < t + e/2, then divide our answer by e. We call the quantity thus estimated the flux of traffi c (at station zo, at time f ) and denote it by F(zo, to). By repeating this experiment throughout the day, we obtain a function of time, F(zo,/), that records variations in the flux of traffi c at that particular point on the road. The interval length e must be neither so long that important variations in flux are not recorded (recall Fig. 1.6) nor so short that F(zo, t) would cease to be a smooth function of time (in the extreme case, it would take the values 0 or 1 in an apparently random sequence!). For a busy road, an hour is too long, a second too short, a minute about right ; for a quiet road, we would not obtain a smooth function. Once traffi c flux F and traffi c density χ have been defined, we may define = Fix to be the velocity of traffi c at station z at tim e t. Thus, in general: 0
0
0
Number of cars passing per unit of time F(z,t)
Number of cars per unit length of road x(z,t)
Length of road covered per unit of time v[z,t).
84
Chapte r 2
Equilibriu m
But it is sometimes reasonable to assume that F is some function fix) of the traffi c density, so that F{z, t) = J{x{z, t)). Then, in equilibrium , we have Number of cars Length of road Number of cars passing = per unit length χ covered per unit per unit of time of road of time = χ χ v{x), Ax) where is the velocity of traffic . The graph of / as a function of χ is known as the fundamental diagram of traffi c flow. It s shape will be similar to that in Fig. E2.1. In particular , J[0) = 0 = flx ) a n d / h as a global maximum at χ = x*. We say traffi c is light if χ < x^ and heavy if χ > χ*, and J{x*) is the capacity of the road. Find the capacity of the road when v(x) is given (i) by the model of Exercise 2.4; (ii ) by the model of Section 2.3. mta
2.6 Verif y (2.38). 2.7 If r lies to the right of the cusp in Fig. 2.3 then the arguments of the absolute -ry(r))(2r-ry{f)value function in (2.40) are negative. For such r, ˜ ( Γ ) = (1 1). Hence ˜ ( Γ ) = 1 is equivalent \oflr ) = 0, where f(j) = ry\f) • (y(r) 2) + 2(r - 1). Find r by using the Newton-Raphson iterativ e technique to solve f[r) = 0. Hint: You will need a computer. First differentiat e g{w) = 2 - w implicitl y wit h respect to r and arrange to obtain 2
2
2
y'(r) =
Ar)W.r)-2)-(l-y(r)) 2-2ry{r)
+ ry{r)
2
Thi s will enable you to express f{r) in terms of r, y{r), and )/{r). Estimate . For r from the graph. Thi s will be your first value in the iterativ e sequence each subsequent value, you will need a separate subroutine to supply the value of y(r). The Newton-Raphson technique will be required withi n this subroutine as well. 2
Slop e
# max n
Slop e
max
Fig. E2.1
υ{χ)
Exercise s
85
2.8 By solving (2.36) numerically, show that there is a period-4 limi t cycle { v , v , v , v } when r = 2.56. To four significant figures, the values of {v } are, in sequence, 0.2101, 1.587, 0.3531, and 1.850. Show similarl y that the steady state when r = 2.67 is the 8-period limi t cycle {1.924, 0.1631, 1.524, 0.3763, 1.990, 0.1417, 1.401, 0.4798} and that the steady state when r = 2.69 is the period-16 limi t cycle {2.000, 0.1357, 1.388, 0.4890, 1.933, 0.1570, 1.516, 0.3781, 2.014, 0.1315, 1.360, 0.5160, 1.897, 0.1699, 1.585, 0.3288}. (
2
3
4
k
2.9 For r = 2.56, the period-2 equilibriu m cycle {y{r),z(r)} = {0.26357,1.7364 } is unstable, because r > r . By solving (2.36) numerically with either y ot ζ as initia l value, show that the equilibriu m cycle diverges toward the period-4 limi t cycle in Exercise 2.8. (To keep the population in period-2 equilibrium , the exact value of or would be needed. Even if y(= 0.263573742169 ) or z(= 1.73642625783 ) were correct to 12 significant figures, the rounding error would be sufficient to shift the period-2 cycle toward the period-4 one, though the divergence would be extremely slow.) 2
*2.10 The wall of a buildin g is in thermal equilibriu m if it transfers heat at a constant rate Oust as a rowing boat is in mechanical equilibriu m if it moves at a constant speed). Let ˆ , be the temperature of air inside a buildin g and T the temperature of the outside air. Assume that T < T (it’ s winter). Let F denote the outward heat flux per unit area, i.e., the amount of heat energy per unit of tim e that flows across unit area of the wall. Let d be the thickness of the wall. (i) Which kind of wall will lose heat at the greater rate, a thick one or a thin one? Accordingly, how do you think F varies with di (ii ) When will the rate of heat loss be greater, when ˆ 2 << ˆ , (much colder outside than inside) or when T is just a littl e lower than 7\ ? Accordingly, how do you think F varies with T - T 1 (iii ) Can you suggest an expression for F, in terms of T T , d, and some arbitrar y constant, which embodies (i) and (ii)? Make the simplest hypothesis consistent with your observations. 2
2
{
2
t
2
lt
2
* 2.11 Instead of installing double-glazing, some folks create a "stor m window" by using a sheet of transparent plastic to trap a layer of stagnant air between the air in a room and the pane of glass in the existing window. Adapt the model of Section 2.5 to calculate the heat loss prevented by this contraption. Show, in particular , that it is always less than the loss prevented by double-glazing. (You do not need to know the thermal conductivity of the plastic. Why?) *2.12 The outward heat flux across area A of wall in Section 2.5 is AF{x) only because we have assumed that heat flux and temperature do not vary withi n any χ = constant plane. If heat flux and temperature also varied with respect to y and z, however, where x, y, and are orthogonal Cartesian coordinates,
86
Chapte r 2
Equilibriu m
then the outward heat flux across area A would be
/
F(x,y,z)dA
=
A
F{x,y,z)dydz
= - / k
A
dT{x,y,z, dx
dydz,
A
on using (2.45). Similarly , the outward heat flux across area ¸ of a sphere of radius χ would be
where χ,θ, and φ are spherical polar coordinates. Use this result to solve the followin g problem. A spherically symmetric planet is in equilibriu m wit h radius a. It consists of a radioactive core 0 < χ < c surrounded by a solid mantle c < χ < a, where χ is the distance from the center of the planet. The core generates a steady heat flux Ant^F, which is conducted through the mantle to the surface of the planet. If the thermal conductivity of the mantle is k , and if the mantle heat flux per unit area is given by (2.45), show that the temperature drop across the mantle is M
cjl - cla)F
2.13 Using the methods of Section 1.14, verify that kinematic viscosity has di› mensions [f J = L /T. 2
2.14 Establish (2.71). Hint: Use the transformation to elliptical cylinder coordi› nates, χ = ra cos(0),
y = fcrsin(0),
to change the region of integration from that given in (2.71) to 0 < θ < 2 , 0 < τ < 1. *2.15 Water is flowing in equilibriu m with circular symmetry through a cylindrical pipe with radius a. The pressure drops from p to p along length L of the pipe. Consider a cylinder of water with radius τ and length L, whose axis of symmetry coincides with that of the pipe. (i) What is the (outward) flux of momentum per unit area across this cylinder? 00 What is therefore the momentum flux? (iii ) What is the net pressure force on this cylinder of water? (iv) Obtain a differential equation for the velocity w(r) and solve it , subject to an appropriat e boundary condition. (v) Hence obtain Poiseuille’s formul a (2.72). 2
t
Exercise *
87
*2.16 (i) In the model of Exercise 1.17, if χ is measured in tonnes and time in years, what are the dimensions of the constant a? (ii ) If the fish are harvested, as in Exercise 1.14, at rate qux, where Μ is a constant, show that there are two equilibri a (other than χ = 0) provided u < aK/4q. Use a graphical method. (iii ) What happens if u > aKIAql We will ignore the possibility that u = aKIAq, precisely, on the grounds that the parameters are subject to so much uncertainty. In deterministic models of natural phenomena, only strict in› equalities between parameters are realistic. (iv) Assume that u < aKIAq. Let x denote the lower equilibriu m and x the upper one. Use the graph from (ii ) to show that 0 < x < KI2 < χ < Κ. Using the equilibriu m shift technique, show that x decreases with u and q but increases with a. Verif y your result graphically. (v) Why may the shift technique not be applied to the equilibriu m x 7 Show that it would lead to absurd results. L
v
L
υ
v
L
2.17 (i) Verif y (2.98) and (2.99). (ii ) Verif y (2.104). *2.18 (i) According to (1.81), following driver s in Fig. 2.11 will stop brakin g and start to accelerate 2.25 seconds after they have observed the preceding car begin to move away. Study the graphs in Fig. 2.11 and convince yourself that this is so. What changes geometrically when a driver stops brakin g and starts to accelerate? (ii ) The restoration of equilibriu m in Fig. 2.10 is exceptionally smooth. I would have anticipated larger ripples. What do you think ? Is there anything about (1.81) that produces a stabilizing effect that would not be observed in practice? If so, how could (1.81) be improved? Hint: Consider how driver s accelerate as the gap between them and the preceding car increases. ’2.19 (You will need a computer for this one.) In 1959, according to Section 3.3, cars were sent through New York’ s Lincoln tunnel in platoons of 22. Assume that they drove at 20 m.p.h., in equilibrium . Would such a platoon remain in equilibriu m if the driver response time were 1.75 seconds and the leading driver slowed temporaril y to 16 m.p.h. according to Fig. 2.9? Now that you have writte n a computer program to solve (2.111), you can reproduce Figs. 2.10-2.12 for yourself, as well as experiment with other values of d and other forms of φ\(ί). *2.20 Suppose that the species of fish in Exercise 2.16 is being "overfished," i.e., that u > aKIAq. Show that, although x tends to zero as t oo, χ never actually reaches zero. Thus, according to the productivit y law F W = o x
2
( l - i ) ,
the population would be certain to recover from any threat of extinction if the harvest were ever stopped. In practice, however, we might expect that the
88
Chapte r 2
Equilibriu m
fish would not recover from an extremely low population level, even if that level were greater than zero (for otherwise, why would species ever become extinct?). In other words, our model does not allow for the real possibility of extinction. Can you suggest an improved form of F(x) that would correct this deficiency without destroying any of the other properties which, according to Exercise 1.17, it is desirable for F to have?
Supplementar y Note s 2.1 A more general system of differential equations than (2.12) would have the form ^jj-=fi(X\>*2
*„)>
!<'<«·
An extension of the analysis performed above would lead to the linear system of differential equations dr\ldt = Grj , where η is an -dimensional vector of relativ e displacements and the matri x G is defined by
The matri x G is called the Jacobian matri x of the system, and the static equi› libriu m x* is stable if and only if all the eigenvalues of G have negative real parts. The special case of this result obtained in the text is sufficiently general for the purposes of thi s book. 2.2 For suppose that there are two solutions, say w and w , and let u = w, - w . Denote the ellipse (2.54) by θA and the region it bounds by A. Then both w, + and w satisfy (2.69) and (2.55), and so we have u = 0 on 8 A and d u/dx d uldy = 0. Put m = uduldx and n = uduldy. Then, on using Green’s theorem {
2
2
2
2
2
2
2
A
OA
(which has essentially been proved in reaching (2.66)), we have
-/"(κ*-ΐΗΘΑ
α
Therefore duldx = 0 = duldy, implyin g that u is a constant. Because u = 0 on dA, the value of the constant must be zero. Hence w = w ; i.e., the solution is unique. v
2.3 Principally , the Jacobian matri x G, defined by _
dfi,^
....
2
Supplementar y Note s
89
must be nonsingular. By even mentioning G, of course, we presume that f is at least once differentiabl e with respect to x. 2.4 In view of (1.55) and (2.44), you may be wondering why dfyjldt is approximated by (2.109), and not by ^{ ,.( +1)- /«-1)}
.
(a)
The answer is that using (a) instead of (2.109) would mean approximating a first order ordinar y differential equation by a second order recurrence relation, instead of by a first order one, and would lead to numerical instability; i.e., it would lead to spurious oscillations that predict collisions even for very low values of ˜ and r , which are bound to be stable. To appreciate this phenomenon of numerical instability , consider the sim› ple first order ordinar y differential equation dx Έ =
. ( b )
where a (> 0) is a constant. If we approximate the left-hand side of (b) by x(n + 1) - x(n), then the result is
*(«+1)-(1-Æ) ( … = 0.
(c)
Thi s first order recurrence relation has solution *<«) = (0 ) • (1 -a) .
(d)
n
If we approximate the left-hand side of (b) by {x(n + 1) - x(n - l)}/2, then the result is x(n+ I) + 2ax(n) - x(n - 1) = 0.
(e)
Thi s second order recurrence has solution m
=
(x(l)-;tx(0))A’’+(Ax(0)-x(l)V º μ
)
( f )
where º = -a + Va + 1, 2
μ = -α-
Vd + 1. z
(g)
Now the solution of (b) for integer values of time, t = n, is x(0) = x(P)e-'"'=x(0)(e-) , n
(h)
so that (d) correctly predicts the qualitativ e behavior of the solution, namely, that it is decaying exponentially; though it overestimates the decay, because 1 -a < e~". Because \μ\ > 1, however, (f) introduces an oscillation of increasing amplitud e that is completely spurious. For a = 0.5, values predicted by (h), (d), and (0 are recorded in the following table.
90
Chapte r 2
Equilibriu m
η 0 Ø 2 3 4 5 6 7 8 9 10 11 12
(¸ )
id)
(/)
1.0000 0.6065 0.3679 0.2231 0.1353 0.0821 0.0498 0.0302 0.0183 0.0111 0.0067 0.0041 0.0025
1.0000 0.5000 0.2500 0.1250 0.0625 0.0319 0.0156 0.0078 0.0039 0.0020 0.0010 0.0005 0.0002
1.000 0.607 0.393 0.213 0.180 0.033 0.148 -0.115 0.263 -0.378 0.641 - 1 . 02 1.66
You can readily see how the spurious oscillation generated by (0 completely overshadows the exponential decay of the tru e solution after only a handful of tim e steps. Of course, for such a large value of Æas used for illustration , even (d) is not a good approximation to (h); but even when a is close to zero, the spurious oscillation introduced by (0 will ultimately swamp the tru e solution. Numerical analysis is an important part of applied mathematics, and if you’ve never yet studied it , then you might lik e to do so now. An especially good introductor y text is the one by Froberg (1969), and much can be learned by perusing the articl e in Encyclopaedia Britannica.
3
OPTIMAL CONTROL AND UTILITY
Man y of the policies we adopt in our lives are attempts t o optimize, that is, t o maximize gain or to minimiz e loss. Th e policy we select depends, of course, on what we are tryin g t o achieve. Suppose, for example, that I’ m travellin g by car fro m Florid a t o Texas. I may wish t o minimiz e fuel con› sumption. Then I wil l attempt t o drive, as far as is possible, at a constant speed that is probably somewhat lower than the speed limit . Th e dashed curv e in Fig. 3.1(a) indicates how I might decide to control my speed. Or I may wish t o reach my destination as quickl y as possible without break› in g the speed limit . Then I wil l select the solid curve of Fig. 3.1(a). On th e other hand, I may wish t o get there as fast as I can, but subject t o th e constraint that the police don’t give me a ticket; and I am invariabl y constrained by the maximum speed of my car. I n these circumstances, I might decide t o control my speed according t o the curve in Fig. 3.1(b). Finally , I may wish t o maximize the pleasure I get fro m the trip , sub› ject t o the constraint of an overnight stop in a hotel on the Texas bor› der. Then I might decide t o control my speed according t o the curve in Fig. 3.1(c). Suppose it takes me Τ days t o driv e t o Texas. Τ is not fixed, but depends on how I drive, as shown in Fig. 3.1. Let u(t) be my speed at tim e t. Let / be the quantit y I wish t o maximize. We wil l refer t o J as my utility. I f I am tryin g t o minimiz e loss, then J = - { L o s s }. Thus, for the first of my four alternatives, / = - { f u e l consumption}; for the second and third , J = - { j o u r n e y time} = -T, although there are different constraints in each case; and for the fourt h alternative, / = pleasure. I n general, / wil l depend upon u. Therefore, fro m all allow› able choices of speed u(t) throughout the interval 0 < t < Τ, I wil l wish to select the one that makes J(u) a maximum. M y problem is 91
92
Chapte r 3
Optima l Contro l and Utilit y
u •
(c)
Fig. 3.1 Possible histories for the control function, speed, on a journey from Florid a to Texas: (a) minimiz e fuel consumption (broken line) or minimiz e travel time, subject to speed limi t (solid line); (b) minimiz e travel time, subject to no tickets (I travel at 55 m.p.h. only when I expect to meet police); (c) maximize pleasure, subject to overnight stay. The speed limi t is assumed to be 55 m.p.h. throughout (which it actually was when I first drew this diagram for my students). thu s To find
u(t) for 0 < t < T,
Which maximizes
/ ( «)
Subject to
any constraints.
(3-1)
Call u the control function. Then (3.1) is the simplest possible statement of an optimal control problem wit h a single control function. Optima l control problems are abundantly found in biology, economics, engineering, management science, and indeed almost every aspect of hu› man endeavor. I f there is more than one control function, then « becomes a vector (which we would writ e in bold typeface as u); but otherwise the problem is still (3.1). Even when u is a scalar, however, optimal control problems are usually very difficul t t o solve unless , by using intuition , we
3.1
How Fast Shoul d a Bir d Fly Whe n Migrating ?
93
can argue that the set of potentially optimal controls, i.e., the set of feasible controls, is a very simple one. (The most obvious simplificatio n is to assume that u is constant throughout 0 < t < T.) Then we might even be able t o find the solution graphically, as wit h the solid curve of Fig. 3.1(a); but it’ s much more likel y that we’ll have to use calculus. Th e solid graph in Fig. 3.1(a) is indeed the solution to a highly idealized control problem, for which we assume the road t o be straight and have zero congestion. It’ s an example of a boundary solution; when optimal, w is always on the constraint boundary (maximum acceleration, maximum speed, maximum deceleration). The dashed curve in Fig. 3.1(a), on the other hand, provides an example of an interior solution; when optimal, u is less than maximum speed. A n alternativ e convention that distinguishes th e tw o solutions is to say that the maximum speed constraint is active in th e first case but inactive in the second. Whenever it is appropriat e t o talk about either, we wil l always adopt the second of these tw o conventions. N ow let’s discuss some more serious examples.
3.1
How Fast Shoul d a Bir d Fly When Migrating ?
A bir d migrates t o be as far away as possible fro m the unpleasant cold weather of it s climate of origin. ’ It starts it s journey wit h a finite source of energy, it s body fat, and generally does not feed en rout e (unlik e me, if I driv e t o Texas). Since thi s energy is limited , and since every hour in the air uses some of it (even if the bir d is just hovering), the bir d must not travel too slowly; if it does, the distance travelled wil l not be considerable. On th e other hand, the power required t o resist the drag of the air increases so rapidl y wit h speed that the bir d must not travel too quickl y either; if it does, it s energy supply wil l again be depleted too near to it s journey’ s origin . Then how fast should the bir d fly? In thi s section, we wil l attempt t o answer that question by using a mathematical model. Let u(t) be the speed of the bird . Then the distance travelled is (3.2) where Τ is the flight time. Under benign weather, our bird’ s flight history is likel y t o look lik e the dashed curve in Fig. 3.2. I f we allow the speed t o be as variabl e as this, however, then we wil l not be able t o solve our problem wit h the calculus alone. Therefore, let’s make an approximation; let’ s assume that u is constant, corresponding t o the solid lin e in Fig. 3.2. Our model is thus, in the previous chapter’s terminology, an equilibriu m model. We ignore the dynamics of ascent and descent in the belief that they affect only a negligible part of the flight. Wit h thi s assumption, the You might lik e to review Section 1.12 before proceeding.
94
Chapte r 3 Optima l Contro l and Utilit y
u
•*—• I
0
τ
Fig. 3.2 Flight speed of a migratin g bird .
distance travelled (3.2) may be approximated by (3.3)
/(«) = u • T(u).
Th e bird’ s objective is t o maximize (3.3). Th e flight tim e Τ depends upon u for the reasons given in the opening paragraph. Let Ε be the bird’ s initia l energy, stored as fat. We wil l assume that all of Ε is used durin g migratio n and none is necessary at the end t o survive. Then the bird’ s power output, assumed constant for th e entir e journey, is E/T, of which only a fraction , say η, can be converted int o mechanical en› ergy for the flight. (I n th e terminology of Section 1.12, ηΕΙΤ is the bird’ s effective power.) Thi s mechanical energy must do work of tw o kinds: work against gravit y (to keep the bir d up) and work against drag (to keep the bir d moving along). I t seems reasonable t o assume that the rat e of workin g against gravity o r induced power, I, in the jargon of aerodynamics doe s not depend upon the flight speed, u. Moreover, we may borro w fro m aero› dynamics the fact that drag, D, is proportiona l t o th e square of the speed and t o the surface area that faces the wind , S. Thi s is the same drag law as for th e oarsmen of Section 1.12, which is not surprisin g when you con› sider that air and water are both fluids. Hence D - bSu , where b is a constant, and 2
ηΕΙΤ = Rate of working against drag + Induced power Du
+
I
bSu*
+
I.
(3.4)
Fro m (3.3) and (3.4) we deduce that
I t is easy t o show (see Exercise 3.1) that J(u) attains a maximum on th e interva l 0 < u < o o a t M = M * , where (3.6)
3.2
How Bi g a Pay Increas e Shoul d a Professo r Receive ?
95
and
N ow / , though independent of u, is known fro m aerodynamics t o be pro› portiona l t o the weight of the bir d (a bir d that’ s twice as heavy, for example, has t o work twice as hard against gravity) . We therefore writ e (3.8)
/ = mgv„
where m is the bird’ s mass, g is the constant acceleration due to gravity , and v , the constant of proportionality , is known in aerodynamics as the induced velocity. (You should check that v, does indeed have the dimensions of velocity, by the method of Section 1.14.) Then, fro m (3.6)-(3.8), we obtain (
and
I n obtaining the optimal speed (3.9), we have overlooked a potential constraint. There is a certain speed, let’s call it M , above which the bir d is incapable of flyin g (however wantonly it squanders fuel). Therefore, instead of seeking the maximum of / ( «) on the interval 0 < u < , we should really have sought it s maximum on the interval 0 < w < u . But the constraint u < w wil l not affect our answer (3.9) if u* < u , which we have tacitl y assumed. In other words, we have tacitl y assumed that the constraint u < « is inactive. If a constraint is inactive, then w e obtain the same result by ignorin g it completely. Clearly, if u* > u , then / ( Œ) would be an increasing function on the interval 0 < u < « and would take it s maximum at « . In principle , therefore, it is more correct to say that the optimal flight speed is the minimu m of u* and « , but we shall continue to assume that the constraint u < M is inactive, because the "sprinting " speed of any creature always greatly exceeds its "lon g distance" speed. How good is thi s model doe s (3.10) tell us how far a bir d flies when migrating ? Perhaps you would lik e t o thin k about that; we’ll raise the topic again in Chapter 4. M A X
m a x
max
miX
m a x
max
max
m a x
m a x
M A X
3.2
How Bi g a Pay Increas e Shoul d a Professo r Receive ?
Lawmakers in a certain state have just granted a pay increase to faculty at the state university. They have done thi s merely by increasing the budget for professors’ salaries, and it is up to the university to decide how these additional funds are to be distribute d among faculty. In principle , all the money could be used to raise the salaries of a few outstanding professors.
96
Chapte r 3
Optima l Contro l and Utilit y
But thi s would hur t the morale of, and hardl y be fair to, all those less than outstanding professors w ho still do an excellent job . On the other hand, an "across-the-board" increase (the same percentage for everyone) would hur t the morale of lower paid faculty who have distinguished themselves as outstanding teachers and scholars. A compromise is needed, according t o which everyone gets some increase, and more deserving faculty get more. But w ho is more deserving, and how much more of an increase should they receive? I n thi s section, we wil l indicate an approach t o solving such a problem by using a mathematical model. To simplif y matters, we wil l begin by assuming that the university administratio n has already partiall y solved the problem by allottin g cer› tai n amounts of the total salary budget increase to each department. These amounts would not, of course, be equal in general. It is perhaps most likel y that they would be proportiona l t o the number of faculty in each depart› ment (although the university administratio n may have found a way t o in› crease it s allotment to one or tw o outstanding departments). Let’ s suppose that , as a consequence , the Mathematics Department now has a budget of Β dollar s for salary increases. We wil l also assume that the extra Β dollar s i s available every year fro m now on, so that the increases wil l be perma› nent. H ow should the Mathematics Department’s chairperson distribut e thi s money among the faculty? Th e method we use t o answer thi s question i s also applicable, wit h rather more work , t o the university as a whole (so we have not cheated by concentrating our attention on a single department). Every year the research, service, and teaching of faculty in the Math › ematics Department are subject t o peer evaluation. They are classified as outstanding, strong, satisfactory, weak, or inadequate. Service might in› clude not only administrativ e and pastoral duties withi n the university but also community service (e.g., judgin g at a high school science fair) . Th e chairperson has decided t o distribut e the Mathematics Department’s salary increase on the basis of thi s evaluation. Thi s year, no one has been judged as weak or inadequate. Thu s research, service, and teaching are placed in one of three categories for each professor, implyin g that faculty are placed in one of 3 3 3 = 27 overall categories. Using ˇ t o denote outstanding, G t o denote strong, and S t o denote satisfactory, the results of thi s year’s peer evaluation are shown in Table 3.1. Notice that only 14 of the 27 possible categories are represented (for example, no one is clas› sified as OGS, i.e., outstanding in research, strong in service, satisfactory i n teaching). Notice also, fro m the final column of the table, that the De› partment of Mathematics has 30 faculty. Let us agree t o describe research, service, and teaching as factors in th e evaluation process. Now, it is generally felt withi n the department that someone whose factor evaluation is strong has achieved approximately twic e as much as someone whose factor evaluation is satisfactory. More › over, it is generally felt that someone whose factor evaluation is outstanding
Ho w Bi g a Pay Increas e Shoul d a Profeeao r Receive ?
3.2
97
Table 3.1 This year’s peer evaluation of faculty in the Depart› ment of Mathematics. Category 2 3 4 5 6 7 8 9 10 11 12 13 14
Research
Service
Teaching
ˇ ˇ
G S S ˇ G G
ˇ
G G G G G S S S s s s
Nui
^ ?I^ 2
G G ˇ G G S ˇ G ˇ G G S
s s
G G S S
Ult y
a
10 3
3 3
has achieved twice as much as someone whose factor evaluation is strong. I t therefore seems reasonable t o say that S corresponds t o one unit of factor achievement, G t o tw o unit s of factor achievement, and ˇ t o four unit s of factor achievement. But faculty in another department or at another universit y might not agree! Therefore, wit h a view to making our model as general as possible, we wil l label the classifications O, G, and S as / = 1, 2 and 3, respectively; and we wil l label the factors research, service, and teaching, respectively, as j - 1 ,2 and 3. Let m denote the number of unit s of factor j achievement corresponding t o the classification /. Then th e perceptions of the faculty on thi s matter can be stored in a 3 3 merit matri x M , in which m,y occupies row i and column j . For the particula r department we are considering, Vj
M =
"4 2 1
4 4 2 2 1 1
(3.11)
Th e columns of are identical in our illustration . But they do not have t o be. If , for example, ˇ for teaching were felt to represent five times the achievement of S for teaching, then w i would be 5, not 4. At thi s juncture , you might lik e to attempt Exercise 3.2. Th e chairperson has decided t o solve the allocation problem by paying each faculty member an additional v, dollar s for every unit of factor achievement. The problem therefore reduces t o determining appropriat e numbers v,, v , and v . We wil l refer t o v,, v , and v as controls. Let i(k,j) denote the factor j label associated wit h a faculty member in category k, l 3
2
3
2
3
98
Chapte r 3
Optima l Contro l and Utilit y
1 < k < 14. These labels are contained in a 1 4 x 3 matri x equivalent t o th e middl e three columns of Table 3.1. For example, /(5,2) = 2, because a professor in category 5 is rated as strong in service, and /(11,3) = 1, because a professor in category 11 is rated outstanding in teaching. Then a faculty member in category k wil l receive a salary increase of m ^ • v, dollar s for hi s research, m • v dollar s for his service, and w , • v dollar s for his teaching. For example, on using (3.11), a professor in category 3 wil l receive 4v, dollar s for research, v dollar s for service, and 2 v dollar s for teaching. Th e total salary increase of a professor in category k wil l therefore be i(k
i(k
2 ) 2
2
(A 3 ) 3
2
3
3
3
s
k
=
Y2
m
i{kjy
(3.12)
• jv
For example, the total salary increase of the professor in category 9 wil l be v, + 4v + 4v dollars. Let n denote the number of faculty in category k. Then the total faculty salary increase for that particula r category wil l be n s . Summing over values of k between 1 and 14, we find the total faculty salary increase. Thi s must equal B, by definition . Hence 2
k
3
k
k
14
(3.13)
Y,n s = B. k
k
k=i
For (3.11) and Table 3.1, you can easily verif y (Exercise 3.3) that the budget constraint (3.13) reduces t o 58v, + 55v -h 6 8 v = B. 2
(3.14)
3
N o matter how our chairperson selects the controls v,, v , and v , he must at least ensure that (3.14) is satisfied! Th e budget constraint could be satisfied in a variety of ways. Th e chairperson could, for example, set v, = v = v = 5 / 1 8 1. But paying equal amounts for equal achievements in each of the factors may not be i n the department’s best interests. Suppose, for example, that the chairper› son is concerned about th e department’s research activity . H e may have observed that, whereas only tw o of the faculty are merely satisfactory in teaching, a thir d of the faculty is merely satisfactory in research. A s an incentive to faculty to concentrate more on research, the chairperson may wish t o increase the bonus for a unit of research achievement. Th e extreme case would be to set , = 5 / 58 and v = v = 0. Thi s would mean that teaching and service achievements went wholly unrewarded, however, and would not be in the department’s best interests either; a successful aca› demic department requires a balance between the three factors. H ow can th e chairperson attain such a balance? 2
2
2
3
3
3
One way would be to insist that the payment for a unit of achievement i n one factor can never be more than, say, twice or three times the payment for a unit of achievement in another. We’r e not sure whether to say twice
3.2
How Bi g a Pay Increas e Shoul d a Professo r Receive ?
99
or three times or even some other ratio ; therefore let’s simply insist that th e control for one factor can never be more than º times that for another, where the choice of º is at the chairperson’s discretion. I n other words, we constrain v,, v , and v so that 2
3
}v,
jv
2
t
^v
lt
3
(3.15)
2
where º > 1. For the sake of morale withi n the department, it is probably also a good idea to set an absolute minimu m on the amount of increase that a professor can receive, provided that his work is at least satisfactory in each of the factors. Suppose we agree that such a professor should obtain at least a fractio n e of the total faculty increase. Here c is some small number, to be agreed upon by the faculty, and it is clear at the outset that e cannot possibly exceed 1/30 (why?). A further constraint is therefore v, + v + v > c f l . 2
(3.16)
3
Let’ s assume that (3.14) (3.16 ) are the only constraints that the chairper› son, in consultation wit h the faculty, finds necessary. I t is convenient at thi s point to make the controls dimensionless. Be› cause Vj and Β have the dimensions of value, we define: ", = | ,
1 < 7 < 3.
(3.17)
Then Uj is dimensionless and the constraints (3.14) (3.16 ) take the dimen› sionless for m -
A «
+
M
"l -AM,
-
AM
3
2
«2 -AM,
-"I
< < < < < < <
2
-
AM
-
U
2
2
-
AM
+
«3
+
"3
-
"3
3
58M, + 5 5 u2 + 6 8M
3
0 0 0 0
(3.18)
0 0 1.
I t wil l shortly emerge why th e seventh of these eight constraints has been writte n as above, rather than in the more natural for m M, + u + w > t. W e wil l say that the control vector u = ( Μ , , 2 , Μ ) is feasible if w,, M , and M are nonnegative numbers satisfying (3.18). Clearly, the need t o satisfy (3.18) gives the chairperson considerably less freedom than would exist if (3.14) were the only constraint. On the other hand, there may still be infinitel y many choices of feasible controls! Suppose, for example, that A = 2 and e = 0.01. Then you may verif y that two feasible choices are u = (1/181,1/181,1/181)" and u = ( 1 / 2 3 6 , 1 / 1 1 8 , 1 / 2 3 6 ") , and it can be 2
ª
3
2
3
7
7
3
100
Chapte r 3
Optima l Contro l and Utilit y
shown that there are infinitel y many others. Whic h of all these feasible control s wil l th e chairperson select? Let’ s suppose, as earlier, that the chairperson is concerned about th e department’s research activit y and would lik e t o provid e an incentive t o improv e it . Then a rational strategy for h i m t o pursue would be to award th e m a x i m um feasible amount t o a uni t of research achievement. I n other words, fro m all feasible controls, he would choose the one for which w, is largest. H e is therefore faced wit h the followin g control problem: Find
u = (w,,« ,u ) ,
Which maximizes
J(u) = u. ’ u feasible.
r
2
Subject to
3
(3.19)
Thi s control problem is a special case of th e followin g one: Find
u=
Which maximizes
J(u) =
Subject to
]T
(u ,u ,...,u„) , T
l
2
η
cu k
k
η ik k
a
u
< i<
i=l,...,g
h
(3.20)
k=l η
^a
i
k
u
k
= bi,
i-q+\,...,r
k=\
l,...,/j.
tij>0,
You can verif y that (3.19) is the special case of (3.20) for which η = 3, q = 7, r = 8, a,, = a = a = a = a = a = 1.0, a = a = a = 4 3 = 5i - 62 = > = b = by - b = b = b = 0, b-, = -c, b = 1.0, c, = 1.0, and c = c = 0. T h e control problem (3.20) is known as a linear program. To solve it we must find a set of η nonnegative controls, {u u ,u ,...,« }, which maximizes some linear combination of controls subject t o r additional constraints, of which q are linear inequality constraints and r - q are linear equality constraints (additional because requirin g u t o be nonnega› tiv e is already a constraint). A linear program of th e for m (3.20) i s com› pletely specified once we have specified entries for an rx η matri x A , an r-dimensional vector b, and an ^-dimensional vector c. Efficient computer program s for solving linear programs are found at almost every computer installatio n and are extremely simple t o use. On the other hand, the theory behind these programs would take at least a chapter t o expound and would have nothing t o do wit h modelling per se. Therefore, we do not discuss it . Th e interested reader is referred t o one of the many excellent textbooks on 3 2
2i
a
a
42
6 3
52
l2
3 (
2J
- A
a
2
2
4
5
6
t
3
lt
2
3
}
3.2
Ho w Bi g a Pay Increas e Shoul d a Professo r Receive ?
101
optimization , for example, Jeter (1986). Fro m the point of view of mod› elling, it is importan t only t o know that a feasible solution of (3.20) may not exist and may not be unique; but if it does exist, then a computer package wil l quickl y find it for you (it wil l also tell you if there is no feasible solu› tion) . Moreover, the set of optimal controls is usually unique in practical problems; and, should there be more than one solution, the decisionmaker would use some other criterio n t o distinguish between them. I f there were mor e than one solution to (3.19), for example, then the chairperson of the Mathematics Department would adopt the most popular one. Let’ s now retur n t o (3.19). M y students and I used the IMS L routin e ZX3L P t o solve thi s problem. Th e routin e is extremely simple t o use and full y documented in the IMS L manuals. But other routines exist, even for small personal computers, and they are usually fast, reliable, and easy t o use at least for moderate values of r and n. (Thi s state of affair s should not be used as an excuse for ignorin g the theory of linear programmin g completely. It simply makes it out of place in a modelling course.) To specify A and b for the computer, it is necessary t o supply values for º and t. Suppose, for example, we take º = 2 and e = 0.01. Thu s one factor payment for a unit of achievement may not exceed twice another, and every professor wil l receive a pay increase that is at least 1% of the total available funds. You can easily verif y that the optimal controls for (3.19) are then given by u* = ( 0 . 0 0 8 3 6 8 2 , 0 . 0 0 4 1 8 4 1 , 0 . 0 0 4 1 8 4. 1 )
(3.21)
Thi s result is quoted wit h far more accuracy than is useful in practice, but that wil l enable you t o check your own results. I f º = 2 and c = 0.017, on th e other hand, then the optimal controls are given by u* = ( 0 . 0 0 6 8 4 2 1 , 0 . 0 0 6 7 3 6 8 , 0 . 0 0 3 4 2 1. 1 )
(3.22)
On using (3.12), we can now deduce the salary increase that a professor in category k would receive according t o (3.21) and (3.22). Th e results are presented in Table 3.2. Notice that solutions (3.21) and (3.22) are fundamentally different . When e = 0.01, only the first and second of the inequality constraints in (3.18) are active. I f we had known in advance that constraints / = 3 t o / = 7 would be inactive, then we could have overlooked them (but of course we di d not know, which is why we included them). I n particular , the minimu m salary increase constraint (3.16) is inactive. I n thi s case, th e value for ι set by the chairperson is so low that the lowest salary increase would exceed it anyway. It means that the greatest possible incentive can be given t o research by making w, exactly twice u or u . When = 0.017, on the other hand, the value for e set by th e chair› person is sufficiently high that the minimu m salary constraint (3.16) has become active. At the same time, the first constraint has become inactive; 2
}
102
Chapte r 3
Optima l Contro l and Utilit y
Table 3.2 Salary increase in dollars awarded to faculty member in category k, 1 < k < 14, for each $1000 of total salary increase awarded to the Department of Mathematics, for º = 2 and for two values of c. Category
£
1 2 3 4 5 6 7
= 0.01
t = 0.017
Category
e = 0.01
t = 0.017
54.53 47.79 40.95 47.47 40.84 34.00 27.26
8 9 10 11 12 13 14
25.10 41.84 33.47 33.47 25.10 20.92 16.74
23.84 47.47 40.63 34.00 27.16 20.42 17.00
58.58 54.39 46.03 41.84 41.84 33.47 29.29
so that, although u, is still twic e u , u is now almost as great as u,. Thi s i s surely not what the chairperson intended by tryin g t o maximize the re› war d for a unit of research achievement, because one can far e almost as well by concentrating on service. It shows that the choice of c is critica l i n determining the distributio n of salary increases, and it might even be argued that the constraint (3.16) should be eliminated fro m the problem. Althoug h we shall not do so here, one can show more generally that for any given º ( > 1) there are tw o critica l values o f f , namely, ( ( \ ) and c (X), defined by 3
2
L
v
C
l
W
˛
f
58XTT23’
" ~ TmrW" (º )
( 1 2 3)
such that there is no feasible solution t o (3.19) if c > e (A) ; however, if e < then the optimal control for (3.19) is y
-
=
58AiTS
( A
’ ’ l
I ) r
’
( 3
•
2 4 )
constraint (3.16) being inactive. I f c (X) < e < (A) , on th e other hand, then constraint (3.16) is active and the optimal control for (3.19) is L
u* =
3
A
|
y
( { 1 - 55f} º , {58º + 68}« - A - 1,1 - 5 5 e ) . r
1
3
(3.25)
N o t e that u\ = Xu* in both cases. For º = 2, as in Table 3.2, we have e (2) = 0.0167364 and €^2) = 0.0170068 (so that the maximum value the chairperson can choose for c is then considerably lower than 1/30). H o w good is thi s model woul d a university department use it ? N o› tic e that, hitherto , we have always made th e question "Ho w good is thi s model?" equivalent t o "Does it fit the facts?" Wh y do we now abandon thi s equivalence? Perhaps you would lik e t o mull thi s importan t matter over, we’ll retur n t o it in Chapter 4. Meanwhile, tr y Exercise 3.5. 3
L
3.3
3.3
Ho w Many Worker * Shoul d Industr y Employ ?
103
How Many Worker s Shoul d Industr y Employ ?
Suppose that the manufacturin g sector of a certain economy seeks t o max› imiz e it s profits. H ow many worker s should it employ? I n thi s section, we wil l attempt t o provid e at least a rough answer t o thi s question. Let u(t) denote th e number of worker s employed at tim e t; thi s wil l be our control function. For th e sake of simplicity , we wil l assume that all are full-tim e worker s (though the effect of part-tim e labor could be in› cluded by counting, say, tw o half-tim e worker s as a single unit of labor). Let w(t) be the average wage per worker per year at tim e t (more precisely, as in Section 1.6, th e instantaneous average annual wage). Then industry’ s (instantaneous) annual wage bil l at tim e t is w(t) • u(t). Let Y(t) denote the monetary value of industry’ s output at tim e / (again, as in Section 1.6, measured as an instantaneous annual quantity) . Let φ) denote annual costs independent of th e size of the labor force. Then, if we assume that all goods produced are also sold, industry’ s an› nual profit s at tim e t are ( ) = Y(t) - c(t) - w(t) • u(t). On using (1.43), we deduce that ( ) = P{t) • QXt) - c(t) - w(t) • u(t), where Q denotes real output and Ρ the pric e index. Let’ s now assume that real output can be modelled adequately by using a Cobb-Douglas production function. Then, fro m (1.32), we obtain ( / ) = au(t)~< K(t) ~~<, where Κ denotes capital stock and 7(0 < 7 < I ) and a are constants. Industr y wishes t o maximize profits , and so it s utilit y is simply . Hence it wil l wish t o control u(t) so as t o maximize 2
l
J(u(t)) = P(t)au(tyK(t) -i l
- φ) -
w(t)u(t).
(3.26)
Differentiatin g wit h respect t o «(/), we easily find that (3.27) and, because 7 < 1, that d J/d(u(l)) 0 < u(f) < 00 at u(t) = «*(/), where 2
2
< 0. Hence J has a maximum on
(3.28) Our model predicts that (3.28) is the optimal amount of labor for industr y t o employ. How good is thi s model doe s (3.28) agree wit h th e amount of labor actually employed? D o es it tell us anything about the usefulness of th e Cobb-Douglas model of economic growth? Essentially thi s question wil l surface again in Chapter 4, as Exercise 4.18. Meanwhile, i n derivin g (3.28), we have overlooked a possible constraint. What is it ? See Exercise 3.6. 2
You might lik e to review Section 1.6 before proceeding.
104
Chapte r 3
Optima l Contro l and Utilit y
3.4
Whe n Shoul d a Fores t B e Cut ?
A forest is an investment. Th e trees that grow there are felled for their wood, and the wood has a market value. But if the trees are harvested too soon, then th e pric e they fetch may not even cover the costs of fellin g them. On the other hand, if the forester waits too long before harvesting, then the doddery old trees may not be growing fast enough t o justif y their occupation of th e soil. Somewhere in between these extremes lies an opti› mal harvesting time. What is it ? I n thi s section, we wil l attempt t o answer that question by using a mathematical model. Th e key t o solving thi s problem is to understand that every investment i s also an act of abstention. Th e money a forester spends on plantin g trees could instead have been deposited in a bank, where it s value at tim e t would have grown at the instantaneous annual rate of interest, u{t), defined t o be the specific growth rat e of the value of money. Thus, if M{t) is the value of money deposited in a bank at tim e t, we have ..
1 dM
,, .
For the sake of simplicity , we wil l assume in thi s section that u is a constant. Then M{t) = M ( 0 y " .
(3.30)
Th e annual rat e ν when interest is compounded instantaneously must be distinguished fro m the annual rat e ν when interest is compounded only once a year. I n the former case, the value of money after one year is A/(0)e" . I n the latter case, the value of money after one year is ¸/(0 ) • (1 + ν). Hence ν = ln( 1 + v). To distinguish verbally between the tw o rates, we might call i/ the yearly rat e and ν th e annual one. Moreover, t o preserve a distinction that wil l shortly emerge, we wil l refer to ν as the nominal annual interest rate. By plantin g trees, the forester hopes that proceeds v\t) fro m the even› tual sale of the wood, i.e., revenue minu s cuttin g costs minu s plantin g costs, wil l exceed whatever the balance of his bank account would have been if he had placed hi s money there instead. It seems reasonable t o call v\t) the value of the forest and t o expect that the forester would be happy if ˚ were made large. D o es it , therefore, correspond t o his utilit y in (3.1)? To understand that the answer is no, consider a purely imaginary event. Suppose that the yearly rat e of interest is 8%, i.e., ν = 0.08; and that I have purchased a beaten-up old bicycle for $100, secure in the knowledge that I can clean it , polish it , and sell it at the end of the year for $112. Ignorin g riskiness, inflation , and so on (because th e event is imaginary), am I righ t t o tell myself that the tru e wort h $ W of my bicycle, at th e tim e of purchase, i s $112? N o, clearly not; for if I had $112, then I could put it in a bank where, after one year, it would become $112 • (1 + 0.08) = $120.96, which
3.4
Whe n Shoul d a Fores t Be Cut ?
105
i s more than I can eventually get for th e bicycle. Thu s th e tru e wort h of my bicycle is less than $112. On th e other hand, the tru e wort h of my bicycle is more than th e $ 1 00 I paid for it , because that amount of money would grow t o only $ 1 08 if I placed it in a bank. Thu s 100 < W < 112. A few moments thought should now reveal that th e tru e wort h of my bicycle is the amount of money that would grow t o $ 1 12 if deposited in a bank, instead of being used t o buy th e bicycle. Hence W ( l + 0.08) = 112; whence W = 112/1.08 = 103.70. I n other words, the bicycle’s tru e wort h today is equal t o it s value one year fro m now divided by the multiplicativ e factor by which money would grow in a bank in that time. For exactly th e same reason, th e tru e wort h of th e forest today is e~"V{\). By an obvious extension of th e same argument, it s tru e wort h is also equal t o e~ \\2), e~ V[3), ˆ • ˚ 4 . 7 6 ) , and so on. Thus, in gen› eral, th e tru e wort h of a forest wit h value V\t) at tim e t, when assessed in the light of alternative investment possibilities, is the quantit y lv
4
iv
76
(3.31)
e""m
which we shall call the present value of th e trees in the forest. Thi s is th e utilit y that the forester’s harvesting policy wil l seek t o maximize. Let there be Ν trees in th e forest and let u(t), the control function, be th e rat e at which trees are cut at tim e t. To simplif y th e control problem, let’ s assume that th e entir e forest is felled in a single operation, which takes place durin g the interval s - e/2 < t < s + e/2. I f th e rat e of fellin g withi n thi s interval is constant (and therefore equal t o N/e), then th e graph of u wil l appear as th e dashed curve in Fig. 3.3(a). I f e is very small (weeks, say) compared t o the tim e for which a forest grows (several decades), then a useful mathematical approximation is t o assume that th e trees are all felled at the same instant, i.e., t o take the limi t of Fig. 3.3(a) as e — 0 (Fig. 3.3(b)).
Ν/ε
(a)
Fig. 3.3 Clearcutting control for a forest.
(b)
106
Chapte r 3
Optima l Contro l and Utilit y
Then u is an impulse control, which can be represented crudely as
3
=
;
w(i) = 0,
ifi^i .
v
(3 32) ’
The utilit y J(u) has thus been reduced to a function of s, say / . The optimal control problem is therefore to Find
j
Which maximizes
(3.33)
j\t) = e- V{t). ut
I t remains to determine the form of V. Assume that the forester always was, and always will be, a forester. Whenever he cuts the forest he replants it again, so that cutting and plant› ing costs occur together at the end of each cycle; or rotation, to use the accepted forestry terminology. Let these (combined) costs be denoted by &, and, at tim e t, let ξ(ή be the volume of wood in a tree and p\t) its selling pric e per unit volume. Assume, moreover, that all Ν trees in the forest are identical. Then f{t) =
Wt)t(t)-e-
(3.34)
Prices and costs (which are simply prices of other commodities) will rise over tim e at the going rate of inflation , r, defined in Section 1.6 by
where P(t) is the price index. Let’s assume that the rate of inflatio n is constant. Then, if c and ρ denote cost and selling price at the start of the current rotation, we have Pit) = pP(0 = P^ c(t) = cP(t) = ce", {
}
on recalling that P(0) = 1. Exploitin g the analogy between (1.43) and (3.36), we say that p is the nominal selling price and ρ the real selling price; and similarl y for 6 and c. Substituting from (3.34) and (3.36) int o (3.33), we obtain At) = r " {NpfUt)
- ce") = e~ V[t\ 6,
(3.37)
where we have defined the real (annual) interest rate b= v-r 3
See Supplementary Note 3.1.
(3.38)
3.4
Whe n Shoul d a Fores t Be Cut ?
107
t o be the difference between the nominal interest rat e and the rat e of in› flation; and where (3.39)
V\t) = Npat)-c=e- 'r\t) r
is the deflated value of the forest at tim e t, i.e., it s value after a correction has been made for the illusor y growth that is merely due to inflatio n of prices (see Section 1.6). Exploitin g th e analogy between (1.43) and (3.39), we refer to F as the nominal value of the forest and F as it s real value. Thus, although the words "true " and "real " are virtuall y synonymous i n everyday speech, they have specialized meanings for us in an economic context. A n economic asset has real value V\t) at tim e / i f we have cor› rected for the illusor y growth in value, prio r t o tim e t, that is merely due t o inflatio n of prices; or, which is exactly the same thing, if we have di› vided it s nominal value by the pric e index />(/) = e" (or, which of course is the same, multiplie d by e~ ). A n economic asset has true wort h f(t) today if we have corrected it s value at tim e t fro m now for the il › lusion that it could not be sold today and the proceeds deposited in a bank; or, which is exactly the same thing, if we have multiplie d it s value at tim e t by either e~ or e~ , according t o whether that value is either nominal or real. You should compare (3.31) wit h (3.37) to verif y that the forest’s tru e wort h can indeed be obtained either (i) by always using nom› inal prices and interest rates or (ii ) by always using real prices and interest rates. Th e second alternativ e is the norm in economic modelling and, in th e absence of a statement to the contrary , we shall assume henceforward that (ii ) prevails. Moreover, we wil l usually refer to fit) henceforward as present value, rather than tru e worth , as an insurance against confusing th e specialized meanings of real and true. We wil l call e~ the discount factor. N ow a tree is a plant, and a model of plant growth was studied in Section 1.3. Although that model was really intended for annual species of plants, and not for trees, it s basic assumption tha t growth is proportiona l t o the remaining amount of a limite d quantit y of nutrient doe s not seem unreasonable for trees as well. Thu s the model of Section 1.3 suggests that th e graph of £(/) wil l be 5-shaped, and we wil l cautiously assume this. Multiplyin g by the constant Ν ρ wil l not alter the 5-shape, and subtracting th e constant c merely displaces the graph downward. We therefore expect that the graph of V\t) = Np£(t)-c wil l appear as shown in Fig. 3.4. Thu s the forest has no commercial value for ι < t , and it s value can never exceed V^, where the graph has a horizontal asymptote. I t is now (Exercise 3.7) a matter of simple calculus to show that./(/), as defined by (3.37), has a maximum at t = s, where rt
ut
6t
u
0
(3.40)
108
Chapte r 3
Optima l Contro l and Utilit y
Fig. 3.4 Expected shape of graph of forest’s real value.
provided (3.41)
"^<8>.
V
m
I f ξ(ή does have the logistic for m (1.16), then
^=TT^fe-’ ’
3
•
4 2 )
where the constant b is defined by (1 + b) • ξ(0) = i . Thu s = Npfy-c, and kfytQ = Inibc/V^). N o te that f is sure t o be a positive number, because f > 0 is equivalent t o our assumption V\Q) < 0. I t is then easy t o deduce fro m (3.42) and (3.40) that V{s) is the sole positive root of the quadrati c equation f
0
0
Np6V=
k(V+
c)(K
TO
- V)
(3.43)
(see Fig. 3.5); whence, fro m (3.42), the optimal rotatio n tim e is i=
i, fW±£i\ n
(3 44)
Referrin g t o Fig. 3.4, therefore, we find the optimal rotatio n tim e by mov› in g along the dashed curve in the direction of the arrows. H o w good is thi s m o d e l d o e s (3.44) determine when a forest should be cut? Perhaps you would lik e to mull thi s question over; we’ll retur n t o i t i n Chapter 4. Meanwhile, tr y Exercise 3.9.
3.5
How Dense Should Traffic Be In a Tunnel?
109
phibV.k(V+c){V,
*· V
Fig. 3.5 Graphical determination of V{s) when Kis given by (3.42).
3.5
How Dense Should Traffic Be In a Tunnel?
Tunnels are notorious bottlenecks where motorists converge from several directions to compete for the means to cross a river.4 To reduce these trame delays, the traffic flux, i.e., number of vehicles using the tunnel per hour, should be maximized. This means solving an optimal control problem for which the utility is traffic flux. We have already seen in Chapter 2 that traffic flux depends upon traffic density, i.e., number of cars per mile. Accordingly, let the control function, «(/), be the traffic density at time /. To make matters simple, however, we'll assume that u is independent of t. The traffic flow is then in equilibrium, and we'll assume that its velocity is given by (2.28). Thus, from Exercise 2.5, the traffic flux is
-{ where we have denned /(
^max>
Vuln(xmJu),
if 0 < u < JCC; if xc < u < xn
(3.45)
(3.46) ln(xmax/xc) and xc is the critical traffic density below which cars may travel at the speed limit, vma!t. We also saw in Exercise 2.5 that the maximum of (3.45) occurs at " = W « = °-37*max >f XmJe > xc and at u = xc if x,mJe < xc. Which of these two inequalities is likely to hold? Let dmia denote the distance between cars at maximum density and dc the distance between cars at the critical density, xc. Then V=
"•max Xr
4
_
dc + L dmin + L'
You may wish to review Section 2.3 before proceeding.
(3.47)
110
Chapte r 3
Optima l Contro l and Utilit y
where L is the length of a car. Cars move if they are more than a fractio n of a carlength apart. Let thi s fractio n be e (to be determined). Then d
min
(3.48)
=
where 0 < t < I . On th e other hand, many state laws declare that for each 10 m.p.h. of speed you should be at least a carlength behind the car i n fron t of you. Let’ s suppose that thi s applies t o the speed limit . Then d > v L / 1 0 . Hence, on using (3.47) and (3.48), the maximum o f / ( «) depends upon whether c
m a x
iB-Li>i= e + 1
2.718.
(3.49)
Because e < 1, (3.49) is sure t o be satisfied if v is 45 m.p.h. or greater. I n practice, v > 45 is very likel y (even if the official speed limi t is lower); and is probably quit e close t o zero, making (3.49) valid even for much lower values of v than 45. Let us therefore assume that x /e > x. Then the optimal density is u = u* , where m a x
m a x
m a x
max
«* = ^ a ;
e
c
(3.50)
whil e the maximum traffi c flux, or tunnel capacity, is J{u*)=Vu\
(3.51)
Thu s V, as defined by (3.46), is the optimal speed of traffi c through the tunnel. H o w would thi s optimal solution be implemented? I n practice, one would control the optimal "throughput " of traffi c itself, by placing a stop light at the start of the tunnel that limite d influ x t o Vu*/60 cars per minute. Accordin g to data presented by Prigogine and Herman (1971, p. 9), the optimal density for N ew York’ s tunnels appears t o be about 65 cars per mile, and the optimal speed is about 20 m.p.h. (though it varies slightly fro m tunnel to tunnel, the newer ones being more efficient.) Thu s according t o (3.51), the capacity of a N ew Yor k tunnel is about 1300 cars per hour. Thi s optimal traffi c flux can be achieved by using a stop light t o allow only about 22 cars (per lane) per minut e t o enter th e tunnel. Gazis (1972, p. 422) report s that, startin g in 1959, thi s very strategy was used t o increase th e throughpu t of the Lincol n tunnel. According t o Gazis, the strategy worked very well for part of the time, but it was difficul t t o reset the (optimal) equilibriu m after perturbation s due t o any sudden increase in congestion. What does thi s mean? I s thi s a good model because it sometimes mim › ics realit y well, or a bad model because it sometimes fail s t o mimi c realit y at all? You should mull thi s question over. We’ll retur n t o it in Chapter 4.
3.6
3.6
How Muc h Pesticid e Shoul d a Cro p Growe r Use an d When ?
111
How Muc h Pesticid e Shoul d a Cro p Growe r Use an d When ?
Crops are afflicted by insects, and the damage they cause is an economic loss for the grower. Using pesticides helps to reduce thi s loss, but it is also expensive. Let C denote the cost of damage and C, the cost of spraying. I f a grower uses a lot of pesticide, then Q will be low but C will be high. I f the grower uses littl e pesticide, then C, will be low but Q will be high. Then how much pesticide should a grower use if he wishes to minimiz e his total loss, L - C + C 1 There is also the question of when to apply the pesticide. Too early an application will mean that not enough insects are yet available for slaughter; too late an application will mean that most of the damage has already been done. In both these ways, the grower of a crop is faced with an optimal control problem. In thi s section, we will tr y to help him solve it. Let the concentration of pesticide when a crop is sprayed at tim e t, denoted by u(t), be the control function. A grower requires a given amount of (diluted) mixtur e to spray a given area of cropland; therefore the con› centration is proportional to the amount of pesticide used. As usual, to make the problem tractable, we will assume that the optimal control is of a particular kind. We’ll assume that the grower sprays his crop only once per season, at tim e s, using pesticide with concentration U; and that any effect on the insects is immediate. We can represent this control mathe› matically by writin g d
$
s
d
(3.52) where the growing season extends from tim e t = 0 to tim e t = T. In practice, of course, the pesticide may take some tim e to work; but as long as this tim e is sufficiently short when compared to the length of the growing season, then it s effect may be regarded as immediate. According to Plant (1984, p. 5), one application of pesticide is frequently all that is needed in the San Joaquin Valley cotton fields, so that (3.52) is not unreasonable. Then the control {u(t): 0 < t < T} is completely determined once s and U have been determined; i.e., we may writ e the loss (negative utility ) as L(uU))=As,U),
(3.53)
where / i s a function of two variables (see (3.63) below). You should com› pare (3.52) with the form of control assumed in Section 3.4. Here, the optimal policy depends both on the timin g of an action (spraying) and its intensity (concentration of pesticide); there, we took the intensity of the action (rate of felling) to be infinite , so that the policy then depended only on the timing .
112
Chapte r 3
Optima l Contro l an d Utilit y
We will assume that the crop is afflicted by a single pest, that the native population of these insects grows at the constant specific rate R, and that it s growth is boosted by immigratio n at constant rate q per unit of time. Hence if x(f) denotes the magnitude of the insect population at tim e t, then (Chapter 1, Exercise 1.16): xit)=
(x(0)+!)e*’-i
0
We will denote the limi t of thi s expression as t tends to s by xAs)
= 40)**'
+I
(e** - 1).
(3.54) X_(J).
Thus (3.55)
Let S denote the proportio n of thi s population that survives the pesticide application at tim e s. From Exercise 1.13, it seems reasonable to assume that there exists a threshold U such that 0
where Æis a constant. Then, because we have assumed that the effect of the pesticide is immediate, the magnitude of the insect population immediately after the crop has been sprayed is x(s) = S(U)x_(s); (3.57) and the growth of that population for the remainder of the season is given by xit) = (x(s) + I)
- |,
s < t < T,
(3.58)
on using Exercise 1.16 again. The crop grower’s objective, you’ll recall, is to minimiz e his total loss, L - C + C . Let c be the fixed cost of spraying the crop (cost of renting an aircraft , etc.) and c, the additional cost of purchasing and applying each unit of pesticide. Then the cost of spraying is s
d
0
C = Co + U. t
Cl
(3.59)
Let D\t) denote the number of unit s of crop (say tons of cotton) destroyed by the pest per unit of time. Let ρ be the price, per unit of crop, that the grower obtains at the end of the season. Then the cost of the damage is the loss of revenue, C =P f d
Jo
D{t)dt.
(3.60)
Crop destruction increases wit h the number of pests. The simplest hypoth› esis consistent wit h thi s observation is that D{t) = bxit),
(3.61)
3.6
Ho w Muc h Pesticid e Shoul d a Cro p Growe r Use an d When ?
113
where b is a constant. Hence, on using ( 3 . 5 9 H 3 . 6 1 ), the loss L = C + is given by s
As, U) = c + U 0
+ pb ί x{t)dt, Jo
Cl
U < £/
0<s
m a x
,
Q
(3.62)
where U is the maximum concentration allowed by law. On using ( 3 . 5 4 )(3.58) we obtain (Exercise 3.10): mM
As, U) = c + U 0
+ ^
<
Γ
^ -
1
(x(0) +
+ pb
Cl
(x(0) + I )
{S(U)
I)
e * + | ( 1 - S(U))}
-
, (3.63)
0<s
I f « = 0 then there is no fixed cost (C = 0) and the total cost is simply Q , the cost of damage to the crop. Hence s
As, 0) = pb £
(x(0) + £ ) - £ } ;
x{t)dt = pb{
(3.64)
naturally , thi s quantit y is independent of s. Now, the pesticide has no effect i f 0 < U < U , and so the grower wil l either apply no pesticide (wit h cost (3.64)) or apply pesticide at tim e s* wit h concentration U*, where {s*, U*) denotes the point in the "rectangle" 0 < i < T,U < U < U where As, U) is least. Th e grower wil l adopt the second strategy only if 0
0
max
(3.65)
As\U*)
Findin g the minimu m of (3.63) in the given rectangle is a calculus problem (Exercise 3.11). Combinin g it s results wit h the remark s above, we find that if the grower sprays, then the optimal spraying tim e is given by if Q < Qc, s* = {
1
T
1 , _¸
, RMQ)\
1 + ^ αJ
ˆ
,
_ .
irq>g ,
(3.66)
c
where
Ther e is therefore a critica l immigratio n rate, q , below which the native population so dominates the immigran t one that the optimal strategy is t o eradicate as much as possible of the native population at the very beginning of the season. Above the critica l rate, the effect of the immigrant s is strong enough t o delay the optimal spraying time, but never by more than half th e length of the growing season. c
114
Chapte r 3 Optima l Contro l and Utilit y
Stating the optimal concentration is somewhat easier if we first define the (continuous) function
m
s
{
^rm^ -^
-
m
p
b
(3 68)
The quantity ˜ is best regarded as an alternative measure of the cost of damage that would occur if no pesticide were applied. Indeed it agrees wit h (3.64) if q = 0. The grower should not spray at all if (3.65) is violated, i.e., if W > 0, where A(q)) + In ( ^ ^ )
W(q) =U +-{C 0
0
+ 1;
(3.69)
but if (3.65) is satisfied, i.e., if W{q) < 0,
(3.70)
then the optimal concentration is
« V c, J
c,
(3.71)
Note in particular that the grower should not spray if Ƙ/c, < 1, for which there is a simple economic interpretation . Recall from Exercise 1.13 that Æis the fraction of insects killed by a unit increase in concentration. Thus a A is the fraction of the uncontrolled damage avoided by the unit increase. The cost of the unit increase is c,, and so it is clearly uneconomic t o spray unless c, < Æ ˜. Do (3.66) and (3.71) correspond to what growers actually do? We’ll retur n to that question in Chapter 4. For now, observe that the utilit y function (negative of the loss function) for the problem we have solved may be writte n /<«)=
(3.72)
fg(x(t),u(t),t)dt,
Jo
where g{x(t),u{t),t)
= g{x{t),s,
U) = -pbx{t)-
C
+
C | C / r
.
(3.73)
(Note that g does not depend upon / explicitly here th e dependence on s is part of the dependence on », not on t but it does in Section 3.7 below; see (3.80).) The form of utilit y appearing in (3.72) is extremely
3.7
Ho w Many Boat s In a Fishin g Fleet Shoul d Be Operational ?
115
common, so c o m m on that we give x(t) a name: we call it the state of the system at tim e t. Th e state of the system for the crop-spraying problem was th e magnitude of the insect population. Convince yourself that J really is just a function of u. It appears at first that / should depend on x, but observe fro m (3.54)-(3.58) that x(t) is completely determined once (3.52) is specified. I n other words, x(t) is a function of u(t). Then why do we bother t o record explicitl y the dependence of / upon x? Th e answer is that the dependence of x{t) upon u(l) may be known only implicitly . For example, χ may depend upon u by being constrained to satisfy a differentia l equation; and very few differentia l equations can be solved explicitly , as we have already discovered in Chapter 1. Th e followin g example should help to clarif y thi s point (even though we are going t o ensure that th e differentia l equation is solvable in thi s particula r case by arguing that the set of potentially optimal controls is a very limite d one).
3.7
How Many Boat s in a Fishin g Fleet Shoul d Be Operational ?
Consider a vast expanse of ocean roamed by a species of edible fish, and let x(t) denote the magnitude of its population at tim e t. Suppose that all vessels that fish in thi s territor y belong to a single owner, who pays the wages of all the fishermen. Let u(t) be the number of boats at sea at tim e t, w a fisherman’s average wage (per unit of time), c the overhead cost per boat (per unit of time), and η the number of crew per boat, assumed the same for each vessel. To fix ideas, you might lik e to imagine that the sole owner is a communist government; though, as we shall see in due course, the model of thi s section is also applicable to a capitalist economy. At any rate, the question we pose is this: how many boats should be operational at any given time? Assume that the owner is a profi t maximizer. Let ρ denote the selling pric e per unit offish. Let hit) denote the harvest rate, i.e., the amount offish caught per unit of time. Then the owner’s revenue per unit of tim e is ph{t), and the owner’s costs per unit of tim e are c u(t) + wnu{t) = cu(t), where B
B
c = c + nw B
(3.74)
i s the owner’s cost per boat. Then, at tim e /, the owner’s rat e of profi t is apparently P(u(t)) =
ph(t)-cu(t).
(3.75)
A s explained in Section 3.4, however, the tru e profi t rat e at tim e t fro m now, when viewed fro m the present moment and in the light of alternativ e investment possibilities, is e- (ph(t)-cu(t)), (t
(3.76)
116
Chapte r 3
Optima l Contro l and Utilit y
where δ is the interest rate. We shall take it for granted that 6 is the real interest rate, as defined in Section 3.4, and that p , w, and c are constant (in real terms). Then, wit h u(t) boats operational at tim e /, the owner’s tru e retur n from now until eternity is B
(3.77)
e- '(ph(t)-cu(t))dt. 6
.70 /o
By fixin g the upper integration limi t at eternity, we assume that the owner is very far-sighted. We also make the mathematics easier. Now suppose that the fish are preyed upon solely by the human species, so that we may regard each vessel as a predator; then the number of active predators is u(t). From Exercise 1.15, it is thus fair to assume that (3.78)
h{t) = qu{t)x{t)
and that the growth and decay of the fish population is governed by ^
= ¸ ( )( -^)-¸( )
.
(3.79)
In the scientific literature , the constant q is known as the catchability, and fro m Section 1.9, we interpret R as the maximum specific growth rate in the absence of harvesting and Κ as the capacity of the expanse of ocean. On substituting (3.78) int o (3.77) and (3.79), the owner’s control problem is to find u(f),
0 < t < oo,
which maximizes mi))
f°°
= / Jo
e-"iKt)
{pqxit) - c) dt
(3.80)
subject to the differential equation constraint
% (ΐ-ψ-ψ). = Μ)
(3.81)
Notice that (3.80) is the special case of (3.72) for which g(x(t),u(t),t) e- u{t) Sl
{pqxit)
=
-c).
To make this control problem tractable, we will further assume that the owner has a special reason for wanting to solve it; namely, that the number of fish has dropped to such a low level that the species might even be in danger of extinction. To be specific, suppose it is somehow known that xiO)=%f,
(3.82)
where Ν is large. The cause of thi s is quite clear to the owner: the number of boats in operation, u(0) an d hence the level of predation i s too high. The owner’s vast experience suggests that the best thing to do would be to recall the entire fleet for s units of time, so that the fish have a chance to
3.7
Ho w Many Boat s In a Fishin g Fleet Shoul d Be Operational ?
117
recuperate, and then maintain th e fleet forevermore at th e constant level U (< u(0)), in such a way that the fish population remains in equilibrium . I n other words, it is being assumed that th e optimal control is of the for m u{i) =
f 0, ’ ( U,
if 0 < t < s; ~ tf s < t < oo;
(3.83)
where j and U are t o be determined. Under these assumptions, it follows fro m Exercises 1.10 and 1.15 that (Exercise 3.12) , l + (N -l)e-«" / mk *W= < K
i
f
* ' * *
0
(3-84)
i f s < t < oo.
Th e population varies continuously; therefore lettin g / tend t o s gives = 1- Ά > R
1
l + (N-l)e-
Rs
0).
(3.85)
Thu s s is a function of U, defined implicitl y by (3.85) and explicitl y by «ˆ7 ) ^1 {(¸ -1)(`_,)} =
W e are therefore entitled t o writ e J(u(t)) i n (3.80),
.
(3.86)
= f(U) where, on using (3.83)
^ -ψ-β-^{ΐ-^-ο}, Ρ
Λυ)
(3.87)
and where
is a dimensionless parameter (Exercise 3.15), which is best regarded as a lower bound on the cost/price rati o of a fishing vessel (being th e cost/price rati o that would take effect if the fish population could be maintained artificiall y at it s capacity Κ despite the harvesting). Clearly b < 1; if not, the owner would do better t o abandon fishing in favor of s o me more profitabl e enterprise. Mor e precisely, th e owner wil l abandon fishing unless f(U) > 0 or 1 - b > UqIR. It’ s a simple matter of th e calculus (Exercise 3.13) t o show that the maximum of (3.87) on th e interval 0 < U < R(l - b)lq occurs at U - (/*, where U' = ^ { i ~ b
+
^ -
x
l [ l
+
b -
R
^ j \ ^ -
Th e optimal recovery tim e s* = s{U*) is given by (3.86).
.
(3.89)
118
Chapte r 3
Optima l Contro l and Utilit y
What is the significance of (3.89) fro m the economic viewpoint? Th e fact that U* is the optimal number of operational boats means that U* - 1 / 2 i s too few, and U* + 1/2 too many. Note that, in our context, it is perfectly legitimat e to have half a boat, because we were careful enough t o define u(t) as the number of boats operational at tim e /. Thu s a boat that spends half it s tim e at sea and half in port would count as an operational halfboat, and similarl y for other fractions. Were thi s not the case, we should hardl y be justifie d in using a noninteger control function. Let us therefore consider what the effect would be of increasing U fro m U - U* - 111 t o U = Ό* + 1/2. I n th e short term, harvesting would begin sooner, because s'{U) < 0, as you can see directl y fro m (3.86). Thu s th e owner’s profi t would be increased by s{U'
r
-1/2)
/
Js(u- + \n)
(3.90)
P(u{t))dt,
where Ρ is defined by (3.75). Thi s expression is approximately equal t o P{U'){s{U*
- \/l)-s[U*
+ 1/2)} « -P{U*)s’((/*).
(3.91)
On the other hand, because straightforwar d algebraic manipulation reveals that P'(U') < 0 (remember that b < 1), the additional boat has the longter m effect of reducing the profi t rat e by P{U* - 1/2) - P(U'
+ 1/2) « -P\W).
Thu s th e tru e wort h of the long-term loss of profi t is approximately
- Γ e- P\U*)dt 6t
Jo
=
-il^l. °
(3.92) 5
(3.93)
But by differentiatin g (3.87) wit h respect t o U we obtain /’(£/) =
- P(t/)i’(t/) j .
(3.94)
Thus, because f'(U*) = 0, we learn that U' is the optimal number of operational boats because the short-term gain fro m slightly increasing that number would be exactly cancelled by the long-term loss, in much the same way as you stop eating candy when the short-term gain in pleasure of taste in the mouth is exactly cancelled by the long-term loss in pleasure of lookin g at your figure in the mirror . Argument s akin t o the one we have just used are very popular wit h economists. They provid e what is known as a marginal interpretation . Th e importanc e of these arguments stems fro m the fact that most people make See Supplementary Note 3.2.
Exercise s
119
decisions by balancing pros against cons, rather than by consciously max› imizin g some utilit y function. Thus, even though the results are equiva› lent, the marginal derivation may come closer t o mimickin g what people actually do than the maximization of J{u). I n particular , there is an im› portan t marginal interpretatio n of equation (3.40) of Section 3.4 (see Exer› cise 3.14). There is also an alternativ e marginal interpretatio n of (3.89) in term s of the stock level, rather than the number of boats (Exercise 3.17). How good is our model woul d fishermen use it? One technical mat› ter can be disposed of immediately. We assumed above that the optimal control function that maximizes (3.80) subject to the constraint (3.81) and initia l condition (3.82) has the for m (3.83). How do we know that thi s is true? The answer is that more advanced mathematics (see Clark , 1990, Chapter 2) can be used to show, without assuming (3.83), that the solution of the optimal control problem (3.80) (3.81 ) is u(t)=
U, N
= IT,
if 0 < t<
s,
ifi
(3.95)
where U* is defined by (3.89), s is defined as the soonest tim e for which x(s) = U* when s is governed by (3.81) and (3.82), and U is defined by N
0,
if,V>( l
U ={
R
N
C/
max
’
,
(3.96)
ifjv <
denotes the maximum Her e Ν is simply K/x(Q), as in (3.82), and C / number of boats that can be made operational. Thu s the correctness of our (mathematical) assumption is assured by the fact that Ν is large. But th e question remains ho w good is thi s model? We’ve asked thi s question so many times that we really ought to pro› vid e some answers! Whic h bring s us nicely t o Chapter 4. max
Exercise s 3.1 Verif y (3.6) and (3.7). *3.2 In Section 3.2, suppose that at least one faculty member had a factor clas› sification of weak or inadequate. Would still be a 3 3 matrix ? Why or why not? Don’t jum p to an apparently obvious conclusion i t may be a wrong one! 3.3 Obtain (3.14).
120
Chapte r 3
Optima l Contro l and Utilit y
3.4 (i) Verif y that (A ) and e {\) in (3.23) satisfy e^A ) > e (\). (ii ) Verif y that (3.25) satisfies Œ , > 0 for = 1,2,3. (iii ) Verif y that (3.24) and (3.25) satisfy all other constraints. (iv) By using a linear programming package such as the IMSL routin e ZX3L P to solve (3.19) for various values of e and A, demonstrate the validit y of the optimal control policy implied by (3.24) and (3.25). A rigorous proof of its validit y would requir e the theory of linear programming. fl/
L
L
"3. 5 (i) Suppose the chairperson of the Mathematics Department in Section 3.2 considered that the faculty’s research effort was about right but wished to en› courage more devotion to teaching. What would be the chairperson’s prob› lem in these circumstances? Use a package such as ZX3L P to find the optimal controls for various values of e and A. Can you conjecture a more general formul a for the optimal policy, corresponding to (3.23)-(3.25)? (ii ) Suppose the chairperson felt his department’s problem was that too much effort was devoted to service and wished to discourage this. What would be the chairperson’s problem in these circumstances? Use a package such as ZX3L P to find the optimal controls for various values of t and A. Can you conjecture a more general formul a for the optimal policy, corresponding to (3.23M3.25)? (iii ) Do you think that a fairer policy would be obtained if the minimu m salary constraint (3.16) were eliminated? Why or why not? *3.6 What constraint have we overlooked in Section 3.3? Modif y (3.28) accord› ingly. 3.7 (i) Verif y (3.40), (3.41), (3.43), and (3.44). Show that (3.41) is satisfied when KO is given by (3.42). (ii ) Verif y that the form of (3.40) would be unchanged if we worked instead wit h nominal value and interest rate. 3.8 Using the shift technique of Chapter 2, show that the optimal forest rotation tim e (3.44) is a decreasing function of interest rate. Verif y this graphically. The significance of this will be discussed in Chapter 4. *3.9 The following net stumpage values, i.e., values of HO = ρΝξ(ί) - c, for a "typical " stand of Britis h Columbia Douglas fir trees are quoted by Clark (1976, p. 261) as due to P. Pearse; t is measured in years, Fi n dollars.
t
no
30 0 40 43 50 143 60 303
t
W)
70 497 80 650 90 805
t
m
100 913 no 1000 120 1075
Exercise s
121
(i) Plot ˚ against t. What do your results tell you about an assumption we made in Section 3.4? (ii ) Using a method suggeste d by Section 1.9, estimate V[t) and V'{t) for t = 3 5 , 4 5 , . . .1 , 15. (iii ) Plot θ against t, where θ is defined by
Use your graph to estimate the optimal rotation tim e for Douglas fir trees, according to the model of Section 3.4, when the real interest rate is 6 = 0.05. 3.10 Obtain the expression (3.63). 3.11 Obtain the minimu m of (3.63) on the open rectangle t / . Hence verify (3.66) and (3.71).
0<S
m a x
3.12 Verif y (3.84). 3.13 Show that the maximum of (3.87) on the interval 0 < U < R{i - b)lq occurs at (3.89). *3.14 In this exercise, you will attempt to provide a marginal interpretatio n of equation (3.40). (i) A forester cuts his forest at time t = s and immediately invests the pro› ceeds (real value VYj) ) in a bank. What is his gain after one unit of time if the real interest rate is 61 (ii ) Assuming that 6 is small, writ e down a first approximation to the expres› sion you obtained in (i). (iii ) What additional proceeds would the forester have accrued durin g the interval from / = J to r = + 1 if he had not cut his forest at t = si (iv) Writ e down a first approximation to the expression you obtained in (iii) . (v) Hence show that the optimal cutting time, according to the model of Section 3.4, is when the incremental loss from failin g to let the trees grow a littl e longer is exactly balanced by the incremental gain from alternative investment. 3.15 What are the dimensions of catchability? Verif y that the constant b defined by (3.88) is dimensionless. *3.16 If 8 = 0, so that the possibility of alternative investment does not arise, then the integral (3.77) does not converge. In these circumstances, we would expect the owner to maximize the profi t rate P(u(t)) - {pqx(t) - c) u{t). Throughout this problem, assume that the fish population is maintained in a static equilibriu m x(U) by using a constant number U of operational
122
Chapte r 3
Optima l Contro l and Utilit y
boats. Thus the profi t rate is P(U) = U {pqx{U) - c], and the harvest rate is qUx{U). Call P(U) the sustained profit rate and qUx{U) the sustained yield. (i) What is the optimal value of Ul (ii ) What is then the equilibriu m population? (iii ) Suppose that, for political reasons, it became expedient to maximize the sustained yield instead of the sustained profi t rate. What would then be the optimal value of C/? (iv) What would then be the equilibriu m population? (v) If you were concerned about the preservation of the species of fish, which objective would you prefer, maximization of sustained profi t or maximiza› tion of sustained yield? (vi) Now suppose that 8 φ 0. There are still two possible objectives, maxi› mization of profi t (from now until eternity) and maximization of sustained yield. Show that the objective that is more conducive to preserving the species of fish is now determined by the relative magnitudes of b and 6/R. (vii ) Suppose that a government is concerned about preserving the species but has no control over the interest rate that is used to determine the optimal fishing strategy. What should it do? *3.17 (i) In any fishing equilibrium , whether optimal or not, the fish population is related to the number of boats by χ = X = K( 1 - qlllR). Hence the optimal control problem of Section 3.7 could have been formulated with X, not U, as the independent variable. Obtain the expression φ(Χ) that then replaces (3.87) and show that it has a maximum at X = X' where (a) (ii ) Show that the cost of harvesting a unit of fish is clqx when the population is x. (iii ) Hence provide a marginal interpretatio n for Eq. (a) Hint: Writ e the optimall y condition in the form
and find an expression for the sustained profit rate as a function of X.
*3.18 A dealer has an approximately constant daily demand for one of his prod› ucts, of which he sells quantity Q per year. He orders the product from a manufacturer in batches of size u, and he wishes to determine the batch size u* that will minimiz e his costs. These costs arise from two sources, a set-up cost of C) per order and a storage cost of c per unit stock per year. (i) Show that the average stock held between orders is u/2. (ii ) Deduce the total yearly cost. (iii ) Find u* and show that the minimu m total cost is y ’ 2 Q c c . 2
1
2
Supplementar y Note s
123
Hint: Make lif e easy for yourself by assuming that the last item is sold around closing tim e one day and that the new consignment arrives before opening tim e the following day. Note: This model is not especially useful because products for which costs arise principall y from these two sources are unlikely to have such a regular demand. Probabilistic models for optimal ordering strategies are introduced in Chapter 7.
Supplementar y Note s 3.1 Although the crude definition (3.32) will be adequate for the purposes of this section, it is possible to proceed more rigorously. Let us define the function D by fO D{1 - s;e) = {
if - j < - |
if
0
(
ΐ
i f - > < f - i < »
0
ifi-j> i
2
=
2
<
-
J
^ s - - < t < s + 2 2
-
(
if
Then D(t-s;c) = 0 unless -til
0
provided that the limi t exists. Strictly , the limi t does not exist as an ordinar y function, but mathematicians have been able to construct a meaningful calculus of so called generalized functions, according to which δ exists as the Dirac delta function, which has the property that 6(x) = 0
ifx/O,
6(x)dx=l.
/ J — CO
For an alternative approach to the Dira c delta function, see Section 11.5. 3.2 The lower limi t of integration on the left-hand side of (3.93) is the time at which harvesting begins. It is legitimate to call it t = 0 because (3.90) has not been discounted to the present. If you insist on calling t = 0 the present time, then the present value of the long-term loss of profit is approximately 'P'(U')dt=-
*
(U
,
JsW)
and the present value of the owner’s short-term gain is e " When the two are equated, of course, the factor e' cancels out. 6s{U
6s{ir)
>
times (3.91).
VALIDATIN G A MODEL
This page intentionally left blank
— VALIDATION : ACCEPT, IMPROVE, OR REJEC T
4
It’ s a fundamental tenet of the philosophy of science that the trut h of a model can never be proved; only disproved. Thu s validatin g a model means proposing a test that the model, if false, would fail to pass. I f a model does fail such a test, then we are bound t o reject it . I f it passes, however, then we propose a more stringent test; if it passes that one, too, then we propose still another one; and so on, unti l . .. when? When do we stop? I n theory, we could go on forever. Indeed, broadly speaking, the received wisdom of science consists of mathematical models for which no one has yet invented a test that results in failure . I n practice, however, there i s always an element of subjectivity about the decision to stop testing. A s we’ll see in the examples, it depends upon the purpose for which the model was constructed. For the tim e being, let’s simply say that we wil l accept a model if it explains all the facts that we would lik e it t o explain. Otherwise, we wil l reject it ; or else improv e it , then test it again. Later , when we come t o discuss the difference between descriptive models and prescriptiv e ones, we wil l have t o enlarge upon thi s simple philosophy, but by then we wil l be better prepared t o appreciate the enlargement.
4.1
A Mode l of U.S. Populatio n Growt h
We have seen the cycle of validation at work already, in Section 1.9.’ There, we proposed x(t) = 3.9e - ’ as a model for the magnitude of the U.S. pop› ulation , on the strength of supporting data for the years 1790 to 1840. We invented a test for thi s model, namely, that it should predict the population levels recorded in later years. It failed thi s test miserably; so we rejected the model and proposed another one, namely, (1.58), in which x(t) = 3.9e°- ' 3
3
You may wish to review Section 1.9 before proceeding. 127
128
Chapte r 4
Validation : Accept , Improve , or Rejec t
for 0 < t < 6.5 but x(t) = 31 - ’- for / > 6.5. Thi s provided an ac› ceptable description of U.S. population growth for about a century, fro m 1790 unti l 1890, but still failed adequately t o estimate the magnitude of th e twentieth century U.S. population. So we rejected thi s model, too, and proposed yet another one, namely, 24(
*
t
)
7)
198 t + 49,4^o.
=
3 l <
•
Thi s provided an acceptable description of U.S. population growth un› ti l the middl e of the twentieth century; but it failed another test, for it could not predict the 1960 and 1970 population levels. Therefore, in Ex› ercise 1.11, we improved the model to take account of the postwar popu› latio n surge. A possible improved model is 198 i f t< 15.5; 1 + 4 9 . 4 - " . .• 373 <- ) i f f > 15.5. 1 + 1.48e- - (’- )’ Thi s provides an acceptable description of the U.S. population growth fro m 1790 onward, one that is correct t o at least one, mostly two, and occasion› ally three significant figures. Accordin g to the 1991 Britannica Yearbook, the U.S. population was 251.4 millio n in 1990, i.e., to two significant figures, x(20) = 250. Thi s agrees wit h the prediction of the model (4.2). If , therefore, we requir e only a rough description of U.S. population growth throughout the history of the nation, then the model (4.2) should be accepted. Thi s does not mean that it s prediction (to two significant figures) of 270 millio n people for the tur n of the century is bound to be true; it simply means that we cannot prove it to be false. We’ll just have to wait and see. Th e model is certainly useful, even if we just regard it as a simplifi › cation of the actual data. But the real value of a model is often it s abilit y t o generate hypotheses. I f (4.2) is true, and i f the conceptual derivation of (1.62) is true, then there was a sudden jum p around 1945 in the capacity of th e land o r at least a j u m p in the general perception of what that capac› it y might be. D i d the capacity suddenly j u m p fro m 2 00 millio n to almost twic e that much? I f so, why did thi s happen wa s it due t o improvements i n technology, or was it simply due to postwar euphoria? These are ques› tion s you might lik e to discuss. For now, simply observe that an hypothesis emerges wit h greater impact when suggested by a mathematical model. 4
28
4.2
2
16
Cleanin g Lak e Ontari o
Accordin g to the model of Section 1.1, if all pollutio n input to a lake of volume V suddenly ceases and if water flows out at rat e r, then the existing pollutio n wil l take i . 5 « 3 Vlr unit s of tim e t o decay to 5% of 0
0
4.3
Plan t Growt h
129
it s current level. According t o Rainey (1967, p. 1242), V = 1636 10 cubic meters for Lak e Ontari o and r = 5 7 2 , 5 6 2 , 4 32 cubic meters per day, so that f .05 « 8572 days or 23.5 years. Can we accept thi s figure as the cleaning tim e for Lak e Ontario ? A s stated at the beginning of thi s chapter, all we can do is attempt to re› ject it . This, as it happens, is a simple matter, for the prediction f « 23.5 i s based on the assumption that all pollutio n inflo w t o Ontari o has ceased. But the water outflow fro m Lak e Eri e is known t o constitute five-sixths of the water inflo w t o Lak e Ontario . Thus, even if pollutio n has ceased t o enter the Great Lakes as a whole, pollutio n fro m Eri e wil l continue to flow int o Ontario . I n these circumstances, we would expect the 5% cleaning tim e for Lak e Ontari o t o be considerably longer than 23.5 years and to be an increasing function of th e current pollutio n level for Lak e Erie. These expectations can be confirmed by an improved model, which relaxes the assumption of zero pollutio n input . We develop thi s model in Section 9.3. For now, simply observe that the model of Section 1.1 has failed a test (the validit y of one of it s basic assumptions) and must therefore be rejected. 2
9
0
0 05
4.3
Plan t Growt h
I t is sometimes necessary t o generate a whole chain of predictions before arrivin g at one that can be tested. Even when thi s is not absolutely nec› essary, it is often still convenient. Consider, for example, the plant growth model of Section 1.3. Thi s predicts the 5-shaped logistic growth curve of Fig. 1.1. I n Section 3.4 we adapted thi s model t o predict that the growth curv e ξ = ξ(ί) of an individua l tree in a forest would also be S-shaped. I t wouldn’t be difficul t to compare thi s shape wit h those of tree growth curves that have actually been observed. But suppose that such data were not readily available woul d that mean that the model could not be tested? Th e answer is no for, as we saw in Section 3.4, the assumption that ξ - ξ(ί) is 5-shaped leads t o the furthe r prediction that the real value V\t) = Νρξ(ή-ο of a forest wil l grow according t o a curve lik e that depicted i n Fig. 3.4; and perhaps the shape of thi s curve can be tested more easily. Th e graph in Fig. 4.1 depicts the actual growth of net stumpage value for a typical stand of Douglas fir trees in Britis h Columbia. It is based on data given in Exercise 3.9 and ought to remind you of Fig. 3.4. As it happens, th e dashed curve in Fig. 4.1 is identical t o th e solid curve in Fig. 3.4. I n other words, Fig. 3.4 is just Fig. 4.1 wit h the coordinate scales removed. Thus, although we did not have the data to test it directly , the assumption that individua l trees grow according t o ξ = ξ(ή has led t o a prediction that is not inconsistent wit h actual data for stumpage value. We have proposed 3
2 3
You may wish to review Section l.l before proceeding. You may wish to review Sections 1.3 and 3.4 before proceeding.
130
Chapte r 4
Validation : Accept , Improve , or Rejec t
ν 1000 4 4 9
4
4 500
4
60
0
90
120
Fig. 4.1 Net stumpage values for a Britis h Columbia Douglas fir. The dots denote Pearse’s data points, quoted by Clark (1976, p. 261) and in Exercise 3.9. a test, and the logistic growth model for trees has passed. We have therefore no reason t o reject the model. But thi s doesn’t mean, of course, that we won’t be forced t o reject it later on other grounds; and we note that many other form s of the function £(r) might also have led t o a stumpage value curv e lik e that in Fig. 4.1.
4.4
Th e Spee d of a Boa t
I n Sections 1.12 and 2.2, we constructed a dynamic model of the approach t o equilibriu m of a rowin g b o a t . Th e equilibriu m speed of the boat was 4
(4.3) where 5 denotes wetted surface area, Ρ denotes the effective power sup› plied by an oarswoman, and b is a constant. I n thi s section, we wil l test thi s model by comparing th e course times it predicts for tw o different crews, a lightweight one and a heavyweight one, in a race of length d. Now, in Exercise 1.19, we found that the rapidit y wit h which the boat approached it s equilibriu m speed depended upon th e dimensionless pa› rameter
"
s
m a -
->
(4 4
where Μ is th e mass of th e boat (plus crew). By setting u = 0.99 Vin (1.78), for example, we find that th e boat is withi n 1% of it s equilibriu m speed You may wish to review Sections 1.12 and 2.2 before proceeding.
4.4
The Speed of a Boat
131
after a tim e iA95qd/V. Because the course tim e would be dlVi[ the crew rowed the entir e race at speed V, the results of that exercise show that, provided q is sufficiently small, it wil l be a good approximatio n t o assume that the boat is in equilibriu m throughout the entir e race. Whether q is small or not wil l depend on the values of the parameters M, S, d, and b. Th e first three of these are either known or easily measured, but a value for b is more difficul t t o supply. Therefore, we are simply going t o assume that a rowin g boat reaches equilibriu m after a small fractio n of the course tim e has elapsed, on the grounds that thi s is what seems t o happen whenever we watch a boat race. Indeed the best way t o estimate the parameter b might well be to determine how long a boat takes t o reach, say, 99% of equilibriu m speed, deduce the value of q, and hence deduce the value of b. Let t , t denote, respectively, the course times of a lightweight crew and a heavyweight one. Let V and V denote the speeds at which they row. Havin g made the assumption that q is small, and if our model is correct, then it is at least approximately tru e that t = dlV and t = dlV ; whence t lt = V IV . Using S to denote the wetted surface area of the lightweight boat, P the effective power supplied by a lightweight oarswoman throughout the race, and S , P t o denote the corresponding quantitie s for a heavyweight crew, we deduce fro m (4.3) that L
H
L
H
L
H
H
L
L
H
L
H
L
L
H
H
(4.5) Now, according t o M c M a h o n (1971, p. 350), the course tim e of a heavy› weight crew is about 5% faster than that for a lightweight one. I f our model i s correct, then the quantit y on the right-han d side of (4.5) should have a value of about 0.95. We thus have a testable prediction. (McMahon’ s data was obtained for male crews, and here we consider a female crew; but that wil l not alter the substance of what is t o follow.) Before we can actually test our prediction, however, we requir e a value for PJP . Now, we do not have values for P and P . But M c M a h o n does tell us that the average weight of a heavyweight crew member is about 86 kilograms, and that of a lightweight crew member about 73 kilograms. Let us therefore make the additional assumption that H
L
H
EFFECTIVE POWER IS PROPORTIONAL T O WEIGHT.
(4.6)
Thu s an oarswoman who is 100a% heavier than another oarswoman wil l supply 1 + a times as much effective power. N ow PJP = 73/86. We also do not have values for S and S . Let us define H
L
H
(4.7) Th e heavyweight boat wil l certainly have a greater wetted surface area than the lightweight one, because extra weight wil l lower the boat. I f the
132
Chapte r 4 Validation : Accept , Improve , o r Rejec t
heavyweight boat is larger than th e lightweight one, however, then it wil l also displace a greater volume of water; and the additional upthrust wil l counterbalance th e additional weight, so that S , though greater than S , wil l not exceed it by very much. Thi s argument suggests that º , though less than 1, is also close t o 1, and experiment confirm s this. On using ( 4 . 5 )(4.7), our model predicts that H
ώ
/ 2 ! ˝ ’ *
L
0 9 4 6 8
=
(
4
8
)
Thus, as long as th e value of º is between about 0.975 and 1, th e value our model predicts for t lt wil l be 0.95 t o tw o significant figures. We have therefor e no reason t o reject our model; it has passed th e test we proposed for it . Notice, however, that, had it failed, we would have been left t o decide by other means whether th e fault lay wit h th e assumptions inherent i n Sections 1.12 and 2.2 or wit h th e additional assumption contained i n (4.6). H
L
4.5 Th e Exten t of Bir d Migratio n I n Section 3.1 we constructed a mathematical model that predicts that bird s wil l migrat e a distance ._ 2 η Ε 3(2bSg v}y»m™' 2
where Ε denotes energy stored for th e flight and m th e mass of the bird , g denotes acceleration due t o gravity , η denotes efficiency at converting fat int o mechanical energy, ,• denotes induced velocity, S denotes surface area facing th e wind, and M s a drag constant. Th e constant g i s certainly th e same for all birds. Moreover, it seems reasonable t o assume that ,•, b, and S are also the same for all birds, at least for bird s of similar species. Then, i f subscript ˘ denotes species Z , our model predicts that 5
d
z
= C-h , m
(4.10)
n
z
where d is th e distance travelled by a member of that species, wit h initia l energy E and mass m \ and where C is independent of Z . Thi s is a testable prediction. Accordin g t o Tucker (1971, p. 122), a hummingbir d (species H) of mass around 5 1 0 " kg flies 500 miles across th e Gul f of Mexico; a Blackpoll warbler (species B) of mass about 20 1 0 " kg flies 800 miles fro m N ew England t o Bermuda; and a golden plover (species G) of mass around 0.2 kg flies 2400 miles fro m the Aleutian t o th e Hawaiian islands. z
z
z
3
3
5
You may wish to review Section 3.1 before proceeding.
4.5
Th e Exten t of Bir d Migratio n
133
Hence d ld = 800/500 = 1.6, m lm = 20/5 = 4, d ld = 2 4 0 0 / 8 00 = 3, and m lm = 0.2/(20 1 0 ) = 10. Let’ s use thi s data t o test our model. Fro m (4.10), our model predicts that B
H
B
H
G
B
- 3
G
B
dfi
\
*-H
m
B J
We have values for d ld and m lm but not for E IE . Let’ s therefore make the additional assumption that stored fat is proportiona l t o weight. Because weight = mg, fro m (1.74), and because g is the same for all birds, our additional assumption is entirely equivalent t o B
H
B
H
B
H
(4.12)
Ε is proportional to m.
Thu s a bir d that is a times heavier than another bir d wil l store a times as much energy as fat. N ow our model predicts that E IE = m lm and hence, on using (4.11), that B
H
B
H
1/3
(4.13) d \™H) Accordin g to our data, the left-hand side of (4.13) is 1.6 and the right-han d = 1.587. Thi s agreement is as good as we could wish for. On the side is 4 other hand, when we use (4.10), our model also predicts that H
1 / 3
da _
("*α\ (4.14) d \™B) but our data do not support thi s prediction, because the cube root of 10 is about 2.15 and certainly not 3. A test of our model has resulted in failure . Whic h of the assumptions responsible for it is false? Zoologists seem t o be quit e content wit h (4.12). Indeed Tucker (1971, p. 119) says that 25% of body mass is a reasonable estimate of the amount of fat that bird s reserve as fuel for long flights. The problem therefore appears t o rest wit h the assumptions we made in Section 3.1. Because 2.15 < 3, a golden plover flies furthe r than the model predicts. I s there, then, an effect we ignored in Section 3.1 that makes a bir d int o a more efficient traveller ? There’s an obvious answer t o thi s question. We have neglected the effect of a followin g wind , and we must improv e our control model t o allow for this. B
Let w, the control, now be the speed of a bir d relative to the air, and let ˚ be the followin g wind. Then distance travelled in tim e St is 6z = (u+V)St.
(4.15)
Thi s result agrees wit h Section 3.1 when V= 0. From Section 1.12, resist› in g the drag force D for thi s distance requires mechanical energy D ( «+ V)St. Fro m aerodynamics, the drag on a bir d is proportiona l t o the surface area facing the win d and t o the square of it s velocity relative to the wind. Hence
134
Chapte r 4
Validation : Accept , Improve , or Rejec t
D = bSu , as in Section 3.1; but u has a different meaning now (which, however, coincides wit h that of Section 3.1 when V = 0). Th e mechani› cal energy required to resist the drag in moving distance 6z is therefore bSu (u+ V)St; of which bSu V6t is supplied by the win d and the remaining bSvPSt must be supplied by the bird . Th e induced power, or rat e at which mechanical energy must be supplied to keep the bir d airborne, remains unchanged. From (3.8), it’ s / = mgVj. Hence the rat e at which the bir d supplies energy, i.e., the effective power, must equal bSu* + rngv,-- Th e ef› fective power is simply times the rat e at which the bir d actually burn s up it s energy, and so we have 2
2
2
= bSu
3
+ mgVi,
(4.16)
where T=
-4— u+V
(4.17)
i s the flight time. The bir d still wishes t o maximize d\ therefore we deduce fro m (4.16) and (4.17) that it s optimal speed relativ e t o the air wil l be the value of u that maximizes
W.jgttBL.
(4.18)
Thi s expression agrees wit h (3.5) when V = 0. Th e mathematics of optimization wil l be simpler if we scale both the flight speed and the followin g wind wit h respect to the speed
that would be optimal if th e wind were zero; (4.19) is merely (3.9) wit h a subscript 0 added t o denote zero win d speed. Let ύ denote dimensionless flight speed (relativ e t o the wind) and e dimensionless wind; i.e., define (4.20) and f
Then we can replace (4.18) by
=
V . «5
(4.21)
4.S
Th e Exten t of Bir d Migratio n
135
I t is a simple exercise (Exercise 4.1) t o show that (4.22) has a maximum at « = it, where «*(e) is the only positive solution of th e equation u ( 2 t i + 3 e )= 2,
(4.23)
2
th e value of the maximum being./(u*(e)). N o te that e = 0 and «*(0) = 1 correspond to Section 3.1. Because (4.23) can be solved numerically (by th e N e w t o n - R a p h s on technique) for any value o f f , the graph of u*(e) is easily found and is sketched in Fig. 4.2, for 0 < e < 1. N o te that u*(e) < 1; i.e., a followin g win d reduces the optimal flight speed. Can you prov e thi s withou t solving (4.23) numerically? See Exercise 4.2. Th e fact that a Blackpoll warbler migrates four times as far as a hum› mingbir d has already been explained by our model. Let us therefore as› sume that no win d follows a hummingbir d or a Blackpoll warbler , but that a golden plover is followed by a (dimensionless) wind e . Then, assuming that (4.12) still holds but that d and d are given by our improved model, we deduce fro m (4.22) that G
G
dc _ (mg\ d
B
- \ m
B
1 / 3
Aieg) _
/ A(e ) G
\
˜ ( 0 ) " Η 0 . 4 6 4 2 )’
)
B
( 4
"
2 4 )
where we have defined u'(e) + 2 3
and used the facts that m lm G
B
= 10 and ˜ ( 0 ) = 1/3. See Exercise 4.3.
0.2 -
•
0
I
1
L -J
0.36
1
1
1
1
J
1
^
£
1.0
Fig. 4.2 Migratin g bird s travel slower (relative to the air) and further with a wind behind them. The diagram shows how the optimal airspeed and distance travelled vary with (dimensionless) wind speed.
136
Chapte r 4
Validation : Accept , Improve , o r Rejec t
Th e graph of ˜( ) is sketched in Fig. 4.2. Notice that ˜( ) > 1/3. Thi s i s the mathematical equivalent of saying that a bir d migrates further wit h a followin g wind. Th e function takes the value 0.4642 where e is about 0.36. Thus, because Œ * ( 0 . 3 6 )« 0.85, the model of thi s section would pass it s test if golden plovers were habituall y followed by a wind of just over 4 2% of their actual fligh t speed (relativ e to that wind). According to Tucker (1971, p. 122), small bird s have been observed to migrat e at 10 to 15 meters per second, wit h a tail wind of at least 5 meters per second; so that, at the very least, our model appears to be along the righ t lines. But does it actually pass it s test? To answer that question, you would have to acquire the wind-speed data. Perhaps thi s is a matter you would lik e to pursue. But if the data match the model’s prediction, it does not mean that the model is true; it means only that we have no good reason to doubt it s trut h and should therefore accept it, at least unti l we have adequate data for a more stringent test. And if the data do not match the model’s prediction, it does not necessarily mean that our model should be rejected completely; it may only mean that our model must be further improved to take account of spatial or temporal variation s of wind speed, or indeed any other factor. See, for example, Exercises 4.20 and 4.21.
4.6
Th e Spee d of Car s in a Tunne l
I n Section 2.3, we used the conceptual approach to derive a model for the speed, v(x) miles per hour, of cars through a tunnel when the traffi c density is χ cars per mile. The model we obtained was 6
(4.26) Her e x is the highest density at which driver s are free t o m o ve at the speed is the density that wil l just brin g traffi c t o a halt. limi t v , and x W e have already explained, in Chapter 2, how density is measured on an actual road. Data points obtained in thi s way fro m N ew York’ s Hollan d tunnel are depicted in Fig. 4.3. Thin k of the data point (JC, v) as recordin g the average value of all speeds observed when the density was measured and found t o be x. Th e dashed curve in the diagram is (4.26), about 55 m.p.h., x about 10 cars per mile, and x about 175 wit h v cars per mile. Observe that thi s curve fits the data quit e well in the range x< χ < x . (We do not have data for 0 < χ < x . Th e effect of thi s is considered toward the end of the section.) W e have raised the point, in Section 4.3, that a model may yield several successive generations of predictions, and that any of these may be tested. c
m a x
max
m a x
c
6
c
miX
mix
c
You may wish to review Sections 2.3 and 3.5 before proceeding.
4.6
Th e Spee d of Car s In a Tunne l
137
60 55
40
20
50
100
150
2 00
2 50
Fig. 4.3 Speed, m.p.h., versus traffi c density, χ cars per mile, for New York’ s Hol› land tunnel. The 32 data points were obtained from a sample of over 20,000 cars. The dashed curve is (4.26). The sketch is adapted by permission of the publisher from Prigogine and Herman, Kinetic Theory of Vehicular Traffic, p. 6. (Copyright 1971 by Elsevier Science Publishing Co., Inc.) I n Section 4.3, for example, a test was applied t o a second generation pre› diction , the growth in value of a forest. Viewed in thi s light , (4.26) is a first generation prediction, which, by virtu e of Fig. 4.3, has passed a first generation test. But the same model has already yielded, in Section 3.5, the second generation prediction that the optimal speed for cars through a tun› nel is v l n ( j c / x ) , the optimal flux being x /e = 0 . 3 6 8 x times that speed. We already know fro m Chapter 3 that these predictions are compat› ibl e wit h data fro m the Lincol n tunnel. Thu s the model has also passed a second generation test. Moreover, the fact that the model, as mentioned in Chapter 3, fail s t o mimi c realit y in the immediate aftermath of perturba › tions, due t o any sudden congestion, is of no concern t o us, because we can› not expect an equilibriu m model t o describe nonequilibriu m conditions! We therefore conclude that the model provides an acceptable description of equilibriu m traffi c flow, the purpose for which it was designed. For x < χ < x , the dashed curve in Fig. 4.3 is the curve of the for m (4.26) which best fits the data, in the sense of Section 8.4. It is found that m w
m ! l x
c
Xm
175
c
mM
m ax
max
and
. ln(x
m a x
, « 19, /x )
(4.27)
c
if x and the parameter on the left-hand side of (4.27) are the two pa› rameters that are varied, to give the dashed curve it s best fit property . I n view of (3.46) and (3.51), it is also found that the optimal speed for cars m
138
Chapte r 4
Validation : Accept , Improve , o r Rejec t
throug h New York’ s Holland tunnel is about 19 m.p.h.; see Prigogine and Herman (1971, p. 9). Because no data are available for 0 < χ < x , however, the appropri › and x cannot be determined accurately. Al l we know ate values of v is that they are constrained, so that (4.27) is satisfied and the horizontal section of the dashed curve lies above the leftmost data point; but withi n these constraints they are arbitrary . Thus the horizontal section of curve in Fig. 4.3 is purely speculative and should, perhaps, be lower. A s we have already seen in Chapter 3, however, thi s is a matter of minor importance when using the model to determine optimal flux. c
m M
4.7
c
Th e Stabilit y of Cars in a Tunne l
Sometimes, even without a conscious effort to compare your model wit h data, it wil l dawn on you that one of your predictions is somewhat du› bious. Improvements that emerge as the result of such doubts are the subject of thi s and the followin g section. I n Section 2.8 we developed a model for instabilit y of traffi c in a tun› nel. We found that for any given amplitud e of the initia l disturbance ˜ ther e is a critica l value, .(˜) , which driver response tim e must not exceed i f a platoon of cars is t o stay in equilibrium . We found, moreover, that dr /dA < 0 (see Fig. 2.12). Thi s pictur e is surely in qualitativ e agreement wit h everyone’s highway experience. But it seems that the retur n t o equi› libriu m in Fig. 2.10 is almost too smooth t o be true. I f thi s is right , then something is wrong wit h the assumptions that led t o Fig. 2.10; and hence wit h equation (1.81), i.e., 7
c
| ,•(0- ,--Ø(01
dt*
Recall that the car wit h index j is followin g the car wit h index j—l. Thu s th e equation says tw o things. First , if tw o cars are moving toward one another then the closer they are, th e harder th e second one brakes. Wit h thi s I agree. Second, if tw o cars are moving away fro m one another then th e furthe r away they are, the more gradually the second one accelerates. I suspect that thi s isn’t tru e (though the follower wil l certainly accelerate i f the leader is moving away). A possible improvement of (4.28) would be t o combine it wit h the model of Exercise 2.4 in th e followin g way: r;(i)-zj_,(t )
d Zj(t 2
+ T)
- |r/0-V,(0r A
- / Ø^ ω -
^ω},
You may wish to review Section 2.8 before proceeding.
. lf
f
,
/ x
,
/
v
4<’> > * / - . « ) ;
(4.29a)
ifzj (o
4.7
Th e Stabilit y of Car e In
Tunne l
139
where º and μ are constants. Thus, i f a gap between cars is closing, th e followin g driver responds both t o the size of the gap and th e rat e at which it i s closing; but if a gap between cars i s widening, then th e followin g driver responds only t o the rat e at which it is widening. Integrating , and choosing th e constants of integration so that th e equilibriu m solution of (4.29) wil l satisfy v ( x ) = 0, we find (verify ) that m a x
dzj(.t+r) —dF-
’ º In ( x =
<
μ
/
m a x
zj^it)
( z ,_ , (0 -
,( )) ) , Ø \
- z /O -
i f z'j(t) > zj _ ,(*);
,
i f zj(i ) < z;_,(i).
(4-30)
Because (4.29a) and (4.29b) must yield the same equilibriu m solution, we have
^ ( ^ « - " ( œ - œ •)
(4
-
31)
Assuming, as i n Section 2.8, that χ = x / e (the optimal density for max› i m u m traffi c flow) and denoting v ( x / e) simply by v, we determine th e constants ¸ and t o be m a x
m a x
º =
vx μ = - i a s f i, e l
,
(4.32)
where e = e x p ( l) = 2.718. On writin g z (f ) as th e sum of the equilibriu m displacement (,•(*)» given by (2.97), and a perturbatio n displacement φ ft), substitutin g int o (4.30), and using (4.32), we find (Exercise 4.4) that th e differential-delay equations for the perturbatio n displacements are ;
άφ, .
(
+
dt
)
i’ln{ i + 5ffi(*Wi)-.W)>} ,
lir f K - i W - * , ( * ) } . (
(4.33)
i f ^ ( o < ^ _ , ( 0. < - > 4
I n view of Exercise 4.4(H), th e expression for exceeds that given by (4.34) i f _ 0 . 6 32 < *
ifW>4-,<0;
άφ^ί + r)ldt given
4 - I - ’ J > < o.
34
by (4.33)
(4.35)
Equations ( 4 . 3 3 M 4 . 3 4) were discretized and solved for a platoon of 10 cars, as described i n Section 2.8 for equations (2.105). I used the same perturbatio n displacement for the leading car as in Fig. 2.9 and th e same = 13/1056 as were used in parameter values d = 65, = 88/3, and x /e th e earlier model. Thu s (4.35) became mix
- 5 1 . 3 < ^ _ , - ^ < 0.
(4.36)
I f you completed Exercise 2.19, then a simple modification of your com› puter program wil l enable y ou t o d o thi s for yourself. Th e results for ˜ = 0.15 and τ = 0.15 are shown in Fig. 4.4 as th e solid graphs. Th e
140
Chapte r 4
Validation : Accept , Improve , o r Rejec t
*
t
Fig. 4.4 Restoration of equilibriu m for a platoon of 10 cars in a tunnel. The dashed curves are identical to those of Fig. 2.10. The solid curves are predicted by the model of (4.29). Scales are as in Fig. 2.10.
dashed ones, for comparison, are those of Fig. 2.10. Th e strong upward curvatur e of the solid curves durin g the accelerative phase is a symptom of (4.34), i.e., of acceleration being independent of spacing between cars. Notice that the solid curves always dip below the dashed ones when they first depart fro m them. Th e reason is that when driver j first reacts t o driver j - 1» Φ]-1 < 0 and φ = 0, in such a way that (4.36) is satisfied. Then (4.33) yields a less negative slope than (4.34). Th e results for ˜ = 0.15 and τ = 2.25 are shown in Fig. 4.5 as the solid graphs. Th e dashed ones, for comparison, are those of Fig. 2.11. Th e eighth car collides wit h the seventh one after only 26.25 seconds (210 tim e units), much sooner than a collision occurs in Fig. 2.11. Th e effect introduced by (4.29b) is clearly a destabilizing one. A selection of points is labeled in Fig. 4.6, according t o whether the point s are stable or unstable. A s in Section 2.8, a square denotes stability , }
4.7
Th e Stabilit y of Car s In a Tunne l
141
Fig. 4.5 Instabilit y of a platoon of 10 cars when ˜ = 0.15 and τ = 2.25, for first 30 seconds following perturbation . The dashed curves are identical to those of Fig. 2.11. No collision has yet occurred. The solid curves are the predictions of (4.29). The eighth car collides with the seventh after 26.25 seconds. Scales are as in Fig. 2.11.
a dot instability , and jln indicates that the yth car collided wit h the car in fron t of it after «/8 seconds. A tentative stabilit y boundary τ = τ (Δ) is drawn as a solid curve. Th e dashed curve, for comparison, is that of Fig. 2.12. Once again, the effect of (4.29b) is seen t o be a destabilizing one. But is thi s a genuine improvement? How do driver s actually drive according t o (4.28), according t o (4.29), or according t o neither of these? I n th e absence of hard data, the best we can do is to compare the predictions of (4.28), namely, Figs. 2 . 1 0 - 2 . 1 2, wit h those of (4.29), namely, Figs. 4 . 44.6, and use our personal experience t o guess which pictur e is a fairer one of reality . Perhaps you would lik e t o pursue thi s matter and obtain some data (though thi s wil l be far fro m easy). I t is even possible that one model describes driver s in, say, Boston, and the other describes driver s in N ew €
142
Chapte r 4
Validation : Accept , Improve , or Rejec t
3;
Ø 0
1
1
1
1
1
0 .2
0 .4
0 .6
0.8
I.O
k
. ˜
Fig. 4.6 Tentative stability boundary (solid curve) in the Δ - Γ plane for the model of (4.29). The dashed curve is identical to that of Fig. 2.12.
York . But we now at least have a rational basis for accepting one model and rejecting the other (or rejecting both), even though, withou t th e data, we cannot actually make that choice. Therefore, as good scientists, we can conclude only that the matter remains open t o question. On a real highway, of course, both τ and L would be functions of/’, but such complexity could not usefully be embodied in a deterministic model. We would expect, however, that such variation s make a real highway even mor e unstable than our models predict, and that a collision is likel y if any drive r (except the first) has a slower reaction tim e than r ( A ) . Individua l values of τ are utterl y beyond the control of traffi c police, and so they must endeavor instead to keep ˜ as close as possible t o zero, i.e., t o ensure that th e stabilit y region i n Fig. 2.12 or Fig. 4.6 is as high as possible. It’ s no wonder that police are so much in evidence in N ew York’ s tunnels, urgin g traffi c t o maintain equilibrium ! c
4.8
Th e Fores t Rotatio n Tim e
I n Exercise 3.14, we considered the effect of reducing a forest rotatio n pe› rio d by a unit of time, fro m t = s + 1 to t = s. We found that the forester’s loss fro m unrealized tree growth would be approximately V"(s) ; whereas her gain fro m alternativ e investment would be approxi› mately 6V(s). Thus, according to Section 3.4, it is too soon to harvest if 8
*Before proceeding, you may wish to review your solutions to Exercise 3.9 and 3.14.
4.8
Th e Fores t Rotatio n Tim e
143
V, (i ) > 6V{s), and too late to harvest if SV{s) > V'(s), but if
(s) =
(4.37)
6v\s)
then the harvest time, s, is exactly right . I n thi s way, we have derived an intuitiv e marginal interpretatio n of the optimalit y condition, namely, that the best tim e t o harvest is when the incremental loss fro m denying th e trees a littl e more growth is exactly cancelled by the incremental gain fro m alternativ e investment (money deposited in a bank). Th e fact that thi s marginal analysis is far fro m rigorou s is without consequence , because rigorou s derivation of the optimalit y condition (4.37) is provided by the analysis of Section 3.4. (An alternativ e verbal expression of (4.37) is that th e specific growth rat e of forest value is equal t o the specific growth rat e of alternativ e investment value, and that the forest should be cut as soon as the former specific growth rat e ceases t o exceed the latter . Although thi s latter interpretatio n requires no approximation for it s derivation, it is much less useful than the one we have chosen to use.) But a moment’s reflection reveals that (4.37) is inconsistent wit h our assumption that the forester always was, and always wil l be, a forester. By comparing V\s) wit h 6V(s), we balance an incremental loss fro m one generation of trees against an incremental gain fro m the same generation of trees an d forget about all futur e generations! If the forester’s land were to become worthless after the harvest, then (4.37) would indeed be correct, but the land does not become worthless, because the forester plants new trees. Then the new seedlings wil l have acquired value, say ) , withi n the interval fro m t = s to t = s + I, and the forester should add thi s incremen› tal gain to 6V(s) in her marginal analysis of the decision to harvest. Thus s is too soon if V'(s) > 6V(s) + e(s) and too late if V\s) < 6V(s) + e(s), but s is just right if V'\Xs)-sns)= (s).
(4.38)
(
I t is easy t o verif y that the optimal rotatio n tim e predicted by (4.38) is shorter than that predicted by (4.37); see Exercise 4.5. To determine e precisely, suppose that our forester harvests her forest every s years, i.e., at times t = js, j = 1, 2, and replants, of course, immediately. Then between t = (j - l)s and t — js the forest wil l acquire (real) value V{s), independently of the value of j , if we assume that (real) costs and prices are constant and the biological growth mechanism is in› e~ ' \\s), dependent of time. Hence the present value of the ;t h harvest is and the present value of all harvests, fro m now unti l eternity, is 6 s
As)=
OO
β-* 7=1
m
=
00
ns) X > - V = 4
7=1
(4.39)
144
Chapte r 4 Validation : Accept , Improve , o r Rejec t
on summing the geometric series. Th e quantit y f{s) is known by foresters as th e value of the land. A more complete description would be the value of th e land for forestry, because the possibility of using the land for alternativ e ends is not entertained. Notice, however, that the attractiveness of such alternativ e investment (followin g th e next harvest) increases rapidl y wit h 6, since th e rati o of the value of the first cuttin g t o that of the land (for forestry) is r"V[s)tJls) = 1 - e~ . I t is straightforwar d (Exercise 4.6) t o show that (4.39) has a maximum at s - s*, where 6s
* V ) = W ) + $ / (A
(4.40)
provided V"{f) < 6V'(f), which i s tru e i n particula r i f V'(s*) > 0 and V"(s*) < 0. Comparing (4.38) wit h (4.40), we have e(s) = 6f(s). Moreover, th e marginal interpretatio n of the opening paragraph of thi s section can be made valid again i f we interpre t the incremental gain fro m alternativ e investment as includin g not only the interest that would accrue fro m selling th e w o od but also the interest that would accrue fro m selling the land itself (for forestry). I n applying our new optimalit y condition, it i s convenient t o define
W=y$y
<· > 4 4Ι
Then (4.40) becomes 1 - e~ ' \ ; 6s
0(s*)=
whereas the condition for a maximum, i.e., V"(s*) < 6V'(s*), 0'(s') + se(s')>
(4.42) becomes (4.43)
I.
For a typical stand of Douglas fir trees i n Britis h Columbia, values of V were given in Exercise 3.9. I n that exercise, by assuming that ( K r + 5) + \\t - 5))/2 w V{t) and (V\t + 5) - \\t - 5))/10 r* V'(t), we obtained th e estimates of V, V, and θ given i n Table 4.1. Notice that V"(t) appears t o change sign between t = 65 and t = 85. Thi s doesn’t seem quit e right , and we suspect that more refined methods are needed t o estimate adequately K’(75) . Therefore, when joinin g th e corresponding point s (r,0) in th e t-Q plane by a dashed curve, we have ignored th e data point at (75, 37.5); see Fig. 4.7. Th e solid curve i n Fig. 4.7 i s th e graph of (1 - e~ )/6, for δ = 0.05. Thi s meets the dashed curve where t = s" « 6 3. I t appears fro m th e diagram that θ(ΐ) > 18 and that B'(s*) a 0.8. Thu s e'(s*)+Se(s*)« 1.7, implyin g that (4.43) i s satisfied. W e now deduce fro m (4.42) that, when th e real interest rat e i s 5%, th e optimal rotatio n period is about 63 years. A s remarked above, thi s is shorter (by about t w o years) than th e value obtained in Chapter 3. Moreover, our estimation of s* i s clearly unaffected St
4.8
Th e Fores t Rotatio n Tim e
145
Table 4.1 Values of V, V and Θ, denned by (4.41), as used to determine optimal rotation period. t
W)
V'{t)
0(0
t
no
v'(t)
θ(ί)
35 45 55 65 75
21.5 93 223 400 573.5
4.3 10 16 19.4 15.3
5.0 9.3 13.9 20.6 37.5
85 95 105 115
727.5 859 956.5 1037.5
15.5 10.8 8.7 7.5
46.9 79.5 110 138
by the ignored data point. Let us therefore expend no furthe r energy on our suspicion that V'(T5) has been poorly estimated. Th e same method can readil y be used t o determine i* for any other value of 6. Th e optimalit y condition (4.40) is certainly an improvement upon (4.37), but the question posed in Chapter 3 has not been answered. D o es (4.40) determine when a forest should be cut? H ow can we test our model? Thi s raises a most importan t question concerning what is testable and what is not, and tw o remark s are in order. First , the choice of utilit y function in an economic problem is a task for moral philosophers. We did not use data to decide that a forester should maximize present value, as opposed t o some other quantity ; we simply
Fig. 4.7 Graphical determination of optimal rotation period for a stand of Douglas fir trees.
146
Chapte r 4
Validation : Accept , Improve , or Rejec t
accepted the prevailin g opinion among practicin g economists (you may challenge this, but not withi n the framework described at the beginning of thi s chapter). Second, as we stated long ago in our AB C of modelling, mathematical deductions fro m given assumptions are not (or should not be) open to question. Mathematics does not lie. Thus, if real prices are constant, if all trees are identical, if a forest is felled and replanted in an instant, and if all other effects which our model neglects are trul y negligible, then there is no question that (4.40) provides the optimal rotatio n period. I n brief , we cannot use data to test the trut h of either the utilit y function or the solution t o the pur e mathematical problem. W e must use data, however, to test the trut h of our assumptions that prices are constant, that trees are identical, that harvesting and replant› in g are instantaneous, and that other effects may be ignored; and it wil l not surprise you to learn that all four assumptions are doubtful for most forests. Indeed the forest rotatio n problem is both more controversial and mor e complicated mathematically than befits furthe r discussion in a gen› eral work on mathematical modelling. We do relax the assumption that all trees are identical in Sections 5.8 and 9.2, but the reader who wishes t o study these matters in depth is referred t o the literature .
4.9
Cro p Sprayin g
Accordin g to Plant (1985, p. 5), a cotton grower in the San Joaquin Valley adopts the followin g strategy in attempting to control the spider mite. Every tim e she measures the pest population, the grower compares the cost of applying pesticide at the maximum level allowed by law wit h the projected cost of crop damage if no pesticide is applied. If the latter is greater than the former , then the grower applies the maximum allowable amount of pesticide. Can we use thi s informatio n to test the model we proposed in Section 3.6? Let’ s make the assumption that, by virtu e of experience (i.e., tria l and error) , what growers do is also what is optimal. Then, if the strategy they adopt agrees wit h the prediction of our model, we wil l accept our model, at least for the tim e being, on the grounds that we have as yet no reason t o reject it . I f the strategy they adopt disagrees wit h our model’s predictions, however, then we wil l have to decide, by other means, whether the fault lies wit h the assumption that growers do what is optimal, wit h (3.54), (3.56), or (3.61), or even wit h some other assumption. Now, in the notation of Section 3.6, the growers’ strategy is 9
Spray if Don’t spray if 9
J[f,
0) > c + c, U 0
mix
, 0) < c + c, U . 0
You may wish to review Section 3.6 before proceeding.
mn
(4.44) (4.45)
4.9
Cro p Sprayin g
147
I f (4.44) is satisfied then the grower sprays wit h concentration i / . We wil l denote the tim e of spraying by j * , on the assumption that when growers spray is also when it is optimal (but remember that As, 0) is independent of s). Because/(i*, t / ) exceeds c + c, U , (4.44) may be satisfied i n one of tw o ways: either m a x
m a x
0
max
< y ( >\ 0)
… + Ci U
<
c +c U
< As', 0) < As', U J.
max
UJ m
(4.46)
or 0
{
maK
(4.47)
m
I f (4.46) holds then (3.65) i s satisfied wit h U = C / ; whence, fro m (3.70) and (3.71), the growers’ strategy is the same as our model’s if m
max
>^---W .
(4.48)
Let’ s assume that (4.48) holds. Then, because U* = C / , the right-han d side of (4.37) is less than/fa* , U*). Therefore, fro m (3.44), (4.45) agrees wit h our model also. Our model is thus i n complete agreement i f max
1. (4.48) is tru e and 2. (4.48) implies that (4.47) i s impossible.
(4.49)
To show that (4.47) cannot hold we must show that W(q) i s negative; - U ) implies that i.e., that ξ > e x p ( t / m ax
0
*(£)== t / + « - +
(4.50)
0
is a decreasing function for ξ > 1 (and ξ > i s negative. Because e x p ( C / - U ) implies ξ > 1), ( ) wil l certainly be negative i f * ( e xp {U - U }) is negative; or, upon rearrangement, max
max
0
0
CU +a^ + K ^ c,
-
1
^
• c.
(4.51)
Mor e generally, if we define A
=
^
r
(
W
i
W
( 5 2) 4 -
(
then (4.49) is satisfied i f ^max + ~
+ 1 + In º < º ^ • » -
u
\
º > 1.
(4.53)
Th e greater the value of º i.e. , i n view of (4.37), the more valuable the crop or the more destructive the pest th e more easily that (4.53) is sat› isfied.
148
Chapte r 4
Validation : Accept , Improve , o r Rejec t
I n summary, if (4.53) holds, then the only piece of data we have is consistent wit h our model. I f (4.53) holds, then we have no reason t o reject th e model, at least unti l more extensive data enable us t o apply a mor e stringent test. But does (4.53) hold? M y guess is that pb is probably large enough t o ensure that it does; but I don’t actually know, and perhaps thi s i s a matter you would lik e t o pursue.
4.10
How Righ t Was Poiseuille ?
I n Section 2.6, we constructed a model for the flow of water through a pipe wit h an arbitrar y elliptical cross section. Because the circl e is a special case of the ellipse, thi s model should at least be able to explain the flow of water through a circular pipe. Let’ s use thi s fact to test our model. 10
Let Oxyz be an orthogonal Cartesian coordinate system, wit h Oz along th e symmetry axis of the pipe. Then recall, fro m (2.70), that our model predict s the flow velocity in the direction of Oz, at station (x,y), t o be
* > » - ^ y
&
( ’ - ? - $ )•
««*>
where a b, are the semi-axes of the ellipse and
i s the constant (adverse) pressure gradient that drives the flow. Let our circula r pipe have radiu s a, and let r = y/x + y . Then, on setting b = a i n (4.54) and using (4.55), we find that th e flow velocity at radiu s r withi n th e pip e is given by 2
2
Th e maximum velocity w
^
= ~TpYz
( 4
·
5 7 )
occurs at the center of the pipe; whereas the average velocity is
« i Γ Jo *
w
=
r)rdrde
=
Hence, according t o the model of Section 2.6, we have
l0
You may wish to review Section 2.6 before proceeding.
(4
·
58)
4.10
Ho w Righ t Wa» Polseullla ?
149
and the flux of water along the pipe is
* = - w % " * " ~
( 4
'
6 0 )
on using (2.72). A s we remarked in Chapter 2, thi s last result is known as Poiseuille’s formul a (by some, and the Hagen-Poiseuille law by others). Experimental values of w(r) at ten different radi i are presented by Hansen (1967, p. 309) and plotted in Fig. 4.8. I f you plot (4.59) on the same graph then you wil l find that the agreement between theory and prac› tic e is excellent th e model fits the facts. Moreover, experiments by Hagen and Poiseuille themselves established that Q/a* was remarkabl y constant for water flowing through pipes of different radii , under th e same adverse pressure gradient; see, for example, Batchelor (1967, p. 181). I n all of thi s ther e is no reason at all to reject the model of Section 2.6. W e must accept it , however, subject t o (at least) tw o limitations . First , i f ζ = 0 is the entrance t o the pipe, then there is a region 0 < ζ < z , known as the entry region, in which (4.59) does not apply. To understand why, imagine that the pip e is inserted int o fluid flowing wit h constant velocity w , parallel t o the pipe. Then at ζ = 0 we have c
av
w=w
a v
,
0
(4.61)
i.o
0.5
Fig. 4.8 Experimental values of *ir)/w at 10 equally spaced radii for flow in a circular pipe. The sketch, based on a Ph.D. thesis by V. E. Senecal, is adapted from Arthu r G. Hansen, Fluid Mechanics, p. 309 by kind permission of the author (who now holds the copyright). max
150
Chapte r 4
Validation : Accept , Improve , o r Re]ec t
whereas for ζ > z we have w given by (4.59). Between = 0 and = z , the fluid velocity profil e must make a transition from the "flat " profil e of (4.61) to the "parabolic " profil e of (4.59). Thi s transition (by a mechanism known as boundary layer thickening) is indicated schematically in Fig. 4.9. The flow in the entry region is difficul t to analyze but the length of the region may be estimated (Hansen, p. 309) as c
c
z = 0.232a w ^ ,
(4.62)
2
c
av
where ρ is the density and μ the shear viscosity of the fluid. The wider the pipe or the faster the flow, the longer is the entry region. Second, and more fundamentally, we must recall our assumption in Section 2.6 that the flow in our pipe is in equilibrium . Now in Section 2.8 we saw an example of a dynamical system, namely, a platoon of cars, that was stable for certain values of the system parameters but not for others. Instabilit y set in when a certain parameter exceede d a critical value. Thi s also happens to flow in a pipe. For traffi c flow, the relevant parameter was r , the driver response time, and it s critical value was r (A). For flow in a pipe, the relevant parameter is c
β
˛
2o£Wjy ^
μ
and it s critical value, R , is about 2000. R, which is dimensionless, is known in fluid dynamics as the Reynolds number. Fig. 4.8 was obtained for a Reynolds number of 1094, well withi n the stable region; but for R > R the equilibriu m (4.59) cannot be sustained, just as (2.96) could not be sustained for > r. I f you wish to pursue the study of flow at Reynolds numbers above R , i.e., at supercritical Reynolds numbers, then you ought to begin wit h an introductor y text lik e Batchelor (1967) or Hansen (1967). We don’t have space to pursue it here. We have raised the matter merely to illustrat e that a model that is excellent for certain conditions may be quit e inadequate for others, because (4.59) provides an excellent description of subcritical {R < R ) pipe flow away from the entrance (z > z ) but is inapplicable either to the entry region 0 < < z or to supercritical flow. To put things another way, it is rar e that an assumption on which a model is based is valid without exception, and we should expect that the model may cease e
c
c
c
c
c
e
z=0
ΞΣΞΞΞΣ 0
Fig. 4.9 Schematic representation of transition to Poiseuille flow in the entry region of a circular pipe.
4.11
Competin g Specie *
151
t o provid e an adequate description of realit y as soon as the assumption ceases to be justifiable . I n the case of the entry region, for example, the assumption that ceases to be justifiabl e is that w is independent of z, as is clear fro m Fig. 4.9.
4.11
Competin g Specie s
W e have good grounds for believing that if an ecosystem consists solely of two species competing for the same food supply then, in the long run, only one species wil l survive. The other species wil l become extinct (or else migrate, in search of an alternativ e food supply). For example, The Economist of Apri l 26, 1986 reports, in a lively and informativ e article, "Th e rows behind ecology," that three kind s of parasitic wasps were once introduced to Hawaii to control frui t flies. Th e first established itself and brought the flies under control. When the second species was introduced, it drove the first one to extinction and assumed for itself the job of control› lin g the frui t flies. Later , the thir d species in tur n drove out the second one. Indeed the idea that only one of two competing species can survive has be› come enshrined in theoretical ecology as "Gause’s principl e of competitive exclusion," even though it was apparently never enunciated by Gause; see Maynar d Smith (1974, pp. 61 and 103). 11
Let x(t) and y(t) denote the population magnitudes, at tim e t, of the tw o competing species. Then it appears at first sight that (1.22), i.e., dx --ji l
u = «i -b y, t
idy -jj
= a -b x, 2
2
,
, (4.64)
where a\, a , b\, b > 0, might be an acceptable model of a competingspecies ecosystem, because, fro m Fig. 1.4, it predicts that species χ wil l prevail if (JC(0), y(0)) lies below ON, but species y wil l prevail if (JC(0), y(0)) lies above ON. But (4.64) also predicts that the survivin g species wil l be› come infinitel y numerous. Suppose, for example, that species χ survives and species y has been driven to extinction. Then y(f) = 0, so that (4.64) yields (Vx)dx/dt = a\, whence x(t) = x^&xpia^) grows without bound. In other words, our model assumes that one species wil l grow exponentially in the absence of the other. Now, although exponential growth may be a reasonable assumption in th e short term, it clearly cannot last forever. I n the long run , the growth of species χ must be limited , because it s food supply is distinctl y finite. Let us therefor e make the fresh assumption that, in th e absence of the other, each species would grow not exponentially but according t o a logistic growth 2
2
You may wish to review Section 1.5 before proceeding.
152
Chapte r 4
Validation : Accept , Improve , o r Rejec t
law, i.e., that, for some positive parameters c, and c , 2
1 dx x ^
=
a
> -
C
*
Idy y T t
>
X
=
' -
a
C
i
y
-
( 4
·
6 5 )
Thus, if /(= 1,2) represents the survivin g species, then it cannot become mor e numerous than Æ,/c, . Addin g the interaction term s t o (4.65), we are thu s led t o propose that (4.64) should be replaced by the model ^
=x(a
-c x-b y),
l
i
l
< •
%
4
j ; =
6 6 )
y(a -b x-c y). 2
2
2
Thi s is a dynamical system of the for m (2.12), wit h u(x,y) = x ( a, - c , x~b y) and v(x, y) = y{a - b x - c y). I t has equilibri a where u and both vanish, i.e., at points (x',y') such that u(x*,y*) = 0 = v(x*,y'). We exclude the unstable equilibriu m * = 0 = y* on the grounds that at least one species i s presumed t o exist, and so there are three potential equilibria : x
2
2
2
x' = 0,
y* = ^ ,
0|
x* = =i-,
(4.67)
y* = 0,
(4.68)
or (x*,y* ) is the intersection of the lin e pair L, :
cx + by
= a,
(4.69a)
L:
bx + cy = a.
(4.69b)
l
2
i
2
l
2
2
Because al,a2,bl,b2,cl, and c are all positive, the lines L and L in (4.69) must have positive intercepts on both axes in the - y plane. Thus there are four possible configurations, as depicted in Fig. 4.10, in which dots denote equilibria . I n (a) and (b) of Fig. 4.10, th e lines L , , L do not intersect, so that th e only equilibri a are at (4.67) and (4.68). I n (c) and (d) the lines do intersect, and there is therefore an additional equilibrium , where 2
{
2
2
C\C — o b\ 2
oo
2
i
2
— cc 2
i
Th e arrow s in the diagrams are a schematic representation of the direction of the vector dxldt in the various regions, in the first quadrant of the and the coordinate axes. These x - y plane, which are separated by L L are easily deduced fro m the observation that dxldt is positive below L zero on it , and negative above it ; whereas dyldt is positive below L , zero on it , and negative above it . Thu s solution curves always cross L , verticall y and L horizontally . Th e curve marked S in Fig. 4.10 (d) is a separatrix, lik e ON in Fig. 1.4, which solution curves may never cross. I f you sketch a U
2
u
2
2
4.11
Competin g Specie s
153
Fig. 4.10 The four possible phase-plane configurations for two competing species.
few trajectorie s by using a computer routin e such as D V E R K (Section 1.4), then you wil l discover that Fig. 4.10(d) is closer t o Fig. 1.4 than any of the remainin g three diagrams. Indeed Fig. 1.4 could be regarded as the special case of Fig. 4.10(d) in which the equilibri a at ( a , / c , , 0) and ( 0 , a / c ) have retreated along their respective axes t o infinity . A few minutes spent pondering these diagrams wil l convince you that, for arbitrar y initia l population magnitudes x{0) and ><0), the ecosystem approaches one of the three potential equilibria . The identit y of thi s steady state is determined by the signs of the numbers l and I , where 2
x
2
y
Th e dependence of the species’ destiny on I and l is recorded in Table 4.2. You can easily confirm , by the method of Section (2.2), that the attractin g equilibriu m is stable, and the other(s) unstable (Exercise 4.7). x
y
154
Chapte r 4
Table 4.2
Validation : Accept , Improve , o r Rejec t
Destiny of Competing Species as a Function of Interference.
Diagram
Sign of I
(b) (a) (c)
+
Sign of I
x
+
-
(d)
—
1
1
Τ
Τ
y
Steady state that attracts all solutions (a,/c,,0) (0,a /c ) (4.70) (a,/c,,0) if {x{Q),yiP)) lies below 5 ( 0 , e / c ) if (x(0), v(0)) lies above S 2
2
2
2
How do we interpret the quantities defined by (4.71)? It is clear fro m (4.65) that aj/ci is the capacity of the first species (as defined in Sec› tion 1.9); and Section 1.5 shows that a lb is the equilibriu m population when the species is assumed to have infinit e capacity. Although that equi› libriu m is unstable and would never be observed, it nevertheless represents the only level at which species χ could coexist wit h species y if both were assumed to have infinit e capacity. I f thi s level is less than a\lc\ then co› existence wit h species y would prevent species χ fro m reaching capacity; whereas if a lb exceeds ajc\ then the growth of species χ is more restricted in isolation than it would be if it were obliged to coexist wit h species y. Thu s I is an interference factor, being negative or positive according to whether species χ interferes more wit h itself than wit h species y, or vice versa. We interpret y similarly . 2
2
2
2
x
Now, if both I and I are negative, then the tw o species interfer e less wit h each other than they would wit h themselves; and can hardl y be said t o compete for a c o m m on food supply. Possibility (c) in Table 4.2 must therefor e be ruled out. I n all other circumstances, i.e., when at least one species interferes wit h th e other, (4.66) predicts that only one species wil l survive, and Table 4.2 specifies which. You might describe (a) and (b) as unfai r competition, in which case (d) would represent a fair fight, although it s outcome would still be determined by th e initia l strengths of the armies. Al l thi s is perfectly in accordance wit h Gause’s principle . We have therefore no reason t o reject (4.66), and unti l we are able t o apply a mor e stringent test, we tentatively accept the improved version of our model. x
4.12
y
Predator-Pre y Oscillation s
W e have two good grounds for believing that if a carnivorous predator feeds solely on an herbivorous prey, then both populations may oscillate forever. The first ground is conceptual. I f there are many prey but few predators then the predators wil l have an abundant food supply and their 12
You may wish to review Section 1.4 before proceeding.
12
4.12
Predator-Pre y Oscillation s
155
numbers wil l grow, at the expense, of course, of the prey. Th e consequent decline in the numbers of prey wil l choke off the food supply of th e more abundant predators, many of whom wil l die of hunger. Th e smaller preda› tor population that results wil l have a smaller demand for food, giving the prey population an opportunit y to recover, but now there are many prey again, which is where we began. Th e second ground is empirical. Such predator-pre y oscillations have actually been observed in nature. Th e most famous example concerns the lynx and the snowshoe hare of America’s norther n coniferous forests, whose populations fluctuate wit h a period of about ten years; see Messenger (1980, p. 1046). I f x(t) and y(t) denote, respectively, the magnitudes of the prey and predator populations at tim e t, then such a cycle of growth and decay would appear as depicted in Figs. 1.2 and 1.3. At first sight, therefore, it seems that (1.20), i.e., \dy -
y 7 R
= -a
, 2
+
b x, 2
(4.72)
where a a , b ,b > 0, might be an acceptable model of a predator-prey ecosystem. But, lik e (4.64) above, the model (4.72) embodies the assump› tio n that species χ (here the prey) would grow exponentially in the absence of the predator (y = 0), and we have just agreed that thi s is not a sound assumption. N o matter how much vegetation there may be t o eat, crowd› ing and disease are bound t o ensure an upper limi t t o the capacity of the land, no matter how large that limi t may be. Let’ s call it 1/e, where we have i n mind that e is a small number. Before we consider any furthe r whether (4.72) is acceptable or not, we must at least correct thi s one defect. Let’ s therefor e assume that, in the absence of predators, the growth of the prey population would obey the logistic equation of Section 1.9. Thu s lt
2
{
2
(4.73) Thi s is just (1.63) wit h R = a, and Κ by the dynamical system
\k.
We therefore replace (4.72)
(4.74) We propose thi s as an improvement to our model. N o te that, because the prey capacity 1/e must exceed all actual prey population levels, it must in particula r exceed the level a lb at which, according t o our old model (4.72), the prey could coexist wit h the predator in static equilibrium . Thu s 2
2
(4.75)
158
Chapte r 4
Validation : Accept , Improve , o r Rejec t
A typical solution of thi s pair of ordinar y differentia l equations, ob› tained as in Sections 1.4 and 1.5 by numerical approximation, is repre› sented in the χ - y plane by the spiral shown in Fig. 4.11. Th e curve is actually drawn for x(0) = 1 = y(0) and parameter values a, = 4, a = 3, b = 2, b = 1, and e = 1/30; but for any other initia l population levels x(0) > 0 and y(0) > 0, and for any other values of a a , b b , and e satis› fyin g (4.75), th e solution curve would still spiral in toward th e stable focus 2
t
2
lt
2
u
2
(4.76) Wher e are the cycles of Fig. 1.3? They have disappeared! Herbivorou s species have been observed to coexist wit h carnivorous ones in apparently static equilibrium . Examples concern the Rocky Moun › tai n lio n and mule deer, and the wolf and caribou i n Alaska (May, 1976c, p. 55). Such simple ecosystems might well be described accurately by the model (4.74). But (4.74) cannot represent the kin d of interaction that de› termines th e population cycles of th e lynx and hare in Canada; i.e., (4.74) i s not an acceptable model of that particula r predator-prey system. More › over, the cycles of Fig. 1.3 are absent fro m (4.74) for any positive value of e, however small. I n other words, the addition of a small quantity , namely, - ˇ, , t o the right-han d side of one of th e equations (4.72) has a drastic effect on the topology of the phase-plane, because the equilibriu m x* erupts (or "bifurcates" ) fro m a metastable center int o a stable focus as e becomes positive. Thi s is easily deduced by the methods of Section 2.2, because the quadrati c equation (2.19) for the system (4.74) is found (Exercise 4.7) t o be 2
(4.77)
y
4
3
2 U ,y ) 0
0
0
2
3
Fig. 4.11 Form of solutions to (4.74).
4
5
6
7
4.13
Sockey o Swings , Paradigms , an d Complexit y
157
For e = 0, the roots of (4.77) are purely imaginary, so that x* is a center, by (2.21); whereas for small positive c the roots are complex, wit h negative real parts, so that x* is a stable focus, again by (2.21). Whenever the phase-plane topology of the dynamical system ^
= tKx,y),
% = ^y) v
( • 7 8) 4
is different fro m that of the dynamical system ^
= u(x, y) + ia(x, y),
^
= v(x, y) + tb(x, y)
(4.79)
for arbitraril y small t, we say that (4.78) is structurally unstable. I n terms of Chapter 2’s mythical land of Phaseplane, it means that a slight change i n the mechanism that determines the wind pattern, while the wind is still blowing, wil l drastically change that pattern. Thu s the concept of structura l stabilit y is fundamentally different fro m those we discussed in Chapter 2. It applies t o the mechanism of a dynamical system; whereas earlier concepts applied t o the destinies of the entities which that mechanism governed. Structura l stabilit y is also much more difficul t t o treat mathematically and is well beyond the scope of thi s book. Fortunately, however, the only re› sult we need t o proceed is that dynamical systems that lead t o metastable cycles are always structurall y unstable; whereas those that lead t o limi t cy› cles are not. Biological systems are constantly subjected t o changes in the mechanism that governs their evolution and so any population cycle that is actually observed must surely be a limi t cycle, because it would not persist if it were not associated wit h a structurall y stable dynamical system. Our predator-prey model is unacceptable. But we have also stumbled upon a test that any acceptable model is obliged t o pass: it must give rise t o a limi t cycle. We wil l discuss such a model in Chapter 10. Meanwhile, tr y Exercise 4.14.
4.13
Sockey e Swings , Paradigms , and Complexit y
W e now consider circumstances in which, as an interi m measure, we are obliged to relax our criteri a and consider models that cannot be tested. W e said at the beginning, and we’ll say it again, that the ultimate test of a model’s wort h is often it s abilit y to predict observable data. But nature is complex, wit h so many variables, that all essential characteristics of many natural phenomena can be captured only by a sophisticated model, one that is synthesized fro m many components. We do not expect that some of the components wil l explain observable data without the others, for that would impl y that the others were redundant anyway; but without 13
You may wish to review Sections 1.8 and 2.4 before proceeding.
158
Chapte r 4
Validation : Accept , Improve , o r Rejec t
th e components, the full y integrated model wil l never be constructed, and hence never tested. We are thus obliged t o develop models that cannot themselves be tested, on th e understanding that th e final product wil l be tested eventually. I f it fail s thi s test, we must then decide which components are fault y and how to replace them. Thi s would be a poor policy for an engineer to adopt; but natur e does not allow controlled experiments in her laborator y and so it is frequently the best that a mathematical modeller of natural phenomena can do. Thi s shouldn’t take you completely by surprise, for we broached the idea earlier, in Sections 4.3 and 4.6, when we spoke of several generations of predictions. Moreover, in certain circumstances, we are even obliged to develop models that wil l never be tested at all, as i n the controversy over the nuclear arms race. At least, we fervently hope that such models wil l never be tested. Th e salmon model of Sections 1.8 and 2.4 can be regarded as a model component that cannot, itself, be tested, because all available data wil l embody the age structure, environmental variability , and interactions wit h other species (includin g man!) that the model simply ignores. Nevertheless, ther e are indications in th e scientific literatur e that our model component may prov e to be a useful one. According t o Ricker (1954, p. 592), the ap› propriat e unit of tim e in the metered model of Section 1.8 is about four years for a certain lineage of sockeye salmon on the Fraser river in Canada. These salmon are supposed t o have been much less plentifu l in 1909 than i n either 1905 or 1913. Could thi s have corresponded to a period-2 cy› cle such as the one suggested by the thir d column of Table 1.2? Th e evi› dence in favor includes the fact that the percentage exploitation of those salmon by the fishery was low at the time. Fro m (1.53) and Section 2.4, a period-2 limi t cycle could occur only if the percentage exploitation were low enough to keep the parameter r = \n(ya) above 2, where 7 denotes the fractio n of young salmon survivin g t o breed and a the number of eggs laid by a female for each existing member of the population. Low percentage exploitation would have made it possible for 7 t o exceed 7.389/a durin g th e early part of thi s century. Durin g the middl e of the century, however, exploitation was high enough t o keep r below 2 (or ª below 7.389/a) and ensure that no swings would be observed. Th e latter is a liberal but nev› ertheless accurate translation of Ricker’ s statement (p. 592) that "unde r present conditions the fishery normall y takes enough t o keep the spawn› in g stock near th e dome of the curve." (I f you want t o know which curve, read the paper.) But the salmon model may also be regarded as a paradigm, i.e., a simple model that isolates and explores the consequence s of a particula r idea. Viewed in thi s way, the model’s simplicit y is it s greatest strength. Suppose, for example, you had the idea that the best way t o preserve a species was t o hunt it in small quantities. How could you test thi s idea? One way would be to apply the model of Section 2.4. According t o thi s
4.14
Optima l Fleet Size and Highe r Paradigm s
159
model, if exploitation is high enough t o ensure r < 2, then the stock of th e species wil l remain in equilibriu m at a moderate level. I n particular , it wil l never reach a low level. But if the species is hunted only in small quantitie s then r may be much larger than 2, implyin g that the stock wil l swing back and fort h between low levels and high levels. Now, suppose that the species is afflicted one year by pathological doses of pollution , disease, or natural catastrophe. Under which circumstances is the species most likel y t o survive i f the stock level is guaranteed t o be at least mod› erate, or if the stock level is guaranteed t o be at least low? Because we cannot arrange for catastrophes t o occur when the stock is abundant, I’ m sure you’ll agree that the species is better off if r < 2. Low levels of ex› ploitatio n do not necessarily help to preserve the species (it would depend upon whether r fell below 2 even withou t human intervention). Thu s the trut h of your idea, as captivating as it sounds, is seen t o be in doubt. D o you believe that you would have realized thi s without the help of a paradigm? I t is no coincidence that the salmon model may be regarded either as a component or as a paradigm, for the tw o are closely related. A model component is an attempt t o capture one (or more) essential characteristics of a complex phenomenon; a paradigm is an attempt t o isolate one (or more) particula r idea; and the foundations of even the most sophisticated models are ideas. When the idea is testable, we call it an assumption. When, as here, it is merely explorable, it simply remains an idea. A good idea now might be t o tackle Exercise 4.8.
4.14
Optima l Fleet Size and Highe r Paradigm s
Th e dual view, that a nontestable model may be regarded either as a paradigm or as a component of a later, testable model, applies in par› ticular to Section 3 . 7 . The number of components in a mathematical model depends, of course, on how you look at it; but a possible view is that the fleet size model has two components, a biological one and an eco› nomic one. In the hierarchy of complexity, therefore, it enjoys a higher station than the model discussed in the previous section, which is purely biological. Stretching the dual relationship to it s very limit s now, we might expect the fleet size model to be the kin d of paradigm that would let us explore not a single idea but the interrelationshi p between two a higher paradigm, as it were. 14
One idea, which some people believe, is that you should liv e for today, on the grounds that tomorro w may never come. I f it does come, however, then you might wish that you had prepared for it, which is why some l4
You may wish to review Section 3.7 before proceeding.
160
Chapte r 4
Validation : Accept , Improve , o r Rejec t
people say that you should liv e for tomorrow . W h o is right ? As we dis› cussed toward th e end of Section 4.8, a mathematical model could never answer such a question. What it can do, however, is t o provid e a con› ceptual framework for assessin g the implication s of tw o conflictin g view› points, and, mor e importantly , of the whole spectrum of viewpoints that li e between. So consider the woman who lives for today. H ow would you convince her t o put her money in a bank? N ot by offerin g her 10% inter › est, or 20% for that matter, because she is far too worrie d that she won’t be around t o enjoy the income. Th e only rat e that might tempt her t o put her money in a bank would be <x>%. N ow consider th e woman who lives for the end of th e next millennium . She’s so sure she wil l still be around that she would accept a (real) interest rat e of 0.001% or so, be› cause she can still nearly tripl e her money. Indeed if she felt that it was wort h paying so much a year for th e safekeeping, then she would proba› bl y accept an interest rat e of zero. Here are the extreme viewpoints. Th e woman who lives for th e far distant futur e is modelled by δ = 0. Th e woman who lives for th e here and now is modelled by δ oo. Most of us mortal s li e somewhere in between, in the spectrum 0 < δ < oo, th e great iron y being that δ probably decreases wit h age. (When Hurri › cane Kat e swept through Tallahassee in November, 1985, she destroyed th e oak tree of an 84-year-old neighbor of mine. Next day he removed i t and planted a new one.) I n thi s section, we wil l refer t o δ as the discount rate. Th e new terminology merely reflects a change of emphasis. When δ was used t o measure th e lucrativeness of alternativ e investment, we called it the (real) interest rate, but when using 6 t o measure the de› gree t o which the futur e is ignored (or "discounted") , we shall call it the discount rate. Let’ s now assess the implication s of concern about th e futur e for the fishing fleet of Section 3.7. Th e optimal number of boats, as a function of δ, is given by (3.89):
b+
W( -*) "}
(4.80)
> 0;
(4.81)
,+t
!+
Thus, because b < 1,
JiJi-l + lbY + Wl-b) also U'(0)
=
W-b) 2q
(4.82)
4.15
and
On th e Advantage s of Flexibilit y In Prescriptiv e Model s
161
15
C/*(oo) =
R{i-b)
(4.83)
You can see immediately fro m the profi t expression (3.87), i.e., fro m (4.84) that the sole owner of a fishery who lived purely for today would driv e it t o a state of zero profi t {after her huge salary had already been included as part of costs (3.74)!); whereas the sole owner who lived purely for her great grandchildren’ s great grandchildren would maximize sustained profit , ensure that the fish stocks remained above the level of maximum sustain› able yield, and thus be very popular wit h the conservationists in Exer› cise 3.16 (where sustained profi t and sustained yield are defined). Because U*'(8) > 0, moreover, the more that the owner cared about the future , th e fewer boats she would use and the higher the stock level that would be maintained. Even in Western democracies, fisheries can be viewed as having a sole owner, namely society. If we could only agree on a suitable value for δ then models lik e thi s one might help to determine a system of licensing laws that would keep exploitation at the optimal level. Naturally , many components would need to be added to the model, because the oceans are roamed by many boats in search of many species, wit h many breeding cycles and as many selling prices; and all are vulnerable to unexpected environmental shocks. The problem of developing a theory of conservation of natural resources is such a difficul t one that, at the tim e of writing , relatively few components have been added by anyone to the model of Section 3.7 (see Clark , 1990). Yet as difficul t as the modelling sounds, the really tough prob› lem is still that of getting society to agree!
4.15
On th e Advantage s of Flexibilit y In Prescriptiv e Model s
We close thi s chapter by addressing a question we posed at the end of Sec› tio n 3.2, where we were tryin g to decide how big a pay increase a professor should receive. Instead of asking whether our linear programmin g model fitted the facts, we wondered whether anyone might use it . Wh y did we suddenly change our criterio n of relevance? 15
Use the fact that lir a \x - y/(C - x) + Ax) = li m 2
for any constants A and C.
(2C - A)x χ + V( C -x) 1
C +Ax 2
162
Chapte r 4
Validation : Accept , Improve , o r Rejec t
Th e answer lies in the purpose behind the model. Th e models we en› countered in Chapters 1 and 2 were descriptions of natural or social phe› nomena, i.e., attempts t o say what things or people do do, in the active sense of the verb. By contrast, the flight model of Section 3.1 was an at› tempt t o say what a bir d should do, i n the modal sense of the verb. I f we believe that what bird s do is also what is optimal by virtu e of tria l and error , then our fligh t model is essentially also an attempt to describe a phe› nomenon. But bird s have migrated for thousands of years. They’ve had all that tim e t o solve their problem, and no one has ever pressed them for an answer. Administrators , on the other hand, have generally had littl e ex› perience of the problems they currentl y face, yet are expected t o prescribe solutions withi n a relatively short period of time. They must therefore short-circui t the process of tria l and error by imagining what people would do, in the subjunctive sense of the verb, if certain actions were taken, then consciously select fro m among those actions the one that seems most desirable. Suppose, for example, that our chairperson is worrie d about her de› partment’ s research rating . She may imagine that her faculty would im › prov e the qualit y of their research if she took the action of raising the payment for a unit of research achievement. Fro m many such actions, she may consider it most desirable t o select th e one that maximizes that pay› ment, subject t o certain constraints. Suppose that her action fail s t o achieve it s intended goal, perhaps because faculty are still devoting too much tim e t o service. What wil l she do? She wil l tr y t o imagine what different actions would achieve, then select fro m among those different actions the one that seems most desirable. She may, for example, consider lowering the pay› ment for a unit of service achievement. Fro m many such actions, she may now consider it most desirable t o select the one that minimizes that pay› ment, subject t o the same constraints as before. Moreover, she may not have the tim e or energy t o thin k through the entir e problem, whenever it appears that a change of policy is required. Then what she needs is a flexible model, one easily altered t o suit the needs of the moment. Th e greater her model’s flexibility, the greater it s usefulness. I f you did Exercise 3.5, then you wil l probably agree that the model we developed in Section 3.2 is indeed a flexible one. Provided they remain linear, the constraints and utilit y function in the linear program (3.20) may be changed at almost a moment’s notice, simply by redefining the matrices A , b, and c. Moreover, a moment later, ZX3L P wil l be just as happy t o reveal the new optimal control (or tell you that no control is feasible). W e have said already that, in managing society and it s resources, the choice of utilit y function lies outside the scope of the philosophy set fort h at the beginning of thi s chapter. I n a democratic nation or institution , that choice is made by political debate, whether at the national level or at the grass-roots level. In a dictatorship, of course, it is made by decree. I n these
Exercise s
163
circumstances, constraints are likewise political choices. Our chairperson’s budget, for example, is (at least indirectly ) the result of a vote in the state legislature. Whenever a model is prescriptiv e rather than descriptive, i.e., whenever a model attempts t o predict what should be done rather than what is actually done, abilit y t o explain facts is no longer a suitable criterio n of worth . There are no facts t o test such a model! A descriptive model is concerned wit h the past or present, a prescriptiv e model wit h the future ; and, as Benjamin Frankli n once wryl y remarked, the only certainties about th e futur e are death and taxes. Withou t certainty, there are no facts. W e should emphasize here that all prescriptiv e models have descriptive elements. For example, the manager of our fishing fleet assumed that the logistic law would describe futur e growth of fish stocks in the absence of harvesting. But even these descriptive elements are untestable, except by virtu e of waitin g and using hindsight. A decision maker must use foresight, however; she cannot wait for the futur e to happen. I f fitting the facts is no longer relevant, how do we measure the wort h of a prescriptiv e model? That raises a controversial issue. I thin k it fair to say that there is no widely accepted criterio n of wort h for prescriptiv e models. I propose, however, that flexibility should be a candidate. Even if it is not th e only one, flexibility is at least desirable in a decision maker’s model, and we shall tr y t o retain as much as possible. I n practice, as we shall see i n Part II I and beyond, thi s usually means keeping parameters free. I t is also desirable that the descriptive elements of a decision making model should explicitl y recognize that the futur e is uncertain, which bring s us nicely to Chapter 5.
Exercise s 4.1 Show that (4.22) has a maximum where (4.23) is satisfied. 4.2 Show graphically that (4.23) has a unique solution u* (e), which is lower than the optimal flight speed in zero wind. 4.3 (i) Verif y (4.24). (10 The graph of M*(e ) in Fig. 4.2 seems almost linear but has a slight upward curvature. Can you prove this by using the shift technique of Chapter 2? 4.4 (1) Derive (4.33) and (4.34). (ii ) Verif y (4.35). Hint: Show that ln(l + w) > bw whenever -0.632 < w < 0, where b = et{e - 1) « 1.582.
164
Chapte r 4
Validation : Accept , Improve , or Rejec t
4.5 Show that the effect of futur e generations of trees in (4.38) is to make the optimal rotation tim e shorter than predicted by Section 3.4. Hint: You need only the fact that e is positive. 4.6 Show thaty(/) = vXiyie ' - 1) has a maximum at / = s*, where s* is defined by (4.40), provided V"(s") < 6V'(s'). 6
4.7 (i) Verif y that the attractin g equilibri a in Fig. 4.10 are stable but any others are unstable, by using the methods of Section 2.2. (ii ) Obtain (4.77). *4.8 Student A think s that in all of Section 4.13 there is no good reason to reject the model (1.54), so why not accept it and forget all thi s business about components and paradigms? Student Β think s the problem with (1.54) is that it will explain almost any kind of behavior for some value of a. Student C think s the problem with (1.54) is that so many real effects are incorporated int o a that it’ s almost impossible to infer from data what its value should be. What do you think ? *4.9 Student A says that the logistic growth model is a paradigm, because it was used in Section 3.7 to capture some qualitativ e features of a fish population’s growth and is too simple to provid e a realistic description of any population. Student Β says that the logistic growth model is not a paradigm but a predic› tiv e model, because it was used in Sections 1.9 and 4.1 to predict the growth of the U.S. population. What do you think ? "4.10 Student C says that the plant growth model of Section 1.3 was a paradigm un› ti l it predicted the growth in value of a stand of Douglas firs, then it became a predictive model. Student A says once a paradigm, always a paradigm. Stu› dent Β says that the plant growth model can’t be a predictive model because it’ s used as a component in Section 3.2, whose model is not predictive. What do you think ? *4.11 Student A says Section 2.8 provides a better model than Section 4.7. Student Β says Section 4.7 provides a better model than Section 2.8. Student C says that it doesn’t matter, because neither of them is any good. What do you think ? *4.12 (i) Let x(t) denote the number of species of bird s on an island at tim e t (not the number of individuals thu s if an island’s only inhabitants are 6 millio n gulls and 2 turtl e doves, then χ = 2). Let Ε denote the number of species becoming extinct per unit of time; let / denote the number of species immigratin g per unit of time. Writ e down a relation between dxldt, E, and /.
Exercise s
165
(ii ) Wil l the number of species immigratin g per unit of tim e decrease or increase with x? Why? What is the simplest dependence of / upon χ which incorporates your answer? Interpre t any parameters you introduce. (iii ) Wil l the number of species becoming extinct per unit of tim e decrease or increase with x? What is the value of Ε if χ = 0? What is the simplest dependence of Ε upon χ which incorporates your answer? Interpre t any pa› rameters you introduce. (iv) The biota of the island of Krakato a was completely destroyed by a vol› canic eruption in 1883 (Diamond and May, 1976, p. 175). Suppose that bird s subsequently began to immigrat e at the rate of ν species per unit of time. Identif y ν in your analysis. (v) The number of bir d species on Krakato a returned to equilibriu m quite quickl y (see Diamond and May, op. cit.). Use the direct method to find this equilibrium , according to your model. Show graphically that the equilibriu m is stable. (vi) Verif y that this equilibriu m is stable by solving the ordinar y differential equation in (i). What does the fact that the equilibriu m was reached quickly tell you about some of your parameters? According to Diamond and May, the number of plant species is still rising toward equilibrium . What would thi s tell you about your parameters, if your model were used for plants instead of birds? (vii) Criticiz e your assumptions, both the ones that you’ve made and the ones we’ve made here. What is wrong with the form of E(x) for small x? Attempt to improve your model. How does any new assumption affect the equilibrium ? Note: Even if the number of species on an island remains static, their identities will still change, because species are continually immigratin g and becoming extinct. 4.13 In the model of Section 4.11, we tacitly assumed that the parameters b b , c , c did not satisfy b b - c c = 0, as is clear from (4.70). There are good reasons for this: because of environmental fluctuations, only in› equalities between system parameters can be expected to have any validity . In a laboratory, however, where the environment is kept constant, equali› ties between parameters may be realistic. Therefore, in this exercise, we will discover the dynamical behavior of the system it
(
2
2
{
{
2
-77 = Aa
2
-b x-c y).
2
2
2
(i) Show that, if a b -a c φ 0, then the only equilibri a are at ( 0 , a / c ) and ( ,/ ,,ˇ) . Show graphically that (x(t),y(t)) approaches (a,/c,,0) if ,/c , > a lb and approaches ( 0 , a / c ) if a lb > a lc . (ii ) Show that, if a b - a c = 0, then every point on the straight lin e between ( 0 , a / c ) and (a,/c,,0) is an equilibrium . Show graphically that these equilibri a are metastable. x
2
2
2
2
x
2
2
{
2
2
2
2
2
{
2
2
x
{
2
166
Chapte r 4
Validation : Accept , Improve , or Rejec t
*4.14 If the model (4.74) of Section 4.12 does not give rise to a limi t cycle, then at least one of the assumptions embodied in it must be false. Which assumption concerning predators is questionable, and why? Can you suggest a better one? (Hint: Do Canadian lynx eat only snowshoe hare?) *4.15 The net specific growth rate of a human population is the difference between the specific birt h rate b and the specific death rate d, i.e., χ dt where x(t) denotes the population at time t in suitably large units (of a mil› lion people, say) and b and d are, respectively, the numbers of birth s and deaths per unit of time, per unit of existing population. A very special kind of population, which demographers call a birth cohort, consists of a large number of individual s of a certain sex (female, say) who were all bom at a certain time, say t = 0. The large number in question is usually taken to be 100,000 individuals, which we shall designate henceforward as the unit of population. Hence x(0) = 1. The population in question is so exclusive that, by definition, you cannot enter it unless you were already in it at t = 0. Thus b = 0. Demographers call d the force of mortalit y and prefer to denote it by the Greek letter μ. Hence - dx - = -,, 1
*v0 ) = 1, . m
Now, a person who is born at time t = 0 will be of age at time z, so that time and age are identical for our birt h cohort. Thus we can use age ζ instead of time / as our independent variable. The advantage of this is that the mortality , i.e., the specific death rate of the birt h cohort, usually depends much more strongly on age than it does on time. If we ignore the dependence of μ on tim e completely, then we have either of the following two equivalent forms:
or x(z) = exp
(i) Why should μ depend much more strongly upon age than upon time? When μ = ( ) , demographers say that mortalit y is fixed i.e., fixed at birth thoug h mortalit y would generally be lower at each age ζ for a cohort born in, say, 1950 than for one born in, say, 1890. How could exceptions to thi s arise? Hint: You may find the first of the two data sets in Table E4.1 helpful. (ii ) (You may wish to read Appendix 1 before attempting this part.) If you used Table E4.1 in answering (i) then you realized that decreasing mortalit y is related to increasing expectation of lif e at birth . We will now derive this relationship explicitly. Because x(z) is the fraction of the cohort alive at age z, the fraction of the cohort dying between the ages of ζ and + Sz, where
Exercise s
Table E4.1
167
Some lif e expectancies .
Lif e expectancy at birt h (in years) of Swedish females born in a given year
Lif e expectancy in 1967 of a Swedish female with the given age in years
Year
Expectancy …
Age
49.53 51.13 52.44 54.09 54.26 56.77 58.95 59.58 58.71 63.77 64.11 66.15 68.42 70.16 72.76 74.18 75.22 76.14
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85
1880 1885 1890 1895 1900 1905 1910 1915 1920 1925 1930 1935 1940 1945 1950 1955 1960 1965
Expectancy
X
76.58 72.59 67.68 62.76 57.85 52.98 48.13 43.32 38.54 33.84 29.26 24.78 20.46 16.35 12.61 9.36 6.86 4.89
Calculated on the assumption that specific death rates prevailin g at birt h remain constant throughout a lifetim e (adapted from Keyfit z and Flieger, 1971, pp. 102 and 464).
Sz is infinitesimall y small, is x(z) - x(z + Sz) = -x\z)6z
+ o(Sz),
where we use the "littl e oh" notation defined in Chapter 1. Hence, if the ran› dom variable L denotes length of lif e and / its probabilit y density function, then we can writ e f(z)6z + o(Sz) = Prob(z < L < ζ + Sz) = -x'(z)6z + o(6z). The expectation of lif e at birth , e , is simply the expected value of the random variabl e L. Hence show that 0
z]\z)dz = / x{z)dz. e = E[L] = / Jo Jo If ( ) were known as a function of z, then e could be calculated from the above formul a as 0
0
eo =
J
e x p
Q
{ ^ -
Mwtyz-
168
Chapte r 4
Validation : Accept , Improve , or Rejec t
(iii ) One of the first attempts to determine the form of μ(ζ) was made by Benjamin Gompertz (1825). He reasoned that mortalit y is partl y caused by humankind’ s "deterioration , or an increased inabilit y to withstand destruc› tion" and that "at the end of equal infinitel y small intervals of time, he lost equal portion s of his remaining power to oppose destruction," which is another way of saying that "power to avoid destruction" decreases at a con› stant specific rate. If "power to avoid destruction" is inversely proportional to mortality , what form of μ(ζ) would be implied by Gompertz’s reasoning, if that were the sole cause of death? Thi s form of μ(ζ) has become known as the Gompertz law of mortality . (iv) Demographers and actuaries use /(z) to denote the probabilit y that an individua l chosen randomly from a certain population will survive to reach age ζ (or beyond). Identif y /(z) wit h a quantity denned above. {Note: Strictly , your answer is what demographers call "/(z ) on radix 1." Radix denotes an arbitrar y scaling factor, here 1 but usually 100,000, by which values of /(z) are multiplied. ) (v ) Tables of values of l(z) are readily available as part of so-called life tables, which actuaries and demographers regularly compile and update. We wil l indicate how such tables are compiled in Section 8.6. Use the followin g excerpt from the 1966 lif e table for U.S. females (Keyfit z and Flieger, 1971, p. 354) to validate the Gompertz law of mortality .
Age 0 1 5 10 15 20 25 30 35 40
Kz) 1.00000 0.98003 0.97672 0.97493 0.97345 0.97058 0.96711 0.96285 0.95677 0.94805
Age 45 50 55 60 65 70 75 80 85
/( ) 0.93486 0.91519 0.88698 0.84706 0.79115 0.70671 0.59260 0.44656 0.27641
Say whether you believe the law to be valid for all ages, for some ages, or not at all. Hint: Review Section 1.9 and your solution to Exercise 1.10. (vi) Gompertz never believed, however, that "deterioration " was the sole cause of death. Rather, he believed that there were "tw o generally coexist› ing causes," the second of which was "chance, without previous disposition to death or deterioration." We might prefer to regard the second cause as constant exposure to the risk of accident. What form would μ(ζ) take if this constant exposure to accident were the sole cause of death? Deduce the form of I(z). Validate thi s mortalit y law by using the data above for U.S. females in 1966. Is there any range of values of in which thi s law explains the data
Exercise s
169
better than Gompertz’s law? Under what conditions could the second cause be the dominant cause of death? (vii ) Suggest a form for ( ) when Gompertz’s two causes are allowed to co› exist. Find the corresponding form of /(z). *4.16 There is a certain age, usually denoted as ω by demographers, beyond which no one can survive. Fries and Crapo (1981) call this the maximum life potential. As in the previous exercise, let /(z) denote the probabilit y of surviving to age (or more). Then /( ) = 0 for > ω; and the specific death rate, ( ) , must tend to infinit y as ζ —* ø to ensure that no one survives past age ω. A form of μ(ζ) consistent with this property is ( ) =
ω-ζ
,
0 < ζ < w,
where £ ( > 0) is a constant. (i) Wit h this form of ( ) , what is the probabilit y of surviving to age z? (See Exercise 4.15) What is the expectation of lif e at birth , e ? (ii ) Using the 1966 survival probabilitie s for U.S. females, quoted in Exer› cise 4.15, validate the mortalit y law above for the particular choices ω = 90, ω = 100, and ω = 110 (years). In each case, is the law valid for all z? If not, is there any indication that it might be valid for some z, i.e., that there exist Ziand z such that 0
2
μ{ζ) =
ω-ζ
z, < z < z ? 2
(iii ) Do your results surprise you in any way? What is the conceptual difficult y in using this form of ( ) for large values of z? Elaborate, comparing your analysis with that of Exercise 4.15. (iv) Can you suggest a way of resolving this difficult y and, at the same time, suggest a "hybrid " mortalit y law that gives a better fit to the lif e table data for U.S. females in 1966, in the range 30 < < ω, than either the Gompertz law or the one considered here? (v ) Criticiz e this hybri d mortalit y law. Does its better fit to data grant suf› ficient grounds for accepting it? If not, do you have sufficient grounds for rejecting it? *4.17 (i) For the U.S. population in 1970 (male and female), the probabilitie s of survival at age (or more) are given by Fries and Crapo (1981, p. 146) as follows:
Age 69 74 79 84
/( ) 0.64077 0.52308 0.38279 0.23805
Age 89 94 99 100
/( ) 0.11387 0.03927 0.00921 0.00656
170
Chapte r 4
Validation : Accept , Improve , or Rejec t
The same authors estimate maximum life potential to be ω = 115. Use the above data to validate the mortality model
where e is a constant, for ages beyond 70. Hint: Use the expression for / derived in Exercise 4.16. For the range of ζ for which you consider the model valid, estimate e graphically. (ii ) The same authors give probabilities of survival to age ζ (or more) in the range 29 < ζ < 64 as follows: Age ζ
/(ζ)
Age ζ
/(ζ)
29 34 39 44
0.95454 0.94675 0.93600 0.91995
49 54 59 60
0.89559 0.85969 0.80730 0.73560
Use these data and those of (i) to validate the Gompertz model μ(ζ) = αέ for ages beyond 29. For the range of ζ in which you consider the model valid, estimate a and c graphically. (iii) Using your answers to (i) and (ii), can you suggest a continuous function that models mortality for all ages beyond about 35? ζ
’4.18 In Section 1.6 and again in Section 3.3, we used the Cobb-Douglas production function Q = ADK " , where α, η are constants satisfying a > 0 and 0 < 7 < 1, to model the relationship between (real) output Q(t\ capital stock K(t), and labor Ut) at time t, in the manufacturing sector of an economy. But the output was expressed in dollar terms as Y(t)IP(t), where Y denotes nominal value of goods produced and Ρ denotes price index. Because everything is expressed in dollar terms, there is no reason to confine this model to a manufacturing sector. It can be applied just as easily to the produce grown by an agricultural sector or the services provided by office workers. Hence the model can be applied to an entire economy. In Section 3.3 we predicted that the optimal amount of labor for such an economy to employ would be 1
1
where w(t) is the annual wage paid to a unit of labor. As when validating the crop-spraying model of Section 3.6, let's assume that what businesswomen do is also what is optimal, by virtue of trial and error. Having made this assumption, if the Cobb-Douglas model is a good one, then the wages paid to labor in the entire economy should equal w(t)L'(t). Denison (1974, p. 260) has estimated w(t)L'(t) as a fraction of nominal output Y(t) for the entire economy of the United States (including Alaska and Hawaii) for most of the 1960s. Denison's estimates for the years {196f: 0 < t < 8}, are as follows:
Exercise s
t
no
0 0.8222 1 0.8226 2 0.8087
t
"WO no
/
»W(t) ϊ(.ι)
3 4 5
0.8047 0.7980 0.7833
6 7 8
0.7814 0.7983 0.7984
171
Based on these estimates, how well did the Cobb-Douglas production function model the relationship between capital, labor, and output in the decade of the 1960s? *4.19 How good are the chemical dynamic models of Sections 1.10 and 1.11? First decide how you could test them, then ask a friendl y chemistry professor about where you might find some data. *4.20 In Section 4.5, investigate the possibility that the false assumption is not that there is no following wind, but rather that S is the same for all birds. *4.21 In Section 3.1, even if there were no following wind, (3.10) would underestimate how far a bird can migrate because we have assumed that mass is constant through› out. In reality, however, mass decreases durin g flight from m to º/ , where º is significantly less than 1. For example, º = 5/8 when a yellow wagtail migrates across the Sahara desert (Alexander, 1990, p. 447). How much further than (3.10) predicts can a bird migrate? How much does thi s result affect the analysis in Section 4.5?
This page intentionally left blank
THE PROBABILISTI C VIEW
This page intentionally left blank
5
BIRTH AND DEATH. PROBABILISTI C DYNAMICS
Th e dynamical models we met in Chapter 1 are all deterministic.’They predict that the state of some system at tim e t perhaps the speed of a boat or the weight of a plant i s certain to be, say, JC. I f the model is correct, then there is no possibility that the state in question might instead tur n out to be y or z. Now, thi s approach is quit e acceptable if the system being modelled is protected fro m unexpected shocks; for example, if the plant is in a laboratory , where unexpected drought wil l not affect it s growth, or if the boat is rowed on a calm day, so that no gusts of win d wil l affect it s speed. But an element of uncertainty is an intrinsi c part of the worl d i n which we live, and we cannot ignore it indefinitely . Accordingly, in thi s chapter, we develop models that recognize uncertainty explicitly . They do not predict that the state of a system is certain t o be χ at tim e /; rather , they predict the probability that the state wil l be at tim e /. For reasons that wil l soon emerge, we begin our study of probabilis› ti c models by takin g a fresh look at a deterministic one, namely, Section 1.9’s logistic model for U.S. population growth. According t o thi s model, th e state of the population at tim e t, namely, x{t) units, is the number of millions of people in the United States at tim e t. Because the addition or removal of one individual , to or fro m the population, corresponded t o additio n or removal of such a tin y fractio n of the unit in which the population was measured in Section 1.9, we could imagine that χ varied continuously. So we made x(t) a real-valued function. I f the number of in› dividual s in an entir e population is small, however, then one individua l corresponds t o a significant fractio n of it , and it is no longer legitimate t o let the state of the population be a real-valued function. I n thi s chapter, because we are interested in the dynamics of small populations, we wil l deYou may wish to study Appendix 1 before proceeding. 175
176
Chapte r 5
Birt h and Death . Probabilisti c Dynamic s
part fro m the approach of Section 1.9 by making the state of a system an integer. Because we have already departed fro m the approach of Chapter 1 by choosing probabilisti c models, the state of a system at tim e t must be an integer-valued random variable. We wil l denote it by X(t) and allow it t o take values /’ = 0, 1,2, ...,N. Thu s the dynamical systems we describe i n thi s chapter, by using probabilisti c models, have Ν + 1 possible states. But Ν may be as large as we please, and it wil l sometimes be convenient t o regard it as infinite . For a fixed value of t, X(t) is a single random variable. But t may take any value satisfying 0 < t < oo. Hence we deal, in effect, wit h an infinit e set of random variables, namely, S, = {¸ˆ(/): 0 < / < o o } . We give S, a name: we call it a continuous-time stochastic process. Al l random variables i n thi s stochastic process have th e same sample space, namely, the integers between 0 and N. But they do not in general have the same distribution . Rather, their distribution s depend on the value of th e parameter /. (I n th e special case where all distribution s are indeed identical, the stochastic process is said t o be stationary, as we shall see in the followin g chapter.) Althoug h we depart fro m the approach of Section 1.9 in tw o respects, by making the state a random variabl e and by making it an integer, one importan t propert y of the logistic model is retained i n our probabilisti c models. Suppose that a population that is growing logistically, wit h maxi› mum specific growth rat e R and capacity K, is known to have magnitude / at tim e t = s. Then it s size at tim e t = s + is obtained by integratin g th e differentia l equation (5.1) forwar d in tim e fro m t = s to / = J + r , subject t o the initia l condition x(s) = I. We obtain IK I + {K-I)e-*r" Notice that thi s expression is completely independent of J. Thus, r unit s of tim e after it had magnitude / , th e population wil l have magnitude (5.2), no matter where in the course of history it had magnitude / . I n other words, if th e model is correct, and if t = s is regarded as th e present time, then you can foretell the population’s futur e by knowing only it s current magnitude / . You do not need t o know anything about it s past. I n thi s sense, the logistic growth model has no memory, and it is thi s memorylessnes s which our probabilisti c models wil l retain. Th e propert y that th e futur e depends only on the present, and not on th e past, is known in the literatur e on probabilit y as the Markov property . Thu s the models of thi s chapter are Marko v models. Because these models are probabilistic , the mathematical formulatio n of the Marko v propert y i s not quit e as simple as saying that x{s 4- r ) depends on τ and x(s), but X
(
S
+
T
)
=
(5
2)
Chapter s
Birt h and Death . Probabilisti c Dynamic s
177
not on s itself. Rather, we say that, i f X(s) = /, then the probabilit y that X(s+ τ) = j depends on τ and i, but not on s itself. I n term s of conditional probabilities , P r o b ( X ( s + r ) = j \ X(s) = /’) is independent of J. Because it’ s independent of s, we might as well set s equal t o zero, and that’ s why the Marko v propert y is usually stated as P r o b ( * ( 5 +t)
= j \ X{s) = i) = P r o b ( * ( i ) = ; | X{0) = i),
(5.3)
where we have replaced τ by /. What gives rise to the Marko v property ? We can understand best by returnin g t o the logistic growth model, where th e net specific growth rat e μ = b - d is given by
/,(* ) = ¸
(5.4)
and imagining instead that, for some strange reason which need not con› cern us, we had another population for which the net specific growth rat e was μ = μ(χ,ή
= Κί(ΐ-^).
(5.5)
Replacing the right-han d side of (5.1) by (5.5) and integratin g fro m t = s t o t = s + τ, subject t o x{s) = I, yields
IK ^
+
τ
)
=
/
+ ( Λ Γ - / ) ^ * ^ > ·
< · > 5
6
Notice that thi s expression is no longer independent of J. Our strange pop› ulatio n has a sense of history! Comparing (5.5) and (5.6) wit h (5.1) and (5.2), we see that the Marko v propert y of the logistic growth model arises fro m the assumption that the specific birt h rat e b, the specific death rat e d, and, as a consequence , the net specific growth rat e μ depend only on th e state; i.e., b = b{x) and d = d(x), implyin g μ = μ(χ). An explicit de› pendence of μ on t, as in (5.5), would destroy the system’s memorylessnes s (ther e is always, of course, an implicit dependence of μ on t, because χ depends upon )• I n the logistic growth model, the number of unit s added t o th e popu› latio n in the infinitesimal interval [t, t + 6t), per unit of existing population, i s b(x)St + o{8t). Similarly , the number of unit s removed in the interval [t, t + St), per unit of population, is d(x)6t + o(St). Because the logistic growt h model is deterministic, and because χ varies continuously, we can be certain that these amounts are added and removed in the infinitesimal interval . I n a probabilisti c model, however, we cannot be sure that anyone was born or died in the interval [/, / + St). We can do no more than assign some probabilit y t o a birt h or death. Th e longer the interval [t, t+ St), the mor e likel y it is that someone is bor n or dies. I t therefore seems reason› able t o assume that the probabilit y of a birt h or death is proportiona l to St. On the other hand, if the interval is short enough, then the probabilit y
178
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
of tw o or more births , or tw o or more deaths, or a birt h and a death, is negligible. We can make these ideas precise by saying that th e probabili › ties of th e latter events are o(St)\ whereas the probabilit y of a birt h when th e state of th e population is i is b(i)6t + o{6t). I t is customary t o denote functional dependence upon an integer by using a subscript, however, and so we prefer t o writ e the probabilit y of a birt h as (5.7)
bfit+otft).
Similarly , we let th e probabilit y of a death when the state of the population i s / be d(i)6t + c(6t) or, in subscript notation, (5.8)
dfit + o(6t).
Th e previous paragraph suggests that our models should then retain the Marko v property ; and indeed they do, as can be verified fro m the examples below. I t wil l be convenient t o go on calling b the birt h rat e and d the death rate, but these should now be interpreted as probabilitie s per unit of time, rather than specific rates of additio n or removal. I n Chapter 1, we introduced a generic term for growth and decay; we called it dynamics. Similarly , we shall find it useful t o have a generic term for th e events that increase or decrease th e state of a system by 1, i.e., for birth s and deaths; we shall call them transitions. On the other hand, birt h and death are not always the most suggestive labels for these tw o transitions; and, where appropriate, we shall replace the labels birt h and death by arriva l and departure, entrance and exit, rise and fall , or even repair and malfunction. But the transition s wil l still be described by (5.7) and (5.8). Only th e label wil l have changed, t o conform t o everyday usage. Th e goal of our models, as stated i n th e opening paragraph, wil l be t o assign probabilit y t o the event that the state of a system is i at tim e t. We wil l therefore attempt t o assign numerical values t o •( ), where we define t
t
(
τ ft) = Prob(*(f ) = / ) ,
/ = 0 , . . ., N.
(5.9)
Th e Ν + 1 values {*,•(’): / = 0 , 1 , . . ., W} constitute th e probabilit y distribu › tio n of the discrete random variabl e X(t) and must therefore sum t o 1:
j[>/(0=l .
<
5 1 0
>
I t wil l be convenient t o record these values as the (N + l)-dimensional column vector *(i ) = ( » o « ) . * iW
M0) , r
( 5 . H)
where a superscript Τ denotes transpose; ( ) wil l be called the system distributio n vector. I t wil l also be convenient t o denote (5.3) by r,y(f) , i.e.,
Chapte r 5
Birt h an d Death . Probabilisti c Dynamic s
179
t o define rijU) = P r o b W O = j I * ( 0 ) = 0,
0 < i,j < N.
(5.12)
For fixed /, {/,•,(/): 0 <j < N} defines a conditional probabilit y distributio n whose terms must sum to 1; i.e.,
l >,y(0=l ,
(5.13)
0
For 0 < / < Ν we have N+ 1 conditional distributions , and it is convenient t o store them as the rows of the (TV + 1) (Ν + 1) matri x
RW=M0].
(5.14)
W e note in passing that any square matri x wit h rows summing t o 1 is called a stochastic matrix. Hence R is stochastic. exhaust the sample space of a ran› Now, if disjoint events U ,U ...,U dom variable, and i f U is any event in the same sample space, then 0
h
N
Ν
Prob(C/) = Σ Prob(C/ | U ) • Prob(C/^ ; *= o
(5.15)
k
see (A. 13). N o te that the event U does not have t o be associated wit h th e same random variabl e as the events U , U ,..., U . I n particular , U may be the event that the random variabl e X(0) takes the value k, and U may be the event that X{t) takes the value /. Then X(0) and X(t) are different random variables, but they have the same sample space and belong to the same stochastic process. Hence: 0
{
N
k
If Prob(*(f ) = 0 =
= i | * ( 0 ) = Jt) • P r o b W O ) = k).
^ob{X(t)
(5.16)
On using (5.12): Ν
»«<0 = *’<’> *<)’ r
0
(5.17)
or in matri x notation, (0
ˆ
= 7r(0) R(f) . r
(5.18)
For given ( 0 ) , (Ø) can be deduced fro m (5.9) as soon as R(i) is known. For thi s reason, our major preoccupation in thi s chapter wil l be wit h the matri x R(f). Th e first of our examples is the simplest one possible, a probabilisti c model for a population that may contain at most one individual .
180
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
5.1
When Wil l an Ol d Man Die? Th e Exponentia l Distributio n
Suppose that a population consists of just one old man. Sooner or later he wil l die; then there wil l be no one. Let the random variabl e X(t) denote th e number alive in thi s population at tim e t. Then X has sample space { 0 , 1 } ; i.e., the tw o possible states of the population are = 0 and i = 1, and th e matri x (5.14) becomes R(0 =
> o o (0
Ø ( 0’
ˆ
.’IOW
r
n(0.
W e wil l now proceed t o derive explicit expressions for the entries of thi s matrix . / / t h e man were dead at tim e t = 0 then he would have t o remain so. Hence ProbLY(r ) = 0 | * ( 0 ) = 0) = 1, Prob(^(i ) = 1 | * ( 0 ) = 0) = 0. Thus, by (5.12), ˆ ˇ = 1 and r ,(f ) = 0. But the man is alive at tim e t = 0, so that we would not expect r and r t o have any bearing on hi s future ; and thi s is confirmed by (5.20) below. By (5.13) wit h / = 1 = N, i.e., because the last row of the matri x R must sum t o 1, we have r, (f ) + r,,(i ) = 1. Hence 0
00
0l
0
R(0 =
1
0
(5.19)
r,,(f)J
. I - r,,(r )
Th e man is alive initially , and so we have -JT(O) = (0, l ) . Hence on using (5.18) th e system distributio n vector ir(r ) is given by r
= (0, l)R(f ) = (l - r (r) , r ( 0 ) ,
π«)
τ
(5.20)
and
is completely determined if we know r,,(i) . W e shall obtain r (t) below fro m a differentia l equation, which re› quire s an initia l condition. A suitable one emerges fro m th e observation that if th e man is alive at tim e t = 0, then he cannot also be dead at t = 0, though he could conceivably be dead at tim e t = e for any value of e > 0, however small. Hence n
r,,(0) = Prob(AT(0) = l | * ( 0 ) = l ) = l .
(5.21)
Let I/ , be the event that the man is alive at tim e /, i.e., that X(t) = l . Let U be the event that he is dead at tim e f, i.e., that X(t) = 0. Let U be the event that the man is alive at the later tim e t + St, i.e., that X(t + 6t)= l , where St is infinitesimall y small. Thu s U and (7, are associated wit h the random variabl e X(t), and U wit h the random variabl e X(t+ St); but both random variables have the same sample space { 0 , 1} and belong t o the same stochastic process. Th e man must be either alive or dead at tim e t, and so U and U exhaust the possibilities then arising. Hence, fro m (5.15) wit h Ν = 1, we have 0
0
0
{
P r o b [ i / ] = Prob[t / | U ] • ?rob[U ] 0
0
+ Prob[U
\ U ] • Prob[C/,] . {
(5.22)
5.1
When Wil l an Ol d Man Die? Th e Exponentia l Distributio n
181
But Prob[t / | U ] = 0, because the man cannot be alive at tim e t + St i f he is dead at tim e t. Also, fro m (5.9) and (5.20), we have Prob[C/] = ?T0b(X(t + 6t) = 1) = r ( / + if) ; and Prob[C/,] = Prober) = 1) = r ( i ) . Moreover, because Prob[[ 7 | C/, ] is the probabilit y that the man survives fro m t t o l + St, 1 - Prob[£7 | £/,] must be the probabilit y that he dies withi n the interval [t,t + St), which, fro m (5.8), equals d St+o(8t). Hence (5.22) reduces to 0
u
{
r (t u
+ St) = (1 - d 6t+
(5.23)
o{St))r {t).
x
n
Rearranging and dividin g by St, we get
'..ft+«>-'..«.^„„ «w M+
Takin g the limi t as St
(5
.
24)
» 0, we have j {r M t
i
(5.25)
= -d r (t). i
ll
Solving thi s ordinar y differentia l equation and using (5.20) and (5.21), we get *i(f l = r (t) u
0
( 0 = r (t) l0
= r,,(())«-’ " = e~ '
(5.26)
d 1
= 1 - r,,(/ ) = 1 - e~ >'.
(5.27)
d
Thu s the probabilit y that th e population remains in state 1 i.e. , th e prob› abilit y that the old man does not die decay s t o zero exponentially as tim e increases toward infinity . Thi s is the probabilisti c analogue of the natural decay process of Chapter 1. You can verif y directl y that thi s model satisfies the Marko v property . Let C/, be the event that the man is alive at tim e s, U the event that he i s dead at tim e s, and U the event that he is alive at tim e t + s. Because th e man must be either alive or dead at tim e s, U and U exhaust the possibilities then arising, so that 0
0
{
Prob[C7] = Prob[[ / | U ] • Prob[C/ ] + Prob U\U,]0
Prob[f/,] .
0
(5.28)
But Prob[£7 | U ] = 0, because the man cannot be alive at tim e t + s i f he i s dead at tim e s. Moreover, Prob[C/] = ?rob(X(t + s) - 1) = 7r,(i + s), and P r o b [ i / , ] = Prob(AXj ) = 1) = , ) . Hence (5.28) implies 0
Prober + s)
= 1 I X(s) = 1) = Prob[t / | £/,] =
^ – i >
ir,(j )
= e- >' = Prob(*(r ) = 1 | X(0) = 1); d
e- " d
(5.29)
i.e., (5.3) is satisfied. But there’s another way t o look at this. Let the random variabl e G de› note the tim e unti l death in the old man’s lif e or, wit h a view t o generaliza› tion , the time until transition. Then the cumulativ e distributio n function
182
Chapte r 5
Birt h and Death . Probabilisti c Dynamic s
of G is given by Prob(G >t)=
(5.30a)
e~ '' d
or Prob(G < t) = 1 - e- .
(5.30b)
dlt
Thi s importan t distribution , called the exponential distributio n wit h the propert y that
distribution,
Prob(G > t + s I G > s) = Prob(G > t)
is th e only (5.31)
for all t, s > 0. Indeed (5.3) and (5.31) are equivalent statements of the Marko v propert y of memorylessness . Thus, if the model is correct, the old man’s chances of livin g t o age 97, having just reached 95, are the same as hi s chances of livin g to be 87 were when he had just turned 85. Th e cumulativ e distributio n function Prob(Cr < /) is plotted in Fig. 5.1 (we wil l need thi s diagram in Section 8.7). Th e probabilit y density function of the exponential distributio n is given by f(t)=
j {?Tob(G
0 < f < o o;
= d e- ', d>
[
l
whence the mean μ and variance σ
of the distributio n are given by
2
Γ tf{t)dt=±-, Jo d\ r°° = (ί-μ) /Μί=±.
(5.33a)
μ= 2
(5.32)
2
Ø
(5.33b)
PROB(G< M
0
2/d
t
3/rf,
W,
5/rf,
Fig. 5.1 Cumulative distribution function (5.30b) of the exponential distribution.
5.2
When Wil l ˝ Men Die? A Pur e Death Proces s
183
Fro m (5.33a), we can interpre t the death rat e as d, = MEAN TIME UNTIL TRANSITION
1
5.2
.
(5.34)
Whe n Wil l Ν Men Die? A Pur e Death Proces s
Th e model we have just discussed is a very simple example of a pur e death process. We wil l now consider a more general death process, in which a pop› ulatio n consists of Ν old men, dead or alive. Let the random variabl e X(t) denote the number alive at tim e t. Then X has sample space { 0 , 1 , . .. ,N}\ i.e., the Ν + 1 possible states of the population are / = 0, 1, . . ., N. I f Ø men are alive at tim e 0, then there cannot be more than / men aliv e when t > 0. Hence r^t) = ?rob(X(t)
if/
= j \ X(0) = i) = 0
(5.35)
I n other words, the matri x R(/), denned by (5.14), is lower triangular . More› over, if / men are alive at tim e 0 then there cannot also be j men alive at tim e 0 unless i = j . I t is convenient to express thi s idea by introducin g some new notation. Let us define the Kronecker delta by
>-{l ν>*Λ"*°·
(
*·
1
< > 5J6
Then r {0) = 6 , u
(5.37)
0
ij
N ow suppose that / men are indeed alive at tim e 0; i.e., restrict the sample space of ¸ˆ(0 ) to the event that X(0) = i. Let U denote the event that j men are alive at tim e t+St, where St is infinitesimall y small. Let U denote th e event that j men are alive at tim e /, U the event that j + 1 men are aliv e at tim e t, and t / the event that more than j+ 1 men are alive at tim e /. Because I/, , U , and C/ exhaust the possibilities then arising, we have {
2
3
3
2
Prob[C/] = Prob[C/ | £/,] • Prob[{7J + Prob[£/ | U ] • P r o b [ i / ] 2
2
+ Prob[C/ I U ] • Prob[C/ ] . 3
3
(5.38)
On using (5.8), the probabilit y of a death in the interval [/, f + St), i f X(t) j+ 1, is d St + o(6t) = Prob[{ 7 | U ]. Similarly , the probabilit y of no death i n the interval [t,t + St), if X(t) = j , is 1 - djSt + o(St) = Prob[t / | C/,]; whereas Prob[C/ \U ] = o(St). Because X(0) = i, Prob[C/,] = Prob{Xtt) = j) = Prob(*(i ) = ; | X(0) = /) = r^t), on using (5.12). Similarly , P r o b [ [ / ] = ’ /,>+1(0 Prob[i7] = rjjO + St). Substituting int o (5.38), we have J+l
2
3
2
a
n
d
r (t + St) = {[-d St u
j
+ o(6t))r (t)+ iJ
{d 6t j+l
+ o(6t)}
r (t) ij+l
+ o(5/)Prob[f/ ] . 3
184
Chapter s
Birt h and Death . Probabilisti c Dynamic s
Hence '— = -djr (t)
Λ J t
+ d r (t)+
u
j+l
^f.
iJ+l
N o t e that an expression for Prob[£/ ] is not required. Takin g th e limi t as St -+ 0 now yields the ordinar y differentia l equation 3
^
{ r ( / ) } = -djr^t)
(5.39)
+ d r U),
ff
J+l
IJ+l
wit h (Exercise 5.1) solution r (r) = ff
f e- *'-\ (s)ds.
e-4V°> + 4 . +
(5.40)
d
j+l
Jo
Because r (s) = 0 by (5.35), we observe, on s e t t i n g) = i in (5.40) and using (5.37), that r,,(/) = r, (0) exp(-,f) = e x p ( - i / , i ). N ow let X(s) = /'; and let the random variabl e (?,• denote tim e that elapses unti l the follow› in g death or, i n more general terms, tim e unti l the next transition . Then Prob(G, > 0 = Prob(*( f + s) = i \ X(s) = i) = Prob(Z(/ ) = i \ X(0) = i) = r, (i) on using the Marko v propert y (5.3). Thu s the tim e unti l transitio n is exponentially distribute d wit h mean l/df, or u+l
7
;
(5.41a)
Prob(Gi,> t) = e- , dlt
d, = . (5.41b) ' MEAN TIME UNTIL TRANSITION ' Expression (5.40) is valid for all / and though, in view of (5.35), we do not need it for i < j . Thus the probabilitie s r./f ) can be found recursively, startin g wit h the diagonal elements of the matri x R(f) and moving leftwar d along the rows. For example, suppose that d = D = constant (i.e., indepen› dent of 0 for i > 1; we must, of course, take d = 0, because the death of the entir e population precludes further deaths of individuals. Then for Ν = 3 we obtain v
t
0
1
R(/) =
11 - e~
e
+ Dt+
Dl
0
0 e~
D t
- Dte~
Dt
1 - e~ (l
-
0
Dt
Dte-
Dt
Dl
\D t ) 2'
\D t e-
2 2
2 2
e
Dl
-Dt
o·
0
0
Dte-
Dt
Notice that thi s is indeed a stochastic matrix . Notice also the pattern of entries, fro m which the structur e of the general (Ν + 1) (Ν + 1) matri x R(/) is readily apparent. Clearly, the probabilit y that TV old men alive today wil l all have died t years fro m now is r
m
( )=l-et
D
'
f -^, *= o * • N
{
(5.42)
where 1/D is a man’s lif e expectancy. We should bear in mind, however, that d-, = D is not realistic why ?
5.3
5.3
Formin g a Queue . A Pur e Birt h Proces s
185
Formin g a Queue . A Pur e Birt h Proces s
Suppose that a queue is formin g at a checkout counter. Let the random variabl e X(t) denote the number of individual s in the queue at tim e t, and let Ν be the maximum number of individual s for which the queue has room. Then X has sample space { 0 ,1 N), and we can thin k of arrival s as birth s in a population wit h ˝ + 1 possible states, namely, / = 0, 1, . . ., /V. We wil l assume that there are no departures fro m the queue or, as it were, no "deaths" in the population. Th e process we are about t o describe i s therefore a pur e birt h process. Suppose that there are / individual s in the queue at tim e 0; i.e., X{0) = i. Because there are no departures, r {t) = Prob(Z(i ) = j I X(0) = i) = 0,
if i > j ;
v
(5.43)
i.e., the matri x R(i) is upper triangular . Let U denote the event that there are j individual s in the queue at tim e t + St, where St is infinitesimall y small. Let C/, denote the event that there are individual s in the queue at tim e t, U the event that there are j - 1 individual s in the queue at tim e /, and t / the event that there are less than j — 1 individual s in the queue at tim e t. Because U , U , and £/ exhaust the possibilities then arising, i.e., exhaust the sample space of X(t), (A. 13) implie s that 2
3
x
3
2
Prob[C7] = Prob[t / | t/,] • Prob[{7,] + Prob[i 7 | U ] • P r o b [ t / ] 2
2
I U ] • Prob[C/ ] .
+ ?tob[U
3
3
(5.44)
On using (5.7), the probabilit y of a birt h in the interval [/, t+ St) if the state of the population i s ) - 1 is bj_ St+ o(St) = Prob[i / | U ]. Similarly , the probabilit y of no birt h in the interval [t,t+St) if the state of the population i s j is i-bjSt+o(6t) = Prob[t / | C/,]; whereas Prob[C/ | t / ] = o(St). Because ΛΓ(0) = Ø, Prob[(/,] = Prober) = ; ) = Prob(^(/ ) = j \ X(0) = i) = r {t), on using (5.12). Similarly , Prob[£/ ] = /•,;_,(/) and Prob[£/] = r {t + St). Substitutin g int o (5.44), we have {
2
3
0
2
jy
njU+St) = { l - b j 6 t + o(St)} r (t)+{b _ St+ ij
j
o{6t)} r , . , _ , ( / ) + 0 ( ^ ) P r o b [ C / ] . 3
l
Rearranging, as in the previous section, and takin g the limi t as St — 0 now yields the ordinar y differentia l equation
wit h (Exercise 5.2) solution r (i ) = e-^'Sjj + bj_, iy
/' e - ' - \ _,[s)ds, Jo b
( l
s
y
(5.46)
because r y(0) = Sy, as in the previous section. Because /"/,,•_ | ( J) = 0 by (5.43), we observe on setting j = i in (5.46) that r (l) = ekp(-bjt). N ow (
u
186
Chapte r 5
Birt h and Death . Probabilisti c Dynamic s
let X(s) = i, and let the random variabl e (7,• denote th e tim e that elapses unti l the followin g birth , or, in more general terms, the tim e unti l the next transition . Then Prob(G, > t) = Prob(*( f + s) = i | X(s) = i) = ProbL¥(/) = i | ¸ˆ(0 ) = 0 = r (i) , on using the Marko v propert y (5.3). Thu s the tim e unti l transitio n is exponentially distribute d wit h mean \lb{, or Prob(G > /) =
(5.47a)
f
(5.47b)
MEA N TIM E UNTI L T R A N S I T I O N ’
Expression (5.46) is valid for all«’ and j though, in view of (5.43), we do not need it for / > j . Thu s the probabilitie s r {t) can be found recursively, startin g wit h the diagonal elements of the matri x R(/) and moving t o the righ t along the rows. For example, suppose b = Β = constant for 0 < i < Ν - 1; we must, of course, take b = 0, because there is space for only Ν individuals . Then for Ν = 3 we obtain (j
t
N
-Bt
a
R(0 =
0 0
Bte~ •Bt e-"' 0
\B t e~ Bte-
Bt
0
2 2
Bl
Bt
1 - e-»'(l +Bt+ {B t y 1 -«?-*’ ( 1 + Bt) 2 2
-Bl
I -
0
0
e •Bt 1
N o t i ce that thi s is indeed a stochastic matrix . Notice also th e pattern of entries, fro m which the structur e of the general ( J V + l ) x ( ; V + l ) matri x R(/) is readily apparent. Clearly, th e probabilit y that a queue that began wit h i people wil l have people at tim e f is given by (Bty -i
-Bt
0 - 0! V 0 =
N-i-l
1-e L 1,
- 1;
i(0<j
a
•Bt
k=0
(Bt) kl
k
i f 0 < <
(5.48)
- l,y = N;
i f / = ; = N.
Though Ν wil l always be finite for th e queue at a checkout, there are other queues for which Ν may be regarded as infinite . Indeed the pur e birt h model wit h constant birt h rat e bj = Β and infinitel y many states occurs so frequentl y in mathematical modelling that we give it a special name; we call it the Poisson process. Let the random variabl e A{t) denote the number of arrival s by tim e t in a Poisson process. Then, setting j = k, i = 0, and lettin g Ν - + co in the first part of (5.48), the distributio n of A is given by Prob04(i) = k) = P r o b ( * ( 0 = k \ X(0) = 0) = r {t) ok
= <ˆ*’ ^
•
(5.49)
We call thi s distributio n the Poisson distribution . You can easily verif y (Exercise 5.2) that it s mean is Bt; i.e., an average of Bt individual s arriv e i n any interval of length r.
5.4
How Bus y Mus t a Road Be t o Requir e a Pedestria n Crossin g Control ?
187
Th e Poisson distributio n is closely related t o the exponential distribu › tion . To see this, let the rth individua l arriv e at tim e s, and let the random variabl e G, denote the tim e that elapses before the next arrival . Then, be› cause of the Marko v property , the random variables G G , G , are independent. We shall call them the interarrival times. On using (5.3) and observing that every entry on the diagonal of R(f) is e~ , we have l3
3
2
Bt
Prob(G, >t) = Prob(X(f + s) = i \ X(s) = i) = r (t) = e~ .
(5.50)
Bt
u
I n other words, the interarriva l times in a Poisson process have identical exponential distributions , wit h mean 1/5. We shall use thi s fact in the followin g section. Havin g now described both a pur e birt h model and a pur e death model, th e logical next step might be to describe a model in which birth s (or arrivals ) and deaths (or departures) can both occur. We prefer, however, t o address thi s matter later, in Section 5.5. Meanwhile, let’s appreciate the power and usefulness of even a simple probabilisti c model.
5.4
How Bus y Mus t a Road Be to Requir e a Pedestria n Crossin g Control ?
Let ¸ denote the average number of cars per second that pass a point on a road where pedestrians cross. We wil l assume that these cars all travel i n the same direction, as in each lane of a two-lane road wit h a median. I f traffi c is flowin g freely, then the passing of a car may be regarded as an arriva l in an infinit e queue. Thi s suggests using the Poisson process (5.49) as a model for the traffi c flow, wit h interarriva l tim e Gj as th e tim e gap between the (j - l)t h car and the jth. But if a second is the unit of tim e then, fro m (5.49), the average number of cars per second is °° k
ˆ0
^ø
°°
=
k
) = T ,
e
~
Jt=i
k=\
ok-1
Dk k
B
T i
=
B
e
~
TFTT V =
B
"·
k = i
K
K
l )
B
E
’
B
E
B
=
B
-
-
(5.51) Thu s º = Β, and gaps between cars have the exponential distributio n Prob(G,- > 0 = e~ . (5.52) xt
Let Τ be the tim e it takes a typical pedestrian t o cross the road. Then th e probabilit y that a typical pedestrian crosses the road durin g the y’th tim e gap, i.e., between the (j - l)t h car and the jth, is 7, = Prob((7 < ˆ , G, < T,G < 0
2
T,..., G,_ < T, G _,
= Prob(G < T) • ProbiG, < T)... 0
= (1-<
º 7
ˆ ’ •<ˆ
º ˆ
,
2
}
> T)
Prob(G,_ < T) • Prob(G,_, > T) 2
(5.53)
where we have used (A. 5 7) and the fact that interarriva l times are indepen› dent. Thu s the mean number of gaps that a typical pedestrian requires t o
188
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
cross the road (includin g the gap durin g which he crosses) is (Exercise 5.4) oo
Σ^
=
βΧΤ
·
<· > 5 54
Let Æ denote the average length of the gaps that occur whil e a typical pedestrian is waitin g t o cross. Then a typical pedestrian’s average waitin g tim e is ( e * - l ) a. Now, let τ be the longest tim e for which, on average, a typical pedes› tria n can reasonably be expected t o wait. Then a crossing control is needed unless r
(^ -l)a
(5.55)
r
Whatever the value of a, it cannot exceed T, for then at least one tim e gap would have exceeded Τ and the pedestrian would have been able t o cross th e road. A sufficient condition for (5.55) is therefore ( e * - l)T < r , or r
A
(5.56)
W e can regard the right-han d side of (5.56) as expressing the maximum rat e at which cars should be allowed t o pass if pedestrians are not t o be delayed unreasonably, or, because long delays encourage pedestrians t o take risks, as the maximum safe traffi c flow. I t is convenient to convert thi s quantit y int o number of cars per hour and express it as a function of the widt h of the road. Suppose that τ is 60 seconds. Let d be the widt h of the road in feet, and assume that a pedestrian walks at 3.5 feet per second. Then Τ = 2dP and, on using (5.56), the maximum safe traffi c flow in cars per hour is 2
(d)=-j-\a[\
+ -j-).
(5.57)
Th e graph of φ is sketched in Fig. 5.2. Points in the d-φ plane below thi s curve represent safe traffi c flows, and point s above the curve represent unsafe ones. Notice how sharply the permissible traffi c flow decreases wit h increasing road width . For example, a traffi c flow of 1500 cars per hour would be judged safe if the road were 20 feet wide, but a flow of only 875 cars per hour would be deemed unsafe if th e road were 30 feet wide. Thus crossing controls for pedestrians are essential on principa l highways, where, because traffi c is heavy and d is large, it is almost certain that traffi c flow exceeds φ{ά). How good is thi s model? D o es it s descriptive component fit th e facts for freely flowing traffic ? We should not accept thi s model unti l we have shown that passing cars may reasonably be regarded as arrival s in a Poisson See Supplementary Note 1.
5.5
Th e Ris e and Fall o t th e Compan y Executiv e
189
A 2 0 00
1 5 00
1 0 00
5 00
0
50
100
150
2 00
2 50
3 00
* d
Fig. 5.2 Maximum safe traffi c flow in cars per hour as a function of road width in feet, according to (5.57).
process. Therefore, in Section 8.7, we wil l analyze some traffi c data and verif y that our assumption is indeed a reasonable one.
5.5
The Ris e and Fall of th e Compan y Executiv e
I n thi s section, we wil l develop a probabilisti c dynamic model in which "births " and "deaths" are both allowed, though the probabilit y of more than one such transitio n in the interval [t, t + St) is o{St). We wil l refer t o thi s model as a birth and death process. We wil l introduc e the model by describing the movement of an elevator between floors of a company building , but the model has several other applications. Let the company buildin g have N+1 floors, wit h 0 corresponding to the lowest floor and Ν t o the uppermost, and let a "birth " on floor i correspond t o a transitio n between floor / and the floor above. Let the random variabl e X(t) denote the floor the elevator occupies at tim e / if it is at rest, or the floor t o which it is headed at tim e t if it is moving. By allowing X t o be the floor of destination as well as of occupancy, the travel tim e between floor i and floor i + 1 can be regarded as part of the elevator’s occupancy of floor i + 1. Thu s a birt h takes place instantly, at the moment when a company executive at floor /’ (or anyone else who wishes t o use the elevator) presses th e button for floor / + 1. Similarly , a "death " on floor Ø corresponds to a transitio n between floor / and the floor below, regarded as happening at the instant when an executive at floor / presses th e button for floor Ø 1. To ensure that a birt h and death model provides an adequate descrip› tion , we wil l assume that the elevator stops at every floor on it s way up or down. We might imagine that the elevator has only tw o buttons, one
190
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
marked "up " and the other marked "down, " a transitio n occurrin g when› ever a button is pressed. Thu s the elevator cannot rise directly fro m the ground floor to, say, the third . Rather, thi s journey would requir e a stop at the second floor en route, so that tw o birth s would be involved. Thi s assumption is an obvious imperfection of our birt h and death model, but we wil l be able t o eliminate it later. Th e followin g section wil l take a step in thi s direction, and furthe r developments wil l be facilitated by Chapter 10. Because we assume the Marko v property , the futur e must never depend on the past. But suppose that an executive has caught the elevator at the thir d floor and is on his way t o the ground floor when, durin g the elevator’s compulsory stop at the second floor, he meets another executive who wishes t o clim b t o the tenth floor. Th e second executive decides t o rid e wit h the first executive t o the ground floor, rather than wait for th e elevator t o return , so that his place in the elevator is assured. I n these circumstances, th e next birt h would depend not just on the elevator’s ground floor position but also on the fact that it had acquired a high-minded executive at the previous stop. I n other words, the Marko v propert y would be violated. We exclude thi s possibility by assuming that executives are always too harassed t o wait for an elevator. I f it’ s already there an d either empty or going in the righ t direction the n they wil l use it . Otherwise, they wil l tak e the stairs. Havin g dispensed wit h these preliminaries, we now proceed to develop our model. Suppose that the elevator is on floor / at tim e 0, i.e., that X(0) = /’. Let U be the event that the elevator is on floor j at tim e t + 6t, where 6t i s infinitesimall y small, and where 1 < < Ν - 1; j = 0 and j = Ν wil l be considered later. Then Prob[C/] = ?tob{X(t+6t) = j) = Prob(AT(f + St) = ; I ¸^ˇ ) = i) = + St). At tim e t, the followin g four events exhaust all possibilities: U : the elevator is on floor j , x
U
2
: the elevator is on
floor
j+l,
(5.58)
Uy: the elevator is on floor j - I, U : the elevator is above floor j + 1 or below floor j A
I.
Hence, fro m (A. 13): 4
Prob[C/] =
(5.59)
Prob[C/ | U ] • Prob[C/J. k
But on using (5.7) and (5.8), we have Prob[C7 | U ] = d 6t + o{6t) and Prob[i / I U ] = bj_ 6t + o(6t); whereas ?tob[U | U ] = o{St), being the probabilit y of a birt h and a death in the interval [t, t + St). Th e probabilit y of a birt h or a death, on the other hand, is bjSt + djSt + o(St) when the elevator is on floor j ; and, given t / , the event U wil l take place only if 2
3
{
J+l
A
(
5.5
Th e Rl« e an d Fall of th e Compan y Executiv e
191
neither a birt h nor a death occurs in the interval [t,t + St). Thu s Prob[i / | C/,] = 1 - bj6t-djSt+o(St). Substituting these results int o (5.59), and using (5.12), we thus obtain rjj(t + 6t) = (l-
bjSt-
dj8t + oi6t)) (t) x
+
+ (d St
rij
j+l
+ o{6t))r,j.iU)
+ {bj_ 6t
o(6t))r (t) u+l
+ o(6t) • Prob[(7 ] . 4
(5.60)
Rearranging, we get r^t + S^-r^t)
. . . . . . . '— = -{bj + dj)r (t) + dj r j (t) ij
Takin g th e limi t as St jH r
t
ty-i V-i
=
r
+l
. . . +
i +[
o(6t) bj_ r j_ (t)+ l
i
l
0, we obtain the differentia l equation
- (bj + dj)r
+ d
v
J + l
r
I J + l
,
l < j < N - l .
(5.61)
For j = 0 the event i/3 is impossible, and for j = Ν we must exclude the event U . Then, by reasoning similar to that which yielded (5.61): 2
dt dt
= d r -b r l
i l
= b _r _
0
N
i
Ui
l
(5.62)
i 0
(5.63)
- dr . N
iN
Her e we have used the fact that d = 0 = b , because the elevator can neither descend below floor 0 nor rise above floor TV. Equations ( 5 . 6 1 )(5.63), together wit h th e initia l conditions r / O ) = 6 i,j = 0, I, ..., Ν are sufficient t o determine r^t) on [0,oo) for all / and Naturally , the constraint (5.13) must be satisfied by r,-,(f) for every value of /, and you should note that the sum of equations (5.61) (5.63 ) is just the derivativ e of thi s constraint wit h respect t o t. Also, be sure you appreciate that r / O ) = S i s an initia l condition only in the mathematical sense. Th e initia l state of th e system itself is the random variabl e ¸ˆ(0) , wit h probabilit y distributio n 0
N
ijt
it
ir(O).
To keep the mathematics simple, however, we shall confine our at› tention for the remainder of thi s section to the special case Ν = 2. Thu s we wil l model a company buildin g that consists of three stories, wit h a single elevator connecting the floors. I n such a buildin g (for exam› ple, the old Florid a Education Association/United buildin g in Tallahassee), can we predict where the elevator wil l be at the end of the day, if it either always starts on the ground floor (i = 0) or else is equally likel y to start the day on any of the three floors?
192
Chapte r 5
Birt h and Death . Probabilisti c Dynamic s
Setting Ν = 2 in ( 5 . 6 1 M 5 . 6 3) gives -77 = - V / o + ^ / i . dt
djji dt
_ =
dr
_ = b r
i2
r
h 0
x
i
-(b +d )r
0
l
-
n
l
i
(5.64)
+d r ,
i
2
n
dr . 2
i2
I t isn’t difficul t (Exercise 5.5) t o solve thi s set of linear equations for any and d , subject of course t o r,y(0) = 6 j,i,j = 0 , 1 , 2; but values oib ,b ,d th e algebra is messy. We wil l therefore make the furthe r assumption that executives on the top floor approach the elevator/staircase area throughout th e day at the same average rat e as executives on the ground floor, so that we may take b = d = a, say. Then you can verif y by substitution that the solution t o (5.64) for i = 0 , 1 ,2 is given by th e 3 3 matri x 0
x
lt
2
0
R(0 =
t
2
1 a + b
+
x
d
a
b[
a
b
"
b,
x
Ø e
(b
x
bt
-at
x
bi+d
{
- ( a + 6 , + < / , )i
+ d )(a
+ b
x
ad
+
x
-a(b +d ) x
χ
+
L-4
0
x
0
ab
x
x
ά)
χ
(5.65)
-b (b +d )
2
χ
x
- α φ + ά )
t
0
x
φ
ad
0
-b
d)
x
- d ^ + d j
Ο
x
x
ab
χ
x
I f the elevator always starts the day on the ground floor then, fro m (5.18) and (5.65), ( ) = (l,0,0)R(f) = ˆ
-
Æ+ o, +
r
d
( d
u
a,b )
+
x
x
M^(l,0,-1) + Æ.
b
x
ae - ( b
l
,-(a+b,+di)t
d X
+
l
a
- r b
d ) (
l
+
l
d
> '
b
>
+
d
" -
b
i
y
>
(
5
whereas if it’ s equally likel y t o start on any of the floors, ir(t) ( 1 / 3 , 1 / 3 , 1 / 3 ) R (0 =
1
x
)
o, + c,
V A ^ V +l fb i ^ +d’) (
6
^«-"’(1,0,-1)
,’,(^1,^1) +
a + bi+di
3 ( 0| + d ){a
6
=
T
+
·
g
x
( 0 + t l + r f
x
’ ’H^ )
l
+ d ,-b ). x
(5.67)
x
We do not have values for a, b , and d , but it seems reasonable t o assume values of several per hour a t the very least, > 1 , 6, > 1, and d > 1. At th e end of the nine-hour workin g day, therefore, the exponential term s in (5.66) and (5.67) are completely negligible, because e ~ ss 1 0 ~ , and e~ is x
x
x
9
4
27
5.6
Discret e Model s of a Day in th e Lif e of an Elevato r
193
even smaller. Thus, regardless of the initia l location of the elevator, we have <>
π
9
Γ
^,a,b ) Æ+ Οχ + a
w
{
(5-68)
l
at the end of the day. Intuitively , thi s is a sound result. It says that the elevator wil l ulti › mately spend a fractio n d\l(a + b + d{) of each hour on the ground floor. Thi s fractio n increases wit h d i.e., wit h an increase in the average rate of departur e fro m the middl e to the ground floor. You should similarl y interpre t Ø(9) and ( 9 ). I f executives on the middl e floor approach the elevator/staircase area at th e same rat e as on the other floors, and i f any executive’s ultimat e destination is equally likel y t o be either of the other t w o floors, then x
u
2
b
= ^ {rat e of ground floor departure} + ^ {rate of approach on middle floor}
{
a
a
= 2 2 ' th e first contributio n being due to executives w ho are ridin g all the way fro m the ground floor t o the top; and similarly , +
=
a
d = ^ {rate of top floor departure} + i {rate of approach on middle floor} {
a
= 2
a +
2
=
a
>
too. I n these circumstances, (5.68) produces the obvious answer ( 9 ) « ( 1 / 3 , 1 / 3 , 1 / 3 ), irrespective, of course, of how the elevator starts it s day. N ow tr y Exercises 5.6 and 5.7. ˆ
5.6
Discret e Model s of a Day in th e Lif e of an Elevato r
I n Sections 1.1 and 1.7 we constructed a model of a contaminated lake. We found that if we wished t o know the state of the lake at all times t, 0 < t < oo, then we had t o use a differentia l equation t o describe the decay of pollution . I f we were satisfied t o know the state of the lake only at discrete instants t = 0, 1, 2, . . . , / , . . ., however, then a recurrence relation could be used instead, provided a certain condition was satisfied. We called th e resulting model a metered model; and the condition for using it was that the system in question behave qualitativel y the same withi n each unit of time. Because of thi s qualitativ e periodicity , the state of the system at tim e t = / + 1 could be predicted if only the state of th e system at tim e t = I were known. What happened prio r to tim e t = / was irrelevant . But thi s i s just th e Marko v propert y of memorylessness , and suggests that birt h and death models can also be metered if we replace the continuous-time stochastic process S = {X(t): 0 < t < oo} by a discrete-time stochastic process, namely, the set S = {X(l):l = 0 , 1 , 2 , . . . }. We wil l illustrat e thi s t
t
194
Chapter s
Birt h and Death . Probabilisti c Dynamic s
idea by constructing a metered model of the company elevator described i n the previous section. Let an hour be the unit of time. Thus, if t = 0 were 8 A . M , then t = 9 would be 5 P.M. We wil l construct a model that predicts the elevator’s distributio n vector π(ή at the discrete instants t = 0, 1, 2, . . ., 9. Let U be the event that the elevator is on floor at tim e / + 1, and let Uj be th e event that the elevator is on floor / at tim e /, for 0 < i < 2. Then, because the disjoint events U , £/,, and U exhaust the possibilities arising at tim e /, we have 0
2
2
Prob[ U) =
Prob[ U | (/,] • Prob[U,].
(5.69)
i=0
But fro m the Marko v property , i.e., on setting t = 0 and s = I in (5.3), we have Prob(t/ 1 [/,) = Prob(Z( / + 1) = j | X(t) = i) = P r o b ( * ( l ) = ; | * ( 0 ) = 0 = ^(1). Moreover, Prob(C/) = P r o b ( * ( / + 1) = j) = τ XI + 1), and Prob(C/,) = ?Tob(X{t) = 0 = * ,•(/) Hence (5.69) yields a set of three coupled recurrence relations: 2 i=0
Let us define the 3
3 matri x S by S = R(1).
(5.71)
Then (5.70) may be writte n more succinctly in matri x for m as ( / + l)
T
= ir([) S. T
(5.72)
Thi s matri x recurrence relation is a probabilisti c analogue of (1.48), and you can verif y by substitution that it s general solution is given by ir(/)
r
= x ( 0 ) S ’. r
(5.73)
Once S and ( 0 ) are known, (/ ) can be calculated fro m (5.73) for any value of /, by recursion. But S is known fro m the previous section. To keep th e mathematics simple, let’s assume, as at the very end of Section 5.5, that executives on all floors of the buildin g approach the elevator/staircase area at the same rat e a and that the other tw o floors are equally likel y t o be their final
5.6
Discret e Model s o f a Day In th e Lif e o f an Elevato r
195
destinations. Then, fro m (5.65) wit h b = d = a: x
"1 R ( 0 =3 1 .1
’ 1
1" 1 + 1.
1 1 1
\e'°'
0 .-1
{
-r
0 0
0 1 .
0
" 1
-2
1"
-2
4
-2
1
-2
1 . (5.74)
1 -2 1
-2 4 -2
1
0
I n particular , 1 1 1
S = R ( 1 ) =5
1 1 1 1 1 1
0 0 0
-n 0 1
For the sake of illustration , let’s take a = 1.5. 0.4467499 0.3296303 0.2236198
0.3296303 0.3407393 0.3296303
0 3
-2
Then (5.75) yields (5.75) 0.2236198 0.3296303 0.4467499
(5.76)
You can easily verif y (though you’ll need a computer) that
S = 9
0.3333340
0.3333333
0.3333326
0.3333333
0.3333333
0.3333333
. 0 . 3 3 3 3 3 26
0.3333333
0 . 3 3 3 3 3 4 0.
-
.
(5.77)
Thu s if the elevator is certain to start the day on the ground floor, then *(9)
r
= ( l , 0 , 0 ) S = ( 0 . 3 3 3 3 3 4 0 , 0 . 3 3 3 3 3 3 3 , 0 . 3 3 3 3 3 2; 6 ) 9
(5.78)
whereas if it is equally likel y t o start it s day on any floor, then . , 9 / = ( i , i , i )
S
’ = (i,i,i) .
( 5 . 7 9,
A s in Section 5.5, we have (9) s* ( 1 / 3 , 1 / 3 , 1 / 3 ), irrespective of where th e elevator began it s day. We can interpre t these equal probabilitie s by saying that the elevator wil l ultimatel y spend an equal proportio n of tim e on each floor. A very different result is obtained if we choose to measure tim e not in hour s but in terms of the number of transition s (birth s or deaths). Let t = 0 correspond, as before, to the start of the elevator’s day. Now, however, let / = 1 correspond to the first transition , t = 2 t o the second transition , and, in general, t - η to the nth transition . Let U denote the event that the elevator is on floor j after n+1 transitions, and let £/,• denote the event that ˆ
Th e idea for this model came from observing the FEA/United buildin g in Talla› hassee. There, the appropriat e value of a was certainly greater than 2, and probably 4 or 5; but I had to choose a sufficiently small that (5.73) would still be converging after 9 tim e steps (to seven significant figures, see (5.77)). 3
196
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
th e elevator is on floor /’ after η transitions, 0 < Ø< 2. Th e disjoint events U , U , and U exhaust the possibilities arising at t = n, and so we have Q
{
2
2
Prob(U) =
i’=0
Prob(U \ U,) • Prob(£/,).
(5.80)
Let us denote Prob(C/ | U ) by p Then fro m the Marko v property , i.e., setting t = 0 and s = η in (5.3), we have (
ir
Py = P r o b W n + 1) = y | X(n) = i) = P r o b ( * ( l ) =j | * ( 0 ) = /). But Prob(£/) = P r o b ( * ( « + 1) = j) = π {η+1), i) = ,•( ) . Hence (5.80) becomes
(5.81)
and Prob(i/,) = Prob(^(n ) =
}
2
/=o
or in matri x terms, π(η+
1)
τ
(5.83)
= π(η) ?, τ
where Ρ is the 3 3 matri x whose (/,y)th entry is given by (5.81). You can verif y by substitution that the general solution of thi s matri x recurrence relatio n is given by ( ) " = ΤΓ(0) Ρ . 7
ª
(5.84)
Λ
Once Ρ and ( 0 ) are known, ( « ) can be calculated fro m (5.84) for any value of n, by recursion. W e may refer t o Ρ as the one-step transitio n matrix , or simply the transition matrix, because fro m (5.81), it gives th e probabilit y of going fro m floor / t o floor j in precisely one transition . Th e matri x P" may be called the n-step transitio n matrix , because it gives the probabilit y of going fro m floor / t o floor j in precisely η transitions. Lik e R(f) , Ρ and P" are both stochastic matrices. I t remains t o calculate P. I t is impossible t o go directl y fro m the top t o th e bottom or th e bottom t o the top in precisely one transition ; therefore we have p Q = PQZ = 0. But it is also impossible t o retur n t o th e same floor i n one transition , whence Poo = Pi Ø = P22 = 0• ^ elevator is on the ground floor or the top floor, then it s next transitio n must be t o the middl e floor, whence p = p = 1. It now remains only t o calculate p and p . I n th e limi t as 6t -» 0, in continuous tim e t, th e probabilit y that the elevator rises fro m floor 1 t o floor 2 is b 6t, and th e probabilit y that the elevator descends fro m floor 1 t o floor 0 is d 6t. Th e rati o of these tw o probabilitie s is b ld . Thi s is tru e for any value of continuous time. Hence it must be true, in particular , at the instant of transitio n (even though we 2
t f t
Ql
1 0
2i
x
t
x
x
e
t2
5.6
Discret e Model s of a Day In th e Lif e o f an Elevato r
197
do not know when that occurs in continuous time). Hence Ell
(5.85)
But P10+P12 = !• Solving these equations yields p {b d,) = b,. Thu s the transitio n matri x is l0
"
1
0
=
0 1
0
0
{
+ d,) - di,p (b t2
l
+
’
bi+d,
(5.86)
0
You can easily deduce fro m thi s that for k = 0, 1, 2, " p2*+l _
1
0
d\ 0 b,+d
0 "
x
1
0
p2*+2 _
d\ 0 bi+d, b,+d, 0
d\
0
1
0
0
b,+d,
(5.87)
Thus, if the elevator is certain t o start the day on the ground floor, then 7 (2º: + 1 ) = ( 1 , 0 , 0 ) * + ’ = ( 0 , 1 , 0) and ˆ
2
(2` : + 2 ) = ( 1 , 0 , 0 ) ˆ
2
*
+ 2
=
, 0,
bi+di
(5.88)
i.e., the elevator is certain t o be on the middl e floor after an odd number of transitions, but cannot possibly be on the middl e floor after an even number. Althoug h thi s result is obvious intuitively , it is quit e at odds wit h the result we obtained in (5.78). I t shows that, despite mathematical similar › ities, the tw o discrete-time elevator models discussed in thi s section are fundamentally different . I n the first model, tim e is measured linearly: each uni t of tim e corresponds t o one hour. I n the second model, tim e is mea› sure nonlinearly: on any particula r day, tw o transition s could be as close together as a fractio n of a minut e or as far apart as an hour or two. We anticipated thi s distinction by using / t o denote linear tim e and η t o denote nonlinear time. I n the first model, t = 9 means that precisely 9 hours have elapsed, but the number of transition s is unknown. I n th e second model, t = 9 means that precisely 9 transition s have occurred, but in an unknown number of hours. I n the first model, even though tim e has been treated as a discrete variable, the elevator’s history up t o tim e / includes a contin› uum of / hours, throughout most of which the elevator is waitin g at one floor or another. I n the second model, the elevator’s waitin g tim e is c o m› pletely ignored. It is the latter omission which precludes the second model fro m predictin g that th e elevator wil l ultimatel y spend a fixed proportio n of tim e at each floor.
198
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
A discrete-time Marko v model in which tim e is measured in thi s non› linear fashion is known in the literatur e on probabilit y as a Markov chain. Althoug h we restricted our attention above t o a Marko v chain wit h only thre e states, namely, / = 0 , 1 , 2, the extension of the model t o Ν + I states i s immediate. Indeed (5.83), (5.84), and the definitio n of in (5.81) are vali d for any value of N, and we need only replace 2 by ¸ ˆ in (5.82) t o make that valid, too. Th e distinction between a Marko v chain and th e discrete version of a linear-tim e Marko v model is often blurre d in the literature , because the passage of a unit of (linear) tim e can be defined t o correspond to a tran › sition. Both models are described as Marko v chains, and S is called a transitio n matrix . I n these last tw o respects, we wil l follow convention. Nevertheless, we wil l attempt t o preserve the theoretical distinction be› tween the tw o models by using η for tim e and for transitio n matri x when transition s correspond to physical events, but / for tim e and S for transitio n matri x when transition s are artificiall y defined as the passage of so many unit s of linear time. Th e periodic behavior that appears in (5.87) is caused by the fact that all entries on the leading diagonal of are zero. But most of the Marko v chains that are useful in practice, and all of those introduced henceforward in the main body of the text, have at least one nonzero on the leading diagonal of the transitio n matrix whic h is enough to prevent such periodicity . That single fact is virtuall y all that we need to know about periodicit y in Marko v chains, and we shall therefore not dwell on the topic; though we do discuss it further in the Exercises and in Section 6.1. Th e followin g example of a Marko v chain involves five states; thus Ν = 4. 4
5.7
Bird s in a Cage . A Birt h and Death Chai n
A cage i n a pet shop contains four budgerigars and is divided int o tw o sections by a trapeze in the middle. For convenience, we wil l label these sections Nort h and South. At each end of th e cage there is a food supply. Thu s the cage’s horizontal section appears as drawn in Fig. 5.3. Th e bird s spend almost all of their tim e i n the vicinit y of a food supply, either eating or resting. Every so often, however, one of the bird s wil l fly up t o th e trapeze and swing on it for a while, before flying down again t o rejoi n it s precious food supply. After swinging on the trapeze, a bir d forgets where it came fro m and is equally likel y t o fly down t o either end of the cage. Moreover, the bird s act independently of one another. Each Th e continuous-time model considered in the previous section is a special case of a Markov jump process, for which more general equations are developed in Exercise 10.8. 4
5.7
Bird s In a Cage . A Birt h an d Death Chai n
199
Ν F o od
Trapeze
F o od S
Fig. 5.3 Plan of bir d cage.
is equally likel y to be the next performin g artist. In these circumstances, can we predict where the bird s wil l be after, say, 20 trapeze acts, if initiall y they were all at the South end of the cage? We wil l model thi s system as a Marko v chain. The resulting model, if somewhat fanciful , wil l be extremely useful in Chapter 10 for th e purpose of introducin g semi-Markov processes . Let the random variabl e X(n) de› note the number of bird s at the Nort h end of th e cage at tim e n. Because ther e are four birds, it s sample space is { 0 , 1 , 2 , 3 , 4 }; i.e., the possible states of the system are / = 0 , 1 , 2 , 3 , 4. Let each trapeze act correspond t o a tran › sition. Then after each transition , the number of bird s at the Nort h end of the cage wil l either increase by one, decrease by one, or stay the same. Hence the transitio n matri x satisfies p = 0 unless / - 1 < j < i + 1. A Marko v chain wit h thi s propert y is known as a birth and death chain. Al l Marko v chains described in thi s chapter belong t o thi s category. Mor e general chains are introduced in Chapter 6. i}
Suppose that there is just one bir d at the Nort h end of th e cage, i.e., that X(n) = 1. Let U be the event that thi s bir d is next t o per› form ; hence U is the complementary event that one of the other bird s is next t o perform . Then, by assumption, Prob(CZ) = 1/4 and Prob(t7) = 1 - Prob(C/) = 3/4. Let V be the event that a bir d flies down to the opposite side of the cage after trapezing; hence V is th e complementary event that it return s whence it came. Then by assumption, V and V are independent of U and U, and Prob(J0 = Probit y = 1/2. Thus, on using (A.49), p = Prob(K n U) = Prob(F) • Prob(£/) = 1/2 • 1/4 = 1/8. Similarly , p = Prob(K n 0) = Prob(V) • Prob(C7) = 1/2 • 3/4 = 3/8. Th e cage wil l l0
l 2
200
Chapte r 5
Birt h and Death . Probablllatl c Dynamic *
remain in state 1 if either the bir d fro m the Nort h or a bir d fro m the South returns; i.e.,/> = P r o b ( ^ P r o b ( t f ) + P r o b ( P ) P r o b ( t / ) = Prob(P) = 1 / 2. I n thi s way, we have completely determined the second row of the transitio n matri x P. Continuin g in thi s fashion, you can easily check that u
Ø 3 0 Ø 3 5 I Ø I
( 5 . 8 9)
I
0
S 0
Notice that all terms on the leading diagonal are nonzero, so that there wil l be no periodicit y in powers of (see the remark s at the end of the previous section). Wit h ( 0 ) = ( 1 , 0 , 0 , 0 , 0 ), the cage distributio n after 2 0 trapeze acts is given by ( 2 0 ) = ( ,ˇ,ˇ,ˇ,ˇ) = ˆ
20
( 0 . 0 6 3 2 9 3 2 , 0 . 2 5 1 5 8 5 6 , 0 . 3 7 4 9 9 9 3 , 0 . 2 4 8 4 1 4 4 , 0 . 0 6 1 7 0,7 6 )
( 5 . 9 0)
on using ( 5 . 8 4 ). Notice that the expected number of bird s in the Nort h end of the cage at that tim e is j > , ( 2 0 )« i=0
( 5 . 9 1)
1 . 9 9 4,
which is close t o 2 . Notice also that O
N
,
R
/
11
1 3
1
IN
( 5 . 9 2)
You’v e probably guessed that, by analogy wit h the previous sections, ( 5 . 9 2) is tru e irrespective of where the bird s began; and after a large number of trapeze acts, th e expected number of bird s at either end of the cage would be indistinguishable fro m 2 . I n other words, the cage ultimatel y approaches a stationary distribution, the probabilisti c equivalent of an equilibrium . But already we’re talkin g about stationary distributions , and these are th e subject of the followin g chapter.
5.8
Trees in a Forest . A n Absorbin g Birt h and Death Chai n
Accordin g to Usher ( 1 9 6 7, p. 3 5 9 ), on which thi s section is based, the Scots pin e trees in the forest plantations at Corrour , in Scotland, are grouped int o classes according t o girth . There are six classes in all, which we shall label i = 0, 1, . . ., 5. Th e thinnest trees belong t o class 0 and the fattest t o class 5, wit h increasing i corresponding t o increasing girth . A census of trees is effectively taken once every six years. Let thi s be the unit of time, and let the passage of every sixth year be regarded as a transition . Then a Marko v chain wit h Ν = 5 can be used t o model th e dynamics of th e forest’s class structure, if we define X(I) t o be the class at tim e / of a
5.8
Trees In a Forest . A n Absorbin g Birt h and Death Chai n
201
randoml y chosen tree. The components of the resulting distributio n vector (/ ) wil l be interpreted as th e proportion s of trees in each class at tim e /. N o t e that by defining a transitio n t o take place once every unit of time, we make linear and nonlinear tim e equivalent (see the remark s at the end of the previous section). Let us assume that all trees reach ful l stature, i.e., enter class S, and are then felled. We wil l regard thi s sixth class as consisting both of felled and unfelled trees (of ful l stature). Once a tree has been felled, it remains forever felled. Thu s i = 5 ultimatel y "absorbs" all trees. I n other words, th e last row of the transitio n matri x S is given by s = 0 for 0 < j < 4 and j = 1. For thi s reason, i = 5 is called an absorbing state of the Marko v chain; and the Marko v chain itself is described as an absorbing chain. Now, the remaining classes are defined in such a way that, at the end of every six-year period, a tree wil l either remain in th e same class or have sufficient girt h t o move int o the class immediately above, but never sufficient girt h to skip a class. For 0 < i < 4, let a denote the probabilit y that a tree fro m class / remains in class / at the end of a census period. Then 1 - a is the probabilit y that it grows sufficiently t o m o ve int o class Ø+ 1. Thu s s = a Sjj = 1 - a, and i,y = 0 if j > i + 2. Moreover, because no tre e ever moves down a class, we have s^ = 0 for / > j ; i.e., the transitio n matri x S is upper triangular . Combinin g these results, we find that yj
5 5
t
i
n
h
+i
«0
S =
1 - a
0
0
0
a\
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I-a,
0
0 0
0
0
1 - ej a
0
0
0
"
(5.93)
l - e 1
4
4
Values for a , a,, a , a , and a are estimated i n Exercise 8.6 t o be 0.72, 0.69, 0.75, 0.77, and 0.63. I f we knew the forest’s initia l class structure, then it s structur e at the end of each six-year census period could now be determined fro m (5.84). Suppose, for example, that the structur e were initiall y uniform ; i.e., ( 0 ) = ( 1 / 6 , 1 / 6 , 1 / 6 , 1 / 6 , 1 / 6 , 1 / 6. ) Then, because 0
2
3
A
ˆ
S
5
=
0.1935
0.3462
0.3243
0.1165
0.0178
0 . 0 0 1 8’
0.0
0.1564
0.4180
0.3103
0.0900
0.0253
0.0
0.0
0.2373
0.4172
0.2128
0.1327
0.0
0.0
0.0
0.2707
0.2816
0.4477
0.0
0.0
0.0
0.0
0.0992
0.9008
0.0
0.0
0.0
0.0
0.0
1.0
(5.94)
th e class structur e after 30 years would be given by ( 5 ) = 7 r ( 0 ) S = ( 0 . 0 3 2 , 0 . 0 8 4 , 0 . 1 6 3 , 0 . 1 8 6 , 0 . 1 1 7 , 0 . 4 1. 8Thus, ) after 30 years, the percent› age of trees in class 2 would be almost as high as originally , and over 40% of the trees would have reached ful l stature. ˆ
T
5
202
Chapte r 5
Birt h and Death . Probabilisti c Dynamic s
Thi s model is of limite d value in its present form why ? How does a real forest differ from the one we have just discussed? Perhaps you would lik e to mull thi s question over. We’ll retur n to it in the following chapter, and again in Chapter 9.
Exercise s 5.1 Deduce (5.40) from (5.39). Verif y the expression for R(i) when Ν = 3. 5.2 Deduce (5.46) from (5.45). Verif y the expression for R(/) when Ν = 3. Show that the Poisson distributio n (5.49) has mean Bt; i.e., verify that oo
J2kProb(A(t) = k) = Bt. *= Ø 5.3 The birt h rate in a pure birt h model need not be constant (independent of 0. It may, for example, increase linearly with /. Show that if b, = Bi,
1 < Ø< oo
then the entries of the upper triangular matri x R(f) are given by
Here ¸ ” is denned as the product of all integers between 1 and K; i.e., Kl = 1 • 2 • 3 • • • (K - 1) • K, with 0! = 1. Note that the lowest state of the population is i = 1, because b = 0 would mean that the population could never exist. In other words, the first row and column of the matri x R(0> as denned in Chapter 5, must be deleted. Hint: The result can be deduced from (5.46) by fixing i and performing mathematical induction on j . 0
5.4 Obtain (5.54). Hint: For \x\ < 1, the Taylor series
-
ι χ
Η
converges absolutely and may be differentiated term by term. Choose suit› able x. 5.5 Solve equations (5.64) and deduce (5.65) as a special case of your answer. "5. 6 In the three-storey buildin g considered in Section 5.5, executives approach the elevator/staircase area at the same rate on each floor, but ground floor executives always want to get to the top, middle floor executives are equally likel y to go up or down, and three-quarters of top floor executives who use the elevator are leaving the building. Show that the elevator is least likely to end its day on the middl e floor and most likely to finish on top.
Exercise s
203
*5.7 The time until failur e of a machine in a factory has exponential distributio n wit h mean 1/D. The repair tim e has exponential distributio n with mean IAS. If the machine is workin g at the beginning of a nine-hour day, show that Β+
De-
9iB+D)
B+D is the probabilit y that it will still be workin g at the end of it. *5.8 Suppose that the bird s in Section 5.7 have excellent memories, always re› member where they came from and, after swinging on the trapeze in the center of the cage, always fly down to the side opposite whence they came. Writ e down the transition matri x that describes these new circumstances. 5.9 In Exercise 5.8, what do you notice about (i) odd powers of P, (ii ) even powers of P? You should see a pattern emerging after you have computed six or seven powers of P. *5.10 An extremely enthusiastic individual decides to found a new religion. He persuades some friends to join , then all new members tr y to enlist as many new members as possible. Do you think that the early growth of thi s religion could be modelled adequately by treating new members as arrival s in a Poisson process? Why or why not? If not, which other model encountered in thi s chapter might prove adequate? *5.11 A U.S. female born in 1966 had a 98% chance of survivin g the first year of life. If she survived the first year of life, then she had a 99.48% chance of survivin g until her tenth birthday . The conditional probabilitie s of surviving various other "milestone" birthday s are given by the following table.
Milestone birthda y
Probabilit y of reaching this birthda y alive, given that the previous birthda y has been reached
1 10 20 30 45 60 70 85 115
0.9800 0.9948 0.9955 0.9920 0.9709 0.9061 0.8343 0.3911 0.0000
Use this data to construct a Marko v chain model, with ten states, that describes the passage through lif e of a female born in 1966 in the United States. Identif y the lif e table probabilitie s /(l) , /(10), /(20), /(30), /(45), /(60),
204
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
/(70) and /(85) in Exercise 4.15 with entries of the -step transition matri x P\ In each case, give appropriat e values of i, j and n. (The values will differ slightly from those presented in Exercise 4.15 because of rounding error) . Which special features does your Marko v chain have whic h model in Chapter 5 does it most resemble? **5.12 A 4-state Marko v chain was used by Li u and Yao (1977) to model traffi c flow at a T-junction . Obtain a copy of Li u and Yao’s paper and read it. Do you think that the states of their Marko v chain have been well denned? Criticiz e their model, paying particular attention to the circumstances in which a car is able to enter the minor road. Would you accept their model, would you reject their model, or can you improve their model? *5.13 Fig. E5.1 is plan of a T-junction . There is no left-tur n lane on the major road, which runs north and south. A driver who wishes to turn left, i.e., west, from the major road must remain in a waiting zone, marked "wai t here" in the diagram, until the "danger zone" in the southbound lane is clear. Naturally , if southbound traffi c is heavy and many driver s wish to go west, then northbound traffi c may be seriously interrupted . In this exercise, we will attempt to use a 4-state, nonlinear-time Marko v chain to model the severity of such interruptions . Let us make the following definitions: a: Probabilit y that a northbound driver , having reached the waiting zone, wishes to tur n left. (Imagine that the decision whether to tur n or not is not made until after the junction has been reached.)
Nort h D a n g er z o ne
Fig. E5.1
Exercise s
205
b: Probabilit y that a left-turnin g driver will be able to enter the minor road immediately after the next southbound car has left the danger zone (given that a driver is waiting to tur n left and that at least one car is blocking the danger zone). º : Mean southbound flow, in numbers of cars per unit of time. : Mean northbound flow, in number of cars per unit of time. p. Probabilit y that a northbound car enters the waiting zone before a southbound car enters the danger zone, given that the waiting zone and danger zone are both clear. Assume that at most one northbound car can wait in the waiting zone (whereas more than one southbound car may occupy the danger zone). q: Probabilit y that a northbound car enters the waiting zone, either to tur n or to go forward , before the southbound car approaching the junctio n can leave the danger zone, given that the danger zone is blocked but the waiting zone clear. T: Minimu m time gap in southbound flow that a left-turnin g driver requires to cross it safely. Assume that the danger zone is denned in terms of this tim e rather than in terms of a distance. Thus the danger zone is clear if and only if the next southbound car is at least Τ seconds away from the junction . Let there be four possible states in which the T-junctio n can be at any given instant, and let the random variable X(l) have sample space {0,1,2,3). Let X(t) = 0 if the danger zone and waiting zone are both occu› pied. Let X(t) = 3 if the danger zone and waiting zone are both clear. Let transition s between states occur as indicated in Fig. E5.1, by arrows over solid bars. For example, a transition occurs if a southbound car turn s right or goes forwar d at the junction . (i) In terms of b, what is p = Prob(A"( n + 1) = 0 | X{n) = 0)? Writ e down the values of p 3 = Œ> (`ˆ(/ Ø+ 1) = 3 | X(n) = 0) and p = Prob(;T(« + 1) = 3 I X(n) = 3). (ii ) Define states 1 and 2. Hence writ e down a transition matri x for a Marko v chain, in terms of a, b, p, and q. (iii ) Suppose that southbound cars arriv e according to a Poisson process. Express b as a function of º and T. (iv) Suppose that northbound cars arriv e according to a Poisson process when the northbound lane is clear, and consider the following argument. Let X{t) = 3. Let random variables Ν and S denote the times that elapse before the next northbound and southbound cars, respectively, arrive. Be› cause interarriva l times in a Poisson process are exponentially distributed, 0 0
3 3
0
Prob(/V > t) = e Prob(5 > r ) = e
(a) (b)
Hence the join t probabilit y density function of S and Ν is given by ,- ,º +
)
0
<
Γ,ί <
(c)
OO.
Thus ρ = Prob(iV < S) =
if Jo
Ar,t)dtd Jo
T
=
º +
’
(d)
206
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
Because b is known as a function of A and Τ from part (iii) , and because q can be found as a function of and ˆ by a calculation similar to (d), the transition matri x is effectively expressed as a function of Æ, º , , and ˆ . Hence the probabilit y that the northbound lane will be blocked at the T-junctio n can be determined for arbitrar y values of Æ, º , μ and Τ. Do you accept or reject thi s argument? Note. There is nothing wrong wit h (c), and the integral in (d) has been evaluated correctly. * 5.14 Measles broke out on the campuses of Baylor University, Indiana Univer› sity, and Florid a State University in, respectively, September of 1982, Febru› ary of 1983, and January of 1986. Each of these outbreaks was controlled by mass immunization of the entire campus, which took place after the disease had been detected. Data pertaining to the three epidemics are contained in the following table, which was obtained from Scime (1986):
University
Number of days from first Total number of day of communicability to infections first day of vaccinations
Baylor Indian a F.S.U.
26 11 7
102 67 4
Total population 10,320 32,000 23,000
According to Scime, the FSU and Baylor outbreaks originated from a single infected person; whereas the Indiana outbreak appeared to origi› nate from several. Moreover, about 3.2% of college-age people are currentl y "susceptible" to measles, i.e., can contract the disease upon contact with an infected person. But an infected person is "infective, " i.e., can transmit the disease to a susceptible person, for a period of only ten days. Thereafter, he recovers and becomes immune (as well as noninfective). Can you construct a simple model of a measles epidemic that is con› sistent with these data? Can you estimate how many infections, say, FSU would have had if they had waited as long as Baylor to vaccinate? Hint: You wil l obviously have to make some fairl y heroic assumptions, so don’t be shy.
Supplementar y Note s 5.1 The material in this section is based on Noble (1967, Section 15.3) and Gerlough and Barnes (1971, p. 60-63), whose walking speed we adopt. Neverthe› less, the derivation of the maximum safe traffi c flow is entirely original and avoids a shortcoming in the analyses of Noble and Gerlough and Barnes. By using different arguments, the earlier authors essentially find that 2 1 0.
/ 2 10
Supplementar y Note *
207
Thi s is negative for roads wider than 210 feet a n absurd result! Although this absurdity may have no practical consequenc e (because relevant values of d are much less than 210), it still seems preferable to dispense with it.
~
6
STATIONAR Y DISTRIBUTIONS
I n Chapters 1 and 2 we met several kind s of dynamical systems. I n partic › ular , we met continuous-time systems described by differentia l equations of the for m dx - ^ = œ , Æ, )
0 < f < c x >,
(6.1)
where x(f) was an -dimensiona l vector, Æ an m-dimensional constant vec› tor , and f an -dimensiona l vector function; and we met discrete-time sys› tems described by recurrence relations of the for m x = F(x ), η = 0, 1, 2, 3 A more general discrete-time dynamical system would have th e for m + 1
x
+ 1
= F(x ) ,
« = 0 , 1 , 2 , 3 , . . .,
n
(6.2)
where x is an .TV-dimensional vector and F an ^-dimensional vector func› tion . W e found that such dynamical systems could have equilibria , states that would persist forever if undisturbed. We agreed, moreover, that any equilibriu m observed in natur e would be a stable one, t o which, after a small perturbation , the system would spend the rest of it s lif e returning . Potentially stable equilibri a = *(Æ) of (6.1) could be identified as the solutions of the