A Concret e Approac h to Mathematica l Modellin g
This page intentionally left blank
A Concret e Approac h to Mathematica l Modellin g
Mike Mesterto η-Gibbons Department of Mathematics Florida State University, Tallahassee
A
W i l e y - l n t e r s c i e n c
e
P u b l i c a t i o n
JOHN WILEY & SONS, INC. N e w
Y o r k
•
C h i c h e s t e r
•
B r i s b a n e
•
T o r o n t o
•
S i n g a p o r e
Copyrigh t '
1995, 2 0 07 by John W i l e y & Sons, Inc. Al l rights reserved.
Published by John W i l e y & Sons, Inc., Hoboken, N ew Jersey. Published simultaneously in Canada. N o part of thi s publication may be reproduced, stored in a retrieval system, or transmitted in any for m or by any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except as permitte d under Section 107 or 108 of the 1976 United States Copyright Act , without either the prio r writte n permission of the Publisher, or authorization through payment of th e appropriat e per-copy fee to th e Copyright Clearance Center, Inc., 2 22 R o s e w o od Drive, Danvers, M A 0 1 9 2 3, (978) 7 5 0 - 8 4 0 0, fax (978) 7 5 0 - 4 4 7 0, or on the w eb at w w w . c o p y r i g h t . c o m. Requests to the Publisher for permission should be addressed to the Permissions Department, John W i l e y & Sons, Inc., 111 River Street, Hoboken, NJ 0 7 0 3 0, ( 2 0 1) 7 4 8 - 6 0 1 1, fax ( 2 0 1) 7 4 8 - 6 0 0 8, or onlin e at http://www.wiley.com/go/permission. Limi t of Liability/Disclaime r of Warranty : Whil e the publisher and author have used their best effort s in preparin g thi s book, they make no representations or warrantie s wit h respect to the accuracy or completeness of the contents of thi s book and specifically disclaim any implie d warrantie s of merchantabilit y or fitness for a particula r purpose. No warrant y may be created or extended by sales representatives or writte n sales materials. Th e advice and strategies contained herein may not be suitable for your situation. Y ou should consult wit h a professional where appropriate. Neither the publisher nor author shall be liabl e for any loss of profi t or any other commercial damages, includin g but not limite d t o special, incidental, consequential, or other damages. For general informatio n on our other products and services or for technical support, please contact our Customer Care Department withi n the United States at (800) 7 6 2 - 2 9 7 4, outside the United States at (317) 5 7 2 - 3 9 93 or fax ( 3 1 7) 5 7 2 - 4 0 0 2. Wile y also publishes it s books in a variety of electronic formats. S o me content that appears in prin t may not be available in electronic format . For informatio n about Wile y products, visit our w eb site at w w w . w i l e y . c o m.
Library
of Congress
Cataloging-in-Publication
ISBN 9 7 8 - 0 - 4 7 0 - 1 7 1 0 73-
10
9 8 7 6 5 4 3 21
Data is
available.
To thre e cherishe d nonmathematicians : t o my Mother who once said, "I f they pay you to do all those squiggles, small wonder the world’ s i n a mess."
t o my Father who said it was better than workin g in a factory.
and to Karen who says if you want to know the meaning of infinity , just ask someone whose spouse is writin g a math book.
This page intentionally left blank
PREFACE
Controversy has persisted in recent years over how to teach mathemati› cal modelling. There are two extreme schools of thought. One believes that a modelling course should have littl e structur e and be dominated by "case studies," open-ended exercises requirin g data collection and research. These might lead students down a great many unforeseen avenues of cre› ativit y but might also lead them nowhere. Th e other school believes that a modelling course should be highly structured and dominated by what, for want of a better phrase, I wil l refer to as "modellin g exercises." These are exercises that involve formulatio n and interpretatio n but bear a more certain relationship to the principa l content of the course. Between these tw o extremes, of course, li e many compromises, one of which form s the basis for thi s textbook. Before describing it, however, let me argue that there is an importan t sense in which the second school of thought should take precedence over the first . Most college major s in mathematics do not become professional mathematicians. Rather, they joi n the graduate workforc e as businesspeo ple, as financial planners, as politicians, or in a number of other careers, and it is far more importan t that they can understand, interpret , criticize, and appreciate the mathematical models of others than that they are able to develop their own models. Just as driver s need not buil d and repair their cars but should know how they work , so consumers of mathematical models need not produce them but should understand both their useful› ness and their limitations . Naturally , it remains desirable that math major s be able to develop their own models, but thi s is essential only to the few who subsequently make model development their career. On the other hand, the capacity to understand, interpret , criticize, and appreciate models is essential to all. Wit h thi s in mind, I have writte n thi s text for the deserving many, not simply a chosen few. Yet I have not neglected the specific needs of vi i
vii i
Prefac e
those w ho aspire to buildin g their own models, although I have not explicitly addressed them unti l relatively late in the book. Thi s is deliberate. Between the two extreme schools of thought thi s book has adopted a dy› namic compromise, in which it begins by espousing the second extreme and gradually evolves toward the first. Thi s approach enables the book to emphasize both the validation of mathematical models and the rational e behind improvin g them. Each of these features is novel, as wil l be clear to anyone familia r wit h Murth y and Rodin’s (1987) review of books on mathematical modelling. Thi s is a book about the process of modelling. It s approach is heuristic but systematic an d embodies my belief that the three most fundamental ideas in mathematical modelling are transience, permanence, and optimal› l y . Because models incorporatin g these ideas may adopt either a deter› ministi c or a probabilisti c viewpoint, there are six combinations of idea and viewpoint. These define the structur e of Chapters 1-3 and Chapters 5 -7 of the text, which proceed in parallel as depicted in the followin g diagram.
View
Idea
Transience
Chapter 1 Deterministic Growth and Decay. Dynamical Systems Probabilistic
Permanence Chapter 2 Equilibriu m
Optimalit y Chapter 3 Optimal Control and Utilit y
Chapter 5 Chapter 6 Chapter 7 Birt h and Death. Stationary Optimal Decision Probabilistic Systems Distribution s and Reward
I n applying these ideas, mathematical modellers are called upon to play conflictin g roles. On the one hand, they must be creative artists, assum› in g boldly perhaps what no one has assumed before. On the other hand, they must be critics, scrupulously doubting whether their models provid e an adequate description of reality . In practice, of course, the distinctions I have drawn between ideas, roles, and even viewpoints are artificial ; but it greatly benefits a beginning student of mathematical modelling to focus on a single aspect at a time, even though the other aspects cannot be en› tirel y ignored. Accordingly, the critica l aspect of modelling is the subject of Chapter 4, it s creative aspect the subject of Chapter 9, and the inter› face between the two the subject of Chapter 8. The remainder of the book, Chapters 1 0 - 1 2, is a reinforcement of the ideas developed in the first nine chapters.
Preface
ix
Th e goal of thi s book is to let readers acquire both critica l and cre› ative modelling skill s and the confidence to use them. Al l other matters are regarded as secondary. Thus, as far as is possible, technical mathemat› ical details are explored in exercises, or occasionally in footnotes, rather than in the main body of text. To distinguish such purely technical exer› cises fro m those that are more directl y related to the goals of the book, modelling exercises are denoted by a single asterisk and case studies by a double asterisk. But not every detail has found it s way int o a footnote or exercise, and the book cannot be used profitabl y unless pencil and paper at all times accompany the reader. The book is to be studied, not simply read. Th e book’s goal is pursued through a layered approach, wit h frequent revisitations to earlier sections, so that even the most sophisticated mod› els are perceived as merely natural outgrowths of less sophisticated ones. A s proclaimed in the title , thi s layered approach is unashamedly concrete. Philosophical points are not discussed unti l several illustrator y examples have already been introduced. Even then the discussion is brief, as at the beginning of Chapter 4, or in Chapter 9, where the art of adapting, extend› ing, and combining is first discussed formally , even though it characterizes every model developed in the text. At all times, I have tried to avoid un› necessary abstractions. I have taken particular care never to introduc e a utilit y function as F(x), wit h constraints on the signs of the derivatives of F; instead, I give the dependence of F on χ explicitly , so that proper› ties of the derivatives are self-evident. The loss of generality is more than compensated by the gain in comprehension. Indeed my experience suggests that the educational value of a modelling course to the average student is decided by thi s factor more than by any other. Thi s book is primaril y intended for a senior level course that gives equal weight to deterministic and probabilisti c modelling. Accordingly, min› imal mathematical prerequisites for mastery of it s entire contents are the standard calculus sequence (includin g the Newton-Raphson method) and first courses in linear algebra, ordinar y differentia l equations, and probabil › it y and statistics. Probabilit y and statistics are reviewed in Appendix 1. A few sections requir e access to computer packages for solving linear pro› grams or ordinar y differentia l equations (now almost universally available), whil e some knowledge of numerical analysis is desirable (though by no means necessary). A modelling course need not include the book’s entir e contents, however, and alternativ e uses are described in an accompanying instructor’ s manual. I n particular , there is ample material in Chapters 1 -4 and Chapters 8 - 11 for a course that requires no probabilit y and statistics. But thi s book is designed to be also suitable for study alone, perhaps by beginning graduate students or by professionals whose background in mathematical modelling is weak. For thi s reason, if an exercise is crucial
Prefac e
to later developments and of even moderate difficulty , then it s solution (or a possible solution) appears at the back of the book. I therefore assume that my readers are matur e enough not to consult a solution until a seri› ous attempt has been made at the problem. Solutions to most other exercises appear in the instructor’ s manual. By using plural s and genderless singulars, I have thus far avoided the vexed question of whether my reader is male or female. The lack of epicene pronouns and possessiv e adjectives in the English language is regrettable, and I have long advocated the use of "their " to mean "hi s or her." But grammarians may be offended by this, and the continual use of "hi s or her" is deplorably inelegant. I therefore felt that odd-numbered chapters should have one gender, even-numbered chapters another, and the toss of a coin decided that males would be odd, females even. Thus Chapters 1, 3, 5, 7, 9, and 11 are male, and Chapters 2, 4, 6, 8, 10, and 12 are fe› male. Thi s convention is not without minor inconveniences fo r example, the forester we meet in Chapter 3 has to change his sex before she enters Chapter 4 bu t thi s is surely preferable to the alternatives. Th e reviews of the first edition of thi s book have all been very positive and pleasing. I haven’t fixed what isn’t broken. Nevertheless, for thi s revised edition I have corrected all known errors, I have added a few exercises, and I have updated both the list of references and other time-sensitive material. Finally , thi s is a substantially original book. Th e models are based on the scientific literature , specifically, on the sources identified in Appendix 2. But I have made it a point of honor to personalize each model by derivin g it fro m scratch, startin g wit h a blank piece of paper and workin g through all the details myself. Thi s has led not only to differences of emphasis and approach but also to new extensions and variations. Moreover, not only are models freely adapted, they are presented here in a fresh perspective, as the inter › lockin g fragments of a mosaic. Thi s is my mosaic of the modelling process, carefully assembled fro m my teaching experience, in which every fragment contributes to the synthesis of a coherent picture. What the pictur e shows me is that even a modest amount of mathematics n o more than should be ex› pected of every college major in business, science, or engineering i s enough to describe a wid e variety of phenomena, offer penetrating insights, and con› tribut e effectively to rational decision making. If that is also what the pictur e shows my readers, then I shall be satisfied wit h what I have written .
Acknowledgemen t I am deeply indebted to the many scientists whose mathematical models have formed a basis for thi s textbook. I wish to express my thanks to all of them, and to each in a measure proportiona l to my indebtedness.
Acknowledgemen t
xl
I wish to thank Lou Gross for constructive and valuable criticis m of the original manuscript, Steve Blumsack and Christopher Fye for discovering er› rors, and Charli e Nam for suggestions concerning the literature . I wish also to thank John Wiley & Sons for their support, cooperation, and professionalism in producing thi s revised edition. Most of all, I would lik e to express my deepest gratitud e to Karen, my wife, in whose space and tim e thi s book was written . Withou t her patience, encouragement and humor, it would never have been possible to complete the manuscript. Tallahassee, Florida
M I K E
M e s t e r t o n - G i b b o n
s
This page intentionally left blank
CONTENTS
An ABC of modelling I
xix
The Deterministi c View
1 Growth and decay. Dynamical systems 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 1.10 1.11 1.12 1.13 1.14
Decay of pollution. Lake purification Radioactive decay Plant growth A simple ecosyste m A second simple ecosyste m Economic growth Metered growth (or decay) models Salmon dynamics A model of U.S. population growth Chemical dynamics More chemical dynamics Rowing dynamics Traffic dynamics Dimensionality, scaling, and units Exercises
2 Equilibrium
3 5 7 7 8 11 13 21 23 26 29 30 32 34 35 40 46
2.1 The equilibrium concentratio n of contaminan t in a lake 2.2 Rowing in equilibrium 2.3 How fast do cars drive through a tunnel? 2.4 Salmon equilibrium and limit cycles xli i
52 53 57 58
xl v
Content s
2.5 2.6 2.7 2.8
H o w much heat loss can double-glazing prevent? Wh y are pipes circular ? Equilibriu m shifts How quickl y must driver s react to preserve an equilibrium ? Exercises
Optima l control and utilit y 3.1 3.2 3.3 3.4 3.5 3.6 3.7
H o w fast should a bir d fly when migrating ? H o w big a pay increase should a professor receive? H o w many worker s should industr y employ? When should a forest be cut? H o w dense should traffi c be in a tunnel? H o w much pesticide should a crop grower use an d when? H o w many boats i n a fishing fleet should be operational? Exercises
63 66 71 76 83 91 93 95 103 104 109 111 115 119
II Validatin g a Model 4
Validation : accept, improve, or reject
127
4.1 4.2 4.3 4.4 4.5 4.6 4.7 4.8 4.9 4.10 4.11 4.12 4.13 4.14 4.15
127 128 129 130 132 136 138 142 146 148 151 154 157 159
A model of U.S. population growth Cleaning Lak e Ontari o Plant growth Th e speed of a boat Th e extent of bir d migratio n Th e speed of cars in a tunnel Th e stabilit y of cars in a tunnel Th e forest rotatio n tim e Crop spraying H ow righ t was Poiseuille? Competing species Predator-prey oscillations Sockeye swings, paradigms, and complexity Optimal fleet size and higher paradigms On the advantages of flexibility in prescriptiv e models Exercises
161 163
Content s
xv
III The Probabilisti c View 5
Birt h and death. Probabilistic dynamics 5.1 5.2 5.3 5.4 5.5 5.6 5.7 5.8
When wil l an old man die? Th e exponential distributio n When wil l Ν men die? A pur e death process Formin g a queue. A pur e birt h process How busy must a road be t o requir e a pedestrian crossing control? Th e rise and fall of the company executive Discrete models of a day in th e lif e of an elevator Bird s in a cage. A birt h and death chain Trees in a forest. A n absorbing birt h and death chain Exercises
6 Stationary distribution s 6.1 6.2 6.3 6.4 6.5 6.6 6.7
7
Th e certainty of death Elevator stationarity . Th e stationary birt h and death process H ow long is the queue at the checkout? A first look H ow long is the queue at the checkout? A second look H ow long must someone wait at the checkout? Another view Th e structur e of the work force When does a T-junctio n requir e a left-tur n lane? Exercises
Optimal decision and reward 7.1 7.2 7.3 7.4 7.5 7.6 7.7 7.8
How much should a buyer buy? A first look H ow many roses for Valentine’s Day? H ow much should a buyer buy? A second look H ow much should a retailer spend on advertising? H ow much should a buyer buy? A thir d look Wh y don’t fast-food restaurants guarantee service times any more? When should o ne barber employ another? Comparin g alternatives On the subjectiveness of decision making Exercises
175 180 183 185 187 189 193 198 2 00 2 02
208 2 10 2 13 215 2 17 219 225 227 2 34
237 237 2 43 245 247 253 2 58 2 63 267 268
xv i
Content s
IV The Art of Applicatio n 8
Using a model: choice and estimation 8.1 8.2 8.3 8.4 8.5 8.6 8.7 8.8
9
Protecting the cargo boat. A message in a bottl e Oil extraction. Choosing an optimal harvesting model Models withi n models. Choosing a behavioral response function Estimating parameters for fitted curves: an error control problem Assigning probabilities: a brief overview Empirica l probabilit y assignment Choosing theoretical distribution s and estimating their parameters Choosing a utilit y function. Cautious attitudes to risk Exercises
Buildin g a model: adapting, extending, and combining 9.1 9.2 9.3 9.4 9.5 9.6 9.7
H ow many papers should a news vendor buy? An adaptation Whic h trees in a forest should be felled? A combination Cleaning Lak e Ontario . A n adaptation Cleaning Lak e Ontario . A n extension Pure diffusion of pollutants. A combination Modellin g a population’s age structure. A first attempt Modellin g a population’s age structure. A second attempt Exercises
275 276 279 281 285 291 2 93 304 316 322 327 328 329 334 337 345 350 360 373
V Towar d More Advance d Model s 10
Further dynamical systems
383
10.1 10.2 10.3
383 389
10.4 10.5
How does a fetus get glucose fro m it s mother? A limit-cycl e ecosystem model D o es increasing the money supply raise or lower interest rates? Linearizin g time: Th e semi-Markov process. A n extension A more general semi-Markov process. A furthe r extension
393 398 406
Content s
10.6
11
409 412
Further flow and diffusion
416
11.1 11.2
417
11.3 11.4 11.5 11.6 11.7 11.8
12
Wh o wil l govern Britai n in the twenty-firs t century? A combination Exercises
xvl l
Unsteady heat conduction. An adaptation How does traffi c move after the trai n has gone by? A first look How does traffi c move after the trai n has gone by? A second look Avoidin g a crash at the other end. A combination Spreading canal pollution . An adaptation Flow and diffusion in a tube: a generic model River cleaning. Th e Streeter-Phelps model Wh y does a stopped organ pipe sound an octave lower than an open one? Exercises
Further optimization 12.1 12.2 12.3 12.4 12.5 12.6
Findin g an optimal policy by dynamic programmin g Th e interviewer’ s dilemma. An optimal stopping problem A faculty hirin g model Th e motorist’ s dilemma. Choosing the optimal parkin g space How should a bir d select worms? A n adaptation Where should an insect lay eggs? A combination Exercises
421 423 429 433 436 440 446 4 54 458 458 465 4 70 475 479 496 507
Epilogue
514
Appendix 1: A review of probabilit y and statistics
516
Appendix 2: Models, sources, and furthe r reading arranged by discipline
531
Solutions to selected exercises
539
References
583
Index
591
This page intentionally left blank
AN AB C OF MODELLIN G
is fo r Assume . I f your mathematical experience has taught you never to assume what you are not given, then thi s book wil l startl e you. What you are given is rarel y enough, so you wil l have to make assumptions abou t what is importan t and what is not, about what is assured beyond reasonable doubt and what i s still open to question. Indeed, in a very real sense, a model is simply the assumptions you make. Mathematics enables you to deduce, fro m those assumptions, conclusions which (a) might otherwise not be so readily ap› parent and (b) can be compared wit h observations of the real phenomenon that your abstract model attempts t o explain. The degree of correspon› dence determines the value of the model. Poor agreement does not (or should not!) suggest that the mathematics is wrong, however, but rather that one (or more) of the assumptions you made is of doubtful validity . Then you modify your model (i.e., modify your assumptions), and the merry-go-roun d begins again.
is fo r Borrow . Wh y borrow ? A mathematical model is an attempt to capture, in abstract form , the essential characteristics of an observed phenomenon. Th e success of the attempt depends as much (if not more) on the modeller’s empirical xi x
xx
A n AB C of Modellin g
knowledge of that phenomenon as on her or his mathematical ability . What do you do if you have neither the knowledge nor the tim e to acquire it ? Th e answer is that you borro w your assumptions, fro m the scientific literatur e or fro m more experienced colleagues (being sure, of course, t o acknowledge your sources). Wit h due respect t o geniuses, it is much more practical t o buil d upon existing models than it is to start fro m scratch. So you must be prepared to borro w freely. Yet therein lies a danger, the danger that you wil l accept too readily the authorit y of the printe d word . Hence . ..
is fo r Criticize . You must be prepared to criticize, too; prepared t o criticiz e not only your own assumptions but also those you have borrowed fro m other people. Wh o is t o say if they are righ t or wrong? Th e answer is you! Modellin g is an iterativ e process. You begin by assuming or borrowing ; wit h the help of mathematics, you reach conclusions; you criticiz e them; if you are not satisfied then you assume or borro w again, conclude and criticiz e again, and so on, unti l eventually you are satisfied (that the model explains th e observations). Don’t forget the ABC . Assume. Borrow . Criticize .
D
is for , amon g othe r things , Decay .
Whic h bring s us nicely t o Chapter 1.
A Concret e Approac h to Mathematica l Modellin g
This page intentionally left blank
Ζί GROWTH AND DECAY I DYNAMICA L SYSTEMS
One of the most useful concepts in mathematical modelling is that of net specific growth rate. We’ll begin thi s chapter by defining and derivin g an expression for it . At the same time, we’ll introduc e two of the most useful notations in applied mathematics, namely "bi g oh" and "littl e oh." Then, in several examples, we’ll see how useful net specific growth rat e can be. Let x(t) denote an appropriat e numerical measure, at tim e t, of the size or magnitude of a certain population. Examples of population magnitudes would be the number of million s of human beings in the world , the number of million s of dollar s in a firm’s capital stock, the dr y weight in kilogram s of a plant (which is just a population of cells), the biomass in tonnes of a fish population, and so on. Let b denote the rat e at which unit s are born or added t o the population for each existing unit of population; b is called th e instantaneous specific birt h rate. Then the number of unit s actually added to the population, in an infinitesimal interval of length St, is given approximately by b • 6t x. Wh y is it not exactly b-St-χΊ We supplied the adjective "instantaneous" above because b is generally changing wit h time; i.e., b - b(t). Thus, dur › ing the infinitesimal interval [/, t + 6t), b increases fro m b{t) to b{t + St). Similarly , χ increases fro m x(t) to x{t + 6t). On the other hand, the interval [/, / + St) is so short that, durin g it , b wil l not differ very much fro m b(t) and χ wil l not differ very much fro m x(0- We are assuming, of course, that b and χ are at least continuous functions of V, and we are about to assume that χ is also differentiable. I n a pur e mathematics text, we might feel obliged t o state such assumptions explicitl y whenever they were made. I n the process of modelling, however, the repetition of such purely math› ematical assumptions is apt to be distracting. We shall therefore assume, once and for all, that all functions used in thi s text have derivatives of as high an order as is necessary, the existence of the first derivativ e implyin g 3
4
Chapte r 1 Growt h and Decay . Dynamica l System *
continuity . Hence b = b(t) + terms that tend to zero as St
0;
χ = x(t) + terms that tend to zero as St
0.
But thi s is rather clumsy, so we introduc e some new notation. We define "bi g oh" by 0.
0{St) = terms that tend to zero as St
(1.1)
Thus, in "bi g oh" notation, b - b{t) + 0(St) and = x{t) + 0(6t). W e can now be more precise about the number o f unit s actually added t o the population in th e infinitesimal interval [t, t + St). I t is {b{t) + 0(St)}
.
• St • {x(t) + 0(St)}
(1.2)
Let d denote the rat e at which unit s di e or are removed fro m the population for each existing unit of population; d is called th e instantaneous specific death rate. Then th e number o f unit s actually removed fro m the population in th e infinitesimal interval [t, t + St) is {d(t) + 0(St)}
(1.3)
• St • {x(t) + 0(6t)),
by an argument similar t o that used above. Th e difference between (1.2) and (1.3) is the net number of unit s added to the population in the infinitesimal interval [/, t + 8t). But thi s is just the amount by which x(t) increases. Hence, writin g b in place of b(t), x{t + 6t)-
x(t) ={b+
0(St)}
-6ί·{χ+
0(St)) -{d+
0(St)} -St-{x+
0(6t)}. (1.4)
W e now define the net specific growth rat e μ t o be the net rat e at which unit s are added t o the population for each existing unit . Thu s i s the difference between the instantaneous specific birt h rat e b and the instantaneous specific death rat e d; i.e., μ = b- d. But fro m (1.4) we have xit + 6t)-x(t)
=
{
b
+
o
m
{
χ
+
0
{
6
t
)
_
}
{d+
o{6t)}
{x+
0{6t)}
. (1.5)
Takin g th e limi t as St — 0 (assumed t o exist), we have ^
= bx-dx=(b-d)x.
(1.6)
Hence μ=-
1 dx χ
Τ
ι
.
. . (1-7)
N o t e that x{t) is assumed t o be differentiabl e and hence continuous. A n appropriat e unit of magnitude is therefore very much larger than a typical increase (or decrease) in population. For example, we might count th e U. S. population in millions , because a millio n people is very much
1.1
Decay of Pollution . Lak e Purificatio n
5
mor e than the (discrete) number of people that can be added (are born) or removed (die) at any given instant. Note also that (1.4), though considerably tidier than if we had writte n 0(St) in words, is still rather clumsy. We can tid y it up a littl e bit by expanding the right-han d side to obtain (b - d)xSt + (b - d + x)St • 0(St) + St • 0(St ). (I n obtaining thi s expression, you should bear in mind that 0(St) - 0(6t) i s not zero but still 0(8t); whereas 0(St) • 0(St) = 0(St ).) We can tid y it up even more by writin g it as (b - d)xSt + 0(St). Unfortunately , thi s last expression, although correct, would not enable us to deduce (1.5), because w e cannot be sure that the result of dividin g O(St) by St would tend to zero as St 0. Thi s leads us naturall y to define "littl e oh" by 2
2
. _ Terms that are so small that we can divide them by ~~ St and the result will still tend to zero as <5i 0.
. ...
I t follows immediately that 6t • 0(61) = o(6t). Thi s allows us to writ e the right-han d side of (1.5) very succinctly as (b- d)x+ o(6t) and still retain sufficient informatio n to deduce equation (1.6). Littl e oh notation wil l be very useful later, particularl y in Chapter 5. By itself, (1.7) is not a mathematical model. It is simply a definitio n of th e net specific growth rat e μ, which might be a function of x, t, and a whole host of other variables and parameters. It may become a mathematical model, however, as soon as assumptions are made about the for m of that functio n (e.g., linear or quadrati c in x, independent of t, etc.). I n thi s book, th e source of these assumptions wil l usually be either borrowed knowledge or native wit (conceptual approach); but it could just as easily be supporting data (empirical approach), or some ad hoc combination of the two. N o source is invariabl y best in the initia l stages of modelling a phenomenon, though the ultimat e test of a model’s wort h is often it s abilit y to predict observable data. We’ll discuss that last point in Chapter 4. N ow let’s see the examples.
1.1
Decay of Pollution . Lak e Purificatio n
Let’ s consider a population of particles that contaminate a lake. Assume that the lake has constant volume Kcubi c meters. I f the lake is well mixed, then contamination wil l be almost unifor m throughout, and an appropriat e measure of the extent of pollutio n at tim e t wil l be the number of grams of contaminant per cubic meter of lake. We’ll denote thi s magnitude by x(t) and follow convention by calling it the concentration (of contaminant). Let r denote the rat e at which water flows out of the lake in cubic meters per day. Because the lake volume is constant, thi s must also be the rat e at which water flows in; there might, for example, be a balance between rainfal l and evaporation. I f all pollutio n input suddenly ceases , how much tim e wil l lapse before the level of pollutio n is reduced to 5% of it s initia l
Chapte r 1 Growt h and Decay . Dynamica l Sy»tem »
value? We have Rate of Change _ Pollution of Pollution Inflow -
4-Mt)-y}
=
0
Pollution Outflow
(1.9a)
rx{t),
whence \_dx _
_r_
(1.9b)
xdt~~V
Thi s is a special case of (1.7) wit h μ = -d = -rIV < 0. Th e net specific growt h rat e is strictl y negative, corresponding t o the decay of th e pollution . Let’ s assume that r is constant. Then (1.9) becomes a model, and (1.9b) i s readily solved t o yield x(t) = x(0)e\p(-rt/V)
,-rllV
= χ(0)β'
(1.10)
where exp denotes the exponential function and e = e x p ( l ). According t o th e model, the pollutio n decays t o 0.05x(0) in tim e V V IV = - l n ( 0 . 0 5 )- = l n ( 2 0 )- w , ( 1 . —) ….05 r r r where In denotes the natural logarith m (see Exercise i . l ) . W e could apply thi s result to the Great Lakes of Nort h America. Ac› cordin g to Rainey (1967, p. 1242), Lak e Erie, Lak e Michigan, and Lak e Superior have volumes 4 58 χ 10 , 4871 χ 1 0 and 12,221 χ 1 0 cubic meters, respectively; and their respective mean outflows are 479,582,208 ; 433,092,096; and 178,619,904 cubic meters per day. (Rainey quotes the outflow s in terms of liter s per second, so you must multipl y his figures by 24 χ 60 χ 60 -f- 1 0 = 86.4 for conversion to cubic meters per day.) Thus, for Lak e Erie, we have i os « 2861 days or 7.8 years. Similarly , f .05 « 3 3 , 6 93 days or 92 years for Lak e Michigan, and i .os « 2 0 4 , 9 65 days or 5 62 years for Lak e Superior. These values must, of course, be interpreted in the light of the initia l pollutio n levels x(0). 9
9
9
3
a
0
0
Our model is riddle d wit h assumptions. We have assumed that r is con› stant; maybe it varies seasonally. We have assumed that χ does not vary across the lake; maybe mixin g is insufficient t o justif y thi s assumption. We would not expect seasonal variatio n to matter much, however (see Exer› cise 1.1), and we would expect poor mixin g t o prolong th e cleaning. It’ s therefor e reasonable to suppose that (1.11) represents a lower bound th e most optimisti c cleaning time an d we have derived thi s useful piece of informatio n fro m a very simple model. Observe that, despite th e cessation of pollutio n input , (1-10) predicts that our lake can never be thoroughly purifie d in a finite time. D o es thi s make sense t o you? Perhaps you would lik e t o thin k about that. We’ll retur n t o the subject of lake purificatio n in Chapters 4 and 9.
1.3
1.2
Plan t Growt h
7
Radioactiv e Decay
Let’ s consider the population of radioactive atoms in some isotope of a chemical element, i.e., in a for m of the element wit h a given number of neutrons in the nucleus (all form s of the nucleus have the same number of protons). The conventional measure of that population’s size at tim e t is simply the number of such atoms present. Let thi s be denoted by x(t). We borro w fro m physical chemistry the result that radioactive isotopes decay at a constant specific rate, say º . Then (1.7) becomes a mathematical model wit h μ = -d = - A . Th e number of atoms is reduced by a factor of 2 in tim e
Thi s tim e is known as the half-lif e of the isotope. For example, the half-lif e of carbon-14, the isotope of carbon wit h 8 neutrons (and the obligatory 6 protons) in it s nucleus, is about 5,700 years. Note that the models introduced in Sections 1.1 and 1.2 have a com› mon mathematical structure. They are both examples of what is often re› ferred to as exponential decay.
1.3
Plan t Growt h
Let x(t) denote the dr y weight at tim e t of a plant that feeds off a fixed amount of a single substrate. Let the weight of substrate that remains at tim e / be denoted by S(t). Th e more substrate there is, the greater the specific growth rat e of the plant; the less substrate, the slower the growth. Th e simplest hypothesis that incorporates thi s observation is that (1.13)
μ = kS,
where A: is a constant. Note that (1.13) is not the only hypothesis incorporatin g the obser› and vation. Two of the infinitel y many other possibilities are μ = kS μ = kS . I n the absence of furthe r informatio n about the plant, however, we have no way of distinguishing between these possibilities. We therefore adopt the simplest. It might be a good hypothesis; if not, then we can alter it later. Th e rational e behind thi s strategy wil l be studied in Chapter 4. Adoptin g (1.13) and substituting int o (1.7): vl
411
(1.14) Let’ s assume no material is lost when 5 is converted int o x, i.e., that dx =
8
Chapte r 1 Growt h and Decay . Dynamica l System *
•
k.t i f
Fig. 1.1 Plant growth according to (1.16). The graph has been plotted in dimensionless variables, which will be discussed in Section 1.14; see (1.91). Meanwhile note that for given values of k, Xy, and x(0), the value of χ can be deduced from thi s diagram for any value of (. and (1.7) becomes a plant growth model, wit h μ = k{Xf-x). of thi s differentia l equation (Exercise 1.2) is ,. A
t
)
Th e solution
x{0)Xf
.. -
~ MP) + (x - JC(0)) e x p (- kx t) f
f
(
-
'
and is depicted in Fig. 1.1. Note that the graph is (mildly ) 5-shaped. It bends upward toward an inflection point, where x(t) = 0.5xp and then bends downward, approaching the horizontal asymptote χ = χ/ as t —• oo. Growt h according t o (1.15) or (1.16) is generally described as logistic. Observe that a real plant actually attains it s maximum dr y weight withi n a finite time; whereas (1.16) predicts that x(t) merely approaches Xf as t -* oo. A s we remarked in our AB C of modelling, however, a model attempts only t o capture the essential features of a phenomenon, not mimi c it in every respect. Empirica l data wil l determine the ultimat e wort h of the model con› tained in (1.15) or (1.16), but we were able t o derive it fro m a purely con› ceptual approach. I n fact (1.16) gives a fairl y good description of annual plant growth for appropriat e values of k and x \ see Thornley (1976). f
1.4
A Simpl e Ecosyste m
Let x{l) denote the number of thousands (say) of individuals, at tim e t, in a population of herbivores. Let y(t) be the corresponding size of a carnivor e
1.4
A Simpl e Ecosyste m
9
population. The carnivores eat the herbivores, and the herbivores eat grass. Thi s is the simple ecosystem that we shall attempt to model. By definition , the specific growth rates for the two populations are \dx
\dy
Let’ s borro w fro m biology: populations tend t o grow exponentially, i.e., at a constant specific rate, unti l some other factor (e.g., crowding, disease, predators) interferes wit h that growth. Hence, in the absence of carnivores, we might propose the followin g model for herbivor e growth: , = fl,, where a, > 0 is a constant, thi s positive net growth rat e for the herbivor e pop› ulatio n being the difference between a positive birt h rat e and a smaller positive death rate. But there are some carnivores, whose effect wil l be t o diminish the growth rat e of the herbivor e population. The simplest as› sumption we can make is that thi s decrease wil l be proportiona l to the number of carnivores. Hence /ii=fl i - V >
(1.18)
where b > 0 is a constant. Similarly , in the absence of herbivores, the carnivor e population would di e off exponentially (assuming that carnivores don’t eat grass). Th e appro› priat e model for thi s would be μ = -a , where a > 0 is constant. But ther e are some herbivores, whose effect wil l be to enlarge the growth rat e of th e carnivor e population. Let us again make the simplest assumption, i.e., that thi s increase wil l be proportiona l t o the number of herbivores. Then t
2
2
μ = -α 2
2
2
(1.19)
+ ΰ χ, 2
where b > 0 is a constant. From (1.17) (1.19) , we obtain the followin g pair of ordinar y differentia l equations for the growth and decay of the tw o populations in our simple ecosystem: 2
1
dx
,
\dy
œ¸
,
~yTt=- *
.,
+ *-
a
b
Λ η
.
( L 2 0 )
These equations, known as the Lotka-Volterr a equations, constitute a mathematical model in which a , a are pur e growth and decay rates and b , b are interaction parameters. As simple as they look, equations (1.20) cannot be solved analytically for χ and y as explicit functions of / in the same way that we solved (1.15) to obtain (1.16). They can, however, be solved "numerically, " i.e., by utilizin g a computer package, for any given values of a , b , a , b , x{0) and y(0). For a = 3, a = 5/2, b = 2, b = 1, x(0) = 1, and j>(0) = 1, the solution is plotted in Fig. 1.2. Th e IMS L computer package D V E R K produced these graphs, and it might be a useful exercise for you t o duplicate them (your computer center wil l have th e package, or a similar one, and wil l be able to show you how to use it) . {
x
x
2
2
2
{
2
2
{
2
K
10
Chapte r 1 Growt h and Decay . Dynamica l System *
.v.
Fig. 1.2 Solutions to (1.20) when a, = 3, a = 5/2, A, = 2, and b = 1. The solid curve is x(t); the dashed curve, y(t). 2
2
N o t e that the graphs of χ and y repeat themselves every 2.4 unit s of time. W e say that χ and y are periodic or cyclic, wit h period 2.4. Pair s of values (x(t),y(t)), representing Fig. 1.2’s solution in th e x-y plane, for m the outermost of th e closed curves depicted in Fig. 1.3. Th e arrow s denote the direction in which tim e increases. Th e remaining curves were obtained by repeating the entir e procedure for different values of (x(0),y(0)), namely, ( 3 / 2 , 1 ), (2,1), ( 5 / 2 , 2 ), and ( 3 , 3 / 2 ). Th e dot denotes th e degenerate closed curve (x(t),y{t)) = ( 5 / 2 , 3 / 2 ).
Ø ο Fig. 1.3 Phase-plane topology for solutions to (1.20). Curves were drawn for a = 3, a = 5/2, b = 2, b — 1, and for various values of x(0), y(0). Tim e increases in the direction of the arrows. See Exercise 1.3 for more details. x
2
t
2
1.5
A Secon d Simpl e Ecosyste m
11
Althoug h thi s diagram was drawn for a, = 3, a = 5/2, b = 2, and b = 1, it would look the same for any other set of parameter values in th e sense that all diagrams would be topologically equivalent. That’ s rather fortunate , because the particula r values chosen for illustratio n have no eco› logical significance! Fig. 1.3 is an example of a phase-plane diagram. An › other one appears in the followin g section, and they are furthe r discussed in Chapter 2. For any values of a,, b a , and b , the phase-plane diagram contains a degenerate closed curve (x(t),y(t)) = (ατ)ύ ,α^ ), which repre› sents a possible state of the ecosystem. Mor e generally, however, the model suggests a continual cycle of growth and decay. How good is thi s model ho w realistic are it s assumptions? That’ s an interesting and importan t question, but we’ll put it aside unti l Chapter 4. Meanwhile, if you are unfamilia r wit h diagrams lik e Fig. 1.3 (or Fig. 1.4.), then tr y Exercise 1.5. 2
{
2
lt
2
2
2
1.5
χ
A Secon d Simpl e Ecosyste m
Thi s time, let x(t) and y{t) denote th e numbers of thousands (say) of in› dividuals, at tim e t, in populations of tw o species that compete for the same food supply (herbivores for grass, say). Definition s (1.17) still apply, of course, but the model wil l have t o be altered. Thi s time, each species would grow exponentially in th e absence of the other; whereas, put together, each species would have a restrainin g effect on th e food supply of the other. We would expect thi s effect t o manifest itself as a decrease in growth rate. Let’ s assume that th e decrease for one population is proportiona l t o the size of the other population. Th e model we propose is therefore μ^ = a^-b^y,
(1.21)
μ = α -^χ, 2
2
where a , a are pur e growth rates and by, b are interaction (crowding) parameters. Th e growth or decay of the tw o populations is thus described by the pair of ordinar y differentia l equations {
2
2
1 dx x T t
, =
a
^
b
^
1 dy y T t
, =
a
* -
b
^
{
L
2
2
)
often called Gause’s equations; see, for example, Pielou (1977, p. 75). Th e first of th e equations agrees wit h (1.20), but th e second is different . Again, these seemingly innocuous equations can be solved completely only by numerical means. Nevertheless, by a similar procedure t o th e one used in Section 1.4, it can be shown that pair s of values (x(t), y(t)), representing the solutions t o (1.22) in the x-y plane, for m curves lik e those depicted in Fig. 1.4 (see Exercise 1.4). Thi s phase-plane diagram was drawn for a, = 3, a - 5/2, Z>, = 2, and b = 1; but the topology would be unaltered if we changed th e parameter values. Notice that all trajectorie s below the dashed curve 2
2
12
Chapte r 1 Growt h and Decay . Dynamica l Sy»tem »
y
A
5
4
3 2
2
0
3
4
5
Fig. 1.4 Phase-plane topology for solutions to (1.22). Curves were drawn for a = 3, a = 5/2, b = 2, b = 1, and for various values of x(0), y(0). The dashed curve is known as a separatrix. As in Fig. 1.3, tim e increases in the direction of the arrows. See Exercise 1.4 for more details. t
2
{
2
ON ultimatel y approach the x-axis, whereas all trajectorie s above ON ul› timatel y approach the y-axis. Because it’ s really too remarkabl e a coinci› dence that the point (x(0),y{0)) would just happen t o li e on th e special curv e ON (isn’t it?), our model suggests the ultimat e extinction of one or other of the tw o species, depending on the initia l population magnitudes. H o w good is thi s model ho w realistic are it s assumptions? Perhaps you would lik e t o consider that question; we’ll retur n t o it in Chapter 4. Meanwhile, before proceeding, we pause to observe that our simple ecosystem model is easily generalized to describe interactions among an arbitrar y number, n, of species, which we shall label as i = \,...,n. Let xXt) denote the population in thousands (say) of species Øat tim e t, i = 1, ..., n. Then the specific growth rate of species /’ is 1 dXf
(1.23)
These η equations are still just definitions, but they become a model as soon as we make assumptions about the for m of ,< . Let’ s suppose that μ, = / ^ ( , , Æ ), where = (x x ,...,x„) is an -dimensional column vector, Æ = (a a a ) is an m-dimensional vector of parameters, and a superscript Τ denotes transpose. Then our -species model has th e T
u
r
lt
2
m
2
1.6
Economi c Growt h
13
mathematical structur e of a system of η ordinar y differentia l equations: ~
= fi(x, t, a) = , ,
, /, a),
i - 1 , . . ., η.
(1.24)
Th e generic term for growth and decay is dynamics, and therefore the model (1.24) is said to for m a dynamical system. In exceptional circum› stances, an equivalent mathematical model of the for m x,(0 = 6 ( i ; x . a ) ,
Ø= 1
(1.25)
n,
where x = x(0) is an arbitrar y vector of initia l conditions and £,• a suitable function, may be deduced fro m (1.24). We saw thi s happen in Section 1.1, wit h χι = χ, η = 1, m = 1, and cti = r/V. We also saw it happen in Sec› tion 1.3, wit h Χι = χ, η = 1, m = 2, a = k, and a = X/. In thi s and the previous section, however, wit h η = 2, m = 4, and a = {a a , b\, b ), we saw only the for m (1.24); (1.25) was implici t in Fig. 1.3 and in Fig. 1.4, but we were unable to deduce it s for m explicitly . Althoug h th e differentia l equations (1.24) always for m a dynamical system, dynamical systems need not have the for m (1.24). A nondifferential dynamical system wil l first appear in Section 1.6. Dynamical systems expressed in terms of recurrence relations wil l first appear in Sections 1.7 and 1.8. A dynamical system expressed in terms of differential-delay equa› tion s wil l appear in Section 1.13. x
2
T
h
1.6
2
2
Economi c Growt h
A s we said at the beginning of the chapter, a model’s assumptions may be suggested either conceptually (by native wit ) or empiricall y (by supporting data). Hithert o we have been followin g th e conceptual approach. N ow let’s tak e the empirical one. For th e most part , the quantit y of goods produced by a society in› creases wit h time; or, which is exactly the same thing, th e society experi› ences economic growth. Why? Because manufacturers increase their output by hirin g more worker s and acquirin g more building s and machinery for them. But if thi s increased output must be shared by an increased work force, wil l anyone really be better off? Let’ s attempt t o answer thi s question by constructing a simple mathematical model. Let L(t) denote a suitable measure of th e amount of labor employed at tim e t, where t is measured in years, in the manufacturin g sector of a certain economy; for example, th e economy of Massachusetts. Let (2(0 denote the instantaneous annual output at tim e t, i.e., th e quantit y of goods per year produced at tim e t by thi s labor force. What do we mean by goods per year at tim e f? We mean that if the production rat e could somehow be held constant for a whole year beginning at tim e t, then the amount of goods produced in that year would be QXt). Provided, as we have assumed,
14
Chapte r 1
Growt h and Decay . Dynamica l System *
that tim e is measured in years, thi s is exactly the same thin g as saying that th e amount of goods produced in the short interval [t - bill, ι + Stll] is Q£t)5t + o(6t), or that the amount of goods produced in s years beginning at tim e t is ft+S
(1.26)
QXr)dr,
j
th e error term vanishing in the limi t of integration. Because "instantaneous annual output" is rather a mouthful , we’ll refer t o Q simply as output. I n producing thi s output, worker s need buildings, raw materials, ma› chinery, tools, and a variety of other aids. We’ll refer t o these aids collec› tivel y as capital stock, or simply capital. Let K{t) denote capital at tim e t. H o w should we measure the amount of labor i n numbers of work › ers, in numbers of hours worked, or in term s of some other unit ? An d how should we measure the economy’s output? Because we are primaril y interested in how things are growing rather than how big they are, we can temporaril y avoid these questions by defining suitable indices. We define a labor index by
w Wr
"
)s
(l
27a)
I t compares the amount of labor being used at tim e t t o the amount being used at tim e zero. The index i is independent of the unit of measurement for labor. Massachusetts, for example, estimated that it s amount of labor increased by 30% between 1899 and 1905 (Douglas, 1934, p. 160; see also Table 1.1). If we assume, arbitrarily , that t = 0 corresponds t o 1899, then i {6) = 1.3, regardless of the amount of labor actually employed at either time. I n a similar vein, we can define capital and output indices by L
L
Μ
K(oy
d . 2 7 b)
i ( t ) = M lQ{l)
-Qxoy
For example, Massachusetts estimated that capital increased by 37% and output by 42% between 1899 and 1905. Thus i (6}= 1.37 and / ( 6) = 1.42. Lik e i , the indices i and iq are independent of their corresponding unit s of measurement. Al l three indices are said t o be "dimensionless" (we’ll discuss dimensionality in Section 1.14). Indices for the years 1890 t o 1926 are presented in Table 1.1. Notice fro m th e final column of thi s table that, on the whole, output increased wit h time, even though there were years lik e 1908 when it fell temporarily . Labor and capital also increased on the whole. But how was thi s increased output related to labor and capital? Were these data the manifestation of some economic law? I n the early part of thi s century, thi s question was addressed by econ› omists C. W. Cobb and P. H. Douglas, who came t o the conclusion that ther e was indeed such a law; for details, see Douglas (1934), on which thi s K
L
K
Q
1.6
Economi c Growt h
15
Table 1.1 Variatio n with tim e of capital, labor, and output indices. 1
<*«)
-9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9
0.95 0.96 0.99 0.96 0.93 0.86 0.82 0.92 0.92 1.00 1.04 1.06 1.16 1.22 1.27 1.37 1.44 1.53 1.57
’ (0
t
<*«)
'LW
i (t)
0.72 0.78 0.84 0.73 0.72 0.83 0.81 0.93 0.96 1.00 1.05 1.18 1.29 1.30 1.30 1.42 1.50 1.52 1.46
10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27
2.05 2.51 2.63 2.74 2.82 3.24 3.24 3.61 4.10 4.36 4.77 4.75 4.54 4.54 4.58 4.58 4.58 4.54
1.43 1.58 1.59 1.66 1.68 1.65 1.62 1.86 1.93 1.96 1.95 1.90 1.58 1.67 1.82 1.60 1.61 1.64
1.60 1.69 1.81 1.93 1.95 2.01 2.00 2.09 1.96 2.20 2.12 2.16 2.08 2.24 2.56 2.34 2.45 2.58
Q
0.78 0.81 0.85 0.77 0.72 0.84 0.81 0.89 0.91 1.00 1.05 1.08 1.18 1.22 1.17 1.30 1.39 1.47 1.31
Q
Data refer to the Massachusetts economy in the years from 1890 (r = - 9) unti l 1926 (r = 27); see Douglas (1934, p. 160).
section is based. We can appreciate their work most readily by defining tw o new variables: ( 0 Ξ ΐ η ( £ ) .
*(0Ξΐη( 2).
(1.28)
Th e usefulness of these definition s wil l shortly emerge. For integer values of / between - 9 and 27, ξ(ή and φ(ί) may be derived fro m Table 1.1, and these values are plotted in Fig. 1.5. N o t i ce that, wit h the exception of a few outlyin g point s such as that representing 1917, the point s in thi s diagram li e fairl y close to the lin e drawn through the origin . Now, suppose that we wish t o capture the essential features of the way in which labor and capital determined economic growth in Massachusetts i n the years between 1890 and 1926. I n other words, suppose that we wish t o have a mathematical model of that growth. Wouldn’ t it be reasonable t o approximat e the informatio n in the data point s in Fig. 1.5 by the straight lin e through the origin ? Because the lin e has slope 3/4, we would thus obtain ψ(ί) = 3 (/)/ 4 or, in view of (1.28),
' ω = {^ω} {/*ω}'· 34 /
2
4 /
α· ) 29
16
Chapte r 1 Growt h and Decay . Dynamica l System *
t
1901 & 1902
Γ
*
-0.5
- 1.0 —Γ
ι
ι
ι
ι
ι
ι
"~i
Γ"
ι
ι m
•44
Λ m
y
y ' m
•• »’ y
••
·' m m _
·
••,* φ*
•
•
my
y
-0.5
·
•1917 «
- 1.0
Fig. 1.5 Plot of φ against ζ for the data in Table 1.1; and φ are defined by (1.28). There are 36, not 37, data points because the uppermost point represents both 1901 and 1902. Indeed, (1.29) might even be a better description of overall economic growt h than th e diagram itself, because even the briefest of glances at Fig. 1.5 suggests that output is abnormal in certain years (e.g., 1917); and such abnormalities may be associated wit h the outlyin g points. We might therefor e propose (1.29) as a model of economic growth in Massachusetts. A possible criticis m of thi s proposal immediately springs t o mind. Sup› pose we accept that there is some lin e that captures the essential features of the distributio n of point s in Fig. 1.5. Then the lin e must certainly pass throug h the origin , as a direct consequence of definition s (1.27) and (1.28). But , having fitted the lin e in Fig. 1.5 to the data by eye, how do we know that slope 3/4 is the one that fits best? Th e answer is that we don’t; perhaps th e best slope is as small as 0.7 or as big as 0.8. Therefore, let’s simply call it 7, where 0 < 7 < I . Then, instead of (1.29), we have
/ (o={/L (m {/*(m'- . 7
Q
7
(1-30)
Th e tru e value of the best slope, in an appropriat e sense t o be defined in Section 8.4, and assuming that the data in Table 1.1 are exact, is actually 0.734; see (8.20). But the data in Table 1.1 are themselves only estimates, and greater accuracy than we determined by eye may not be relevant. A second criticis m might be that, however good thi s model is for Mas› sachusetts, it wil l fail t o describe economic growth in Vermont or N ew
1.6
Economi c Growt h
17
Hampshire. But if these economies were qualitativel y similar t o that of Massachusetts, then wouldn’t we still expect them to yield a diagram lik e Fig. 1.5, though the points would li e in different places and the lin e through th e origi n would have a different slope? Thus, by varyin g th e value of 7, we could use (1.30) t o describe economic growth in a variety of economies. Let us define (1.31)
a=QiO)L(0)-
Then, fro m (1.27) and (1.30), we obtain (1.32)
at)=aL(tyK{l) -\ l
I n the jargon of economics, capital and labor are factors of production, and relationships between output and it s factors are known as production functions. Thu s (2(K,L) = aL^K " is a production function. It is known as the Cobb-Douglas production function, in honor of the men who in› troduced it . Takin g logarithm s of (1.32) and differentiatin g wit h respect t o time, we find the followin g expression for the specific growth rat e of the economy’s manufacturin g sector, in term s of the specific growth rates of labor and capital: 1
1
\_dQ_l_dL .\^l_dK Qdt ~ Ldt Κ dt' ' Notice that when 7 is close to zero, the growth rate of output is much less responsive to the growth rate of labor than to the growth rate of cap› ital ; whereas if 7 is close to 1, then the output growth rate is much more responsive to the labor growth rate than to the capital growth rate. We can therefore interpret the parameter 7 as measuring the desirabilit y of labor. In the jargon of economics, if F denotes a factor, then the quantit y (F/Q)dQ/dF is called the elasticity of production wit h respect to that factor. Setting F = L in (1.32), we see that 7 is the elasticity of production wit h respect to labor. For further elaboration, see a text on microeconomics, for example Nicholson (1979). We have thus obtained an expression, namely, (1.33), for the specific growt h rat e of an economy. But what good is it ? Unless we know the spe› cifi c growth rates of labor and capital, how can we use (1.33) to obtain an explicit expression for the growth rat e of output? Before answering thi s criticism , let us first observe that (1.32) is a single relation among three functions, namely, K, L, and Q. It is because ther e are fewer relations than functions that we are unable to obtain an explicit expression for any of them. Mor e generally, thi s situation would arise if we had η relations among η + m functions. I f the word "closed" were used t o mean explicit, then such a model would not be closed, because explicit expressions could not be deduced for all n + m functions. We might +
K
18
Chapte r 1 Growt h and Decay . Dynamica l System s
therefor e call the model open. I f the η relations did not involv e derivatives of the η + m functions wit h respect t o t, then the model would also be nondifferentiai Thu s (1.32) is a special case of a nondifferential , open, dynamical system. Tw o answers t o the above criticis m are now possible. Th e first is simply that , in certain circumstances, we might wish to know how fast output would grow, if capital and output were to grow at certain rates. Or , given th e labor growth rate, we might lik e t o know how fast capital must grow t o keep output risin g at a certain rate. Mor e generally, we might lik e to know how η of the η + m functions, called the endogenous functions, would respond t o hypothetical movements of the remaining m functions, called th e exogenous ones. For these purposes, nondifferential , open, dynamical systems can be very useful, as we wil l demonstrate mor e convincingly in Chapter 10. Th e second answer is that an open dynamical system can always be closed by combining it wit h other relations (which might be either differ › ential or nondifferential) . Let’ s attempt t o close the model (1.32). Wher e does a firm obtain it s capital stock? It buys it fro m other firms, so that cap› ital stock, in a certain sense, i s part of the economy’s output. There is one crucial difference, however. Suppose that a company buys a tool that was made thi s year. Then, next year, the tool wil l still be part of the company’s capital stock bu t it won’t be part of the economy’s output, because it was counted as part of thi s year’s. Mor e generally, suppose you are standing on the bank of a river , watching it flow around a bend. Silt gathers on a bend; imagine that the silt belongs t o you. Now, most of th e silt that the rive r carries wil l flow righ t past you. It’ s lik e the output of an economy: once it’ s gone you can’t include it , but there wil l always be mor e of it . On th e other hand, some of the silt that the river carries wil l be deposited on your bend, and there it wil l remain, t o be augmented by th e later flow of th e river . It’ s lik e your capital stock, and the silt on all the bends in the rive r is lik e the capital of the whole economy. Th e part of it s output that an economy retains for it s capital stock i s said t o be invested. Let / ( /) denote th e instantaneous annual rat e of investment, i.e., the amount of goods per year retained at tim e t for capital stock. Thus, in th e short interval [t - 6til, t + of/2], the amount of goods retained is I(t)6t + o(6t). Fro m now on, we’ll refer t o / as the investment rate. Furthermore , we’ll refer to I(t)IK{t) as th e specific investment rate, i.e., th e amount retained per year per unit of existing stock. Let us make the bold assumption that capital lasts forever. Then by analogy wit h (1.9): Rate of Change of _ Capital Capital Stock ~~ Inflow
Capital Outflow
0.
(1.34)
1.6
Economi c Growt h
19
Her e is a furthe r relation, a differentia l one. But by also introducin g an extr a function, namely, / ( i ) , we have moved no nearer t o closing our model! W e must therefore devise a new relation withou t introducin g new func› tions. A new relation requires a fresh assumption. Perhaps the simplest we can make is that the economy retains a constant proportion , σ, of output for it s capital stock. Thu s (1.35)
I(t) = aQXt).
Wit h (1.32), (1.33), and (1.35), we now have three relations (one differentia l and two nondifferential ) among the four functions /(*) , K{t), L{t), and Q{t). To close our model we must devise a fourth . But that fourt h relation wil l close our model only if no new functions are introduced an d ensuring thi s is not always easy, as we have just discovered! To make matters simple, therefore, we wil l simply assume (see Exer› cise 1.6) that the labor force is growing at constant specific rat e p, i.e., L (0 = L(0K’ .
(1.36)
Then on substituting (1.32), (1.35), and (1.36) int o (1.34), we obtain the first order ordinar y differentia l equation ^
= σα{Σ(0)}
(1.37)
β"'Κ -ι.
Ί
ι
Th e solution of thi s equation (Exercise 1.7) is readily shown to be given by {K(t)y
= {K(0)} +
mO)V
j
y
- 1) •
(1.38)
We can now retur n to the question of whether economic growth makes anyone better off. Let us assume that our measure, L(t), of labor is simply th e number of worker s employed, as was actually the case for the Mas› sachusetts study summarized in Table 1.1, and define the output per worker by
® = m I f economic growth is going t o improv e the lot of the labor force, shouldn’t ˘ increase wit h time? Takin g logarithm s of (1.39), differentiating , and using (1.33), we find that: z
\dZ ˘ ¸
=
IdQ ¸ -
IdL ¸
=
(
-
1
ª
)
J Id * | ? ¸ - ˘ ¸ )
(
L
(
L
9
)
AM
N
•
3
4
0
)
Using ( 1 . 3 6H 1.38), (1.31), and (1.35) in (1.40), we now find (Exercise 1.7):
ΤΈ
=
( 1
~
7 ) { / ( 0 )
"
p
K
m
{
* ~' (0)}7
{ κ { ί ) ]
'
Ί
•
(
1
4
1
)
20
Chapte r 1 Growt h and Decay . Dynamica l System *
Thus, because 0 < 7 < 1, our model predicts that output per worker rises if (1.42) i.e., i f the specific rat e of investment is higher, initially , than that of the labor force. Earl y investment is seen t o be crucial. Because (1.41) tends t o zero as t oo (Exercise 1.7), however, our model also predicts that output per worker ultimatel y settles down t o a constant value. How good is thi s model ho w realistic are it s assumptions? Perhaps you would lik e t o consider that question, though you’ll be in a better po› sition t o answer it after studying Chapter 4. Before changing the subject, however, and in preparation for Sec› tion s 3.3, 3.4, and 10.3, we pause t o remark upon th e way i n which output is measured, a matter we have managed t o avoid unti l now by defining th e output index iq{t). Th e output of an economy may consist of products as diverse as knives, bookcases, and automobiles; therefore it would be meaningless t o count th e number of items produced. That would create th e illusion that a factory producing 1000 knives had equalled th e output of one producing 1000 cars. It would be equally meaningless t o measure th e weight of the output i n tonnes, because a factory producing 1000 glass paperweights would have equalled the output of one producing several thousand scientific calculators. I n avoiding such absurdities, the traditiona l method of incorporatin g diverse products int o a single measure of output has been t o count each according t o it s monetary value. Even here there’s a difficulty , however, because it’ s c o m m on knowledge that a dollar won’t buy as much in the year 2000 as it would have bought in 1950; or, more gener› ally, that it won’t buy as much today as it would have bought / years ago. Therefore, if we wish t o make a fair comparison between an economy’s output in one year and it s output in a different year, then we must assign t o the output of the second year the monetary value that it would have had i n the first; or vice versa; or else assign t o each th e monetary value that it would have had in some other year, which we shall call th e base year for comparison. It is usually most convenient t o take / = 0 as th e base year. N ow suppose that a dollar at tim e zero has th e buying power of P(t) dollar s at tim e t, so that P(0) = 1; and suppose that th e monetary value of an economy’s output at tim e t is Y(t). Then because each dollar at tim e t is equivalent t o lAP(f) dollar s at tim e zero, the economy’s output would have been assigned monetary value Y(t)/P(t) if it had been produced at t = 0. Thi s is a tru e measure of th e economy’s output, th e one we have been denoting by Q(t). Hence Q = YIP, or Y(t) =
P{t)Qli)-
(1.43)
You might lik e t o thin k of QXt) as being measured i n real dollar s and Υ (t) as being measured in paper dollars, wit h P(t): 1 being th e exchange rat e
1.7
Metere d Growt h (or Decay ) Model s
21
between a paper dollar and a real dollar . Economists call Y the nominal output , Q the real output, and Ρ the price index (compare wit h (1.27), remembering that P(0) = 1). Takin g logarithm s of (1.43) and differentiatin g wit h respect t o t, we obtain
i ^ - I ^ + QI^C Y dt ~ Ρ dt dt'
( 1 4 4) • ' Th e term on the left-hand side of thi s relation is called the nominal (spe› cific) growth rat e of output. Th e second term on the right-han d side is called the real (specific) growth rat e of output. Th e first term on the right hand side, the specific growth rat e of the pric e index, is called the rate of inflation. Thu s tru e output, Q(/), is measured by assigning to output it s nominal monetary value Y(t) and dividin g by the pric e index, a procedure known as deflation. Th e tru e measure of capital stock, namely K(l), is likewise obtained by assigning t o capital stock it s monetary value and dividin g by th e pric e index (and similarl y for tru e investment, /(<)). I n the present sec› tion , however, we were able t o work exclusively in terms of real measures, because th e data in Table 1.1 had already been deflated.
1.7
K
Metere d Growt h (or Decay ) Model s
Let’ s retur n to Section 1.1 ’s polluted lake, in which x(t) denotes the con› centration of contaminant at tim e , V lake volume, and r the rate at which water flows through. Suppose that, for economic reasons, the environmen› tal police measure the lake’s pollutio n level only once every unit of time. They obtain a set of readings *(0) , x(l), x(2), x(n) To test the model of Section 1.1, we could compare these readings wit h the predictions jt(l ) = x(0)e- , x(2) = x(0)e- , x(3) = x(.0)e~ ' , and so on of equation (1.10); which we can writ e more succinctly as x(n + 1) = e~' x(n), η = 0, 1, 2, If we found acceptable agreement then we’d be satisfied wit h our model. If not, we would either reject it or tr y to improv e it. (We’ll discuss thi s at length in Chapter 4.) But notice, now, that what has been happening in th e interval s 0 < t < 1, 1 < t < 2, 2 < t < 3, . . ., η < t < n+ 1, . .. is of no importance. It might happen, for example, that in every tim e unit some mischievous pol› luter dumps fresh pollutio n int o the lake but always removes it before the next measurement is taken. Then th e tru e pollutio n level would fluctuate according to the solid curve in Fig. 1.6; whereas the model’s predictions would be given by the dashed curve. I n these circumstances, the model would not be a faithfu l guide t o what was actually happening ye t we wouldn’ t be aware of this! Indeed we might as well replace the model of Section 1.1 by the discrete dynamic model r,v
2r,v
ir v
/v
JC («+ 1) = e- x(ri), rlv
n = 0,1,2,...
(1.45)
22
Chapter 1 Growth and Decay. Dynamical System»
0
1
2
3
4
5
Fig. 1.6 A mischievous polluter deceives the environmental police. Whenever integer values of t are the only relevant ones, it is customary to write x(t) as x,. Hence the more usual form of (1.45) is K
n+l
= e-«vx
« = 0,1,2,.
(1.46)
Once x0 is known, we can determine the sequence of values xu x2, x3, ..., by repeated, or recurrent, application of (1.46). Thus (1.46) is dubbed a recurrence relation. You can see that the measurable predictions of the continuous model (1.10) are exactly the same as those of the discrete model (1.46). But a cautious person—and scientists are supposed to be cautious people—would certainly prefer the model (1.46), because it says just as much with far less risk that it might actually be wrong. (Incidentally, I am unable to resist pointing out that a cautious person is also discreet.) If we're interested only in the long-term pollution dynamics of this extraordinary lake, then (1.46) suffices as a model. If we're interested in the short-term dynamics, however, then (1.46) tells us nothing—and (1.10) is false! What can we do about mis? Notice from Fig. 1.6 that the short-term dynamics appears cyclic. This raises the intriguing possibility of constructing a separate model to describe pollution dynamics within each unit of time, independently of the value of n, although the long-term dynamics would still be described by (1.46). We might regard the short-term model as imbedded in the long-term one. A possible form for the imbedded model would be y(ta) = A(xn); n
(1.47)
xn+l = B(yitb)), where y denotes pollution within a time unit and appropriate functions A, B, and g are to be defined. The time that elapses between t - ta and t = tb in (1.47) is independent of n. Perhaps it is easier to appreciate this by writing ta = n + c,, tb = n + 1 - €2, where «,,c2 > 0 and e, + «2 < 1;
1.8
Salmo n Dynamic s
23
then t - t = 1 - f, - c . Note that the possible dependence of A, B, and g on any parameters of the problem, e.g., rIV, has been suppressed in the notation of (1.47). Just suppose, for example, that our mischievous polluter achieves his goal by doubling the pollutio n level one tenth of a tim e unit after every reading, lettin g it decay at the natural rat e and then halving it again one tenth of a tim e unit before the next reading. Then (1.47) would describe thi s process if we took e, = 0.1 = e and denned A{x) = 2xe~ , g(y) = -rylV, and B(y) = 0.5ye~ . You can easily check that (1.46) is implied. (Note that the solid curve in Fig. 1.6 would no longer be smooth but would have four corners in each tim e unit ; tw o where χ rises verticall y after onetenth of the tim e unit , and tw o where χ fall s verticall y four-fifth s of a tim e uni t later.) Th e example above is very fanciful and was introduced purely for ped› agogical purposes. But the idea of modelling growth and decay by imbed› din g a short-term dynamic model lik e (1.47) in a long-term dynamic model of the for m b
a
2
0Ariy
2
0ir/v
Xn+i=F(x„)
(1-48)
can be a powerful one. We wil l follow Clar k (1976) in calling such models metered models. Th e essential prerequisite for using such models is that the system being modelled is qualitatively the same withi n each unit of time. Th e system is said t o be memoryless, because it is incapable of knowing fro m it s own behavior which unit of tim e it is in. We wil l discuss the propert y of memorylessnes s more full y in Chapter 5. N ow let’s see a more realistic example.
1.8
Salmo n Dynamic s
Suppose we wish t o know the size of a salmon population at the end of each spawning cycle. We might expect a metered model t o be useful here, because the spawning process is qualitativel y th e same withi n each cycle. Ther e are, to be sure, some quantitativ e differences. But those that are due t o initia l conditions are part of the long-term dynamics described by (1.48). Other quantitativ e differences are due t o changes in the environment. To make matters simple, let’s assume that the environment is changing so slowly as t o make such differences negligible. It is then legitimate t o ex› press the short-term dynamics in an imbedded model of the for m (1.47). Th e followin g model, due t o Ricker (1954), is adapted fro m Clar k (1976, P. 229). Let x„ be the number of hundreds of million s of salmon at the end of cycle and therefore also at the beginning of cycle « + 1. These salmon are all adults. Referrin g t o (1.47), lety(/) denote the larval population (again in hundreds of millions) durin g the subsequent cycle (i.e., cycle η + 1). H ow
24
Chapte r 1 Growt h and Decay . Dynamica l System s
is the initia l larval population, y(t ), related t o χ„Ί Th e more salmon there are, the more females there are, the more eggs they lay, and hence the more larva e there are. Th e simplest assumption incorporatin g thi s observation is that th e number of larvae is proportiona l t o the number of adult salmon at the end of the previous cycle, or a
=
(1-49)
where Æ is a constant. Hence A(x) - ax in (1.47). What happens t o these larvae? Th e adults cannibalize them. The more adult s there are, the more larvae that are eaten. Th e simplest assumption incorporatin g thi s observation is that the larval population decays at a rat e proportiona l t o the adult population which , in the short term, is fixed. Thu s 1 dy
=
(1-50)
where β is a constant. I n term s of (1.47), g{y) = -0x„y, where x„ is constant i n the embedded model. Integratin g (1.50) fro m t t o t gives the number of (hundreds of million s of) larvae that survive t o matur e int o young salmon: a
b
yih) = y[t ) e x p ( - / ? x ( / - Q) = ax„ e x p ( - / ? x ( i - t )). 6
a
6
(1.51)
a
What happens t o these young salmon? Th e ocean is fraught wit h risk for them and not all wil l survive t o breed. Let’ s assume that a fractio n 7 survives. Then, at the end of the cycle, the salmon population is yy(t ) plus the survivin g adults. How many adults survive? I n the case of Pacific salmon, we can safely assume that the answer is zero, because the adults di e soon after spawning. On the other hand, Atlanti c salmon may retur n to th e sea after spawning, spend a year or tw o in the open water, then retur n upstream t o spawn again. To keep things simple, let’s assume that we’re interested in Pacific salmon. Then b
(1.52)
Xn+i = iyih).
Thu s Hy) = yy in (1.47). On defining α = α, Ί
b =
(1.53)
fi(t -t ) b
a
and combining (1.51) wit h (1.52), we obtain x
(1.54)
= ax e- ". bx
n+l
n
I t isn’t possible t o express the solution t o thi s recurrence relation as an explicit function of n, for all values of th e parameters a and b, in th e way that the solution t o (1.46) was expressed as x„ — x e~ , for all values of the parameter VIr. We must therefore solve (1.54) numerically, for par› ticula r values of and b. Suppose, for example, that there are 1 0 salmon nrlv
0
8
1.
Salmo n Dynamic s
25
initially ; then x = 1, because we are counting in hundreds of millions. Suppose that, on average, each female lays 1 0 eggs for each individual , male or female, in the existing population (thus, when = 0, all the females together lay 1 0 eggs). Then, if we assume that eggs are just young lar› vae (salmon cannibalize both), Æ = 10 . Assume, moreover, that the effect of thi s cannibalism on the first generation is to reduce the larval popu› lation by 90%. Then, fro m (1.51), 0.1 = y(t )/y(t ) = exp(-Pxo(t - f j ) , whence b = P(t - t ) = ln(10)/jr « 2.303. For these values of α, β and 7, (1.54) was solved numerically for various values of 7 (the fractio n of young survivin g unti l the next spawning). These values were 7 = 0.5 10" \ 7 = 1.0 1 0 ~\ 7 = 1.1 1 0 ~\ and 7 = 1.5 10~ . Because a = ηα = 1 0 7 , the corresponding values of a were 5, 10, 11, and 15. Th e results are presented in Table 1.2, and you should verif y them for yourself (Exer› cise 1.9). Notice that the four values of 7 (or a) correspond t o four completely different kind s of behavior. For a = 5, the population settles down t o th e steady value x* = 0.699, 70% of the initia l value. For a = 10, the population is absolutely static. For a = 11, the population bounces back and fort h between th e values x = 0.3568 and x = 1.726. For a = 15, it 0
s
13
5
a
b
b
b
0
a
4
s
L
v
Table 1.2 Variatio n with tim e of salmon population. n 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
a=5 1.000 0.500 0.7906 0.6402 0.7329 0.6778 0.7117 0.6912 0.7037 0.6961 0.7007 0.6979 0.6996 0.6986 0.6992 0.6988 0.6991 0.6989 0.6990 0.6989 0.6990
a = 10 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000 1.000
a = 11
a= 15
1.000 1.000 1.100 1.500 0.9611 0.7115 1.156 2.074 0.8876 0.2625 2.151 1.265 0.7562 0.2278 1.458 2.022 0.5584 0.2882 1.698 2.226 0.3744 0.1983 1.739 1.884 0.3488 0.3691 1.719 2.367 0.3614 0.1526 1.730 1.611 0.3545 0.5919 1.724 2.272 0.3581 0.1821 1.727 1.796 0.3562 0.4308
n
a= 11
a= 15
21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40
1.725 0.3572 1.726 0.3567 1.726 0.3569 1.726 0.3568 1.726 0.3569 1.726 0.3568 1.726 0.3568 1.726 0.3568 1.726 0.3568 1.726 0.3568
2.396 0.1443 1.552 0.6526 2.178 0.2167 1.973 0.3147 2.287 0.1771 1.767 0.4531 2.394 0.1449 1.557 0.6481 2.186 0.2137 1.960 0.3225
The four values of Æcorrespond to four values of the survival rate of young, when b = 2.3026; x = 0.6990 for > 20 when a = 5. n
26
Chapte r 1 Growt h and Decay . Dynamica l System s
seems that the population trie s to settle int o a pattern that repeats itself every twelve unit s of time, but withou t much success . D o populations of salmon really behave in any of these ways? Perhaps you would lik e t o consider that question. We’ll retur n t o it in Chapter 4; (1.54) is furthe r discussed in Chapter 2.
1.9
A Mode l of U.S. Populatio n Growt h
Havin g discussed economic growth in Section 1.6, we now discuss a further example of the empirical approach to modelling. The number of million s in the U.S. population fro m 1790 unti l 1850 appears in the thir d column of Table 1.3. The unit of tim e is a decade, and x(t) denotes magnitude at tim e t. Notice that population increases wit h time. The simplest hypothesis that might explain thi s observation is that χ is proportiona l to t; then dxldt would be constant. But the fourt h column of Table 1.3 records values of the quantit y (1.55)
D(t)= -{x«+l)-x(t-l)}. l
Thi s is a good approximation to dx/dt if d x/dt is small, which we shall sim› pl y assume (although see Exercise 1.12). Because D also increases wit h t, we reject the hypothesis that χ is proportiona l to time. On the other hand, th e final column of Table 1.3 shows that Dlx is almost constant. Indeed 3
i
= 0.3
^
(I.5Q
is correct to one significant figure. I n other words, the data suggest that we model growth of the population by setting μ = 0.3 = constant in (1.7). Thi s empiricall y derived model predicts x{t) = x(0)e - ' 0 3
m 3.9e ’ .
(1.57)
J
Table 1.3 U.S. population in millions, 1790-1850. Year 1790 1800 1810 1820 1830 1840 1850
t
*< 0
D{t)
0 1 2 3 4 5 6
3.929 5.308 7.24 9.638 12.87 17.07 23.19
1.66 2.17 2.81 3.72 5.16
0.31 0.3 0.29 0.29 0.3
Data for x(i) are taken from Historical Statistics of the United States, Colonial Times to 1970, Bicenten› nial Edition, Part I , p. 8 (U.S. Bureau of the Census, Washington, D.C., 1975).
1.9
A Mode l o f U.S. Populatio n Growt h
27
You can easily check that (1.57) predicts the population correctly t o tw o significant figures for the years 1 7 9 0 - 1 8 4 0, except for 1810, when it pre› dict s 7.1 instead of 7.2 for x(2). Can the same model predict population magnitude in later years? I n th e thir d and fourt h columns of Table 1.4, the predictions of (1.57) are compared wit h observed values for the years 1 8 5 0 - 1 9 7 0. You can see that (1.57) soon fail s to describe population growth wit h acceptable accuracy. On the other hand, Dlx « 0.24 for the years 1 8 6 0 - 1 8 8 0, suggesting the improved model
\
3 1 i ?
0.24(/-7)
(
(
>
6
5
But although thi s is correct to tw o significant figures for the years 1 8 6 01880, and even to one significant figure for 1850 and 1890, it seriously overestimates the magnitude of the population in the present century. We must tr y again! To find a better description empirically , the values for Dlx in Tables 1.3 and 1.4 were plotted against those for x. Th e result appears in Fig. 1.7. Notice that points corresponding t o the years 1 8 0 0 - 1 9 40 are clustered around the dashed line, which intercepts the vertical axis at about 0.31 and the horizontal axis at about 198. Hence the data suggest the improved model
Table 1.4 U.S. population magnitude and related data, 1850-1970. Year 1850 1860 1870 1880 1890 1900 1910 1920 1930 1940 1950 1960 1970
t
(1.57)
AO
˘ 0
D{i)lxit)
6 7 8 9 10 11 12 13 14 15 16 17 18
24 32 43 58 78 110 140 190 260 350 470 640 860
23.19 31.44 38.56 50.16 62.95 75.96 91.97 105.7 122.8 131.7 150.7 179.3 203.2
7.19 7.68 9.36 12.2 12.9 14.5 14.9 15.4 13.0 14.0 23.8 26.2
0.31 0.24 0.24 0.24 0.2 0.19 0.16 0.15 0.11 0.11 0.16 0.15
Source of fourt h column as in Table 1.3.
(1.60) 23 30 39 49 61 75 90 110 120 130 150 160 170
28
Chapte r 1
Growt h and Decay . Dynamica l System *
DIx
-I
0
I
I
I
I
I
I
I
I
I
50
I
I
•
1
100
•
150
'
'
I
I
-’
’ hv
200
Fig. 1.7 U.S. population (horizontal axis) plotted against specific growth rate (verti › cal axis) for years 1800-1960. The unit of tim e is a decade; the unit of population, a million .
Th e solution of thi s differentia l equation, subject t o x(0) = 3.93, i s 198 * ’
)
=
l
+ 49.4
(
1
•
6
0 )
Th e predictions of (1.60), rounded t o t w o significant figures, are recorded i n the final column of Table 1.4. Notice that they are correct t o at least one significant figure unti l 1950. I n fact, the percentage error , that is, i. predicted value Ί lOOxU-^ }% , observed value J y n (
„.» (1.61)
i s less than 2.5% throughout thi s entir e period, except for the year 1860, when the error i s a littl e over 5%. But the model fail s to account for the postwar rise i n specific growth rat e (appearing i n the final column of Ta› bl e 1.4). Indeed the current population of th e United States exceeds th e least upper bound of (1.60) by about 20%. T h e model (1.60), which we derived empirically , could also have been conceptually derived by th e followin g simple argument. Assume that there i s a maximum population K, th e capacity, that the land can sustain. When th e population is x, th e unused fractio n of the capacity is 1 - xlK. Thi s i s a measure of the potential for growth, and we might expect the specific
1.10
Chemica l Dynamic s
29
growt h rat e t o be proportiona l to it . Hence 1 dx
f.
n
χ Έ = ν-κ)>
x\
^ - v
κ
(L62)
where R is a constant of proportionality . We may interpret R strictl y as an upper bound on the specific growth rate. On the other hand, if χ is much smaller than K, say xlK < e, where e is sufficiently small, then (1.62) yields 1 dx . R . T
(1.63)
t
Thu s R may be regarded more intuitivel y as the early or maximum specific growt h rate. For the U.S. population we have found t « 0.1, ¸ = 0.31, and Κ 198, as you should check for yourself. But if the capacity of the United States is 198 millio n people, why are there over 235 millio n people here today? D o es thi s mean that the model is useless o r can we improv e it to resolve the discrepancy between it and the observations? We’ll retur n t o thi s question in Chapter 4. Meanwhile, tr y t o answer the question yourself (Exercise 1.11); then tr y Exercises 1.10 and 1.13.
1.10
Chemica l Dynamic s
A chemical reaction is a process in which one or more substances, the reactants, combine or separate to for m one or more other substances, the products. Mass is conserved in such a process (energy is not). Th e conser› vation of mass in one such reaction is represented by the symbolic equation (1.64)
A + B —>P.
Thi s says that one molecule of substance A combines wit h one molecule of substance Β t o for m one molecule of substance P. For example, A could be carbon (A = C), Β could be oxygen in it s diatomi c for m (B = 0 ) , and Ρ could be carbon dioxid e (P = C 0 ) . Then (1.64) would describe mass conservation in the combustion of graphit e (which releases heat energy at th e rat e of about 0.664 Joules per molecule of P). Molecules, however, are such tin y things that we prefer to count them i n unit s of approximately 6.024 ˇ , just as we preferred to count the U.S. molecules population in unit s of one millio n people. We call 6.024 ˇ of substance X a mole of X . Then (1.64) may also be read as saying that a mole of A combines wit h a mole of Β t o produce a mole of P. N ow th e molecules are constantly whizzing about the y combine because they collide an d the more they collide, the more they combine. But the greater th e concentration of each substance, i.e., the more of it that there is, then 2
2
23
23
1
’See Supplementary Note 1.1. The Supplementary Notes sections can be found at the ends of the chapters.
30
Chapte r 1 Growt h and Decay . Dynamica l System *
th e greater the number of collisions between respective molecules. I t there› for e seems reasonable t o assume that the rat e at which A and Β are con› verted int o Ρ wil l be proportiona l t o the concentration of each. Let [X] denote the concentration of substance X, in moles per unit volume. Then we have Rate of Increase of Product = Rate of Conversion of Reactant (1-65)
k[A)[B)
where A: is a constant. Suppose that ξ(ή moles of A and Β are converted t o Ρ in tim e r, i.e., ξ(ί) moles of A plus ( ) moles of Β become ξ(ί) moles of Ρ which is perfectly consistent, because the molecules of Ρ are heavier than those of A or B. Then, if a and b denote the initia l concentrations of ¸ and B, (1.65) becomes 0
0
£ = *(Æ - (0 & - (0) .
(1.66)
Thi s may, at first , appear to be a new mathematical equation. But you can easily check that the substitutions χ = max(fl . *o) ~ £. 0
R
= (o k a
~ *o).
K = a -b 0
(1.67)
Q
convert (1.66) int o (1.62). Th e complete solution can thu s be deduced fro m Exercise 1.10, and we leave that to you. You should check that, as t oo i n your solution, th e product concentration £ tends t o m i n ( a , b ); whereas th e reactant concentrations tend to 0 and m a x ( a , b )-min(a , b ). I n other words, the less abundant of the tw o reactants i s completely converted int o a constituent of the product. Recalling Exercise 1.10, notice how many phenomena are described by a single differentia l equation. Plant growth, U.S. population growth, and a chemical reaction al l are described mathematically by (1.62). That diverse phenomena may have a c o m m on mathematical structur e is a re› currin g theme of applied mathematics, and furthe r examples wil l appear throughout the text. Th e first such example appears in the followin g section. 0
0
1.11
0
0
0
0
Mor e Chemica l Dynamic s
Th e chemical reaction (1.64) is irreversible. Ρ does not separate int o it s constituents ¸ and B. Th e simplest reversible reaction would be represented symbolically by A <—* B.
(1.68)
Thi s says that A i s converted int o B, a process known as th e forwar d re› action; at the same time, Β is converted int o A, a process known as th e backward reaction. For the sake of definiteness, we wil l continue t o call
1.11
Mor e Chemica l Dynamic s
31
th e term on the right-han d side the product and the term on the left-hand side the reactant, though, because of symmetry, thi s terminology is arbi › trar y and purely for convenience. To make matters simple, suppose that th e substances A and Β are diluted in water. Then A and Β are solutes, and water is the solvent. Suppose, moreover, that the amount of water (i n moles) per unit volume is extremely large compared wit h the amount of solute. We sometimes describe thi s by saying that the substances are i n weak solution. T h en the reaction takes place because molecules of A and Β collide wit h water molecules. Perhaps, therefore, the reaction (1.68) should really be writte n as U0 2
+ A ^ H
2
(1.69)
0 + B.
I f so then, for reasons given in the previous section, the rat e of conver› sion fro m A t o B, i.e., the forward rate, would be AT, [ ˙ 0 ] [ ¸ ] , where K i s a constant; whereas the rat e of conversion fro m Β t o A, or the backward rate, would be K [H 0][B], where K is another constant. But the concentration of H 0 in thi s weak solution is so extremely large that i t does not alter appreciably durin g the lifetim e of the reaction. Hence, as an approximation , k = / T , [ H 0] and k = / s f [ H 0] may be re› garded as constants. Th e forwar d rat e is then k [A] and the backward rat e k [B). Let a and b be the initia l concentrations of substances A and B, respectively, in number of moles per unit volume of water. Suppose that, per unit volume of water, ξ(ή moles of A are converted int o Β i n tim e t. Then 2
2
2
{
2
2
2
{
2
2
2
{
2
0
0
d ^[Product] = Forward Rate - Backward Rate
(1.70)
^[Reactant] = Backward Rate - Forward Rate (1.71)
T,{
-
-0
•
Either equation i s equivalent to
^
=
-
-(*
Ø+ *2˚ •
0• ) 7 2
Equation (1.72) is a mathematical model for the dynamics of the reversible chemical reaction that is described symbolically by (1.68). At first , thi s may look lik e a new mathematical equation; but you’ve seen it before, haven’t you? See Exercise 1.18.
32
Chapte r 1 Growt h and Decay . Dynamica l S y t e m a
1.12
Rowin g Dynamic s
What determines the speed of a rowin g boat? By pullin g on their oars the crew push against the water far fro m the boat. Thi s exerts a force, which tries to make the boat gain speed; we’ll call it the tractiv e force and denote it by T. The water adjacent to the sides of the boat, however, exerts a force that tries to make the boat lose speed; we’ll call thi s the drag force and denote it by D. If Τ exceeds D, then the boat really wil l gain speed, or accelerate; and the greater the difference between Τ and D, the greater thi s acceleration. On the other hand, if D exceeds T, then the boat wil l actually lose speed; and the greater the difference, the greater the speed loss. Let’ s tr y t o tur n these ideas int o mathematics. Let u(t) be the speed of the boat at tim e t. Then duldt is the rat e of change of speed, which we have agreed to call the acceleration. What we have found is that ^ > 0 dt
i(T>D,
^ < 0 dt
i(T
du dt
increases wit h
Th e simplest hypothesis that explains all thi s is that duldt t o Τ - D. Let us therefore assume that
37 = S < - > ’ r
\T-D\.
is proportiona l
( 1
’
7 3 )
where MM is a constant of proportionally . Notice that, for given tractiv e force and drag, large Μ is associated wit h small acceleration, and small Μ is associated wit h large acceleration. Μ is therefore a measure of the boat’s reluctance t o change speed, or inertia. We call Μ the mass. Before proceeding, we pause t o record a detail fro m physics. Heavy objects have greater reluctance t o change speed than light ones (tr y push› ing), hence greater mass. But heavier objects, by definition , have greater weight, denoted by W. Indeed the relationship between weight and mass i s a simple one of proportionality , namely, W = Mg.
(1.74)
Th e constant of proportionality , g, is known as the acceleration due to gravity. The justificatio n for thi s terminology wil l emerge in Section 1.14. Furthe r to develop our model (1.73), we borro w again fro m the science of physics. I n an infinitesimal tim e St, the boat wil l m o ve a distance uSt; and maintainin g a tractiv e force Τ for thi s distance requires mechanical energy TuSt. Where does thi s energy come from ? Fro m the muscular exertions of th e crew. Th e rat e at which energy is supplied by them is known as the power. But since humans are only about 25% efficient at converting the chemical energy of food int o mechanical energy for useful work , the power actually supplied t o the boat is only about a quarter of the rat e at which oarsmen bur n energy, the remaining three quarter s being dissipated as heat. For thi s reason, some people prefer to call the rat e of energy supply the
1.12
Rowin g Dynamic s
33
effective power. Now, assume that there are eight in the boat’s crew, and that they have entered a race. I n training , they wil l have determined empiricall y th e maximum effective power that an oarsman can sustain for the full length of the course; let’s denote it by P. To make matters simple, let’s assume that the oarsmen are identical, at least for the purpose of rowin g a boat. Then, assuming that they would lik e to wi n the race, they wil l supply power iP for the entir e length of the course. Therefore, because power is rat e of energy supply, the energy supplied in an infinitesimal tim e St wil l be SPSt. Thi s must equal TuSt. Hence Effective Power = Tractiv e Force
Velocity
— 75)
SP Txu. Fro m fluid dynamics, we borro w the result that drag is proportiona l both t o the square of the boat’s velocity and t o it s wetted surface area, i.e., the area in contact wit h the water. Let’ s denote wetted surface area by S. Then (1.76)
D=bSu , 2
where b is a constant of proportionality . From (1.73), (1.75), and (1.76): Mass
Acceleration = Tractiv e Force - Drag Force
= - bSu . Μ χ — dt u Thi s is a first order ordinar y differentia l equation for u(t), which we propose as a model for the dynamics of rowing. The solution of thi s dif › ferential equation, subject t o the initia l condition u(0) = 0, is defined im› plicitl y (Exercise 1.19) by (u
2
+ uV+V*\
π
_ (V+2u\ l
6bSVt
„ „ .
where we have defined Ρ \
1/3
Th e function u(t) defined implicitl y by (1.78) is plotted in Fig. 1.8. N o› tic e that the initia l acceleration is theoretically infinit e according t o (1.77), when in practice it must be finite; but thi s should not concern us any more than the fact that, in theory, the boat wil l actually reach speed V only as t —* oo. A model is intended only t o capture the essential features of real› ity , not t o be an identical replica. Yet how good is thi s model doe s it fit the facts? Fig. 1.8 suggests that oarsmen supplying power at a constant rat e would achieve maximum acceleration at the start of a race and subsequently reduce acceleration, unti l their speed levelled off at the constant value defined by (1.79). M y intuitio n suggests that thi s is more or less what happens in a race; except perhaps that the oarsmen slow down slightly towards the end of it . But in
34
Chapte r 1
Growt h an d Decay . Dynamica l System *
u/V
+
bSVtIM
Fig. 1.8 Speed history of a rowing boat. Both dependent and independent variables are dimensionless; see Section 1.14 and Exercise 1.20.
science it’ s generally a bad idea t o rely exclusively upon one’s intuition . Therefore, in Chapter 4, we wil l test thi s model mor e objectively.
1.13
Traffi c Dynamic s
Suppose that there are Ν vehicles i n a lane of traffic . We wil l label t h em N, wit h j = 1 corresponding t o th e leading vehicle. Let us j = 1, assume that their masses and lengths are equal. Thi s might be at least approximately tru e on a bridg e or i n a tunnel fro m which truck s have been barred . Let th e fron t bumper of th e j t h vehicle have displacement Zj(t) at tim e t, measured fro m th e beginning of th e road. Then th e j’t h vehicle whereas it s displacement and has velocity dzjldt and acceleration d z ldt ; velocity relative to the vehicle in front of it are, respectively, ,-( ) z _ (t) 1
l
j
and dzj/dt -
j
i
dz _ /dt. J
l
Suppose that the road is quit e congested, which bridges and tunnels usually are. Thu s the average value of \zj(t) - z,_ ,(/)| is not t oo large. Th e smaller it is, th e mor e congested th e road. Now, on a busy road, vehicles are prevented fro m crashing int o o ne another, at least i n theory, because driver s brak e when they see that th e gap i n fron t of them is closing. Th e faster that gap closes, i.e., the greater th e value of dzj/dt - dz _ /dt, th e harder they brake. Moreover, th e greater th e congestion, i.e., th e smaller th e value of |z,(i) - z,_ ,(r)|, th e harder they brake. Th e simplest hypothesis incorporatin g these t w o observations i s that J
BHWFw.^gg:^,,
l
c.M )
where A{>0) is a constant and a prim e denotes differentiation . Now, bor› ACCELERATION , where Μ rowin g fro m physics, th e brakin g force is -Μ i s th e mass of a vehicle. You can see thi s by identifyin g th e brakin g force wit h D i n (1.73) above and setting Τ — 0. But driver s take a certain time,
1.14
Dimensionality , Scaling , and Unit s
35
say τ, to respond to changing traffi c conditions. Hence d zj(t+r) 2
dt* or, because z _ (t) J
l
>
_
z; . ( 0 - z j _ , ( 0 - \z (t)-z _ «)\> A
j
J
( i . 8 1)
l
Zj(t),
(1.82)
(1.83) where a, is independent of t. Because thi s equation is valid for 2 < j < N, we have a system of Ν - 1 nonlinear ordinar y differentia l equations. Thi s system is even more complex than (1.20) and (1.22) because of the delay, r , in driver response t o the stimulus of changing traffi c conditions. I f we weren’t able t o solve (1.20) or (1.22) analytically, then what hope do we have of solving (1.83)? To be sure, we can always find solutions by numerical approximation. A s we shall discover repeatedly throughout thi s text, however, there is a satisfaction in the simplicit y but generality of analyti c solutions which makes them always desirable and always prefer› able, when available, t o numerical approximations. But the question still remains: how do we hope to obtain analytic solutions fro m equations as complicated as (1.83)? Th e answer lies in the observation that, in the real world , nothing can grow or decay forever: ultimately , growth or decay must cease. What hap› pens then? A n equilibriu m or steady state is reached. I n the present model, thi s steady state is a special solution of (1.83) which, as we shall see in Sec› tio n 2.3, is readily found. But already we’re talkin g about equilibrium , and thi s is th e topi c of Chapter 2.
1.14
Dimensionality , Scaling , and Unit s
Th e use of dynamic models is greatly facilitated by an understanding of thre e closely related concepts, namely, those of dimensionality, units, and scaling. We conclude our first chapter by discussing them. Suppose that a frien d of min e drove 20,000 miles last year and earned 20,000 dollars. Would I be righ t to say that he drove as much as he earned? N o, of course not, because the equation $ 2 0 , 0 00 = 2 0 , 0 00 miles
(1.84)
does not make sense. Distance is measured in miles, income is measured in dollars, and no amount of dollar s can ever equal a mile. We formaliz e thi s
38
Chapte r 1 Growt h and Decay . Dynamica l System *
idea by saying that distance has the dimension o f length or, in shorthand notation, [distance] = L; whil e income has the dimension of value, or [income] = V. I n these terms, (1.84) is dimensionally inconsistent because [$20,000] = V, and [20,000 miles] = L. If , however, my frien d spent 50p for every mil e he drove, then I would be absolutely righ t t o say that $ 1 0 , 0 00 = 2 0 , 0 00 miles χ 0.5 dollars per mile.
(1.85)
Thi s equation is dimensionally consistent, because [dollar s per mile] = VIL. Thu s the right-han d side has the dimensions of L χ VIL = V, agreeing wit h th e left-hand side. Al l parameters and variables used in thi s book have characteristic di› mensions, which are derived fro m products or quotients (or both) of the six basic dimensions listed in Table 1.5. Dimensions are given for a selection of quantities used in thi s book in Table 1.6. Al l equations between variables and parameters must be dimensionally consistent. Consider, for example, the lake purificatio n equation (1.9a), repeated here for convenience: y
^
= - >
(1-86)
r x
where ˚ denotes volume, JC concentration, / time, and r rat e of water flow. On using rows three through five of Table 1.6, the left-hand side of (1.86) has dimensions [V] • [x]/[t] - L? ML-^IT = MIT; whereas the right-han d side has dimensions [r] • [x] = L?IT • MIL? = MIT. Hence the equation i s dimensionally consistent. Similarly , y(t ) = ax in (1.49) is dimensionally consistent, because the proportio n Æ is dimensionless, and the pur e numbers y(t ) and x„ are also dimensionless. Th e fact that all equations must be dimensionally consistent can be used t o determine the dimensions of new parameters as they arise. For example, in (1.50), i.e., in the equation a
n
a
Table 1.5 The six basic dimensions and their symbols. length mass tim e
L Μ Τ
temperature value no dimensions
C V 1
Shear viscosity Kinemati c viscosity Thermal conductivity
Pressure
See Section 2.5
= [ ]/[æ]* > see Section 2.6
See Section 2.6
2
3
l
T~
2
MLT- C~
2
L /T
1
ML~
l
ML~ T~
3
ML /T
[Power] = [Energy]/[Time ] or [Power] = [Force] • [Velocity] [Pressure] = [Force]/[Area]
Power 2
MLrIT
[Energy] = [Force] • [Distance]
Energy 2
Μ LIT
[Force] = [Mass] • [Acceleration]
3
L IT MIT
[Water flow] = [Volume]/[Time ] [Pollutio n inflow] = [Water inflow] • [Concentration]
3
2
LIT LIT MIL
[Velocity] = [LengthJ/fTime) [Acceleration] = [Velocity]/[Time ] [Concentration] = [Mass]/[Volume]
1
Dimensions
Velocity Acceleration Concentration of pollutant Water flow Pollution inflo w Force
Derivation
1
-rV C
Erg-cm"
2
J-m-’
1
- 1
c m /s
gm - c m m /s
1
2
2
s
- 1
-s-’^C
Dyne/cm Newton/m (Pascal) kg • m ~ • s ~ 2
gm - cm • Is (Dyne) D y n e • cm (Erg) Erg/s 2
J
kg • m/s (Newton) Newton • m (Joule) Joule/s
2
c m /s gm/s
3
3
cm/s cm/s gm/cm
CGS unit s
m /s kg/s
2
S.I. units mis m/s kg/m
Dimensions of some quantities arising frequently in mathematical modelling.
Quantit y
Table 1.6
38
Chapte r 1 Growt h and Decay . Dynamica l S y t o m t
x„ is dimensionless, y is dimensionless, and dyldt has dimensions l / T . Hence the dimensions o f /? must also be l/T. Similarly , the quantities º and ctj appearing in (1.83) must have the dimensions of velocity, or LIT. After a quantity’ s dimensionality has been settled, the number that de› termines it s actual value wil l still depend upon the units in which those basic dimensions are measured. For example, velocity has the dimen› sions of length per unit of time. But a car that travels at 60 m.p.h., if lengths are measured in miles and tim e in hours, wil l travel at 88 feet per second if lengths are measured in feet and tim e i n seconds. Th e car’s velocity has not changed; velocity’s dimensions have not changed; only th e unit s chosen for the basic dimensions have changed. Two frequent choices for the basic dimensions of mass, length, and tim e are kilogram , meter, and second (Systeme Internationale, or S.I.) and gram, centime› ter, and second (CGS). For the quantities listed in Table 1.6, the appro› priat e S.I. unit s or CGS unit s are given next t o the respective dimen› sions. Temperature is usually measured in degrees Celsius ( C ) and value i n dollars. But other unit s are sometimes chosen for the basic dimen› sions. Moreover, unit s are sometimes mixed withi n a problem so that numbers are neither too large nor too small. I n modelling lakes, for ex› ample, we might choose t o measure flow of contaminant in tonnes per day, because tonnes per second would give too small a number, and kg per day would be too large. I n brief , unit s for the basic dimensions may be chosen arbitrarily . Once they have been chosen, however, the unit s for quantities wit h derived dimensions must always be consistent wit h them. Dimensionless parameters are useful in mathematical modelling for a variet y of reasons. First , as we shall see in Sections 4.10 and 9.5, they are importan t measures of the relativ e strengths of competing effects. Second, they are importan t in the design of experiments. Being primaril y concerned wit h the conceptual approach t o modelling, however, we shall not pursue thi s matter; i f you are interested, see Chapter 10 of Hansen (1967). Third , by using dimensionless parameters, we can reduce the number of arbitrar y constants associated wit h a mathematical model. Th e process by which we achieve thi s is known as scaling. A few examples should suffice to explain how scaling works. Equation (1.86) contains a single arbitrar y constant, namely, r = Vlr. We wil l call thi s the drainage time, because volume Voi water would take tim e r t o flow out at rat e r. Let us define a new variabl e by (1.87)
dx dt
dt dx di dt
T
dx dt
τ
{-ν) = -(Ψ) - > χ= χ
1.14
Dimensionality , Scaling , and Unit s
39
whence (1.88)
x(i) = x(0)e-'.
Th e arbitrar y constant has disappeared, because i measures the passage of tim e in unit s of drainage time. Th e expression for χ corresponds, of course, to (1.10). A dependent variabl e may also be scaled. Equation (1.15), i.e., γ
k(x -x)x,
=
f
contains tw o arbitrar y constants, namely, k and Xf. Now, if χ were so small that x could be neglected, then thi s equation would be approx› imately (\lx)dxldt - kxp an exponential growth equation for which th e doubling time, i.e., the growth equivalent of the half-life , would be h.o = (l/fcxy) ln(2); see Section 1.2. Let’ s use thi s doubling tim e to scale t and Xf to scale x, i.e., let’s define 2
i=-^-,
x
Then, on using the chain rule, we have dx
\_dx
=
di
t^dx
=
x di
x
f
= t . kXfX(l
=
dt
f
f
h^j, x
_ f
f
= ln(2)x(l - x),
-x)
2 0
(1.89)
* = - .
'2.0
(1.90)
an equation fro m which the arbitrar y constants have disappeared. The solution
corresponds, of course, to (1.16). = ax exp(-&x ) , contains tw o arbitrar y Equation (1.54), namely, x„ constants, a and b. By using a recurrence relation, we have, in effect, already scaled the tim e variable. It remains only to scale the dependent variable, x. Let us define +l
n
=
(1-92)
where x* = \n(a)/b. Th e significance of x* wil l emerge in Section 2.4. Then x is measured in unit s of x", just as was measured in unit s of Xy above. If we now define r = ln(a), then we easily obtain the dimensionless recurrence relatio n n
v
Xn-L+ 1I —
"
~
X'
~
= ax e- " Xn(a)i
n
o-bx'(x„lx")
X'
= i/"-*’ ,
which contains a single arbitrar y constant, r.
(1.93)
40
Chapte r 1 Growt h an d Decay . Dynamica l System s
A s a final example, let’s consider equations (1.20), which contain the four arbitrar y constants a a , b and b . Let’ s scale χ wit h respect t o x* = a lb and y wit h respect t o y* = a lb . Th e significance of x' and y* wil l emerge in the followin g chapter. Suppose that you cannot thin k of an appropriat e characteristic magnitude for t; then just call it T, and determine it s value later. Hence the new dimensionless variables are u
2
2
u
2
2
{
bx
χ χ
=
^
y
2
=
ΐ '
y
=
7
{
b,y
.
t
'=T
= T*
( L 9 4 )
By methods that should now be familiar , we obtain
τι Vii =
=
~*
i ( / j > ) ) =
°
i T x ( l
-
y' y
on using (1.20). Because Τ is at our disposal, we choose Τ = 1/Æ,. Th e resultant set of differentia l equations contains only a single arbitrar y con› stant, a la , instead of the original four . You should check that (1.95) would contain the same single arbitrar y parameter if we had chosen Τ = \la in› stead. Scaling variables is by no means compulsory and not always useful. Though it always simplifies the mathematics, it sometimes obscures im › portan t details of the process being modelled. Therefore, scale if it helps you; otherwise don’t. That’ s what I’v e done throughout the text. You can test your understanding of dimensionality and scaling by at› temptin g Exercise 1.20. 2
{
2
Exercise s 1.1 (i) Obtain (1.10) and (1.11). (ii ) Show that, in the lake purificatio n model of Section 1.1, an annual vari› ation of r about its mean would not significantly alter the value predicted for *o.o5- Hint: Take r(t) = p(\ + e sin(2xf))» where æis the mean outflow (and inflow) , l is the number of years since pollution input ceased, and |e| < 1 (otherwise r could be negative). 1.2 Derive (1.16). 1.3 Suppose that the phase-plane diagram in Fig. 1.3 is drawn for arbitrar y values of the parameters Æ,, a , b and b . Deduce from (1.20) that the solution curves belong to the family 2
lt
2
a ln(x) - b x + a, \n(y) -b y 2
2
x
= ln(c),
Exercise s
41
where c is a constant. To two significant figures, the values of c in Fig. 1.3 are, starting with the degenerate innermost curve denoted by a dot, c = 0.14, c = 0.13, c = 0.12, c = 0.10, c = 0.08, and c = 0.05. 1.4 Suppose that the phase-plane diagram in Fig. 1.4 is drawn for arbitrar y values of the parameters a a , b and b . Deduce from (1.22) that the solution curves belong to the family it
-a
2
2
lt
2
ln(x) + b x + a ln(y) - b y - ln(c) 2
{
{
where c is a constant. In Fig. 1.4, the value c = 0.207 corresponds to the two branches of the dashed curve (separatrix). For values of c exceeding this value, the two branches of the corresponding curve li e above and below the separatrix; for c < 0.207, to the right and left of it. 1.5 Two plants are growing independently off independent fixed supplies of sub› strate. Let x(t) be the dry weight at time t of the first plant and y(t) that of the second. Then, according to Section 1.3, we may regard x(f) = (x(t),y(t)) as the state at tim e / of a two-dimensional system governed by the equations T
dxldt
-- kx(x
f
- x),
dyldt
= ky(y
f
-
y).
(1) Writ e down the solution x(z) to these equations. (ii ) For k = 0.1, x = 7, and >y = 10, plot solution curves in the x-y plane for a variety of initia l values x(0) in the rectangle 0 < ;c < 13, 0 < y < 16. Not all initia l values are physically meaningful, but this will help you to understand the phase-plane. f
1.6 Use the data in Table 1.1 to plot ln(/ ) against /. Use your diagram to com› ment upon the validit y of (1.36). Do you consider this to be an acceptable labor growth model for the entire period 1890-1926? For part of it? If so, can you provide a rough estimate for the best value of p? L
1.7 Solve (1.37) to obtain (1.38). Verif y (1.41), and show that this expression approaches zero as t — oo. *1.8 (i) Suppose that a lake is being polluted at the rate of P tonnes per day. How must the model of Section 1.1 be modified to account for this pollution input ? Obtain a new expression for x(t), (ii ) Everyone knows that machines wear out and buildings deteriorate. Sup› pose that, if there were no investment, then an economy’s capital stock would decay in value at constant specific rate a. This decay is known as depreciation. How must the model of Section 1.6 be modified to account for de› preciation? in
1.9 Reproduce Table 1.2 for yourself by solving (1.54) on a calculator or com› puter.
42
Chapte r 1 Growt h and Decay . Dynamica l System s
1.10 Deduce the solution of the differential equation (1.62) from (1.16). ” . 1 1 According to the 1981 Yearbook of Encyclopedia Britannica, the U.S. popu› lation in 1980 was 226.5 million . Using Fig. 1.7, can you suggest a model that describes U.S. population growth from 1940 onward? Can you interpret the apparent change in the capacity of the land? 1.12 Mathematical assumptions can often be justified subsequently without re› course to data by checking the consistency of some mathematical prediction (whereas modelling assumptions can ultimately be justified only by recourse to data). We call this an a posteriori justificatio n of the mathematical as› sumption. In Section 1.9, for example, we had to assume that d x/dfi was small in order to arrive at equation (1.59). Show a posteriori that the error in approximatin g dxldt by D(t), to obtain (1.59), could not have exceede d 10~ . 3
3
"1.13 In this exercise, we will derive a model empirically and then interpret it conceptually. The model concerns the decay of a population of houseflies, not with respect to an increase in tim e but rather wit h respect to an increase in dosage of insecticide. Let φ denote the concentration in milligram s per cubic centimeter of pyrethri n insecticide. Let d denote the fraction of the population of houseflies that would be killed by that dosage. The following data are given by Finney (1952, p. 149):
φ d
0.50 0.20
0.75 0.35
1.00 0.53
1.50 0.80
2.00 0.88
(i) Let χ = 1 - d denote the survivin g fraction of the population when the concentration of insecticide is φ. Plot the values of - ln(x) against those of φ. What possible model is suggeste d by the data? (ii ) Can you interpret thi s model conceptually? Hint: Consider the effect on the survivors of an infinitesimal increase in concentration of insecticide. *1.14 In Section 1.8 we imagined that the fraction, 7 , of young salmon survivin g unti l spawning was 1 in 10 , or thereabouts. What could cause thi s fraction to be so small? A possible answer is predation. Let x(t) denote the number of units (hundreds of millions) of young salmon at tim e /, during the survival period (thus t < t < n+ 1, where n+ 1 - t = e is independent of n). Let h{t) denote the harvest rate, i.e., the number of units of young salmon captured and eaten per unit of time. Then, clearly, 4
b
b
2
Exercise s
43
(i) The more young salmon there are, the more that are captured. The more predators there are, the more young salmon that are captured. If w(f) denotes the predator population, what is the simplest form of h(t) consistent with these two observations? (ii ) The model described only short-term dynamics, because everything hap› pens withi n the salmon’s breeding cycle. What is the simplest form of «(/) consistent with this observation? (iii ) Solve the resulting differential equation for x(t) in the interval t < t < η + 1. Hence express 7 as a function of the other parameters. Does it now seem reasonable that 7 might be as small as 10" ? b
4
* 1.15 In Exercise 1.14, we introduced a short-term model for preying on fish (salmon, in that particular example). Perhaps you imagined the predator to be another species offish. It might be so, but it might just as easily be the human species. Then u(t) denotes number of fishermen. Since fishermen who hope to sustain their livelihoods will be interested mainly in the long-term dynamics of harvesting, we must modify our model to account for this. Now, in Section 1.8, the long-term dynamics were described by a recur› rence relation, but they might also be described by a differential equation witness (1.59), which describes U.S. population growth from 1790 onward. Indeed the main reason that the model of Exercise 1.14 is a short-term one is that growth of the fish population is ignored. Let’s therefore include it by writin g dx ^ = F(x(t))-h(t),
(a)
where F(x), the net productivity, is the number of units of fish added to the population per unit of tim e (and h(t) remains the harvest rate). Exercise 1.14 is the special case of (a) for which F(x) = 0. Equation (1.62) is the special case of (a) for which F(x) = Rx(\ - xlK) and h(t) = 0. (i) Suppose that in the absence of harvesting the (long-term) growth of a fish population would be given by (1.62), and observation (i) of Exercise 1.14 would remain valid. Writ e down the ordinar y differential equation that de› scribes harvesting of fish under these conditions. (ii ) Suppose that the number of fishermen, u(l), is constant (even in the long term). Solve your differential equation for x(t) as a function of / in the interval 0 < / < 0 0. *1.16 (i) We have seen in Section 1.9 that a population may adequately be described by (1.63) in the early stages of growth. Indeed this observation is implici t in (1.20) and (1.22). Let x(t) denote the size of an insect population, which acts as a pest on an agricultura l crop and is controlled by applying pesticide. Why might (1.62) actually be inappropriate? (ii ) Assume that the population dynamics would be described by (1.63) if it weren’t for the fact that, enticed by the crop, additional pests of the same species immigrat e into the area of cropland at a constant rate q per unit of
44
Chapte r 1 Growt h and Decay . Dynamica l System s
time. Writ e down a differential equation that describes the growth of the total pest population before the crop is sprayed, (iii ) Show that * W = ( 4 0 )+
I)
at least until the crop is sprayed. * 1.17 (i) In Exercise 1.15, we defined the net productivit y of a species of fish to be the number of units added to the population per unit of time. Let us suppose that the fish are not being harvested (i.e., h — 0). Then what is the relationship between net productivit y and net specific growth rate? In particular , what is the relationship of μ(χ) to the graph of F(x)? (ii ) What is the value of F(0)7 If Κ is the population’s capacity, i.e., the value that χ cannot exceed, then what must be the value of F{K)1 (iii ) In (1.62), with μ(χ) = R(\ - xlK), we assumed that specific growth rate was largest when the population was least. Why might this assumption be unrealistic? (iv) Why might it be more realistic to assume that /i(jc ) is small when χ is small, increases to a maximum and then decreases to zero as χ approaches the capacity, ΚΊ (v) In view of (i) and (ii), what is the shape of the graph of F if it embodies (iv)? (vi) Verif y that F(x) = ax (\ - xlK), where Æis a constant, embodies (ii) and (iv). 2
1.18 Show that model (1.72) for a reversible chemical reaction is mathematically equivalent to the one you developed in Exercise 1.8(i). Hence obtain an expression for £(/). 1.19 (i) Derive (1.78). (ii ) Using the relation uduldx = duldt, where χ is distance travelled, solve (1.77) for u as a function of χ and show that u approaches ˚ as distance travelled becomes infinitel y large. (iii ) Suppose that the length of the course is d. If the crew were magically able to attain speed V instantly, how long would it take them to row the course? (iv) How long does it actually take them? Call this time t and find an ex› pression of the form l = G{q)dl V, where q = MldbSd. (v) Show that G is an increasing function of q, which approaches 1 as q approaches 0 from above. (vi) If q — 0.2, by what percentage is t longer than the tim e given in (iii) ? What if q = 0.02? f
f
f
1.20 (i) What are the dimensions of the constant b in (1.77)? (ii ) By suitably defining dimensionless variables, show that (1.77) may be rewritte n in a form that does not contain any arbitrar y constants.
Supplementar y Note s
45
(ίίί) Integrate this differential equation and compare your answer with the one you obtained in Exercise 1.19. (iv ) By scaling t with respect to \IR and χ with respect to K, show that the logistic equation (1.62) may be written in the form dx There are, of course, no arbitrary constants; but note that the factor ln(2), which appeared in (1.90) has also disappeared. * 1.21 Two plants are feeding off the same substrate, whose weight at time l is 5(0· Can you adapt the model of Section 1.3 to devise a system of two differential equations that describes their growth? Can you solve these equations? What if the plants are identical in all respects but one, namely, that they were of different sizes when they began to feed off the substrate?
Supplementar y Note s 1.1 The number 6.024 ˇ , known as Avogadro’s number, was originall y chosen so that a mole of hydrogen would have a mass of 1 gram. Then the mass of a mole of any other substance could be counted in terms of hydrogen molecule equivalents (or hydrogen atom equivalents, since atoms and molecules are the same thing for elements). Masses quoted in these units are known as molecular weights. Carbon dioxide (C0 ), for example, has a molecular weight of 44 be› cause the carbon atom in each molecule has six protons and six neutrons and each of the two oxygen atoms has eight protons and eight neutrons, making a grand total of 44 protons and neutrons (each of which is counted as a hydro› gen atom equivalent). The problem with this approach is that it pretends elec› trons have zero mass, when in fact their mass is 1/1840 of a proton’s. For greater accuracy, therefore, it is customary nowadays to replace "hydrogen atom equiv› alent" by "equivalent of one twelfth of carbon atom" (in terms of mass); but if you round molecular weights to the nearest integer then it makes no difference. 23
2
2
EQUILIBRIU M
Two more of th e most useful ideas in mathematical modelling are those of equilibrium , or steady state, and stability . Th e tw o are closely related. Withou t stability , equilibriu m has virtuall y no practical significance. With › out equilibriu m (or steady state), stabilit y has absolutely no meaning, ei› ther practical or theoretical. To understand these importan t ideas, it wil l be convenient t o introduc e a littl e fiction. Imagin e that, whil e travellin g through a distant region of the universe, you have accidentally discovered an infinit e two-dimensional world . Thi s world , called Phaseplane, is inhabited by microscopic creatures who call themselves Phasies. They are so tin y that we may thin k of them as points. Because their worl d is absolutely flat, they are lik e points moving about on an infinit e page. What kin d of a worl d is Phaseplane? Th e first thin g I must tell you is that it’ s an extremely windy one! Th e wind in Phaseplane moves in curious ways; yet it s pattern never changes. Thu s maps of it are extremely useful, and every Phasie is given a wind-atlas on her first day in kindergarten. A page fro m thi s atlas appears in Fig. 2.1. It shows the wind pattern over the rectangle 0 < χ < 9 0 ,0 < y < 60; χ and y are measured in phasemiles. (The origi n was chosen by the Phaseplane government and is jocularl y known as the Big Saddle.) A curve in Fig. 2.1 shows the path along which a Phasie would get blown by the win d if she were t o stand at any point along that curve; the directio n of movement is indicated by arrows. Thi s path is known as the Phasie’s phase trajectory. Because Phaseplane is such a wind y place, a curve lik e thi s could in principl e be drawn through any point of the rectangle in Fig. 2.1. The resulting infinit y of curves would fill the entir e diagram. But nobody can draw an infinit e number of curves; and the exercise would be pointless even if possible, because a solid black diagram would give no informatio n about the wind . Thu s a page of a Phasie’s atlas shows only 46
Chapte r 2
0
10
20
30
40
50
60
Equilibriu m
70
80
47
90
Fig. 2.1 Page of a Phasie’s atlas.
a few phase trajectories. Fro m these, a Phasie can infer the entir e wind patter n by using her imagination. Because Phasies are so tin y and the wind so strong, shouldn’t they al› ways go where the win d takes them? Isn’t a Phasie’s path in lif e completely determined by where she began it? There is much trut h in this, but not the whole truth . Th e second thin g I must tell you about is the wicked monster, Perturbation . Although the wind is almost always blowing, there are times when it disappears completely, just for a few seconds. When that happens, Perturbatio n comes out of her lair and takes great delight in blowing the Phasies all over the place. But the wind always comes back withi n a few seconds and, furthermore , resumes precisely the same pattern that it had before it mysteriously disappeared. Then Perturbatio n retire s t o her lair , and the Phasies retur n t o followin g the destinies mapped out for ihem i n the atlas. Phasies have a name for these sudden experiences: they call them perturbations. Perturbation s may be either large or small, depend› in g on how far you get blown fro m where you were; and, as Phasies know well, even a small perturbatio n can be very disruptive. We’ll discuss thi s furthe r below. Though Phaseplane is such a windy world , there are points where the wind velocity is always zero. These special points are known officiall y as static equilibria ; though Phasies often omit the word static and refer
48
Chapte r 2
Equilibriu m
t o them merely as equilibria . Such points are marked on Fig. 2.1 by a small dot. There is one, for example, at the point ( 7 0 , 7) and another at (25,12). Notice how the wind pattern in the immediate vicinit y of one equilibriu m may differ fro m that in the immediate vicinit y of another. Near ( 7 0 , 7 ), for example, the wind is always blowing toward the equilib› rium . Thu s a small perturbatio n would scarcely be noticed by a Phasie at (70,7); the wind , when it returned, would blow her back toward where she came from . For that reason, the equilibriu m at ( 7 0 , 7) is called locally stable. Even a small perturbation , however, would be enough t o nudge a Phasie at ( 2 5 , 1 2) onto a path that spirals outward, toward the curve consisting of four straight-lin e segments linkin g equilibri a at (0,0), ( 5 0 , 5 ), ( 5 0 , 2 0 ), and ( 0 , 2 0 ). Because, followin g a perturbation , a Phasie at ( 2 5 , 1 2) would end up so far fro m where she began, thi s equilibriu m is called unstable. Fro m thi s point of view, the equilibriu m at ( 2 5 , 4 0) is identical t o th e one at (70,7). Both are locally stable. Fro m another viewpoint, however, they differ : a Phasie being blown toward ( 2 5 , 4 0) wil l spiral toward the equi› librium ; whereas a Phasie being blown toward ( 7 0 , 7) wil l approach it head on. We distinguish the tw o by calling the equilibriu m that is approached circuitousl y a focus but the equilibriu m that is approached directl y a node. Hence ( 2 5 , 4 0) is a (locally) stable focus, and ( 7 0 , 7) is a (locally) stable node. Then what is (25,12)? Notice that if the arrow s were reversed then th e win d current s in it s vicinit y would be the same topologically as ( 2 5 , 4 0 ). For that reason, ( 2 5 , 1 2) is called an unstable focus. Similarly , ( 8 5 , 1 5) is an unstable node. W e said that a small perturbatio n would scarcely be noticed by a Phasie who had been occupying (70,7). Nevertheless life, though not disrupted, would never be quit e th e same for her. Even if she lived forever, she would never again retur n to ( 7 0 , 7 ). Th e longer she lived, the closer she would approach; but she would never actually reach it . Why? The answer is that th e win d speed keeps droppin g as an equilibriu m is approached alway s just a littl e below the speed that would be necessary to blow the Phasie back home. (To be just a littl e more precise, the one way in which the Phasie could retur n all the way h o me before the end of eternity would be if the wicked monster blew her back durin g another perturbation ; but that never happens, because monsters are so wicked.) Th e wind in Phaseplane does vary in strength fro m place to place. Indeed the wind velocity can be described by a vector u = (u{x, y), v(x, y)) , where u is the component in the χ direction, the component in the y directio n and both u and are differentiabl e functions. Here, as throughout th e book, bold typeface wil l denote a column vector and superscript Τ it s transpose, which is a row vector. Thu s u = (u{x, y), v(x, y)) is the transpose of u. I f x(i) = (x{t),y(t)) denotes the Phasie’s phase trajectory , then her velocity is dxldt = (dxldl,dyldt) ; and, because the Phasie is carried by T
r
T
T
Chapte r 2
the wind, we have dxldt
Equilibriu m
49
- u or, which is exactly the same thing,
^
= u{x,y),
^
= v{ ,y). X
(2.1)
Let x* = ( x * , y * ) denote a static equilibriu m point. Then, because the win d velocity is zero at x*, we have u(x*,y*) = 0 = v(x*,y*). Because u and are both continuous, you can see that {dxldt, dyldt) wil l approach th e zero vector as the Phasie nears the equilibrium . Th e wind just isn’t quit e strong enough t o take her all the way back home in a finite time. Th e best it can do for her is ensure that r
l i m x ( / ) = x* , OO
li m y{t) = y'
(2.2)
t— 00
(provided there are no furthe r perturbations). However disgruntled thi s Phasie might be, she has less cause for com› plaint than one who resided at ( 6 5 , 4 0) before a (small) perturbation . N o› tice that the wind current s in thi s vicinit y for m closed curves around the equilibrium . A Phasie perturbed fro m ( 6 5 , 4 0) wil l spend the rest of her lif e circlin g it. She wil l not approach it even in infinit e time! On the other hand she at least remains in close proximit y to her old equilibrium . Her plight is not as dir e as that of the Phasie who once resided at ( 2 5 , 1 2 ). Thus ( 6 5 , 4 0) is far fro m being unstable; yet it isn’t quit e as stable as (25,40). How, then, should we distinguish between the two? Some mathematicians prefer to say that both are stable but that, in addition, (25,40) is asymp› toticall y stable. Others, and we are among them, prefer to say mat ( 2 5 , 4 0) is stable, but ( 6 5 , 4 0) is only metastable, or neutrally stable. Al l are agreed that ( 6 5 , 4 0) should be called a center, because the nearby trajectorie s for m closed curves around it. Ther e is also some disagreement as to the best description for the equilibri a at ( 5 0 , 5 ), ( 5 0 , 2 0 ), and (80,30), the neighborhoods of which have th e same topology. Th e equilibri a at ( 0 , 2 0 ), ( 0 , 6 0 ), ( 5 0 , 6 0 ), ( 8 0 , 6 0 ), and th e Big Saddle itself are also of thi s form , though some of the trajectorie s nearby fall on different pages of the Phasie atlas. What distinguishes these equilibri a is that each has tw o trajectorie s of approach; whereas all other trajectorie s emanating fro m the equilibriu m are ones of departure. Thus a Phasie who once resided at (50,20), for example, and just happened t o be perturbed in the x-direction, would have a similar experience to a Phasie perturbed fro m (70,7). For thi s reason, some mathematicians prefer t o call ( 5 0 , 2 0) only partiall y unstable; for them, ( 8 5 , 1 5) would be totall y unstable. Others, and we are among them, prefer t o call ( 5 0 , 2 0) simply unstable, because why would the wicked monster be so considerate as to pertur b the Phasie in just exactly the righ t direction? Al l mathematicians, however, agree that equilibri a lik e ( 5 0 , 2 0) are called saddle-points. We have thus far distinguished four categories of equilibri a on the basis of neighborhood topology: center, focus, node, and saddle-point. A center
50
Chapte r 2
Equilibriu m
must be metastable; a saddle-point must be unstable; and nodes and foci may be stable or unstable. Al l six form s of equilibriu m have one thin g in common, however: they are static. But a Phasie can liv e in a steady state withou t being absolutely static. Thi s is what happens to the Phasies on th e closed curves near ( 6 5 , 4 0 ). It is also what happens t o the Phasies who liv e on the closed curves through ( 1 2 , 4 0) and (43,40); these tw o points are marked by large dots, the only dots in Fig. 2.1 that do not represent static equilibria . But there is a difference. A Phasie who lived on a curve near a center, if slightly perturbed, would continue to liv e lif e on a closed curve. But a Phasie on the closed curve through ( 1 2 , 4 0 ), if perturbed, would either spiral in toward the focus at ( 2 5 , 4 0) or spiral out toward the closed curve throug h (43,40). She would never again find herself on a closed curve. Likewise, a Phasie on the closed curve through (43,40), if perturbed, would never again find herself on a closed curve; rather , depending on the natur e of the perturbation , she would spend the rest of her lif e either spirallin g i n or spirallin g out toward the steady state that she used t o enjoy. For thi s reason, the latter trajector y is called a stable equilibriu m cycle. Th e curve throug h ( 1 2 , 4 0) is called an unstable equilibriu m cycle. The more c o m m on ter m for a stable equilibriu m cycle is limit cycle. Unti l now, we have been talkin g exclusively about small perturbation s and local stability . I f the wind disappeared for quit e a while, however, then the wicked monster might blow the Phasies a long way fro m home; or, as the Phasies prefer t o say, cause them t o suffer a large perturbation . I t is clear fro m Fig. 2.1 that, even if a Phasie occupied a stable equi› librium , such a perturbatio n might land her on a trajector y that would never retur n t o it , even in infinit e time. We would say that her old equi› libriu m was locally stable, but not globally stable. For example, consider a Phasie who occupied ( 7 0 , 7) when the win d disappeared. Suppose that th e perturbatio n shifted her to (49,21). Then, when the win d came back, she would find herself being blown toward the stable limi t cycle in the upper left of Fig. 2.1. I n the conventional jargon, she would find herself in the limi t cycle’s domain of attraction (the region between the unstable limi t cycle and the upper left rectangle wit h a saddle-point at each cor› ner). Unfortunately , the mathematics associated wit h large perturbation s and global stabilit y of an equilibriu m or steady state is beyond the scope of thi s text. Therefore, we shall continue t o assume that any perturba › tio n is a small perturbation , and stabilit y synonymous wit h local stabil› ity . But the universe is an enormous place, and the worl d of Phaseplane is not unique. Rather, there are many such worlds, one for every dynamical system of the for m (2.1). Because there are so many of them, let’s drop th e capital Ρ and use phase-plane t o denote th e "wind " pattern associated wit h a pair of equations of the for m (2.1). Different choices of u(x,y) and v(x, y) wil l lead t o different patterns. Indeed we met tw o systems of the
Chapte r 2
Equilibriu m
51
for m (2.1) in Chapter 1, and it wil l be convenient now to give them a phase-plane interpretation . Fro m (1.20), the simple ecosystem of Section 1.4 corresponds t o (2.1) + b x). There is therefore wit h u(x,y) = x{a - b y) and v{x,y) = y(-a because u and both an equilibriu m at the point x* = (a /b ,a /b ) , vanish there; thi s point is marked wit h a dot in Fig. 1.3. (There is also an equilibriu m at x* = ( 0 , 0 ) , but we paid no attention to it in Section 1.4, because neither species would then exist.) From the pattern in Fig. 1.3, we immediately deduce that the equilibriu m is a center. From (1.22), the simple ecosystem of Section 1.5 corresponds to (2.1) wit h u(x, y) = x(a\ - biy) and v(x, y) = y(a - b x). There is therefore an because u and both vanish equilibriu m at the point x* = {a lb , a\lb{?, there; thi s point is marked wit h a dot in Fig. 1.4. (Again, we ignore the equilibriu m at x* = ( 0 , 0 ) . ) From the pattern in Fig. 1.4, we immediately deduce that the equilibriu m is a saddle-point. {
{
2
2
T
2
2
l
l
r
2
2
2
2
r
By drawin g the phase-plane of a dynamical system of the for m (2.1), we can always find it s (static) equilibri a and limi t cycles; we can also char› acterize them as stable or unstable. But, as we saw in Chapter 1, not every dynamical system consists of a pair of differentia l equations. A system might , for example, be governed by differential-delay equations or a recur› rence relation. It is therefore desirable to fram e more general definition s of equilibriu m and stabilit y than are afforded by the Phasie atlas. Accordingly , we define an equilibriu m (or steady state) of a dynamical system to be a state (or cycle) that wil l persist forever if undisturbed. A n equilibriu m may be unstable, stable, or metastable. It is unstable if there exists a small perturbatio n that wil l cause the system to move furthe r and furthe r away fro m equilibrium . It is stable if any small perturbatio n wil l cause the system t o spend the rest of it s lif e returnin g t o equilibriu m (in th e absence of furthe r perturbation) . And it is metastable if a small pertur › bation wil l neither send the system furthe r and furthe r away, nor retur n it t o where it was, but cause it to persist forever in a state or cycle nearby. By perturbatio n we mean a sudden change of state due t o circumstances outside the control of the system itself (i.e., a change that cannot be pre› dicted by the differentia l equations or recurrence relations that govern the system). Of these three kind s of equilibrium , a stable one is by far the most important , because equilibri a in natur e are subject t o so many random perturbation s that we would not even observe them as steady states unless they were quit e stable. The word "observe" is crucial here, because nothing is trul y constant in nature; but states that change appreciably only over very long tim e scales, such as evolutionary or geological ones, wil l appear t o be steady a t least to mere mortals an d we model things as we observe them. Moreover, even fro m a purely mathematical viewpoint, things often appear steady when in fact they are not (consider equation (1.16) for very
52
Chapte r 2
Equilibriu m
large values of t). Thu s a system that, followin g a perturbation , wil l take infinitel y long in theory t o retur n t o stable equilibriu m can be regarded, in practice, as resuming it s former state withi n a finite time. Stable equilibri a can be identified in tw o ways: either directly by solv› in g an equation or equations whose solution can only be an equilibrium , or indirectly by followin g the system through a sequence of nonequilibriu m states which converges to the equilibrium . (Unstable equilibri a can be identified only directly . Why?) Thi s is a chapter on equilibriu m models; therefor e we are primaril y concerned wit h the first of the tw o methods. But we’ll begin, in Sections 2.1 and 2.2, by understanding the interrelationshi p between the tw o methods. From Section 2.3 onward we’ll concentrate on th e direct method.
2.1
Th e Equilibriu m Concentratio n of Contaminan t in a Lak e
Suppose that, at tim e / = 0, the concentration of contaminant in a certain lak e of volume Vis x(0) = x tonnes per cubic meter. A new polluter now begins to pollut e the lake at the rat e P tonnes per day. There are no other polluters. What wil l be the equilibriu m concentration of contaminant in th e lake? First , let’s answer thi s question by using the direct method; i.e., let’s construct an equation whose solution can only be an equilibrium . Let x* tonnes per cubic meter be thi s equilibriu m concentration. Then, if water flows out at the rat e r cubic meters per day, the daily outflow of contami› nant is rx* tonnes per day. I n equilibrium , thi s daily outflow must balance th e daily inflo w P . Hence rx* = P or 0
in
i n
in
x' = ^ -
(2.3)
N ow let’s use the indirect method. From Exercise 1.8: Rate of change _ Pollution _ Pollution of pollution ~~ inflow outflow j {Vx{t)} t
=
P
in
-
rx{t).
N o t e that (2.3) is the particula r solution of thi s equation for which dxldt 0. You can easily show that the general solution i s x(l) = £ a + (x(0) -
e-
n l v
.
=
(2.5)
I f it just happens that x{0) = x*, then you can see fro m (2.4) and (2.5) that the new polluter makes no difference; the lake remains forever in the state x(0). I f x(0) φ * , however, then we can follow the sequence of states
2.2
Rowin g In Equilibriu m
53
{x(t):t> 0 } , which converges t o the equilibriu m concentration as t -> oo. I f x* < x(Q), then the pollutio n continues to fall; if x' > x(0), then th e pollutio n rises. (I f P = 0, of course, then the pollutio n just decays at th e rat e determined in Section 1.1). in
2.2
Rowin g in Equilibriu m
I n Section 1.12 we developed the followin g model for determining th e speed of a rowin g boat: , .• Tractiv e Acceleration = . force
Mass
»s M
x
8
T t
=
Drag force 3
x
A r t
^
1
τ
where ξ{ή denotes the speed of the boat at tim e t, Μ it s mass, Ρ the effective power supplied by an oarswoman, S the wetted surface area and b a constant. We may regard ξ(ή as th e state of a dynamical system. Thi s system has a "static " equilibrium , in which the boat is moving but it s speed does not change, if ξ(ί) = ξ* = constant. Then άξ/dt = 0, and th e tractiv e force exactly balances th e drag. Let us define 1
*>"37{t -"4
'>
<2 7
Then, using the direct method, the equilibriu m speed is given by /(ξ*) = 0 or ι, pΡv\ 1/3 ˆ = ^ 2 ( - ) , (2.8) 1/3
where Vis the speed denned by (1.79). Thi s equilibriu m can also be found indirectl y by solving equation (2.6) and followin g the sequence of states {ξ(():ί > 0} as t oo. We di d thi s in Chapter 1 and saw fro m Fig. 1.8 that ξ -+ V as l -* oo. But thi s result also follows fro m (2.6). For i f ξ(ή < F t h en th e righ t hand side of (2.6) is positive, implyin g that άζ/άί > 0 and ξ increases wit h t; whereas if ξ(ή > V then the right-han d side of (2.6) is negative, implyin g that άξ/dt < 0 and ξ decreases wit h /. Thu s ξ is always approaching V— even i f the oarswomen began by rowin g faster, the excess of drag over tractiv e force would soon reduce their speed to V. These arguments are sufficient to show that the equilibriu m ξ = ξ* = V i s stable. But it wil l be instructiv e to verif y thi s result by an alternativ e The speed is denoted by ξ rather than u as in (1.77) to emphasize its role as the state of a dynamical system.
54
Chapte r 2
Equilibriu m
method. Suppose that the oarswomen are rowin g at the equilibriu m speed ˚ when their boat suffers an external shock, such as a sudden gust of wind . Thi s perturb s their speed fro m ˚ t o V+ n , where n is small. Withou t loss of generality, let’s suppose that thi s all took place at tim e / = 0. Then the subsequent motion of the boat is governed by (2.6) wit h ξ(0) = V+ η . Let us define relativ e velocity η(ί) = £(f) - Κ so that »?(0) = n . Then, on using (2.6), (2.7), and the Taylor expansion of / about V, the motion is governed by 0
0
0
0
j {r+ri=AV+n)=AV)
(2.9)
+ nr(V)+ θ( ), 2
t
η
where 0(η ) is defined by (1.1). N ow dVldt = 0=f(V). Moreover, because η is small and η continuous, ??(/) must remain small at least for / close t o zero. Then 0(η ) is negligible, and (2.9) yields the approximatio n 2
0
2
fro m which you can readily deduce that rfi)
M
fV>
%
= η β-^"
Μ
0
(2.11)
= e-", no
where º = IbSVIM. Thu s η(ή remains small, not just for small t but for all t, and dies away completely as / —• oo (though note that would increase withou t bound if º were negative). Th e rapidit y of retur n t o equilibriu m i s clearly measured by the rat e |A| at which (2.11) decays t o zero. (You should verif y that |A| is indeed a rate, i.e., has the dimen› sions of I /time ). Th e larger thi s rate, the more rapi d the return . More › over, the larger thi s rate, the sooner a crew reaches equilibriu m speed fro m rest, and the better an approximation it is t o estimate their tim e i n a race by assuming they row at equilibriu m speed for it s entir e du› ratio n (see Exercise 1.20). We shall make use of thi s observation in Sec› tio n 4.4. W e have thus used analytical methods t o establish the stabilit y of the equilibriu m * = K(whereas Fig. 1.8 established thi s graphically). Likewise, we can determine analytically whether equilibri a of the system j l = u(x,y),
^
= v{x,y)
(2.12)
are stable or not (we do thi s graphically by sketching it s phase-plane). be a static equilibriu m of thi s system. Let relativ e dis› Let * = (χ',γ') where placement fro m thi s equilibriu m be defined by tj(i ) = (η(ή,ζ(ή) , r/(i ) = x{t) - x* and C(0 = y(t) - y*. Then, on using Taylor’ s theorem for 7
τ
2.2
Rowin g In Equilibriu m
55
function s of tw o variables, we deduce fro m (2.12) that j {x'
+ } = u(x' + ,y
(
η
r
+ 0
n
= u(x', / ) + ηγ {χ*,
f)
χ
+ C
,/ ) +
0(e ) 2
(2.13) ^ { / + C }
=
v
(
*
*
Ο
= v ( x * , / ) + v^ix*
/ )+
,y') +
0(Λ
where e is defined to be the maximum of η and ζ. I f η and C are small initially , then so is e. Thus, at least for a short tim e after the system has suffered the perturbatio n ij(0 ) = = (η , ζο) , the evolution of the relativ e displacement ( ) is well approximated by ignorin g the 0{t ) terms in (2.13). Moreover, x* is a static equilibrium ; therefore we have dx'ldt = 0 = dfldt and u(x*, y*) = 0 = vi** , / ) . „ , on defining τ
0
0
2
du, , 4»ii = ^ ( J C . J ' ) .
du. „ ^12= ^ r i ^ . J ' ) . 7
7
ft I = ^ ( * * . f ).
( · 2
1
4
)
#22 = ^ ( * * . f )>
th e immediately subsequent motion of the system is approximately gov› erned by the linear equations
Multiplyin g the second of (2.15) by g and using the first of (2.15) t o replace g ( by άη/dt - g q, we easily obtain n
l2
u
-
(ΖιØ
+ 822)
+
(Si
1822
= 0.
~ 812821)*}
(2.16)
Fro m the first of (2.15), and because ?j(0) = η , we must solve thi s equation for η(ή subject t o 0
,(0 ) = , *
η'(0)- η(0)
=
8ιι
8 ι 1
ζ . 0
(2.17)
I t is known fro m the theory of ordinar y differentia l equations that any solution of (2.16) must have the for m η(ΐ) = Α (ί) ηι
+ Βη (ί), 2
(2.18)
where A, Β are constants and 77, (f), η (ή are any tw o nonzero solutions that are not constant multiple s of one another; see, for example, Theorem 3.9 of Boyce and DiPrim a (1965, p. 97). It follows, in particular , that the solution satisfying (2.17) must have the for m (2.18). N ow consider the quadrati c 2
56
Chapte r 2
Equilibriu m
equation
+^22^+^11^22-^12^21 = 0 .
ø - ( £ ,, 2
(2.19)
Th e roots, u>\ and ω , of thi s equation must belong to one of the followin g three categories: 1. real and unequal; 2. real and equal, i.e., ω = ω = ω; 3. complex conjugate, i.e., ω = ρ + iq, ω p — iq, where i = You can verif y by simple substitution (Exercise 2.1) that appropriat e form s for η\ and η corresponding to the three categories are, respectively: 2
χ
2
χ
2
2
1. >,,(/) = **"’ ,
n U) =
^' 1
2
KU)=tt"
2. n,(i) =<*"’ ,
3. >?,(/) = β* cos(qt),
(2.20)
η (ί) = e 2
pl
%m(qt).
I t follows immediately fro m (2.18) and (2.20) that η(ή wil l decay t o zero oo if both ø , and ω have negative real parts, wil l increase withou t as bound as - Œ» for some η if either w, or w has a positive real part , and wil l oscillate wit h constant amplitud e if both w, and ω are purely imaginary, where ø , and ω are defined as the roots of (2.19). Moreover (Exercise 2.2), you can show that C obeys the same differentia l equation as η, so that what we have just said about n(r) is also tru e of C(0- Combinin g our results, we find that x* is (locally) stable if w, and w are both negative, metastable if w, and w are purely imaginary, and unstable if either w, or w has a positive real part . I f case (3) applies, then trajectorie s in the phaseplane near x* wil l spiral around it . I n conclusion, the natur e of the static equilibriu m x* may be classified as follows fro m knowledge of the roots of (2.19): 2
0
2
2
2
2
2
2
ROOTS OF (2.19)
EQUILIBRIUM
Real, both positive Real, both negative Real, opposite signs Complex, purely imaginary Complex, ρ > 0 Complex, ρ < 0
Unstable node Stable node Saddle-point Center Unstable focus Stable focus
(2.21)
Limi t cycles are somewhat more difficul t to identif y and classify ana› lytically . We wil l proceed ad hoc whenever we meet them. N ow tr y Exercise 2 . 3 . 2
2
See Supplementary Note 2.1.
2.3
2.3
How Fast Do C a r » Driv e Throug h a Tunnel ?
57
How Fast Do Cars Driv e Throug h a Tunnel ?
Th e more congested a tunnel is, the slower the cars move; the less con› gested, the faster. Thu s the speed of cars through a tunnel is a decreasing functio n of congestion. How does thi s function decrease? I n thi s section, we’ll attempt t o answer that question by using an equilibriu m model. First we need a suitable measure of traffi c congestion. One such mea› sure is the traffi c density, x, i.e., the number of cars per unit length of road. I n general, the density Λ: varies wit h time, /, and wit h distance, z, along th e road; hence χ = x(z, t). We measure the density by takin g aerial pho› tographs at fixed times. Let one such tim e be t = t . Then, to measure the traffi c density at a particula r station = z on the road (at tim e / ) , we use the photograph to count the number of cars in a suitable interval of th e for m z - e/2 < ζ < ζ + e/2 and divid e the answer by t; thi s is our estimate of x(z ,t ). Th e interval length e must be chosen carefully. It can› not, of course, be less than a few car-lengths; neither can it be too long, for importan t spatial variation s of density would be smoothed out. It is prob› ably best t o choose c somewhere between 30 and 50 meters, and certainly much less than a mil e (even though traffi c density is traditionall y quoted as number of cars per mile). Because z is arbitrary , and because we may repeat thi s procedure for any value of z , a single photograph wil l enable us to plot x(z, t ) as a function of z. A series of such photographs taken at different times wil l enable us t o estimate x(z, t). I f speed is a decreasing function of traffi c congestion, and if density χ is our chosen measure of congestion, then = v(x) where 3
0
0
0
0
0
0
0
0
0
Ax)
< 0.
(2.22)
At one extreme, if traffi c is very light , then cars are free to move at the speed limit , which we wil l denote by v . Thi s may be the official speed limi t if police are watching, or whatever speed driver s deem safe, if not; all that matters is that the limi t exists and may be assumed the same for all drivers. Hence there exists some critica l traffi c density x such that m a x
c
if0<x<x .
v(x)=v
(2.23)
c
max
should be interpreted as meaning that a car Th e condition v(0) = v that enters an empty road is free to driv e at the speed limit . At the other extreme, if traffi c is so heavy that cars cannot move, then traffi c density . Thus has reached it s maximum, which we wil l denote by x m a x
m a x
v(*
m a
J = 0.
(2.24)
N ow assume that x < χ < x , so that there is some degree of con› gestion; and suppose that the cars have reached an equilibrium , in which c
max
You may wish to review Section 1.13 before proceeding.
58
Chapte r 2
Equilibriu m
all are cruising at th e constant speed v, at th e same distance d fro m th e car in front . To make matters simple, we’ll also assume that all cars have th e same length, L. Then th e traffi c density is
*-7πτ
'
(2 25>
(why?). Note that, although equilibriu m density, x, and equilibriu m veloc› ity , = v(x), are independent of both ζ and r, their values may vary fro m tunnel t o tunnel. I n thi s section, we’ll assume that our equilibriu m is stable. We’ll discuss whether that assumption is reasonable or not i n Section 2.8. Let’ s assume that th e dynamics of approach t o thi s equilibriu m are governed by th e model introduced in Section 1.13. Then, fro m (1.83), dz-Xt+ J d
t
t) = º In \zj{t) - zj_ , ( 0| + aj,
(2.26)
where Zj(t) is th e displacement of the jt h car in a platoon of Ν cars, and where r is the driver response time. Now, we have just assumed that all cars are moving at th e same speed v, wit h fron t bumpers a distance d+L apart. Therefore, for a l l a n d at all times, dzj(t+r)/dt= v, \zXt)-z _ {t)\ = d+L and aj i s independent of j . Hence (2.26) yields = º \n{d + L) + a. Fro m (2.25), and on using (2.24) t o determine a, we deduce j
y(x) = A l n ( i s a * ) ,
x <χ < x . c
mM
l
(2.27)
Th e value of º i s determined fro m th e assumption that v(x) is a continuous and hence, in particular , at functio n throughout the interval 0 < χ < x χ = x . Thu s m a x
c
0 <χ < x
c
v(x) = {
» n ( W s) Mnax ,
.
.
r
, ι
Xc
<
r
<
X
(2-28)
r
_
-*max •
You can easily see that (2.22) is satisfied. H o w good is thi s model doe s it fit th e facts? A possible objection t o thi s model is that traffi c density i s not allowed t o vary across the road, as i t surely would if a road had several lanes. I n a tunnel, however, cars are invariabl y prohibite d fro m switching lanes, so that each lane behaves as though it were a separate tunnel and density varies only along the road. But does it vary along the road as predicted by (2.28)? Perhaps you would lik e t o thin k about that we’l l retur n t o thi s point i n Chapter 4. Meanwhile, tr y your hand at Exercises 2.4, 2.5, and 2.10.
2.4
Salmo n Equilibriu m and Limi t Cycle s
Th e salmon population described in Section 1.8 wil l be in static equi› libriu m i f the population (i n hundreds of millions) persists forever at th e
2.4
Salmo n Equilibriu m and Limi t Cycle s
59
level x*. Recall fro m (1.54) that the population’s dynamics are governed by the recurrence relation 4
x
(2.29)
= ax„e- ", bx
n+i
where x denotes the population at the end of cycle n. Hence, in equilib› = x„ = x* for all n. On using (2.29), we find that rium , we have x n
n+l
x* = ax'e~ ';
(2.30)
bx
whence, since * φ 0, we have (2.31)
x* = ^ln(a).
Equation (2.30) is one whose solution can only be an equilibrium . Thus (2.31) has been found by the direct method. I n principle , if x„ could be expressed explicitl y as a function of n, then we could find x* indirectl y as the limit , as η * oo, of the sequence {x }. But no such expression is known. Thu s the direct method is the only one that enables us to identif y the equilibriu m for arbitrar y values of a and b. For particula r values of a and b, however, we can identif y the equilibriu m by solving (2.29) numerically. You did thi s in Exercise 1.9 for b = l n ( 1 0 )« 2.3026 and for various values of a. Th e first value was a = 5, yieldin g x' = ln(5) + ln(10) « 0.6990; and you can see fro m Table 1.2 that thi s is the limitin g value of the sequence {x }. Now, the indirect method work s only for stable equilibria , so that (2.31) must be a stable equilibriu m for a = 5 and b - ln(10). It is pos› sible t o verif y thi s by analogous methods t o those of Section 2.2. Recall fro m (1.48) that (2.29) is just the special case of the recurrence relation n
n
(2.32)
x =F(x ) n+l
n
for which F(x) = axe~ . Any static equilibriu m x' of (2.32) must satisfy n+\ = x„ = x* for all values of n; whence x' = F(x"). Combinin g wit h (2.32) and using Taylor’ s theorem, we find that bx
x
x
-x>=
n + 1
F(x„) - F{x*) = F'ix*) • (x„ - x*) + oi\x
n
- x'\),
(2.33)
where littl e oh is defined by (1.8). I f x is very close t o x* , then o ( | x - x * | ) is so small as to be negligible; let’s therefore neglect it . Now, if |F’(x* )| < 1, then | x | - x * | < | x - x * | ; i.e., x„ is closer t o x* t h a n x . By an extension of thi s argument, we see that the sequence {x } converges to x* if n
+
+i
\F'(x*)\ < 1.
(2.34)
Thu s x* is a stable equilibriu m if (2.34) is satisfied. On the other hand, if |F’(x*) | > 1, then the sequence {x } diverges fro m x* ; i.e., the equilibriu m You may wish to review Section 1.8 before proceeding.
60
Chapte r 2
Equilibriu m
i s unstable. For F(x) = axer , we obtain \F'(x')\ = a e~ *\l - bx*\ = |1 - In(o)|, on using (2.31). Thu s (2.31) is stable or unstable according t o whether a < e («s 7.4) or a > e . I t is therefore stable for a = 5. (Moreover, it is actually unstable for a - 10, so that the slightest perturbatio n would cause x„ t o move successivel y furthe r and furthe r away fro m χ" = I . W e. identified thi s unstable equilibriu m by th e indirect method in Table i.Z only because we were fortunat e enough t o pick j t = 1 = x* ia.,the nil-* merical iteration. ) Accordin g t o (2.34), (2.31) is unstable when a = 11, because 11 > . But look at the column of Table 1.2 corresponding t o a - 11. You can see that th e sequence of values {x„} converges toward a stable equilibriu m cycle, or limi t cycle, in which the population magnitude alternates for th e rest of tim e between th e values x = 0.3568 and χ ~ 1.726. We wil l denote thi s limi t cycle by { ι,Χυ)· Thi s particula r limi t cycle was identified indirectly ; but the direct method identifies all such limi t cycles, i.e., all limi t cycles wit h a period of tw o tim e units. First , recall fro m (1.92) that, by defining bx
b
2
2
0
2
L
υ
χ
3ζ=£.
(2.35)
i.e., by measuring population in unit s of 1001n(a)/6 millions, we can scale th e parameter b out of recurrence relation (2.29) and writ e it in the dimensionless for m (2.36)
xTTi^e* -™, 1
where r = ln(fl) . Let us define y = x = bxjr and = χ = fcty/r. Then, because {y,z} constitutes a limi t cycle wit h period 2, (2.36) yields L
υ
z = ye' -'\
(2.37)
y = ze' - .
tl
il
2)
Eliminatin g ζ fro m these equations, we obtain ye^~ = 2-y. Eliminatin g y fro m these equations, we obtain ze* '^ - 2 - ζ (Exercise 2.6). T h u sy and ζ must both be roots of the equation g{w) = 2 - w, where y)
1
g(w)= we*’-*’) .
(2.38)
Th e function g(w) has a maximum (ff - X)lr at w = Mr and an inflection point at w = 2/r (verify) . Th e roots of g[w) ~ w can be found graphically as the points where the curve W = g(w) meets the straight lin e W — 2-w. I t is clear fro m (2.38) that w = 1 is always a root. Moreover, fro m Fig. 2.2, thi s i s the only root if ^ ( 1 ) > - 1 ; whereas there are tw o other root s i f ^ ( l ) < - 1 . Th e condition for an equilibriu m cycle wit h period 2 i s therefore 1 - r < - 1 or r > 2. Th e corresponding values of y and ζ can be determined fro m (2.38) for any specific value of r. When a = 11, for example, so that r - l n ( l l ) = 2.398, th e Newton-Raphson iterativ e technique finds the roots of (2.38) to be y = 0.342658, ζ = 1.65734 (and 1).
2.4
Salmo n Equilibriu m and Limi t Cycle s
61
w
2
\
Fig. 2.2 Graphical determination of equilibriu m cycle with period 2.
These values correspond to x = 0.3568 and x = 1.726 (hundreds of millions ) in Table 1.2. Let the period-2 equilibriu m cycle for arbitrar y r (> 2) be denoted by MO . z( )}- Then the functions y = y(r) and = z(r) are denned implicitl y by (2.38). For the sake of definiteness, y[f) is the smallest of the three roots and z(r) the largest (so that 0 < y(r) < 1, 1 < z(r) < 2). Th e tw o functions are sketched in Fig. 2.3. A s r becomes indefinitel y large, the smallest root approaches zero; whereas the largest approaches 2. A s r approaches 2, on th e other hand, the equilibriu m cycle collapses to the static equilibriu m x* = 1. L
v
r
y.:.
˜
- (’ )
( ι ) /
˜
v ( c)
2.0
1
1 2.2
\ / l
]
2.4
Fig. 2.3 Period-2 equilibriu m cycles {y(r),z(r)},
1
1
'Ί
l
2.6
which are limi t cycles for r < r . 2
62
Chapte r 2
Equilibriu m
W e have established th e existence of a period-2 equilibriu m cycle for all r > 2, but thi s cycle is a limi t cycle only if it is stable. Th e condition for thi s is Δ(ª)<1,
(2.39)
where A(r) = |(1 - ry(r))(i
- 2r + ry(r))\ = |(1 - rz(r))( l - 2r+rz(r))\.
(2.40)
To see this, observe that for any n, we have Xn+2 = W
K I
~
j e
"
+
’
= Χηβ* -**-**""^,
)
(2.41)
2
on using (2.36). Hence tw o recursions of (2.36) are equivalent t o a single recursion of the recurrence relation X = G(X ), where n+l
n
(2.42)
G(x) = xe' - - ' ~ ; i2 x xe {l
x,)
thi s implies (verify ) that G'(x) = (1 - rx) • (1 - rxe* - ) [ x)
(2.43)
• 'ν- - '"- \ χ χ
χ)
β
Let denote either y(r) or z(f). Then, fro m (2.38), v e = 2 - v; so that G'(v) = (1 - rv)( l - r( 2 - v)). Because the stabilit y condition is |G’(v)| < 1, fro m (2.34), we arriv e immediately at (2.39). Th e function Δ is also sketched in Fig. 2.3. It s graph appears t o be tw o straight lines but in fact has a slight curvature, upward to the left of th e cusp at r = 2.2564 and downward t o the righ t of it . (Th e cusp occurs at the root of the equation έ·'~ = 2r I and corresponds t o the value of r for which the m a x i m um of g in Fig. 2.2 is at y.) We deduce fro m the graph that the period-2 equilibriu m cycle is a limi t cycle if r < r , where Δ ( ª ) = I . It can be shown (Exercise 2.7) that r = 2.5265. Th e period-2 equilibriu m cycle is unstable if r > r , but limi t cycles wit h period higher than 2 may still exist (see Exercise 2.8). Indeed there i s a bounded increasing sequence r < r < r < r < • • •, wit h limi t point r* = 2.6924, such that the population x wil l settle down to a limi t cycle wit h period 2* whenever r < r < r ; see Clark (1976, pp. 2 1 5 - 2 1 6) or May (1976, pp. 12-14), by whom the model of Section 1.8 is denoted "For m B." The first three terms in the sequence, already found, are r = 0, = 2, and r = 2.5265. The static equilibriu m x* = 1 is regarded as a period-1 limi t cycle, so that convergence to it is guaranteed whenever 0 < r < rj . The steady state is still x* = 1 when r = r but convergence K I - v )
,}
2
2
2
2
0
x
2
3
n
k
k+i
5
0
2
u
In theory, this may not be tru e if the initia l condition just happens to place the population in an unstable equilibriu m cycle. In practice, however, there are bound to be perturbations, the slightest of which wil l destroy the unstable equilibrium ; see Exercise 2.9. 3
2.5
Ho w Muc h Heat l o s s Can Double-Glazin g Prevent ?
63
is then extremely slow. For r > r*, the population may never settle int o any finite cycle, as suggested by the columns in Table 1.2 corresponding t o Æ = 15 or r = 2.71. But what does all thi s have t o do wit h salmon? Do salmon populations fluctuate in a limi t cycle? Perhaps you would lik e t o thin k about that we’l l retur n to the matter in Chapter 4. Meanwhile, you should not proceed t o Section 2.5 before attempting Exercise 2.10.
2.5
How Muc h Heat Los s Can Double-Glazin g Prevent ?
Th e wall of a buildin g is in (thermal) equilibriu m if it transfers heat at a constant rate, in much the same way as a rowin g boat is in (mechanical) equilibriu m if it moves at a constant speed. I n winter , the air outside a buildin g is considerably colder than the air inside, so that heat energy is transferred outward; i.e., the buildin g loses heat. Muc h of the heat is lost throug h windows, and double-glazing can reduce thi s loss. By how much? I n thi s section, we’ll use an equilibriu m model t o explore that question. Let ˆ , be the temperature of air inside the buildin g and T the temper› atur e of the outside air ; it’ s winter , so ˆ , > T . Let d be the thickness of a pane of glass and L the distance between panes of a double-glazed window, as in Fig. 2.4 (a). Let x, increasing outward, measure distance perpendic› ular t o the window. It is convenient t o let the inside pane meet th e inside air at χ - 0. Then the outside pane meets the outside air at χ = 2d + JL, and air occupies the gap d < χ < d + L. Let T(x) denote the temperature at station x, so that ˆ(0 ) = ˆ , and T(2d + L) = T We’ll denote T(d) by T and T(d + L) by T . Let F{x) denote the heat flux per unit area at station x, i.e., the heat energy lost per unit tim e fro m left to righ t across unit area of the plane wit h coordinate x. Then, if F does not vary withi n any χ = constant plane, the actual heat flux across area A at station χ is AF(x). How does F(x) depend upon temperature? I f you attempted Exercise 2.10, then you have already trie d to answer thi s question. Let e be some very small number. Then the temperatur e gradient across the interval fro m χ - 112 to χ + e/2 is 2
2
v
A
B
r(x -e/2)-T(x
+
e/2)
e I f T(x - e/2) = T(x + e/2) then no heat flows across the interval . I f T{x e/2) > T(x + e/2), then heat flows fro m hot t o cold, i.e., fro m left t o righ t i n Fig. 2.4 (a); and the steeper the gradient, the more heat that flows. It therefor e seems reasonable t o assume that F(x) is proportiona l t o (2.44); i.e., that F(x)=-k^.
(2.45)
64
Chapter 2
Equilibrium
Wall
Wann inside air(T.)
Cold outside air (T 2 )
4-d-¥*-L-*4-d-¥ |
Wall
|
2d + L (a)
¥*
(b)
Fig. 2.4 (a) Cross section of window, (b) Steady temperature distribution. This approximation has been found acceptable and is used by physicists. The constant of proportionality is called the thermal conductivity and depends upon the medium through which the heat is flowing. Because F has the dimensions of energy per unit area per unit of time (say, Joules per second per cm2), it is clear from the dimensional consistency of (2.45) that k has the dimensions of energy per unit time per length per degree (say, Joules/cm · sec · °C). We will denote the thermal conductivities of air and glass by kA and kG, respectively. Let us now assume that the glass and the air between the panes are in thermal equilibrium. Then the heat flux is constant. Hence T'(x) will be constant in each of the intervals 0 < x < d, d < x < d + L, and d + L < x < 2d + L; but will be discontinuous at JC = d and x = d + L, because of the discontinuity in k. This is depicted in Fig. 2.4 (b). Thus TX-TA T Ti *- = F. Β -k = k, τΑ-τ (2.46) -KG—: ~c--M d L On solving these equations we find (verify) T[ + (p+l)T2 + Γ2 (2.47) TÀ _0>+1)7Ί = T„ = P+ 2 ' P+2 ' where koL (2.48) p = kAd· Hence kGTl-T2_kA p (2.49) :(Γ, - T2). F= d p+2 L p+2 Now, if the window were single-glazed with the same amount of glass, then the heat loss would clearly be
Fs=kfdiT{
T2).
(2.50)
2.5
Ho w Muc h Heat Los s Can Double-Glazin g Prevent ?
65
Hence the relativ e reduction of heat loss is the proportio n Α
=
1
F ρ - Ί Γ = 7ΤΪ·
( 2
·
5 1 )
Accordin g to Landau et al. (1967, p. 321), the thermal conductivity of glass at room temperature is between about 4 1 0 ~ and 8 10~ J/cm • sec • C . (Thermal conductivity varies slightly wit h temperature, but th e effect is negligible in the circumstances being considered.) According to Batchelor (1967, p. 594), the thermal conductivity of dr y air at th e same temperatur e is about 2.5 1 0 ~ J/cm - sec • C . It therefore appears that k lk lies between about 16 and 32. A manufacturer of double-glazing would surely use glass wit h the best available thermal properties, and so let’ s assume that k lk = 16. Then, defining the gap aspect rati o to be h = Lid, (2.51) reduces to ˜(¸ ) = hl{h + 1/8). Thi s heat loss reduction factor is plotted in Fig. 2.5 and clearly shows th e insulating effect of a narro w gap of air. Indeed ˜ increases so sharply wit h h that a gap of four pane-widths achieves a heat loss reduction of 97%. Thereafter, ˜(¸ ) increases very slowly; so that, t o tw o significant figures, th e reduction factor is 0.98 for all values of h between 5 and 8. It therefore appears that very littl e is t o be gained fro m increasing the separation of th e window panes beyond a value of about four pane-widths. Manufactur › ers evidently agree. Double-glazing is advertised regularl y in th e pages of Architectural Digest; and you can see fro m the diagram between pages 64 and 65 of the April , 1986 issue, for example, that the value of h is just a littl e bit bigger than 4. I f cheap air is such a good insulator, as Fig. 2.5 suggests, then why is expensive synthetic fiber used to insulate cavities in walls? Th e answer is that air is an efficient insulator only if it is both dr y and stagnant, as we have tacitl y assumed (wit h good reason, because th e cavity between th e panes of a double-glazed window is perfectly sealed). Ai r containing water vapor has a higher thermal conductivity, and air that is moving can 3
3
4
G
A
G
A
Fig. 2.5 Heat loss reduction factor as a function of the gap aspect rati o h = Lid when k = \6k . G
A
6
Chapte r 2
Equilibriu m
remove heat rapidl y by a mechanism known as convection (transport by a moving medium), which is fundamentally different fro m the mechanism of conduction (transport through a medium at rest) described in thi s sec› tion . Fillin g the gap between the inner and outer brickwor k of a building’ s external walls wit h synthetic fiber prevents convection withi n the gap fro m transportin g heat t o places that are especially vulnerable to heat loss (i.e., holes!). Mathematical models of convection wil l be explored in Chapters 9 and 11. Moreover, by introducin g a dynamic model for heat conduction i n Chapter 11, we wil l show that the indirect method can also be used t o identif y the (stable) equilibriu m temperature distributio n that we found directl y in the present section. I n preparation for this, observe fro m (2.45) that , because heat flux is constant in equilibrium , th e steady temperature distributio n must satisfy (2.52) Meanwhile, tr y your hand at Exercises 2.11 and 2.12.
2.6
Wh y Ar e Pipe s Circular ?
Th e pipes that brin g water int o your house have a circular cross section. Why ? Wh y not elliptical ? Th e answer is that, for a given cross-sectional area, a circular pip e carries a greater quantit y of water per unit of tim e than any elliptical one. To see this, we wil l have to develop a mathematical model of water flowing through an elliptical pipe. I n keeping wit h the titl e of thi s chapter, we wil l assume that thi s flow is in equilibrium . Let a typical cross section of our elliptical pipe have area A, major axis 2a, and minor axis 2b. Let Oxy be a Cartesian coordinate system, wit h Ο at the center of the pipe, Ox along the major axis, and Oy along the minor one (Fig. 2.6). Then the cross-sectional area is given by A = nab,
(2.53)
and the inner wall of the pip e has equation x y ? F = < • > Let w be the velocity of water along the pipe, perpendicular t o the cross section in Fig. 2.6 and out of the page. Th e flow is in equilibrium , and so w is independent of time. Th e velocity of flow wil l vary across the pipe, however, wit h faster flow in the center and slower flow near the wall, so that w is a function of and y. At the wall itself, the velocity wil l be zero, because the outermost particles of water adhere t o the pipe. Hence 2
2
+
w(x,y)
l
= 0 for all x,y satisfying (2.54).
2
5 4
(2.55)
2.6
Wh y Ar e æ » Circular ?
67
V
- - ^ ^
+h
D,
1
h
\
r
A'
"B
ι
ι
ο a
- a
\L
C
\
\
+
\
-
2
a
a
-
j
J Ψ
Fig. 2.6 Pipe cross section.
Th e constraint (2.55) is known in fluid dynamics as a boundary condition. Th e force that reduces th e velocity of the outermost particles t o zero is known as friction . Frictio n is present throughout th e flow, though it is stronger at th e wall than anywhere else. Th e effect of frictio n withi n the flow is that water near the walls attempts t o retar d the adjacent water; thi s water, in turn , attempts t o retar d the water adjacent t o it ; and so on across th e flow, wit h slower water exerting a drag on th e faster water adjacent t o it . But, according t o N e w t on (or, if you prefer, borrowin g fro m physics), every action has an equal and opposite reaction. Thus an equivalent pictur e is that th e water near the center of th e pipe attempts t o accelerate the adjacent water; thi s water, in turn , attempts t o accelerate the water adjacent t o it ; and so on across the flow, wit h th e faster water exerting a tractiv e forc e on th e slower water adjacent t o it . But the attempts t o accelerate are unsuccessful, because th e water is flowing in equilibrium . Another way of describing all thi s is t o say that the faster water is losing it s momentum t o slower water; that slower water is losing it s momentum, i n turn , t o slower water still ; and so on across th e pipe, wit h each layer of water losing it s momentum t o the slower water adjacent t o it . Therefore, i n equilibrium , there is a steady flux of momentum across the flow. (Each layer does not, of course, lose all it s momentum, or there would be no flow; except for the outermost layer, which loses all it s momentum t o the wall. Th e wall experiences thi s momentum transfer as a tractiv e force. Th e equal and opposite reaction is the wall’ s drag on the water, often dubbed the skin friction , which, as explained toward th e end of thi s section, is ultimatel y responsible for the pipe’s resistance t o the flow.) Thi s steady outward flux of momentum is reminiscent of the previous section, where a temperature gradient caused a steady outward flux of heat. N ow a velocity gradient is causing a steady outward flux of momentum. By analogy wit h (2.45), it seems fair t o assume that the flux of momentum
68
Chapte r 2
Equilibriu m
per unit area across the plane wit h coordinate χ is ~ ^x U
^
M
o
m
e
n
,
u m
P
er
u n i t
v
o
l
u
m
e
} .
(2.56)
where u is a constant of proportionality . We use the symbol for partia l differentiatio n rather than that for ordinar y differentiatio n as in (2.45), because the momentum flux across the plane wit h coordinate χ wil l vary wit h y. Let ρ denote the density of water, i.e., it s mass per unit volume. Then momentum per unit volume = {mass velocity} per unit volume = {mass per unit volume) velocity = pw(x,y). Hence, denoting m o m e n t um flux per unit area across the plane wit h coordinate χ by M(x,y), we have M{x,y)
(2.57)
= ~^w),
where (2.58)
μ = pv.
Similarly , the flux of m o m e n t um per unit area across the plane wit h co› ordinat e y is given by N(x,y)
(2.59)
= - ^ w ) .
Th e constant μ is known in fluid dynamics as the shear viscosity of th e fluid. Th e constant ν is known as the kinematic viscosity. It varies wit h temperatur e and (Exercise 2.13) has the dimensions of area per unit of time. At 20 C the kinemati c viscosity of water is about 1 0 ~ c m / s e c; see Batchelor (1967, p. 597). N ow suppose that L is the length of pip e over which the water pressure drop s fro m p to p . (I n practice, you would create such a pressure dro p by turnin g on a faucet, and without it there would be no flow.) Consider (Fig. 2.7) the cylinder of water, wit h rectangular cross section and length 2
2
x
Fig. 2.7 Elementary slice of flow with rectangular cross section.
2
2.6
Wh y Ar c Pipe * Circular ?
69
L, which occupies th e region Æ, < χ < a ,
(2.60)
b
2
{
2
shaded in Fig. 2.6. Pressure is just a force per unit area, which acts in all directions; but the only directions affecting the flow are perpendicular t o the faces ABCD and EFGH of the rectangular cylinder sketched i n Fig. 2.7. Hence the net pressure force on the fluid in thi s diagram is the force on EFGH in the direction of EA minu s the force on ABCD in the directio n of AE\ i.e.,
Γ Γ\Ρ2
~ Pudxdy.
(2.61)
Accordin g t o Newton, however (or again, if you prefer, borrowin g fro m physics), force equals rat e of change of momentum. Th e flow is in equi› librium , and so the water cannot speed up; so that th e rat e of change of m o m e n t um is simply the net rat e at which m o m e n t um flows out of Fig. 2.7 across the four rectangular faces that are parallel t o the direction of flow. Now, the flux of m o m e n t um across the face BCGF (in the direction of increasing x) is bi
(2.62)
M(a ,y)Ldy; 2
and the flux of m o m e n t um across the face DCGH increasing y) is
L
(i n the direction of
(2.63)
° N{x,b )Ldx. 2
2
Thu s the total flux of momentum out o / t h e rectangular cylinder is the sum of (2.62) and (2.63), i.e., ^ M{a ,y)dy 2
+ jT
N(x,b )dx\ 2
.
(2.64)
Th e total flux of m o m e n t um into the rectangular cylinder, on th e other hand, is the sum of the fluxes across EADH and EABF, i.e., L j
M{a ,y)dy x
+ £
iV(jc,*,)rfx| .
(2.65)
Th e net m o m e n t um flux out of the rectangular cylinder is th e difference
70
Chapte r 2
Equilibriu m
between (2.64) and (2.65), i.e., L 1 ^
(M(a ,y)2
M(a y))
-Att
ΛΓ(χ,Ζ>,)) < f r j
dy + j P (N(x,b )-
lt
2
dx
Ja, Jb,
dy
dydx
Equatin g (2.61) wit h (2.66) gives
But the rectangle i n Fig. 2.6 is completely arbitrary . I t could have been placed in any of the other quadrants or expanded or shrunk to any size. Provided that the integrand in (2.67) is continuous, which we shall assume, thi s can only be so if the integrand is identically zero. Hence
For suppose that (2.68) were false at (x , y ) because the left-hand side had, say, a strictl y positive value. Then, by continuity , it would remain posi› tiv e throughout some small region of the for m (2.60) surroundin g (xo,y ); so that it s integral over that region would also be positive, contradictin g (2.67). To cover the possibility that the left-hand side of (2.68) might be negative at (x ,y ), simply multipl y by - 1 . On using (2.57) and (2.59), and assuming that fluid density, p, is con› stant, we obtain 0
0
0
0
0
(d^w > \ j ?
+ +
dhv\ » ? )
m
^Pi-P L -
2 ( 2
·
6 9 )
Thi s equation, which i s usually known as Poisson’s equation, is our first ex› ample of a partial differential equation, or P DE for short. Further examples of P D Es wil l emerge in Chapters 9 and 11. You can verif y by direct substi› tutio n that a solution of (2.69) satisfying the boundary condition (2.55) is
Moreover, it can be shown that (2.70) is th e only solution of (2.69) that satisfies the boundary condition. Hence (2.70) describes th e flow of water throug h our elliptical p i p e . T h e expression for velocity, namely, w(x,y), represents the distance travelled per unit of time, perpendicular t o the cross section of the pipe, 6
6
See Supplementary Note 2.2.
2.7
Equilibriu m Shift s
71
by the particl e of fluid wit h coordinates (x,y). Hence the volume of water traversin g the cross section per unit of tim e is the integral, over th e section, of the distances travelled by all such particles. Denote thi s flux of water throug h the pipe by Q. Then (Exercise 2.14)
By setting a = b - r in (2.71), we deduce that th e flux of water through a circular pipe of radiu s r is given by
which is known in fluid dynamics as Poiseuille’s formula . From (2.53), a circular pip e wit h th e same cross-sectional area as the ellipse (2.54) must have radiu s Vab. Hence the flux reduction caused by deforming the circl e int o an ellipse wit h the same area is
_ ( Æ^ Thi s is always nonnegative and is clearly minimized by takin g a — b. But why should the circl e have thi s optimal property ? To understand this, observe fro m (2.70) that velocity is constant over any ellipse, say E, which is similar to the wall. Now, as discussed above, there are tw o entirely equivalent interpretation s of equilibriu m flow in a pipe. We can say either that the pressure drop is exactly balanced by an outward m o m e n t um flux or that the pressure drop is exactly balanced by a frictiona l (or viscous) drag. Thus, recalling our earlier discussion, the m o m e n t um flux across Ε represents the viscous drag of the water outside Ε on the water inside it . I n particular , the momentum flux int o the wall itself represents the drag of that wall on the entir e fluid . Thu s the circle, being the curve of m i n i m u m length for a given area, minimizes that outward flux at the wall an d hence the pipe’s resistance t o the flow. Th e higher the value of μ in (2.57)-(2.59), the greater the resistance; or, which is the same thing, the greater the amount of momentum that is transported toward the wall. Thu s the analogy between (2.45) and (2.57) is a perfect one, provided only that we interpre t μ not as th e viscosity, or stickiness, of the fluid but as a conductivit y of momentum. Expression (2.72) for the flux of water through a circular pip e can be obtained much more readily by exploiting the pipe’s symmetry. See Exercise 2.15.
2.7
Equilibriu m Shift s
Let’ s retur n to the lake we considered in Section 2.1 and suppose that the level of contaminant has already reached it s steady state. Thu s pollutio n
72
Chapte r 2
Equilibriu m
outflo w rx exactly balances pollutio n inflo w P , so that χ = PJr, as in (2.3). N ow suppose that the lake’s outflow is suddenly increased, at t = 0, t o r + Ar. Then, fro m (2.4), the pollutio n subsequently evolves according t o in
j
t
{ Vx(t)} = P
in
x(0) = ^ ;
- (r + Ar)x(t),
(2.74)
whence x(t) =
r+ Ar
+ (£a \ r
-
r+ Ar
J
e
-
{ r + A r ) , l v
.
(2.75)
'
v
I n the course of time, the exponential decay term wil l become so small that th e pollutio n level wil l have shifted fro m x* = P lr t o the new equilibrium , xn
(2-76) which is lower than x* . Thu s increasing r whil e P remains fixed shifts the equilibriu m pollutio n level downward. A similar analysis would show that increasing P whil e r remains fixed shifts th e equilibriu m level upward. I n other words x* , though a constant as far as it s dependence on tim e is concerned, is nevertheless a function of the tw o parameters r and P . We therefor e writ e in
i n
in
(2.77)
x*(P ,r)=?*. in
Partial differentiatio n reveals that 7 5 - = - > 0 dP r
and
-r - = dr
in
ψ < 0, r 1
(2.78)
i n agreement wit h our conclusions above. I f we were using the direct method then we would obtain (2.77) fro m th e right-hand side of (2.4) in the for m (2.79)
0 = P -rx-(P ,r). in
in
N ow suppose we were unable to solve (2.79) t o obtain (2.77) jus t suppose! Then we could differentiat e (2.79) instead t o obtain dx*
dx*
whence
as before. I n (2.75), (2.78), and (2.80), we have three different ways t o determine how shiftin g a parameter wil l shift an equilibriu m of dynamical system (2.4): 1. indirectly , fro m an expression for x{t);
2.7
Equilibriu m Shift s
2. directly , fro m an explicit expression for x";
73
(2.82)
3. directly , fro m an implicit expression for x* . Mor e generally, let Æ = (a a ,...,a ) be an w-dimensional vector of parameters, and consider the dynamical system T
i1
1
m
7
= f,(x,
a) = fi(Xi, x ,...,
x„, a a ,...,
2
u
2
a ), m
i = 1.2,..., n. (2.83)
= x * ( a ) be an equilibriu m of thi s system. Then the effect on thi s Let equilibriu m of a parameter shift fro m a, t o aj+Aoj can also be determined i n one of three ways: 1. indirectly , fro m an expression for x(/) 2. directly , fro m an explicit expression for x*
(2.84)
3. directly , fro m an implicit expression for x* . But the lake model that led t o (2.82) was a very simple one. We have already seen, in Sections 1.4 and 1.5, that an explicit expression \(t) = ζ(ί,α) for solutions t o (2.83) may simply not be available. Thi s is the rule, rather than the exception, and so ( I ) is rarel y of use. Th e equilibriu m = * ( Æ) must satisfyfj(x,a) = 0, / = 1, 2, n; or, i n vector form , f ( x * ( a ) , a ) = 0.
(2.85)
= x * ( a ) of these equations exist in principl e whenever Now, solutions th e conditions of the implici t function theorem are satisfied. But (2.85) may be impossible t o solve analytically. Then (2) is rendered useless, t o o, and only (3) remains. We shall dub thi s alternativ e th e equilibrium shift technique. Mathe› matically, it amounts t o no mor e than implici t differentiatio n of the equi› libriu m equations. Applyin g the chain rul e t o (2.85), we obtain 8
E l T T £ f dx daj J
k
i
+
T =' daj L
\
0
(2.86)
I t is just possible that these nm equations might be simple enough t o allow for some / and k. I f so, th e infor › determination of the sign of dx lda mation, though qualitative, might be very useful. Economists are frequent users of the equilibriu m shift technique because it is often helpful t o know, for example, whether a certain tax rat e should be increased or decreased t o raise, for example, the gross national product (it would be even more helpful , of course, t o know by how much). i
k
Thi s is the special case of (1.24) for which f is independent of t. The dynamical system is said to be autonomous. See Supplementary Note 2.3. 8
74
Chapte r 2
Equilibriu m
We pause t o emphasize that, when applied t o an equilibriu m of the dif › ferential dynamical system (2.83), the equilibriu m shift technique is mean› ingful only if the equilibriu m is stable. To appreciate this, let’s apply the shift technique t o the ecosystem model (2.87) first introduced in Section 1.5 and furthe r considered in Exercise 2.3 (ii) . Thi s system has th e equilibriu m (2.88) where Æ = (a ,b ,a ,b ) .
You can see directl y that
T
l
l
2
2
Thi s suggests that an increase in the parameter a wil l shift x* upward. N ow let’s see what really happens. Suppose that th e ecosystem described by (2.87) is in equilibrium . Recall th e remark in Section 1.5 that the phaseplane diagram Fig. 1.4 retains it s topology if the parameters are changed. Th e effect of an increase in a is merely t o shift the equilibriu m point x* t o th e right . Thi s shift in topology is sketched in Fig. 2.8. The old trajectorie s are dashed, the new ones solid, and the dot denotes the old equilibriu m x* . Notice that, in the new topology, the initia l point x* lies on a trajector y that veers off t o th e northwest as tim e increases. Thus, far fro m shiftin g χ upward, an increase in a wil l ultimatel y reduce it all th e way t o zero! Th e discrepancy between what (2.89) suggests and what actually happens is due t o th e equilibrium’ s instability . It illustrate s that caution is necessary i n applying the shift technique t o systems of the for m (2.83). 2
2
2
y A
.N
0
Fig. 2.8 Phase-plane topology shift for (1.22) when a is increased. 2
2.7
Equilibriu m Shift s
75
A s we saw in Section 1.6, however, not every dynamical system is a differentia l dynamical system. Indeed th e equilibriu m shift technique is probabl y most useful when applied t o nondifferential ones. Consider, for example, the economic growth model of Section 1.6, in which capital at tim e / is denoted by K(t), labor by L(t), and output by OXt). Th e economy is not in equilibrium , because K, L, and Q do not persist at fixed levels; rather , they increase wit h time. On th e other hand, according t o th e model, they increase in such a way that, at any given time, Q(t) = amrK(t) ~\
(2.90)
l
where a and 7 are constants. Thus, although K, L, and Q keep changing, the relationship (2.90) between and the quantit y aLyK ~ persists. Now, we associate persistence wit h equilibrium ; and it therefore seems that th e econ› omy of Section 1.6 has at least some of the qualities of equilibrium , even though it is not trul y in equilibriu m in the sense of thi s chapter. We wil l recognize thi s state of affair s by saying that the nondifferential dynamical system (2.90) represents a quasi-equilibrium between th e exogenous vari › ables, namely K(t) and L(t), and the endogenous variable, namely, QXt). A more general nondifferential dynamical system would consist of η relation s l
f (x (t),x (t),...,x (l),a (t),a (t),..., (t)) i
l
2
n
l
2
= 0,
am
y
i= 1 , . . . , «,
(2.91)
which we may regard as representing a quasi-equilibriu m between the η endogenous f u n c t i o n sx ( t ) , x (t),x„(t) and th e m exogenous functions «,(/), a (t),<* (t). We can use the chain rul e t o differentiat e (2.91) wit h respect t o Æ,( .) By analogy wit h (2.86), we obtain t
2
2
m
£r j dx (t) k
oajit)
d a / /)
I t is just possible that these nm equations might be simple enough t o allow for some 1 and k. We would then determination of the sign of dXj(t)/da (t) know the effect of a change in the exogenous function a (t) on th e endoge› nous function x,{t), assuming the quasi-equilibriu m (2.91) t o be maintained at all times. A s a simple example of thi s idea, observe that (2.90) yields k
k
W . t l - i m X ^ (2.93) dK(t) ~ ' \K(t), expressing th e fact that an increase in capital wil l always result in an in› crease in output (if the quasi-equilibriu m (2.90) persists throughout). Further application of the shift technique t o nondifferential dynami› cal systems is deferred unti l Chapter 10, i.e., unti l after we have had an opportunit y t o appreciate the usefulness of such models. Meanwhile, t o appreciate the limitation s of thi s technique when applied t o systems of the for m (2.83), tr y Exercise 2.16. v
76
2.8
Chapte r 2
Equilibriu m
Ho w Quickl y Mus t Driver s React to Preserv e an Equilibrium ?
Consider a platoon of cars, each of length L, drivin g in equilibriu m through a tunnel. All cars are moving at the same speed, v. The gap between cars is a constant, d. The cars will remain in equilibriu m only if they all con› tinu e to travel at exactly the same speed and hence remain a distance d apart. Now, suppose that the leading driver slows down for a moment, for whatever reason, before accelerating back to speed v. Thus she subjects the equilibriu m of the platoon to a small perturbation . Following this per› turbation , will the driver s regain their equilibrium ? In other words, is the equilibriu m stable? Intuitio n suggests that the driver s will regain equilib› riu m if they react sufficiently quickly to the first driver’ s braking, but if they react too slowly, then two or more of the cars will collide. But how quickly is quickly enough? In an attempt to answer that question, we will develop the model for a platoon of Ν cars that we introduced in Section 1.13. For the sake of definiteness, we will assume in thi s section that there are just ten cars in the platoon, but with obvious modifications, the analysis would apply just as well to any other number of cars. Let χ be the traffi c density in thi s equilibrium ; i.e., let χ = l/(d + L). Then, on using (2.28) and assuming the tunnel to be at least so congested that j c > x , we find that the speed of the platoon in the equilibriu m is 9
c
Hx Jx) m
ln(W*c>'
max
(2.94)
where v is the speed a car would have if the tunnel were empty. For rea› sons that will emerge in Section 3.5, and again for the sake of definiteness, we shall assume that the traffi c density in equilibriu m is ^ = 0.368x , (2.95) m i x
max
where e - exp(l). Then, on using (2.94), we find that the speed of the platoon is v= , / " w (2.96) ln(x /x ) Suppose that the cars have remained in equilibriu m throughout the interval t < 0 and that the first car of the platoon crosses station ζ = 0 at tim e / = 0. If thi s equilibriu m persists then, for t > 0, the displacement of the jt h car in the platoon is given by mix
c
C,(0=vf-O-l)( + L)
You may wish to review Section 2.3 before proceeding.
2.8
How Quickl y Mus t Driver s React to Preserv e an Equilibrium ?
=
10.
1 , 2 ,.
j=
v f
77
(2.97)
of the jth car. Thi s We wil l refer t o < (/) as the equilibrium displacement does not, of course, mean that the displacement is constant (it increases linearl y wit h time); rather , the speed d^ldt = of the car is constant, and
;
dzjjt + τ ) _ dt
=
In |z;(r) - zj-i (t)\ + Qj,
2 < j < 10.
(2.98)
Her e i s the driver response tim e (assumed the same for all drivers) and qj a constant. We wil l assume that for all j the constant a, takes the value implie d by the analysis of Section 2.3, namely, (verify ) a = v l n ( x ) . Then (Exercise 2.17), because Zj_i(t) > Zj(t), the subsequent displacements of cars 2 t o 10 satisfy m a x
dzjU + r )
= v l n j ^ ^ . , ^ ) - z/r))} , 2<j< 10. (2.99) dt N ow suppose that at t = 0 the first driver brakes for exactly one sec› ond, reducing her car’s speed t o v(l - ˜ ) before accelerating back to the equilibriu m speed v. Then a reasonable description of the car’s velocity for t > 0 would be (Fig. 2.9) =
^
(1-˜/,’-’) ,
(2.100)
+ ˜ { ( / + 1 ) < ˆ ’ - 1}]
(2.101)
=
whence (verify ) [
2,(/)=
v(l
- ˜ )
0
-1
I
1
L.
_ι
ι
5
Fig. 2.9 Speed history of first car in a platoon.
ι
ι
10
ι
ι
ι
ί-
15
78
Chapte r 2
Equilibriu m
Fro m (2.97), wit h j = I, thi s displacement differ s fro m th e equilibriu m displacement Cj( 0 by an amount 2,(0 - C/(0 = ˜ {(t + l)e~' - 1} e, when t > 0. Let us define th e perturbation displacement of th e leading car at tim e t, 0,(0, by 0,(0 = ,( ) - ,( ) . Then . ^ ( ’ M C + O e - ’ - i U
if’>0;
I 0
(
1
1
0
2
)
i f t < 0.
N o te that 0,(0 < 0 when t > 0 because as a result of braking , th e leading drive r is nearer t o ζ = 0 at tim e t than she would have been otherwise. Car s 2 t o 10 wil l react t o thi s perturbatio n by also braking . Let th e perturbatio n displacement of the ,/th car be denoted by 0 (O = ζ β) - £,·(/), 2 < j < 10. Then, on using (2.97) we have y
^ ) = (
˘
U
^ -
+
£
^ ˆ •
i f
’^
;
(2.103)
if / < 0.
On substituting z {t) = < (0 + 4>j(t) int o (2.99), we obtain (Exercise 2.17) }
7
d
j(t+r) —. = vln dt Replacing t by / + r , we thu s obtain (verify ) VH
J>L
d
=
vl n [l +
*ψ
{^_,(
-
τ) - φ# - τ)}} .
(2.104)
(2.105)
I n thi s equation, <$>j is identically zero whenever it s argument is negative. Thu s 0y(r - r ) = 0 whenever τ > t. Th e equilibriu m described by (2.97) is stable if, followin g th e perturba › tio n depicted i n Fig. 2.9, th e cars all regain speed withou t colliding. Now, tw o cars wil l collid e i f th e relativ e displacement of their fron t bumpers fall s below a car length, L ; i.e., if Zj_ ,(0 - z /0 < L, at any tim e i( > 0) and for any j such that 2 < j < 10. Fro m th e definitio n of 0y, th e condition zj_, (0 - Zj(t) < Lis equivalent t o 0,
^(0-^-i(0>rf .
(2.106)
For th e sake of definiteness, let’s choose a particula r value for d. Now, as we wil l discuss in Section 3.3, an appropriat e traffi c density for N ew York’ s tunnels is about 65 cars per mile, and an appropriat e equilibriu m traffi c speed is about 20 miles per hour. Workin g i n feet and seconds, therefore, it seems reasonable t o take = 20 5280 -f- 3600 = 8 8 /3 and x = mJe = 65/5280 = 13/1056. Then d + L = 1056/13. Thus, i f we choose d = 65, then th e length of a car is a littl e mor e than sixteen feet, which does not seem unreasonable. Let’ s adopt these values (i f you don’t x
2.8
Ho w Quickl y Mus t Driver s React to Preserv e an Equilibrium ?
79
lik e them, then you can easily work through the analysis again using dif › ferent ones). Then the collision criterio n (2.106) becomes - < £ ; _ , ( / ) + 0 , ( i ) > 65,
(2.107)
and on using our chosen values in (2.102)-(2.105), we find (verify ) 0 / 0 = 0,
if t<
* , ( / ) = ª ˜ { ( / + 1) < Γ < - \}e, 8 8,
άφ,
τ/ = τ
1η
0,1 <j
< 10;
if/>0;
l + To^i ^-iC- -)-^-^)}] ’ i f > 0 , 2 < ; < 1
10. (2.108)
These differential-delay equations are not especially easy t o solve. We wil l therefore approximate them by recurrence relations. Now, the quantit y d4>jldt is approximately equal t o φ Xf + c) - φ At) ' ΣΔ '
(2.109)
ψ κ
i f f is s m a l l . It wil l be convenient t o suppose that c = l/M, where Μ is a large enough integer, and measure tim e in unit s of one Mth of a second. Thu s unit s of new tim e correspond to t = nIM seconds. Let / ) denote th e perturbatio n displacement of driver j after unit s of new time; i.e., + 1 ) - / ) } , and for large / ) φ \ηΙΜ). Then (2.109) becomes ` / { / enough Μ we can approximate the last equation of (2.108) by (verify ) 10
}
Μ { /
+ 1) -
/ ) }
= y
In [l + -Ij-
{
, · _ , ( Η - σ) -
/
-
)}1
,
(2.110) where σ is the reaction tim e measured in new units; i.e., in old units, the reaction tim e is τ = σ/Μ seconds. How large should Μ be? Clearly, the larger the value of Μ we choose, th e smaller the error in approximatin g άφ^Ιάΐ by (2.109). On the other hand, you must perfor m 60Af recursions of (2.110) for each minut e of tim e durin g which you would lik e to know what happens to the platoon; and these recursions wil l be time-consuming if Μ is very large. I experimented wit h different values of Μ and decided that Μ = 8 gave an acceptable trade-off between accuracy and computing cost. Hence we use Μ - 8 in th e remainder of thi s section. (You may wish t o experiment wit h larger values, but you wil l find that they do not qualitativel y alter our conclusions fro m the analysis.) Wit h thi s value, and on replacing η by - 1 i n (2.110),
10
S ee Supplementary Note 2.4.
60
Chapte r 2
Equilibriu m
(2.108) is approximated (verify ) by ,( ) = 0 if η < 0, 1 < < 10; Ø ( ) = ª ˜ { ( / Ø + 8) < Γ
/ 8
-8}
if η > 0;
/Μ) = ;( - 1) + y ln[ l + ^{φ (η Μ
- - 1) - ,( - Æ- 1)}] if η >
0,2 < j < 10.
(2.111) These recurrence relations are easily solved by calculator or computer. Th e results are shown in Fig. 2.10 for ˜ = 0.15 and r = 1.5 seconds ( = 12). I n thi s particula r case, the leading driver reduces speed fro m 20 m.p.h. to 17 m.p.h. and then accelerates back t o 20 m.p.h. again, ac-
Ø
I
l
Fig. 2.10 Perturbation displacements of a platoon often cars in which driver s take 1.5 seconds to respond when the first car slows temporaril y to 17 m.p.h., according to Fig. 2.9, from the equilibriu m speed of 20 m.p.h. The horizontal scale is 1 inch to 14.3 seconds, the vertical scale 1 inch to 186 feet.
2.8
Ho w Quickl y Mus t Driver s React to Preserv e an Equilibrium ?
81
> ι
Fig. 2.11 Perturbation displacements of a platoon of ten cars in which driver s take 2.25 seconds to respond when the first car slows temporaril y to 17 m.p.h., according to Fig. 2.9, from the equilibriu m speed of 20 m.p.h. The horizontal scale is 1 inch to 14.3 seconds, the vertical scale 1 inch to 186 feet.
cordin g t o Fig. 2.9. Th e corresponding perturbatio n (2.102) is the upper› most graph in Fig. 2.10. The remaining graphs are (approximations to) the perturbatio n displacements {<j>j(t):t> 0 ,2 <j < 10} of the followin g cars, plotted 0.35 inches apart, which corresponds t o a real distance of 65 feet. Notice that equilibriu m is restored withi n three-quarters of a minute, wit h all cars once again moving at 20 m.p.h., but (takin g the limi t of (2.102) as t —* oo) in such a way that all cars are a fixed distance vAe « 12 feet be› hin d where they would have been if the first driver had not braked. Notice also that each of the followin g cars takes longer t o adjust t o the new equi› libriu m than the car in fron t of it . It s phase of adjustment is represented by an oscillation of decreasing amplitud e about the new equilibrium , but th e amplitud e of thi s oscillation increases wit h j as the initia l perturbatio n
82
Chapte r 2
Equilibriu m
4 Unstable
3
2
•d * = \W
D
Stable
0
1.0
0.5
Fig. 2.12 Tentative stability boundary r = r (A ) in the ˜ - ˆ plane. c
propagates backward through the platoon of cars. (From the point of view of pure mathematics, of course, the equilibriu m is never restored. Rather, the cars will move toward the equilibriu m forevermore, but will ultimately be an imperceptible distance away from it.) For the same perturbatio n but the slower response tim e of r = 2.25 seconds ( = 18), the graphs of φ ft) are plotted in Fig. 2.11. Notice that (2.107) is violated after 347 unit s of tim e (43.4 seconds), when the nint h car collides wit h the car in front of it . Thus, in the ˜ - r plane, (0.15,1.5) is a stable point for a platoon often cars; whereas (0.15,2.25) is unstable. The same analysis can be repeated for any other value of r that is a multipl e of an eighth of a second and for any other value of ˜ (between 0 and 1). Thus we discover, for example, that (0.4,1.625) is a stable point, but that (0.4,1.75) is unstable, because the ninth car collides with the car in front of it after 24.25 seconds. A selection of such points is plotted in Fig. 2.12. A square denotes stability and a dot instability , wit h the label j/n recording that the ;’th car collided wit h the one in front after η unit s of tim e (n/8 seconds). By continuing in thi s fashion, we see that there is a boundary curve r = T ( A ) in the ˜- r plane, below which the platoon is stable and above which it is unstable. On the unstable side of thi s boundary, for given ˜ , a higher value of τ (slower response time) means a sooner collision between lower numbered cars; and, for given r , a higher value of ˜ (larger perturbation ) means the very same thing. The boundary drawn (dashed) in Fig. 2.12 is a tentative one. To locate it precisely, you would have to solve C
Exercise s
83
(2.108) numerically and use a significant amount of computer time. You would find, however, a similar pictur e t o the one in Fig. 2.12. Th e analysis in thi s section is easily reproduced for a platoon that con› tain s an arbitrar y number of cars. Simply replace 10, wherever it appears, by N. Increasing Ν (higher number of cars in the platoon) wil l shift the T (A) curve downward and t o the left; whereas decreasing ˝ wil l shift it upwar d and t o the righ t (as indicated by the labels jln in Fig. 2.12). But do you consider that Figs. 2 . 1 0 - 2 . 12 yield a reasonable picture? Perhaps you would lik e t o mull thi s over, and then tr y Exercise 2.18. C
Exercise s 2.1 Verif y (2.20). 2.2 Verif y that ζ, as well as η, satisfies the differential equation (2.16). 2.3 By findin g the roots of (2.19), classify the static equilibri a encountered in (i) Section 1.4, (ii ) Section 1.5, (Hi) Exercise 1.5. *2.4 What would be the form of v(x) in Section 2.3 if, in Section 1.13, we had assumed that brakin g driven do not respond to the size of a gap but only to the rate at which it’ s closing? *2.5 Suppose that we stand at a fixed point zo on a road and count the number of vehicles that pass that point in e units of time, say durin g the interval t - e/2 < t < t + e/2, then divide our answer by e. We call the quantity thus estimated the flux of traffi c (at station zo, at time f ) and denote it by F(zo, to). By repeating this experiment throughout the day, we obtain a function of time, F(zo,/), that records variations in the flux of traffi c at that particular point on the road. The interval length e must be neither so long that important variations in flux are not recorded (recall Fig. 1.6) nor so short that F(zo, t) would cease to be a smooth function of time (in the extreme case, it would take the values 0 or 1 in an apparently random sequence!). For a busy road, an hour is too long, a second too short, a minute about right ; for a quiet road, we would not obtain a smooth function. Once traffi c flux F and traffi c density χ have been defined, we may define = Fix to be the velocity of traffi c at station z at tim e t. Thus, in general: 0
0
0
Number of cars passing per unit of time F(z,t)
Number of cars per unit length of road x(z,t)
Length of road covered per unit of time v[z,t).
84
Chapte r 2
Equilibriu m
But it is sometimes reasonable to assume that F is some function fix) of the traffi c density, so that F{z, t) = J{x{z, t)). Then, in equilibrium , we have Number of cars Length of road Number of cars passing = per unit length χ covered per unit per unit of time of road of time = χ χ v{x), Ax) where is the velocity of traffic . The graph of / as a function of χ is known as the fundamental diagram of traffi c flow. It s shape will be similar to that in Fig. E2.1. In particular , J[0) = 0 = flx ) a n d / h as a global maximum at χ = x*. We say traffi c is light if χ < x^ and heavy if χ > χ*, and J{x*) is the capacity of the road. Find the capacity of the road when v(x) is given (i) by the model of Exercise 2.4; (ii ) by the model of Section 2.3. mta
2.6 Verif y (2.38). 2.7 If r lies to the right of the cusp in Fig. 2.3 then the arguments of the absolute -ry(r))(2r-ry{f)value function in (2.40) are negative. For such r, ˜ ( Γ ) = (1 1). Hence ˜ ( Γ ) = 1 is equivalent \oflr ) = 0, where f(j) = ry\f) • (y(r) 2) + 2(r - 1). Find r by using the Newton-Raphson iterativ e technique to solve f[r) = 0. Hint: You will need a computer. First differentiat e g{w) = 2 - w implicitl y wit h respect to r and arrange to obtain 2
2
2
y'(r) =
Ar)W.r)-2)-(l-y(r)) 2-2ry{r)
+ ry{r)
2
Thi s will enable you to express f{r) in terms of r, y{r), and )/{r). Estimate . For r from the graph. Thi s will be your first value in the iterativ e sequence each subsequent value, you will need a separate subroutine to supply the value of y(r). The Newton-Raphson technique will be required withi n this subroutine as well. 2
Slop e
# max n
Slop e
max
Fig. E2.1
υ{χ)
Exercise s
85
2.8 By solving (2.36) numerically, show that there is a period-4 limi t cycle { v , v , v , v } when r = 2.56. To four significant figures, the values of {v } are, in sequence, 0.2101, 1.587, 0.3531, and 1.850. Show similarl y that the steady state when r = 2.67 is the 8-period limi t cycle {1.924, 0.1631, 1.524, 0.3763, 1.990, 0.1417, 1.401, 0.4798} and that the steady state when r = 2.69 is the period-16 limi t cycle {2.000, 0.1357, 1.388, 0.4890, 1.933, 0.1570, 1.516, 0.3781, 2.014, 0.1315, 1.360, 0.5160, 1.897, 0.1699, 1.585, 0.3288}. (
2
3
4
k
2.9 For r = 2.56, the period-2 equilibriu m cycle {y{r),z(r)} = {0.26357,1.7364 } is unstable, because r > r . By solving (2.36) numerically with either y ot ζ as initia l value, show that the equilibriu m cycle diverges toward the period-4 limi t cycle in Exercise 2.8. (To keep the population in period-2 equilibrium , the exact value of or would be needed. Even if y(= 0.263573742169 ) or z(= 1.73642625783 ) were correct to 12 significant figures, the rounding error would be sufficient to shift the period-2 cycle toward the period-4 one, though the divergence would be extremely slow.) 2
*2.10 The wall of a buildin g is in thermal equilibriu m if it transfers heat at a constant rate Oust as a rowing boat is in mechanical equilibriu m if it moves at a constant speed). Let ˆ , be the temperature of air inside a buildin g and T the temperature of the outside air. Assume that T < T (it’ s winter). Let F denote the outward heat flux per unit area, i.e., the amount of heat energy per unit of tim e that flows across unit area of the wall. Let d be the thickness of the wall. (i) Which kind of wall will lose heat at the greater rate, a thick one or a thin one? Accordingly, how do you think F varies with di (ii ) When will the rate of heat loss be greater, when ˆ 2 << ˆ , (much colder outside than inside) or when T is just a littl e lower than 7\ ? Accordingly, how do you think F varies with T - T 1 (iii ) Can you suggest an expression for F, in terms of T T , d, and some arbitrar y constant, which embodies (i) and (ii)? Make the simplest hypothesis consistent with your observations. 2
2
{
2
t
2
lt
2
* 2.11 Instead of installing double-glazing, some folks create a "stor m window" by using a sheet of transparent plastic to trap a layer of stagnant air between the air in a room and the pane of glass in the existing window. Adapt the model of Section 2.5 to calculate the heat loss prevented by this contraption. Show, in particular , that it is always less than the loss prevented by double-glazing. (You do not need to know the thermal conductivity of the plastic. Why?) *2.12 The outward heat flux across area A of wall in Section 2.5 is AF{x) only because we have assumed that heat flux and temperature do not vary withi n any χ = constant plane. If heat flux and temperature also varied with respect to y and z, however, where x, y, and are orthogonal Cartesian coordinates,
86
Chapte r 2
Equilibriu m
then the outward heat flux across area A would be
/
F(x,y,z)dA
=
A
F{x,y,z)dydz
= - / k
A
dT{x,y,z, dx
dydz,
A
on using (2.45). Similarly , the outward heat flux across area ¸ of a sphere of radius χ would be
where χ,θ, and φ are spherical polar coordinates. Use this result to solve the followin g problem. A spherically symmetric planet is in equilibriu m wit h radius a. It consists of a radioactive core 0 < χ < c surrounded by a solid mantle c < χ < a, where χ is the distance from the center of the planet. The core generates a steady heat flux Ant^F, which is conducted through the mantle to the surface of the planet. If the thermal conductivity of the mantle is k , and if the mantle heat flux per unit area is given by (2.45), show that the temperature drop across the mantle is M
cjl - cla)F
2.13 Using the methods of Section 1.14, verify that kinematic viscosity has di› mensions [f J = L /T. 2
2.14 Establish (2.71). Hint: Use the transformation to elliptical cylinder coordi› nates, χ = ra cos(0),
y = fcrsin(0),
to change the region of integration from that given in (2.71) to 0 < θ < 2 , 0 < τ < 1. *2.15 Water is flowing in equilibriu m with circular symmetry through a cylindrical pipe with radius a. The pressure drops from p to p along length L of the pipe. Consider a cylinder of water with radius τ and length L, whose axis of symmetry coincides with that of the pipe. (i) What is the (outward) flux of momentum per unit area across this cylinder? 00 What is therefore the momentum flux? (iii ) What is the net pressure force on this cylinder of water? (iv) Obtain a differential equation for the velocity w(r) and solve it , subject to an appropriat e boundary condition. (v) Hence obtain Poiseuille’s formul a (2.72). 2
t
Exercise *
87
*2.16 (i) In the model of Exercise 1.17, if χ is measured in tonnes and time in years, what are the dimensions of the constant a? (ii ) If the fish are harvested, as in Exercise 1.14, at rate qux, where Μ is a constant, show that there are two equilibri a (other than χ = 0) provided u < aK/4q. Use a graphical method. (iii ) What happens if u > aKIAql We will ignore the possibility that u = aKIAq, precisely, on the grounds that the parameters are subject to so much uncertainty. In deterministic models of natural phenomena, only strict in› equalities between parameters are realistic. (iv) Assume that u < aKIAq. Let x denote the lower equilibriu m and x the upper one. Use the graph from (ii ) to show that 0 < x < KI2 < χ < Κ. Using the equilibriu m shift technique, show that x decreases with u and q but increases with a. Verif y your result graphically. (v) Why may the shift technique not be applied to the equilibriu m x 7 Show that it would lead to absurd results. L
v
L
υ
v
L
2.17 (i) Verif y (2.98) and (2.99). (ii ) Verif y (2.104). *2.18 (i) According to (1.81), following driver s in Fig. 2.11 will stop brakin g and start to accelerate 2.25 seconds after they have observed the preceding car begin to move away. Study the graphs in Fig. 2.11 and convince yourself that this is so. What changes geometrically when a driver stops brakin g and starts to accelerate? (ii ) The restoration of equilibriu m in Fig. 2.10 is exceptionally smooth. I would have anticipated larger ripples. What do you think ? Is there anything about (1.81) that produces a stabilizing effect that would not be observed in practice? If so, how could (1.81) be improved? Hint: Consider how driver s accelerate as the gap between them and the preceding car increases. ’2.19 (You will need a computer for this one.) In 1959, according to Section 3.3, cars were sent through New York’ s Lincoln tunnel in platoons of 22. Assume that they drove at 20 m.p.h., in equilibrium . Would such a platoon remain in equilibriu m if the driver response time were 1.75 seconds and the leading driver slowed temporaril y to 16 m.p.h. according to Fig. 2.9? Now that you have writte n a computer program to solve (2.111), you can reproduce Figs. 2.10-2.12 for yourself, as well as experiment with other values of d and other forms of φ\(ί). *2.20 Suppose that the species of fish in Exercise 2.16 is being "overfished," i.e., that u > aKIAq. Show that, although x tends to zero as t oo, χ never actually reaches zero. Thus, according to the productivit y law F W = o x
2
( l - i ) ,
the population would be certain to recover from any threat of extinction if the harvest were ever stopped. In practice, however, we might expect that the
88
Chapte r 2
Equilibriu m
fish would not recover from an extremely low population level, even if that level were greater than zero (for otherwise, why would species ever become extinct?). In other words, our model does not allow for the real possibility of extinction. Can you suggest an improved form of F(x) that would correct this deficiency without destroying any of the other properties which, according to Exercise 1.17, it is desirable for F to have?
Supplementar y Note s 2.1 A more general system of differential equations than (2.12) would have the form ^jj-=fi(X\>*2
*„)>
!<'<«·
An extension of the analysis performed above would lead to the linear system of differential equations dr\ldt = Grj , where η is an -dimensional vector of relativ e displacements and the matri x G is defined by
The matri x G is called the Jacobian matri x of the system, and the static equi› libriu m x* is stable if and only if all the eigenvalues of G have negative real parts. The special case of this result obtained in the text is sufficiently general for the purposes of thi s book. 2.2 For suppose that there are two solutions, say w and w , and let u = w, - w . Denote the ellipse (2.54) by θA and the region it bounds by A. Then both w, + and w satisfy (2.69) and (2.55), and so we have u = 0 on 8 A and d u/dx d uldy = 0. Put m = uduldx and n = uduldy. Then, on using Green’s theorem {
2
2
2
2
2
2
2
A
OA
(which has essentially been proved in reaching (2.66)), we have
-/"(κ*-ΐΗΘΑ
α
Therefore duldx = 0 = duldy, implyin g that u is a constant. Because u = 0 on dA, the value of the constant must be zero. Hence w = w ; i.e., the solution is unique. v
2.3 Principally , the Jacobian matri x G, defined by _
dfi,^
....
2
Supplementar y Note s
89
must be nonsingular. By even mentioning G, of course, we presume that f is at least once differentiabl e with respect to x. 2.4 In view of (1.55) and (2.44), you may be wondering why dfyjldt is approximated by (2.109), and not by ^{ ,.( +1)- /«-1)}
.
(a)
The answer is that using (a) instead of (2.109) would mean approximating a first order ordinar y differential equation by a second order recurrence relation, instead of by a first order one, and would lead to numerical instability; i.e., it would lead to spurious oscillations that predict collisions even for very low values of ˜ and r , which are bound to be stable. To appreciate this phenomenon of numerical instability , consider the sim› ple first order ordinar y differential equation dx Έ =
. ( b )
where a (> 0) is a constant. If we approximate the left-hand side of (b) by x(n + 1) - x(n), then the result is
*(«+1)-(1-Æ) ( … = 0.
(c)
Thi s first order recurrence relation has solution *<«) = (0 ) • (1 -a) .
(d)
n
If we approximate the left-hand side of (b) by {x(n + 1) - x(n - l)}/2, then the result is x(n+ I) + 2ax(n) - x(n - 1) = 0.
(e)
Thi s second order recurrence has solution m
=
(x(l)-;tx(0))A’’+(Ax(0)-x(l)V º μ
)
( f )
where º = -a + Va + 1, 2
μ = -α-
Vd + 1. z
(g)
Now the solution of (b) for integer values of time, t = n, is x(0) = x(P)e-'"'=x(0)(e-) , n
(h)
so that (d) correctly predicts the qualitativ e behavior of the solution, namely, that it is decaying exponentially; though it overestimates the decay, because 1 -a < e~". Because \μ\ > 1, however, (f) introduces an oscillation of increasing amplitud e that is completely spurious. For a = 0.5, values predicted by (h), (d), and (0 are recorded in the following table.
90
Chapte r 2
Equilibriu m
η 0 Ø 2 3 4 5 6 7 8 9 10 11 12
(¸ )
id)
(/)
1.0000 0.6065 0.3679 0.2231 0.1353 0.0821 0.0498 0.0302 0.0183 0.0111 0.0067 0.0041 0.0025
1.0000 0.5000 0.2500 0.1250 0.0625 0.0319 0.0156 0.0078 0.0039 0.0020 0.0010 0.0005 0.0002
1.000 0.607 0.393 0.213 0.180 0.033 0.148 -0.115 0.263 -0.378 0.641 - 1 . 02 1.66
You can readily see how the spurious oscillation generated by (0 completely overshadows the exponential decay of the tru e solution after only a handful of tim e steps. Of course, for such a large value of Æas used for illustration , even (d) is not a good approximation to (h); but even when a is close to zero, the spurious oscillation introduced by (0 will ultimately swamp the tru e solution. Numerical analysis is an important part of applied mathematics, and if you’ve never yet studied it , then you might lik e to do so now. An especially good introductor y text is the one by Froberg (1969), and much can be learned by perusing the articl e in Encyclopaedia Britannica.
3
OPTIMAL CONTROL AND UTILITY
Man y of the policies we adopt in our lives are attempts t o optimize, that is, t o maximize gain or to minimiz e loss. Th e policy we select depends, of course, on what we are tryin g t o achieve. Suppose, for example, that I’ m travellin g by car fro m Florid a t o Texas. I may wish t o minimiz e fuel con› sumption. Then I wil l attempt t o drive, as far as is possible, at a constant speed that is probably somewhat lower than the speed limit . Th e dashed curv e in Fig. 3.1(a) indicates how I might decide to control my speed. Or I may wish t o reach my destination as quickl y as possible without break› in g the speed limit . Then I wil l select the solid curve of Fig. 3.1(a). On th e other hand, I may wish t o get there as fast as I can, but subject t o th e constraint that the police don’t give me a ticket; and I am invariabl y constrained by the maximum speed of my car. I n these circumstances, I might decide t o control my speed according t o the curve in Fig. 3.1(b). Finally , I may wish t o maximize the pleasure I get fro m the trip , sub› ject t o the constraint of an overnight stop in a hotel on the Texas bor› der. Then I might decide t o control my speed according t o the curve in Fig. 3.1(c). Suppose it takes me Τ days t o driv e t o Texas. Τ is not fixed, but depends on how I drive, as shown in Fig. 3.1. Let u(t) be my speed at tim e t. Let / be the quantit y I wish t o maximize. We wil l refer t o J as my utility. I f I am tryin g t o minimiz e loss, then J = - { L o s s }. Thus, for the first of my four alternatives, / = - { f u e l consumption}; for the second and third , J = - { j o u r n e y time} = -T, although there are different constraints in each case; and for the fourt h alternative, / = pleasure. I n general, / wil l depend upon u. Therefore, fro m all allow› able choices of speed u(t) throughout the interval 0 < t < Τ, I wil l wish to select the one that makes J(u) a maximum. M y problem is 91
92
Chapte r 3
Optima l Contro l and Utilit y
u •
(c)
Fig. 3.1 Possible histories for the control function, speed, on a journey from Florid a to Texas: (a) minimiz e fuel consumption (broken line) or minimiz e travel time, subject to speed limi t (solid line); (b) minimiz e travel time, subject to no tickets (I travel at 55 m.p.h. only when I expect to meet police); (c) maximize pleasure, subject to overnight stay. The speed limi t is assumed to be 55 m.p.h. throughout (which it actually was when I first drew this diagram for my students). thu s To find
u(t) for 0 < t < T,
Which maximizes
/ ( «)
Subject to
any constraints.
(3-1)
Call u the control function. Then (3.1) is the simplest possible statement of an optimal control problem wit h a single control function. Optima l control problems are abundantly found in biology, economics, engineering, management science, and indeed almost every aspect of hu› man endeavor. I f there is more than one control function, then « becomes a vector (which we would writ e in bold typeface as u); but otherwise the problem is still (3.1). Even when u is a scalar, however, optimal control problems are usually very difficul t t o solve unless , by using intuition , we
3.1
How Fast Shoul d a Bir d Fly Whe n Migrating ?
93
can argue that the set of potentially optimal controls, i.e., the set of feasible controls, is a very simple one. (The most obvious simplificatio n is to assume that u is constant throughout 0 < t < T.) Then we might even be able t o find the solution graphically, as wit h the solid curve of Fig. 3.1(a); but it’ s much more likel y that we’ll have to use calculus. Th e solid graph in Fig. 3.1(a) is indeed the solution to a highly idealized control problem, for which we assume the road t o be straight and have zero congestion. It’ s an example of a boundary solution; when optimal, w is always on the constraint boundary (maximum acceleration, maximum speed, maximum deceleration). The dashed curve in Fig. 3.1(a), on the other hand, provides an example of an interior solution; when optimal, u is less than maximum speed. A n alternativ e convention that distinguishes th e tw o solutions is to say that the maximum speed constraint is active in th e first case but inactive in the second. Whenever it is appropriat e t o talk about either, we wil l always adopt the second of these tw o conventions. N ow let’s discuss some more serious examples.
3.1
How Fast Shoul d a Bir d Fly When Migrating ?
A bir d migrates t o be as far away as possible fro m the unpleasant cold weather of it s climate of origin. ’ It starts it s journey wit h a finite source of energy, it s body fat, and generally does not feed en rout e (unlik e me, if I driv e t o Texas). Since thi s energy is limited , and since every hour in the air uses some of it (even if the bir d is just hovering), the bir d must not travel too slowly; if it does, the distance travelled wil l not be considerable. On th e other hand, the power required t o resist the drag of the air increases so rapidl y wit h speed that the bir d must not travel too quickl y either; if it does, it s energy supply wil l again be depleted too near to it s journey’ s origin . Then how fast should the bir d fly? In thi s section, we wil l attempt t o answer that question by using a mathematical model. Let u(t) be the speed of the bird . Then the distance travelled is (3.2) where Τ is the flight time. Under benign weather, our bird’ s flight history is likel y t o look lik e the dashed curve in Fig. 3.2. I f we allow the speed t o be as variabl e as this, however, then we wil l not be able t o solve our problem wit h the calculus alone. Therefore, let’s make an approximation; let’ s assume that u is constant, corresponding t o the solid lin e in Fig. 3.2. Our model is thus, in the previous chapter’s terminology, an equilibriu m model. We ignore the dynamics of ascent and descent in the belief that they affect only a negligible part of the flight. Wit h thi s assumption, the You might lik e to review Section 1.12 before proceeding.
94
Chapte r 3 Optima l Contro l and Utilit y
u
•*—• I
0
τ
Fig. 3.2 Flight speed of a migratin g bird .
distance travelled (3.2) may be approximated by (3.3)
/(«) = u • T(u).
Th e bird’ s objective is t o maximize (3.3). Th e flight tim e Τ depends upon u for the reasons given in the opening paragraph. Let Ε be the bird’ s initia l energy, stored as fat. We wil l assume that all of Ε is used durin g migratio n and none is necessary at the end t o survive. Then the bird’ s power output, assumed constant for th e entir e journey, is E/T, of which only a fraction , say η, can be converted int o mechanical en› ergy for the flight. (I n th e terminology of Section 1.12, ηΕΙΤ is the bird’ s effective power.) Thi s mechanical energy must do work of tw o kinds: work against gravit y (to keep the bir d up) and work against drag (to keep the bir d moving along). I t seems reasonable t o assume that the rat e of workin g against gravity o r induced power, I, in the jargon of aerodynamics doe s not depend upon the flight speed, u. Moreover, we may borro w fro m aero› dynamics the fact that drag, D, is proportiona l t o th e square of the speed and t o the surface area that faces the wind , S. Thi s is the same drag law as for th e oarsmen of Section 1.12, which is not surprisin g when you con› sider that air and water are both fluids. Hence D - bSu , where b is a constant, and 2
ηΕΙΤ = Rate of working against drag + Induced power Du
+
I
bSu*
+
I.
(3.4)
Fro m (3.3) and (3.4) we deduce that
I t is easy t o show (see Exercise 3.1) that J(u) attains a maximum on th e interva l 0 < u < o o a t M = M * , where (3.6)
3.2
How Bi g a Pay Increas e Shoul d a Professo r Receive ?
95
and
N ow / , though independent of u, is known fro m aerodynamics t o be pro› portiona l t o the weight of the bir d (a bir d that’ s twice as heavy, for example, has t o work twice as hard against gravity) . We therefore writ e (3.8)
/ = mgv„
where m is the bird’ s mass, g is the constant acceleration due to gravity , and v , the constant of proportionality , is known in aerodynamics as the induced velocity. (You should check that v, does indeed have the dimensions of velocity, by the method of Section 1.14.) Then, fro m (3.6)-(3.8), we obtain (
and
I n obtaining the optimal speed (3.9), we have overlooked a potential constraint. There is a certain speed, let’s call it M , above which the bir d is incapable of flyin g (however wantonly it squanders fuel). Therefore, instead of seeking the maximum of / ( «) on the interval 0 < u < , we should really have sought it s maximum on the interval 0 < w < u . But the constraint u < w wil l not affect our answer (3.9) if u* < u , which we have tacitl y assumed. In other words, we have tacitl y assumed that the constraint u < « is inactive. If a constraint is inactive, then w e obtain the same result by ignorin g it completely. Clearly, if u* > u , then / ( Œ) would be an increasing function on the interval 0 < u < « and would take it s maximum at « . In principle , therefore, it is more correct to say that the optimal flight speed is the minimu m of u* and « , but we shall continue to assume that the constraint u < M is inactive, because the "sprinting " speed of any creature always greatly exceeds its "lon g distance" speed. How good is thi s model doe s (3.10) tell us how far a bir d flies when migrating ? Perhaps you would lik e t o thin k about that; we’ll raise the topic again in Chapter 4. M A X
m a x
max
miX
m a x
max
max
m a x
m a x
M A X
3.2
How Bi g a Pay Increas e Shoul d a Professo r Receive ?
Lawmakers in a certain state have just granted a pay increase to faculty at the state university. They have done thi s merely by increasing the budget for professors’ salaries, and it is up to the university to decide how these additional funds are to be distribute d among faculty. In principle , all the money could be used to raise the salaries of a few outstanding professors.
96
Chapte r 3
Optima l Contro l and Utilit y
But thi s would hur t the morale of, and hardl y be fair to, all those less than outstanding professors w ho still do an excellent job . On the other hand, an "across-the-board" increase (the same percentage for everyone) would hur t the morale of lower paid faculty who have distinguished themselves as outstanding teachers and scholars. A compromise is needed, according t o which everyone gets some increase, and more deserving faculty get more. But w ho is more deserving, and how much more of an increase should they receive? I n thi s section, we wil l indicate an approach t o solving such a problem by using a mathematical model. To simplif y matters, we wil l begin by assuming that the university administratio n has already partiall y solved the problem by allottin g cer› tai n amounts of the total salary budget increase to each department. These amounts would not, of course, be equal in general. It is perhaps most likel y that they would be proportiona l t o the number of faculty in each depart› ment (although the university administratio n may have found a way t o in› crease it s allotment to one or tw o outstanding departments). Let’ s suppose that , as a consequence , the Mathematics Department now has a budget of Β dollar s for salary increases. We wil l also assume that the extra Β dollar s i s available every year fro m now on, so that the increases wil l be perma› nent. H ow should the Mathematics Department’s chairperson distribut e thi s money among the faculty? Th e method we use t o answer thi s question i s also applicable, wit h rather more work , t o the university as a whole (so we have not cheated by concentrating our attention on a single department). Every year the research, service, and teaching of faculty in the Math › ematics Department are subject t o peer evaluation. They are classified as outstanding, strong, satisfactory, weak, or inadequate. Service might in› clude not only administrativ e and pastoral duties withi n the university but also community service (e.g., judgin g at a high school science fair) . Th e chairperson has decided t o distribut e the Mathematics Department’s salary increase on the basis of thi s evaluation. Thi s year, no one has been judged as weak or inadequate. Thu s research, service, and teaching are placed in one of three categories for each professor, implyin g that faculty are placed in one of 3 3 3 = 27 overall categories. Using ˇ t o denote outstanding, G t o denote strong, and S t o denote satisfactory, the results of thi s year’s peer evaluation are shown in Table 3.1. Notice that only 14 of the 27 possible categories are represented (for example, no one is clas› sified as OGS, i.e., outstanding in research, strong in service, satisfactory i n teaching). Notice also, fro m the final column of the table, that the De› partment of Mathematics has 30 faculty. Let us agree t o describe research, service, and teaching as factors in th e evaluation process. Now, it is generally felt withi n the department that someone whose factor evaluation is strong has achieved approximately twic e as much as someone whose factor evaluation is satisfactory. More › over, it is generally felt that someone whose factor evaluation is outstanding
Ho w Bi g a Pay Increas e Shoul d a Profeeao r Receive ?
3.2
97
Table 3.1 This year’s peer evaluation of faculty in the Depart› ment of Mathematics. Category 2 3 4 5 6 7 8 9 10 11 12 13 14
Research
Service
Teaching
ˇ ˇ
G S S ˇ G G
ˇ
G G G G G S S S s s s
Nui
^ ?I^ 2
G G ˇ G G S ˇ G ˇ G G S
s s
G G S S
Ult y
a
10 3
3 3
has achieved twice as much as someone whose factor evaluation is strong. I t therefore seems reasonable t o say that S corresponds t o one unit of factor achievement, G t o tw o unit s of factor achievement, and ˇ t o four unit s of factor achievement. But faculty in another department or at another universit y might not agree! Therefore, wit h a view to making our model as general as possible, we wil l label the classifications O, G, and S as / = 1, 2 and 3, respectively; and we wil l label the factors research, service, and teaching, respectively, as j - 1 ,2 and 3. Let m denote the number of unit s of factor j achievement corresponding t o the classification /. Then th e perceptions of the faculty on thi s matter can be stored in a 3 3 merit matri x M , in which m,y occupies row i and column j . For the particula r department we are considering, Vj
M =
"4 2 1
4 4 2 2 1 1
(3.11)
Th e columns of are identical in our illustration . But they do not have t o be. If , for example, ˇ for teaching were felt to represent five times the achievement of S for teaching, then w i would be 5, not 4. At thi s juncture , you might lik e to attempt Exercise 3.2. Th e chairperson has decided t o solve the allocation problem by paying each faculty member an additional v, dollar s for every unit of factor achievement. The problem therefore reduces t o determining appropriat e numbers v,, v , and v . We wil l refer t o v,, v , and v as controls. Let i(k,j) denote the factor j label associated wit h a faculty member in category k, l 3
2
3
2
3
98
Chapte r 3
Optima l Contro l and Utilit y
1 < k < 14. These labels are contained in a 1 4 x 3 matri x equivalent t o th e middl e three columns of Table 3.1. For example, /(5,2) = 2, because a professor in category 5 is rated as strong in service, and /(11,3) = 1, because a professor in category 11 is rated outstanding in teaching. Then a faculty member in category k wil l receive a salary increase of m ^ • v, dollar s for hi s research, m • v dollar s for his service, and w , • v dollar s for his teaching. For example, on using (3.11), a professor in category 3 wil l receive 4v, dollar s for research, v dollar s for service, and 2 v dollar s for teaching. Th e total salary increase of a professor in category k wil l therefore be i(k
i(k
2 ) 2
2
(A 3 ) 3
2
3
3
3
s
k
=
Y2
m
i{kjy
(3.12)
• jv
For example, the total salary increase of the professor in category 9 wil l be v, + 4v + 4v dollars. Let n denote the number of faculty in category k. Then the total faculty salary increase for that particula r category wil l be n s . Summing over values of k between 1 and 14, we find the total faculty salary increase. Thi s must equal B, by definition . Hence 2
k
3
k
k
14
(3.13)
Y,n s = B. k
k
k=i
For (3.11) and Table 3.1, you can easily verif y (Exercise 3.3) that the budget constraint (3.13) reduces t o 58v, + 55v -h 6 8 v = B. 2
(3.14)
3
N o matter how our chairperson selects the controls v,, v , and v , he must at least ensure that (3.14) is satisfied! Th e budget constraint could be satisfied in a variety of ways. Th e chairperson could, for example, set v, = v = v = 5 / 1 8 1. But paying equal amounts for equal achievements in each of the factors may not be i n the department’s best interests. Suppose, for example, that the chairper› son is concerned about th e department’s research activity . H e may have observed that, whereas only tw o of the faculty are merely satisfactory in teaching, a thir d of the faculty is merely satisfactory in research. A s an incentive to faculty to concentrate more on research, the chairperson may wish t o increase the bonus for a unit of research achievement. Th e extreme case would be to set , = 5 / 58 and v = v = 0. Thi s would mean that teaching and service achievements went wholly unrewarded, however, and would not be in the department’s best interests either; a successful aca› demic department requires a balance between the three factors. H ow can th e chairperson attain such a balance? 2
2
2
3
3
3
One way would be to insist that the payment for a unit of achievement i n one factor can never be more than, say, twice or three times the payment for a unit of achievement in another. We’r e not sure whether to say twice
3.2
How Bi g a Pay Increas e Shoul d a Professo r Receive ?
99
or three times or even some other ratio ; therefore let’s simply insist that th e control for one factor can never be more than º times that for another, where the choice of º is at the chairperson’s discretion. I n other words, we constrain v,, v , and v so that 2
3
}v,
jv
2
t
^v
lt
3
(3.15)
2
where º > 1. For the sake of morale withi n the department, it is probably also a good idea to set an absolute minimu m on the amount of increase that a professor can receive, provided that his work is at least satisfactory in each of the factors. Suppose we agree that such a professor should obtain at least a fractio n e of the total faculty increase. Here c is some small number, to be agreed upon by the faculty, and it is clear at the outset that e cannot possibly exceed 1/30 (why?). A further constraint is therefore v, + v + v > c f l . 2
(3.16)
3
Let’ s assume that (3.14) (3.16 ) are the only constraints that the chairper› son, in consultation wit h the faculty, finds necessary. I t is convenient at thi s point to make the controls dimensionless. Be› cause Vj and Β have the dimensions of value, we define: ", = | ,
1 < 7 < 3.
(3.17)
Then Uj is dimensionless and the constraints (3.14) (3.16 ) take the dimen› sionless for m -
A «
+
M
"l -AM,
-
AM
3
2
«2 -AM,
-"I
< < < < < < <
2
-
AM
-
U
2
2
-
AM
+
«3
+
"3
-
"3
3
58M, + 5 5 u2 + 6 8M
3
0 0 0 0
(3.18)
0 0 1.
I t wil l shortly emerge why th e seventh of these eight constraints has been writte n as above, rather than in the more natural for m M, + u + w > t. W e wil l say that the control vector u = ( Μ , , 2 , Μ ) is feasible if w,, M , and M are nonnegative numbers satisfying (3.18). Clearly, the need t o satisfy (3.18) gives the chairperson considerably less freedom than would exist if (3.14) were the only constraint. On the other hand, there may still be infinitel y many choices of feasible controls! Suppose, for example, that A = 2 and e = 0.01. Then you may verif y that two feasible choices are u = (1/181,1/181,1/181)" and u = ( 1 / 2 3 6 , 1 / 1 1 8 , 1 / 2 3 6 ") , and it can be 2
ª
3
2
3
7
7
3
100
Chapte r 3
Optima l Contro l and Utilit y
shown that there are infinitel y many others. Whic h of all these feasible control s wil l th e chairperson select? Let’ s suppose, as earlier, that the chairperson is concerned about th e department’s research activit y and would lik e t o provid e an incentive t o improv e it . Then a rational strategy for h i m t o pursue would be to award th e m a x i m um feasible amount t o a uni t of research achievement. I n other words, fro m all feasible controls, he would choose the one for which w, is largest. H e is therefore faced wit h the followin g control problem: Find
u = (w,,« ,u ) ,
Which maximizes
J(u) = u. ’ u feasible.
r
2
Subject to
3
(3.19)
Thi s control problem is a special case of th e followin g one: Find
u=
Which maximizes
J(u) =
Subject to
]T
(u ,u ,...,u„) , T
l
2
η
cu k
k
η ik k
a
u
< i<
i=l,...,g
h
(3.20)
k=l η
^a
i
k
u
k
= bi,
i-q+\,...,r
k=\
l,...,/j.
tij>0,
You can verif y that (3.19) is the special case of (3.20) for which η = 3, q = 7, r = 8, a,, = a = a = a = a = a = 1.0, a = a = a = 4 3 = 5i - 62 = > = b = by - b = b = b = 0, b-, = -c, b = 1.0, c, = 1.0, and c = c = 0. T h e control problem (3.20) is known as a linear program. To solve it we must find a set of η nonnegative controls, {u u ,u ,...,« }, which maximizes some linear combination of controls subject t o r additional constraints, of which q are linear inequality constraints and r - q are linear equality constraints (additional because requirin g u t o be nonnega› tiv e is already a constraint). A linear program of th e for m (3.20) i s com› pletely specified once we have specified entries for an rx η matri x A , an r-dimensional vector b, and an ^-dimensional vector c. Efficient computer program s for solving linear programs are found at almost every computer installatio n and are extremely simple t o use. On the other hand, the theory behind these programs would take at least a chapter t o expound and would have nothing t o do wit h modelling per se. Therefore, we do not discuss it . Th e interested reader is referred t o one of the many excellent textbooks on 3 2
2i
a
a
42
6 3
52
l2
3 (
2J
- A
a
2
2
4
5
6
t
3
lt
2
3
}
3.2
Ho w Bi g a Pay Increas e Shoul d a Professo r Receive ?
101
optimization , for example, Jeter (1986). Fro m the point of view of mod› elling, it is importan t only t o know that a feasible solution of (3.20) may not exist and may not be unique; but if it does exist, then a computer package wil l quickl y find it for you (it wil l also tell you if there is no feasible solu› tion) . Moreover, the set of optimal controls is usually unique in practical problems; and, should there be more than one solution, the decisionmaker would use some other criterio n t o distinguish between them. I f there were mor e than one solution to (3.19), for example, then the chairperson of the Mathematics Department would adopt the most popular one. Let’ s now retur n t o (3.19). M y students and I used the IMS L routin e ZX3L P t o solve thi s problem. Th e routin e is extremely simple t o use and full y documented in the IMS L manuals. But other routines exist, even for small personal computers, and they are usually fast, reliable, and easy t o use at least for moderate values of r and n. (Thi s state of affair s should not be used as an excuse for ignorin g the theory of linear programmin g completely. It simply makes it out of place in a modelling course.) To specify A and b for the computer, it is necessary t o supply values for º and t. Suppose, for example, we take º = 2 and e = 0.01. Thu s one factor payment for a unit of achievement may not exceed twice another, and every professor wil l receive a pay increase that is at least 1% of the total available funds. You can easily verif y that the optimal controls for (3.19) are then given by u* = ( 0 . 0 0 8 3 6 8 2 , 0 . 0 0 4 1 8 4 1 , 0 . 0 0 4 1 8 4. 1 )
(3.21)
Thi s result is quoted wit h far more accuracy than is useful in practice, but that wil l enable you t o check your own results. I f º = 2 and c = 0.017, on th e other hand, then the optimal controls are given by u* = ( 0 . 0 0 6 8 4 2 1 , 0 . 0 0 6 7 3 6 8 , 0 . 0 0 3 4 2 1. 1 )
(3.22)
On using (3.12), we can now deduce the salary increase that a professor in category k would receive according t o (3.21) and (3.22). Th e results are presented in Table 3.2. Notice that solutions (3.21) and (3.22) are fundamentally different . When e = 0.01, only the first and second of the inequality constraints in (3.18) are active. I f we had known in advance that constraints / = 3 t o / = 7 would be inactive, then we could have overlooked them (but of course we di d not know, which is why we included them). I n particular , the minimu m salary increase constraint (3.16) is inactive. I n thi s case, th e value for ι set by the chairperson is so low that the lowest salary increase would exceed it anyway. It means that the greatest possible incentive can be given t o research by making w, exactly twice u or u . When = 0.017, on the other hand, the value for e set by th e chair› person is sufficiently high that the minimu m salary constraint (3.16) has become active. At the same time, the first constraint has become inactive; 2
}
102
Chapte r 3
Optima l Contro l and Utilit y
Table 3.2 Salary increase in dollars awarded to faculty member in category k, 1 < k < 14, for each $1000 of total salary increase awarded to the Department of Mathematics, for º = 2 and for two values of c. Category
£
1 2 3 4 5 6 7
= 0.01
t = 0.017
Category
e = 0.01
t = 0.017
54.53 47.79 40.95 47.47 40.84 34.00 27.26
8 9 10 11 12 13 14
25.10 41.84 33.47 33.47 25.10 20.92 16.74
23.84 47.47 40.63 34.00 27.16 20.42 17.00
58.58 54.39 46.03 41.84 41.84 33.47 29.29
so that, although u, is still twic e u , u is now almost as great as u,. Thi s i s surely not what the chairperson intended by tryin g t o maximize the re› war d for a unit of research achievement, because one can far e almost as well by concentrating on service. It shows that the choice of c is critica l i n determining the distributio n of salary increases, and it might even be argued that the constraint (3.16) should be eliminated fro m the problem. Althoug h we shall not do so here, one can show more generally that for any given º ( > 1) there are tw o critica l values o f f , namely, ( ( \ ) and c (X), defined by 3
2
L
v
C
l
W
˛
f
58XTT23’
" ~ TmrW" (º )
( 1 2 3)
such that there is no feasible solution t o (3.19) if c > e (A) ; however, if e < then the optimal control for (3.19) is y
-
=
58AiTS
( A
’ ’ l
I ) r
’
( 3
•
2 4 )
constraint (3.16) being inactive. I f c (X) < e < (A) , on th e other hand, then constraint (3.16) is active and the optimal control for (3.19) is L
u* =
3
A
|
y
( { 1 - 55f} º , {58º + 68}« - A - 1,1 - 5 5 e ) . r
1
3
(3.25)
N o t e that u\ = Xu* in both cases. For º = 2, as in Table 3.2, we have e (2) = 0.0167364 and €^2) = 0.0170068 (so that the maximum value the chairperson can choose for c is then considerably lower than 1/30). H o w good is thi s model woul d a university department use it ? N o› tic e that, hitherto , we have always made th e question "Ho w good is thi s model?" equivalent t o "Does it fit the facts?" Wh y do we now abandon thi s equivalence? Perhaps you would lik e t o mull thi s importan t matter over, we’ll retur n t o it in Chapter 4. Meanwhile, tr y Exercise 3.5. 3
L
3.3
3.3
Ho w Many Worker * Shoul d Industr y Employ ?
103
How Many Worker s Shoul d Industr y Employ ?
Suppose that the manufacturin g sector of a certain economy seeks t o max› imiz e it s profits. H ow many worker s should it employ? I n thi s section, we wil l attempt t o provid e at least a rough answer t o thi s question. Let u(t) denote th e number of worker s employed at tim e t; thi s wil l be our control function. For th e sake of simplicity , we wil l assume that all are full-tim e worker s (though the effect of part-tim e labor could be in› cluded by counting, say, tw o half-tim e worker s as a single unit of labor). Let w(t) be the average wage per worker per year at tim e t (more precisely, as in Section 1.6, th e instantaneous average annual wage). Then industry’ s (instantaneous) annual wage bil l at tim e t is w(t) • u(t). Let Y(t) denote the monetary value of industry’ s output at tim e / (again, as in Section 1.6, measured as an instantaneous annual quantity) . Let φ) denote annual costs independent of th e size of the labor force. Then, if we assume that all goods produced are also sold, industry’ s an› nual profit s at tim e t are ( ) = Y(t) - c(t) - w(t) • u(t). On using (1.43), we deduce that ( ) = P{t) • QXt) - c(t) - w(t) • u(t), where Q denotes real output and Ρ the pric e index. Let’ s now assume that real output can be modelled adequately by using a Cobb-Douglas production function. Then, fro m (1.32), we obtain ( / ) = au(t)~< K(t) ~~<, where Κ denotes capital stock and 7(0 < 7 < I ) and a are constants. Industr y wishes t o maximize profits , and so it s utilit y is simply . Hence it wil l wish t o control u(t) so as t o maximize 2
l
J(u(t)) = P(t)au(tyK(t) -i l
- φ) -
w(t)u(t).
(3.26)
Differentiatin g wit h respect t o «(/), we easily find that (3.27) and, because 7 < 1, that d J/d(u(l)) 0 < u(f) < 00 at u(t) = «*(/), where 2
2
< 0. Hence J has a maximum on
(3.28) Our model predicts that (3.28) is the optimal amount of labor for industr y t o employ. How good is thi s model doe s (3.28) agree wit h th e amount of labor actually employed? D o es it tell us anything about the usefulness of th e Cobb-Douglas model of economic growth? Essentially thi s question wil l surface again in Chapter 4, as Exercise 4.18. Meanwhile, i n derivin g (3.28), we have overlooked a possible constraint. What is it ? See Exercise 3.6. 2
You might lik e to review Section 1.6 before proceeding.
104
Chapte r 3
Optima l Contro l and Utilit y
3.4
Whe n Shoul d a Fores t B e Cut ?
A forest is an investment. Th e trees that grow there are felled for their wood, and the wood has a market value. But if the trees are harvested too soon, then th e pric e they fetch may not even cover the costs of fellin g them. On the other hand, if the forester waits too long before harvesting, then the doddery old trees may not be growing fast enough t o justif y their occupation of th e soil. Somewhere in between these extremes lies an opti› mal harvesting time. What is it ? I n thi s section, we wil l attempt t o answer that question by using a mathematical model. Th e key t o solving thi s problem is to understand that every investment i s also an act of abstention. Th e money a forester spends on plantin g trees could instead have been deposited in a bank, where it s value at tim e t would have grown at the instantaneous annual rate of interest, u{t), defined t o be the specific growth rat e of the value of money. Thus, if M{t) is the value of money deposited in a bank at tim e t, we have ..
1 dM
,, .
For the sake of simplicity , we wil l assume in thi s section that u is a constant. Then M{t) = M ( 0 y " .
(3.30)
Th e annual rat e ν when interest is compounded instantaneously must be distinguished fro m the annual rat e ν when interest is compounded only once a year. I n the former case, the value of money after one year is A/(0)e" . I n the latter case, the value of money after one year is ¸/(0 ) • (1 + ν). Hence ν = ln( 1 + v). To distinguish verbally between the tw o rates, we might call i/ the yearly rat e and ν th e annual one. Moreover, t o preserve a distinction that wil l shortly emerge, we wil l refer to ν as the nominal annual interest rate. By plantin g trees, the forester hopes that proceeds v\t) fro m the even› tual sale of the wood, i.e., revenue minu s cuttin g costs minu s plantin g costs, wil l exceed whatever the balance of his bank account would have been if he had placed hi s money there instead. It seems reasonable t o call v\t) the value of the forest and t o expect that the forester would be happy if ˚ were made large. D o es it , therefore, correspond t o his utilit y in (3.1)? To understand that the answer is no, consider a purely imaginary event. Suppose that the yearly rat e of interest is 8%, i.e., ν = 0.08; and that I have purchased a beaten-up old bicycle for $100, secure in the knowledge that I can clean it , polish it , and sell it at the end of the year for $112. Ignorin g riskiness, inflation , and so on (because th e event is imaginary), am I righ t t o tell myself that the tru e wort h $ W of my bicycle, at th e tim e of purchase, i s $112? N o, clearly not; for if I had $112, then I could put it in a bank where, after one year, it would become $112 • (1 + 0.08) = $120.96, which
3.4
Whe n Shoul d a Fores t Be Cut ?
105
i s more than I can eventually get for th e bicycle. Thu s th e tru e wort h of my bicycle is less than $112. On th e other hand, the tru e wort h of my bicycle is more than th e $ 1 00 I paid for it , because that amount of money would grow t o only $ 1 08 if I placed it in a bank. Thu s 100 < W < 112. A few moments thought should now reveal that th e tru e wort h of my bicycle is the amount of money that would grow t o $ 1 12 if deposited in a bank, instead of being used t o buy th e bicycle. Hence W ( l + 0.08) = 112; whence W = 112/1.08 = 103.70. I n other words, the bicycle’s tru e wort h today is equal t o it s value one year fro m now divided by the multiplicativ e factor by which money would grow in a bank in that time. For exactly th e same reason, th e tru e wort h of th e forest today is e~"V{\). By an obvious extension of th e same argument, it s tru e wort h is also equal t o e~ \\2), e~ V[3), ˆ • ˚ 4 . 7 6 ) , and so on. Thus, in gen› eral, th e tru e wort h of a forest wit h value V\t) at tim e t, when assessed in the light of alternative investment possibilities, is the quantit y lv
4
iv
76
(3.31)
e""m
which we shall call the present value of th e trees in the forest. Thi s is th e utilit y that the forester’s harvesting policy wil l seek t o maximize. Let there be Ν trees in th e forest and let u(t), the control function, be th e rat e at which trees are cut at tim e t. To simplif y th e control problem, let’ s assume that th e entir e forest is felled in a single operation, which takes place durin g the interval s - e/2 < t < s + e/2. I f th e rat e of fellin g withi n thi s interval is constant (and therefore equal t o N/e), then th e graph of u wil l appear as th e dashed curve in Fig. 3.3(a). I f e is very small (weeks, say) compared t o the tim e for which a forest grows (several decades), then a useful mathematical approximation is t o assume that th e trees are all felled at the same instant, i.e., t o take the limi t of Fig. 3.3(a) as e — 0 (Fig. 3.3(b)).
Ν/ε
(a)
Fig. 3.3 Clearcutting control for a forest.
(b)
106
Chapte r 3
Optima l Contro l and Utilit y
Then u is an impulse control, which can be represented crudely as
3
=
;
w(i) = 0,
ifi^i .
v
(3 32) ’
The utilit y J(u) has thus been reduced to a function of s, say / . The optimal control problem is therefore to Find
j
Which maximizes
(3.33)
j\t) = e- V{t). ut
I t remains to determine the form of V. Assume that the forester always was, and always will be, a forester. Whenever he cuts the forest he replants it again, so that cutting and plant› ing costs occur together at the end of each cycle; or rotation, to use the accepted forestry terminology. Let these (combined) costs be denoted by &, and, at tim e t, let ξ(ή be the volume of wood in a tree and p\t) its selling pric e per unit volume. Assume, moreover, that all Ν trees in the forest are identical. Then f{t) =
Wt)t(t)-e-
(3.34)
Prices and costs (which are simply prices of other commodities) will rise over tim e at the going rate of inflation , r, defined in Section 1.6 by
where P(t) is the price index. Let’s assume that the rate of inflatio n is constant. Then, if c and ρ denote cost and selling price at the start of the current rotation, we have Pit) = pP(0 = P^ c(t) = cP(t) = ce", {
}
on recalling that P(0) = 1. Exploitin g the analogy between (1.43) and (3.36), we say that p is the nominal selling price and ρ the real selling price; and similarl y for 6 and c. Substituting from (3.34) and (3.36) int o (3.33), we obtain At) = r " {NpfUt)
- ce") = e~ V[t\ 6,
(3.37)
where we have defined the real (annual) interest rate b= v-r 3
See Supplementary Note 3.1.
(3.38)
3.4
Whe n Shoul d a Fores t Be Cut ?
107
t o be the difference between the nominal interest rat e and the rat e of in› flation; and where (3.39)
V\t) = Npat)-c=e- 'r\t) r
is the deflated value of the forest at tim e t, i.e., it s value after a correction has been made for the illusor y growth that is merely due to inflatio n of prices (see Section 1.6). Exploitin g th e analogy between (1.43) and (3.39), we refer to F as the nominal value of the forest and F as it s real value. Thus, although the words "true " and "real " are virtuall y synonymous i n everyday speech, they have specialized meanings for us in an economic context. A n economic asset has real value V\t) at tim e / i f we have cor› rected for the illusor y growth in value, prio r t o tim e t, that is merely due t o inflatio n of prices; or, which is exactly the same thing, if we have di› vided it s nominal value by the pric e index />(/) = e" (or, which of course is the same, multiplie d by e~ ). A n economic asset has true wort h f(t) today if we have corrected it s value at tim e t fro m now for the il › lusion that it could not be sold today and the proceeds deposited in a bank; or, which is exactly the same thing, if we have multiplie d it s value at tim e t by either e~ or e~ , according t o whether that value is either nominal or real. You should compare (3.31) wit h (3.37) to verif y that the forest’s tru e wort h can indeed be obtained either (i) by always using nom› inal prices and interest rates or (ii ) by always using real prices and interest rates. Th e second alternativ e is the norm in economic modelling and, in th e absence of a statement to the contrary , we shall assume henceforward that (ii ) prevails. Moreover, we wil l usually refer to fit) henceforward as present value, rather than tru e worth , as an insurance against confusing th e specialized meanings of real and true. We wil l call e~ the discount factor. N ow a tree is a plant, and a model of plant growth was studied in Section 1.3. Although that model was really intended for annual species of plants, and not for trees, it s basic assumption tha t growth is proportiona l t o the remaining amount of a limite d quantit y of nutrient doe s not seem unreasonable for trees as well. Thu s the model of Section 1.3 suggests that th e graph of £(/) wil l be 5-shaped, and we wil l cautiously assume this. Multiplyin g by the constant Ν ρ wil l not alter the 5-shape, and subtracting th e constant c merely displaces the graph downward. We therefore expect that the graph of V\t) = Np£(t)-c wil l appear as shown in Fig. 3.4. Thu s the forest has no commercial value for ι < t , and it s value can never exceed V^, where the graph has a horizontal asymptote. I t is now (Exercise 3.7) a matter of simple calculus to show that./(/), as defined by (3.37), has a maximum at t = s, where rt
ut
6t
u
0
(3.40)
108
Chapte r 3
Optima l Contro l and Utilit y
Fig. 3.4 Expected shape of graph of forest’s real value.
provided (3.41)
"^<8>.
V
m
I f ξ(ή does have the logistic for m (1.16), then
^=TT^fe-’ ’
3
•
4 2 )
where the constant b is defined by (1 + b) • ξ(0) = i . Thu s = Npfy-c, and kfytQ = Inibc/V^). N o te that f is sure t o be a positive number, because f > 0 is equivalent t o our assumption V\Q) < 0. I t is then easy t o deduce fro m (3.42) and (3.40) that V{s) is the sole positive root of the quadrati c equation f
0
0
Np6V=
k(V+
c)(K
TO
- V)
(3.43)
(see Fig. 3.5); whence, fro m (3.42), the optimal rotatio n tim e is i=
i, fW±£i\ n
(3 44)
Referrin g t o Fig. 3.4, therefore, we find the optimal rotatio n tim e by mov› in g along the dashed curve in the direction of the arrows. H o w good is thi s m o d e l d o e s (3.44) determine when a forest should be cut? Perhaps you would lik e to mull thi s question over; we’ll retur n t o i t i n Chapter 4. Meanwhile, tr y Exercise 3.9.
3.5
How Dense Should Traffic Be In a Tunnel?
109
phibV.k(V+c){V,
*· V
Fig. 3.5 Graphical determination of V{s) when Kis given by (3.42).
3.5
How Dense Should Traffic Be In a Tunnel?
Tunnels are notorious bottlenecks where motorists converge from several directions to compete for the means to cross a river.4 To reduce these trame delays, the traffic flux, i.e., number of vehicles using the tunnel per hour, should be maximized. This means solving an optimal control problem for which the utility is traffic flux. We have already seen in Chapter 2 that traffic flux depends upon traffic density, i.e., number of cars per mile. Accordingly, let the control function, «(/), be the traffic density at time /. To make matters simple, however, we'll assume that u is independent of t. The traffic flow is then in equilibrium, and we'll assume that its velocity is given by (2.28). Thus, from Exercise 2.5, the traffic flux is
-{ where we have denned /(
^max>
Vuln(xmJu),
if 0 < u < JCC; if xc < u < xn
(3.45)
(3.46) ln(xmax/xc) and xc is the critical traffic density below which cars may travel at the speed limit, vma!t. We also saw in Exercise 2.5 that the maximum of (3.45) occurs at " = W « = °-37*max >f XmJe > xc and at u = xc if x,mJe < xc. Which of these two inequalities is likely to hold? Let dmia denote the distance between cars at maximum density and dc the distance between cars at the critical density, xc. Then V=
"•max Xr
4
_
dc + L dmin + L'
You may wish to review Section 2.3 before proceeding.
(3.47)
110
Chapte r 3
Optima l Contro l and Utilit y
where L is the length of a car. Cars move if they are more than a fractio n of a carlength apart. Let thi s fractio n be e (to be determined). Then d
min
(3.48)
=
where 0 < t < I . On th e other hand, many state laws declare that for each 10 m.p.h. of speed you should be at least a carlength behind the car i n fron t of you. Let’ s suppose that thi s applies t o the speed limit . Then d > v L / 1 0 . Hence, on using (3.47) and (3.48), the maximum o f / ( «) depends upon whether c
m a x
iB-Li>i= e + 1
2.718.
(3.49)
Because e < 1, (3.49) is sure t o be satisfied if v is 45 m.p.h. or greater. I n practice, v > 45 is very likel y (even if the official speed limi t is lower); and is probably quit e close t o zero, making (3.49) valid even for much lower values of v than 45. Let us therefore assume that x /e > x. Then the optimal density is u = u* , where m a x
m a x
m a x
max
«* = ^ a ;
e
c
(3.50)
whil e the maximum traffi c flux, or tunnel capacity, is J{u*)=Vu\
(3.51)
Thu s V, as defined by (3.46), is the optimal speed of traffi c through the tunnel. H o w would thi s optimal solution be implemented? I n practice, one would control the optimal "throughput " of traffi c itself, by placing a stop light at the start of the tunnel that limite d influ x t o Vu*/60 cars per minute. Accordin g to data presented by Prigogine and Herman (1971, p. 9), the optimal density for N ew York’ s tunnels appears t o be about 65 cars per mile, and the optimal speed is about 20 m.p.h. (though it varies slightly fro m tunnel to tunnel, the newer ones being more efficient.) Thu s according t o (3.51), the capacity of a N ew Yor k tunnel is about 1300 cars per hour. Thi s optimal traffi c flux can be achieved by using a stop light t o allow only about 22 cars (per lane) per minut e t o enter th e tunnel. Gazis (1972, p. 422) report s that, startin g in 1959, thi s very strategy was used t o increase th e throughpu t of the Lincol n tunnel. According t o Gazis, the strategy worked very well for part of the time, but it was difficul t t o reset the (optimal) equilibriu m after perturbation s due t o any sudden increase in congestion. What does thi s mean? I s thi s a good model because it sometimes mim › ics realit y well, or a bad model because it sometimes fail s t o mimi c realit y at all? You should mull thi s question over. We’ll retur n t o it in Chapter 4.
3.6
3.6
How Muc h Pesticid e Shoul d a Cro p Growe r Use an d When ?
111
How Muc h Pesticid e Shoul d a Cro p Growe r Use an d When ?
Crops are afflicted by insects, and the damage they cause is an economic loss for the grower. Using pesticides helps to reduce thi s loss, but it is also expensive. Let C denote the cost of damage and C, the cost of spraying. I f a grower uses a lot of pesticide, then Q will be low but C will be high. I f the grower uses littl e pesticide, then C, will be low but Q will be high. Then how much pesticide should a grower use if he wishes to minimiz e his total loss, L - C + C 1 There is also the question of when to apply the pesticide. Too early an application will mean that not enough insects are yet available for slaughter; too late an application will mean that most of the damage has already been done. In both these ways, the grower of a crop is faced with an optimal control problem. In thi s section, we will tr y to help him solve it. Let the concentration of pesticide when a crop is sprayed at tim e t, denoted by u(t), be the control function. A grower requires a given amount of (diluted) mixtur e to spray a given area of cropland; therefore the con› centration is proportional to the amount of pesticide used. As usual, to make the problem tractable, we will assume that the optimal control is of a particular kind. We’ll assume that the grower sprays his crop only once per season, at tim e s, using pesticide with concentration U; and that any effect on the insects is immediate. We can represent this control mathe› matically by writin g d
$
s
d
(3.52) where the growing season extends from tim e t = 0 to tim e t = T. In practice, of course, the pesticide may take some tim e to work; but as long as this tim e is sufficiently short when compared to the length of the growing season, then it s effect may be regarded as immediate. According to Plant (1984, p. 5), one application of pesticide is frequently all that is needed in the San Joaquin Valley cotton fields, so that (3.52) is not unreasonable. Then the control {u(t): 0 < t < T} is completely determined once s and U have been determined; i.e., we may writ e the loss (negative utility ) as L(uU))=As,U),
(3.53)
where / i s a function of two variables (see (3.63) below). You should com› pare (3.52) with the form of control assumed in Section 3.4. Here, the optimal policy depends both on the timin g of an action (spraying) and its intensity (concentration of pesticide); there, we took the intensity of the action (rate of felling) to be infinite , so that the policy then depended only on the timing .
112
Chapte r 3
Optima l Contro l an d Utilit y
We will assume that the crop is afflicted by a single pest, that the native population of these insects grows at the constant specific rate R, and that it s growth is boosted by immigratio n at constant rate q per unit of time. Hence if x(f) denotes the magnitude of the insect population at tim e t, then (Chapter 1, Exercise 1.16): xit)=
(x(0)+!)e*’-i
0
We will denote the limi t of thi s expression as t tends to s by xAs)
= 40)**'
+I
(e** - 1).
(3.54) X_(J).
Thus (3.55)
Let S denote the proportio n of thi s population that survives the pesticide application at tim e s. From Exercise 1.13, it seems reasonable to assume that there exists a threshold U such that 0
where Æis a constant. Then, because we have assumed that the effect of the pesticide is immediate, the magnitude of the insect population immediately after the crop has been sprayed is x(s) = S(U)x_(s); (3.57) and the growth of that population for the remainder of the season is given by xit) = (x(s) + I)
- |,
s < t < T,
(3.58)
on using Exercise 1.16 again. The crop grower’s objective, you’ll recall, is to minimiz e his total loss, L - C + C . Let c be the fixed cost of spraying the crop (cost of renting an aircraft , etc.) and c, the additional cost of purchasing and applying each unit of pesticide. Then the cost of spraying is s
d
0
C = Co + U. t
Cl
(3.59)
Let D\t) denote the number of unit s of crop (say tons of cotton) destroyed by the pest per unit of time. Let ρ be the price, per unit of crop, that the grower obtains at the end of the season. Then the cost of the damage is the loss of revenue, C =P f d
Jo
D{t)dt.
(3.60)
Crop destruction increases wit h the number of pests. The simplest hypoth› esis consistent wit h thi s observation is that D{t) = bxit),
(3.61)
3.6
Ho w Muc h Pesticid e Shoul d a Cro p Growe r Use an d When ?
113
where b is a constant. Hence, on using ( 3 . 5 9 H 3 . 6 1 ), the loss L = C + is given by s
As, U) = c + U 0
+ pb ί x{t)dt, Jo
Cl
U < £/
0<s
m a x
,
Q
(3.62)
where U is the maximum concentration allowed by law. On using ( 3 . 5 4 )(3.58) we obtain (Exercise 3.10): mM
As, U) = c + U 0
+ ^
<
Γ
^ -
1
(x(0) +
+ pb
Cl
(x(0) + I )
{S(U)
I)
e * + | ( 1 - S(U))}
-
, (3.63)
0<s
I f « = 0 then there is no fixed cost (C = 0) and the total cost is simply Q , the cost of damage to the crop. Hence s
As, 0) = pb £
(x(0) + £ ) - £ } ;
x{t)dt = pb{
(3.64)
naturally , thi s quantit y is independent of s. Now, the pesticide has no effect i f 0 < U < U , and so the grower wil l either apply no pesticide (wit h cost (3.64)) or apply pesticide at tim e s* wit h concentration U*, where {s*, U*) denotes the point in the "rectangle" 0 < i < T,U < U < U where As, U) is least. Th e grower wil l adopt the second strategy only if 0
0
max
(3.65)
As\U*)
Findin g the minimu m of (3.63) in the given rectangle is a calculus problem (Exercise 3.11). Combinin g it s results wit h the remark s above, we find that if the grower sprays, then the optimal spraying tim e is given by if Q < Qc, s* = {
1
T
1 , _¸
, RMQ)\
1 + ^ αJ
ˆ
,
_ .
irq>g ,
(3.66)
c
where
Ther e is therefore a critica l immigratio n rate, q , below which the native population so dominates the immigran t one that the optimal strategy is t o eradicate as much as possible of the native population at the very beginning of the season. Above the critica l rate, the effect of the immigrant s is strong enough t o delay the optimal spraying time, but never by more than half th e length of the growing season. c
114
Chapte r 3 Optima l Contro l and Utilit y
Stating the optimal concentration is somewhat easier if we first define the (continuous) function
m
s
{
^rm^ -^
-
m
p
b
(3 68)
The quantity ˜ is best regarded as an alternative measure of the cost of damage that would occur if no pesticide were applied. Indeed it agrees wit h (3.64) if q = 0. The grower should not spray at all if (3.65) is violated, i.e., if W > 0, where A(q)) + In ( ^ ^ )
W(q) =U +-{C 0
0
+ 1;
(3.69)
but if (3.65) is satisfied, i.e., if W{q) < 0,
(3.70)
then the optimal concentration is
« V c, J
c,
(3.71)
Note in particular that the grower should not spray if Ƙ/c, < 1, for which there is a simple economic interpretation . Recall from Exercise 1.13 that Æis the fraction of insects killed by a unit increase in concentration. Thus a A is the fraction of the uncontrolled damage avoided by the unit increase. The cost of the unit increase is c,, and so it is clearly uneconomic t o spray unless c, < Æ ˜. Do (3.66) and (3.71) correspond to what growers actually do? We’ll retur n to that question in Chapter 4. For now, observe that the utilit y function (negative of the loss function) for the problem we have solved may be writte n /<«)=
(3.72)
fg(x(t),u(t),t)dt,
Jo
where g{x(t),u{t),t)
= g{x{t),s,
U) = -pbx{t)-
C
+
C | C / r
.
(3.73)
(Note that g does not depend upon / explicitly here th e dependence on s is part of the dependence on », not on t but it does in Section 3.7 below; see (3.80).) The form of utilit y appearing in (3.72) is extremely
3.7
Ho w Many Boat s In a Fishin g Fleet Shoul d Be Operational ?
115
common, so c o m m on that we give x(t) a name: we call it the state of the system at tim e t. Th e state of the system for the crop-spraying problem was th e magnitude of the insect population. Convince yourself that J really is just a function of u. It appears at first that / should depend on x, but observe fro m (3.54)-(3.58) that x(t) is completely determined once (3.52) is specified. I n other words, x(t) is a function of u(t). Then why do we bother t o record explicitl y the dependence of / upon x? Th e answer is that the dependence of x{t) upon u(l) may be known only implicitly . For example, χ may depend upon u by being constrained to satisfy a differentia l equation; and very few differentia l equations can be solved explicitly , as we have already discovered in Chapter 1. Th e followin g example should help to clarif y thi s point (even though we are going t o ensure that th e differentia l equation is solvable in thi s particula r case by arguing that the set of potentially optimal controls is a very limite d one).
3.7
How Many Boat s in a Fishin g Fleet Shoul d Be Operational ?
Consider a vast expanse of ocean roamed by a species of edible fish, and let x(t) denote the magnitude of its population at tim e t. Suppose that all vessels that fish in thi s territor y belong to a single owner, who pays the wages of all the fishermen. Let u(t) be the number of boats at sea at tim e t, w a fisherman’s average wage (per unit of time), c the overhead cost per boat (per unit of time), and η the number of crew per boat, assumed the same for each vessel. To fix ideas, you might lik e to imagine that the sole owner is a communist government; though, as we shall see in due course, the model of thi s section is also applicable to a capitalist economy. At any rate, the question we pose is this: how many boats should be operational at any given time? Assume that the owner is a profi t maximizer. Let ρ denote the selling pric e per unit offish. Let hit) denote the harvest rate, i.e., the amount offish caught per unit of time. Then the owner’s revenue per unit of tim e is ph{t), and the owner’s costs per unit of tim e are c u(t) + wnu{t) = cu(t), where B
B
c = c + nw B
(3.74)
i s the owner’s cost per boat. Then, at tim e /, the owner’s rat e of profi t is apparently P(u(t)) =
ph(t)-cu(t).
(3.75)
A s explained in Section 3.4, however, the tru e profi t rat e at tim e t fro m now, when viewed fro m the present moment and in the light of alternativ e investment possibilities, is e- (ph(t)-cu(t)), (t
(3.76)
116
Chapte r 3
Optima l Contro l and Utilit y
where δ is the interest rate. We shall take it for granted that 6 is the real interest rate, as defined in Section 3.4, and that p , w, and c are constant (in real terms). Then, wit h u(t) boats operational at tim e /, the owner’s tru e retur n from now until eternity is B
(3.77)
e- '(ph(t)-cu(t))dt. 6
.70 /o
By fixin g the upper integration limi t at eternity, we assume that the owner is very far-sighted. We also make the mathematics easier. Now suppose that the fish are preyed upon solely by the human species, so that we may regard each vessel as a predator; then the number of active predators is u(t). From Exercise 1.15, it is thus fair to assume that (3.78)
h{t) = qu{t)x{t)
and that the growth and decay of the fish population is governed by ^
= ¸ ( )( -^)-¸( )
.
(3.79)
In the scientific literature , the constant q is known as the catchability, and fro m Section 1.9, we interpret R as the maximum specific growth rate in the absence of harvesting and Κ as the capacity of the expanse of ocean. On substituting (3.78) int o (3.77) and (3.79), the owner’s control problem is to find u(f),
0 < t < oo,
which maximizes mi))
f°°
= / Jo
e-"iKt)
{pqxit) - c) dt
(3.80)
subject to the differential equation constraint
% (ΐ-ψ-ψ). = Μ)
(3.81)
Notice that (3.80) is the special case of (3.72) for which g(x(t),u(t),t) e- u{t) Sl
{pqxit)
=
-c).
To make this control problem tractable, we will further assume that the owner has a special reason for wanting to solve it; namely, that the number of fish has dropped to such a low level that the species might even be in danger of extinction. To be specific, suppose it is somehow known that xiO)=%f,
(3.82)
where Ν is large. The cause of thi s is quite clear to the owner: the number of boats in operation, u(0) an d hence the level of predation i s too high. The owner’s vast experience suggests that the best thing to do would be to recall the entire fleet for s units of time, so that the fish have a chance to
3.7
Ho w Many Boat s In a Fishin g Fleet Shoul d Be Operational ?
117
recuperate, and then maintain th e fleet forevermore at th e constant level U (< u(0)), in such a way that the fish population remains in equilibrium . I n other words, it is being assumed that th e optimal control is of the for m u{i) =
f 0, ’ ( U,
if 0 < t < s; ~ tf s < t < oo;
(3.83)
where j and U are t o be determined. Under these assumptions, it follows fro m Exercises 1.10 and 1.15 that (Exercise 3.12) , l + (N -l)e-«" / mk *W= < K
i
f
* ' * *
0
(3-84)
i f s < t < oo.
Th e population varies continuously; therefore lettin g / tend t o s gives = 1- Ά > R
1
l + (N-l)e-
Rs
0).
(3.85)
Thu s s is a function of U, defined implicitl y by (3.85) and explicitl y by «ˆ7 ) ^1 {(¸ -1)(`_,)} =
W e are therefore entitled t o writ e J(u(t)) i n (3.80),
.
(3.86)
= f(U) where, on using (3.83)
^ -ψ-β-^{ΐ-^-ο}, Ρ
Λυ)
(3.87)
and where
is a dimensionless parameter (Exercise 3.15), which is best regarded as a lower bound on the cost/price rati o of a fishing vessel (being th e cost/price rati o that would take effect if the fish population could be maintained artificiall y at it s capacity Κ despite the harvesting). Clearly b < 1; if not, the owner would do better t o abandon fishing in favor of s o me more profitabl e enterprise. Mor e precisely, th e owner wil l abandon fishing unless f(U) > 0 or 1 - b > UqIR. It’ s a simple matter of th e calculus (Exercise 3.13) t o show that the maximum of (3.87) on th e interval 0 < U < R(l - b)lq occurs at U - (/*, where U' = ^ { i ~ b
+
^ -
x
l [ l
+
b -
R
^ j \ ^ -
Th e optimal recovery tim e s* = s{U*) is given by (3.86).
.
(3.89)
118
Chapte r 3
Optima l Contro l and Utilit y
What is the significance of (3.89) fro m the economic viewpoint? Th e fact that U* is the optimal number of operational boats means that U* - 1 / 2 i s too few, and U* + 1/2 too many. Note that, in our context, it is perfectly legitimat e to have half a boat, because we were careful enough t o define u(t) as the number of boats operational at tim e /. Thu s a boat that spends half it s tim e at sea and half in port would count as an operational halfboat, and similarl y for other fractions. Were thi s not the case, we should hardl y be justifie d in using a noninteger control function. Let us therefore consider what the effect would be of increasing U fro m U - U* - 111 t o U = Ό* + 1/2. I n th e short term, harvesting would begin sooner, because s'{U) < 0, as you can see directl y fro m (3.86). Thu s th e owner’s profi t would be increased by s{U'
r
-1/2)
/
Js(u- + \n)
(3.90)
P(u{t))dt,
where Ρ is defined by (3.75). Thi s expression is approximately equal t o P{U'){s{U*
- \/l)-s[U*
+ 1/2)} « -P{U*)s’((/*).
(3.91)
On the other hand, because straightforwar d algebraic manipulation reveals that P'(U') < 0 (remember that b < 1), the additional boat has the longter m effect of reducing the profi t rat e by P{U* - 1/2) - P(U'
+ 1/2) « -P\W).
Thu s th e tru e wort h of the long-term loss of profi t is approximately
- Γ e- P\U*)dt 6t
Jo
=
-il^l. °
(3.92) 5
(3.93)
But by differentiatin g (3.87) wit h respect t o U we obtain /’(£/) =
- P(t/)i’(t/) j .
(3.94)
Thus, because f'(U*) = 0, we learn that U' is the optimal number of operational boats because the short-term gain fro m slightly increasing that number would be exactly cancelled by the long-term loss, in much the same way as you stop eating candy when the short-term gain in pleasure of taste in the mouth is exactly cancelled by the long-term loss in pleasure of lookin g at your figure in the mirror . Argument s akin t o the one we have just used are very popular wit h economists. They provid e what is known as a marginal interpretation . Th e importanc e of these arguments stems fro m the fact that most people make See Supplementary Note 3.2.
Exercise s
119
decisions by balancing pros against cons, rather than by consciously max› imizin g some utilit y function. Thus, even though the results are equiva› lent, the marginal derivation may come closer t o mimickin g what people actually do than the maximization of J{u). I n particular , there is an im› portan t marginal interpretatio n of equation (3.40) of Section 3.4 (see Exer› cise 3.14). There is also an alternativ e marginal interpretatio n of (3.89) in term s of the stock level, rather than the number of boats (Exercise 3.17). How good is our model woul d fishermen use it? One technical mat› ter can be disposed of immediately. We assumed above that the optimal control function that maximizes (3.80) subject to the constraint (3.81) and initia l condition (3.82) has the for m (3.83). How do we know that thi s is true? The answer is that more advanced mathematics (see Clark , 1990, Chapter 2) can be used to show, without assuming (3.83), that the solution of the optimal control problem (3.80) (3.81 ) is u(t)=
U, N
= IT,
if 0 < t<
s,
ifi
(3.95)
where U* is defined by (3.89), s is defined as the soonest tim e for which x(s) = U* when s is governed by (3.81) and (3.82), and U is defined by N
0,
if,V>( l
U ={
R
N
C/
max
’
,
(3.96)
ifjv <
denotes the maximum Her e Ν is simply K/x(Q), as in (3.82), and C / number of boats that can be made operational. Thu s the correctness of our (mathematical) assumption is assured by the fact that Ν is large. But th e question remains ho w good is thi s model? We’ve asked thi s question so many times that we really ought to pro› vid e some answers! Whic h bring s us nicely t o Chapter 4. max
Exercise s 3.1 Verif y (3.6) and (3.7). *3.2 In Section 3.2, suppose that at least one faculty member had a factor clas› sification of weak or inadequate. Would still be a 3 3 matrix ? Why or why not? Don’t jum p to an apparently obvious conclusion i t may be a wrong one! 3.3 Obtain (3.14).
120
Chapte r 3
Optima l Contro l and Utilit y
3.4 (i) Verif y that (A ) and e {\) in (3.23) satisfy e^A ) > e (\). (ii ) Verif y that (3.25) satisfies Œ , > 0 for = 1,2,3. (iii ) Verif y that (3.24) and (3.25) satisfy all other constraints. (iv) By using a linear programming package such as the IMSL routin e ZX3L P to solve (3.19) for various values of e and A, demonstrate the validit y of the optimal control policy implied by (3.24) and (3.25). A rigorous proof of its validit y would requir e the theory of linear programming. fl/
L
L
"3. 5 (i) Suppose the chairperson of the Mathematics Department in Section 3.2 considered that the faculty’s research effort was about right but wished to en› courage more devotion to teaching. What would be the chairperson’s prob› lem in these circumstances? Use a package such as ZX3L P to find the optimal controls for various values of e and A. Can you conjecture a more general formul a for the optimal policy, corresponding to (3.23)-(3.25)? (ii ) Suppose the chairperson felt his department’s problem was that too much effort was devoted to service and wished to discourage this. What would be the chairperson’s problem in these circumstances? Use a package such as ZX3L P to find the optimal controls for various values of t and A. Can you conjecture a more general formul a for the optimal policy, corresponding to (3.23M3.25)? (iii ) Do you think that a fairer policy would be obtained if the minimu m salary constraint (3.16) were eliminated? Why or why not? *3.6 What constraint have we overlooked in Section 3.3? Modif y (3.28) accord› ingly. 3.7 (i) Verif y (3.40), (3.41), (3.43), and (3.44). Show that (3.41) is satisfied when KO is given by (3.42). (ii ) Verif y that the form of (3.40) would be unchanged if we worked instead wit h nominal value and interest rate. 3.8 Using the shift technique of Chapter 2, show that the optimal forest rotation tim e (3.44) is a decreasing function of interest rate. Verif y this graphically. The significance of this will be discussed in Chapter 4. *3.9 The following net stumpage values, i.e., values of HO = ρΝξ(ί) - c, for a "typical " stand of Britis h Columbia Douglas fir trees are quoted by Clark (1976, p. 261) as due to P. Pearse; t is measured in years, Fi n dollars.
t
no
30 0 40 43 50 143 60 303
t
W)
70 497 80 650 90 805
t
m
100 913 no 1000 120 1075
Exercise s
121
(i) Plot ˚ against t. What do your results tell you about an assumption we made in Section 3.4? (ii ) Using a method suggeste d by Section 1.9, estimate V[t) and V'{t) for t = 3 5 , 4 5 , . . .1 , 15. (iii ) Plot θ against t, where θ is defined by
Use your graph to estimate the optimal rotation tim e for Douglas fir trees, according to the model of Section 3.4, when the real interest rate is 6 = 0.05. 3.10 Obtain the expression (3.63). 3.11 Obtain the minimu m of (3.63) on the open rectangle t / . Hence verify (3.66) and (3.71).
0<S
m a x
3.12 Verif y (3.84). 3.13 Show that the maximum of (3.87) on the interval 0 < U < R{i - b)lq occurs at (3.89). *3.14 In this exercise, you will attempt to provide a marginal interpretatio n of equation (3.40). (i) A forester cuts his forest at time t = s and immediately invests the pro› ceeds (real value VYj) ) in a bank. What is his gain after one unit of time if the real interest rate is 61 (ii ) Assuming that 6 is small, writ e down a first approximation to the expres› sion you obtained in (i). (iii ) What additional proceeds would the forester have accrued durin g the interval from / = J to r = + 1 if he had not cut his forest at t = si (iv) Writ e down a first approximation to the expression you obtained in (iii) . (v) Hence show that the optimal cutting time, according to the model of Section 3.4, is when the incremental loss from failin g to let the trees grow a littl e longer is exactly balanced by the incremental gain from alternative investment. 3.15 What are the dimensions of catchability? Verif y that the constant b defined by (3.88) is dimensionless. *3.16 If 8 = 0, so that the possibility of alternative investment does not arise, then the integral (3.77) does not converge. In these circumstances, we would expect the owner to maximize the profi t rate P(u(t)) - {pqx(t) - c) u{t). Throughout this problem, assume that the fish population is maintained in a static equilibriu m x(U) by using a constant number U of operational
122
Chapte r 3
Optima l Contro l and Utilit y
boats. Thus the profi t rate is P(U) = U {pqx{U) - c], and the harvest rate is qUx{U). Call P(U) the sustained profit rate and qUx{U) the sustained yield. (i) What is the optimal value of Ul (ii ) What is then the equilibriu m population? (iii ) Suppose that, for political reasons, it became expedient to maximize the sustained yield instead of the sustained profi t rate. What would then be the optimal value of C/? (iv) What would then be the equilibriu m population? (v) If you were concerned about the preservation of the species of fish, which objective would you prefer, maximization of sustained profi t or maximiza› tion of sustained yield? (vi) Now suppose that 8 φ 0. There are still two possible objectives, maxi› mization of profi t (from now until eternity) and maximization of sustained yield. Show that the objective that is more conducive to preserving the species of fish is now determined by the relative magnitudes of b and 6/R. (vii ) Suppose that a government is concerned about preserving the species but has no control over the interest rate that is used to determine the optimal fishing strategy. What should it do? *3.17 (i) In any fishing equilibrium , whether optimal or not, the fish population is related to the number of boats by χ = X = K( 1 - qlllR). Hence the optimal control problem of Section 3.7 could have been formulated with X, not U, as the independent variable. Obtain the expression φ(Χ) that then replaces (3.87) and show that it has a maximum at X = X' where (a) (ii ) Show that the cost of harvesting a unit of fish is clqx when the population is x. (iii ) Hence provide a marginal interpretatio n for Eq. (a) Hint: Writ e the optimall y condition in the form
and find an expression for the sustained profit rate as a function of X.
*3.18 A dealer has an approximately constant daily demand for one of his prod› ucts, of which he sells quantity Q per year. He orders the product from a manufacturer in batches of size u, and he wishes to determine the batch size u* that will minimiz e his costs. These costs arise from two sources, a set-up cost of C) per order and a storage cost of c per unit stock per year. (i) Show that the average stock held between orders is u/2. (ii ) Deduce the total yearly cost. (iii ) Find u* and show that the minimu m total cost is y ’ 2 Q c c . 2
1
2
Supplementar y Note s
123
Hint: Make lif e easy for yourself by assuming that the last item is sold around closing tim e one day and that the new consignment arrives before opening tim e the following day. Note: This model is not especially useful because products for which costs arise principall y from these two sources are unlikely to have such a regular demand. Probabilistic models for optimal ordering strategies are introduced in Chapter 7.
Supplementar y Note s 3.1 Although the crude definition (3.32) will be adequate for the purposes of this section, it is possible to proceed more rigorously. Let us define the function D by fO D{1 - s;e) = {
if - j < - |
if
0
(
ΐ
i f - > < f - i < »
0
ifi-j> i
2
=
2
<
-
J
^ s - - < t < s + 2 2
-
(
if
Then D(t-s;c) = 0 unless -til
0
provided that the limi t exists. Strictly , the limi t does not exist as an ordinar y function, but mathematicians have been able to construct a meaningful calculus of so called generalized functions, according to which δ exists as the Dirac delta function, which has the property that 6(x) = 0
ifx/O,
6(x)dx=l.
/ J — CO
For an alternative approach to the Dira c delta function, see Section 11.5. 3.2 The lower limi t of integration on the left-hand side of (3.93) is the time at which harvesting begins. It is legitimate to call it t = 0 because (3.90) has not been discounted to the present. If you insist on calling t = 0 the present time, then the present value of the long-term loss of profit is approximately 'P'(U')dt=-
*
(U
,
JsW)
and the present value of the owner’s short-term gain is e " When the two are equated, of course, the factor e' cancels out. 6s{U
6s{ir)
>
times (3.91).
VALIDATIN G A MODEL
This page intentionally left blank
— VALIDATION : ACCEPT, IMPROVE, OR REJEC T
4
It’ s a fundamental tenet of the philosophy of science that the trut h of a model can never be proved; only disproved. Thu s validatin g a model means proposing a test that the model, if false, would fail to pass. I f a model does fail such a test, then we are bound t o reject it . I f it passes, however, then we propose a more stringent test; if it passes that one, too, then we propose still another one; and so on, unti l . .. when? When do we stop? I n theory, we could go on forever. Indeed, broadly speaking, the received wisdom of science consists of mathematical models for which no one has yet invented a test that results in failure . I n practice, however, there i s always an element of subjectivity about the decision to stop testing. A s we’ll see in the examples, it depends upon the purpose for which the model was constructed. For the tim e being, let’s simply say that we wil l accept a model if it explains all the facts that we would lik e it t o explain. Otherwise, we wil l reject it ; or else improv e it , then test it again. Later , when we come t o discuss the difference between descriptive models and prescriptiv e ones, we wil l have t o enlarge upon thi s simple philosophy, but by then we wil l be better prepared t o appreciate the enlargement.
4.1
A Mode l of U.S. Populatio n Growt h
We have seen the cycle of validation at work already, in Section 1.9.’ There, we proposed x(t) = 3.9e - ’ as a model for the magnitude of the U.S. pop› ulation , on the strength of supporting data for the years 1790 to 1840. We invented a test for thi s model, namely, that it should predict the population levels recorded in later years. It failed thi s test miserably; so we rejected the model and proposed another one, namely, (1.58), in which x(t) = 3.9e°- ' 3
3
You may wish to review Section 1.9 before proceeding. 127
128
Chapte r 4
Validation : Accept , Improve , or Rejec t
for 0 < t < 6.5 but x(t) = 31 - ’- for / > 6.5. Thi s provided an ac› ceptable description of U.S. population growth for about a century, fro m 1790 unti l 1890, but still failed adequately t o estimate the magnitude of th e twentieth century U.S. population. So we rejected thi s model, too, and proposed yet another one, namely, 24(
*
t
)
7)
198 t + 49,4^o.
=
3 l <
•
Thi s provided an acceptable description of U.S. population growth un› ti l the middl e of the twentieth century; but it failed another test, for it could not predict the 1960 and 1970 population levels. Therefore, in Ex› ercise 1.11, we improved the model to take account of the postwar popu› latio n surge. A possible improved model is 198 i f t< 15.5; 1 + 4 9 . 4 - " . .• 373 <- ) i f f > 15.5. 1 + 1.48e- - (’- )’ Thi s provides an acceptable description of the U.S. population growth fro m 1790 onward, one that is correct t o at least one, mostly two, and occasion› ally three significant figures. Accordin g to the 1991 Britannica Yearbook, the U.S. population was 251.4 millio n in 1990, i.e., to two significant figures, x(20) = 250. Thi s agrees wit h the prediction of the model (4.2). If , therefore, we requir e only a rough description of U.S. population growth throughout the history of the nation, then the model (4.2) should be accepted. Thi s does not mean that it s prediction (to two significant figures) of 270 millio n people for the tur n of the century is bound to be true; it simply means that we cannot prove it to be false. We’ll just have to wait and see. Th e model is certainly useful, even if we just regard it as a simplifi › cation of the actual data. But the real value of a model is often it s abilit y t o generate hypotheses. I f (4.2) is true, and i f the conceptual derivation of (1.62) is true, then there was a sudden jum p around 1945 in the capacity of th e land o r at least a j u m p in the general perception of what that capac› it y might be. D i d the capacity suddenly j u m p fro m 2 00 millio n to almost twic e that much? I f so, why did thi s happen wa s it due t o improvements i n technology, or was it simply due to postwar euphoria? These are ques› tion s you might lik e to discuss. For now, simply observe that an hypothesis emerges wit h greater impact when suggested by a mathematical model. 4
28
4.2
2
16
Cleanin g Lak e Ontari o
Accordin g to the model of Section 1.1, if all pollutio n input to a lake of volume V suddenly ceases and if water flows out at rat e r, then the existing pollutio n wil l take i . 5 « 3 Vlr unit s of tim e t o decay to 5% of 0
0
4.3
Plan t Growt h
129
it s current level. According t o Rainey (1967, p. 1242), V = 1636 10 cubic meters for Lak e Ontari o and r = 5 7 2 , 5 6 2 , 4 32 cubic meters per day, so that f .05 « 8572 days or 23.5 years. Can we accept thi s figure as the cleaning tim e for Lak e Ontario ? A s stated at the beginning of thi s chapter, all we can do is attempt to re› ject it . This, as it happens, is a simple matter, for the prediction f « 23.5 i s based on the assumption that all pollutio n inflo w t o Ontari o has ceased. But the water outflow fro m Lak e Eri e is known t o constitute five-sixths of the water inflo w t o Lak e Ontario . Thus, even if pollutio n has ceased t o enter the Great Lakes as a whole, pollutio n fro m Eri e wil l continue to flow int o Ontario . I n these circumstances, we would expect the 5% cleaning tim e for Lak e Ontari o t o be considerably longer than 23.5 years and to be an increasing function of th e current pollutio n level for Lak e Erie. These expectations can be confirmed by an improved model, which relaxes the assumption of zero pollutio n input . We develop thi s model in Section 9.3. For now, simply observe that the model of Section 1.1 has failed a test (the validit y of one of it s basic assumptions) and must therefore be rejected. 2
9
0
0 05
4.3
Plan t Growt h
I t is sometimes necessary t o generate a whole chain of predictions before arrivin g at one that can be tested. Even when thi s is not absolutely nec› essary, it is often still convenient. Consider, for example, the plant growth model of Section 1.3. Thi s predicts the 5-shaped logistic growth curve of Fig. 1.1. I n Section 3.4 we adapted thi s model t o predict that the growth curv e ξ = ξ(ί) of an individua l tree in a forest would also be S-shaped. I t wouldn’t be difficul t to compare thi s shape wit h those of tree growth curves that have actually been observed. But suppose that such data were not readily available woul d that mean that the model could not be tested? Th e answer is no for, as we saw in Section 3.4, the assumption that ξ - ξ(ί) is 5-shaped leads t o the furthe r prediction that the real value V\t) = Νρξ(ή-ο of a forest wil l grow according t o a curve lik e that depicted i n Fig. 3.4; and perhaps the shape of thi s curve can be tested more easily. Th e graph in Fig. 4.1 depicts the actual growth of net stumpage value for a typical stand of Douglas fir trees in Britis h Columbia. It is based on data given in Exercise 3.9 and ought to remind you of Fig. 3.4. As it happens, th e dashed curve in Fig. 4.1 is identical t o th e solid curve in Fig. 3.4. I n other words, Fig. 3.4 is just Fig. 4.1 wit h the coordinate scales removed. Thus, although we did not have the data to test it directly , the assumption that individua l trees grow according t o ξ = ξ(ή has led t o a prediction that is not inconsistent wit h actual data for stumpage value. We have proposed 3
2 3
You may wish to review Section l.l before proceeding. You may wish to review Sections 1.3 and 3.4 before proceeding.
130
Chapte r 4
Validation : Accept , Improve , or Rejec t
ν 1000 4 4 9
4
4 500
4
60
0
90
120
Fig. 4.1 Net stumpage values for a Britis h Columbia Douglas fir. The dots denote Pearse’s data points, quoted by Clark (1976, p. 261) and in Exercise 3.9. a test, and the logistic growth model for trees has passed. We have therefore no reason t o reject the model. But thi s doesn’t mean, of course, that we won’t be forced t o reject it later on other grounds; and we note that many other form s of the function £(r) might also have led t o a stumpage value curv e lik e that in Fig. 4.1.
4.4
Th e Spee d of a Boa t
I n Sections 1.12 and 2.2, we constructed a dynamic model of the approach t o equilibriu m of a rowin g b o a t . Th e equilibriu m speed of the boat was 4
(4.3) where 5 denotes wetted surface area, Ρ denotes the effective power sup› plied by an oarswoman, and b is a constant. I n thi s section, we wil l test thi s model by comparing th e course times it predicts for tw o different crews, a lightweight one and a heavyweight one, in a race of length d. Now, in Exercise 1.19, we found that the rapidit y wit h which the boat approached it s equilibriu m speed depended upon th e dimensionless pa› rameter
"
s
m a -
->
(4 4
where Μ is th e mass of th e boat (plus crew). By setting u = 0.99 Vin (1.78), for example, we find that th e boat is withi n 1% of it s equilibriu m speed You may wish to review Sections 1.12 and 2.2 before proceeding.
4.4
The Speed of a Boat
131
after a tim e iA95qd/V. Because the course tim e would be dlVi[ the crew rowed the entir e race at speed V, the results of that exercise show that, provided q is sufficiently small, it wil l be a good approximatio n t o assume that the boat is in equilibriu m throughout the entir e race. Whether q is small or not wil l depend on the values of the parameters M, S, d, and b. Th e first three of these are either known or easily measured, but a value for b is more difficul t t o supply. Therefore, we are simply going t o assume that a rowin g boat reaches equilibriu m after a small fractio n of the course tim e has elapsed, on the grounds that thi s is what seems t o happen whenever we watch a boat race. Indeed the best way t o estimate the parameter b might well be to determine how long a boat takes t o reach, say, 99% of equilibriu m speed, deduce the value of q, and hence deduce the value of b. Let t , t denote, respectively, the course times of a lightweight crew and a heavyweight one. Let V and V denote the speeds at which they row. Havin g made the assumption that q is small, and if our model is correct, then it is at least approximately tru e that t = dlV and t = dlV ; whence t lt = V IV . Using S to denote the wetted surface area of the lightweight boat, P the effective power supplied by a lightweight oarswoman throughout the race, and S , P t o denote the corresponding quantitie s for a heavyweight crew, we deduce fro m (4.3) that L
H
L
H
L
H
H
L
L
H
L
H
L
L
H
H
(4.5) Now, according t o M c M a h o n (1971, p. 350), the course tim e of a heavy› weight crew is about 5% faster than that for a lightweight one. I f our model i s correct, then the quantit y on the right-han d side of (4.5) should have a value of about 0.95. We thus have a testable prediction. (McMahon’ s data was obtained for male crews, and here we consider a female crew; but that wil l not alter the substance of what is t o follow.) Before we can actually test our prediction, however, we requir e a value for PJP . Now, we do not have values for P and P . But M c M a h o n does tell us that the average weight of a heavyweight crew member is about 86 kilograms, and that of a lightweight crew member about 73 kilograms. Let us therefore make the additional assumption that H
L
H
EFFECTIVE POWER IS PROPORTIONAL T O WEIGHT.
(4.6)
Thu s an oarswoman who is 100a% heavier than another oarswoman wil l supply 1 + a times as much effective power. N ow PJP = 73/86. We also do not have values for S and S . Let us define H
L
H
(4.7) Th e heavyweight boat wil l certainly have a greater wetted surface area than the lightweight one, because extra weight wil l lower the boat. I f the
132
Chapte r 4 Validation : Accept , Improve , o r Rejec t
heavyweight boat is larger than th e lightweight one, however, then it wil l also displace a greater volume of water; and the additional upthrust wil l counterbalance th e additional weight, so that S , though greater than S , wil l not exceed it by very much. Thi s argument suggests that º , though less than 1, is also close t o 1, and experiment confirm s this. On using ( 4 . 5 )(4.7), our model predicts that H
ώ
/ 2 ! ˝ ’ *
L
0 9 4 6 8
=
(
4
8
)
Thus, as long as th e value of º is between about 0.975 and 1, th e value our model predicts for t lt wil l be 0.95 t o tw o significant figures. We have therefor e no reason t o reject our model; it has passed th e test we proposed for it . Notice, however, that, had it failed, we would have been left t o decide by other means whether th e fault lay wit h th e assumptions inherent i n Sections 1.12 and 2.2 or wit h th e additional assumption contained i n (4.6). H
L
4.5 Th e Exten t of Bir d Migratio n I n Section 3.1 we constructed a mathematical model that predicts that bird s wil l migrat e a distance ._ 2 η Ε 3(2bSg v}y»m™' 2
where Ε denotes energy stored for th e flight and m th e mass of the bird , g denotes acceleration due t o gravity , η denotes efficiency at converting fat int o mechanical energy, ,• denotes induced velocity, S denotes surface area facing th e wind, and M s a drag constant. Th e constant g i s certainly th e same for all birds. Moreover, it seems reasonable t o assume that ,•, b, and S are also the same for all birds, at least for bird s of similar species. Then, i f subscript ˘ denotes species Z , our model predicts that 5
d
z
= C-h , m
(4.10)
n
z
where d is th e distance travelled by a member of that species, wit h initia l energy E and mass m \ and where C is independent of Z . Thi s is a testable prediction. Accordin g t o Tucker (1971, p. 122), a hummingbir d (species H) of mass around 5 1 0 " kg flies 500 miles across th e Gul f of Mexico; a Blackpoll warbler (species B) of mass about 20 1 0 " kg flies 800 miles fro m N ew England t o Bermuda; and a golden plover (species G) of mass around 0.2 kg flies 2400 miles fro m the Aleutian t o th e Hawaiian islands. z
z
z
3
3
5
You may wish to review Section 3.1 before proceeding.
4.5
Th e Exten t of Bir d Migratio n
133
Hence d ld = 800/500 = 1.6, m lm = 20/5 = 4, d ld = 2 4 0 0 / 8 00 = 3, and m lm = 0.2/(20 1 0 ) = 10. Let’ s use thi s data t o test our model. Fro m (4.10), our model predicts that B
H
B
H
G
B
- 3
G
B
dfi
\
*-H
m
B J
We have values for d ld and m lm but not for E IE . Let’ s therefore make the additional assumption that stored fat is proportiona l t o weight. Because weight = mg, fro m (1.74), and because g is the same for all birds, our additional assumption is entirely equivalent t o B
H
B
H
B
H
(4.12)
Ε is proportional to m.
Thu s a bir d that is a times heavier than another bir d wil l store a times as much energy as fat. N ow our model predicts that E IE = m lm and hence, on using (4.11), that B
H
B
H
1/3
(4.13) d \™H) Accordin g to our data, the left-hand side of (4.13) is 1.6 and the right-han d = 1.587. Thi s agreement is as good as we could wish for. On the side is 4 other hand, when we use (4.10), our model also predicts that H
1 / 3
da _
("*α\ (4.14) d \™B) but our data do not support thi s prediction, because the cube root of 10 is about 2.15 and certainly not 3. A test of our model has resulted in failure . Whic h of the assumptions responsible for it is false? Zoologists seem t o be quit e content wit h (4.12). Indeed Tucker (1971, p. 119) says that 25% of body mass is a reasonable estimate of the amount of fat that bird s reserve as fuel for long flights. The problem therefore appears t o rest wit h the assumptions we made in Section 3.1. Because 2.15 < 3, a golden plover flies furthe r than the model predicts. I s there, then, an effect we ignored in Section 3.1 that makes a bir d int o a more efficient traveller ? There’s an obvious answer t o thi s question. We have neglected the effect of a followin g wind , and we must improv e our control model t o allow for this. B
Let w, the control, now be the speed of a bir d relative to the air, and let ˚ be the followin g wind. Then distance travelled in tim e St is 6z = (u+V)St.
(4.15)
Thi s result agrees wit h Section 3.1 when V= 0. From Section 1.12, resist› in g the drag force D for thi s distance requires mechanical energy D ( «+ V)St. Fro m aerodynamics, the drag on a bir d is proportiona l t o the surface area facing the win d and t o the square of it s velocity relative to the wind. Hence
134
Chapte r 4
Validation : Accept , Improve , or Rejec t
D = bSu , as in Section 3.1; but u has a different meaning now (which, however, coincides wit h that of Section 3.1 when V = 0). Th e mechani› cal energy required to resist the drag in moving distance 6z is therefore bSu (u+ V)St; of which bSu V6t is supplied by the win d and the remaining bSvPSt must be supplied by the bird . Th e induced power, or rat e at which mechanical energy must be supplied to keep the bir d airborne, remains unchanged. From (3.8), it’ s / = mgVj. Hence the rat e at which the bir d supplies energy, i.e., the effective power, must equal bSu* + rngv,-- Th e ef› fective power is simply times the rat e at which the bir d actually burn s up it s energy, and so we have 2
2
2
= bSu
3
+ mgVi,
(4.16)
where T=
-4— u+V
(4.17)
i s the flight time. The bir d still wishes t o maximize d\ therefore we deduce fro m (4.16) and (4.17) that it s optimal speed relativ e t o the air wil l be the value of u that maximizes
W.jgttBL.
(4.18)
Thi s expression agrees wit h (3.5) when V = 0. Th e mathematics of optimization wil l be simpler if we scale both the flight speed and the followin g wind wit h respect to the speed
that would be optimal if th e wind were zero; (4.19) is merely (3.9) wit h a subscript 0 added t o denote zero win d speed. Let ύ denote dimensionless flight speed (relativ e t o the wind) and e dimensionless wind; i.e., define (4.20) and f
Then we can replace (4.18) by
=
V . «5
(4.21)
4.S
Th e Exten t of Bir d Migratio n
135
I t is a simple exercise (Exercise 4.1) t o show that (4.22) has a maximum at « = it, where «*(e) is the only positive solution of th e equation u ( 2 t i + 3 e )= 2,
(4.23)
2
th e value of the maximum being./(u*(e)). N o te that e = 0 and «*(0) = 1 correspond to Section 3.1. Because (4.23) can be solved numerically (by th e N e w t o n - R a p h s on technique) for any value o f f , the graph of u*(e) is easily found and is sketched in Fig. 4.2, for 0 < e < 1. N o te that u*(e) < 1; i.e., a followin g win d reduces the optimal flight speed. Can you prov e thi s withou t solving (4.23) numerically? See Exercise 4.2. Th e fact that a Blackpoll warbler migrates four times as far as a hum› mingbir d has already been explained by our model. Let us therefore as› sume that no win d follows a hummingbir d or a Blackpoll warbler , but that a golden plover is followed by a (dimensionless) wind e . Then, assuming that (4.12) still holds but that d and d are given by our improved model, we deduce fro m (4.22) that G
G
dc _ (mg\ d
B
- \ m
B
1 / 3
Aieg) _
/ A(e ) G
\
˜ ( 0 ) " Η 0 . 4 6 4 2 )’
)
B
( 4
"
2 4 )
where we have defined u'(e) + 2 3
and used the facts that m lm G
B
= 10 and ˜ ( 0 ) = 1/3. See Exercise 4.3.
0.2 -
•
0
I
1
L -J
0.36
1
1
1
1
J
1
^
£
1.0
Fig. 4.2 Migratin g bird s travel slower (relative to the air) and further with a wind behind them. The diagram shows how the optimal airspeed and distance travelled vary with (dimensionless) wind speed.
136
Chapte r 4
Validation : Accept , Improve , o r Rejec t
Th e graph of ˜( ) is sketched in Fig. 4.2. Notice that ˜( ) > 1/3. Thi s i s the mathematical equivalent of saying that a bir d migrates further wit h a followin g wind. Th e function takes the value 0.4642 where e is about 0.36. Thus, because Œ * ( 0 . 3 6 )« 0.85, the model of thi s section would pass it s test if golden plovers were habituall y followed by a wind of just over 4 2% of their actual fligh t speed (relativ e to that wind). According to Tucker (1971, p. 122), small bird s have been observed to migrat e at 10 to 15 meters per second, wit h a tail wind of at least 5 meters per second; so that, at the very least, our model appears to be along the righ t lines. But does it actually pass it s test? To answer that question, you would have to acquire the wind-speed data. Perhaps thi s is a matter you would lik e to pursue. But if the data match the model’s prediction, it does not mean that the model is true; it means only that we have no good reason to doubt it s trut h and should therefore accept it, at least unti l we have adequate data for a more stringent test. And if the data do not match the model’s prediction, it does not necessarily mean that our model should be rejected completely; it may only mean that our model must be further improved to take account of spatial or temporal variation s of wind speed, or indeed any other factor. See, for example, Exercises 4.20 and 4.21.
4.6
Th e Spee d of Car s in a Tunne l
I n Section 2.3, we used the conceptual approach to derive a model for the speed, v(x) miles per hour, of cars through a tunnel when the traffi c density is χ cars per mile. The model we obtained was 6
(4.26) Her e x is the highest density at which driver s are free t o m o ve at the speed is the density that wil l just brin g traffi c t o a halt. limi t v , and x W e have already explained, in Chapter 2, how density is measured on an actual road. Data points obtained in thi s way fro m N ew York’ s Hollan d tunnel are depicted in Fig. 4.3. Thin k of the data point (JC, v) as recordin g the average value of all speeds observed when the density was measured and found t o be x. Th e dashed curve in the diagram is (4.26), about 55 m.p.h., x about 10 cars per mile, and x about 175 wit h v cars per mile. Observe that thi s curve fits the data quit e well in the range x< χ < x . (We do not have data for 0 < χ < x . Th e effect of thi s is considered toward the end of the section.) W e have raised the point, in Section 4.3, that a model may yield several successive generations of predictions, and that any of these may be tested. c
m a x
max
m a x
c
6
c
miX
mix
c
You may wish to review Sections 2.3 and 3.5 before proceeding.
4.6
Th e Spee d of Car s In a Tunne l
137
60 55
40
20
50
100
150
2 00
2 50
Fig. 4.3 Speed, m.p.h., versus traffi c density, χ cars per mile, for New York’ s Hol› land tunnel. The 32 data points were obtained from a sample of over 20,000 cars. The dashed curve is (4.26). The sketch is adapted by permission of the publisher from Prigogine and Herman, Kinetic Theory of Vehicular Traffic, p. 6. (Copyright 1971 by Elsevier Science Publishing Co., Inc.) I n Section 4.3, for example, a test was applied t o a second generation pre› diction , the growth in value of a forest. Viewed in thi s light , (4.26) is a first generation prediction, which, by virtu e of Fig. 4.3, has passed a first generation test. But the same model has already yielded, in Section 3.5, the second generation prediction that the optimal speed for cars through a tun› nel is v l n ( j c / x ) , the optimal flux being x /e = 0 . 3 6 8 x times that speed. We already know fro m Chapter 3 that these predictions are compat› ibl e wit h data fro m the Lincol n tunnel. Thu s the model has also passed a second generation test. Moreover, the fact that the model, as mentioned in Chapter 3, fail s t o mimi c realit y in the immediate aftermath of perturba › tions, due t o any sudden congestion, is of no concern t o us, because we can› not expect an equilibriu m model t o describe nonequilibriu m conditions! We therefore conclude that the model provides an acceptable description of equilibriu m traffi c flow, the purpose for which it was designed. For x < χ < x , the dashed curve in Fig. 4.3 is the curve of the for m (4.26) which best fits the data, in the sense of Section 8.4. It is found that m w
m ! l x
c
Xm
175
c
mM
m ax
max
and
. ln(x
m a x
, « 19, /x )
(4.27)
c
if x and the parameter on the left-hand side of (4.27) are the two pa› rameters that are varied, to give the dashed curve it s best fit property . I n view of (3.46) and (3.51), it is also found that the optimal speed for cars m
138
Chapte r 4
Validation : Accept , Improve , o r Rejec t
throug h New York’ s Holland tunnel is about 19 m.p.h.; see Prigogine and Herman (1971, p. 9). Because no data are available for 0 < χ < x , however, the appropri › and x cannot be determined accurately. Al l we know ate values of v is that they are constrained, so that (4.27) is satisfied and the horizontal section of the dashed curve lies above the leftmost data point; but withi n these constraints they are arbitrary . Thus the horizontal section of curve in Fig. 4.3 is purely speculative and should, perhaps, be lower. A s we have already seen in Chapter 3, however, thi s is a matter of minor importance when using the model to determine optimal flux. c
m M
4.7
c
Th e Stabilit y of Cars in a Tunne l
Sometimes, even without a conscious effort to compare your model wit h data, it wil l dawn on you that one of your predictions is somewhat du› bious. Improvements that emerge as the result of such doubts are the subject of thi s and the followin g section. I n Section 2.8 we developed a model for instabilit y of traffi c in a tun› nel. We found that for any given amplitud e of the initia l disturbance ˜ ther e is a critica l value, .(˜) , which driver response tim e must not exceed i f a platoon of cars is t o stay in equilibrium . We found, moreover, that dr /dA < 0 (see Fig. 2.12). Thi s pictur e is surely in qualitativ e agreement wit h everyone’s highway experience. But it seems that the retur n t o equi› libriu m in Fig. 2.10 is almost too smooth t o be true. I f thi s is right , then something is wrong wit h the assumptions that led t o Fig. 2.10; and hence wit h equation (1.81), i.e., 7
c
| ,•(0- ,--Ø(01
dt*
Recall that the car wit h index j is followin g the car wit h index j—l. Thu s th e equation says tw o things. First , if tw o cars are moving toward one another then the closer they are, th e harder th e second one brakes. Wit h thi s I agree. Second, if tw o cars are moving away fro m one another then th e furthe r away they are, the more gradually the second one accelerates. I suspect that thi s isn’t tru e (though the follower wil l certainly accelerate i f the leader is moving away). A possible improvement of (4.28) would be t o combine it wit h the model of Exercise 2.4 in th e followin g way: r;(i)-zj_,(t )
d Zj(t 2
+ T)
- |r/0-V,(0r A
- / Ø^ ω -
^ω},
You may wish to review Section 2.8 before proceeding.
. lf
f
,
/ x
,
/
v
4<’> > * / - . « ) ;
(4.29a)
ifzj (o
4.7
Th e Stabilit y of Car e In
Tunne l
139
where º and μ are constants. Thus, i f a gap between cars is closing, th e followin g driver responds both t o the size of the gap and th e rat e at which it i s closing; but if a gap between cars i s widening, then th e followin g driver responds only t o the rat e at which it is widening. Integrating , and choosing th e constants of integration so that th e equilibriu m solution of (4.29) wil l satisfy v ( x ) = 0, we find (verify ) that m a x
dzj(.t+r) —dF-
’ º In ( x =
<
μ
/
m a x
zj^it)
( z ,_ , (0 -
,( )) ) , Ø \
- z /O -
i f z'j(t) > zj _ ,(*);
,
i f zj(i ) < z;_,(i).
(4-30)
Because (4.29a) and (4.29b) must yield the same equilibriu m solution, we have
^ ( ^ « - " ( œ - œ •)
(4
-
31)
Assuming, as i n Section 2.8, that χ = x / e (the optimal density for max› i m u m traffi c flow) and denoting v ( x / e) simply by v, we determine th e constants ¸ and t o be m a x
m a x
º =
vx μ = - i a s f i, e l
,
(4.32)
where e = e x p ( l) = 2.718. On writin g z (f ) as th e sum of the equilibriu m displacement (,•(*)» given by (2.97), and a perturbatio n displacement φ ft), substitutin g int o (4.30), and using (4.32), we find (Exercise 4.4) that th e differential-delay equations for the perturbatio n displacements are ;
άφ, .
(
+
dt
)
i’ln{ i + 5ffi(*Wi)-.W)>} ,
lir f K - i W - * , ( * ) } . (
(4.33)
i f ^ ( o < ^ _ , ( 0. < - > 4
I n view of Exercise 4.4(H), th e expression for exceeds that given by (4.34) i f _ 0 . 6 32 < *
ifW>4-,<0;
άφ^ί + r)ldt given
4 - I - ’ J > < o.
34
by (4.33)
(4.35)
Equations ( 4 . 3 3 M 4 . 3 4) were discretized and solved for a platoon of 10 cars, as described i n Section 2.8 for equations (2.105). I used the same perturbatio n displacement for the leading car as in Fig. 2.9 and th e same = 13/1056 as were used in parameter values d = 65, = 88/3, and x /e th e earlier model. Thu s (4.35) became mix
- 5 1 . 3 < ^ _ , - ^ < 0.
(4.36)
I f you completed Exercise 2.19, then a simple modification of your com› puter program wil l enable y ou t o d o thi s for yourself. Th e results for ˜ = 0.15 and τ = 0.15 are shown in Fig. 4.4 as th e solid graphs. Th e
140
Chapte r 4
Validation : Accept , Improve , o r Rejec t
*
t
Fig. 4.4 Restoration of equilibriu m for a platoon of 10 cars in a tunnel. The dashed curves are identical to those of Fig. 2.10. The solid curves are predicted by the model of (4.29). Scales are as in Fig. 2.10.
dashed ones, for comparison, are those of Fig. 2.10. Th e strong upward curvatur e of the solid curves durin g the accelerative phase is a symptom of (4.34), i.e., of acceleration being independent of spacing between cars. Notice that the solid curves always dip below the dashed ones when they first depart fro m them. Th e reason is that when driver j first reacts t o driver j - 1» Φ]-1 < 0 and φ = 0, in such a way that (4.36) is satisfied. Then (4.33) yields a less negative slope than (4.34). Th e results for ˜ = 0.15 and τ = 2.25 are shown in Fig. 4.5 as the solid graphs. Th e dashed ones, for comparison, are those of Fig. 2.11. Th e eighth car collides wit h the seventh one after only 26.25 seconds (210 tim e units), much sooner than a collision occurs in Fig. 2.11. Th e effect introduced by (4.29b) is clearly a destabilizing one. A selection of points is labeled in Fig. 4.6, according t o whether the point s are stable or unstable. A s in Section 2.8, a square denotes stability , }
4.7
Th e Stabilit y of Car s In a Tunne l
141
Fig. 4.5 Instabilit y of a platoon of 10 cars when ˜ = 0.15 and τ = 2.25, for first 30 seconds following perturbation . The dashed curves are identical to those of Fig. 2.11. No collision has yet occurred. The solid curves are the predictions of (4.29). The eighth car collides with the seventh after 26.25 seconds. Scales are as in Fig. 2.11.
a dot instability , and jln indicates that the yth car collided wit h the car in fron t of it after «/8 seconds. A tentative stabilit y boundary τ = τ (Δ) is drawn as a solid curve. Th e dashed curve, for comparison, is that of Fig. 2.12. Once again, the effect of (4.29b) is seen t o be a destabilizing one. But is thi s a genuine improvement? How do driver s actually drive according t o (4.28), according t o (4.29), or according t o neither of these? I n th e absence of hard data, the best we can do is to compare the predictions of (4.28), namely, Figs. 2 . 1 0 - 2 . 1 2, wit h those of (4.29), namely, Figs. 4 . 44.6, and use our personal experience t o guess which pictur e is a fairer one of reality . Perhaps you would lik e t o pursue thi s matter and obtain some data (though thi s wil l be far fro m easy). I t is even possible that one model describes driver s in, say, Boston, and the other describes driver s in N ew €
142
Chapte r 4
Validation : Accept , Improve , or Rejec t
3;
Ø 0
1
1
1
1
1
0 .2
0 .4
0 .6
0.8
I.O
k
. ˜
Fig. 4.6 Tentative stability boundary (solid curve) in the Δ - Γ plane for the model of (4.29). The dashed curve is identical to that of Fig. 2.12.
York . But we now at least have a rational basis for accepting one model and rejecting the other (or rejecting both), even though, withou t th e data, we cannot actually make that choice. Therefore, as good scientists, we can conclude only that the matter remains open t o question. On a real highway, of course, both τ and L would be functions of/’, but such complexity could not usefully be embodied in a deterministic model. We would expect, however, that such variation s make a real highway even mor e unstable than our models predict, and that a collision is likel y if any drive r (except the first) has a slower reaction tim e than r ( A ) . Individua l values of τ are utterl y beyond the control of traffi c police, and so they must endeavor instead to keep ˜ as close as possible t o zero, i.e., t o ensure that th e stabilit y region i n Fig. 2.12 or Fig. 4.6 is as high as possible. It’ s no wonder that police are so much in evidence in N ew York’ s tunnels, urgin g traffi c t o maintain equilibrium ! c
4.8
Th e Fores t Rotatio n Tim e
I n Exercise 3.14, we considered the effect of reducing a forest rotatio n pe› rio d by a unit of time, fro m t = s + 1 to t = s. We found that the forester’s loss fro m unrealized tree growth would be approximately V"(s) ; whereas her gain fro m alternativ e investment would be approxi› mately 6V(s). Thus, according to Section 3.4, it is too soon to harvest if 8
*Before proceeding, you may wish to review your solutions to Exercise 3.9 and 3.14.
4.8
Th e Fores t Rotatio n Tim e
143
V, (i ) > 6V{s), and too late to harvest if SV{s) > V'(s), but if
(s) =
(4.37)
6v\s)
then the harvest time, s, is exactly right . I n thi s way, we have derived an intuitiv e marginal interpretatio n of the optimalit y condition, namely, that the best tim e t o harvest is when the incremental loss fro m denying th e trees a littl e more growth is exactly cancelled by the incremental gain fro m alternativ e investment (money deposited in a bank). Th e fact that thi s marginal analysis is far fro m rigorou s is without consequence , because rigorou s derivation of the optimalit y condition (4.37) is provided by the analysis of Section 3.4. (An alternativ e verbal expression of (4.37) is that th e specific growth rat e of forest value is equal t o the specific growth rat e of alternativ e investment value, and that the forest should be cut as soon as the former specific growth rat e ceases t o exceed the latter . Although thi s latter interpretatio n requires no approximation for it s derivation, it is much less useful than the one we have chosen to use.) But a moment’s reflection reveals that (4.37) is inconsistent wit h our assumption that the forester always was, and always wil l be, a forester. By comparing V\s) wit h 6V(s), we balance an incremental loss fro m one generation of trees against an incremental gain fro m the same generation of trees an d forget about all futur e generations! If the forester’s land were to become worthless after the harvest, then (4.37) would indeed be correct, but the land does not become worthless, because the forester plants new trees. Then the new seedlings wil l have acquired value, say ) , withi n the interval fro m t = s to t = s + I, and the forester should add thi s incremen› tal gain to 6V(s) in her marginal analysis of the decision to harvest. Thus s is too soon if V'(s) > 6V(s) + e(s) and too late if V\s) < 6V(s) + e(s), but s is just right if V'\Xs)-sns)= (s).
(4.38)
(
I t is easy t o verif y that the optimal rotatio n tim e predicted by (4.38) is shorter than that predicted by (4.37); see Exercise 4.5. To determine e precisely, suppose that our forester harvests her forest every s years, i.e., at times t = js, j = 1, 2, and replants, of course, immediately. Then between t = (j - l)s and t — js the forest wil l acquire (real) value V{s), independently of the value of j , if we assume that (real) costs and prices are constant and the biological growth mechanism is in› e~ ' \\s), dependent of time. Hence the present value of the ;t h harvest is and the present value of all harvests, fro m now unti l eternity, is 6 s
As)=
OO
β-* 7=1
m
=
00
ns) X > - V = 4
7=1
(4.39)
144
Chapte r 4 Validation : Accept , Improve , o r Rejec t
on summing the geometric series. Th e quantit y f{s) is known by foresters as th e value of the land. A more complete description would be the value of th e land for forestry, because the possibility of using the land for alternativ e ends is not entertained. Notice, however, that the attractiveness of such alternativ e investment (followin g th e next harvest) increases rapidl y wit h 6, since th e rati o of the value of the first cuttin g t o that of the land (for forestry) is r"V[s)tJls) = 1 - e~ . I t is straightforwar d (Exercise 4.6) t o show that (4.39) has a maximum at s - s*, where 6s
* V ) = W ) + $ / (A
(4.40)
provided V"{f) < 6V'(f), which i s tru e i n particula r i f V'(s*) > 0 and V"(s*) < 0. Comparing (4.38) wit h (4.40), we have e(s) = 6f(s). Moreover, th e marginal interpretatio n of the opening paragraph of thi s section can be made valid again i f we interpre t the incremental gain fro m alternativ e investment as includin g not only the interest that would accrue fro m selling th e w o od but also the interest that would accrue fro m selling the land itself (for forestry). I n applying our new optimalit y condition, it i s convenient t o define
W=y$y
<· > 4 4Ι
Then (4.40) becomes 1 - e~ ' \ ; 6s
0(s*)=
whereas the condition for a maximum, i.e., V"(s*) < 6V'(s*), 0'(s') + se(s')>
(4.42) becomes (4.43)
I.
For a typical stand of Douglas fir trees i n Britis h Columbia, values of V were given in Exercise 3.9. I n that exercise, by assuming that ( K r + 5) + \\t - 5))/2 w V{t) and (V\t + 5) - \\t - 5))/10 r* V'(t), we obtained th e estimates of V, V, and θ given i n Table 4.1. Notice that V"(t) appears t o change sign between t = 65 and t = 85. Thi s doesn’t seem quit e right , and we suspect that more refined methods are needed t o estimate adequately K’(75) . Therefore, when joinin g th e corresponding point s (r,0) in th e t-Q plane by a dashed curve, we have ignored th e data point at (75, 37.5); see Fig. 4.7. Th e solid curve i n Fig. 4.7 i s th e graph of (1 - e~ )/6, for δ = 0.05. Thi s meets the dashed curve where t = s" « 6 3. I t appears fro m th e diagram that θ(ΐ) > 18 and that B'(s*) a 0.8. Thu s e'(s*)+Se(s*)« 1.7, implyin g that (4.43) i s satisfied. W e now deduce fro m (4.42) that, when th e real interest rat e i s 5%, th e optimal rotatio n period is about 63 years. A s remarked above, thi s is shorter (by about t w o years) than th e value obtained in Chapter 3. Moreover, our estimation of s* i s clearly unaffected St
4.8
Th e Fores t Rotatio n Tim e
145
Table 4.1 Values of V, V and Θ, denned by (4.41), as used to determine optimal rotation period. t
W)
V'{t)
0(0
t
no
v'(t)
θ(ί)
35 45 55 65 75
21.5 93 223 400 573.5
4.3 10 16 19.4 15.3
5.0 9.3 13.9 20.6 37.5
85 95 105 115
727.5 859 956.5 1037.5
15.5 10.8 8.7 7.5
46.9 79.5 110 138
by the ignored data point. Let us therefore expend no furthe r energy on our suspicion that V'(T5) has been poorly estimated. Th e same method can readil y be used t o determine i* for any other value of 6. Th e optimalit y condition (4.40) is certainly an improvement upon (4.37), but the question posed in Chapter 3 has not been answered. D o es (4.40) determine when a forest should be cut? H ow can we test our model? Thi s raises a most importan t question concerning what is testable and what is not, and tw o remark s are in order. First , the choice of utilit y function in an economic problem is a task for moral philosophers. We did not use data to decide that a forester should maximize present value, as opposed t o some other quantity ; we simply
Fig. 4.7 Graphical determination of optimal rotation period for a stand of Douglas fir trees.
146
Chapte r 4
Validation : Accept , Improve , or Rejec t
accepted the prevailin g opinion among practicin g economists (you may challenge this, but not withi n the framework described at the beginning of thi s chapter). Second, as we stated long ago in our AB C of modelling, mathematical deductions fro m given assumptions are not (or should not be) open to question. Mathematics does not lie. Thus, if real prices are constant, if all trees are identical, if a forest is felled and replanted in an instant, and if all other effects which our model neglects are trul y negligible, then there is no question that (4.40) provides the optimal rotatio n period. I n brief , we cannot use data to test the trut h of either the utilit y function or the solution t o the pur e mathematical problem. W e must use data, however, to test the trut h of our assumptions that prices are constant, that trees are identical, that harvesting and replant› in g are instantaneous, and that other effects may be ignored; and it wil l not surprise you to learn that all four assumptions are doubtful for most forests. Indeed the forest rotatio n problem is both more controversial and mor e complicated mathematically than befits furthe r discussion in a gen› eral work on mathematical modelling. We do relax the assumption that all trees are identical in Sections 5.8 and 9.2, but the reader who wishes t o study these matters in depth is referred t o the literature .
4.9
Cro p Sprayin g
Accordin g to Plant (1985, p. 5), a cotton grower in the San Joaquin Valley adopts the followin g strategy in attempting to control the spider mite. Every tim e she measures the pest population, the grower compares the cost of applying pesticide at the maximum level allowed by law wit h the projected cost of crop damage if no pesticide is applied. If the latter is greater than the former , then the grower applies the maximum allowable amount of pesticide. Can we use thi s informatio n to test the model we proposed in Section 3.6? Let’ s make the assumption that, by virtu e of experience (i.e., tria l and error) , what growers do is also what is optimal. Then, if the strategy they adopt agrees wit h the prediction of our model, we wil l accept our model, at least for the tim e being, on the grounds that we have as yet no reason t o reject it . I f the strategy they adopt disagrees wit h our model’s predictions, however, then we wil l have to decide, by other means, whether the fault lies wit h the assumption that growers do what is optimal, wit h (3.54), (3.56), or (3.61), or even wit h some other assumption. Now, in the notation of Section 3.6, the growers’ strategy is 9
Spray if Don’t spray if 9
J[f,
0) > c + c, U 0
mix
, 0) < c + c, U . 0
You may wish to review Section 3.6 before proceeding.
mn
(4.44) (4.45)
4.9
Cro p Sprayin g
147
I f (4.44) is satisfied then the grower sprays wit h concentration i / . We wil l denote the tim e of spraying by j * , on the assumption that when growers spray is also when it is optimal (but remember that As, 0) is independent of s). Because/(i*, t / ) exceeds c + c, U , (4.44) may be satisfied i n one of tw o ways: either m a x
m a x
0
max
< y ( >\ 0)
… + Ci U
<
c +c U
< As', 0) < As', U J.
max
UJ m
(4.46)
or 0
{
maK
(4.47)
m
I f (4.46) holds then (3.65) i s satisfied wit h U = C / ; whence, fro m (3.70) and (3.71), the growers’ strategy is the same as our model’s if m
max
>^---W .
(4.48)
Let’ s assume that (4.48) holds. Then, because U* = C / , the right-han d side of (4.37) is less than/fa* , U*). Therefore, fro m (3.44), (4.45) agrees wit h our model also. Our model is thus i n complete agreement i f max
1. (4.48) is tru e and 2. (4.48) implies that (4.47) i s impossible.
(4.49)
To show that (4.47) cannot hold we must show that W(q) i s negative; - U ) implies that i.e., that ξ > e x p ( t / m ax
0
*(£)== t / + « - +
(4.50)
0
is a decreasing function for ξ > 1 (and ξ > i s negative. Because e x p ( C / - U ) implies ξ > 1), ( ) wil l certainly be negative i f * ( e xp {U - U }) is negative; or, upon rearrangement, max
max
0
0
CU +a^ + K ^ c,
-
1
^
• c.
(4.51)
Mor e generally, if we define A
=
^
r
(
W
i
W
( 5 2) 4 -
(
then (4.49) is satisfied i f ^max + ~
+ 1 + In º < º ^ • » -
u
\
º > 1.
(4.53)
Th e greater the value of º i.e. , i n view of (4.37), the more valuable the crop or the more destructive the pest th e more easily that (4.53) is sat› isfied.
148
Chapte r 4
Validation : Accept , Improve , o r Rejec t
I n summary, if (4.53) holds, then the only piece of data we have is consistent wit h our model. I f (4.53) holds, then we have no reason t o reject th e model, at least unti l more extensive data enable us t o apply a mor e stringent test. But does (4.53) hold? M y guess is that pb is probably large enough t o ensure that it does; but I don’t actually know, and perhaps thi s i s a matter you would lik e t o pursue.
4.10
How Righ t Was Poiseuille ?
I n Section 2.6, we constructed a model for the flow of water through a pipe wit h an arbitrar y elliptical cross section. Because the circl e is a special case of the ellipse, thi s model should at least be able to explain the flow of water through a circular pipe. Let’ s use thi s fact to test our model. 10
Let Oxyz be an orthogonal Cartesian coordinate system, wit h Oz along th e symmetry axis of the pipe. Then recall, fro m (2.70), that our model predict s the flow velocity in the direction of Oz, at station (x,y), t o be
* > » - ^ y
&
( ’ - ? - $ )•
««*>
where a b, are the semi-axes of the ellipse and
i s the constant (adverse) pressure gradient that drives the flow. Let our circula r pipe have radiu s a, and let r = y/x + y . Then, on setting b = a i n (4.54) and using (4.55), we find that th e flow velocity at radiu s r withi n th e pip e is given by 2
2
Th e maximum velocity w
^
= ~TpYz
( 4
·
5 7 )
occurs at the center of the pipe; whereas the average velocity is
« i Γ Jo *
w
=
r)rdrde
=
Hence, according t o the model of Section 2.6, we have
l0
You may wish to review Section 2.6 before proceeding.
(4
·
58)
4.10
Ho w Righ t Wa» Polseullla ?
149
and the flux of water along the pipe is
* = - w % " * " ~
( 4
'
6 0 )
on using (2.72). A s we remarked in Chapter 2, thi s last result is known as Poiseuille’s formul a (by some, and the Hagen-Poiseuille law by others). Experimental values of w(r) at ten different radi i are presented by Hansen (1967, p. 309) and plotted in Fig. 4.8. I f you plot (4.59) on the same graph then you wil l find that the agreement between theory and prac› tic e is excellent th e model fits the facts. Moreover, experiments by Hagen and Poiseuille themselves established that Q/a* was remarkabl y constant for water flowing through pipes of different radii , under th e same adverse pressure gradient; see, for example, Batchelor (1967, p. 181). I n all of thi s ther e is no reason at all to reject the model of Section 2.6. W e must accept it , however, subject t o (at least) tw o limitations . First , i f ζ = 0 is the entrance t o the pipe, then there is a region 0 < ζ < z , known as the entry region, in which (4.59) does not apply. To understand why, imagine that the pip e is inserted int o fluid flowing wit h constant velocity w , parallel t o the pipe. Then at ζ = 0 we have c
av
w=w
a v
,
0
(4.61)
i.o
0.5
Fig. 4.8 Experimental values of *ir)/w at 10 equally spaced radii for flow in a circular pipe. The sketch, based on a Ph.D. thesis by V. E. Senecal, is adapted from Arthu r G. Hansen, Fluid Mechanics, p. 309 by kind permission of the author (who now holds the copyright). max
150
Chapte r 4
Validation : Accept , Improve , o r Re]ec t
whereas for ζ > z we have w given by (4.59). Between = 0 and = z , the fluid velocity profil e must make a transition from the "flat " profil e of (4.61) to the "parabolic " profil e of (4.59). Thi s transition (by a mechanism known as boundary layer thickening) is indicated schematically in Fig. 4.9. The flow in the entry region is difficul t to analyze but the length of the region may be estimated (Hansen, p. 309) as c
c
z = 0.232a w ^ ,
(4.62)
2
c
av
where ρ is the density and μ the shear viscosity of the fluid. The wider the pipe or the faster the flow, the longer is the entry region. Second, and more fundamentally, we must recall our assumption in Section 2.6 that the flow in our pipe is in equilibrium . Now in Section 2.8 we saw an example of a dynamical system, namely, a platoon of cars, that was stable for certain values of the system parameters but not for others. Instabilit y set in when a certain parameter exceede d a critical value. Thi s also happens to flow in a pipe. For traffi c flow, the relevant parameter was r , the driver response time, and it s critical value was r (A). For flow in a pipe, the relevant parameter is c
β
˛
2o£Wjy ^
μ
and it s critical value, R , is about 2000. R, which is dimensionless, is known in fluid dynamics as the Reynolds number. Fig. 4.8 was obtained for a Reynolds number of 1094, well withi n the stable region; but for R > R the equilibriu m (4.59) cannot be sustained, just as (2.96) could not be sustained for > r. I f you wish to pursue the study of flow at Reynolds numbers above R , i.e., at supercritical Reynolds numbers, then you ought to begin wit h an introductor y text lik e Batchelor (1967) or Hansen (1967). We don’t have space to pursue it here. We have raised the matter merely to illustrat e that a model that is excellent for certain conditions may be quit e inadequate for others, because (4.59) provides an excellent description of subcritical {R < R ) pipe flow away from the entrance (z > z ) but is inapplicable either to the entry region 0 < < z or to supercritical flow. To put things another way, it is rar e that an assumption on which a model is based is valid without exception, and we should expect that the model may cease e
c
c
c
c
c
e
z=0
ΞΣΞΞΞΣ 0
Fig. 4.9 Schematic representation of transition to Poiseuille flow in the entry region of a circular pipe.
4.11
Competin g Specie *
151
t o provid e an adequate description of realit y as soon as the assumption ceases to be justifiable . I n the case of the entry region, for example, the assumption that ceases to be justifiabl e is that w is independent of z, as is clear fro m Fig. 4.9.
4.11
Competin g Specie s
W e have good grounds for believing that if an ecosystem consists solely of two species competing for the same food supply then, in the long run, only one species wil l survive. The other species wil l become extinct (or else migrate, in search of an alternativ e food supply). For example, The Economist of Apri l 26, 1986 reports, in a lively and informativ e article, "Th e rows behind ecology," that three kind s of parasitic wasps were once introduced to Hawaii to control frui t flies. Th e first established itself and brought the flies under control. When the second species was introduced, it drove the first one to extinction and assumed for itself the job of control› lin g the frui t flies. Later , the thir d species in tur n drove out the second one. Indeed the idea that only one of two competing species can survive has be› come enshrined in theoretical ecology as "Gause’s principl e of competitive exclusion," even though it was apparently never enunciated by Gause; see Maynar d Smith (1974, pp. 61 and 103). 11
Let x(t) and y(t) denote the population magnitudes, at tim e t, of the tw o competing species. Then it appears at first sight that (1.22), i.e., dx --ji l
u = «i -b y, t
idy -jj
= a -b x, 2
2
,
, (4.64)
where a\, a , b\, b > 0, might be an acceptable model of a competingspecies ecosystem, because, fro m Fig. 1.4, it predicts that species χ wil l prevail if (JC(0), y(0)) lies below ON, but species y wil l prevail if (JC(0), y(0)) lies above ON. But (4.64) also predicts that the survivin g species wil l be› come infinitel y numerous. Suppose, for example, that species χ survives and species y has been driven to extinction. Then y(f) = 0, so that (4.64) yields (Vx)dx/dt = a\, whence x(t) = x^&xpia^) grows without bound. In other words, our model assumes that one species wil l grow exponentially in the absence of the other. Now, although exponential growth may be a reasonable assumption in th e short term, it clearly cannot last forever. I n the long run , the growth of species χ must be limited , because it s food supply is distinctl y finite. Let us therefor e make the fresh assumption that, in th e absence of the other, each species would grow not exponentially but according t o a logistic growth 2
2
You may wish to review Section 1.5 before proceeding.
152
Chapte r 4
Validation : Accept , Improve , o r Rejec t
law, i.e., that, for some positive parameters c, and c , 2
1 dx x ^
=
a
> -
C
*
Idy y T t
>
X
=
' -
a
C
i
y
-
( 4
·
6 5 )
Thus, if /(= 1,2) represents the survivin g species, then it cannot become mor e numerous than Æ,/c, . Addin g the interaction term s t o (4.65), we are thu s led t o propose that (4.64) should be replaced by the model ^
=x(a
-c x-b y),
l
i
l
< •
%
4
j ; =
6 6 )
y(a -b x-c y). 2
2
2
Thi s is a dynamical system of the for m (2.12), wit h u(x,y) = x ( a, - c , x~b y) and v(x, y) = y{a - b x - c y). I t has equilibri a where u and both vanish, i.e., at points (x',y') such that u(x*,y*) = 0 = v(x*,y'). We exclude the unstable equilibriu m * = 0 = y* on the grounds that at least one species i s presumed t o exist, and so there are three potential equilibria : x
2
2
2
x' = 0,
y* = ^ ,
0|
x* = =i-,
(4.67)
y* = 0,
(4.68)
or (x*,y* ) is the intersection of the lin e pair L, :
cx + by
= a,
(4.69a)
L:
bx + cy = a.
(4.69b)
l
2
i
2
l
2
2
Because al,a2,bl,b2,cl, and c are all positive, the lines L and L in (4.69) must have positive intercepts on both axes in the - y plane. Thus there are four possible configurations, as depicted in Fig. 4.10, in which dots denote equilibria . I n (a) and (b) of Fig. 4.10, th e lines L , , L do not intersect, so that th e only equilibri a are at (4.67) and (4.68). I n (c) and (d) the lines do intersect, and there is therefore an additional equilibrium , where 2
{
2
2
C\C — o b\ 2
oo
2
i
2
— cc 2
i
Th e arrow s in the diagrams are a schematic representation of the direction of the vector dxldt in the various regions, in the first quadrant of the and the coordinate axes. These x - y plane, which are separated by L L are easily deduced fro m the observation that dxldt is positive below L zero on it , and negative above it ; whereas dyldt is positive below L , zero on it , and negative above it . Thu s solution curves always cross L , verticall y and L horizontally . Th e curve marked S in Fig. 4.10 (d) is a separatrix, lik e ON in Fig. 1.4, which solution curves may never cross. I f you sketch a U
2
u
2
2
4.11
Competin g Specie s
153
Fig. 4.10 The four possible phase-plane configurations for two competing species.
few trajectorie s by using a computer routin e such as D V E R K (Section 1.4), then you wil l discover that Fig. 4.10(d) is closer t o Fig. 1.4 than any of the remainin g three diagrams. Indeed Fig. 1.4 could be regarded as the special case of Fig. 4.10(d) in which the equilibri a at ( a , / c , , 0) and ( 0 , a / c ) have retreated along their respective axes t o infinity . A few minutes spent pondering these diagrams wil l convince you that, for arbitrar y initia l population magnitudes x{0) and ><0), the ecosystem approaches one of the three potential equilibria . The identit y of thi s steady state is determined by the signs of the numbers l and I , where 2
x
2
y
Th e dependence of the species’ destiny on I and l is recorded in Table 4.2. You can easily confirm , by the method of Section (2.2), that the attractin g equilibriu m is stable, and the other(s) unstable (Exercise 4.7). x
y
154
Chapte r 4
Table 4.2
Validation : Accept , Improve , o r Rejec t
Destiny of Competing Species as a Function of Interference.
Diagram
Sign of I
(b) (a) (c)
+
Sign of I
x
+
-
(d)
—
1
1
Τ
Τ
y
Steady state that attracts all solutions (a,/c,,0) (0,a /c ) (4.70) (a,/c,,0) if {x{Q),yiP)) lies below 5 ( 0 , e / c ) if (x(0), v(0)) lies above S 2
2
2
2
How do we interpret the quantities defined by (4.71)? It is clear fro m (4.65) that aj/ci is the capacity of the first species (as defined in Sec› tion 1.9); and Section 1.5 shows that a lb is the equilibriu m population when the species is assumed to have infinit e capacity. Although that equi› libriu m is unstable and would never be observed, it nevertheless represents the only level at which species χ could coexist wit h species y if both were assumed to have infinit e capacity. I f thi s level is less than a\lc\ then co› existence wit h species y would prevent species χ fro m reaching capacity; whereas if a lb exceeds ajc\ then the growth of species χ is more restricted in isolation than it would be if it were obliged to coexist wit h species y. Thu s I is an interference factor, being negative or positive according to whether species χ interferes more wit h itself than wit h species y, or vice versa. We interpret y similarly . 2
2
2
2
x
Now, if both I and I are negative, then the tw o species interfer e less wit h each other than they would wit h themselves; and can hardl y be said t o compete for a c o m m on food supply. Possibility (c) in Table 4.2 must therefor e be ruled out. I n all other circumstances, i.e., when at least one species interferes wit h th e other, (4.66) predicts that only one species wil l survive, and Table 4.2 specifies which. You might describe (a) and (b) as unfai r competition, in which case (d) would represent a fair fight, although it s outcome would still be determined by th e initia l strengths of the armies. Al l thi s is perfectly in accordance wit h Gause’s principle . We have therefore no reason t o reject (4.66), and unti l we are able t o apply a mor e stringent test, we tentatively accept the improved version of our model. x
4.12
y
Predator-Pre y Oscillation s
W e have two good grounds for believing that if a carnivorous predator feeds solely on an herbivorous prey, then both populations may oscillate forever. The first ground is conceptual. I f there are many prey but few predators then the predators wil l have an abundant food supply and their 12
You may wish to review Section 1.4 before proceeding.
12
4.12
Predator-Pre y Oscillation s
155
numbers wil l grow, at the expense, of course, of the prey. Th e consequent decline in the numbers of prey wil l choke off the food supply of th e more abundant predators, many of whom wil l die of hunger. Th e smaller preda› tor population that results wil l have a smaller demand for food, giving the prey population an opportunit y to recover, but now there are many prey again, which is where we began. Th e second ground is empirical. Such predator-pre y oscillations have actually been observed in nature. Th e most famous example concerns the lynx and the snowshoe hare of America’s norther n coniferous forests, whose populations fluctuate wit h a period of about ten years; see Messenger (1980, p. 1046). I f x(t) and y(t) denote, respectively, the magnitudes of the prey and predator populations at tim e t, then such a cycle of growth and decay would appear as depicted in Figs. 1.2 and 1.3. At first sight, therefore, it seems that (1.20), i.e., \dy -
y 7 R
= -a
, 2
+
b x, 2
(4.72)
where a a , b ,b > 0, might be an acceptable model of a predator-prey ecosystem. But, lik e (4.64) above, the model (4.72) embodies the assump› tio n that species χ (here the prey) would grow exponentially in the absence of the predator (y = 0), and we have just agreed that thi s is not a sound assumption. N o matter how much vegetation there may be t o eat, crowd› ing and disease are bound t o ensure an upper limi t t o the capacity of the land, no matter how large that limi t may be. Let’ s call it 1/e, where we have i n mind that e is a small number. Before we consider any furthe r whether (4.72) is acceptable or not, we must at least correct thi s one defect. Let’ s therefor e assume that, in the absence of predators, the growth of the prey population would obey the logistic equation of Section 1.9. Thu s lt
2
{
2
(4.73) Thi s is just (1.63) wit h R = a, and Κ by the dynamical system
\k.
We therefore replace (4.72)
(4.74) We propose thi s as an improvement to our model. N o te that, because the prey capacity 1/e must exceed all actual prey population levels, it must in particula r exceed the level a lb at which, according t o our old model (4.72), the prey could coexist wit h the predator in static equilibrium . Thu s 2
2
(4.75)
158
Chapte r 4
Validation : Accept , Improve , o r Rejec t
A typical solution of thi s pair of ordinar y differentia l equations, ob› tained as in Sections 1.4 and 1.5 by numerical approximation, is repre› sented in the χ - y plane by the spiral shown in Fig. 4.11. Th e curve is actually drawn for x(0) = 1 = y(0) and parameter values a, = 4, a = 3, b = 2, b = 1, and e = 1/30; but for any other initia l population levels x(0) > 0 and y(0) > 0, and for any other values of a a , b b , and e satis› fyin g (4.75), th e solution curve would still spiral in toward th e stable focus 2
t
2
lt
2
u
2
(4.76) Wher e are the cycles of Fig. 1.3? They have disappeared! Herbivorou s species have been observed to coexist wit h carnivorous ones in apparently static equilibrium . Examples concern the Rocky Moun › tai n lio n and mule deer, and the wolf and caribou i n Alaska (May, 1976c, p. 55). Such simple ecosystems might well be described accurately by the model (4.74). But (4.74) cannot represent the kin d of interaction that de› termines th e population cycles of th e lynx and hare in Canada; i.e., (4.74) i s not an acceptable model of that particula r predator-prey system. More › over, the cycles of Fig. 1.3 are absent fro m (4.74) for any positive value of e, however small. I n other words, the addition of a small quantity , namely, - ˇ, , t o the right-han d side of one of th e equations (4.72) has a drastic effect on the topology of the phase-plane, because the equilibriu m x* erupts (or "bifurcates" ) fro m a metastable center int o a stable focus as e becomes positive. Thi s is easily deduced by the methods of Section 2.2, because the quadrati c equation (2.19) for the system (4.74) is found (Exercise 4.7) t o be 2
(4.77)
y
4
3
2 U ,y ) 0
0
0
2
3
Fig. 4.11 Form of solutions to (4.74).
4
5
6
7
4.13
Sockey o Swings , Paradigms , an d Complexit y
157
For e = 0, the roots of (4.77) are purely imaginary, so that x* is a center, by (2.21); whereas for small positive c the roots are complex, wit h negative real parts, so that x* is a stable focus, again by (2.21). Whenever the phase-plane topology of the dynamical system ^
= tKx,y),
% = ^y) v
( • 7 8) 4
is different fro m that of the dynamical system ^
= u(x, y) + ia(x, y),
^
= v(x, y) + tb(x, y)
(4.79)
for arbitraril y small t, we say that (4.78) is structurally unstable. I n terms of Chapter 2’s mythical land of Phaseplane, it means that a slight change i n the mechanism that determines the wind pattern, while the wind is still blowing, wil l drastically change that pattern. Thu s the concept of structura l stabilit y is fundamentally different fro m those we discussed in Chapter 2. It applies t o the mechanism of a dynamical system; whereas earlier concepts applied t o the destinies of the entities which that mechanism governed. Structura l stabilit y is also much more difficul t t o treat mathematically and is well beyond the scope of thi s book. Fortunately, however, the only re› sult we need t o proceed is that dynamical systems that lead t o metastable cycles are always structurall y unstable; whereas those that lead t o limi t cy› cles are not. Biological systems are constantly subjected t o changes in the mechanism that governs their evolution and so any population cycle that is actually observed must surely be a limi t cycle, because it would not persist if it were not associated wit h a structurall y stable dynamical system. Our predator-prey model is unacceptable. But we have also stumbled upon a test that any acceptable model is obliged t o pass: it must give rise t o a limi t cycle. We wil l discuss such a model in Chapter 10. Meanwhile, tr y Exercise 4.14.
4.13
Sockey e Swings , Paradigms , and Complexit y
W e now consider circumstances in which, as an interi m measure, we are obliged to relax our criteri a and consider models that cannot be tested. W e said at the beginning, and we’ll say it again, that the ultimate test of a model’s wort h is often it s abilit y to predict observable data. But nature is complex, wit h so many variables, that all essential characteristics of many natural phenomena can be captured only by a sophisticated model, one that is synthesized fro m many components. We do not expect that some of the components wil l explain observable data without the others, for that would impl y that the others were redundant anyway; but without 13
You may wish to review Sections 1.8 and 2.4 before proceeding.
158
Chapte r 4
Validation : Accept , Improve , o r Rejec t
th e components, the full y integrated model wil l never be constructed, and hence never tested. We are thus obliged t o develop models that cannot themselves be tested, on th e understanding that th e final product wil l be tested eventually. I f it fail s thi s test, we must then decide which components are fault y and how to replace them. Thi s would be a poor policy for an engineer to adopt; but natur e does not allow controlled experiments in her laborator y and so it is frequently the best that a mathematical modeller of natural phenomena can do. Thi s shouldn’t take you completely by surprise, for we broached the idea earlier, in Sections 4.3 and 4.6, when we spoke of several generations of predictions. Moreover, in certain circumstances, we are even obliged to develop models that wil l never be tested at all, as i n the controversy over the nuclear arms race. At least, we fervently hope that such models wil l never be tested. Th e salmon model of Sections 1.8 and 2.4 can be regarded as a model component that cannot, itself, be tested, because all available data wil l embody the age structure, environmental variability , and interactions wit h other species (includin g man!) that the model simply ignores. Nevertheless, ther e are indications in th e scientific literatur e that our model component may prov e to be a useful one. According t o Ricker (1954, p. 592), the ap› propriat e unit of tim e in the metered model of Section 1.8 is about four years for a certain lineage of sockeye salmon on the Fraser river in Canada. These salmon are supposed t o have been much less plentifu l in 1909 than i n either 1905 or 1913. Could thi s have corresponded to a period-2 cy› cle such as the one suggested by the thir d column of Table 1.2? Th e evi› dence in favor includes the fact that the percentage exploitation of those salmon by the fishery was low at the time. Fro m (1.53) and Section 2.4, a period-2 limi t cycle could occur only if the percentage exploitation were low enough to keep the parameter r = \n(ya) above 2, where 7 denotes the fractio n of young salmon survivin g t o breed and a the number of eggs laid by a female for each existing member of the population. Low percentage exploitation would have made it possible for 7 t o exceed 7.389/a durin g th e early part of thi s century. Durin g the middl e of the century, however, exploitation was high enough t o keep r below 2 (or ª below 7.389/a) and ensure that no swings would be observed. Th e latter is a liberal but nev› ertheless accurate translation of Ricker’ s statement (p. 592) that "unde r present conditions the fishery normall y takes enough t o keep the spawn› in g stock near th e dome of the curve." (I f you want t o know which curve, read the paper.) But the salmon model may also be regarded as a paradigm, i.e., a simple model that isolates and explores the consequence s of a particula r idea. Viewed in thi s way, the model’s simplicit y is it s greatest strength. Suppose, for example, you had the idea that the best way t o preserve a species was t o hunt it in small quantities. How could you test thi s idea? One way would be to apply the model of Section 2.4. According t o thi s
4.14
Optima l Fleet Size and Highe r Paradigm s
159
model, if exploitation is high enough t o ensure r < 2, then the stock of th e species wil l remain in equilibriu m at a moderate level. I n particular , it wil l never reach a low level. But if the species is hunted only in small quantitie s then r may be much larger than 2, implyin g that the stock wil l swing back and fort h between low levels and high levels. Now, suppose that the species is afflicted one year by pathological doses of pollution , disease, or natural catastrophe. Under which circumstances is the species most likel y t o survive i f the stock level is guaranteed t o be at least mod› erate, or if the stock level is guaranteed t o be at least low? Because we cannot arrange for catastrophes t o occur when the stock is abundant, I’ m sure you’ll agree that the species is better off if r < 2. Low levels of ex› ploitatio n do not necessarily help to preserve the species (it would depend upon whether r fell below 2 even withou t human intervention). Thu s the trut h of your idea, as captivating as it sounds, is seen t o be in doubt. D o you believe that you would have realized thi s without the help of a paradigm? I t is no coincidence that the salmon model may be regarded either as a component or as a paradigm, for the tw o are closely related. A model component is an attempt t o capture one (or more) essential characteristics of a complex phenomenon; a paradigm is an attempt t o isolate one (or more) particula r idea; and the foundations of even the most sophisticated models are ideas. When the idea is testable, we call it an assumption. When, as here, it is merely explorable, it simply remains an idea. A good idea now might be t o tackle Exercise 4.8.
4.14
Optima l Fleet Size and Highe r Paradigm s
Th e dual view, that a nontestable model may be regarded either as a paradigm or as a component of a later, testable model, applies in par› ticular to Section 3 . 7 . The number of components in a mathematical model depends, of course, on how you look at it; but a possible view is that the fleet size model has two components, a biological one and an eco› nomic one. In the hierarchy of complexity, therefore, it enjoys a higher station than the model discussed in the previous section, which is purely biological. Stretching the dual relationship to it s very limit s now, we might expect the fleet size model to be the kin d of paradigm that would let us explore not a single idea but the interrelationshi p between two a higher paradigm, as it were. 14
One idea, which some people believe, is that you should liv e for today, on the grounds that tomorro w may never come. I f it does come, however, then you might wish that you had prepared for it, which is why some l4
You may wish to review Section 3.7 before proceeding.
160
Chapte r 4
Validation : Accept , Improve , o r Rejec t
people say that you should liv e for tomorrow . W h o is right ? As we dis› cussed toward th e end of Section 4.8, a mathematical model could never answer such a question. What it can do, however, is t o provid e a con› ceptual framework for assessin g the implication s of tw o conflictin g view› points, and, mor e importantly , of the whole spectrum of viewpoints that li e between. So consider the woman who lives for today. H ow would you convince her t o put her money in a bank? N ot by offerin g her 10% inter › est, or 20% for that matter, because she is far too worrie d that she won’t be around t o enjoy the income. Th e only rat e that might tempt her t o put her money in a bank would be <x>%. N ow consider th e woman who lives for the end of th e next millennium . She’s so sure she wil l still be around that she would accept a (real) interest rat e of 0.001% or so, be› cause she can still nearly tripl e her money. Indeed if she felt that it was wort h paying so much a year for th e safekeeping, then she would proba› bl y accept an interest rat e of zero. Here are the extreme viewpoints. Th e woman who lives for th e far distant futur e is modelled by δ = 0. Th e woman who lives for th e here and now is modelled by δ oo. Most of us mortal s li e somewhere in between, in the spectrum 0 < δ < oo, th e great iron y being that δ probably decreases wit h age. (When Hurri › cane Kat e swept through Tallahassee in November, 1985, she destroyed th e oak tree of an 84-year-old neighbor of mine. Next day he removed i t and planted a new one.) I n thi s section, we wil l refer t o δ as the discount rate. Th e new terminology merely reflects a change of emphasis. When δ was used t o measure th e lucrativeness of alternativ e investment, we called it the (real) interest rate, but when using 6 t o measure the de› gree t o which the futur e is ignored (or "discounted") , we shall call it the discount rate. Let’ s now assess the implication s of concern about th e futur e for the fishing fleet of Section 3.7. Th e optimal number of boats, as a function of δ, is given by (3.89):
b+
W( -*) "}
(4.80)
> 0;
(4.81)
,+t
!+
Thus, because b < 1,
JiJi-l + lbY + Wl-b) also U'(0)
=
W-b) 2q
(4.82)
4.15
and
On th e Advantage s of Flexibilit y In Prescriptiv e Model s
161
15
C/*(oo) =
R{i-b)
(4.83)
You can see immediately fro m the profi t expression (3.87), i.e., fro m (4.84) that the sole owner of a fishery who lived purely for today would driv e it t o a state of zero profi t {after her huge salary had already been included as part of costs (3.74)!); whereas the sole owner who lived purely for her great grandchildren’ s great grandchildren would maximize sustained profit , ensure that the fish stocks remained above the level of maximum sustain› able yield, and thus be very popular wit h the conservationists in Exer› cise 3.16 (where sustained profi t and sustained yield are defined). Because U*'(8) > 0, moreover, the more that the owner cared about the future , th e fewer boats she would use and the higher the stock level that would be maintained. Even in Western democracies, fisheries can be viewed as having a sole owner, namely society. If we could only agree on a suitable value for δ then models lik e thi s one might help to determine a system of licensing laws that would keep exploitation at the optimal level. Naturally , many components would need to be added to the model, because the oceans are roamed by many boats in search of many species, wit h many breeding cycles and as many selling prices; and all are vulnerable to unexpected environmental shocks. The problem of developing a theory of conservation of natural resources is such a difficul t one that, at the tim e of writing , relatively few components have been added by anyone to the model of Section 3.7 (see Clark , 1990). Yet as difficul t as the modelling sounds, the really tough prob› lem is still that of getting society to agree!
4.15
On th e Advantage s of Flexibilit y In Prescriptiv e Model s
We close thi s chapter by addressing a question we posed at the end of Sec› tio n 3.2, where we were tryin g to decide how big a pay increase a professor should receive. Instead of asking whether our linear programmin g model fitted the facts, we wondered whether anyone might use it . Wh y did we suddenly change our criterio n of relevance? 15
Use the fact that lir a \x - y/(C - x) + Ax) = li m 2
for any constants A and C.
(2C - A)x χ + V( C -x) 1
C +Ax 2
162
Chapte r 4
Validation : Accept , Improve , o r Rejec t
Th e answer lies in the purpose behind the model. Th e models we en› countered in Chapters 1 and 2 were descriptions of natural or social phe› nomena, i.e., attempts t o say what things or people do do, in the active sense of the verb. By contrast, the flight model of Section 3.1 was an at› tempt t o say what a bir d should do, i n the modal sense of the verb. I f we believe that what bird s do is also what is optimal by virtu e of tria l and error , then our fligh t model is essentially also an attempt to describe a phe› nomenon. But bird s have migrated for thousands of years. They’ve had all that tim e t o solve their problem, and no one has ever pressed them for an answer. Administrators , on the other hand, have generally had littl e ex› perience of the problems they currentl y face, yet are expected t o prescribe solutions withi n a relatively short period of time. They must therefore short-circui t the process of tria l and error by imagining what people would do, in the subjunctive sense of the verb, if certain actions were taken, then consciously select fro m among those actions the one that seems most desirable. Suppose, for example, that our chairperson is worrie d about her de› partment’ s research rating . She may imagine that her faculty would im › prov e the qualit y of their research if she took the action of raising the payment for a unit of research achievement. Fro m many such actions, she may consider it most desirable t o select th e one that maximizes that pay› ment, subject t o certain constraints. Suppose that her action fail s t o achieve it s intended goal, perhaps because faculty are still devoting too much tim e t o service. What wil l she do? She wil l tr y t o imagine what different actions would achieve, then select fro m among those different actions the one that seems most desirable. She may, for example, consider lowering the pay› ment for a unit of service achievement. Fro m many such actions, she may now consider it most desirable t o select the one that minimizes that pay› ment, subject t o the same constraints as before. Moreover, she may not have the tim e or energy t o thin k through the entir e problem, whenever it appears that a change of policy is required. Then what she needs is a flexible model, one easily altered t o suit the needs of the moment. Th e greater her model’s flexibility, the greater it s usefulness. I f you did Exercise 3.5, then you wil l probably agree that the model we developed in Section 3.2 is indeed a flexible one. Provided they remain linear, the constraints and utilit y function in the linear program (3.20) may be changed at almost a moment’s notice, simply by redefining the matrices A , b, and c. Moreover, a moment later, ZX3L P wil l be just as happy t o reveal the new optimal control (or tell you that no control is feasible). W e have said already that, in managing society and it s resources, the choice of utilit y function lies outside the scope of the philosophy set fort h at the beginning of thi s chapter. I n a democratic nation or institution , that choice is made by political debate, whether at the national level or at the grass-roots level. In a dictatorship, of course, it is made by decree. I n these
Exercise s
163
circumstances, constraints are likewise political choices. Our chairperson’s budget, for example, is (at least indirectly ) the result of a vote in the state legislature. Whenever a model is prescriptiv e rather than descriptive, i.e., whenever a model attempts t o predict what should be done rather than what is actually done, abilit y t o explain facts is no longer a suitable criterio n of worth . There are no facts t o test such a model! A descriptive model is concerned wit h the past or present, a prescriptiv e model wit h the future ; and, as Benjamin Frankli n once wryl y remarked, the only certainties about th e futur e are death and taxes. Withou t certainty, there are no facts. W e should emphasize here that all prescriptiv e models have descriptive elements. For example, the manager of our fishing fleet assumed that the logistic law would describe futur e growth of fish stocks in the absence of harvesting. But even these descriptive elements are untestable, except by virtu e of waitin g and using hindsight. A decision maker must use foresight, however; she cannot wait for the futur e to happen. I f fitting the facts is no longer relevant, how do we measure the wort h of a prescriptiv e model? That raises a controversial issue. I thin k it fair to say that there is no widely accepted criterio n of wort h for prescriptiv e models. I propose, however, that flexibility should be a candidate. Even if it is not th e only one, flexibility is at least desirable in a decision maker’s model, and we shall tr y t o retain as much as possible. I n practice, as we shall see i n Part II I and beyond, thi s usually means keeping parameters free. I t is also desirable that the descriptive elements of a decision making model should explicitl y recognize that the futur e is uncertain, which bring s us nicely to Chapter 5.
Exercise s 4.1 Show that (4.22) has a maximum where (4.23) is satisfied. 4.2 Show graphically that (4.23) has a unique solution u* (e), which is lower than the optimal flight speed in zero wind. 4.3 (i) Verif y (4.24). (10 The graph of M*(e ) in Fig. 4.2 seems almost linear but has a slight upward curvature. Can you prove this by using the shift technique of Chapter 2? 4.4 (1) Derive (4.33) and (4.34). (ii ) Verif y (4.35). Hint: Show that ln(l + w) > bw whenever -0.632 < w < 0, where b = et{e - 1) « 1.582.
164
Chapte r 4
Validation : Accept , Improve , or Rejec t
4.5 Show that the effect of futur e generations of trees in (4.38) is to make the optimal rotation tim e shorter than predicted by Section 3.4. Hint: You need only the fact that e is positive. 4.6 Show thaty(/) = vXiyie ' - 1) has a maximum at / = s*, where s* is defined by (4.40), provided V"(s") < 6V'(s'). 6
4.7 (i) Verif y that the attractin g equilibri a in Fig. 4.10 are stable but any others are unstable, by using the methods of Section 2.2. (ii ) Obtain (4.77). *4.8 Student A think s that in all of Section 4.13 there is no good reason to reject the model (1.54), so why not accept it and forget all thi s business about components and paradigms? Student Β think s the problem with (1.54) is that it will explain almost any kind of behavior for some value of a. Student C think s the problem with (1.54) is that so many real effects are incorporated int o a that it’ s almost impossible to infer from data what its value should be. What do you think ? *4.9 Student A says that the logistic growth model is a paradigm, because it was used in Section 3.7 to capture some qualitativ e features of a fish population’s growth and is too simple to provid e a realistic description of any population. Student Β says that the logistic growth model is not a paradigm but a predic› tiv e model, because it was used in Sections 1.9 and 4.1 to predict the growth of the U.S. population. What do you think ? "4.10 Student C says that the plant growth model of Section 1.3 was a paradigm un› ti l it predicted the growth in value of a stand of Douglas firs, then it became a predictive model. Student A says once a paradigm, always a paradigm. Stu› dent Β says that the plant growth model can’t be a predictive model because it’ s used as a component in Section 3.2, whose model is not predictive. What do you think ? *4.11 Student A says Section 2.8 provides a better model than Section 4.7. Student Β says Section 4.7 provides a better model than Section 2.8. Student C says that it doesn’t matter, because neither of them is any good. What do you think ? *4.12 (i) Let x(t) denote the number of species of bird s on an island at tim e t (not the number of individuals thu s if an island’s only inhabitants are 6 millio n gulls and 2 turtl e doves, then χ = 2). Let Ε denote the number of species becoming extinct per unit of time; let / denote the number of species immigratin g per unit of time. Writ e down a relation between dxldt, E, and /.
Exercise s
165
(ii ) Wil l the number of species immigratin g per unit of tim e decrease or increase with x? Why? What is the simplest dependence of / upon χ which incorporates your answer? Interpre t any parameters you introduce. (iii ) Wil l the number of species becoming extinct per unit of tim e decrease or increase with x? What is the value of Ε if χ = 0? What is the simplest dependence of Ε upon χ which incorporates your answer? Interpre t any pa› rameters you introduce. (iv) The biota of the island of Krakato a was completely destroyed by a vol› canic eruption in 1883 (Diamond and May, 1976, p. 175). Suppose that bird s subsequently began to immigrat e at the rate of ν species per unit of time. Identif y ν in your analysis. (v) The number of bir d species on Krakato a returned to equilibriu m quite quickl y (see Diamond and May, op. cit.). Use the direct method to find this equilibrium , according to your model. Show graphically that the equilibriu m is stable. (vi) Verif y that this equilibriu m is stable by solving the ordinar y differential equation in (i). What does the fact that the equilibriu m was reached quickly tell you about some of your parameters? According to Diamond and May, the number of plant species is still rising toward equilibrium . What would thi s tell you about your parameters, if your model were used for plants instead of birds? (vii) Criticiz e your assumptions, both the ones that you’ve made and the ones we’ve made here. What is wrong with the form of E(x) for small x? Attempt to improve your model. How does any new assumption affect the equilibrium ? Note: Even if the number of species on an island remains static, their identities will still change, because species are continually immigratin g and becoming extinct. 4.13 In the model of Section 4.11, we tacitly assumed that the parameters b b , c , c did not satisfy b b - c c = 0, as is clear from (4.70). There are good reasons for this: because of environmental fluctuations, only in› equalities between system parameters can be expected to have any validity . In a laboratory, however, where the environment is kept constant, equali› ties between parameters may be realistic. Therefore, in this exercise, we will discover the dynamical behavior of the system it
(
2
2
{
{
2
-77 = Aa
2
-b x-c y).
2
2
2
(i) Show that, if a b -a c φ 0, then the only equilibri a are at ( 0 , a / c ) and ( ,/ ,,ˇ) . Show graphically that (x(t),y(t)) approaches (a,/c,,0) if ,/c , > a lb and approaches ( 0 , a / c ) if a lb > a lc . (ii ) Show that, if a b - a c = 0, then every point on the straight lin e between ( 0 , a / c ) and (a,/c,,0) is an equilibrium . Show graphically that these equilibri a are metastable. x
2
2
2
2
x
2
2
{
2
2
2
2
2
{
2
2
x
{
2
166
Chapte r 4
Validation : Accept , Improve , or Rejec t
*4.14 If the model (4.74) of Section 4.12 does not give rise to a limi t cycle, then at least one of the assumptions embodied in it must be false. Which assumption concerning predators is questionable, and why? Can you suggest a better one? (Hint: Do Canadian lynx eat only snowshoe hare?) *4.15 The net specific growth rate of a human population is the difference between the specific birt h rate b and the specific death rate d, i.e., χ dt where x(t) denotes the population at time t in suitably large units (of a mil› lion people, say) and b and d are, respectively, the numbers of birth s and deaths per unit of time, per unit of existing population. A very special kind of population, which demographers call a birth cohort, consists of a large number of individual s of a certain sex (female, say) who were all bom at a certain time, say t = 0. The large number in question is usually taken to be 100,000 individuals, which we shall designate henceforward as the unit of population. Hence x(0) = 1. The population in question is so exclusive that, by definition, you cannot enter it unless you were already in it at t = 0. Thus b = 0. Demographers call d the force of mortalit y and prefer to denote it by the Greek letter μ. Hence - dx - = -,, 1
*v0 ) = 1, . m
Now, a person who is born at time t = 0 will be of age at time z, so that time and age are identical for our birt h cohort. Thus we can use age ζ instead of time / as our independent variable. The advantage of this is that the mortality , i.e., the specific death rate of the birt h cohort, usually depends much more strongly on age than it does on time. If we ignore the dependence of μ on tim e completely, then we have either of the following two equivalent forms:
or x(z) = exp
(i) Why should μ depend much more strongly upon age than upon time? When μ = ( ) , demographers say that mortalit y is fixed i.e., fixed at birth thoug h mortalit y would generally be lower at each age ζ for a cohort born in, say, 1950 than for one born in, say, 1890. How could exceptions to thi s arise? Hint: You may find the first of the two data sets in Table E4.1 helpful. (ii ) (You may wish to read Appendix 1 before attempting this part.) If you used Table E4.1 in answering (i) then you realized that decreasing mortalit y is related to increasing expectation of lif e at birth . We will now derive this relationship explicitly. Because x(z) is the fraction of the cohort alive at age z, the fraction of the cohort dying between the ages of ζ and + Sz, where
Exercise s
Table E4.1
167
Some lif e expectancies .
Lif e expectancy at birt h (in years) of Swedish females born in a given year
Lif e expectancy in 1967 of a Swedish female with the given age in years
Year
Expectancy …
Age
49.53 51.13 52.44 54.09 54.26 56.77 58.95 59.58 58.71 63.77 64.11 66.15 68.42 70.16 72.76 74.18 75.22 76.14
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85
1880 1885 1890 1895 1900 1905 1910 1915 1920 1925 1930 1935 1940 1945 1950 1955 1960 1965
Expectancy
X
76.58 72.59 67.68 62.76 57.85 52.98 48.13 43.32 38.54 33.84 29.26 24.78 20.46 16.35 12.61 9.36 6.86 4.89
Calculated on the assumption that specific death rates prevailin g at birt h remain constant throughout a lifetim e (adapted from Keyfit z and Flieger, 1971, pp. 102 and 464).
Sz is infinitesimall y small, is x(z) - x(z + Sz) = -x\z)6z
+ o(Sz),
where we use the "littl e oh" notation defined in Chapter 1. Hence, if the ran› dom variable L denotes length of lif e and / its probabilit y density function, then we can writ e f(z)6z + o(Sz) = Prob(z < L < ζ + Sz) = -x'(z)6z + o(6z). The expectation of lif e at birth , e , is simply the expected value of the random variabl e L. Hence show that 0
z]\z)dz = / x{z)dz. e = E[L] = / Jo Jo If ( ) were known as a function of z, then e could be calculated from the above formul a as 0
0
eo =
J
e x p
Q
{ ^ -
Mwtyz-
168
Chapte r 4
Validation : Accept , Improve , or Rejec t
(iii ) One of the first attempts to determine the form of μ(ζ) was made by Benjamin Gompertz (1825). He reasoned that mortalit y is partl y caused by humankind’ s "deterioration , or an increased inabilit y to withstand destruc› tion" and that "at the end of equal infinitel y small intervals of time, he lost equal portion s of his remaining power to oppose destruction," which is another way of saying that "power to avoid destruction" decreases at a con› stant specific rate. If "power to avoid destruction" is inversely proportional to mortality , what form of μ(ζ) would be implied by Gompertz’s reasoning, if that were the sole cause of death? Thi s form of μ(ζ) has become known as the Gompertz law of mortality . (iv) Demographers and actuaries use /(z) to denote the probabilit y that an individua l chosen randomly from a certain population will survive to reach age ζ (or beyond). Identif y /(z) wit h a quantity denned above. {Note: Strictly , your answer is what demographers call "/(z ) on radix 1." Radix denotes an arbitrar y scaling factor, here 1 but usually 100,000, by which values of /(z) are multiplied. ) (v ) Tables of values of l(z) are readily available as part of so-called life tables, which actuaries and demographers regularly compile and update. We wil l indicate how such tables are compiled in Section 8.6. Use the followin g excerpt from the 1966 lif e table for U.S. females (Keyfit z and Flieger, 1971, p. 354) to validate the Gompertz law of mortality .
Age 0 1 5 10 15 20 25 30 35 40
Kz) 1.00000 0.98003 0.97672 0.97493 0.97345 0.97058 0.96711 0.96285 0.95677 0.94805
Age 45 50 55 60 65 70 75 80 85
/( ) 0.93486 0.91519 0.88698 0.84706 0.79115 0.70671 0.59260 0.44656 0.27641
Say whether you believe the law to be valid for all ages, for some ages, or not at all. Hint: Review Section 1.9 and your solution to Exercise 1.10. (vi) Gompertz never believed, however, that "deterioration " was the sole cause of death. Rather, he believed that there were "tw o generally coexist› ing causes," the second of which was "chance, without previous disposition to death or deterioration." We might prefer to regard the second cause as constant exposure to the risk of accident. What form would μ(ζ) take if this constant exposure to accident were the sole cause of death? Deduce the form of I(z). Validate thi s mortalit y law by using the data above for U.S. females in 1966. Is there any range of values of in which thi s law explains the data
Exercise s
169
better than Gompertz’s law? Under what conditions could the second cause be the dominant cause of death? (vii ) Suggest a form for ( ) when Gompertz’s two causes are allowed to co› exist. Find the corresponding form of /(z). *4.16 There is a certain age, usually denoted as ω by demographers, beyond which no one can survive. Fries and Crapo (1981) call this the maximum life potential. As in the previous exercise, let /(z) denote the probabilit y of surviving to age (or more). Then /( ) = 0 for > ω; and the specific death rate, ( ) , must tend to infinit y as ζ —* ø to ensure that no one survives past age ω. A form of μ(ζ) consistent with this property is ( ) =
ω-ζ
,
0 < ζ < w,
where £ ( > 0) is a constant. (i) Wit h this form of ( ) , what is the probabilit y of surviving to age z? (See Exercise 4.15) What is the expectation of lif e at birth , e ? (ii ) Using the 1966 survival probabilitie s for U.S. females, quoted in Exer› cise 4.15, validate the mortalit y law above for the particular choices ω = 90, ω = 100, and ω = 110 (years). In each case, is the law valid for all z? If not, is there any indication that it might be valid for some z, i.e., that there exist Ziand z such that 0
2
μ{ζ) =
ω-ζ
z, < z < z ? 2
(iii ) Do your results surprise you in any way? What is the conceptual difficult y in using this form of ( ) for large values of z? Elaborate, comparing your analysis with that of Exercise 4.15. (iv) Can you suggest a way of resolving this difficult y and, at the same time, suggest a "hybrid " mortalit y law that gives a better fit to the lif e table data for U.S. females in 1966, in the range 30 < < ω, than either the Gompertz law or the one considered here? (v ) Criticiz e this hybri d mortalit y law. Does its better fit to data grant suf› ficient grounds for accepting it? If not, do you have sufficient grounds for rejecting it? *4.17 (i) For the U.S. population in 1970 (male and female), the probabilitie s of survival at age (or more) are given by Fries and Crapo (1981, p. 146) as follows:
Age 69 74 79 84
/( ) 0.64077 0.52308 0.38279 0.23805
Age 89 94 99 100
/( ) 0.11387 0.03927 0.00921 0.00656
170
Chapte r 4
Validation : Accept , Improve , or Rejec t
The same authors estimate maximum life potential to be ω = 115. Use the above data to validate the mortality model
where e is a constant, for ages beyond 70. Hint: Use the expression for / derived in Exercise 4.16. For the range of ζ for which you consider the model valid, estimate e graphically. (ii ) The same authors give probabilities of survival to age ζ (or more) in the range 29 < ζ < 64 as follows: Age ζ
/(ζ)
Age ζ
/(ζ)
29 34 39 44
0.95454 0.94675 0.93600 0.91995
49 54 59 60
0.89559 0.85969 0.80730 0.73560
Use these data and those of (i) to validate the Gompertz model μ(ζ) = αέ for ages beyond 29. For the range of ζ in which you consider the model valid, estimate a and c graphically. (iii) Using your answers to (i) and (ii), can you suggest a continuous function that models mortality for all ages beyond about 35? ζ
’4.18 In Section 1.6 and again in Section 3.3, we used the Cobb-Douglas production function Q = ADK " , where α, η are constants satisfying a > 0 and 0 < 7 < 1, to model the relationship between (real) output Q(t\ capital stock K(t), and labor Ut) at time t, in the manufacturing sector of an economy. But the output was expressed in dollar terms as Y(t)IP(t), where Y denotes nominal value of goods produced and Ρ denotes price index. Because everything is expressed in dollar terms, there is no reason to confine this model to a manufacturing sector. It can be applied just as easily to the produce grown by an agricultural sector or the services provided by office workers. Hence the model can be applied to an entire economy. In Section 3.3 we predicted that the optimal amount of labor for such an economy to employ would be 1
1
where w(t) is the annual wage paid to a unit of labor. As when validating the crop-spraying model of Section 3.6, let's assume that what businesswomen do is also what is optimal, by virtue of trial and error. Having made this assumption, if the Cobb-Douglas model is a good one, then the wages paid to labor in the entire economy should equal w(t)L'(t). Denison (1974, p. 260) has estimated w(t)L'(t) as a fraction of nominal output Y(t) for the entire economy of the United States (including Alaska and Hawaii) for most of the 1960s. Denison's estimates for the years {196f: 0 < t < 8}, are as follows:
Exercise s
t
no
0 0.8222 1 0.8226 2 0.8087
t
"WO no
/
»W(t) ϊ(.ι)
3 4 5
0.8047 0.7980 0.7833
6 7 8
0.7814 0.7983 0.7984
171
Based on these estimates, how well did the Cobb-Douglas production function model the relationship between capital, labor, and output in the decade of the 1960s? *4.19 How good are the chemical dynamic models of Sections 1.10 and 1.11? First decide how you could test them, then ask a friendl y chemistry professor about where you might find some data. *4.20 In Section 4.5, investigate the possibility that the false assumption is not that there is no following wind, but rather that S is the same for all birds. *4.21 In Section 3.1, even if there were no following wind, (3.10) would underestimate how far a bird can migrate because we have assumed that mass is constant through› out. In reality, however, mass decreases durin g flight from m to º/ , where º is significantly less than 1. For example, º = 5/8 when a yellow wagtail migrates across the Sahara desert (Alexander, 1990, p. 447). How much further than (3.10) predicts can a bird migrate? How much does thi s result affect the analysis in Section 4.5?
This page intentionally left blank
THE PROBABILISTI C VIEW
This page intentionally left blank
5
BIRTH AND DEATH. PROBABILISTI C DYNAMICS
Th e dynamical models we met in Chapter 1 are all deterministic.’They predict that the state of some system at tim e t perhaps the speed of a boat or the weight of a plant i s certain to be, say, JC. I f the model is correct, then there is no possibility that the state in question might instead tur n out to be y or z. Now, thi s approach is quit e acceptable if the system being modelled is protected fro m unexpected shocks; for example, if the plant is in a laboratory , where unexpected drought wil l not affect it s growth, or if the boat is rowed on a calm day, so that no gusts of win d wil l affect it s speed. But an element of uncertainty is an intrinsi c part of the worl d i n which we live, and we cannot ignore it indefinitely . Accordingly, in thi s chapter, we develop models that recognize uncertainty explicitly . They do not predict that the state of a system is certain t o be χ at tim e /; rather , they predict the probability that the state wil l be at tim e /. For reasons that wil l soon emerge, we begin our study of probabilis› ti c models by takin g a fresh look at a deterministic one, namely, Section 1.9’s logistic model for U.S. population growth. According t o thi s model, th e state of the population at tim e t, namely, x{t) units, is the number of millions of people in the United States at tim e t. Because the addition or removal of one individual , to or fro m the population, corresponded t o additio n or removal of such a tin y fractio n of the unit in which the population was measured in Section 1.9, we could imagine that χ varied continuously. So we made x(t) a real-valued function. I f the number of in› dividual s in an entir e population is small, however, then one individua l corresponds t o a significant fractio n of it , and it is no longer legitimate t o let the state of the population be a real-valued function. I n thi s chapter, because we are interested in the dynamics of small populations, we wil l deYou may wish to study Appendix 1 before proceeding. 175
176
Chapte r 5
Birt h and Death . Probabilisti c Dynamic s
part fro m the approach of Section 1.9 by making the state of a system an integer. Because we have already departed fro m the approach of Chapter 1 by choosing probabilisti c models, the state of a system at tim e t must be an integer-valued random variable. We wil l denote it by X(t) and allow it t o take values /’ = 0, 1,2, ...,N. Thu s the dynamical systems we describe i n thi s chapter, by using probabilisti c models, have Ν + 1 possible states. But Ν may be as large as we please, and it wil l sometimes be convenient t o regard it as infinite . For a fixed value of t, X(t) is a single random variable. But t may take any value satisfying 0 < t < oo. Hence we deal, in effect, wit h an infinit e set of random variables, namely, S, = {¸ˆ(/): 0 < / < o o } . We give S, a name: we call it a continuous-time stochastic process. Al l random variables i n thi s stochastic process have th e same sample space, namely, the integers between 0 and N. But they do not in general have the same distribution . Rather, their distribution s depend on the value of th e parameter /. (I n th e special case where all distribution s are indeed identical, the stochastic process is said t o be stationary, as we shall see in the followin g chapter.) Althoug h we depart fro m the approach of Section 1.9 in tw o respects, by making the state a random variabl e and by making it an integer, one importan t propert y of the logistic model is retained i n our probabilisti c models. Suppose that a population that is growing logistically, wit h maxi› mum specific growth rat e R and capacity K, is known to have magnitude / at tim e t = s. Then it s size at tim e t = s + is obtained by integratin g th e differentia l equation (5.1) forwar d in tim e fro m t = s to / = J + r , subject t o the initia l condition x(s) = I. We obtain IK I + {K-I)e-*r" Notice that thi s expression is completely independent of J. Thus, r unit s of tim e after it had magnitude / , th e population wil l have magnitude (5.2), no matter where in the course of history it had magnitude / . I n other words, if th e model is correct, and if t = s is regarded as th e present time, then you can foretell the population’s futur e by knowing only it s current magnitude / . You do not need t o know anything about it s past. I n thi s sense, the logistic growth model has no memory, and it is thi s memorylessnes s which our probabilisti c models wil l retain. Th e propert y that th e futur e depends only on the present, and not on th e past, is known in the literatur e on probabilit y as the Markov property . Thu s the models of thi s chapter are Marko v models. Because these models are probabilistic , the mathematical formulatio n of the Marko v propert y i s not quit e as simple as saying that x{s 4- r ) depends on τ and x(s), but X
(
S
+
T
)
=
(5
2)
Chapter s
Birt h and Death . Probabilisti c Dynamic s
177
not on s itself. Rather, we say that, i f X(s) = /, then the probabilit y that X(s+ τ) = j depends on τ and i, but not on s itself. I n term s of conditional probabilities , P r o b ( X ( s + r ) = j \ X(s) = /’) is independent of J. Because it’ s independent of s, we might as well set s equal t o zero, and that’ s why the Marko v propert y is usually stated as P r o b ( * ( 5 +t)
= j \ X{s) = i) = P r o b ( * ( i ) = ; | X{0) = i),
(5.3)
where we have replaced τ by /. What gives rise to the Marko v property ? We can understand best by returnin g t o the logistic growth model, where th e net specific growth rat e μ = b - d is given by
/,(* ) = ¸
(5.4)
and imagining instead that, for some strange reason which need not con› cern us, we had another population for which the net specific growth rat e was μ = μ(χ,ή
= Κί(ΐ-^).
(5.5)
Replacing the right-han d side of (5.1) by (5.5) and integratin g fro m t = s t o t = s + τ, subject t o x{s) = I, yields
IK ^
+
τ
)
=
/
+ ( Λ Γ - / ) ^ * ^ > ·
< · > 5
6
Notice that thi s expression is no longer independent of J. Our strange pop› ulatio n has a sense of history! Comparing (5.5) and (5.6) wit h (5.1) and (5.2), we see that the Marko v propert y of the logistic growth model arises fro m the assumption that the specific birt h rat e b, the specific death rat e d, and, as a consequence , the net specific growth rat e μ depend only on th e state; i.e., b = b{x) and d = d(x), implyin g μ = μ(χ). An explicit de› pendence of μ on t, as in (5.5), would destroy the system’s memorylessnes s (ther e is always, of course, an implicit dependence of μ on t, because χ depends upon )• I n the logistic growth model, the number of unit s added t o th e popu› latio n in the infinitesimal interval [t, t + 6t), per unit of existing population, i s b(x)St + o{8t). Similarly , the number of unit s removed in the interval [t, t + St), per unit of population, is d(x)6t + o(St). Because the logistic growt h model is deterministic, and because χ varies continuously, we can be certain that these amounts are added and removed in the infinitesimal interval . I n a probabilisti c model, however, we cannot be sure that anyone was born or died in the interval [/, / + St). We can do no more than assign some probabilit y t o a birt h or death. Th e longer the interval [t, t+ St), the mor e likel y it is that someone is bor n or dies. I t therefore seems reason› able t o assume that the probabilit y of a birt h or death is proportiona l to St. On the other hand, if the interval is short enough, then the probabilit y
178
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
of tw o or more births , or tw o or more deaths, or a birt h and a death, is negligible. We can make these ideas precise by saying that th e probabili › ties of th e latter events are o(St)\ whereas the probabilit y of a birt h when th e state of th e population is i is b(i)6t + o{6t). I t is customary t o denote functional dependence upon an integer by using a subscript, however, and so we prefer t o writ e the probabilit y of a birt h as (5.7)
bfit+otft).
Similarly , we let th e probabilit y of a death when the state of the population i s / be d(i)6t + c(6t) or, in subscript notation, (5.8)
dfit + o(6t).
Th e previous paragraph suggests that our models should then retain the Marko v property ; and indeed they do, as can be verified fro m the examples below. I t wil l be convenient t o go on calling b the birt h rat e and d the death rate, but these should now be interpreted as probabilitie s per unit of time, rather than specific rates of additio n or removal. I n Chapter 1, we introduced a generic term for growth and decay; we called it dynamics. Similarly , we shall find it useful t o have a generic term for th e events that increase or decrease th e state of a system by 1, i.e., for birth s and deaths; we shall call them transitions. On the other hand, birt h and death are not always the most suggestive labels for these tw o transitions; and, where appropriate, we shall replace the labels birt h and death by arriva l and departure, entrance and exit, rise and fall , or even repair and malfunction. But the transition s wil l still be described by (5.7) and (5.8). Only th e label wil l have changed, t o conform t o everyday usage. Th e goal of our models, as stated i n th e opening paragraph, wil l be t o assign probabilit y t o the event that the state of a system is i at tim e t. We wil l therefore attempt t o assign numerical values t o •( ), where we define t
t
(
τ ft) = Prob(*(f ) = / ) ,
/ = 0 , . . ., N.
(5.9)
Th e Ν + 1 values {*,•(’): / = 0 , 1 , . . ., W} constitute th e probabilit y distribu › tio n of the discrete random variabl e X(t) and must therefore sum t o 1:
j[>/(0=l .
<
5 1 0
>
I t wil l be convenient t o record these values as the (N + l)-dimensional column vector *(i ) = ( » o « ) . * iW
M0) , r
( 5 . H)
where a superscript Τ denotes transpose; ( ) wil l be called the system distributio n vector. I t wil l also be convenient t o denote (5.3) by r,y(f) , i.e.,
Chapte r 5
Birt h an d Death . Probabilisti c Dynamic s
179
t o define rijU) = P r o b W O = j I * ( 0 ) = 0,
0 < i,j < N.
(5.12)
For fixed /, {/,•,(/): 0 <j < N} defines a conditional probabilit y distributio n whose terms must sum to 1; i.e.,
l >,y(0=l ,
(5.13)
0
For 0 < / < Ν we have N+ 1 conditional distributions , and it is convenient t o store them as the rows of the (TV + 1) (Ν + 1) matri x
RW=M0].
(5.14)
W e note in passing that any square matri x wit h rows summing t o 1 is called a stochastic matrix. Hence R is stochastic. exhaust the sample space of a ran› Now, if disjoint events U ,U ...,U dom variable, and i f U is any event in the same sample space, then 0
h
N
Ν
Prob(C/) = Σ Prob(C/ | U ) • Prob(C/^ ; *= o
(5.15)
k
see (A. 13). N o te that the event U does not have t o be associated wit h th e same random variabl e as the events U , U ,..., U . I n particular , U may be the event that the random variabl e X(0) takes the value k, and U may be the event that X{t) takes the value /. Then X(0) and X(t) are different random variables, but they have the same sample space and belong to the same stochastic process. Hence: 0
{
N
k
If Prob(*(f ) = 0 =
= i | * ( 0 ) = Jt) • P r o b W O ) = k).
^ob{X(t)
(5.16)
On using (5.12): Ν
»«<0 = *’<’> *<)’ r
0
(5.17)
or in matri x notation, (0
ˆ
= 7r(0) R(f) . r
(5.18)
For given ( 0 ) , (Ø) can be deduced fro m (5.9) as soon as R(i) is known. For thi s reason, our major preoccupation in thi s chapter wil l be wit h the matri x R(f). Th e first of our examples is the simplest one possible, a probabilisti c model for a population that may contain at most one individual .
180
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
5.1
When Wil l an Ol d Man Die? Th e Exponentia l Distributio n
Suppose that a population consists of just one old man. Sooner or later he wil l die; then there wil l be no one. Let the random variabl e X(t) denote th e number alive in thi s population at tim e t. Then X has sample space { 0 , 1 } ; i.e., the tw o possible states of the population are = 0 and i = 1, and th e matri x (5.14) becomes R(0 =
> o o (0
Ø ( 0’
ˆ
.’IOW
r
n(0.
W e wil l now proceed t o derive explicit expressions for the entries of thi s matrix . / / t h e man were dead at tim e t = 0 then he would have t o remain so. Hence ProbLY(r ) = 0 | * ( 0 ) = 0) = 1, Prob(^(i ) = 1 | * ( 0 ) = 0) = 0. Thus, by (5.12), ˆ ˇ = 1 and r ,(f ) = 0. But the man is alive at tim e t = 0, so that we would not expect r and r t o have any bearing on hi s future ; and thi s is confirmed by (5.20) below. By (5.13) wit h / = 1 = N, i.e., because the last row of the matri x R must sum t o 1, we have r, (f ) + r,,(i ) = 1. Hence 0
00
0l
0
R(0 =
1
0
(5.19)
r,,(f)J
. I - r,,(r )
Th e man is alive initially , and so we have -JT(O) = (0, l ) . Hence on using (5.18) th e system distributio n vector ir(r ) is given by r
= (0, l)R(f ) = (l - r (r) , r ( 0 ) ,
π«)
τ
(5.20)
and
is completely determined if we know r,,(i) . W e shall obtain r (t) below fro m a differentia l equation, which re› quire s an initia l condition. A suitable one emerges fro m th e observation that if th e man is alive at tim e t = 0, then he cannot also be dead at t = 0, though he could conceivably be dead at tim e t = e for any value of e > 0, however small. Hence n
r,,(0) = Prob(AT(0) = l | * ( 0 ) = l ) = l .
(5.21)
Let I/ , be the event that the man is alive at tim e /, i.e., that X(t) = l . Let U be the event that he is dead at tim e f, i.e., that X(t) = 0. Let U be the event that the man is alive at the later tim e t + St, i.e., that X(t + 6t)= l , where St is infinitesimall y small. Thu s U and (7, are associated wit h the random variabl e X(t), and U wit h the random variabl e X(t+ St); but both random variables have the same sample space { 0 , 1} and belong t o the same stochastic process. Th e man must be either alive or dead at tim e t, and so U and U exhaust the possibilities then arising. Hence, fro m (5.15) wit h Ν = 1, we have 0
0
0
{
P r o b [ i / ] = Prob[t / | U ] • ?rob[U ] 0
0
+ Prob[U
\ U ] • Prob[C/,] . {
(5.22)
5.1
When Wil l an Ol d Man Die? Th e Exponentia l Distributio n
181
But Prob[t / | U ] = 0, because the man cannot be alive at tim e t + St i f he is dead at tim e t. Also, fro m (5.9) and (5.20), we have Prob[C/] = ?T0b(X(t + 6t) = 1) = r ( / + if) ; and Prob[C/,] = Prober) = 1) = r ( i ) . Moreover, because Prob[[ 7 | C/, ] is the probabilit y that the man survives fro m t t o l + St, 1 - Prob[£7 | £/,] must be the probabilit y that he dies withi n the interval [t,t + St), which, fro m (5.8), equals d St+o(8t). Hence (5.22) reduces to 0
u
{
r (t u
+ St) = (1 - d 6t+
(5.23)
o{St))r {t).
x
n
Rearranging and dividin g by St, we get
'..ft+«>-'..«.^„„ «w M+
Takin g the limi t as St
(5
.
24)
» 0, we have j {r M t
i
(5.25)
= -d r (t). i
ll
Solving thi s ordinar y differentia l equation and using (5.20) and (5.21), we get *i(f l = r (t) u
0
( 0 = r (t) l0
= r,,(())«-’ " = e~ '
(5.26)
d 1
= 1 - r,,(/ ) = 1 - e~ >'.
(5.27)
d
Thu s the probabilit y that th e population remains in state 1 i.e. , th e prob› abilit y that the old man does not die decay s t o zero exponentially as tim e increases toward infinity . Thi s is the probabilisti c analogue of the natural decay process of Chapter 1. You can verif y directl y that thi s model satisfies the Marko v property . Let C/, be the event that the man is alive at tim e s, U the event that he i s dead at tim e s, and U the event that he is alive at tim e t + s. Because th e man must be either alive or dead at tim e s, U and U exhaust the possibilities then arising, so that 0
0
{
Prob[C7] = Prob[[ / | U ] • Prob[C/ ] + Prob U\U,]0
Prob[f/,] .
0
(5.28)
But Prob[£7 | U ] = 0, because the man cannot be alive at tim e t + s i f he i s dead at tim e s. Moreover, Prob[C/] = ?rob(X(t + s) - 1) = 7r,(i + s), and P r o b [ i / , ] = Prob(AXj ) = 1) = , ) . Hence (5.28) implies 0
Prober + s)
= 1 I X(s) = 1) = Prob[t / | £/,] =
^ – i >
ir,(j )
= e- >' = Prob(*(r ) = 1 | X(0) = 1); d
e- " d
(5.29)
i.e., (5.3) is satisfied. But there’s another way t o look at this. Let the random variabl e G de› note the tim e unti l death in the old man’s lif e or, wit h a view t o generaliza› tion , the time until transition. Then the cumulativ e distributio n function
182
Chapte r 5
Birt h and Death . Probabilisti c Dynamic s
of G is given by Prob(G >t)=
(5.30a)
e~ '' d
or Prob(G < t) = 1 - e- .
(5.30b)
dlt
Thi s importan t distribution , called the exponential distributio n wit h the propert y that
distribution,
Prob(G > t + s I G > s) = Prob(G > t)
is th e only (5.31)
for all t, s > 0. Indeed (5.3) and (5.31) are equivalent statements of the Marko v propert y of memorylessness . Thus, if the model is correct, the old man’s chances of livin g t o age 97, having just reached 95, are the same as hi s chances of livin g to be 87 were when he had just turned 85. Th e cumulativ e distributio n function Prob(Cr < /) is plotted in Fig. 5.1 (we wil l need thi s diagram in Section 8.7). Th e probabilit y density function of the exponential distributio n is given by f(t)=
j {?Tob(G
0 < f < o o;
= d e- ', d>
[
l
whence the mean μ and variance σ
of the distributio n are given by
2
Γ tf{t)dt=±-, Jo d\ r°° = (ί-μ) /Μί=±.
(5.33a)
μ= 2
(5.32)
2
Ø
(5.33b)
PROB(G< M
0
2/d
t
3/rf,
W,
5/rf,
Fig. 5.1 Cumulative distribution function (5.30b) of the exponential distribution.
5.2
When Wil l ˝ Men Die? A Pur e Death Proces s
183
Fro m (5.33a), we can interpre t the death rat e as d, = MEAN TIME UNTIL TRANSITION
1
5.2
.
(5.34)
Whe n Wil l Ν Men Die? A Pur e Death Proces s
Th e model we have just discussed is a very simple example of a pur e death process. We wil l now consider a more general death process, in which a pop› ulatio n consists of Ν old men, dead or alive. Let the random variabl e X(t) denote the number alive at tim e t. Then X has sample space { 0 , 1 , . .. ,N}\ i.e., the Ν + 1 possible states of the population are / = 0, 1, . . ., N. I f Ø men are alive at tim e 0, then there cannot be more than / men aliv e when t > 0. Hence r^t) = ?rob(X(t)
if/
= j \ X(0) = i) = 0
(5.35)
I n other words, the matri x R(/), denned by (5.14), is lower triangular . More› over, if / men are alive at tim e 0 then there cannot also be j men alive at tim e 0 unless i = j . I t is convenient to express thi s idea by introducin g some new notation. Let us define the Kronecker delta by
>-{l ν>*Λ"*°·
(
*·
1
< > 5J6
Then r {0) = 6 , u
(5.37)
0
ij
N ow suppose that / men are indeed alive at tim e 0; i.e., restrict the sample space of ¸ˆ(0 ) to the event that X(0) = i. Let U denote the event that j men are alive at tim e t+St, where St is infinitesimall y small. Let U denote th e event that j men are alive at tim e /, U the event that j + 1 men are aliv e at tim e t, and t / the event that more than j+ 1 men are alive at tim e /. Because I/, , U , and C/ exhaust the possibilities then arising, we have {
2
3
3
2
Prob[C/] = Prob[C/ | £/,] • Prob[{7J + Prob[£/ | U ] • P r o b [ i / ] 2
2
+ Prob[C/ I U ] • Prob[C/ ] . 3
3
(5.38)
On using (5.8), the probabilit y of a death in the interval [/, f + St), i f X(t) j+ 1, is d St + o(6t) = Prob[{ 7 | U ]. Similarly , the probabilit y of no death i n the interval [t,t + St), if X(t) = j , is 1 - djSt + o(St) = Prob[t / | C/,]; whereas Prob[C/ \U ] = o(St). Because X(0) = i, Prob[C/,] = Prob{Xtt) = j) = Prob(*(i ) = ; | X(0) = /) = r^t), on using (5.12). Similarly , P r o b [ [ / ] = ’ /,>+1(0 Prob[i7] = rjjO + St). Substituting int o (5.38), we have J+l
2
3
2
a
n
d
r (t + St) = {[-d St u
j
+ o(6t))r (t)+ iJ
{d 6t j+l
+ o(6t)}
r (t) ij+l
+ o(5/)Prob[f/ ] . 3
184
Chapter s
Birt h and Death . Probabilisti c Dynamic s
Hence '— = -djr (t)
Λ J t
+ d r (t)+
u
j+l
^f.
iJ+l
N o t e that an expression for Prob[£/ ] is not required. Takin g th e limi t as St -+ 0 now yields the ordinar y differentia l equation 3
^
{ r ( / ) } = -djr^t)
(5.39)
+ d r U),
ff
J+l
IJ+l
wit h (Exercise 5.1) solution r (r) = ff
f e- *'-\ (s)ds.
e-4V°> + 4 . +
(5.40)
d
j+l
Jo
Because r (s) = 0 by (5.35), we observe, on s e t t i n g) = i in (5.40) and using (5.37), that r,,(/) = r, (0) exp(-,f) = e x p ( - i / , i ). N ow let X(s) = /'; and let the random variabl e (?,• denote tim e that elapses unti l the follow› in g death or, i n more general terms, tim e unti l the next transition . Then Prob(G, > 0 = Prob(*( f + s) = i \ X(s) = i) = Prob(Z(/ ) = i \ X(0) = i) = r, (i) on using the Marko v propert y (5.3). Thu s the tim e unti l transitio n is exponentially distribute d wit h mean l/df, or u+l
7
;
(5.41a)
Prob(Gi,> t) = e- , dlt
d, = . (5.41b) ' MEAN TIME UNTIL TRANSITION ' Expression (5.40) is valid for all / and though, in view of (5.35), we do not need it for i < j . Thus the probabilitie s r./f ) can be found recursively, startin g wit h the diagonal elements of the matri x R(f) and moving leftwar d along the rows. For example, suppose that d = D = constant (i.e., indepen› dent of 0 for i > 1; we must, of course, take d = 0, because the death of the entir e population precludes further deaths of individuals. Then for Ν = 3 we obtain v
t
0
1
R(/) =
11 - e~
e
+ Dt+
Dl
0
0 e~
D t
- Dte~
Dt
1 - e~ (l
-
0
Dt
Dte-
Dt
Dl
\D t ) 2'
\D t e-
2 2
2 2
e
Dl
-Dt
o·
0
0
Dte-
Dt
Notice that thi s is indeed a stochastic matrix . Notice also the pattern of entries, fro m which the structur e of the general (Ν + 1) (Ν + 1) matri x R(/) is readily apparent. Clearly, the probabilit y that TV old men alive today wil l all have died t years fro m now is r
m
( )=l-et
D
'
f -^, *= o * • N
{
(5.42)
where 1/D is a man’s lif e expectancy. We should bear in mind, however, that d-, = D is not realistic why ?
5.3
5.3
Formin g a Queue . A Pur e Birt h Proces s
185
Formin g a Queue . A Pur e Birt h Proces s
Suppose that a queue is formin g at a checkout counter. Let the random variabl e X(t) denote the number of individual s in the queue at tim e t, and let Ν be the maximum number of individual s for which the queue has room. Then X has sample space { 0 ,1 N), and we can thin k of arrival s as birth s in a population wit h ˝ + 1 possible states, namely, / = 0, 1, . . ., /V. We wil l assume that there are no departures fro m the queue or, as it were, no "deaths" in the population. Th e process we are about t o describe i s therefore a pur e birt h process. Suppose that there are / individual s in the queue at tim e 0; i.e., X{0) = i. Because there are no departures, r {t) = Prob(Z(i ) = j I X(0) = i) = 0,
if i > j ;
v
(5.43)
i.e., the matri x R(i) is upper triangular . Let U denote the event that there are j individual s in the queue at tim e t + St, where St is infinitesimall y small. Let C/, denote the event that there are individual s in the queue at tim e t, U the event that there are j - 1 individual s in the queue at tim e /, and t / the event that there are less than j — 1 individual s in the queue at tim e t. Because U , U , and £/ exhaust the possibilities then arising, i.e., exhaust the sample space of X(t), (A. 13) implie s that 2
3
x
3
2
Prob[C7] = Prob[t / | t/,] • Prob[{7,] + Prob[i 7 | U ] • P r o b [ t / ] 2
2
I U ] • Prob[C/ ] .
+ ?tob[U
3
3
(5.44)
On using (5.7), the probabilit y of a birt h in the interval [/, t+ St) if the state of the population i s ) - 1 is bj_ St+ o(St) = Prob[i / | U ]. Similarly , the probabilit y of no birt h in the interval [t,t+St) if the state of the population i s j is i-bjSt+o(6t) = Prob[t / | C/,]; whereas Prob[C/ | t / ] = o(St). Because ΛΓ(0) = Ø, Prob[(/,] = Prober) = ; ) = Prob(^(/ ) = j \ X(0) = i) = r {t), on using (5.12). Similarly , Prob[£/ ] = /•,;_,(/) and Prob[£/] = r {t + St). Substitutin g int o (5.44), we have {
2
3
0
2
jy
njU+St) = { l - b j 6 t + o(St)} r (t)+{b _ St+ ij
j
o{6t)} r , . , _ , ( / ) + 0 ( ^ ) P r o b [ C / ] . 3
l
Rearranging, as in the previous section, and takin g the limi t as St — 0 now yields the ordinar y differentia l equation
wit h (Exercise 5.2) solution r (i ) = e-^'Sjj + bj_, iy
/' e - ' - \ _,[s)ds, Jo b
( l
s
y
(5.46)
because r y(0) = Sy, as in the previous section. Because /"/,,•_ | ( J) = 0 by (5.43), we observe on setting j = i in (5.46) that r (l) = ekp(-bjt). N ow (
u
186
Chapte r 5
Birt h and Death . Probabilisti c Dynamic s
let X(s) = i, and let the random variabl e (7,• denote th e tim e that elapses unti l the followin g birth , or, in more general terms, the tim e unti l the next transition . Then Prob(G, > t) = Prob(*( f + s) = i | X(s) = i) = ProbL¥(/) = i | ¸ˆ(0 ) = 0 = r (i) , on using the Marko v propert y (5.3). Thu s the tim e unti l transitio n is exponentially distribute d wit h mean \lb{, or Prob(G > /) =
(5.47a)
f
(5.47b)
MEA N TIM E UNTI L T R A N S I T I O N ’
Expression (5.46) is valid for all«’ and j though, in view of (5.43), we do not need it for / > j . Thu s the probabilitie s r {t) can be found recursively, startin g wit h the diagonal elements of the matri x R(/) and moving t o the righ t along the rows. For example, suppose b = Β = constant for 0 < i < Ν - 1; we must, of course, take b = 0, because there is space for only Ν individuals . Then for Ν = 3 we obtain (j
t
N
-Bt
a
R(0 =
0 0
Bte~ •Bt e-"' 0
\B t e~ Bte-
Bt
0
2 2
Bl
Bt
1 - e-»'(l +Bt+ {B t y 1 -«?-*’ ( 1 + Bt) 2 2
-Bl
I -
0
0
e •Bt 1
N o t i ce that thi s is indeed a stochastic matrix . Notice also th e pattern of entries, fro m which the structur e of the general ( J V + l ) x ( ; V + l ) matri x R(/) is readily apparent. Clearly, th e probabilit y that a queue that began wit h i people wil l have people at tim e f is given by (Bty -i
-Bt
0 - 0! V 0 =
N-i-l
1-e L 1,
- 1;
i(0<j
a
•Bt
k=0
(Bt) kl
k
i f 0 < <
(5.48)
- l,y = N;
i f / = ; = N.
Though Ν wil l always be finite for th e queue at a checkout, there are other queues for which Ν may be regarded as infinite . Indeed the pur e birt h model wit h constant birt h rat e bj = Β and infinitel y many states occurs so frequentl y in mathematical modelling that we give it a special name; we call it the Poisson process. Let the random variabl e A{t) denote the number of arrival s by tim e t in a Poisson process. Then, setting j = k, i = 0, and lettin g Ν - + co in the first part of (5.48), the distributio n of A is given by Prob04(i) = k) = P r o b ( * ( 0 = k \ X(0) = 0) = r {t) ok
= <ˆ*’ ^
•
(5.49)
We call thi s distributio n the Poisson distribution . You can easily verif y (Exercise 5.2) that it s mean is Bt; i.e., an average of Bt individual s arriv e i n any interval of length r.
5.4
How Bus y Mus t a Road Be t o Requir e a Pedestria n Crossin g Control ?
187
Th e Poisson distributio n is closely related t o the exponential distribu › tion . To see this, let the rth individua l arriv e at tim e s, and let the random variabl e G, denote the tim e that elapses before the next arrival . Then, be› cause of the Marko v property , the random variables G G , G , are independent. We shall call them the interarrival times. On using (5.3) and observing that every entry on the diagonal of R(f) is e~ , we have l3
3
2
Bt
Prob(G, >t) = Prob(X(f + s) = i \ X(s) = i) = r (t) = e~ .
(5.50)
Bt
u
I n other words, the interarriva l times in a Poisson process have identical exponential distributions , wit h mean 1/5. We shall use thi s fact in the followin g section. Havin g now described both a pur e birt h model and a pur e death model, th e logical next step might be to describe a model in which birth s (or arrivals ) and deaths (or departures) can both occur. We prefer, however, t o address thi s matter later, in Section 5.5. Meanwhile, let’s appreciate the power and usefulness of even a simple probabilisti c model.
5.4
How Bus y Mus t a Road Be to Requir e a Pedestria n Crossin g Control ?
Let ¸ denote the average number of cars per second that pass a point on a road where pedestrians cross. We wil l assume that these cars all travel i n the same direction, as in each lane of a two-lane road wit h a median. I f traffi c is flowin g freely, then the passing of a car may be regarded as an arriva l in an infinit e queue. Thi s suggests using the Poisson process (5.49) as a model for the traffi c flow, wit h interarriva l tim e Gj as th e tim e gap between the (j - l)t h car and the jth. But if a second is the unit of tim e then, fro m (5.49), the average number of cars per second is °° k
ˆ0
^ø
°°
=
k
) = T ,
e
~
Jt=i
k=\
ok-1
Dk k
B
T i
=
B
e
~
TFTT V =
B
"·
k = i
K
K
l )
B
E
’
B
E
B
=
B
-
-
(5.51) Thu s º = Β, and gaps between cars have the exponential distributio n Prob(G,- > 0 = e~ . (5.52) xt
Let Τ be the tim e it takes a typical pedestrian t o cross the road. Then th e probabilit y that a typical pedestrian crosses the road durin g the y’th tim e gap, i.e., between the (j - l)t h car and the jth, is 7, = Prob((7 < ˆ , G, < T,G < 0
2
T,..., G,_ < T, G _,
= Prob(G < T) • ProbiG, < T)... 0
= (1-<
º 7
ˆ ’ •<ˆ
º ˆ
,
2
}
> T)
Prob(G,_ < T) • Prob(G,_, > T) 2
(5.53)
where we have used (A. 5 7) and the fact that interarriva l times are indepen› dent. Thu s the mean number of gaps that a typical pedestrian requires t o
188
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
cross the road (includin g the gap durin g which he crosses) is (Exercise 5.4) oo
Σ^
=
βΧΤ
·
<· > 5 54
Let Æ denote the average length of the gaps that occur whil e a typical pedestrian is waitin g t o cross. Then a typical pedestrian’s average waitin g tim e is ( e * - l ) a. Now, let τ be the longest tim e for which, on average, a typical pedes› tria n can reasonably be expected t o wait. Then a crossing control is needed unless r
(^ -l)a
(5.55)
r
Whatever the value of a, it cannot exceed T, for then at least one tim e gap would have exceeded Τ and the pedestrian would have been able t o cross th e road. A sufficient condition for (5.55) is therefore ( e * - l)T < r , or r
A
(5.56)
W e can regard the right-han d side of (5.56) as expressing the maximum rat e at which cars should be allowed t o pass if pedestrians are not t o be delayed unreasonably, or, because long delays encourage pedestrians t o take risks, as the maximum safe traffi c flow. I t is convenient to convert thi s quantit y int o number of cars per hour and express it as a function of the widt h of the road. Suppose that τ is 60 seconds. Let d be the widt h of the road in feet, and assume that a pedestrian walks at 3.5 feet per second. Then Τ = 2dP and, on using (5.56), the maximum safe traffi c flow in cars per hour is 2
(d)=-j-\a[\
+ -j-).
(5.57)
Th e graph of φ is sketched in Fig. 5.2. Points in the d-φ plane below thi s curve represent safe traffi c flows, and point s above the curve represent unsafe ones. Notice how sharply the permissible traffi c flow decreases wit h increasing road width . For example, a traffi c flow of 1500 cars per hour would be judged safe if the road were 20 feet wide, but a flow of only 875 cars per hour would be deemed unsafe if th e road were 30 feet wide. Thus crossing controls for pedestrians are essential on principa l highways, where, because traffi c is heavy and d is large, it is almost certain that traffi c flow exceeds φ{ά). How good is thi s model? D o es it s descriptive component fit th e facts for freely flowing traffic ? We should not accept thi s model unti l we have shown that passing cars may reasonably be regarded as arrival s in a Poisson See Supplementary Note 1.
5.5
Th e Ris e and Fall o t th e Compan y Executiv e
189
A 2 0 00
1 5 00
1 0 00
5 00
0
50
100
150
2 00
2 50
3 00
* d
Fig. 5.2 Maximum safe traffi c flow in cars per hour as a function of road width in feet, according to (5.57).
process. Therefore, in Section 8.7, we wil l analyze some traffi c data and verif y that our assumption is indeed a reasonable one.
5.5
The Ris e and Fall of th e Compan y Executiv e
I n thi s section, we wil l develop a probabilisti c dynamic model in which "births " and "deaths" are both allowed, though the probabilit y of more than one such transitio n in the interval [t, t + St) is o{St). We wil l refer t o thi s model as a birth and death process. We wil l introduc e the model by describing the movement of an elevator between floors of a company building , but the model has several other applications. Let the company buildin g have N+1 floors, wit h 0 corresponding to the lowest floor and Ν t o the uppermost, and let a "birth " on floor i correspond t o a transitio n between floor / and the floor above. Let the random variabl e X(t) denote the floor the elevator occupies at tim e / if it is at rest, or the floor t o which it is headed at tim e t if it is moving. By allowing X t o be the floor of destination as well as of occupancy, the travel tim e between floor i and floor i + 1 can be regarded as part of the elevator’s occupancy of floor i + 1. Thu s a birt h takes place instantly, at the moment when a company executive at floor /’ (or anyone else who wishes t o use the elevator) presses th e button for floor / + 1. Similarly , a "death " on floor Ø corresponds to a transitio n between floor / and the floor below, regarded as happening at the instant when an executive at floor / presses th e button for floor Ø 1. To ensure that a birt h and death model provides an adequate descrip› tion , we wil l assume that the elevator stops at every floor on it s way up or down. We might imagine that the elevator has only tw o buttons, one
190
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
marked "up " and the other marked "down, " a transitio n occurrin g when› ever a button is pressed. Thu s the elevator cannot rise directly fro m the ground floor to, say, the third . Rather, thi s journey would requir e a stop at the second floor en route, so that tw o birth s would be involved. Thi s assumption is an obvious imperfection of our birt h and death model, but we wil l be able t o eliminate it later. Th e followin g section wil l take a step in thi s direction, and furthe r developments wil l be facilitated by Chapter 10. Because we assume the Marko v property , the futur e must never depend on the past. But suppose that an executive has caught the elevator at the thir d floor and is on his way t o the ground floor when, durin g the elevator’s compulsory stop at the second floor, he meets another executive who wishes t o clim b t o the tenth floor. Th e second executive decides t o rid e wit h the first executive t o the ground floor, rather than wait for th e elevator t o return , so that his place in the elevator is assured. I n these circumstances, th e next birt h would depend not just on the elevator’s ground floor position but also on the fact that it had acquired a high-minded executive at the previous stop. I n other words, the Marko v propert y would be violated. We exclude thi s possibility by assuming that executives are always too harassed t o wait for an elevator. I f it’ s already there an d either empty or going in the righ t direction the n they wil l use it . Otherwise, they wil l tak e the stairs. Havin g dispensed wit h these preliminaries, we now proceed to develop our model. Suppose that the elevator is on floor / at tim e 0, i.e., that X(0) = /’. Let U be the event that the elevator is on floor j at tim e t + 6t, where 6t i s infinitesimall y small, and where 1 < < Ν - 1; j = 0 and j = Ν wil l be considered later. Then Prob[C/] = ?tob{X(t+6t) = j) = Prob(AT(f + St) = ; I ¸^ˇ ) = i) = + St). At tim e t, the followin g four events exhaust all possibilities: U : the elevator is on floor j , x
U
2
: the elevator is on
floor
j+l,
(5.58)
Uy: the elevator is on floor j - I, U : the elevator is above floor j + 1 or below floor j A
I.
Hence, fro m (A. 13): 4
Prob[C/] =
(5.59)
Prob[C/ | U ] • Prob[C/J. k
But on using (5.7) and (5.8), we have Prob[C7 | U ] = d 6t + o{6t) and Prob[i / I U ] = bj_ 6t + o(6t); whereas ?tob[U | U ] = o{St), being the probabilit y of a birt h and a death in the interval [t, t + St). Th e probabilit y of a birt h or a death, on the other hand, is bjSt + djSt + o(St) when the elevator is on floor j ; and, given t / , the event U wil l take place only if 2
3
{
J+l
A
(
5.5
Th e Rl« e an d Fall of th e Compan y Executiv e
191
neither a birt h nor a death occurs in the interval [t,t + St). Thu s Prob[i / | C/,] = 1 - bj6t-djSt+o(St). Substituting these results int o (5.59), and using (5.12), we thus obtain rjj(t + 6t) = (l-
bjSt-
dj8t + oi6t)) (t) x
+
+ (d St
rij
j+l
+ o{6t))r,j.iU)
+ {bj_ 6t
o(6t))r (t) u+l
+ o(6t) • Prob[(7 ] . 4
(5.60)
Rearranging, we get r^t + S^-r^t)
. . . . . . . '— = -{bj + dj)r (t) + dj r j (t) ij
Takin g th e limi t as St jH r
t
ty-i V-i
=
r
+l
. . . +
i +[
o(6t) bj_ r j_ (t)+ l
i
l
0, we obtain the differentia l equation
- (bj + dj)r
+ d
v
J + l
r
I J + l
,
l < j < N - l .
(5.61)
For j = 0 the event i/3 is impossible, and for j = Ν we must exclude the event U . Then, by reasoning similar to that which yielded (5.61): 2
dt dt
= d r -b r l
i l
= b _r _
0
N
i
Ui
l
(5.62)
i 0
(5.63)
- dr . N
iN
Her e we have used the fact that d = 0 = b , because the elevator can neither descend below floor 0 nor rise above floor TV. Equations ( 5 . 6 1 )(5.63), together wit h th e initia l conditions r / O ) = 6 i,j = 0, I, ..., Ν are sufficient t o determine r^t) on [0,oo) for all / and Naturally , the constraint (5.13) must be satisfied by r,-,(f) for every value of /, and you should note that the sum of equations (5.61) (5.63 ) is just the derivativ e of thi s constraint wit h respect t o t. Also, be sure you appreciate that r / O ) = S i s an initia l condition only in the mathematical sense. Th e initia l state of th e system itself is the random variabl e ¸ˆ(0) , wit h probabilit y distributio n 0
N
ijt
it
ir(O).
To keep the mathematics simple, however, we shall confine our at› tention for the remainder of thi s section to the special case Ν = 2. Thu s we wil l model a company buildin g that consists of three stories, wit h a single elevator connecting the floors. I n such a buildin g (for exam› ple, the old Florid a Education Association/United buildin g in Tallahassee), can we predict where the elevator wil l be at the end of the day, if it either always starts on the ground floor (i = 0) or else is equally likel y to start the day on any of the three floors?
192
Chapte r 5
Birt h and Death . Probabilisti c Dynamic s
Setting Ν = 2 in ( 5 . 6 1 M 5 . 6 3) gives -77 = - V / o + ^ / i . dt
djji dt
_ =
dr
_ = b r
i2
r
h 0
x
i
-(b +d )r
0
l
-
n
l
i
(5.64)
+d r ,
i
2
n
dr . 2
i2
I t isn’t difficul t (Exercise 5.5) t o solve thi s set of linear equations for any and d , subject of course t o r,y(0) = 6 j,i,j = 0 , 1 , 2; but values oib ,b ,d th e algebra is messy. We wil l therefore make the furthe r assumption that executives on the top floor approach the elevator/staircase area throughout th e day at the same average rat e as executives on the ground floor, so that we may take b = d = a, say. Then you can verif y by substitution that the solution t o (5.64) for i = 0 , 1 ,2 is given by th e 3 3 matri x 0
x
lt
2
0
R(0 =
t
2
1 a + b
+
x
d
a
b[
a
b
"
b,
x
Ø e
(b
x
bt
-at
x
bi+d
{
- ( a + 6 , + < / , )i
+ d )(a
+ b
x
ad
+
x
-a(b +d ) x
χ
+
L-4
0
x
0
ab
x
x
ά)
χ
(5.65)
-b (b +d )
2
χ
x
- α φ + ά )
t
0
x
φ
ad
0
-b
d)
x
- d ^ + d j
Ο
x
x
ab
χ
x
I f the elevator always starts the day on the ground floor then, fro m (5.18) and (5.65), ( ) = (l,0,0)R(f) = ˆ
-
Æ+ o, +
r
d
( d
u
a,b )
+
x
x
M^(l,0,-1) + Æ.
b
x
ae - ( b
l
,-(a+b,+di)t
d X
+
l
a
- r b
d ) (
l
+
l
d
> '
b
>
+
d
" -
b
i
y
>
(
5
whereas if it’ s equally likel y t o start on any of the floors, ir(t) ( 1 / 3 , 1 / 3 , 1 / 3 ) R (0 =
1
x
)
o, + c,
V A ^ V +l fb i ^ +d’) (
6
^«-"’(1,0,-1)
,’,(^1,^1) +
a + bi+di
3 ( 0| + d ){a
6
=
T
+
·
g
x
( 0 + t l + r f
x
’ ’H^ )
l
+ d ,-b ). x
(5.67)
x
We do not have values for a, b , and d , but it seems reasonable t o assume values of several per hour a t the very least, > 1 , 6, > 1, and d > 1. At th e end of the nine-hour workin g day, therefore, the exponential term s in (5.66) and (5.67) are completely negligible, because e ~ ss 1 0 ~ , and e~ is x
x
x
9
4
27
5.6
Discret e Model s of a Day in th e Lif e of an Elevato r
193
even smaller. Thus, regardless of the initia l location of the elevator, we have <>
π
9
Γ
^,a,b ) Æ+ Οχ + a
w
{
(5-68)
l
at the end of the day. Intuitively , thi s is a sound result. It says that the elevator wil l ulti › mately spend a fractio n d\l(a + b + d{) of each hour on the ground floor. Thi s fractio n increases wit h d i.e., wit h an increase in the average rate of departur e fro m the middl e to the ground floor. You should similarl y interpre t Ø(9) and ( 9 ). I f executives on the middl e floor approach the elevator/staircase area at th e same rat e as on the other floors, and i f any executive’s ultimat e destination is equally likel y t o be either of the other t w o floors, then x
u
2
b
= ^ {rat e of ground floor departure} + ^ {rate of approach on middle floor}
{
a
a
= 2 2 ' th e first contributio n being due to executives w ho are ridin g all the way fro m the ground floor t o the top; and similarly , +
=
a
d = ^ {rate of top floor departure} + i {rate of approach on middle floor} {
a
= 2
a +
2
=
a
>
too. I n these circumstances, (5.68) produces the obvious answer ( 9 ) « ( 1 / 3 , 1 / 3 , 1 / 3 ), irrespective, of course, of how the elevator starts it s day. N ow tr y Exercises 5.6 and 5.7. ˆ
5.6
Discret e Model s of a Day in th e Lif e of an Elevato r
I n Sections 1.1 and 1.7 we constructed a model of a contaminated lake. We found that if we wished t o know the state of the lake at all times t, 0 < t < oo, then we had t o use a differentia l equation t o describe the decay of pollution . I f we were satisfied t o know the state of the lake only at discrete instants t = 0, 1, 2, . . . , / , . . ., however, then a recurrence relation could be used instead, provided a certain condition was satisfied. We called th e resulting model a metered model; and the condition for using it was that the system in question behave qualitativel y the same withi n each unit of time. Because of thi s qualitativ e periodicity , the state of the system at tim e t = / + 1 could be predicted if only the state of th e system at tim e t = I were known. What happened prio r to tim e t = / was irrelevant . But thi s i s just th e Marko v propert y of memorylessness , and suggests that birt h and death models can also be metered if we replace the continuous-time stochastic process S = {X(t): 0 < t < oo} by a discrete-time stochastic process, namely, the set S = {X(l):l = 0 , 1 , 2 , . . . }. We wil l illustrat e thi s t
t
194
Chapter s
Birt h and Death . Probabilisti c Dynamic s
idea by constructing a metered model of the company elevator described i n the previous section. Let an hour be the unit of time. Thus, if t = 0 were 8 A . M , then t = 9 would be 5 P.M. We wil l construct a model that predicts the elevator’s distributio n vector π(ή at the discrete instants t = 0, 1, 2, . . ., 9. Let U be the event that the elevator is on floor at tim e / + 1, and let Uj be th e event that the elevator is on floor / at tim e /, for 0 < i < 2. Then, because the disjoint events U , £/,, and U exhaust the possibilities arising at tim e /, we have 0
2
2
Prob[ U) =
Prob[ U | (/,] • Prob[U,].
(5.69)
i=0
But fro m the Marko v property , i.e., on setting t = 0 and s = I in (5.3), we have Prob(t/ 1 [/,) = Prob(Z( / + 1) = j | X(t) = i) = P r o b ( * ( l ) = ; | * ( 0 ) = 0 = ^(1). Moreover, Prob(C/) = P r o b ( * ( / + 1) = j) = τ XI + 1), and Prob(C/,) = ?Tob(X{t) = 0 = * ,•(/) Hence (5.69) yields a set of three coupled recurrence relations: 2 i=0
Let us define the 3
3 matri x S by S = R(1).
(5.71)
Then (5.70) may be writte n more succinctly in matri x for m as ( / + l)
T
= ir([) S. T
(5.72)
Thi s matri x recurrence relation is a probabilisti c analogue of (1.48), and you can verif y by substitution that it s general solution is given by ir(/)
r
= x ( 0 ) S ’. r
(5.73)
Once S and ( 0 ) are known, (/ ) can be calculated fro m (5.73) for any value of /, by recursion. But S is known fro m the previous section. To keep th e mathematics simple, let’s assume, as at the very end of Section 5.5, that executives on all floors of the buildin g approach the elevator/staircase area at the same rat e a and that the other tw o floors are equally likel y t o be their final
5.6
Discret e Model s o f a Day In th e Lif e o f an Elevato r
195
destinations. Then, fro m (5.65) wit h b = d = a: x
"1 R ( 0 =3 1 .1
’ 1
1" 1 + 1.
1 1 1
\e'°'
0 .-1
{
-r
0 0
0 1 .
0
" 1
-2
1"
-2
4
-2
1
-2
1 . (5.74)
1 -2 1
-2 4 -2
1
0
I n particular , 1 1 1
S = R ( 1 ) =5
1 1 1 1 1 1
0 0 0
-n 0 1
For the sake of illustration , let’s take a = 1.5. 0.4467499 0.3296303 0.2236198
0.3296303 0.3407393 0.3296303
0 3
-2
Then (5.75) yields (5.75) 0.2236198 0.3296303 0.4467499
(5.76)
You can easily verif y (though you’ll need a computer) that
S = 9
0.3333340
0.3333333
0.3333326
0.3333333
0.3333333
0.3333333
. 0 . 3 3 3 3 3 26
0.3333333
0 . 3 3 3 3 3 4 0.
-
.
(5.77)
Thu s if the elevator is certain to start the day on the ground floor, then *(9)
r
= ( l , 0 , 0 ) S = ( 0 . 3 3 3 3 3 4 0 , 0 . 3 3 3 3 3 3 3 , 0 . 3 3 3 3 3 2; 6 ) 9
(5.78)
whereas if it is equally likel y t o start it s day on any floor, then . , 9 / = ( i , i , i )
S
’ = (i,i,i) .
( 5 . 7 9,
A s in Section 5.5, we have (9) s* ( 1 / 3 , 1 / 3 , 1 / 3 ), irrespective of where th e elevator began it s day. We can interpre t these equal probabilitie s by saying that the elevator wil l ultimatel y spend an equal proportio n of tim e on each floor. A very different result is obtained if we choose to measure tim e not in hour s but in terms of the number of transition s (birth s or deaths). Let t = 0 correspond, as before, to the start of the elevator’s day. Now, however, let / = 1 correspond to the first transition , t = 2 t o the second transition , and, in general, t - η to the nth transition . Let U denote the event that the elevator is on floor j after n+1 transitions, and let £/,• denote the event that ˆ
Th e idea for this model came from observing the FEA/United buildin g in Talla› hassee. There, the appropriat e value of a was certainly greater than 2, and probably 4 or 5; but I had to choose a sufficiently small that (5.73) would still be converging after 9 tim e steps (to seven significant figures, see (5.77)). 3
196
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
th e elevator is on floor /’ after η transitions, 0 < Ø< 2. Th e disjoint events U , U , and U exhaust the possibilities arising at t = n, and so we have Q
{
2
2
Prob(U) =
i’=0
Prob(U \ U,) • Prob(£/,).
(5.80)
Let us denote Prob(C/ | U ) by p Then fro m the Marko v property , i.e., setting t = 0 and s = η in (5.3), we have (
ir
Py = P r o b W n + 1) = y | X(n) = i) = P r o b ( * ( l ) =j | * ( 0 ) = /). But Prob(£/) = P r o b ( * ( « + 1) = j) = π {η+1), i) = ,•( ) . Hence (5.80) becomes
(5.81)
and Prob(i/,) = Prob(^(n ) =
}
2
/=o
or in matri x terms, π(η+
1)
τ
(5.83)
= π(η) ?, τ
where Ρ is the 3 3 matri x whose (/,y)th entry is given by (5.81). You can verif y by substitution that the general solution of thi s matri x recurrence relatio n is given by ( ) " = ΤΓ(0) Ρ . 7
ª
(5.84)
Λ
Once Ρ and ( 0 ) are known, ( « ) can be calculated fro m (5.84) for any value of n, by recursion. W e may refer t o Ρ as the one-step transitio n matrix , or simply the transition matrix, because fro m (5.81), it gives th e probabilit y of going fro m floor / t o floor j in precisely one transition . Th e matri x P" may be called the n-step transitio n matrix , because it gives the probabilit y of going fro m floor / t o floor j in precisely η transitions. Lik e R(f) , Ρ and P" are both stochastic matrices. I t remains t o calculate P. I t is impossible t o go directl y fro m the top t o th e bottom or th e bottom t o the top in precisely one transition ; therefore we have p Q = PQZ = 0. But it is also impossible t o retur n t o th e same floor i n one transition , whence Poo = Pi Ø = P22 = 0• ^ elevator is on the ground floor or the top floor, then it s next transitio n must be t o the middl e floor, whence p = p = 1. It now remains only t o calculate p and p . I n th e limi t as 6t -» 0, in continuous tim e t, th e probabilit y that the elevator rises fro m floor 1 t o floor 2 is b 6t, and th e probabilit y that the elevator descends fro m floor 1 t o floor 0 is d 6t. Th e rati o of these tw o probabilitie s is b ld . Thi s is tru e for any value of continuous time. Hence it must be true, in particular , at the instant of transitio n (even though we 2
t f t
Ql
1 0
2i
x
t
x
x
e
t2
5.6
Discret e Model s of a Day In th e Lif e o f an Elevato r
197
do not know when that occurs in continuous time). Hence Ell
(5.85)
But P10+P12 = !• Solving these equations yields p {b d,) = b,. Thu s the transitio n matri x is l0
"
1
0
=
0 1
0
0
{
+ d,) - di,p (b t2
l
+
’
bi+d,
(5.86)
0
You can easily deduce fro m thi s that for k = 0, 1, 2, " p2*+l _
1
0
d\ 0 b,+d
0 "
x
1
0
p2*+2 _
d\ 0 bi+d, b,+d, 0
d\
0
1
0
0
b,+d,
(5.87)
Thus, if the elevator is certain t o start the day on the ground floor, then 7 (2º: + 1 ) = ( 1 , 0 , 0 ) * + ’ = ( 0 , 1 , 0) and ˆ
2
(2` : + 2 ) = ( 1 , 0 , 0 ) ˆ
2
*
+ 2
=
, 0,
bi+di
(5.88)
i.e., the elevator is certain t o be on the middl e floor after an odd number of transitions, but cannot possibly be on the middl e floor after an even number. Althoug h thi s result is obvious intuitively , it is quit e at odds wit h the result we obtained in (5.78). I t shows that, despite mathematical similar › ities, the tw o discrete-time elevator models discussed in thi s section are fundamentally different . I n the first model, tim e is measured linearly: each uni t of tim e corresponds t o one hour. I n the second model, tim e is mea› sure nonlinearly: on any particula r day, tw o transition s could be as close together as a fractio n of a minut e or as far apart as an hour or two. We anticipated thi s distinction by using / t o denote linear tim e and η t o denote nonlinear time. I n the first model, t = 9 means that precisely 9 hours have elapsed, but the number of transition s is unknown. I n th e second model, t = 9 means that precisely 9 transition s have occurred, but in an unknown number of hours. I n the first model, even though tim e has been treated as a discrete variable, the elevator’s history up t o tim e / includes a contin› uum of / hours, throughout most of which the elevator is waitin g at one floor or another. I n the second model, the elevator’s waitin g tim e is c o m› pletely ignored. It is the latter omission which precludes the second model fro m predictin g that th e elevator wil l ultimatel y spend a fixed proportio n of tim e at each floor.
198
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
A discrete-time Marko v model in which tim e is measured in thi s non› linear fashion is known in the literatur e on probabilit y as a Markov chain. Althoug h we restricted our attention above t o a Marko v chain wit h only thre e states, namely, / = 0 , 1 , 2, the extension of the model t o Ν + I states i s immediate. Indeed (5.83), (5.84), and the definitio n of in (5.81) are vali d for any value of N, and we need only replace 2 by ¸ ˆ in (5.82) t o make that valid, too. Th e distinction between a Marko v chain and th e discrete version of a linear-tim e Marko v model is often blurre d in the literature , because the passage of a unit of (linear) tim e can be defined t o correspond to a tran › sition. Both models are described as Marko v chains, and S is called a transitio n matrix . I n these last tw o respects, we wil l follow convention. Nevertheless, we wil l attempt t o preserve the theoretical distinction be› tween the tw o models by using η for tim e and for transitio n matri x when transition s correspond to physical events, but / for tim e and S for transitio n matri x when transition s are artificiall y defined as the passage of so many unit s of linear time. Th e periodic behavior that appears in (5.87) is caused by the fact that all entries on the leading diagonal of are zero. But most of the Marko v chains that are useful in practice, and all of those introduced henceforward in the main body of the text, have at least one nonzero on the leading diagonal of the transitio n matrix whic h is enough to prevent such periodicity . That single fact is virtuall y all that we need to know about periodicit y in Marko v chains, and we shall therefore not dwell on the topic; though we do discuss it further in the Exercises and in Section 6.1. Th e followin g example of a Marko v chain involves five states; thus Ν = 4. 4
5.7
Bird s in a Cage . A Birt h and Death Chai n
A cage i n a pet shop contains four budgerigars and is divided int o tw o sections by a trapeze in the middle. For convenience, we wil l label these sections Nort h and South. At each end of th e cage there is a food supply. Thu s the cage’s horizontal section appears as drawn in Fig. 5.3. Th e bird s spend almost all of their tim e i n the vicinit y of a food supply, either eating or resting. Every so often, however, one of the bird s wil l fly up t o th e trapeze and swing on it for a while, before flying down again t o rejoi n it s precious food supply. After swinging on the trapeze, a bir d forgets where it came fro m and is equally likel y t o fly down t o either end of the cage. Moreover, the bird s act independently of one another. Each Th e continuous-time model considered in the previous section is a special case of a Markov jump process, for which more general equations are developed in Exercise 10.8. 4
5.7
Bird s In a Cage . A Birt h an d Death Chai n
199
Ν F o od
Trapeze
F o od S
Fig. 5.3 Plan of bir d cage.
is equally likel y to be the next performin g artist. In these circumstances, can we predict where the bird s wil l be after, say, 20 trapeze acts, if initiall y they were all at the South end of the cage? We wil l model thi s system as a Marko v chain. The resulting model, if somewhat fanciful , wil l be extremely useful in Chapter 10 for th e purpose of introducin g semi-Markov processes . Let the random variabl e X(n) de› note the number of bird s at the Nort h end of th e cage at tim e n. Because ther e are four birds, it s sample space is { 0 , 1 , 2 , 3 , 4 }; i.e., the possible states of the system are / = 0 , 1 , 2 , 3 , 4. Let each trapeze act correspond t o a tran › sition. Then after each transition , the number of bird s at the Nort h end of the cage wil l either increase by one, decrease by one, or stay the same. Hence the transitio n matri x satisfies p = 0 unless / - 1 < j < i + 1. A Marko v chain wit h thi s propert y is known as a birth and death chain. Al l Marko v chains described in thi s chapter belong t o thi s category. Mor e general chains are introduced in Chapter 6. i}
Suppose that there is just one bir d at the Nort h end of th e cage, i.e., that X(n) = 1. Let U be the event that thi s bir d is next t o per› form ; hence U is the complementary event that one of the other bird s is next t o perform . Then, by assumption, Prob(CZ) = 1/4 and Prob(t7) = 1 - Prob(C/) = 3/4. Let V be the event that a bir d flies down to the opposite side of the cage after trapezing; hence V is th e complementary event that it return s whence it came. Then by assumption, V and V are independent of U and U, and Prob(J0 = Probit y = 1/2. Thus, on using (A.49), p = Prob(K n U) = Prob(F) • Prob(£/) = 1/2 • 1/4 = 1/8. Similarly , p = Prob(K n 0) = Prob(V) • Prob(C7) = 1/2 • 3/4 = 3/8. Th e cage wil l l0
l 2
200
Chapte r 5
Birt h and Death . Probablllatl c Dynamic *
remain in state 1 if either the bir d fro m the Nort h or a bir d fro m the South returns; i.e.,/> = P r o b ( ^ P r o b ( t f ) + P r o b ( P ) P r o b ( t / ) = Prob(P) = 1 / 2. I n thi s way, we have completely determined the second row of the transitio n matri x P. Continuin g in thi s fashion, you can easily check that u
Ø 3 0 Ø 3 5 I Ø I
( 5 . 8 9)
I
0
S 0
Notice that all terms on the leading diagonal are nonzero, so that there wil l be no periodicit y in powers of (see the remark s at the end of the previous section). Wit h ( 0 ) = ( 1 , 0 , 0 , 0 , 0 ), the cage distributio n after 2 0 trapeze acts is given by ( 2 0 ) = ( ,ˇ,ˇ,ˇ,ˇ) = ˆ
20
( 0 . 0 6 3 2 9 3 2 , 0 . 2 5 1 5 8 5 6 , 0 . 3 7 4 9 9 9 3 , 0 . 2 4 8 4 1 4 4 , 0 . 0 6 1 7 0,7 6 )
( 5 . 9 0)
on using ( 5 . 8 4 ). Notice that the expected number of bird s in the Nort h end of the cage at that tim e is j > , ( 2 0 )« i=0
( 5 . 9 1)
1 . 9 9 4,
which is close t o 2 . Notice also that O
N
,
R
/
11
1 3
1
IN
( 5 . 9 2)
You’v e probably guessed that, by analogy wit h the previous sections, ( 5 . 9 2) is tru e irrespective of where the bird s began; and after a large number of trapeze acts, th e expected number of bird s at either end of the cage would be indistinguishable fro m 2 . I n other words, the cage ultimatel y approaches a stationary distribution, the probabilisti c equivalent of an equilibrium . But already we’re talkin g about stationary distributions , and these are th e subject of the followin g chapter.
5.8
Trees in a Forest . A n Absorbin g Birt h and Death Chai n
Accordin g to Usher ( 1 9 6 7, p. 3 5 9 ), on which thi s section is based, the Scots pin e trees in the forest plantations at Corrour , in Scotland, are grouped int o classes according t o girth . There are six classes in all, which we shall label i = 0, 1, . . ., 5. Th e thinnest trees belong t o class 0 and the fattest t o class 5, wit h increasing i corresponding t o increasing girth . A census of trees is effectively taken once every six years. Let thi s be the unit of time, and let the passage of every sixth year be regarded as a transition . Then a Marko v chain wit h Ν = 5 can be used t o model th e dynamics of th e forest’s class structure, if we define X(I) t o be the class at tim e / of a
5.8
Trees In a Forest . A n Absorbin g Birt h and Death Chai n
201
randoml y chosen tree. The components of the resulting distributio n vector (/ ) wil l be interpreted as th e proportion s of trees in each class at tim e /. N o t e that by defining a transitio n t o take place once every unit of time, we make linear and nonlinear tim e equivalent (see the remark s at the end of the previous section). Let us assume that all trees reach ful l stature, i.e., enter class S, and are then felled. We wil l regard thi s sixth class as consisting both of felled and unfelled trees (of ful l stature). Once a tree has been felled, it remains forever felled. Thu s i = 5 ultimatel y "absorbs" all trees. I n other words, th e last row of the transitio n matri x S is given by s = 0 for 0 < j < 4 and j = 1. For thi s reason, i = 5 is called an absorbing state of the Marko v chain; and the Marko v chain itself is described as an absorbing chain. Now, the remaining classes are defined in such a way that, at the end of every six-year period, a tree wil l either remain in th e same class or have sufficient girt h t o move int o the class immediately above, but never sufficient girt h to skip a class. For 0 < i < 4, let a denote the probabilit y that a tree fro m class / remains in class / at the end of a census period. Then 1 - a is the probabilit y that it grows sufficiently t o m o ve int o class Ø+ 1. Thu s s = a Sjj = 1 - a, and i,y = 0 if j > i + 2. Moreover, because no tre e ever moves down a class, we have s^ = 0 for / > j ; i.e., the transitio n matri x S is upper triangular . Combinin g these results, we find that yj
5 5
t
i
n
h
+i
«0
S =
1 - a
0
0
0
a\
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I-a,
0
0 0
0
0
1 - ej a
0
0
0
"
(5.93)
l - e 1
4
4
Values for a , a,, a , a , and a are estimated i n Exercise 8.6 t o be 0.72, 0.69, 0.75, 0.77, and 0.63. I f we knew the forest’s initia l class structure, then it s structur e at the end of each six-year census period could now be determined fro m (5.84). Suppose, for example, that the structur e were initiall y uniform ; i.e., ( 0 ) = ( 1 / 6 , 1 / 6 , 1 / 6 , 1 / 6 , 1 / 6 , 1 / 6. ) Then, because 0
2
3
A
ˆ
S
5
=
0.1935
0.3462
0.3243
0.1165
0.0178
0 . 0 0 1 8’
0.0
0.1564
0.4180
0.3103
0.0900
0.0253
0.0
0.0
0.2373
0.4172
0.2128
0.1327
0.0
0.0
0.0
0.2707
0.2816
0.4477
0.0
0.0
0.0
0.0
0.0992
0.9008
0.0
0.0
0.0
0.0
0.0
1.0
(5.94)
th e class structur e after 30 years would be given by ( 5 ) = 7 r ( 0 ) S = ( 0 . 0 3 2 , 0 . 0 8 4 , 0 . 1 6 3 , 0 . 1 8 6 , 0 . 1 1 7 , 0 . 4 1. 8Thus, ) after 30 years, the percent› age of trees in class 2 would be almost as high as originally , and over 40% of the trees would have reached ful l stature. ˆ
T
5
202
Chapte r 5
Birt h and Death . Probabilisti c Dynamic s
Thi s model is of limite d value in its present form why ? How does a real forest differ from the one we have just discussed? Perhaps you would lik e to mull thi s question over. We’ll retur n to it in the following chapter, and again in Chapter 9.
Exercise s 5.1 Deduce (5.40) from (5.39). Verif y the expression for R(i) when Ν = 3. 5.2 Deduce (5.46) from (5.45). Verif y the expression for R(/) when Ν = 3. Show that the Poisson distributio n (5.49) has mean Bt; i.e., verify that oo
J2kProb(A(t) = k) = Bt. *= Ø 5.3 The birt h rate in a pure birt h model need not be constant (independent of 0. It may, for example, increase linearly with /. Show that if b, = Bi,
1 < Ø< oo
then the entries of the upper triangular matri x R(f) are given by
Here ¸ ” is denned as the product of all integers between 1 and K; i.e., Kl = 1 • 2 • 3 • • • (K - 1) • K, with 0! = 1. Note that the lowest state of the population is i = 1, because b = 0 would mean that the population could never exist. In other words, the first row and column of the matri x R(0> as denned in Chapter 5, must be deleted. Hint: The result can be deduced from (5.46) by fixing i and performing mathematical induction on j . 0
5.4 Obtain (5.54). Hint: For \x\ < 1, the Taylor series
-
ι χ
Η
converges absolutely and may be differentiated term by term. Choose suit› able x. 5.5 Solve equations (5.64) and deduce (5.65) as a special case of your answer. "5. 6 In the three-storey buildin g considered in Section 5.5, executives approach the elevator/staircase area at the same rate on each floor, but ground floor executives always want to get to the top, middle floor executives are equally likel y to go up or down, and three-quarters of top floor executives who use the elevator are leaving the building. Show that the elevator is least likely to end its day on the middl e floor and most likely to finish on top.
Exercise s
203
*5.7 The time until failur e of a machine in a factory has exponential distributio n wit h mean 1/D. The repair tim e has exponential distributio n with mean IAS. If the machine is workin g at the beginning of a nine-hour day, show that Β+
De-
9iB+D)
B+D is the probabilit y that it will still be workin g at the end of it. *5.8 Suppose that the bird s in Section 5.7 have excellent memories, always re› member where they came from and, after swinging on the trapeze in the center of the cage, always fly down to the side opposite whence they came. Writ e down the transition matri x that describes these new circumstances. 5.9 In Exercise 5.8, what do you notice about (i) odd powers of P, (ii ) even powers of P? You should see a pattern emerging after you have computed six or seven powers of P. *5.10 An extremely enthusiastic individual decides to found a new religion. He persuades some friends to join , then all new members tr y to enlist as many new members as possible. Do you think that the early growth of thi s religion could be modelled adequately by treating new members as arrival s in a Poisson process? Why or why not? If not, which other model encountered in thi s chapter might prove adequate? *5.11 A U.S. female born in 1966 had a 98% chance of survivin g the first year of life. If she survived the first year of life, then she had a 99.48% chance of survivin g until her tenth birthday . The conditional probabilitie s of surviving various other "milestone" birthday s are given by the following table.
Milestone birthda y
Probabilit y of reaching this birthda y alive, given that the previous birthda y has been reached
1 10 20 30 45 60 70 85 115
0.9800 0.9948 0.9955 0.9920 0.9709 0.9061 0.8343 0.3911 0.0000
Use this data to construct a Marko v chain model, with ten states, that describes the passage through lif e of a female born in 1966 in the United States. Identif y the lif e table probabilitie s /(l) , /(10), /(20), /(30), /(45), /(60),
204
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
/(70) and /(85) in Exercise 4.15 with entries of the -step transition matri x P\ In each case, give appropriat e values of i, j and n. (The values will differ slightly from those presented in Exercise 4.15 because of rounding error) . Which special features does your Marko v chain have whic h model in Chapter 5 does it most resemble? **5.12 A 4-state Marko v chain was used by Li u and Yao (1977) to model traffi c flow at a T-junction . Obtain a copy of Li u and Yao’s paper and read it. Do you think that the states of their Marko v chain have been well denned? Criticiz e their model, paying particular attention to the circumstances in which a car is able to enter the minor road. Would you accept their model, would you reject their model, or can you improve their model? *5.13 Fig. E5.1 is plan of a T-junction . There is no left-tur n lane on the major road, which runs north and south. A driver who wishes to turn left, i.e., west, from the major road must remain in a waiting zone, marked "wai t here" in the diagram, until the "danger zone" in the southbound lane is clear. Naturally , if southbound traffi c is heavy and many driver s wish to go west, then northbound traffi c may be seriously interrupted . In this exercise, we will attempt to use a 4-state, nonlinear-time Marko v chain to model the severity of such interruptions . Let us make the following definitions: a: Probabilit y that a northbound driver , having reached the waiting zone, wishes to tur n left. (Imagine that the decision whether to tur n or not is not made until after the junction has been reached.)
Nort h D a n g er z o ne
Fig. E5.1
Exercise s
205
b: Probabilit y that a left-turnin g driver will be able to enter the minor road immediately after the next southbound car has left the danger zone (given that a driver is waiting to tur n left and that at least one car is blocking the danger zone). º : Mean southbound flow, in numbers of cars per unit of time. : Mean northbound flow, in number of cars per unit of time. p. Probabilit y that a northbound car enters the waiting zone before a southbound car enters the danger zone, given that the waiting zone and danger zone are both clear. Assume that at most one northbound car can wait in the waiting zone (whereas more than one southbound car may occupy the danger zone). q: Probabilit y that a northbound car enters the waiting zone, either to tur n or to go forward , before the southbound car approaching the junctio n can leave the danger zone, given that the danger zone is blocked but the waiting zone clear. T: Minimu m time gap in southbound flow that a left-turnin g driver requires to cross it safely. Assume that the danger zone is denned in terms of this tim e rather than in terms of a distance. Thus the danger zone is clear if and only if the next southbound car is at least Τ seconds away from the junction . Let there be four possible states in which the T-junctio n can be at any given instant, and let the random variable X(l) have sample space {0,1,2,3). Let X(t) = 0 if the danger zone and waiting zone are both occu› pied. Let X(t) = 3 if the danger zone and waiting zone are both clear. Let transition s between states occur as indicated in Fig. E5.1, by arrows over solid bars. For example, a transition occurs if a southbound car turn s right or goes forwar d at the junction . (i) In terms of b, what is p = Prob(A"( n + 1) = 0 | X{n) = 0)? Writ e down the values of p 3 = Œ> (`ˆ(/ Ø+ 1) = 3 | X(n) = 0) and p = Prob(;T(« + 1) = 3 I X(n) = 3). (ii ) Define states 1 and 2. Hence writ e down a transition matri x for a Marko v chain, in terms of a, b, p, and q. (iii ) Suppose that southbound cars arriv e according to a Poisson process. Express b as a function of º and T. (iv) Suppose that northbound cars arriv e according to a Poisson process when the northbound lane is clear, and consider the following argument. Let X{t) = 3. Let random variables Ν and S denote the times that elapse before the next northbound and southbound cars, respectively, arrive. Be› cause interarriva l times in a Poisson process are exponentially distributed, 0 0
3 3
0
Prob(/V > t) = e Prob(5 > r ) = e
(a) (b)
Hence the join t probabilit y density function of S and Ν is given by ,- ,º +
)
0
<
Γ,ί <
(c)
OO.
Thus ρ = Prob(iV < S) =
if Jo
Ar,t)dtd Jo
T
=
º +
’
(d)
206
Chapte r 5
Birt h and Death . Probabilisti c Dynamic *
Because b is known as a function of A and Τ from part (iii) , and because q can be found as a function of and ˆ by a calculation similar to (d), the transition matri x is effectively expressed as a function of Æ, º , , and ˆ . Hence the probabilit y that the northbound lane will be blocked at the T-junctio n can be determined for arbitrar y values of Æ, º , μ and Τ. Do you accept or reject thi s argument? Note. There is nothing wrong wit h (c), and the integral in (d) has been evaluated correctly. * 5.14 Measles broke out on the campuses of Baylor University, Indiana Univer› sity, and Florid a State University in, respectively, September of 1982, Febru› ary of 1983, and January of 1986. Each of these outbreaks was controlled by mass immunization of the entire campus, which took place after the disease had been detected. Data pertaining to the three epidemics are contained in the following table, which was obtained from Scime (1986):
University
Number of days from first Total number of day of communicability to infections first day of vaccinations
Baylor Indian a F.S.U.
26 11 7
102 67 4
Total population 10,320 32,000 23,000
According to Scime, the FSU and Baylor outbreaks originated from a single infected person; whereas the Indiana outbreak appeared to origi› nate from several. Moreover, about 3.2% of college-age people are currentl y "susceptible" to measles, i.e., can contract the disease upon contact with an infected person. But an infected person is "infective, " i.e., can transmit the disease to a susceptible person, for a period of only ten days. Thereafter, he recovers and becomes immune (as well as noninfective). Can you construct a simple model of a measles epidemic that is con› sistent with these data? Can you estimate how many infections, say, FSU would have had if they had waited as long as Baylor to vaccinate? Hint: You wil l obviously have to make some fairl y heroic assumptions, so don’t be shy.
Supplementar y Note s 5.1 The material in this section is based on Noble (1967, Section 15.3) and Gerlough and Barnes (1971, p. 60-63), whose walking speed we adopt. Neverthe› less, the derivation of the maximum safe traffi c flow is entirely original and avoids a shortcoming in the analyses of Noble and Gerlough and Barnes. By using different arguments, the earlier authors essentially find that 2 1 0.
/ 2 10
Supplementar y Note *
207
Thi s is negative for roads wider than 210 feet a n absurd result! Although this absurdity may have no practical consequenc e (because relevant values of d are much less than 210), it still seems preferable to dispense with it.
~
6
STATIONAR Y DISTRIBUTIONS
I n Chapters 1 and 2 we met several kind s of dynamical systems. I n partic › ular , we met continuous-time systems described by differentia l equations of the for m dx - ^ = œ , Æ, )
0 < f < c x >,
(6.1)
where x(f) was an -dimensiona l vector, Æ an m-dimensional constant vec› tor , and f an -dimensiona l vector function; and we met discrete-time sys› tems described by recurrence relations of the for m x = F(x ), η = 0, 1, 2, 3 A more general discrete-time dynamical system would have th e for m + 1
x
+ 1
= F(x ) ,
« = 0 , 1 , 2 , 3 , . . .,
n
(6.2)
where x is an .TV-dimensional vector and F an ^-dimensional vector func› tion . W e found that such dynamical systems could have equilibria , states that would persist forever if undisturbed. We agreed, moreover, that any equilibriu m observed in natur e would be a stable one, t o which, after a small perturbation , the system would spend the rest of it s lif e returning . Potentially stable equilibri a = *(Æ) of (6.1) could be identified as the solutions of the vector equation f ( x , a) = 0.
(6.3)
Th e stabilit y of these equilibri a could then be verified by the method described at the beginning of Chapter 2. Alternatively , we could iden› tif y a stable equilibriu m indirectl y by solving (6.1) and watching the so› lutio n converge. Similarly , a stable equilibriu m x = x* of (6.2) would 208
Chapte r 6
Stationar y Distribution s
209
satisfy x* = F(x*) .
( 6 . 4)
I t could be identified indirectl y by choosing x , solving ( 6 . 2 ), and watching th e solution converge. Both continuous-time and discrete-time equilibri a have their proba› bilisti c analogues. But the state in a probabilisti c model (X(t) or X(n)) is a random variable, which cannot be restricted to a single value for the remainder of time fo r then it would no longer be random! In thi s sense, a stochastic process could never converge to an equilibrium . In another sense, however, a stochastic process can converge and often does. We say that a stochastic process has a stationary distribution π* = (π*., π*,..., π*) when, if * is the initia l distributio n vector, then the distributio n vector experiences no tendency to change. In other words, the continuous-time stochastic process S, = {X(t) : 0 < t < } has a stationary distributio n when, if 7r,(0) = Prob(X(0) = / ) = π-, 0 < /’ < Ν, then for all t satisfying 0 < t < " , ,( ) = Prob(X(0 = i) = it*, 0 < i < N. Again, the discrete-time stochastic process S = {X(k): k = 0 , 1 , 2 , . . .} has a stationary distributio n when, if ΤΓ,(ˇ ) = Prob(X(0) = ί) = π% 0 < i < Ν, then for all k = 0 , 1 , 2, . . .. 7T/(Jfc) = Prob(X(fc) = /) = * , 0 < i < N. Here, k can stand for either / or n; i.e., tim e can be measured either linearl y or nonlinearly. We shall assume henceforward that if a stationary distributio n π* ex› ists, then it is also unique, and, furthermore , that ir(t) (or ( / converges t o * as t -* oo (or k —* oo) fro m any value of ( 0 ) . Convergence to stationarit y is the probabilisti c analogue of stabilit y of equilibrium . By analogy wit h Chapter 2 , the stationary distributio n can be identified in either of tw o ways: by the direct method, which involves solving equations whose solution can only be a stationary distribution ; and by the indirect method, which involves finding the limi t as t -* oo of the matri x R(f), the limi t as / oo of the matri x S’ or the limi t as η -+ oo of the matri x P" . Because, by assumption, the stationary distributio n must be reached for any ( 0 ) , i t is legitimate to assume that X(0) = i for any value of i; or, which is exactly the same thing, all rows of the matri x R(i), S’ or P" must con› verge to (T T * ) . N o te that assuming X(Q) = i is equivalent t o assuming that ( 0 ) = ( ˇ , . , . , 0 , 1 , 0 , . . . , 0 ) , where the 1 fall s in row / of ( 0 ) and all other entries are zero. N ot all stochastic processes are as well behaved as we have just as› sumed. Some do not converge t o their stationary distribution . Some have mor e than one stationary distribution . But our assumptions are valid for many applications, includin g almost all of the examples considered in the remainder of thi s text. Th e only tw o exceptions are introduced (purely for illustration ) at the end of the followin g section, where we state sufficient conditions for our assumptions to be valid for a Marko v chain. 0
τ
k
t
ˆ
210
Chapter s
Stationar y Distribution *
6.1
Th e Certaint y of Death
Recall fro m Section 5.2 that a matri x R(f) for our 4-state pur e death pro› cess is given by 1
R0) =
0
1-
e~
l-e' -Dte- ' A-e- {l + Dl
e
D
D
Dt+{D t )
D,
2 2
t
ο
-Dl - D l
e
e
\Dh e~ 2
o•
0
Dt
0
-Dt
Dte-
Di
(6.5)
0
Dl
-Dt
e
To find the stationary distributio n of thi s pur e death process by th e indirect method, we must simply take the limi t as t oo and observe that 0
ˆ R(oo) =
1 1
0
.1
0
(6.6)
0
Notice that all row s of thi s matri x R converge t o ( * ) = ( 1 , 0 , 0 , 0 ). Thus, irrespective of th e value of X(0), th e population is certain t o end in state 0. I n other words, no matter how many of three old men are alive t o begin with , it is certain that ultimatel y all wil l be dead. To verif y thi s result by the direct method, observe fro m (6.5) that if ( 0 ) = ( 1 , 0 , 0 , 0 ) " , then (Ø*) = w ( 0 ) R ( r ) = ( 1 , 0 , 0 , 0) for all t,0 < t < oo. Mor e generally, you can easily verif y that ir * = ( l , 0 , 0 , . . . , 0 ) is a stationary distributio n of th e Ν + I state pur e death process discussed at the end of Section 5.2, confirmin g the rather obvious result that for any value of Ν, Ν old men wil l ultimatel y die. ˆ
7
ˆ
r
r
A s a second example of the certainty of death, recall that in Section 5.8 we used the transitio n matri x
S=
0.72
0.28
0
0.69
0
0
0
0
0 0
0
0
0
0
0.31
0
0
0
0.75
0.25
0
0
0
0.77
0.23
0
0
0
0
0.63
0.37
0
0
0
0
l
(6.7)
t o describe the growth of Scots pin e trees in a forest. By computing succes› sive powers of S, you can easily verif y that the limi Tt of S’ as / -* oo is th e ( 0 , 0 , 0 , 0 , 0 , 1 .) Thus, 6 x 6 matri x whose every row is th e vector by th e indirect method, ( * ) = ( 0 , 0 , 0 , 0 , 0, l) is a stationary distributio n for trees in th e forest. N o matter which class a tree initiall y occupies, it wil l ultimatel y enter class 5 and remain there (recall our assumption that all trees would reach maturit y before being felled). To obtain thi s result by the direct method, observe that if * is a stationary distribution , then ir(i) = * for all values of/. But ( ( / + l ) ) =
(ir*) = T
r
6.1
(n(l)) S. T
Th e Certaint y of Death
211
Hence (π*)
(6.8)
= (*'fS.
τ
Thi s is a set of six linear equations, only five of which are independent, the solution being ( *) " = ( 0 , 0 , 0 , 0 , 0 c, ) for any value of c. But the solution is made unique by observing that 7
5
*«
=
1
Ø =0
•
< •) 6
9
A s we said at the end of Chapter 5, our forest chain is of limite d value. A forester doesn’t need a mathematical model t o know that all her trees wil l eventually reach maturit y if not removed at an earlier stage! I n it s present form , our forest model ignores the fact that a forester replants trees as well as fells them; for note fro m the first column of (6.7) that it is impossible for a tree to enter state 0. Our model must therefore be extended before it can describe a real forest, and we wil l retur n t o thi s matter in Chapter 9. For a more general Marko v chain wit h Ν + 1 states, the direct method of finding n* still reduces t o solving equations (6.8) and (6.9), but wit h 5 replaced by N, and, where necessary, S by P. Thus, if tim e is measured nonlinearly, the stationary distributio n (assumed unique) is determined by (V) " = ( V ) P 7
(6.10a)
r
Ν
* ;
= I-
(6-lOb)
One of the Ν + 1 equations (6.10a) is always redundant because those equations add up to (6.10b). In the terminology of linear algebra, * is the left eigenvector of the matri x wit h eigenvalue 1, normalized so that the sum of entries is 1. Before proceeding t o the followin g section, we illustrat e that a Marko v chain may not possess a unique stationary distribution ; or, even if it does, may not converge t o it . We also state sufficient conditions on (or S) for uniqueness and convergence assumptions t o be valid. By solving (6.10), you can easily show that ir* = (a, b, a, b, a) is a stationary distributio n of th e Marko v chain wit h transitio n matri x T
ˆ 1 3
0 I 3
0 1 L 3
0
I 3
I
0
0
0
Ø 3
I
0
0
1
1 3
0
1 3
0
1 3
5 0
I
I
I
1
0 1 3.
for all 0 < a,b < 1 satisfying 3a + 2b = 1. Hence there are infinitel y many stationary distributions . To which distributio n wil l th e Marko v
212
Chapte r
Stationar y Distribution s
chain converge? Because, as is readily verified, " = for all values of n, the Marko v chain wil l converge t o th e stationary distributio n * given by (ir') = ( 0 ) . I f ir(0 ) = (1/2, l / 2 , 0 , 0 , 0 ) , for example, then th e stationary distributio n wil l be it' - ( 1 / 6 , 1 / 4 , 1 / 6 , 1 / 4, l / 6 ) ; whereas if w(0) = ( 1 / 3 , 1 / 3 , 1 / 3 , 0 , 0 ), then the stationary distributio n wil l be π' = ( 2 / 9 , 1 / 6 , 2 / 9 , 1 / 6 , 2 / 9 ). Wh y does thi s behavior arise? Directl y fro m th e transitio n matrix , you can see that the states can be partitione d int o tw o mutuall y disjoint sets, namely, { 0 , 2 , 4} and { 1 , 3 }, such that it is impossi› bl e t o move fro m one of these sets t o the other. Th e Marko v chain could therefor e be decomposed int o tw o smaller Marko v chains, one having 3 x 3 transitio n matri x wit h all entries equal t o 1/3 and th e other having 2 x 2 transitio n matri x wit h all entries equal t o 1/2. Th e Marko v chain is said t o be reducible. States 0, 2, and 4 are said t o be inaccessible fro m states 1 and 3, and vice versa; and 0, 2, 4 are mutuall y accessible, and similarl y for 1, 3. Thi s suggests that for our uniqueness and convergence assump› tion s t o be valid, a Marko v chain should not be reducible, i.e., should be irreducible. You can check for irreducibility i.e. , that it’ s possible t o go fro m any state t o any other after a finite number of transitions merel y by inspecting P. r
T
r
r
r
But we do not assume only that a stationary distributio n is unique. We also assume that P" converges. Consider th e Marko v chain wit h transitio n matri x (5.86): 0
1
0
b,+d, bi+d, 0
0
1
0
You can easily verif y by solving (6.10) that thi s Marko v chain has th e uniqu e stationary distributio n
*' = G c s ^ S ' S t S T t ^ )
·
( 6 , 1 2 )
But we know fro m (5.87) that thi s Marko v chain exhibits periodic behavior, so that P" does not converge. Thu s a Marko v chain need not converge t o it s stationary distribution . But there wil l be no periodic behavior i.e. , th e chain wil l be aperiodic if />,•,• > 0 for even one value of i, 0 < i < N, and you can easily check for this. Al l thi s suggests that sufficient conditions for uniqueness and con› vergence are that a Marko v chain be irreducibl e and aperiodic. Thi s is not quit e enough, however; the chain must also be positive recurrent. For finite Ν thi s simply means that if X(0) = i, 0 < i < N, then state i wil l be visited infinitel y often if the process goes on forever. A Marko v chain that is positive recurrent and aperiodic is called ergodic, and it can be proved that an irreducibl e ergodic chain has a unique stationary distribution , to
6.2
Elevato r Stationarlty . Th e Stationar y Birt h and Death Proces s
213
which 7T(/I ) must converge for any value of ( 0 ) . See Ross (1983, p. 109) for a proof of thi s theorem and for furthe r elaboration of the concepts of periodicity , recurrence, and reducibility .
6.2
Elevato r Stationarity . Th e Stationar y Birt h and Death Proces s
Th e 3-state birt h and death process used in Section 5.5 to describe an elevator has stationary distribution 1
T T * = li m » ( /)
=-j—•i—ˆ-(„αΛ). Γ
(6.13)
We virtuall y obtained thi s result in Section 5.5 by the indirect method, as we showed that π(ή was approximately (6.13) after only nine hours. We indicated in (5.68) that the stationary distributio n was independent of the initia l distribution , and you can check for yourself that all rows of R(t) in (5.65) do indeed converge t o (6.13) as t —• oo. We can also obtain thi s distributio n by the direct method. Recall fro m Chapter 5 that the matri x R(i) for the continuous-time birt h and death model wit h Ν + 1 states is obtained fro m the solution of the followin g system of Ν + 1 differentia l equations:
^
d
J
b
t
(6.14)
= d r -b r ; l
n
0
i0
" % + l>H + fr ØU+1’ d
d
1
r
<
<
" ; 1
(6-15)
Now, if the distributio n of X(t) is stationary, then R(f) is constant and equal to R(oo). Hence we have 7^
= 0,
0
N.
(6.17)
Th e elevator model of Section 5.5 is the special case of thi s in which Ν = 2 a. Hence fro m (6.14)-(6.17) we have and b - ά 0
Ύ
-ar ar
0
y
- Φι + di )r br {
= 0,
+ dr
i0
n
ix
+ ar -ar
= 0,
a
a
= 0.
You may wish to review Section 5.5 before proceeding.
(6.18)
214
Chapter s
Stationar y Distribution *
These equations are linearl y dependent; (6.18) sums t o 0 = 0. Their solu› tio n i s made uniqu e by appending (5.13), namely, r + r + r = 1. Hence l 0
i\> n) =
r
l
r
d
l2
( i> > d
+ a + b
ix
( >
α
6l9
confirmin g that (6.13) must be the limi t of each row of the matri x R(i). Similarly , in Section 5.6, we virtuall y established by the indirect method that the metered model of the same elevator, wit h matri x S defined by (5.76) and b = d = a, had stationary distributio n x
{
*'=jua*<Mi'5-i) r
( 6
·
2 0 )
W e indicated that thi s limi t was independent of ( 0 ) and virtuall y showed, throug h (5.77), that the limi t of the matri x S" as η -* oo was the matri x whose every row is equal t o (6.20). Thi s result can also be obtained by using (6.10); see Exercise 6.1. Again, we virtuall y established by the indi › rect method that th e bir d chain of Section 5.7 converges t o a stationary distribution . Thi s may also be found directly ; see Exercise 6.2. I n Chapter 2 we found that by assuming a system had already reached a steady state, we were able (directly ) t o determine equilibri a that could not easily be found by the indirect method, because of th e complexity of th e dynamical equations. I n the same way, by assuming that a stochastic process has reached stationarity , we are able to determine stationary dis› tribution s that could not easily be found by the indirect method. Th e rows of R(f) are identical in a stationary state, and so we have r y(i) = ( * ) independently of the value of /. Henceforward, we wil l analyze stationary distribution s solely by the direct method. I t is therefore convenient t o drop th e asterisk and denote th e (stationary) distributio n by the Ν + 1 dimen› sional vector η = ( , . . . , π ) . Then, for all /, we writ e r,j(t) , and on using (6.14) (6.17 ) we obtain the followin g equations for a stationary birth and death process: (
j t
τ
0
;
Ν
- V o + 4*1=0, bj_, , _ , - (bj + dj)*j 4- d 1* , j+
b _, N
= 0,
J+
9Tjv_ j - d ir N
N
= 0;
(6.21) I < ; < Ν - 1,
(6.22) (6.23)
7=0
Onl y Ν + 1 of these JV + 2 linear equations are independent, because the left-hand sides of (6.21)-{6.23) sum t o zero. By substituting (6.21) int o (6.22) for j = 1, and proceeding recursively for higher values of j , it is readil y shown that £•,•_!*, _, = dpsj, for all 1 < j < N. Hence, on using
6.3
How Lon g Is th e Queu e at th e Checkout ? A Firs t Loo k
215
(6.24) and defining „ C
hj_ b _ b:_-,...b br l
i =
j
A A A
1
l
A A
j
>
J?- ' 1
( · 6
2 5
)
d d _ d _ ...d d J
J
l
j
2
2
l
we find that =
Øj. ^ 1
L^j=
+
*j = Cjir , 0
r ’ ØS l<j
(6.26a) (6.26b)
I t is often convenient to let Ν be infinite . Thi s is legitimate whenever extends to zero sufficiently rapidly , as j » oo, for the resulting infinit e series i n the denominator of π to converge. We now proceed to an application of the stationary birt h and death process. 0
6.3
How Lon g Is th e Queu e at th e Checkout ? A Firs t Loo k
Suppose that a supermarket checkout has only one cashier, whose serving tim e is exponentially distribute d wit h mean J minutes. Let’ s assume that customers arriv e independently, the tim e between arrival s being exponen› tiall y distribute d wit h mean c minutes. Then we can model the queue at th e checkout as a birt h and death process, wit h arrival s corresponding to birth s and customer departures to deaths. Let the random variabl e X(t), takin g integer v a l u e sj = 0, 1 , 2, N, denote the number of individual s in the queue, includin g the one being served. Then, fro m expressions (5.41b) and (5.47b) for the reciprocal of th e mean tim e unti l transition , we have b, = \ ,
(6.27)
dj=\
for all relevant j (or, if you prefer, d Now assume that
Q
= 0 =
s < c.
b ). N
(6.28)
Thus, on average, the cashier work s fast enough to restrict the queue t o an acceptable size. Although the pattern of customer arriva l wil l change durin g the day, it does not seem unreasonable to suppose it constant over a fairl y short interval , a lunch hour, perhaps. Let us therefore assume that th e queue is stationary, i.e., that the distributio n of X(t) is independent of time. Then YTob(X(t) = j) = π is independent of time, and fro m ( 6 . 2 5 )}
216
Chapter s
Stationar y Distribution s
(6.27) we have
(6.29)
Let’ s define (6.30)
Ρ =
Th e parameter ρ is a measure of business intensity; note fro m (6.28) that 0 < ρ < 1. Then (Exercise 6.4) the expected value of the length of the queue is F
m
A
Np»+l-(N+l)^+p
(6.31)
Thi s is a rather unwieldy expression. We therefore assume that ./V is so large as t o be effectively infinite . Then, takin g the limi t of (6.31) as Ν -* oo, the expected number of individual s in the queue is (6.32)
l-p-
Thi s function is plotted in Fig. 6.1. Notice how rapidl y L , increases as ρ approaches 1. I t jump s fro m 3 t o 10 as ρ increases fro m 0.75 t o 0.91. Mean queue lengths of up t o 3 are probably quit e acceptable; whereas mean queue lengths of up t o 10 are certainly not, and the manager would have t o open another checkout. Thu s our checkout model, albeit a very simple one,
10
0
0 .2
0 .4
0 .6
0 .8
1.0
Fig. 6.1 Single-server mean queue length as a function of business intensity.
6.4
Ho w Lon g Is th e Queu e at th e Checkout ? A Secon d Loo k
217
has already played an importan t role. It has highlighted the importance of th e parameter ρ and told us that s and c are importan t times, which a successful manager must measure and know.
6.4
How Lon g Is th e Queu e at th e Checkout ? A Secon d Loo k
W e saw in the previous section that if p, the business intensity, is close to 1 then the queue, on average, wil l be too long and a second checkout wil l be opened. It is now permissible for s t o exceed c, but s/2 must still be less than c if th e tw o servers together are t o restrict the queue t o an acceptable size in the long run . Hence ρ < 2. To make matters simple, we wil l assume that the customers for m a single queue whose first member advances t o th e next available server. Thi s is already what happens in banks and post offices and may one day happen in supermarkets, too. I t is still tru e that (6.33)
bj = \
because customers arrive , on average, every c minutes. But it’ s no longer tru e that dj = l/s because the chance of a "death," or customer departure, increases wit h the number of servers. It seems reasonable t o assume that th e new (two-server) death rat e wil l be twice the old one. But we must also remember that one server wil l be idl e if j = 1, because the only customer then enjoys the attention of the other server. Hence
4=
-, 1
i ?
X2<j
f
; ’ =
L
I n these circumstances (Exercise 6.5), it is straightforwar d t o show that th e expected value of the length of the queue is
where
° —r~τ;;"·
π
=
·>
(6 36
These expressions are somewhat unwieldy. Therefore, as in the previous section, we assume that Ν is so large as t o be effectively infinite . Then the mean queue length wit h tw o servers is (6.37)
218
Chapter 6 Stationary Distribution«
This function is plotted in Fig. 6.2. You should verify that L2(p) < Lfa) when p < I (when p > 1, of course, Z,, is undefined). The dashed horizontal line represents a mean queue length of three. Suppose the manager believes that this value should not be exceeded. Then, from Fig. 6.2, a single checkout will suffice if 0 < p < 0.75, and two will suffice if 0.75 < p < 1.44. If p significantly exceeds 1.44, however, then at least three servers are needed. It isn't difficult to see how the results of this section can be generalized to an arbitrary number of servers, k. We will assume, of course, that these k servers restrict the queue to an acceptable size in the long run. Thus s/k < c or (6.38)
P< k.
If all are busy, then the death rate is k times that for a single server, but if at least one is idle (j < k), then the death rate is j times that for a single server. Hence (6.34) is replaced by if; > k; dj=<
(6.39)
if 1 <j
Assume that N is so large as to be effectively infinite. Then (Exercise 6.6) the expected value of the /c-server queue length is Lk{P) =
Σ;=ι (7rrj! + ir(JÉ) ι
+ Σ;=ι yT + m=7>
MP>
0
1
Fig. 6.2 Mean length of fc-server queue at checkout.
2
(6.40)
6.5
Ho w Lon g Mus t Someon e Walt at th e Checkout ? Anothe r Vie w
219
Note that (6.32) and (6.37) are the special cases of (6.40) for which k = 1 and k = 2, respectively. Th e graph of L
M-(3- )(6 P
+
4
P
+
pi)
(
6
4
1
)
is also sketched in Fig. 6.2, fro m which you can see that three servers would be adequate if p < 2.0. But a fourt h server would be needed if ρ were significantly greater than 2, and so on, ad infinitum . Th e notion that three is th e critica l queue length is entirely arbitrary , of course; but it is clear how Fig. 6.2 may be extended to higher values of k (up t o the maximum number of checkouts available), so that a manager can determine the appropriat e number of servers for any business intensity. I f the choice of 3 for a critica l queue length is purely arbitrary , however, then how do we decide which length is optimal? Perhaps you would lik e t o thin k about that it’ s th e kin d of question we shall tr y to answer in th e followin g chapter. Meanwhile, now might be a good tim e t o attempt Exercises 6.7 and 6.8.
6.5
How Lon g Mus t Someon e Wait at th e Checkout ? Anothe r View
Naturally , th e length of the queue at a checkout does not tell th e whole story about waiting. A queue of ten people might be quit e acceptable i f each took 30 seconds t o pass the checkout, but a queue of tw o might be unacceptable if you were th e second and had t o wait half an hour. For certain purposes, therefore, the waitin g tim e is a more reliabl e indicator of th e tedium of queuing than th e number of folk s in th e queue, but , as we shall now discover, th e expected value of the waitin g tim e in a stationary birt h and death process can always be deduced fro m th e expected length of th e queue. To make matters simple, we’ll begin wit h th e case of a single server and assume that Ν is infinite . Then fro m (6.29) and (6.30), we have ,r,=V(l-p) ,
;>0.
(6.42)
Suppose that there are / - 1 people in th e queue when an individua l arrives. Then, before departing, she wil l have t o wait a total of / service times. Now, fro m the point of view of the worl d at large, these service times are associated wit h a stationary birt h and death process. But our individua l does not care about th e waitin g tim e of people w ho joi n th e queue behind her. These futur e birth s are of no concern. Thus, fro m her point of view, th e birt h and death process converts t o a pur e death process wit h X(0) = /, in which she wil l witness / transition s before departing. Let th e times between these transitions, i.e., th e service times, be denoted by th e random variables
220
Chapte r
G, G, x
2
Stationar y Distribution *
G,. Then fro m (5.41a) and (6.27), we have (6.43)
Prob(G, > 0 = e~" . s
Because the exponential distributio n has no memory, (6.43) is valid even i f the first person in the queue has already been receiving the server’s at› tention when our individua l arrives. What really interests our individual , however, is the total waitin g time, includin g the tim e durin g which she is actually served. Let thi s be denoted by th e continuous random variabl e Y. Let us also define th e random vari › able Vj by V =G i
+ G +G +-+G _
l
2
3
i
(6.44)
+ G.
l
i
Now, if our individua l knew for certain that there would be, say,;’-1 people i n the queue when she arrived , then her total waitin g tim e would be Y = Vj, and th e thin g she wanted t o know would be P r o b (y < 0 = P r o b ( ^ < t). Thi s is readily obtained fro m Section 5.2. For if X(t) denotes the number of individual s in a pur e death process at tim e t, then Prob(^ . < t) = Prob(*( 0 = 0 | * ( 0 ) = j) = r (t),
(6.45)
j0
and explicit expressions for all entries of the matri x R(f) are already known. But our individua l does not know how many people there wil l be in the queue on her arrival , so that P r o b (y < 0 is not given by (6.45) and furthe r analysis is required. Let U be th e event that Y < t, and let U be the event that there are j people in the queue when our individua l arrives, for 0 < j < oo. Then, because the set {Uj'.O < j < oo} includes all possibilities, we have }
oo
Prob(U) = Σ
Prob(U \ U ) • Prob(Uj).
(6.46)
}
But Prob(i / I Vj) = P r o b (Y < t \ j in queue on arrival ) = and Prob[i/} ] = Hence (6.45) and (6.46) yield:
ΓΟΓΧ^
+ Ι
< t),
oo
P r o b ( r < 0 = E 7 + i . o U > y.
(6.47)
r
7=0
Now, itj is given by (6.42), and there are tw o equivalent expressions for
0+i.o(0: r
y + l j 0
( f ) = Prob(^,.
W O
=
P f
+ 1
< 0 = 1-
(6.48a)
ob(^ . < 0 = - /
+
s Jo
J-
(6.48b)
6.5
How Lon g Mus t Someon e Walt at th e Checkout ? Anothe r View
221
Th e first of these expressions follows directl y fro m (6.27) and (5.42) on replacing Ν by j + 1. The second expression, which is the one we shall use, can be obtained fro m (5.40) by recursive integration, but it can be obtained just as easily (Exercise 6.9) by observing that the integrand in (6.48b) is the derivativ e of (6.48a). Hence, on using (6.27), (6.42), (6.47), and (6.48b) we have CIs
rrob
J
=
"
(6.49)
7=0
= / ’ e-"-rX' d({\ Jo
/' l—*e-<"e""dC Jo
_ j _
s
s
-
pK/s)
-(i~p)tls
e
I n other words, on comparing (6.49) wit h (5.30b), our individual’ s total waitin g tim e is exponentially distribute d wit h transitio n rat e l/s- l/c, the difference between the death rat e (serving rate) and birt h rat e (customer arriva l rate). It follows immediately that the expected value of the waitin g time, which we wil l denote by W, is given by
W £[y]= iS
T
r
= _£_.
(6.50)
But fro m Section 6.3, the expected value of the length of a single server queue is L = pl{ 1 - p) - slc{ 1 - p). Hence IV and L are related by . (6.51) BIRTH RATE Thi s result is intuitivel y sound. It says that, under stationary condi› tions, AVERAG E Q U E U E L E N G T H = AVERAG E WAITIN G T I M E X AVERAG E RAT E O F ARRIVAL . Moreover, it is merely a special case of the more general result that IV = L= C
W =k, b
where
(6.52)
CO
b=J2 j*j b
j=o
<- > 6 53
for any stationary queuing process, whether service times are exponentially distribute d or not, and for an arbitrar y number of servers. It is also tru e that L„ W = ~f, (6.54) b where W is the expected value of the waitin g tim e excluding service time, and L is the expected queue length excluding the k people being served. q
a
q
222
Chapte r
Because L
q
Stationar y Distribution s
and L are related by oo
L 9
=
oo
> " - * 7 =*
)
; =
> ; -
> ; - * s I
y =l
7= 1
*- l
f
7= 1
^
(
k-1
oo
k-1
¸
… y =o
y =0
(6.55)
k-1
7 =0
all four quantities L , W, L , and W are known as soon as any one of them is known. These are just a few of the results that are known collectively as queuing theory. Thi s vast but quit e recent discipline generalizes the stationary birt h and death process t o deal wit h queuing problems where the interarriva l and service times do not have exponential distributions . Wh y might thi s generalization be necessary? Let’ s attempt t o answer thi s question by comparing th e exponential distributio n wit h mean μ, and hence cumulativ e frequency distributio n ?
q
Prob(G < 0 = 1 -
""" ,
(6.56)
wit h a frequently used alternative, namely, the so-called normal distribu › tio n wit h mean μ and variance σ (and hence standard deviation σ). Th e latter has probabilit y density function 1
f )=-±=e-«-^°
(6.57)
1
{t
and cumulativ e distributio n function Prob(G
J= = / ’
erK-rf^dd.
(6.58)
Both functions are denned for - o o < t < oo and are sketched in Fig. 6.3. N o t i ce that th e normal distributio n is symmetric about it s mean, at› taching the same probabilit y t o the event μ - r < G < μ as t o the event μ < G < μ + τ, for any value of r . Moreover, approximately 68% of obser› vations taken fro m a normal distributio n li e withi n one standard deviation of the mean, approximately 95% withi n tw o standard deviations, and al› most all (99.7%) withi n three. Thus, provided that μ exceeds 3 , (6.57) assigns negligible probabilit y t o negative values of a random variable. It can therefore be used t o approximate the distributio n of random variables that are intrinsicall y positive. On the other hand, the exponential distributio n is not symmetric about it s mean. Indeed it follows immediately fro m (6.56) that Prob(/j < G< μ + τ) _ Prob( < μ + τ) - Prob(C7 < μ) _ Prob(/i - τ < G < μ) ~ Prob(G < μ) - Prob(G < μ - τ) ~
£ 6
_
τ / μ <
(6.59)
6.5
How Lon g Mus t Someon e Walt at th e Checkout ? Anothe r View
223
/
(b)
Fig. 6.3 Normal distributio n with mean μ and variance a . (a) Probabilit y density function (6.57). Notice that 68% of the area under the graph falls in the interval σ-μ<ί<σ + μ, i.e., withi n one standard deviation of the mean. Mor e than 95% of the area falls withi n two standard deviations of the mean and almost all (99.7%) withi n three standard deviations. (b) Cumulative distributio n function (6.58). For each value of f, this records the area between the horizontal axis, - oo < ζ < t, and the graph in (a). Again, notice that 68% of normally distributed values fall withi n one standard deviation of the mean and almost all (99.7%) fall withi n three. We will use this observation in deriving the normal approximation to the Poisson distribution ; see Section 7.2. 2
Onl y 100 e~ fa 37% of exponentially distribute d values li e above the mean; the corresponding figure for th e normal distribution , of course, is 50%. Yet despite that, an exponentially distribute d random variabl e is more than twice as likel y as a normall y distribute d one to exceed the mean by tw o standard deviations. These qualitativ e considerations enable us t o reach some tentative con› clusions about inter-transitio n times in queues. I f real service times fall withi n a narro w band and are as likel y t o exceed the mean as fall be› low it , then the normal is a more suitable service distributio n than the exponential. Thi s would happen if each customer received the same serl
224
Chapte r 6
Stationar y Distribution *
vice in theory but human frailt y made service tim e a random variabl e in practice i n a soup kitchen, for example, where everyone gets soup and a roll ; or at a movie theater, where cashiers appear able t o launch tickets and change at a famil y of seven as rapidl y as at a dating couple. I n such circum› stances, long service times would be exceedingly rare. But customers in a supermarket may be buying anything fro m a six-pack of beer t o a gourmet meal that is fit for a queen. Long service times must therefore be assigned higher probabilit y than according t o the normal distribution . Moreover, isn’t it tru e that the majorit y of supermarket service times are lower than average? Don’t checkout queues usually m o ve prett y quickl y unti l someone can’t find her check book, or insists on paying wit h a Bank of Mar s card? Thi s all suggests that the exponential is a more suitable service distribu › tio n for a supermarket checkout than the normal; and the validit y of thi s hypothesis can be tested by a method t o be described in Section 8.7. On th e whole, you don’t have t o worr y so much about customer interarriva l times the y tend t o be exponentially distributed , even when service times don’t . But the value of c might vary throughout the day. Thu s our model, which assumes c constant, is valid only for fairl y short intervals, and differ › ent versions of it would have t o be used at different times durin g the day. Unfortunately , although queues wit h nonexponentially distribute d inter-transitio n times are importan t in practice, the technical difficultie s associated wit h studying them far outweigh the additional contributio n they make t o an understanding of the modelling process. Therefore, we shall not pursue them furthe r in thi s text. But if you would lik e t o pursue th e matter yourself, then you might begin wit h Chapter 10 of Hillie r and Liebermann (1980), followed by Chapter 8 of Ross (1980). Indeed our for › mal study of queuing theory could have ended wit h the previous section if it weren’t that tw o of thi s section’s results wil l be needed later. The first is (6.49), which we shall need in Chapter 7. Th e second is the probabilit y den› sity function of the random variabl e V defined by (6.44). Directl y fro m (6.48b), we see that the cumulative distributio n function of V is given by h
t
(6.60) Hence, on using (A.28), it s probabilit y density function is given by d
t'^e'"*
(6.61)
W e say that V, has a Gamma distributio n wit h parameter i, on 0 < / < . Th e Gamma distributio n is sketched in Fig. 6.4 for several values of i. Note that, because V, is the sum of i independent random variables, which are identically distribute d wit h mean s, it follows fro m (A.58) that the mean and variance of the Gamma distributio n are μ = is and σ = is . We shall need (6.61) in Exercise 6.10. 2
2
.
Th e Structur e of th e Wor k Forc e
225
0 . 4 /i -
0
2
4
6
8
10
12
14
16
18
20
Fig. 6.4 Gamma distributio n with mean is and variance is for various values of i. (a) Probabilit y density function (6.60). (b) Cumulative distributio n function (6.61). 2
6.6
The Structur e of th e Wor k Forc e
Marko v chains have proved extremely useful in the social sciences, where a natural unit of nonlinear tim e is one generation. I n 1953 or thereabouts, David Glass and John Hall made use of thi s fact t o construct the followin g model of social mobilit y in Britain . Let seven classes of occupation, i = 0, 1, 2, . . ., 6, be defined as in Table 6.1. Let the random variabl e X(n) denote the occupational class of a randomly chosen individua l fro m the nth generation of the Britis h work force, and suppose that her children’ s chances of belonging t o a certain occupational class do not depend on that of her parents. I n other words, suppose that Prob(X( n + 1) = j | X{n) = /) = P r o b ( * ( « ) =
| X(n - 1) = /) = p . u
(6.62)
Then the seven occupational classes may be regarded as the seven states of a Marko v chain, wit h Py denoting the probabilit y that a son or daughter of a member of class Øwil l become a member of class j .
226
Chapte r
Stationar y Distribution *
Table 6.1 and Hall
Occupational classes defined by Glass
State
Class of occupation
0 1 2 3 4 5 6
Professional and higher administrativ e Managerial and executive Higher grade supervisory and nonmanual Lower grade supervisory and nonmanual Skilled manual and routin e nonmanual Semi-skilled manual Unskilled manual
Based on thi s assumption, and using data collected in 1949, Glass and Hal l estimated a transitio n matri x for England and Wales t o be -.388 .107
.146 .267
.202 .277
.035 .021
.101 .039 .024
.188 .112
.009 .0 .0
.013 .008
.075 .041
.062
.140
.047
.015-
.120 .191 .212
.206 .357
.020 .061 .062
.123
.473 .391 .364
.053 .067 .124 .171 .312 .235
.155 . 2 7 4.
.088 .083
.036
.430
.125
Thi s says, for example, that about 1.5% of children of professional and higher administrativ e people grew up t o become unskilled manual work › ers. (Th e data were actually based on 3 5 00 pair s of fathers and sons and excluded the female work force; but we wil l ignore thi s point in the present section, where we are simply concerned wit h the idea behind the model.) I t is straightforwar d t o show that th e Marko v chain associated wit h (6.63) has a unique stationary distribution , it. One way t o verif y thi s would be t o use a computer t o calculate successive powers of P. A s η -* oo, all row s of P" would converge t o ir . A second way would be t o inspect the transitio n matrix , verifyin g that the conditions laid down at the end of Section 6.1 are all satisfied; i t would then emerge fro m (6.10). By either method, the unique stationary distributio n is found t o be given by T
ˆ
= ( 0 . 0 2 3 , 0 . 0 4 2 , 0 . 0 8 8 , 0 . 1 2 7 , 0 . 4 0 9 , 0 . 1 8 2 , 0 . 1.2 9 )
(6.64)
Thi s enables us to predict the structur e of the Britis h work force several generations fro m now. We might, for example, predict that about 4% of worker s wil l be managers or executives. Naturally , the correctness of any prediction s wil l strongly depend on the correctness of th e model’s major assumption, namely, (6.62).
6.7
Whe n Doe » a T-lunctlo n Requir e a Left-tur n Lane ?
227
D o worker s really migrat e in fixed proportion s fro m one occupational class t o another? We wil l retur n t o thi s question in Chapter 8, where we describe how the transitio n matri x (6.63) was estimated.
6.7
When Does a T-junctio n Requir e a Left-tur n Lane ?
Consider a T-junctio n on a narro w two-lane road. A s drawn in Fig. 6.5, th e major road run s fro m nort h to south, wit h the minor road leaving t o th e west. There is no left-tur n lane on the major road at th e junction . Thu s if southbound traffi c is heavy, then cars turnin g left may have difficult y entering th e minor road and may cause delays t o northbound traffic . When is thi s problem serious enough t o warran t buildin g a left-tur n lane? I n thi s section, we wil l attempt t o answer that question. Let A denote the mean traffi c flow fro m nort h t o south, expressed as number of cars per second. Let μ denote the corresponding flow fro m south t o north . Let Æ denote the probabilit y that one of these northwar d bound cars wil l tur n left at the junction ; hence 1 - a is the probabilit y that it wil l continue forward . We wil l suppose that northbound driver s first cross th e bar marked "Decision" in Fig. 6.5, then decide t o tur n left (wit h probabilit y a ) or continue forwar d (wit h probabilit y 1 - a). We wil l call thi s bar th e decision bar. I n practice, th e decision bar might be 20 or 30 yards 2
4
Nort h
1 - Æ
D e c i s i on
S o u th
Fig. 6.5 Plan of T-junction .
t"
You may wish to review Section 5.4 before proceeding.
228
Chapte r 6
Stationar y Distribution *
south of the junction ; but it wil l be convenient t o imagine that driver s make thi s decision at the last possible moment, so that th e decision bar i s about a car-length away fro m the turnin g point (thi s is, anyway, how almost everyone in Tallahassee seems t o drive). Let Τ be the m i n i m u m tim e gap in the southbound traffi c flow that wil l allow a north-bound car t o tur n left (assumed the same for all cars). Because ˆ is a time, as opposed t o a distance, it is immaterial whether a southbound car turn s righ t or goes forwar d at the junction . We wil l assume throughout that driver s joinin g the main road at the junctio n (fro m the west) interrup t neither the northbound nor southbound flow, but rather enter the main stream of traffi c whenever i t is completely clear for them to do so. We wil l also assume that driver s act responsibly, so that southbound cars are not impeded by driver s turnin g left when such a m o ve would be dangerous. I t is then reasonable to regard th e approach of southbound cars to th e junctio n as unrestricted; and hence, as for the crossing control problem of Section 5.4, t o model it as a Poisson process, wit h an average of Ar arrival s in an interval of length t seconds. Let th e random variabl e S denote the tim e gap in seconds between southbound cars. Then, fro m (5.52), the distributio n of S is given by Probi S > /) = e~ , M
0 < t < oo.
(6.65)
Similarly , if the random variabl e Ν denotes the tim e gap in seconds be› tween northbound cars whenever northbound traffi c is moving freely, then i t seems reasonable to assume that Prob(/V > t) = e-"',
0 < t < oo,
(6.66)
wit h associated probabilit y density function f (t) N
= j
{Prob(JV < 0} = μ
t
0 < t < oo.
(6.67)
Let us define a tailback to be a group of one or mor e northboun d cars that have been brought t o a halt behind a car turnin g left at the junction . Because a tailback may form , northbound traffi c need not m o ve freely at th e junctio n itself, but it wil l still m o ve freely behind the tailback! Thu s (6.66) governs times between northbound arrival s at the tailback, if there is a tailback; or at the junction , if not. Fro m our comments above, it follows that the first car of any tailback wil l be waitin g just behind the decision bar. N ow suppose that a northbound car has reached the T-junctio n and i s waitin g to tur n left. I n Fig. 6.5, it has just crossed the decision bar. Let th e random variables S S , S , . .. denote the sequence of tim e gaps in th e southbound flow which confronts thi s driver ; and let Uj be th e event that she enters the minor road durin g the jth such gap. Then, because th e gaps are independent, her predicament is identical t o that of a crossing lf
2
3
6.7
Whe n Does a T-)unctlo n Requir e a Left-tur n Lane ?
229
v= t
Τ
0 Fig. 6.6 The region in the r-v plane for which s ˆ and t > v. This infinit e trapezoid is sliced into infinitesimall y thin strips, parallel to the r-axis and extending from / = to t —* oo. For fixed v, the inner integration with respect to t in (6.70) is performed along a strip, as indicated schematically. The outer integration with respect to then sums over all such strips. pedestrian, and we deduce immediately from (5.53) that Prob(t/ ) = P r o b ^ y
<ˆ,
= (1 _ e - A 7 y -i
2
< r, Sj >
<: ˆ, . . .
g-Ar
7)
Let W denote the event that no tailback form s behind our waitin g driver , and let q denote the probabilit y that southbound car / arrive s before the next northbound car, conditional upon southbound cars 1, 2, . . . , i - 1 having al› ready arrived ; and all conditional upon tim e gaps not exceeding Τ in the southbound flow. Then, because a Poisson process is memoryless, q = ProbiA f > S\ S ^ T) is independent of /. Let A denote the hatched trapezoidal region in Figur e 6.6, and note that S has probabilit y density function t
t
(6.69) by analogy wit h (6.67). Then, because (A.l 1) implies that Prob(/V > S \ S < T) equals Prob(/V > S and S < T) divided by Prob(5 < T), we have
(6.70) 1 _
μ+\\
e
-(M+A) r
1
ixercise 6.10. on using the results in Exercise
3
am very grateful t o Peter Watterson for pointin g out that I n e g l e c t ed to condition on g a ps no greater than Τ in earlier editions of thi s b o o k, in effect a s s u m i ng that T—»
00
in ( 6 . 7 0 ) - ( 6 . 7 4 ).
230
Chapte r
Stationar y Distribution *
Now, given that our driver enters the minor road durin g gap j , the probabilit y that no tailback form s behind her is simply the probabilit y that the 0 - l)t h southbound car passes her before the next northbound car arrive s at the junction . I n other words,
Prob(^m.) = ^
. _
2
. . . ^ , ^
{
A
^
+
}
{
i
_ . e
A
r
}
)
,
(6.71)
on using (6.70). But the infinit e sequence of events {£/,, U , U ,...} ex› hausts all possibilities for entering the minor road. Hence fro m (A. 13), 2
3
oo
?rob(lV) = Σ Prob( W | Uj) • Prob(C/})
(6.72) (6.73)
on using (6.68) and (6.71). Let θ denote the probabilit y that a tailback does for m behind a left-turnin g driver . Then (Exercise 6.10) (μ + º) ˆ
` ˆ
θ- 1 - P r o b W - 1 (6.74) Note that because the formatio n of a tailback i s governed by tw o memoryless Poisson processes , θ is also the probabilit y that a tailback containing tw o or more cars wil l for m behind a tailback containing precisely one. Let us now define four traffi c configurations, labelled / = 0 , 1 , 2 , 3, as shown in Fig. 6.7: +
Configuratio n = 0 i= 1 ’= 2 i= 3 :
º
Last car to driv e over decision bar has continued forwar d is waiting to tur n left has continued forwar d is waiting to tur n left
(
+ º )
Status of northbound lane no tailback no tailback tailback tailback (6.75)
Because transition s between these configurations are governed by tw o memoryless Poisson processes , we may regard them as the states of a Marko v chain. Notice that each transitio n corresponds to a physical event. States 0 or 1 may be entered only when a car crosses the decision bar,
ft 0
1
2
Fig. 6.7 Possible traffi c configurations at a T-junction .
ft 3
6.7
When Does a T-junctlo n Requir e a Left-tur n Lane ?
231
states 2 or 3 either when a car crosses the decision bar or when one join s th e tailback. Thu s tim e is measured nonlinearly. Therefore, let = [py] be the transitio n matrix ; i.e., let py be the probabilit y t h a t i s the next configuratio n if the current one is /, 0 < i, j < 3. Then, because state 2 cannot be entered fro m states 0 or 1, and because state 3 cannot be entered fro m state 0, we have p = p = p = 0. Suppose that the junctio n is in state 0. Then northbound traffi c is moving freely, the last car over the decision bar has gone forward , and the next state wil l be 0 or 1 according t o whether the next car goes forwar d or turn s left, after passing the decision bar. Hence p - 1 - a, p = a. Suppose that the junctio n is in state 1. Thu s a car is waitin g to turn , and traffi c behind it is still moving freely. I f it fail s to tur n before the arriva l of the next northbound car, however, then a tailback wil l for m and th e junctio n wil l enter state 3. Hence p = Θ. Otherwise, the car succeeds i n turnin g before the next arrival , no tailback form s and the next state wil l be 0 or 1 according to whether the next northbound car goes forwar d or turns . We have thus determined p , 0 < j < 3. Next suppose that the junctio n is in either state 2 or state 3; let r denote the probabilit y of exactly one car in the tailback (conditional on at least one car) just before the next transition ; and let ædenote the corresponding proba› bilit y just after the previous transition . A s noted above, the probabilit y that the tailback does not lengthen durin g the interi m is 1 - Θ, and so r = (1 - θ)ρ. But æ < 1. Hence 0 2
0 3
1 2
w
0l
l3
Vl
æ < 1 - θ.
(6.76)
Thi s inequality wil l yield an answer to the question we set out to address i n effect, a sufficient condition for a left-tur n lane to be necessary! N ow suppose that the junctio n is i n state 2 for sure. Then a car has just gone forward , and the junctio n wil l enter state 0 or state 1 wit h probabilit y r, state 2 or state 3 wit h probabilit y 1 - r. I f it enters state 0 or state 1, then it wil l enter state 1 wit h probabilit y a and state 0 wit h probabilit y 1 - a. Similarl y for state 2 or state 3. Thi s is sufficient t o determine p , 0 < j < 3. Suppose, finally, that the junctio n is in state 3. Then it wil l enter state 0 or state 1 only if there is precisely one car in the tailback and the waitin g car succeeds in turnin g before the next arrival . Hence p + p = r{ \ - Θ). I f the junctio n enters state 0 or state 1, then it wil l enter 1 wit h probabilit y Q and 0 wit h probabilit y 1 - a. Otherwise it wil l enter state 2 or state 3. I t wil l enter state 2 if the waitin g car succeeds in turnin g before the next arrival , and the tailback contains more than one car, and the next car goes forward . Thu s 2j
}0
p
3 2
= (l-0)(l-r)(l-a) .
3 1
(6.77)
I t wil l remain in state 3 if either the waitin g car fail s to tur n before a new northboun d car arrives, regardless of how many cars are in the tailback; or i f the tailback contains more than one car, and the waitin g car turn s before
232
Chapte r 6
Stationar y Distribution s
an arrival , and the next car then waits to tur n left. Thus />33 = 0 + ( l - r ) ( l - 0 ) a .
(6.78)
Combining our results, we find that the transition matri x for the Marko v chain is 1- Α ( 1 - 0 X 1- Α ) ΚΙ - A) .R(L-0Xl-A)
a
0
0
0~θ)α rex R(L-0)A
0 (1 - RXL - a) (\ - φ - βχ\ - α)
θ
(1 - r)a θ + (1 - RXL - θ)α
(6.79)
Inspection of (6.79) reveals that it is the transition matri x of an irreducibl e ergodic Marko v chain; see the end of Section 6.1. Hence, irrespective of the value of 7r(0), the T-junction’ s distributio n vector (« ) will converge to a unique stationary distributio n 77(00). On using (6.10) thi s stationary dis› tributio n is found to be (Exercise 6.10) R(L - 0)(1 77(00) = —
R(L αθ(\
a)
θ)α
- Ł ) (1 - Æ ) (1
αθ{(1
(6.80)
-r)
- a)r + a}
where (6.81)
Γ = {1-β(ΐ-α)Μ1-αβ) + αβ}.
Note that the numerator of ( ) is the product of five numbers wit h magnitude less than one; whereas for j = 0,1,3, the numerator of JT/OO) is the product of only three numbers with magnitude less than one. Thus 2 is always the least probable configuration, as confirmed by numerical results. 2
From (6.80), we deduce that the stationary proportio n of blocked config› aff)r)(\uration s is Β = 7 7 ( o o) + 773(00) = αθ{ 1 - (1 - Æ)(1 - r)0}/{(<* 0 + (1 (1 - οήθ)}, which decreases wit h r and hence is least for r = 1 - Θ, by (6.76): i f Β is too large for r = 1 - Θ, then Β is too large, and thus we arriv e at our sufficient condition for requirin g a left-tur n lane. Let ˜(º , μ, a, Τ) denote the lower bound on B. Then, on setting r = 1 - θ in Β and writin g 0(º, μ, Τ) in place of (6.74), we obtain 2
˜(º , V
^
, Æ, Τ) =
1+
( 1 - 0 ( ` , μ, αθ(λ,
μ,Τ){\-{\-α}θ(λ,
: Τ)}
•
(6.82)
2
μ,
Τ) } 2
Let 6 denote the maximum proportio n of traffi c configurations in which a tailback is deemed acceptable. Of course, defining S may requir e a value judgment on the part of a traffi c engineer or community activist, depending C
c
6.7
Whe n Doea a T-junctlo n Requir e a Left-tur n Lane ?
233
on the purpose for which the model is being used, but we shall suppose that somehow 6 is known. Then a left-tur n lane is necessary if C
A(X,p,a,T)>6 . c
(6.83)
I f ˜ > 6 but there is no left-tur n lane, then driver s may tr y t o reduce ˜ t o 6 by lowering their perception of the value of T, thu s increasing the risk of collisions at the junction . Th e junctio n of High Road wit h Hartsfiel d Road in Tallahassee was a Tjunctio n lik e the one we have described above. High Road, the main road, run s nort h and south; Hartsfiel d Road, the minor road, run s east and west. Hig h Road is not used excessively by large vehicles, and those that do use it almost never tur n left int o Hartsfield . Thus assuming Τ to be the same for all cars is a better approximation to realit y than it might be at many other junctions. Unfortunately , the other major source of such variation , namely, the personality of the driver , cannot be so easily eliminated. C
C
O n Apri l 10, 1986, a normal workin g day, th e Cit y of Tallahassee Traf › fi c Engineering Department enumerated peak-hour traffi c movements at thi s junction . I n the morning, 437 vehicles traversed the junctio n in the southbound direction and 154 in th e northbound direction, of which 41 turne d left int o Hartsfield . For the mornin g rush hour, it therefore seems reasonable t o take º = 437/3600 = 0.121, μ = 154/3600 = 0.0428 and a = 41/154 = 0.266. I n the evening, 383 vehicles traversed the junctio n in th e southbound direction and 337 in the northbound direction, of which 133 turned left int o Hartsfield . For the evening rush hour, it therefore seems reasonable t o take A = 383/3600 = 0.106, μ = 337/3600 = 0.0936 and a = 133/337 = 0.395. For these mornin g and evening rush hours, ˜ has been plotted i n Fig. 6.8 as a function of T. For Τ = 6, for example, th e model predicts that the northbound lane may have been brought to a halt behind cars turnin g left for only 3.2% of traffi c configurations in the mornin g rush hour, but for more than 8.1% of traffi c configurations in the evening rush hour. Unfortunately , data for Τ were not available, though it seems likel y that Τ would be less than 10 seconds (which is why th e graph has been truncated at that value). Th e T-junctio n model we developed in thi s section represents a con› siderable improvement upon Li u and Yao (1977); see Exercise 5.12. Our model allows arbitrar y values of the four most relevant traffi c parameters, namely, southbound traffi c flow A, northbound traffi c flow μ, left tur n prob› abilit y a, and minimu m crossing tim e 7¸ By contrast, Li u and Yao’s model allows arbitrar y values of only tw o parameters, namely, th e left tur n proba› bilit y a, and the probabilit y that a southbound vehicle wil l tur n right . Th e latter is one of the least relevant parameters. Mor e fundamentally, however, Li u and Yao chose traffi c configurations in which a northbound vehicle can tur n left only after a southbound vehicle has turned right . Thi s is clearly unrealistic, because left-turnin g vehicles could not take advantage of breaks
234
Chapte r 6
Stationar y Distribution s
˜
Fig. 6.8 Proportion of traffi c configurations, Δ(\,μ,α,Τ), as a function of mini › mum crossing tim e ˆ , in which flow along a narrow two-lane major road develops a tailback in one direction behind cars turnin g left onto a minor road at a T-junction . The values of the parameters ¸ , , and a are fixed for the morning and evening rush hours at a T-junctio n in Tallahassee, Florida.
in the oncoming flow and would block the northbound lane permanently if all southbound traffi c were continuing forward ! (I n the mornin g rush hour described above, only 53 of the 437 southbound cars, i.e., only 12%, turned right.) I devised thi s model toward the end of 1986. Th e junctio n of High wit h Hartsfiel d in Tallahassee has since been redesigned.
Exercise s 6.1 By solving (6.8) and (6.9), with 2 replacing 5 in (6.9) and S given by (5.76), verif y directly that (6.20) is the unique stationary distributio n of the linear tim e elevator model introduced in Section 5.6. 6.2 Verif y directly that (5.92) is the unique stationary distributio n of the bir d chain considered in Section 5.7. Confir m that, when the distributio n is sta› tionary , the mean number of bird s in the Nort h end of the cage is 2, as suggeste d by (5.91). 6.3 Show that the modified bir d chain in Exercise 5.8 has the same stationary distributio n as in Exercise 6.2. Thi s further illustrates that stationary dis› tribution s exist which cannot be found by the indirect method, at least as described at the beginning of thi s chapter. The relationship of this station› ary distributio n to the pattern discovered in Exercise 5.9 is explained, for example, by Hoel et. al. (1972, pp. 78-79). It is interesting mathematically but has littl e to do with the subject of thi s book.
Exercise s
235
6.4 Verif y (6.31). Hint: First differentiat e
wit h respect to p. 6.5 Verif y (6.35) and (6.36). Hint: Adapt Exercise 6.4. 6.6 Derive (6.40). 6.7 (i) Let the random variables A and / denote, respectively, the number of active servers and the number of idle servers in a stationary supermarket. Then =
f 0,
if A > k-
\k-A,
ifA
Show that the expected number of idle servers is E[I] = k - p. (ii ) Deduce that the expected number of active servers agrees with intuition . Hint: Assume Ν infinit e and use the fact that jCj — pCj_ if j < k - 1, whereas kCj = pC _, if j > k. (
;
* 6.8 A single worker is responsible for the maintenance of TV machines. The tim e she takes to repair a machine is exponentially distributed with mean s, and the tim e until failur e of a machine is exponentially distributed with mean μ. Model this as a stationary birt h and death process in which the birt h rate bj actually depends upon j . Show that the expected number of machines in need of repair is
L = /v--(l-* )J, 0
where * 0 = ~ρ
1
;·
;=0
Hints: It may be easier to think of the birt h rate as being a function of Ν - j , the number of machines in workin g condition. You may find the mathematics easier if you observe that Cj = s(N -j+ l)C _ 11μ. Note that the model would apply as well to a team of repair workers if every member were needed to fix each machine. y
6.9 (i) Obtain (6.48b) by successiv e application of (5.40). Hint: Remember that (6.27) is valid only for j > 1; d = 0. (ii ) Verif y that the integrand in (6.48b) is the derivative of (6.48a). 0
236
Chapte r 6
Stationar y Distribution *
6.10 (i) Define the random variabl e V by Vj= 5, + S + . . . + 5,, where 5, is the /-th tim e gap confrontin g the northbound driver in Section 6.7, so that Vj has a Gamma distributio n (by (6.44) and (6.61)). Because northbound and soutbound flows of traffi c are indepen› dent, the join t probabilit y density function of Ν (the tim e gap be› tween freely moving northbound cars) and Vj is simply the prod› uct of (6.67) and (6.69); see Appendix 1, in particula r remark s followin g (A.55). So we can calculate the (unconditional) proba› bilit y that Vj < Ν as follows: }
2
Verif y thi s result, and show that it is consistent wit h (6.70) in the limi t as ˆ - » oo. (ii ) Verif y (6.74). (iii ) Verif y (6.80). **6.1 1 Use the model of Section 6.7 to compare several T-junction s in your vicinity . At least in Nort h Florida , there are still many such juntion s in rura l and outer suburban areas. Moreover, fro m tim e to tim e a lefttur n lane appears. Why did the traffi c engineers put it there and not at the junctio n further down the road? Was their decision a good one? Which of the remaining T-junction s is most in need of a tur n lane?
^ /
OPTIMAL DECISION AND REWARD
Toward the end of Chapter 3, on the subject of optimal control, we intro › duced the state variabl e x(t) and saw that it was generally a function of th e control, u(t). We also saw that utilit y / is generally a function of both χ and u in the first instance; although, because is a function of u, it is permissible t o regard / as a function of u alone. Th e control function is always deterministic, but in many circum› stances, particularl y where human action is concerned, uncertain knowl› edge of futur e events makes it more appropriat e to regard the state as a random variable, X{t). Because utilit y depends on state, it must also be a random variabl e and can no longer itself be maximized. Nevertheless, we can still maximize an associated statistic, e.g., it s expected value. To distinguish these circumstances fro m those we have met in Chapter 3, we shall call the control a decision variabl e whenever the state is a random variable, and the statistic t o be maximized wil l be called the reward (so "reward " is given a special meaning, which departs fro m c o m m on usage). A s we shall discover below, however, matters of optimal decision and re› war d are identical in all other respects t o matters of optimal control and utility . The optimal decision is always the one that maximizes reward. Throughout the followin g examples, we shall assume that reward is indeed the expected value of utility . We wil l denote it by J, so that J(u) continues t o be the function that we maximize. Rewards other than ex› pected value are considered in Exercise 7.13 and in Section 8.8.
7.1
How Muc h Shoul d a Buye r Buy ? A Firs t Loo k
I t is customary for retail stores and other buyers to order merchandise at regular intervals. Let such an interval correspond to a unit of time. Let u denote the amount of some product that a buyer buys at the beginning of th e interval , and suppose that the merchandise is delivered immediately 237
238
Chapte r 7
Optima l Decisio n an d Rewar d
(for if it took tim e s t o be delivered, we could simply suppose that the buyer placed his order tim e s in advance). Let ˘ denote the demand for th e product durin g the interval . Demand is uncertain, so ˘ is a random variable. Assuming that th e distributio n of ˘ is known, how much should th e buyer buy? I n thi s section, we wil l attempt t o answer that question. We wil l assume that the buyer is a profi t maximizer, so that his reward is th e expected value of his profit . We wil l first derive an expression for thi s reward, then find the value u' that maximizes it . To make matters simple, we shall suppose that the stock is initiall y zero and that the buyer cannot reorder before the end of the interval . I f demand exceeds supply, then tard y customers are out of luck. Let the demand ˘ have probabilit y density function J\z). T h e n / ( z) > 0 o n 0 < z < co and
Let c denote th e cost t o th e buyer of a unit of merchandise. Let k denote th e delivery cost, plus any other administrativ e costs that are independent of the size of the order (assume that the order is never so big that an extra truc k is required t o deliver it) . Then the cost of placing that order is k+c u. Durin g the subsequent interval , one of tw o things may happen: demand may exceed supply or supply may exceed demand. I n the former case, no furthe r costs are incurre d and, because all unit s are sold, the retailer’ s revenue is simply pu, where ρ is the unit selling price. But in the latter case, where the retailer’ s revenue is pZ, furthe r costs know n as holding costs arise fro m the unsold units. 0
0
Included in holding costs are stock insurance and rent for additional storage space, if needed. Most holding costs, however, are opportunity costs, i.e., penalties for losing opportunities. For example, the warehouse space wasted by items for which demand is low could have been used more profitabl y by items for which demand is high. Moreover, the money used t o buy the unsold items could instead have been deposited in a bank, and the unearned interest is an opportunit y cost. These opportunit y costs depend i n quit e a complicated way upon the circumstances of the retailer and th e natur e of the commodity being sold. For example, if the retailer is a jeweler and diamonds are the commodity, then insurance is high but th e warehouse space that could have been used instead for grandfather clocks is negligible; and vice versa. Moreover, the unit of tim e for which an order is placed may be as short as 7 days, in which case unearned interest is negligible; or as long as 365 days, in which case it might be considerable. Despite thi s complexity, one thin g is clear: on any given day withi n th e interval 0 < t < 1, the more items in stock, the greater th e holdin g costs for that particula r day. We incorporat e thi s observation int o a model by making the robust assumption that holding costs per unit of tim e are proportiona l t o th e average stock withi n that interval . Let <(/) be
7.1
Ho w Muc h Shoul d
Buye r Buy ? A Firs t Loo k
238
th e stock level at tim e t, 0 < t < I . Then <(0) = u, and th e average stock per unit of tim e is
Thu s holding costs are
L'\{t)dt. ' at)dt,
(7.1)
(7.2)
where c is th e constant of proportionality . Suppose, for example, that the buyer ordered every week and that almost all sales were made on a single day (Saturday, say) at the beginning of the 7-day interval 0 < / < 1. (Thi s is not such an unlikel y circumstance. A s a high school student in England at a tim e when stores were forbidden t o open on Sunday, I worked in a furnitur e store and observed directl y that items unsold by Saturday night were almost always still unsold by the followin g Friday.) Then would have the for m depicted by the solid curves i n Fig. 7.1. Th e exact expression for (7.2) would be rather unwieldy. But C in Fig. 7.1 could reasonably be approximated by the dashed curves. For these curves, (7.1) equals u - ˘ if ˘ < u and equals 0 if ˘ > u. Let us define a threshold function Η by {
Fig. 7.1 Possible graph of depletion of stock C(0 durin g the interval 0 < / < 1 for which order is placed. If ˘ < u then CO) = Z- (a) Unsold items: Ζ < u; (b) unsatisfied demand: Ζ > u. (Technically, C(0 is a random variable, so the graph should be interpreted as that of its expected value, £[ (01•)
240
Chapte r 7
Optima l Decisio n and Rewar d
Then fro m (7.2), the associated holding costs are c^u-Z)H(u-Z). I n the present section, we wil l assume that the holdin g costs are of thi s form . A n alternativ e for m for ζ(ή, and hence holdin g costs, is depicted in Fig. 7.2; and we’ll pursue it in Section 7.3. Wit h the assumptions we have now made, total costs per unit of time, i.e., orderin g costs plus holding costs, are given by (7.4)
/C + C W + C , ( U - Z ) / / ( M - Z ) ; 0
and revenue per unit of tim e is pZ if ˘ < u and pu if ˘ > υ, i.e., p{Z + (M - Z)H(Z - «)}.
(7.5)
Thu s profi t fro m the period is the random variabl e P = ρ {Ζ + (u - Z)H(Z
- «)} - c,(u - Z)H{u - Z) - c u - k.
u
(7.6)
0
N o te that thi s i s a mixed random variabl e (see Appendix 1) because it takes th e value (p - c )u — k wit h finite probabilit y 0
/•OO
Prob(Z>w)= /
Rz)dz\
Ju
whereas all other values are continuously distribute d between - { ( c + c, )u+ Recall that our buyer is a profi t maximizer. Hi s reward k) and (p- c )u-k. i s therefore the expected value of profit , i.e., E[P ]. Th e mixed random variabl e P is defined in (7.6) as a function of the purely continuous random variabl e Z , and so we can calculate E[P ] directl y fro m the distributio n of ˘ and thus avoid finding P 's distributio n explicitly ; see (A.32). Thu s 0
0
U
u
U
u
J(u) = E[P„] = pE[Z + (u - Z)I1(Z - c E[(u l
- u)]
- Z)H(u - Z ) ] - c u - k 0
/•OO
= p
Jo
-c,
{z +
(u-z)H(z-u)}f{z)dz
/•OO
/ Jo
(7.7)
(u-z)II(u-z]f(z)dz-c u-k. 0
After some manipulatio n (Exercise 7.1), we obtain J(u) = (p + c,) j £
zf(z)dz
- u
"f(z)dz}
+ (p-
c )u - k. 0
(7.8)
By Leibnitz’ s rul e fro m the calculus, the first and second derivatives of thi s wit h respect to u are J\u)
= -iP + c.) [ f(z)dz Jo U
+ p - c
0
(7.9)
and / " ( « ) = -(p+CtYiu), which is negative. Thu s subject to a proviso that wil l be discussed at the end of thi s section, the optimal decision is t o order
7.1
Ho w Muc h Shoul d a Buye r Buy ? A Firs t Loo k
0
Η/˘
(b)
241
I
Fig. 7.2 Same as for Figure 7.1. u*, where u* is defined by f(z)dz=?-^
P+
(7.10)
C\
or, which is exactly the same thin g (why?),
L
N o t e that u* is unique (see Exercise 7.2). Then, on substituting (7.10) int o (7.8), we find the maximum reward to be zf{z)dz-k. (7.12) Jo I f the probabilit y density function is explicitl y known, then it may be possible to determine u* analytically. We explore thi s possibility in the Exercises (see, for example, Exercise 7.4). Even if the distributio n of ˘ is known only empirically , however, it is always possible to estimate u* fro m th e graph of it s cumulativ e distributio n function. To illustrat e thi s idea, let’ s suppose that demand ˘ has a normal distribution , wit h mean μ and variance . Then (Section 6.5): J(u*)=(p
+ ) Cl
2
Prob(Z
1
/
—i== σ\/2π
e- -" dz. {z
Ynol
(7.13)
Let be the cumulativ e distributio n function of a normall y distribute d random variabl e wit h mean 0 and variance 1; i.e., define ( ) = -i= —
If
e~<
/2
/ .
(7.14)
242
Chapte r 7
Optima l Decisio n and Rewar d
Then (Exercise 7.2) (7.15)
Prob(Z < u) =
Th e left hand side of (7.10) is just Prob(Z < u*); therefore we find that
Th e graph of is drawn in Fig. 7.3. Let 7 denote the unique value of t for which ( ) equals th e right-han d side of (7.16); ª is a function of th e tw o cost/price ratios, c /p and c,/p, and is readily determined fro m the graph of , as indicated in Fig. 7.3. Thus, for arbitrar y μ, σ, c /p, and c,/p, th e optimal order quantit y is given by 0
0
U*(ji, σ, c lp, C /p) = p + a- y(c /p, Q
t
c lp).
0
{
(7.17)
Because u* lies above or below the mean of ˘ according t o whether ª is positive or negative, we deduce fro m Fig. 7.3 that u* > μ or u* < μ according t o whether th e right-han d side of (7.16) is greater or less than 1/2, i.e., according t o whether ρ > c, + 2 c or ρ < c, + 2 c . I n other words, when demand is normall y distributed , it is risk y t o order a greater quantit y than E[Z] unless the buyers marku p per item, ρ - c , exceeds the cost per item plus the unit holding cost. I n all of thi s we have tacitl y assumed that the optimal reward is pos› itive . Now, if k is zero or very small, then J(W) is certainly positive. I f k is large, however, then th e possibility arises that J(u*) might be negative. On using (7.10) t o eliminate p + c, fro m (7.12), we find that / ( « * ) < 0 if 0
0
0
-3
Fig. 7.3 Cumulative distributio n function of normally distributed random variable wit h mean μ = 0 and variance a = 1; i.e., ( ) , as defined by (7.14). 1
7.2
k > k, c
where
Ho w Many Roaea fo r Valentine * Day ?
*, = ( , - . ) C f ^ . So
243
(7.IS)
S^)dz
I t would then be better not t o order at all; for then there would be no delivery cost k and a profi t of zero would be guaranteed. I n conclusion, therefore, the buyer should order an amount (7.19)
u'H(k -k), c
where Η is defined by (7.3), u* by either (7.10) or (7.11), and k by (7.18). I n practice, the cost of actually shipping the goods fro m supplier t o retailer is often proportiona l t o the amount delivered (particularl y if an independent truckin g company is used) and is then best regarded as incor› porated int o c . Th e fixed delivery cost k, due t o the order (and not due simply t o being in business), is then essentially the cost of promotin g th e items in question. I n these circumstances, a possible interpretatio n of k in (7.18) is that it is the maximum amount the retailer in question should even consider spending on promotin g the goods for which the order is placed. c
0
c
7.2
How Many Rose s fo r Valentine’ s Day?
Let’ s attempt t o apply our model to a man selling roses by the side of the road. Despite the exhortations of florists t o order early for Valentine’s Day, these street vendors are still in business. Indeed they seem to function all year long in Tallahassee; but we shall confine our attention to Valentine’s Day, when they are extraordinaril y busy, serving the needs of those for whom romance cannot be planned. Th e interval for which the rose-vendor orders, namely, part of a day, is so short that he loses no money by tyin g up his money in flowers (as opposed t o having it in a bank). Because his product is highly perishable, he throw s the surplus away at the end of the day, so that there are no storage charges. Hence c, = 0,
(7.20)
and the shape of ( ) in Fig. 7.1 becomes irrelevant . Moreover, because th e vendor does not pay t o advertise his roses, we can safely assume that k = 0 (see the remark s at the end of the previous section). Let’ s suppose that the vendor makes all hi s sales durin g a period of tw o or three hours, say the mornin g rush hours, which therefore correspond t o the interval 0 < t < 1. Because thi s interval is short, it is reasonable t o suppose that customers arriv e according to a Poisson process. I f the random variabl e A(t) denotes the number arrivin g by tim e /, then fro m (5.49), Prob(/l(f ) = k) = e - ’ ^ r B
( • ) 7
2 1
244
Chapte r 7
Optima l Decisio n and Rewar d
for some parameter B. Let’ s suppose that each customer buys one bunch of roses. Then demand for the period 0 < t < I is given by ˘ = A{\). Hence on using (7.21), ˘ has probabilit y distributio n Prob(Z = k)=
(7.22)
?^e- . B
Thi s is the cumulativ e distributio n of a discrete random variable; whereas th e buying model of Section 7.1 assumes that ˘ has a continuous distri › bution . Then can we not use the model? To answer thi s question, let us define the cumulativ e distributio n func› tio n of th e discrete random variabl e (7.22): F(k) = Prob(Z < k)
= ] T S^e-*.
(7.23)
Th e function F is plotted in Fig. 7.4 for three values of B, namely, Β = 10, Β = 30, and Β = 70. What do you notice about it s shape? First of all, it resembles that of the normal distribution . Thi s suggests that we might approximat e th e discrete Poisson probabilit y function (7.22) by a contin› uous normal probabilit y density function (6.57). But which values should we choose for the parameters μ and ? Recall fro m Exercise 5.2 that ˘ i n (7.22) has mean B, th e expected number of arrival s for th e entir e in› terval 0 < t < 1. Thi s suggests we take μ = Β. Recall fro m Fig. 6.3, moreover, that almost all normall y distribute d values li e withi n three stan2
1.0
0.8
0 .6 B=
10
= 30
* ´ = 70
0 .4
0 .2
0
10
*- 10±3VT0-
• I
30
I
50
70
90
7 0 – 3λ / 7 0 30 – 3 ^ 3 0 -
Fig. 7.4 Poisson cumulative distributio n function (7.23) for various values of B.
7.3
Ho w Muc h Shoul d A Buye r Buy ? A Secon d Loo k
245
dar d deviations of the mean. Then observe fro m Fig. 7.4 that the interval Β - l^B < k < Β + 3^B contains almost all values distribute d accord› ing t o (7.23). Thi s suggests that we take σ = y/B. I n other words, it leads us t o conjecture that the discrete Poisson distributio n wit h mean Β can be approximated by the continuous normal distributio n wit h mean Β and variance B. I s thi s conjecture correct? The answer is yes, if Β is sufficiently large. I t can be established rigorously that the Poisson distributio n wit h mean Β approaches the normal distributio n wit h mean and variance Β as Β -* oo; but the verificatio n is somewhat lengthy, and the reader who is unwillin g to accept thi s result on fait h is referred t o Fr y (1965, p. 251) for the proof. Fr y warn s against using the approximation far fro m the mean of the distribu › tion , where the relativ e error might still be large. Hi s caveat can be ignored for our purposes, however, because u* wil l always be close to th e mean. But how large is large? Fig. 7.4 suggests that values of Β exceeding about 30 are big enough, and you can verif y thi s numerically; see Exer› cise 7.6. It would hardl y be wort h a vendor’s whil e t o brave the early mornin g cold if he couldn’t sell at least 30 bunches of roses! Hence the approximatio n can safely be used, and on using (7.20), (7.17) yields the optimal order quantit y u'(B, VB, c /p, c, lp) = Β + y/B (c /p, 0
7
0
c, Ip).
(7.24)
Of course, real demand is always an integer, and so the value u* predicted by (7.24) must be rounded t o the nearest one. Fig. 7.3 has been drawn for c lp = 3/4 and c lp = 0; which would apply to the rose vendor if he marked up his roses by a third . The graph shows that (7) = 0.25 when ª is just a littl e larger than - 0 . 7. Mor e precisely, fro m tables of values of th e function (e.g., Lindle y and Miller , 1953), we find that 7 = - 0 . 6 7 4 5. Hence w* = y/B(y/B - 0.6745). If , for example, Β were 100 then our model would recommend that the vendor acquire 93 bunches of roses. Q
x
But should the vendor accept that recommendation? Perhaps you would lik e to thin k about thi s matter, then tr y Exercise 7.13.
7.3
How Muc h Shoul d A Buye r Buy ? A Secon d Loo k
I n Section 7.1, we assumed that merchandise sold to customers durin g the interva l 0 < t < 1 was mostly demanded shortly after t = 0. Thi s gave rise t o Fig. 7.1, which might be appropriat e if the interval in question were about a week. I f the interval is much longer (a month or a quarter , say), however, then we might expect demand t o occur more uniforml y throughout it . To simplif y the mathematics, we wil l assume that the shortter m demand, that is the rat e at which the stock is depleted withi n the interva l 0 < t < 1, is absolutely uniform . Then stock ζ(ή wil l vary linearl y wit h time, as shown in Fig. 7.2. I f supply exceeds demand, then the area
246
Chapte r 7
Optima l Decisio n and Rewar d
under th e graph i n Fig. 7.2(a) is u - ZI2, whence fro m (7.2), holding costs are c (u - Ζ12). I f demand exceeds supply, then only a proportio n ulZ of demand is satisfied. Because short-term demand is uniform , supplies are exhausted after a proportio n ulZ of th e interval 0 < t < 1 has elapsed, whence th e holding costs are c times the area in Fig. 7.2(b), or C | M / Z . On using (7.3), the expression for holding costs is therefore t
2
{
{(« - ±Z)H(u
-Z)+
- u) j .
^H(Z
(7.25)
Th e expressions for revenue and delivery cost are unchanged fro m th e pre› vious section. Thu s th e retailer’ s reward i s J(u) = £ [ R e v e n u e ] - £ [ C o s t s] =
ρ Γ {z + (u- z)H(z - u)}J\z)dz Jo
"
C{
Jo
{ (" " S ) Z
H
{
U
~
Z
= Ρ (J~ zAz)dz + j \ u ~
C l
{Jo
(" " Ι )™* 2
= (p + y ) / V ^
-\c u* x
2
)
Tz
+
^ \ ^
u
d
z
- W - k
z)f\z)dz^j
ˆ ^
+
- (P +
J™Mdz
-
H{z
Z ) d Z
)- C
U
k
c,)ujj{z)dz
+ {p-c )u-k,
(7.26)
0
by algebraic manipulations similar t o those that produced (7.8). Th e first and second derivatives of thi s expression wit h respect t o u are, on using Leibnitz’ s rul e fro m th e calculus,
rMdz
y ’ ( u ) = - ( p + c,) ["Az)dz-clu
Jo
and
Ju
+ p-c0
(7.27)
Ζ
J"(u) = -pJXu) - c, Γ Ju
(7.28)
^-dz, Ζ
which is negative. Thus (for k sufficiently small) th e optimal decision is t o order «*, where
Γ'
Λζ)άζ+
^ΓΜ
Jo
ά2
P+ c
t
= J . u
ζ
Ρζ^
(
7
.
2
9
)
p + c,
or, which i s exactly th e same thing,
P (\l _
Jw
(P+Ci)zj
jy
W
Z ! S
SLt* . p+ c
t
(7.30)
7.4
How Muc h Shoul d a Retaile r Spen d o n Advertising ?
247
On substituting (7.29) int o (7.26) we find the maximum reward t o be /(«·)=
{p ^)J " +
zAMz+jCiif*J~!Qdz-k.
0
(7.31)
For ζ > u', the (positive) integrand on the left-side of (7.30) is smaller than th e one on the left-hand side of (7.11), but the value of the integral must still be the same. We immediately conclude that the value of w* given by (7.30) is smaller than the value given by (7.11), regardless of the shape of th e distributio n of Z . Thus the optimal order is always smaller when sales are unifor m throughout the interval 0 < t < 1 than when sales take place soon after the stock arrive s at the store. For an illustratio n of thi s result, see Exercise 7.5. A s in Section 7.1, we should allow for the possibility that it might be better not to order at all. You can easily verif y that the buyer should then order an amount u*H(k - k), where, fro m (7.31), c
K =
( > 2) Jo^^r^Jl^ +
(7J2)
Thi s is the analogue of (7.18). At the end of the previous section, we spoke of circumstances in which k would denote the costs of advertising. There is a critica l value, k that these costs must not exceed if a positive profi t is t o be expected, but if k < k then, according t o both buying models, the reward is simply k - k. Thi s is a paradoxical result, because it suggests that zero is the optimal amount t o spend on advertising; whereas c o m m on sense suggests that a new item of merchandise might not sell at all. if nothing were spent on advertising it . How can thi s be so? You should attempt to resolve thi s paradox before proceeding. c
c
7.4
c
How Muc h Shoul d a Retaile r Spen d on Advertising ?
Th e answer t o the question posed at the end of the previous section is that , hitherto , we have tacitl y assumed that A?) is independent of k. I n reality , of course, if k denotes advertising costs, then E[Z] increases wit h k. A model wit h thi s propert y is now discussed. Consider a bookseller who is promotin g a new book by a famous ma› rin e biologist, wit h many colored photographs of deep-sea exploration. Let b(k) denote the number of potential buyers of th e book when k dollar s are spent on advertising it ; b(k) is the number of people w ho are genuinely interested and would lik e t o own a copy (but may not actually buy one because they need t o spend the money on something else). Then bik) is an increasing function of k, and because the book is new, we shall suppose that b(0) = 0. (I t is possible that a few well informed customers would
248
Chapte r 7
Optima l Decisio n an d Rewar d
order the book before the bookseller had spent even a dim e on public› ity ; then b(0) would be positive. But we ignore thi s possibility, because it complicates the algebra whil e adding littl e t o the model.) Th e bookseller intends to promote the book by invitin g the author t o sign copies one day i n the bookstore, and a brochur e describing the book’s virtue s and adver› tisin g the author’ s visit wil l be mailed t o prospective customers. I n such circumstances, copies of the book wil l mostly be sold soon after publica› tion ; hence the model of Fig. 7.1 is appropriate. Moreover, in the absence of fuller informatio n about actual buyers, it is not unreasonable t o as› sume that demand is equally likel y t o fall anywhere between b(0) and b(k). Hence ˘ has probabilit y density function (7.33)
Λζ)=·£βΗΜ)-ζ),
where Η is defined by (7.3). Thu s / d e p e n ds on k, but we wil l continue t o use th e notation J\z). For given k, the optimal order u*(k) is obtained by substitutin g (7.33) int o (7.10). We obtain Ρ+
C|
Fro m (7.12), the corresponding reward is /(«·(*))
= a b(k)-k, 0
(7.35)
where we define
°° - WTcTr
·
(7 36)
For any value of k, (7.35) is the maximum reward, and we can maximize thi s reward in tur n t o obtain the particula r value of k that is best overall. Before proceeding t o do this, however, we must make some assump› tion s about the for m of b\k). Th e number of potential buyers created by th e kth dollar spent on advertising is measured by b(k + 1/2) - b(k - 1/2). By a slight modification of the argument used to justif y (1.55), thi s is ap› proximatel y b"{k) if thir d derivatives are small (and assuming, of course, that b is differentiable). N o matter how much is spent on advertising, there exists a limi t that the number of potential buyers cannot exceed; call it B. Then t/{k) is decreasing for sufficiently large k and li m b(k) = B, k—>oo
li m bf(k) = 0.
(7.37)
k—oo
Suppose it costs $a t o prin t and mail a brochure, and the setup costs (for printin g the brochure) and author’ s expenses amount t o %kp. Then the first kp dollar s spent on advertising create no potential buyers: b(k) = 0 for 0
7.4
Ho w Muc h Shoul d a Retaile r Spen d o n Advertising ?
249
people is guaranteed t o create a potential buyer; whence each dollar wil l create 1/a potential buyers: b (k)=-,
k
J
0
< k < k
l
(7.38)
f
a
where k
{
(7.39)
= k + ab . 0
0
For k > k , we cannot be sure that a brochur e wil l create a potential buyer; hence t/(k) < 1/a. Al l that has been assumed so far about the for m of b{k) i s summarized by the solid curve in Fig. 7.5. Th e dashed curve is purely speculative. We have supposed that, for k > k , the person whose brochur e is paid for by the kth dollar is a littl e less likel y t o be a potential buyer than the person whose brochur e was paid for by the (k - l)t h ; i.e., we have supposed that the bookseller has sorted his mailin g list according to some criterio n of decreasing interest i n marin e biology. Hence fik) decreases continuously fro m 1/a t o 0 as k increases fro m fc, t o infinity , in such a way that b(k) tends t o B. Th e simplest functio n that behaves in thi s way for k > k is b\k) = B(k + k )l(k + fc ), where k and /c are constants chosen t o ensure the continuit y of b(k) and (/(k) at k . We now have an explicit expression for th e potential buyer function : {
x
{
2
3
3
2
{
0,
if 0 < k < ICQ;
if
Μ)={~^ ' Α
Bik-k^
+ bpajB-bo)
i
- b)
k - k + a(B
'
0
t
( 7 4 Q )
i
k
>
J
(
~
•
Β •--
-> 0
*
0
k,
Fig. 7.5 Possible form of potential buyer function.
k
250
Chapte r 7
Optima l Decisio n an d Rewar d
Hence, fro m (7.35), we have an explicit expression for the reward: i f 0 < k<
(-k, = < \ a
I
i f fc < fc< fc,; 0
a
r(Bjk-k^ i ( f c - f c , )+- rbpc V»(i-6 )j _ 0
ˆ
0
!
/eg; (7.41)
i f *: > it, .
K
k-kt+aiB-bo)
Th e maximization of (7.41) is a straightforwar d application of the calculus (Exercise 7.8). I f a > a then the maximum is at k = 0. Hence there is no reward unless Æ < Æ. We shall, in fact, make a stronger assumption, namely, that th e bookseller would not undertake the venture of promotin g thi s book unless he could expect a positive profi t solely fro m sales t o his prim e targets, the first b customers on his mailin g list. Hence 7(u*(/c,)) > 0; or Æ < Æ., where we define 0
0
0
a
c = "
(7.42)
- •
-
Then th e reward J(u*(k)) has the for m depicted in Fig. 7.6. Th e maximum occurs at k = k", where (7.43) and the optimal strategy is t o order
«'(fc*)//(a -a)
(7.44)
c
copies of the new book, where Η is defined by (7.3), a by (7.42), fc* by (7.43), and w*(fc* ) by setting k = k* in (7.34). N o t i ce fro m Fig. 7.6 that, as in Sections 7.1 and 7.3, there is a critica l value k which advertising c
c
Au*(k))
Fig. 7.6 Reward J(u*(k)) plotted against k for
< a. e
7.4
How Muc h Shoul d a Retaile r Spen d o n Advertising ?
251
expenditure must not exceed; but there is also a second critica l value, (7.45) below which there is no (positive) reward for advertising expenditure. For an application of the model, see Exercise 7.9. How good is thi s model woul d a bookseller use it ? By definition , f(z) = 0 unless b(0) < ζ < b(k), but the bookseller might argue that he has enough informatio n about actual buyers t o know that (7.33) is a poor assumption. H e might, for example, have learned fro m experience that th e fractio n of potential buyers who actually buy the book is ten times mor e likel y to fall between a sixth and a half than anywhere else. Then the distributio n can easily be altered; see Exercises 7.10 and 7.11. Ther e is no reason in principl e why all the informatio n that a bookseller could possibly have about actual buyers cannot be incorporated int o a probabilit y density functio n wit h parameter k. Hi s first objection is therefore overruled! Suppose that the bookseller now objects to the cavalier way in which we continued the potential buyer function past the value k = k . Then we wil l ask t o see his mailin g list of, say, Β - t members. We wil l use our ingenuity t o arrange it in order of decreasing propensity t o buy. We might, for example, divid e it int o Ν classes, such that the it h class has b members, a fractio n , of which are assumed to be potential buyers. Then x
t
l=fo>*i>fc>--->*tf-i>0 ;
( • ) 7
4 6
and, for i = 0, 1, . . ., Ν - 1,
where
6’(fc)=Æ
if* . < * < * , +
T
(7.47)
i- l
j=0
and, of course, Y^bj
= B-t.
(7.49)
7= 0
Thi s empiricall y derived potential buyer function has been sketched in Fig. 7.7. The straight lin e segments could be approximated by the dashed curv e (wit h continuous derivative). Doesn’t thi s remind you of the concep› tuall y derived potential buyer function in Fig. 7.5? We do not, of course, pretend to know precisely which ^b, members of class i are the potential buyers (if we did, we’d save postage on the others, who simply hurl their brochur e in the trash). We just have a hunch that they are there. We might, for example, believe that a tenth of all people who adore photography wil l
252
Chapte r 7
Optima l Decisio n and Rewar d
Fig. 7.7 An empirically derived potential buyer function.
buy th e book for it s lavish color photographs, even though they hate ma› rin e biology. Surely the bookseller cannot object t o the function in Fig. 7.7! (Even if some of hi s advertising is done by telephone, newspaper ads, or other means, thi s simply makes a a function of /’ and creates occasional horizontal segments in the graph of b{k), corresponding t o the additional setup costs.) I f the distributio n of ˘ is "piecewise uniform, " as in Exercise 7.10, then (7.35) is still valid for some constant a (not, however, defined by (7.36)); and you can easily show that J(u*(k)) has the piecewise linear for m 0
if0
-k,
0
**- < Jew+5»-**}-* .
""is*s*». .
<7
-
50)
U > 0 abj. For a numerical example, see Exer› cise 7.12. s 0
a
0
7.5
7.5
Ho w Muc h Shoul d a Buye r Buy ? A Thir d too k
253
How Muc h Shoul d a Buye r Buy ? A Thir d Loo k
We have assumed unti l now that our buyer places a single order at t — 0, for the period 0 < t < 1, and that items not sold by t = 1 remain unsold forever. I n practice, however, our buyer may order regularly , say at times = 0, 1 , 2, Items not sold by t = 1 may be sold durin g 1 < / < 2 or later. Our model must be extended to account for this. Let t = Ν be the buyer’s horizon, i.e., the tim e beyond which demand for the product is either nonexistent or so low as to be effectively zero. Item s not sold by t = Ν are assumed t o remain unsold forever. N o te that Ν may be as large as we please, sometimes even infinit e (recall the forester’s model fro m Sections 3.4 and 4.8). Th e buyer therefore places a total of /V order s at times ι = 0, 1 , . . ., Ν - 1. Let Uj denote the quantit y ordered at tim e t - j for the interval j < t < j + 1. Let demand durin g thi s period be denoted by the random variabl e Z , wit h probabilit y density function fj. For simplicity’ s sake, we shall assume that the random variables Z are all uniforml y distribute d between a and b, i.e., that 7
;
0,
if
fM)=\b~- '
[{a
a
. 0,
< a;
^> z
i(z>b,
(7-51) j = 0 ,1 , . , . , Ν - 1. ;
N o new concepts are needed in extending thi s section’s model t o cover circumstances where the probabilit y density functions differ fro m (7.51) or depend upon j (or both); but the mathematical details are so complicated as virtuall y t o obscure the model’s essential insights, and it is more in keeping wit h the spiri t of thi s book t o overlook them. What distinguishes thi s problem fro m that studied previously is that surplu s stock at t - j may be sold durin g j < t < j + 1 or later. Let Xj denote thi s surplus, i.e., the number of items ordered by t = j - 1 but not yet sold by t = j . Then the single most importan t point to observe about Xj is that, from the point of view of the buyer's decision at t = j - 1, Xjis a random variable; whereas, from the point of view of the buyers decision at t = j , Xj is full y determined (being the value the random variabl e actually took). Specifically, if we view the surplus wit h the benefit of hindsight fro m / = then Xj = , Xj
(7.52)
j=0,l,...,N-l,
where x is a number that is known for certain; whereas, if we view th e surplu s fro m t = j — 1, then Xj is the random variabl e }
Uj_, + _,
x-i * u
Xj
- Zj_,,
if Zj_, < Uj_, + xj_,; ifZ,_ ,
+ * , _ ,.
254
Chapte r 7
Optima l Decisio n and Rewar d
These equations are valid f o r ; = 1, . . ., N. Th e initia l surplus is Xo = 0,
(7.54)
because nothing was ordered at tim e / = - 1 . Now, Xj is a mixed random variabl e (see Appendix 1), because there is a finite probabilit y that it wil l take the value zero, whereas all other values are distribute d uniforml y between 0 and , + Xj_ - a. Specifically, on using (7.51) and (7.53), we have {
ProbOi , = 0) = Prob(Z,_, > u,_, +
,)
fj_ z)d J-\->- ^ X
- L uj. +xj.,
i{
Z
b-a
J
t
(7.55)
and, for χ lyin g between 0 and «,•_, + Xj_, - a, Prob (x-
~6x <Xj<x+
ifa)
+ o{6x).
= ^
(7.56)
For completeness , we append that Prob(Ar < 0) = 0 = Prob(* > M,_, + * , • _, - a). y
;
(7.57)
You can verif y that (7.55)-(7.57) define a probabilit y distributio n by ob› serving that P r o b i X = 0) + / ;o
ο—a
= 1.
(7.58)
We wil l assume throughout that costs for each period are assesse d ac› cordin g t o the formul a (7.4), suggested by Fig. 7.1. Because demand is recurrent , it is reasonable t o suppose that the product in question is not promoted by the retailer (except insofar as it advertises itself by being dis› played). Let shipping costs be absorbed int o c , as suggested at the end of Section 7.1. Then k = 0 in (7.4); i.e., costs fro m the interval ; < t < j+1 are 0
c uj + c, (uj + xj - Zj),
if Zj < Uj +
c Uj,
if Zj > Uj + Xj.
0
0
Xj
; '
Revenue fro m the same period is pZj,
if ˘ , < * , + *,•;
Piuj + xj),
i(Zj>Uj
+ Xj.
V'
W )
Thu s reward fro m the interval ;’ < t < j + 1 is the expected value of the difference between (7.60) and (7.59) or !
f Jo
\pz
- c Uj - c {Uj + Xj 0
z)jfj{z)dz
t
+
Γ
{p{Uj + Xj)-c Uj}fj(z)dz.
Juj+Xj *·
0
1
(7.61)
7.5
Ho w Muc h Shoul d a Buye r Buy ? A Thir d Loo k
255
Thi s quantit y depends upon u . I t also depends upon x but because Xj i s not a decision variable, we prefer t o denote (7.61) by Ij(Uj). Hence, on substitutin g (7.51) int o (7.61), we have }
//«,)
= piuj + )
Jf
- c
Xj
(7.62)
y fl)
oUj
You may be wondering why we have now used the symbol / for reward when previously we have always used J. The answer is that Ij is not in general the quantit y a rational buyer would wish to maximize, so it is perfectly logical to denote it by a different symbol. To understand this, we wil l confine our attention t o the short horizon Ν = 2 for the remainder of thi s section. We wil l extend our analysis t o longer horizons in Section 12.1. Consider, therefore, the buyer whose horizon is Ν = 2. H e makes tw o decisions, the first at t = 0, the second at t = 1. Hi s objective at t = 0 is t o maximize reward fro m th e interval 0 < t < 2. Thi s reward wil l depend upon the quantit y u he orders at t = 0; hence denote it by 7 ( o)> th e subscript on J indicatin g the number of decisions that remain to be made. At / = 1, however, the interval 0 < t < 1 is part of history. Th e buyer’ s objective changes fro m maximization of reward fro m 0 < t < 1 t o maximization of reward fro m the remaining period, 1 < t < 2. Thi s reward wil l depend upon the quantit y M, ordered at t = 1; hence denote it by / [ ( u , ) . Now, in thi s particula r case, the buyer’s objective function at t = 1 coincides wit h (7.62); i.e., / | ( « |) = / j ( « ) . But it would be incorrect t o say that / ( w ) = A)("o) > because then the buyer would be basing his decision at / = 0 solely on reward fro m 0 < t < 1 and ignorin g reward fro m 1 < t < 2. D o es thi s mean that J (u ) = / o ( o ) + ¸ ( Ø )? Unfortunately , the answer is still no, because / , ( « ,) depends upon x , which is an unknown quantit y at t = 0. To resolve thi s difficulty , we wil l begin by considering the second deci› sion. From (7.62) and the remark s in the previous paragraph, the buyer’s jo b at t = 1 is to maximize the function M
2
0
(
2
0
w
2
0
x
/,(«,) = /Ku, +x )-c u l
0
2(6-0)
l
*
(
over the interval 0 < w, < b - x, (why not 0 < M, < bl). Thi s is a simple calculus problem. You can easily show that the maximum occurs at u = u\, where {
f º . - χ,, "’
(
*
,
)
=
if χ, < º, ;
if x , > A,;
{ Ł
(
7
•
6
4 )
and º , is defined by X. º , == (( ? - ? ) ( * - « ) •
,P + Ci
(7-65)
256
Chapte r 7
Optima l Decisio n and Rewar d
Thu s º , is the quantit y that the buyer should order for a single interval if th e existing stock x, were zero. It is therefore the solution t o the problem considered in Section 7.1, as you can easily verif y by substituting (7.51) int o (7.10). N ow (7.64) yields a simple interpretation : if inventory at t = 1 already exceeds the quantit y predicted as optimal by the simple-period model of Section 7.1, then order nothing; otherwise, raise th e inventory t o that level. Provided that he follows thi s policy at t = I , the buyer should expect the maximum reward fro m the remaining interval . Denote thi s max› i m u m reward by «^( ,) . Then on substituting (7.64) int o (7.63), we obtain
4>i(X[) = J (u\(x )) x
l
c ^i + 2 ^ 0
=
_ c
o)(
ΡΧι - 2~ο~Ζ^( ι χ
a
+
A
i)’
~ '' a
if JCg < A,; l f
x
< >
λ
(7.66)
'·
Thi s (continuously differentiable) function is sketched in Fig. 7.8. N o te that the reward fro m 1 < / < 2 is at least as great as the value 0 , ( 0) predicted by Section 7.1, because any c costs associated wit h a surplus x, have already been paid at t = 0 (and hence, when , < º, , are simply added t o the expected profi t that the earlier analysis would predict for the second interval) . N o te also that Ø / , were at our disposal then we should certainly choose x, = a + ρφ - a)l[p + c,), t o maximize reward fro m 1 < t < 2; but x , is not at our disposal, having been determined beyond our control by demand durin g 0 < t < 1. Now, as far as the second decision is concerned, we are quit e correct t o say that •|( ,) is the optimal reward fro m 1 < t < 2, because the surplus at t - 1 is known to be , . A s we move backward in tim e across t = 1, however, that surplus becomes the random variabl e ¸", , causing optimal 0
i ( p - c ) ( a + X,) 0
0
a+
P(b-a) p + c.
Fig. 7.8 Maximum reward φ from the second interval, 1 < t < 2, as a function of the initia l surplus, x ,. The large dots denote the maximum of φ, and the point where the shape of the graph changes from linear to parabolic. χ
7.5
Ho w Muc h Shoul d a Buye r Buy ? A Thir d Loo k
257
rewar d fro m 1 < / < 2 to become the random variabl e ^”( ¸ˆ ,), a utility . Thi s cannot itself be maximized, but we can maximize it s expected value, Ε[Φι(Χ[)]. Thu s reward fro m the second decision, when viewed from the time of the first decision, is ΕΙΦ^Χ^]. We wil l call thi s perceived optimal reward. Thu s perceived optimal reward is the expected value of a random variable, the realized value of which is the optimal reward fro m a period that begins when the value is realized and ends at the horizon. On using (7.54)-(7.57) in (A.38), a straightforwar d calculation (Exercise 7.14) reveals that if u < a + A, then 0
+ -τ—
/
"
u / v
> a + A, then J(b-u )(a \
2{b
(7.67a)
ΦΜΚχ a
)
2
-a)
Ε[φ (Χ )] χ
+ Xi) + b^a
0
C o )
r"o-a
Co(" o -
x/
2^ 0
/
b - a Jo
b-a
1
b-a
Jo uo-a
1
h — ν
= ΦΜ-τ^ζ
whereas if u
dx
= *,((>) • Prob(Z, = 0) + /
ΕΙΦ^)]
{
aXi\
J
" 6 ^ ^ - 2 ^ - ( ¸ , - ^
+
.
(7.67b)
Th e quantit y Ε[φ (Χ )] is independent of M, because, when looking ahead fro m t — 0, the buyer assumes that whatever decision is subsequently made at t = 1 wil l be the one that is then optimal, namely, (7.64). But (7.67) depends upon u , because X depends upon w (set j = 1 in (7.53)). Th e total reward fro m 0 < / < 2, when viewed fro m t = 0, is reward fro m 0 < t < 1 plus perceived optimal reward fro m 1 < t < 2; that is, χ
{
0
0
{
J (u ) 1
0
= I {u ) 0
0
+
Ett (X )]. l
i
On using (7.54), (7.62) wit h j = 0 and (7.67), if u < a + A, then we obtain 0
J (u ) 2
0
c ){«
= ip-
whereas if u
0
0
+ \ifl + A , ) } -
P
" ^ _ 0
2
0
C | g )
( u - a) ;
(7.68a)
1
0
> a + A, then we obtain
/ ( u ) _ (p - c ) | «o + 2
+
(
f
0
^ L{(u 6(b - a)
2(b - a)
2
-2a) -(A 3
C
0
-a) } , 3
1
(7.68b)
258
Chapte r 7
Optima l Decisio n and Rewar d
M a x i m i z i n g / ( « o) ’ straightforwar d calculus problem (Exercise 7.14). I t i s convenient t o define th e auxiliar y parameters s a
2
A
_ {p-c )(p-c 0
+ 2ci) + c\ _ 2a(p-c
0
+ c)
0
(J7 + C , )
l
( 0 - f l ) ( P + C , )"
2
Then th e m a x i m um occurs at u = Uq, where 0
(p-c )(b-a)
a+
0
f
*o=<
C
.
>
+
C
’
,
2a+ { V Z - ] ( b - a ) ,
i
6
<
0
.
if 5 > 0.
(7-71)
You can easily check that Uq is greater than A,. What is th e significance of this? See Exercise 7.15. I n summary, combining (7.64) wit h (7.71), we find that th e optimal policy for horizon 2 is t - 0
First decision
Order « ,
=1
Second decision
Order w*(x,) .
(7.72)
Notice that the entir e policy is formulated at t = 0, even though part of it is not implemented unti l t = 1. Th e reason for this, of course, is uncertainly i n demand. A policy can be formulated as soon as th e distributio n of X , has been specified, but it cannot be full y implemented withou t certain knowledge of x ,. I n derivin g thi s two-period policy, we have tacitl y assumed that th e periods are rather short. W e have ignored th e fact that the tru e wort h of profit s fro m the second period is not as great as that of profit s fro m th e first period, for th e reasons described i n Section 3.4. H o w would th e effect of th e discount rat e be incorporated? See Exercise 7.16. For furthe r discussion of th e TV-period buyin g problem, see Chapter 12.
7.6 Wh y Don’ t Fast-foo d Restaurant s Guarante e Servic e Time s Anymore ? Fast-food restaurants compete for customers in a bewildering variety of ways, ranging fro m claims of tastiness or nutritiona l value t o gift s or sim› pl e pric e cutting. Many of those w ho eat in such places, however, particu › larl y durin g a lunch break, are probably less concerned about th e taste of their food than th e speed wit h which it arrives. I don’t mean by thi s that taste is unimportant . Rather, these people would argue that fast food tastes much th e same wherever you go, so that th e deciding factor i n choosing a restaurant should be th e speed of service. Wouldn’ t you think , therefore,
7.6
Why P o n t Fast-too d Restaurant s Guarante e Servic e Time * Anymore ?
259
that a fast-food restaurant could attract more customers by promising that food wil l be served withi n a given tim e limit , or else no charge wil l be made? Now, fro m tim e to time, various fast-food restaurants have trie d such a policy, but the speed wit h which they have given it up suggests that it’ s never successful. Why? Let’ s tr y t o answer thi s question by using a mathematical model. Fig. 7.9 represents a hypothetical fast-food restaurant, which guaran› tees t o serve your food withi n u minutes or else refund your money. We wil l refer to u as the guarantee. You enter thi s restaurant through the door on the left and approach the first available cashier. Thi s cashier receives your order, transmit s it to the kitchen, and takes your money. Th e tim e of day appears on your cash register receipt; thi s is the official beginning of your waitin g time. You now walk across to the cashier on the right , who eventually receives your food fro m the kitchen and presents it t o you. I f it took longer than u minutes t o arrive , then thi s cashier return s your money. W e can describe thi s restaurant by using the single-server queuing model developed in Sections 6.3 and 6.5. Th e single server wil l be the kitchen, where combined resources can be regarded as a kin d of black box, which receives orders and exchanges them for food. We wil l assume that thi s service tim e is exponentially distributed , wit h mean s. Th e queue the kitchen services consists of orders placed by the cashiers. We wil l assume that these arriv e according t o a Poisson process, wit h mean interarriva l tim e c. Then the mean number of orders per minut e is 1/c. To apply the model of Sections 6.3 and 6.5, we wil l also assume that meals leave the kitchen in the same sequence as that in which orders are placed by the cashiers. 1
Kitche n Food out here
Order s in here
e
e
*
Cashiers
’
C u s t o m e rs in
Fig. 7.9 A hypothetical fast food restaurant. See Supplementary Note 1.
e
C u s t o m e rs out
260
Chapte r 7
Optima l Decisio n and Rewar d
Let a customer’s waitin g tim e be denoted by the random variabl e Y. Then, fro m (6.49), Prob(K > t) = -
{ U s
e
- ' l
c ) t
(7.73)
.
Let the random variabl e P(Y) denote the restaurant’s profi t fro m the cus› tomer whose waitin g tim e is Y. Then, if r is the pric e of a meal and σ the cost of producing it , we have
(˚)={
ˆ
-’•
(7.74)
"II* if Y > u;
( -σ,
whence, on using (7.73), we have
E[P] = (r - )Prob (r < u) - σProb(7 = r-σ
-
r e
-
( U s
-
i l c ) u
> u)
(7.75)
.
Thu s the expected profi t per unit of tim e is J{u) = ^E[P]
= 1 (r - σ - rer "11
(7.76)
).
Uc)u
I f Y exceeds u, then the restaurant must refund the customer’s money. Th e sole reason for agreeing t o thi s is that it should increase demand for the restaurant’ s product. A n increase of demand wil l correspond to a decrease of interarriva l time. Hence the effect of the guarantee can be incorporated int o our model by allowing c t o depend on u, i.e., by writin g c = c(«). Decreasing u wil l increase demand, or at least not decrease it ; hence d{,u) > 0 (whenever c is differentiable). Let 7 be the existing mean interarriva l time, i.e., the one that would apply if the restaurant had offered no guarantee. Then c(oo) = 7. It is convenient, moreover, t o imagine that c(0) = 0, on th e grounds that if « = 0 then the restaurant would have t o give all it s food away; and thi s would presumably lead to such large demand as to be virtuall y infinite . Of course, u = 0 now violates condition (6.10) for stationarity , namely, (7.77)
s < du);
but thi s is withou t consequence , because the restaurant wil l choose the optimal u, i.e., the value u* which maximizes (7.76), and it is clear that J(u) cannot even be positive unless (7.77) is satisfied. I n practice, unless u is quit e small, no new customers wil l be attracted t o the restaurant, because the general publi c wil l respond t o the guarantee only if u is less than the values of Y they have typicall y experienced else› where. It is therefore reasonable t o assume the existence of a threshold, « , above which the guarantee has absolutely no effect: 0
c(«) = 7
i f « > « o-
(7-78)
Th e value of 7 wil l vary fro m restaurant t o restaurant, but u should be the same for all restaurants of a given type, say for all pizzerias or for all burger 0
7.6
Wh y Don’ t Fast-foo d Restaurant s Guarante e Servic e Time s Anymore ?
261
joints . Moreover, the speedier the service consumers expect in general, the lower in general the value of w . Th e simplest function satisfying (7.78) and the other conditions of the previous paragraph is the piecewise linear one sketched in Fig. 7.10. Givin g c(w) curvatur e for u < w would not significantly alter the conclusions of thi s section, but would significantly complicate the mathematics. Henceforward, therefore, we adopt the for m of Fig. 7.10. I n view of (7.77), we must seek the maximum of J(u) not on 0 < u < oo but on SUQ/J < u < oo, where J(u) is given by (7.76) and 0
0
( ju/un, < < « ) =
< U < U
Q)
if su h < u< u ; -p if w < Μ < oo.
(- >
{l-ag-" ’}
(7.80)
V
a
0
0
7 79
then
/( ) =
M o ( r
~
< r )
/
where a = ——e"^. r—σ N o t e that Æ > 1. Thu s (7.80) has a unique maximum on (juo/ª, u = £/*, where (Exercise 7.17) U* satisfies
w>s
e
=
Q
f Vpj l +
(7.81) ) at
(7.82)
and
0
su /y a
Fig. 7.10 Hypothesized response c = c(u) of customer demand to the stimulus of a service guarantee.
262
Chapte r 7
Optima l Decisio n and Rewar d
I t is also clear fro m (7.75) that J(u) increases on u < u < oo, wit h max› imu m 0
/(oo) = — . (7.84) 7 Combinin g these tw o results, we find that the maximum of / on surfy < u < oo occurs at u = u*, where
\
if « < U* + s.
0 0,
0
I t follows immediately that the guarantee should not be advertised unless + 1.
(7.86)
Unless (7.86) is satisfied, the best option is t o guarantee no more than that th e food wil l be brought before the end of time, i.e., t o offer no guarantee! We can obtain the value of U'/s, for given a, by solving (7.82) by the N e w t o n - R a p h s on method. Don’t forget that the equation has a negative root and that you want the positive one, so your initia l guess must not be too close t o zero. By obtaining U*/s for varyin g a, we implicitl y define a function. Let us denote it by / = J\a). Thu s U* is sj\a) mean kitchen service times. Part of the graph of f = fl,a) is sketched in Fig. 7.11. Now, (7.86) implie s that the guarantee should be advertised only if Because a depends on the three parameters rh, u , and « > s{l +J\a)}. 7, Uq/{1 + / ( a )} is also a function of rh, u and 7. Let us denote thi s functio n by s . Then the guarantee should be advertised only if 0
0
0
c
i < 5,.(ˆ / ,
0
(7.87)
,7).
For rh — 1.25 and for three values of 7, namely, 7 = 1, 7 = 2, and is sketched in Figur e 7.11(a) as a 7 = 5, the graph of s = s [rh,u ,t) solid curve. Thus, for example, if the kitchen already receives orders at th e rat e of one per minute, and if a guarantee in excess of three minutes would have no effect on customer demand, then th e kitchen’s mean service tim e would have t o be lower than 23.6 seconds for the guarantee t o be profitable ; in which case th e optimal guarantee would b e / ( a) = / ( 1 0 0 . 4) » 6.64 mean kitchen service times. We have placed Fig. 7.11(a) and (b) as shown t o emphasize that (7.86) should be checked before obtaining U*. Graph s corresponding t o rh = 1.25 but other values of 7 are readily added t o Fig. 7.11(a). Moreover, by varyin g the value of rh, it is possible t o obtain a whole series of similar diagrams, the graphs being higher or lower according t o whether rh is higher or lower. A s an indication of thi s process, Fig. 7.11(a) shows the (dashed) curve that corresponds t o rh = 2 and 7 = 5 . c
c
Q
Taken as a whole, these diagrams suggest that if rh and 7 are small, then th e critica l mean service tim e s , which the kitchen must better for a guarantee to be profitable , is unattainably low unless u is large. But the c
0
7.7
Whe n Shoul d On e Barbe r Emplo y Another ? Comparin g Alternative s
263
60.s,
A
60 •
Fig. 7.11 (a) Typical graphs of critical service tim e 60J seconds, which the kitchen mean service time must not exceed for a guarantee to be profitable, as a function of Uq. The solid curves are drawn for rla = 1.25 and for various values of 7 . The dashed curve is drawn for rla = 2 and 7 = 5. (b) Graph of the function / = A<*)If (7.87) is satisfied, then the optimal guarantee is / ( a) kitchen mean service times, where a is defined by (7.81). c
fast-food industr y is characterized by tight profi t margins, heavy through› put , and high expectations of speedy service by customers i n other words, by low values of all three parameters r/σ, 7, and « . Thu s our model predict s that the practice of guaranteeing service times is not, by itself, economically sound, and it is no surprise that it is soon discontinued by restaurants that adopt it in the first place. Th e function c = c(u) is an example of a behavioral response function, or simply response function. Thi s represents an attempt t o capture, in a single function, the characteristic response of people or other creatures t o a stimulus, u, here the service guarantee. Another example of a behavioral response function appears in the followin g section, and the idea wil l be mor e full y discussed in Section 8.3. Meanwhile, tr y Exercise 7.18. 0
7.7
When Shoul d On e Barbe r Emplo y Another ? Comparin g Alternative s
Optima l decisions have been reached hithert o wit h the help of the calculus. Thi s was appropriat e because the range of feasible values for the decision variabl e u has been a rather large one. We grant that decision variables are
264
Chapte r 7
Optima l Decisio n and Rewar d
usually restricted t o integer values in practice. But if the number of feasi› bl e values is sufficiently large sa y if an order quantit y can li e anywhere between 0 and 100 the n the calculus is still the most efficient mathemati› cal technique for optimization . I n other circumstances, however, when u is restricted t o be an integer, the number of feasible values is so few that the most efficient optimizatio n technique is t o evaluate J(u) for every feasible u and simply compare the alternatives. Strictly , th e problem of the previ› ous section probably belonged to thi s category, because the only guarantees a fast-food restaurant could realistically offer would for m a very restricted set sa y half a minute, one minute, 100 seconds, tw o minutes, and so on. But the simplicit y of the behavioral response function made the calculus as efficient as comparing the alternatives. W e wil l illustrat e the method of alternatives by takin g up the first of the tw o questions raised at th e end of Chapter 6. H ow would a store manager determine the optimal value for the length of a queue at the checkout? Remember that th e queue length itself is a random variable, outside the manager’s direct control. Th e only variabl e he can control directl y is the number of servers. Let’ s call thi s «(instead of k, as in Section 6.4). Now, the manager could control u so that the expected queue length would always be three, irrespective of the prevailin g value of the business intensity, S MEAN SERVICE TIME p = - = . C MEAN INTERARRIVAL TIME y
, „ (7.88) ' v
v
But three is a purely arbitrar y choice. A more rational approach would be t o select the value of u which minimizes the loss, L(u), associated wit h queuing, when the number of servers is u. A s observed in Chapter 3, thi s i s equivalent t o maximizin g J(u) = -L(u).
(7.89)
Now, the tru e loss fro m queuing is borne by society as a whole, in term s of increased irritabilit y and lost tim e for other activities, and is extremely difficul t t o quantify . We shall assume, however, that our businessman is concerned not so much about society’s loss as about the loss of revenue that queuing causes, because customers may be enticed away by stores that promise speedier service. Unfortunately , even thi s more personal loss i s difficul t t o quantif y in general, and we wil l therefore concentrate on a particula r example. Ther e are fewer "walk-in " barber shops in downtown areas than was once the case, but thi s particula r small business simply refuses t o die (Talla› hassee has at least four) . Let u be the number of barbers in such a business. I t is usually the case that one of them owns the business; anyway, let’s as› sume this. Let’ s also assume that the remaining u - 1 barbers are paid employees, earning w dollar s per hour. Then the owner’s loss per hour in
7.7
Whe n Shoul d On e Barbe r Emplo y Another ? Comparin g Alternative *
265
term s of wages is simply w(u - I) . I f thi s were the only loss incurred , then th e owner would minimiz e it by choosing u = 1, i.e., by employing no one. But lif e isn’t quit e as simple as all that. I f the owner is the only barber, then customers inside the shop wil l have longer to wait. Passers-by wil l look through the window and, noticing the length of the queue, perhaps decide that the queue is too long and continue t o the next nearest barber shop. Potential customers are therefore lost. Let’ s assume that, on average, a customer arrive s at the barber shop every 60c minutes. I n other words, the mean customer interarriva l tim e is c hours, and the mean number of customers arrivin g per hour is lie. I f all agreed t o enter, then the owner’s average revenue per hour would be pic dollars, where ρ is the pric e of a haircut . But all do not enter. A proportio n of potential customers, say r(u), decides that the queue in th e shop is too long. These customers walk on by t o do something else wit h their lunch break (perhaps buy a hamburger, see previous section). Note that r wil l be a decreasing function of u (why?). Th e corresponding loss of revenue per hour is pr(u)/c, provided that the u barbers can cut hair fast enough t o cope wit h an average demand of lie haircut s per hour (they cannot claim t o have lost revenue that they could not have earned in th e first place). Hence the owner’s total loss per hour, on average, wil l be (7.90) I f u is too small, then the owner wil l lose too much revenue fro m potential customers who tur n away. I f « is too large, then he wil l pay too much in wages. Somewhere in between lies the value, w\ that minimizes loss. W e must still determine the for m of r(u). We wil l do thi s by assum› in g that the stationary w-server queuing model of Section 6.4 provides an adequate description of arrival s and service in the barber’ s shop. Let the random variabl e X denote the number of heads in the queue at any time; u of these are receiving attention, whil e X - u are simply waiting. Let Ν denote the maximum number of heads there could ever be in the queue. I n other words, assume that, if a potential customer looks through the win › dow and sees Ν - u people waiting, then he is bound t o go away again. Then X has sample space { 0 , 1 , . . . ,N } ; and, on replacing k by u in (6.39) = ProbiAT = j) and using ( 6 . 2 5 H 6 . 2 6 ), we can evaluate the expression for any value of j . It seems reasonable t o suppose that the proportio n r(u) i s equal t o the proportio n of tim e for which there are Ν heads in the queue, or in the language of Section 6.4, that r(w) = π . Hence (Exer› cise 7.19): 7
Ν
(7.91)
266
Chapte r 7
Optima l Decisio n and Rewar d
Observing now that the value of Ν wil l depend upon « i.e. , Ν = and collecting together (7.90)-(7.92), we find that 7(w) = w(l - i / ) -
c
i
N(u)—
-t\u) u" (p\N(u)
\
™(l-u) 2~yy l (792) I t still remains t o specify the value of the integer N{u) for integer values of u. I n the terminology introduced at the end of the previous section, Ν is a behavioral response function and u is a stimulus. For now, let’s simply suppose that, after thinkin g about it for several days, a barber produced th e customer response function defined in Table 7.1. D o es thi s seem unsat› isfactory, lik e pullin g a response function out of a hat? Perhaps you would lik e t o ponder that question; we’ll retur n t o it in the followin g section. For given values of s, c, w, and p, the maximum of J{u) can now be determined by direct evaluation of 7(1), 7(2), 7(3), and 7(4). Suppose, for example, that the mean tim e for a haircut is 10 minutes and the mean tim e between potential customer arrival s is 12 minutes. Then s = 1/6, c = 1/5, and ρ = 5/6, fro m (7.88). Th e corresponding values of r{u) are easily calculated fro m (7.91) and are presented in Table 7.2; for example, til) - p / ( 16 + 16p + 8p + 4 p + 2 p + p ). We see immediately that 7(1) < 7(2) if ρ > 1.14w, and 7(2) < 7(3) only if ρ > 19.66w. I t seems to me that th e pric e of a haircut is quit e likel y to exceed an hour’ s wage by 14%, but could never exceed an hour’ s wage by 1866% unless employees were being severely exploited! What thi s means is that a lone barber observing a potential business intensity of 5/6 should employ a second barber, and a barber who already has a helper should not employ 2
5
2
3
4
s
Table 7.1 Behavioral response function for a four-server barber shop. It is assumed that the shop isn’t big enough to accommodate more than four barbers u
N(u)
1 2 3 4
3 5 7 8
Thu s æ< 1, implyin g in particular that æ< u. Because the queue is finite, however, condition (6.38) is no longer necessary. 2
7.8
On th e Sub)ectlvenes s of Decisio n Makin g
267
Table 7.2 Calculation of optimal number of barbers when c = 1/5, ρ = 5/6. The values for r are quoted to six decimal places so that you can check your own calculation. u
Ku)
1 2 3 4
ˇ . 186289 0.010419 0.000248 0.000016
/ ( « - J(u+ l)=w-Sp{r(u)-r(u+
1)}
w - 0.879/7 iv - 0.051/7 w- 0.001/7
another. Thi s result is strongly dependent, of course, on th e values chosen for s and c and the for m of the behavioral response function. But our model does at least indicate how such a decision can be made wit h the help of a mathematical model. You may wish t o experiment furthe r wit h choices of s, c and Ν that are more appropriat e t o a barber’ s shop y ou know.
7.8
On th e Subjectivenes s of Decisio n Makin g
We have now studied several decision models. I n every case a single deci› sion maker, whether a company or an individual , must 1. make assumptions about the futur e behavior of other people by sup› plyin g probabilit y distribution s or behavioral response functions, 2. assign utilit y to the possible consequence s of his decisions, and 3. maximize reward from all feasible options.
(7-93)
I n thi s chapter, utilit y has been either profi t or negative loss, and reward has been it s expected value. A s we remarked at the beginning of the chapter, however, the reward could be some other statistic of a random variabl e (as in Exercise 7.13). Moreover, models that cater for several decision makers can also be constructed, though they are not discussed in thi s text. Th e models introduced in Chapter 7 are all prescriptiv e and there› fore, as remarked in Section 4.15, essentially untestable. Thi s applies in particula r t o (1). To appreciate this, let’s suppose that each of t w o buy› ers would lik e to apply the model of Section 7.5. The first has been told by an economist that th e economy is "buoyant; " he believes that demand wil l be uniforml y distribute d between 100 and 200. Th e second has been tol d by a psychic that a "crash " may be imminent; he believes that de› mand wil l be uniforml y distribute d between 0 and 100. Now, you know that economists are sometimes wrong, and you’ve heard that psychics are 3
’Models allowing more than one decision maker are known as games. For an intro › duction to game theory, see Dresher (1981), Vincent and Grantham (1981), Shubik (1982, 1984), and Mesterton-Gibbons (1992).
268
Chapte r 7
Optima l Decisio n and Rewar d
sometimes right , but a decision must be made before the futur e has had tim e t o happen. Then which buyer has made the mor e realistic assumption about futur e behavior? I n the final analysis, it’ s just impossible t o be sure. We must simply accept that (1) involves a subjective assessmen t on th e part of decision makers, in thi s case the buyers. Naturally , th e more expe› rienced a buyer, the more apt he is t o guess correctly. But hi s assessmen t is nonetheless subjective, and other buyers may disagree. N o t e, moreover, th e importan t point that if we intervened between the tw o buyers and said that economists know better than psychics, then we would still not eliminate th e element of subjectiveness. We would simply transfer it t o ourselves! I n these circumstances, it would appear desirable t o design decision models wit h sufficient flexibilit y that tw o decision makers who agree on (2) but disagree on (1) can both use the same model t o derive an optimal policy for their particula r view. I n thi s light , let us reconsider the model of the previous section. I t is quit e possible that one barber would agree wit h the behavioral response function N(u) in Table 7.2, whil e another would hotly dispute it . D o es it matter? N ot at all. Th e prejudices of the second owner can easily be substituted for those of Table 7.2, because th e model is flexibl e enough t o allow an arbitrar y choice of behavioral response function . Again, suppose that one of our buyers believed demand t o have a distributio n other than the unifor m one. D o es it matter? N ot much. Th e model of Section 7.5 can easily be modified t o deal wit h other distributions , though the mathematics may be more difficult . To repeat what we said at the end of Chapter 4, whereas th e ultimat e test of a descriptive model’s wort h is it s abilit y t o predict observable data, th e ultimat e test of a prescriptiv e model’s wort h may well be it s abilit y t o accommodate alternativ e assumptions about futur e behavior. A s we saw in th e case of the barber shop, we obtain such flexibilit y by retainin g as many free parameters as possible, as late as possible in the analysis. Occasionally, it is even unnecessary t o estimate certain parameters, either because quan› titie s of interest are somewhat insensitive t o them or because they can be given their worst possible values (whatever that means in a particula r con› text). Examples of the former wil l appear in Sections 10.6 and 12.3, and an example of the latter wil l appear in Section 8.1; while, i n Sections 8.3 and 8.5-8.7, (1) and (2) of (7.93) wil l be discussed in greater depth.
Exercise s 7.1 Verif y (7.8). 7.2 (i) How can you be sure that a unique solution to (7.11) exists? Does your answer requir e any qualification if ˘ is normally distributed? (ii ) Verif y (7.15).
Exercise s
269
*7.3 The expression for expected profi t in (7.8) consists of three terms. The second two, namely (p - c )u - k, are the "sellout" profit , i.e., the retailer’ s profi t if all items ordered are sold. Can you interpret the first term? 0
7.4 A bookseller is deciding whether to promote a new book, which he can buy from the publisher for $10 per copy (including shipment); holding costs are $1 per book. The bookseller reckons that, if he sells the books for $15 apiece, then demand (after advertising) is equally likely to fall anywhere between zero and 480. According to the model of Section 7.1, how many copies should he order if the costs of advertising are (i) $200 (ii) $375; and what is the expected profit ? 7.5 How many copies should the bookseller in the previous exercise order ac› cording to the model of Section 7.3? What is the expected profit ? 7.6 When is Β sufficiently large for the normal approximation to the Poisson dis› tributio n to be incorporated into the model of Section 7.1? Compare (7.23) wit h (( & - Β)Ι^/Β) for relevant values of k and B. 7.7 By applying the shift technique of Chapter 2 to (7.10) or (7.11), show that u* in Section 7.1 is an increasing function of the selling price but a decreasing function of CQ and c . Interpre t your answer in terms of Fig. 7.3. Repeat for if in Section 7.3. t
7.8 Show that the maximum of the function defined by (7.41) is zero, at k = 0, whenever a > a . If a < a , show that the function has a local maximum at k*, where k* is denned by (7.43). Is this necessarily the global maximum of the function? 0
0
7.9 The book on marine biology in Section 7.4 costs the bookseller $11 per copy (includin g shipment), and holding costs are $1 per book. The bookseller, who will sell the book at the recommended price of $19, believes that there wil l never be more than 2500 potential buyers, no matter how much he publicizes it. The setup cost for the mailing and the author’s expenses for the autograph session amount to $750; each brochure costs 50? to prin t and mail; and the mailing list of the local Marin e Biology Society contains 1000 names and addresses . Show that the bookseller’s optimal strategy, according to the model of Section 7.4, is to spend $1842 on advertising and order 665 copies of the marine biologist’s book. Sketch the graph of J{u* {k}) and use it to estimate the retailer’ s reward. 7.10 Suppose that the bookseller in the previous exercise believes demand to be distribute d on (0,b(k)), not uniformly , but as shown in Fig. E7.1. Show that (7.34) is replaced by u'(k) = 0.3lb(k); but that (7.35) is still true, provided that (7.36) is replaced by a = 1.7775. Hence show that the bookseller’s 0
270
Chapte r 7
Optima l Decisio n an d Rewar d
_2_ Hk) 1 b(k) '
0
1
•
•
b{k)lb
h(k)/2
b(k)
Fig. E7.1 optimal strategy is to spend k* « $1914 on advertising and order 528 copies of the book. What is his expected profit ? 7.11 Why is the reward in Exercise 7.10 greater than in Exercise 7.9? 7.12 What is the optimal policy in Exercise 7.10 if the potential buyer function of Fig. 7.7 is used in place of the one in Fig. 7.5? Suppose that there are 2384 people on the mailing list, divided int o six classes with b = 1000, b, = 600, b = 360, Z> = 216, fc = 130, and b = 78 (so that each class is approximately 40% smaller than the previous one); and that , = 1 - 0.2/, 0 < < 5. 0
3
2
4
5
*7.13 Suppose that the rose vendor in Section 7.2 would go home happy as long as his profi t exceede d r. Would ordering the quantity that maximizes E[P ] still be his best strategy? If not, how many roses do you think he should order instead? U
7.14 (i) Verif y (7.67). Hint. Don’t forget that
[ U a
-
' Γ°~ a
Ja
I f
t
kt
/
(ii ) Verif y (7.71).
f 1 {CQX+-(p-CoXa
α
j
if « - Æ< º, ;
0
φ (χ)άχ+
Φ {χ)άχ,
{
> JO
1 + X^jdx,
χ
ifu -a>A . 0
(
Jx,
*7.15 (i) Why is uj in (7.71) always greater than the value A, predicted by the single period model? First answer the question on the assumption that c, is small, then observe that uj/ º decreases with c . (ii ) Interpre t the fact that «0 tends to Æas c, - oo. (Note that 6 < 0 for large c, unless a = 0.) (
{
Supplementar y Note s
271
*7.16 (i) Suppose that the unit of tim e in Section 7.5 is a year, so that the effect of the discount rate on futur e profit s must be taken int o account (see Sec› tion 3.4). Let the (real) annual interest rate be S, and suppose that prices and costs are fixed at the beginning of each period and are constant in real terms. How must the analysis of Section 7.5 be altered to allow for the effect of the discount rate? At this stage, answer the question conceptually; do not work through the details. (ii ) To simplify the mathematics, set a = 0, so that demand in each interval is distributed uniforml y between 0 and b. Hence determine the optimal w and ii] as a function of 6, b, p, c , and c . (iii ) Show that u is a decreasing function of the interest rate but is never less than º, . Interpret . 0
0
{
0
7.17 Show that (7.80) has a maximum on (51/0/7,oo) at U = I/* , where U* is the positive root of equation (7.82). *7.18 A major airpor t has a single runway for international flights. At certain times of day, incoming planes must circle the airpor t for minutes, or even hours, before obtaining permission to land. (i) Describe how you could model this circlin g as a stationary, single-server queue. State the assumptions involved. (ii ) An insurance company has observed that almost all the delay on incoming flight s is caused by this circlin g before landing. It is debating whether to offer passengers an insurance against excessive delays. Specifically, for a premium of u dollars, the company would pay the sum of 5 dollars to any passenge r whose plane arrived more than d hours after the appointed time. If the average cost of a transaction with customers is tS dollars, show that the insurance company can make money by adopting such a scheme only if d is sufficiently large. Try to obtain a critical value, d , as a function of e and any other parameters you introduce. Hint: You will need a behavioral response function to describe the proportio n of passengers who would pay for such insurance if the premium were u. You will also need to make an assumption about the time allowed in the flight schedule for circlin g and landing. (iii ) What is the optimal insurance premium? (iv) Pick appropriat e parameter values and decide whether the proposition is a viable one. c
7.19 Obtain (7.91).
Supplementar y Note s 7.1 This is not the same as the mean customer interarriva l time, though it can be argued that the two should be roughly the same. To see this, let c denote the actual mean interarriva l tim e for customers and let S be the mean service tim e for the cashiers (as opposed to the kitchen). Suppose that j(< k) are currentl y busy, and let T be the service tim e for attendant i (i < j). Let the random i
272
Chapte r 7
Optima l Decisio n and Rewar d
variabl e U denote the interarriva l tim e for placement of orders. Then U = m i n ( 7 . .. ,7}); and 1(
7} > Z)
Prob(l/ > 0 = ProbfT, > I, T > t,..., 2
= Prob(T| > 0 x Prob(T > /) 2
= (e-' y h
=
•• •
Prob(7} > 0
e- . j,/i
Hence c = s/j. In performin g this calculation, we have regarded j as a fixed parameter whose value is unknown. But, from Exercise 6.7 (ii) , the expected value of the number of busy servers is sli. To the extent that this can be regarded as an approximation f o r t h e n c can be regarded as an approximation for c.
THE ART OF APPLICATIO N
This page intentionally left blank
8
~~ USING A MODEL: CHOICE AND ESTIMATION
You have already developed a number of mathematical models in the exer› cises, but you have always known that the chapter in which an exercise was set would offer significant clues t o it s solution. Then what can you do if an exercise belongs t o no particula r chapter? You must either use a "known " model "known " meaning known t o you o r buil d your own model. For economy of effort , you always use a known model if you know one; only if you don’t do you buil d your own. Th e second of these t w o options is the subject of Chapter 9. I n thi s chapter, we’ll concentrate on the first. Imagine, for example, that a bottl e has floated t o you fro m some distant desert island. The bottl e contains a modelling exercise and a desperate message fro m a shipwrecked traveller , whose lif e wil l be spared by the natives only if she solves the problem contained in the bottle. Assuming that you would lik e t o help thi s poor soul, how do you go about it ? We’ll assume that the natives have been sufficiently friendl y as t o pose a problem that a known model wil l solve. Your first concern is then t o choose it . That choice may be tantamount t o the solution. On the other hand, the model may involv e one or more arbitrar y parameters, in which case, your second concern is t o estimate them. Suppose, for example, that the castaway had sent you the island’s cen› sus data for the last hundred years. You might stare at these data for several minutes and just get a feeling, deep down inside, that the natives obey a logistic growth law. So you choose model (1.62) fro m Section 1.9. It may be the wrong choice, but, at least for the moment, you’ve made it . The lo› gistic growth law contains tw o arbitrar y parameters R and K, so that your next concern is t o estimate them. Figur e 1.7 suggests how you might do this. Naturally , the goodness of fit of your lin e t o the data points would determine whether your choice was th e righ t one. Thu s choice and estima› tio n are really two sides of the same coin, though it’ s often helpful, whil e learning, to separate them. 275
276
Chapte r 8
Usin g a Model : Choic e and Estimatio n
But how do you actually choose? How do you produce that feeling inside, given only a verbal description of a problem? You can pare down your list of possible models by asking the followin g questions. I s the phe› nomenon you wish t o describe transient or permanent? Should the infor › mation you are given be regarded as certain or uncertain? Your answers wil l help you decide whether t o use a dynamic model or an equilibrium one, and whether the most appropriat e description is deterministic or probabilistic. You should also ask yourself whether or not a decision is required. I n the final analysis, however, there is no pat answer as to how a model is chosen it’ s simply a matter of experience. Thi s chapter should help you acquir e it fro m your ongoing study of mathematical models. Here, then, are some examples of choosing a model, interwoven wit h sections on estimating parameters.
8.1
Protectin g th e Carg o Boat . A Messag e in a Bottl e
Your castaway has been captured by the natives of Nands, a nation of tw o islands wit h a simple agricultura l lifestyle. Th e only crop that grows on Nor , the norther n island, is .Jf-grass. Th e only crop that grows on Sou, the southern island, is Z-fruit . Both foods are essential t o the natives’ simple diet. Consequently, the natives’ cargo boat is always sailing back and fort h between the islands, takin g A’-grass t o Sou and Z-frui t t o Nor . Unfortunately , the sea between the islands is not entirely tranquil . It’ s roamed by pirates. Th e natives have cannons t o defend their boat, and th e pirates are so cowardly that they wil l always withdra w if they see one on board. But a cannon takes up so much space on board that not enough `ˆ-gras s and Z-frui t would be shipped if a cannon went on every trip . Th e natives have solved thi s problem by takin g a cannon wit h them only if their witch-doctors report that there are pirates in the area. They always unload the cannon at the end of a tri p t o make room for more cargo on the return . Thi s tactic worked perfectly well for several months until , on the day that your castaway was captured, the witch-doctor on Sou reported pirates in the area, when all the cannons were lyin g on the beach on Nor. Th e natives, who had four cannons, already appreciate that they must acquir e some more. Th e question is, how many? Your castaway must help them decide; and we must choose a model t o help her. Th e boat sails back and fort h for ever; therefore we’re describing a permanent phenomenon. Because we don’t know when a witch-doctor wil l report that there are pirates in th e area, our informatio n is uncertain. I t therefor e seems appropriat e t o choose a probabilisti c model and seek it s stationary state. Because nothing changes durin g a boat trip , we may mea› sure tim e discretely, wit h each tri p markin g the passage of a unit of time.
8.1
Protectin g th e Carg o Boat . A Messag e In a Bottl e
277
Al l the above suggests that we use a Marko v chain, wit h tim e being mea› sured nonlinearly. Let the random variabl e X{ri) denote the number of cannons, at tim e n, on the island where the boat is docked. Let Ν be the total number of cannons. Then we can model the boat’s movements in relation to the cannons as a Marko v chain wit h Ν + 1 states, / = 0, 1 N. Suppose that X = i. I f / = 0, then the only allowable transitio n is (fro m 0) to N, because all the cannons are on the other island. I f 0 < i (Χ(η + 1) = j | X(n) = i) occupies row / and column j , is tj
0
ο
0 0 0
0 0 0
0 l-q Q
Q 0
. .. . ..
0 0
οί1 -q
q
1 -9
Q
0
0
0
0
0
0
0
0
0
0.
You should satisfy yourself that the entries in thi s matri x are correct. Note, in particular , that the number of nonzero entries on the leading diagonal i s precisely one, but still enough t o ensure the existence of a stationary distribution . You can verif y (Exercise 8.1) that it’ s given by Ν - q+ * ( 1 1- 0 . 1 . 1 , • • • . 1 , 1 ) . Ν ˆ
(8-2)
Let Vbe the event that all the cannons are on the other island, and assume that the witch-doctors never know where the cannons are. Then U and V are independent events. Th e probabilit y of being intimidate d by pirates when all the cannons are on the other island is therefore Prob(C/n V) = P r o b ( i / ) - P r o b ( ^ = <7
(8.3)
I n particular , the event that occurred on the day your castaway was cap› ture d had a probabilit y of q(l - q)/(5 - q). Clearly thi s was too high, and we must reduce (8.3) t o an acceptable value by increasing the value of
278
Chapte r 8
Usin g a Model : Choic e and Estimatio n
N. Unfortunately , we have no informatio n as to the value of q. We must therefor e give q it s worst possible value. It’ s a simple matter of the cal› culus (Exercise 8.2) to show that (8.3) has a maximum on 0 < q < 1 at q = Ν + I - ^/N(N + 1), the value of the maximum being m(N) = IN + 1 - 2 v W ( / V + l ) =
(8.4)
N o t e that m(0) = 1, m(oo) = 0. By choosing Ν such that m lies below some acceptable value, we guarantee that the probabilit y of the boat being unprotected is also less than thi s value. Perhaps it is considerably lower, because q may not take it s worst possible value. Th e first 20 relevant values of 100m(/Y), the percentage of journeys for which the boat would be unprotected, are given in Table 8.1 correct t o thre e significant figures. A Taylor expansion of (8.4) in terms of \IN shows that the percentage is approximately 100/(4/V + 1) for large values of N, and thi s wil l be correct t o at least tw o significant figures for all Ν > 24. Your castaway wil l be able t o use Table 8.1 to convince the natives that their boat could not endure more than about 11 unprotected jour › neys in every 200 even if they acquired no new cannons; whereas their present strategy could never guarantee it s safety on every journey, even i f they acquired a hundred cannons. She might even suggest a figure t o th e natives. For example, she might suggest they acquire eight new can› nons t o reduce the long ru n percentage of unprotected journey s t o 2%. But it would be up t o the natives t o balance the risk of a given num› ber of unprotected journeys (or the cost, in terms of hunger pangs, of a given number of delays unti l the witch-doctor gave the all clear) against th e cost of acquirin g the cannons. I f the natives had half a heart, then Ta› bl e 8.1 might even be enough to secure your castaway’s release. But if they di d not relent, then she would have t o send you a furthe r message , wit h enough informatio n to construct a reward function lik e those of the previ› ous chapter, and hence determine a unique value for the optimal number of cannons. Table 8.1 Worst possible percentage of journeys for which cargo boat would be unprotected, as a function of the number of cannons. Ν
100m(/V)
4 5 6 7 8
5.57 4.55 3.85 3.34 2.94
Ν
9 10 11 12 13
100m(/V)
Ν
100m(/V)
Ν
I00m(/V)
2.63 2.38 2.17 2.00 1.85
14 15 16 17 18
1.72 1.61 1.52 1.43 1.35
19 20 21 22 23
1.28 1.22 1.16 1.11 1.06
8.2
8.2
Oi l Extraction . Choosin g an Optima l Harvestin g Mode l
279
Oil Extraction . Choosin g an Optima l Harvestin g Mode l
A publi c outcry against nuclear power has led to the closure of several nuclear power stations and the suspension of plans to buil d several others. Oi l is now relatively scarcer, and it s (real) pric e is risin g at an annual rat e of 12%. A Texan farmer owns the land directl y above a proven oil deposit but, because the pric e is still risin g so rapidly , her oil is not for sale. Th e farmer believes that the (real) pric e of oil wil l ultimatel y level off at about three times the current price, as soon as alternativ e energy sources have been developed sufficiently t o compensate for the loss of nuclear power. Before that time, however, our Texan farmer wil l have sold her oil, whenever she considers the pric e t o be right . I f she believes the cost of extracting each barrel of oil t o be a fixed percentage of it s selling price, and the (real) rat e of interest that she can earn in a bank t o be 9%, when should she consider that the pric e is right ? Notice, first of all, that it is by no means certain that the pric e of oil wil l level off as she think s it will , or, for that matter, that the cost of extraction wil l be a fixed percentage of the amount extracted. Nevertheless, because our farmer believes that she is right , her informatio n should be regarded as certain when making the optimal decision. I n other words, a deterministic model is quit e appropriate; and our first concern must be t o choose between th e three (deterministic) optimal harvesting models already known t o us, namely, those encountered in Section 3.4, Section 3.7, and Section 4.8. N o ne of these models was designed specifically for harvesting oil, but that does not mean that we won’t be able t o use one of them. We arriv e at our choice by elimination. Th e optimal fleet size model was designed for the harvesting of a renewable resource, fro m now unti l eternity. Oil is not renewable, at least on any respectable tim e scale, so we cannot use the model of Section 3.7. For the same reason, there is no such thin g as an oil rotatio n time, so we cannot use the model of Sec› tio n 4.8. Th e remaining candidate is that of Section 3.4. Thi s would be an appropriat e model if the oil could be extracted very rapidly . Let’ s as› sume that it can be, on the grounds that impatient, oilthirst y tycoons have been hovering over our Texan farmer day and night for several years. It is importan t t o appreciate that the "improvement " on (3.40) obtained in Section 4.8 would not be an improvement here. I n other words, a model can never be rejected absolutely; it can be rejected only for a particular purpose. Never discard a known model outright , because you never know when it might come in handy. One problem’s reject may be another prob› lem’s solution. Let p(t) denote the (real) pric e at tim e t, Ν the number of barrel s beneath the ground, and b the fractio n of a barrel’ s pric e that it costs to
280
Chapte r 8
Usin g a Model : Choic e and Estimatio n
extract it . Then the value of the oil is \\t) = N(l - b)p(t). According t o (3.40), the farmer should have the oil extracted at tim e t - s, where °
0
9
-
6
-
s)
~ pis)'
n
( 8
·
i
R
5 )
provided V»(S)
,2_P"(i )
~ m ~
~P<S)-
, 2 ^ 6
<
0
0
-
( 8
·
« 6 )
Th e farmer’ s beliefs concerning the for m of p(t) can be summarized as PiP) < Pit) < 3/KO) and ^
Pi0)
= 0.12,
l i m ^ = 3. p(0)
l-oo
(8.7)
One way t o satisfy (8.7) is t o assume that pric e obeys the logistic growth law of Section 1.9, i.e., that
on setting Κ = 3p(0) and R = 0.18 in Exercise 1.10. I t is straightforwar d t o show that (8.5) and (8.8) yield (Exercise 8.3): i = ^
«
3.85 years,
(8.9)
wit h p(s)/p{0) = 1.5; (8.6) is satisfied because - 0 . 0 0 81 < 0. But the choice of (8.8) presupposes that the rat e of pric e increase is still increasing at the tim e that the farmer makes her decision. I f the rat e of pric e increase is already falling , however, then we need t o choose for p{t) a for m that is always curvin g downward. An appropriat e choice might be
$ r - o T c o’ 3
•»
(8 10
where C is a constant, th e first of (8.7) determinin g the constant to be 0.06. I t i s straightforwar d (Exercise 8.3) to show that (8.10) would yield th e earlier tim e 1-31 years,
(8.11)
wit h p(s)/p{0) = 3(v/5" - l)/(\/5" + 1), so that the pric e would have risen by less than 15%; (8.6) i s satisfied because - 0 . 0 1 81 < 0. Thus, even if th e farmer is absolutely righ t about the pric e of oil, the optimal extraction date could be as soon as just over a year away or as far int o the futur e as almost four years away. Clearly, many other form s of p{t) are consistent wit h (8.7). Therefore, before we could reach a firm conclusion, we would have to consult the farmer for furthe r details of how she believes that p{t)lp(Q) wil l approach 3 asymptotically.
8.3
8.3
Model s withi n Models . Choosin g a Behaviora l Respons e Functio n
281
Model s withi n Models . Choosin g a Behaviora l Respons e Functio n
A behavioral response function, which is used to embody everything as› sumed about the way some activit y responds to a stimulus, may properl y be regarded as a model in its own right a functional model, as it is some› times called. A functional model can be used as an input to a known model, such as those we met in Sections 7.6 and 7.7. It becomes, in the pro› cess, a model withi n a model. Functional models, lik e the ones in which they are embedded, may be constructed by either a conceptual approach or an empirical one. Th e latter is the subject of the followin g section. In thi s section, we concentrate on the former . Th e conceptual approach t o constructing a functional model is greatly aided by what we might call the method of extremes. Let χ be the stimulus and r(x) the response. Then we wish t o determine a curve r - r(x) in the x-r plane. By the method of extremes, we simply attempt t o enclose the feasible region in the x-r plane i.e. , the region in which r = r(x) might possibly lie b y a boundary consisting of straight lin e segments. A n acceptable for m for the behavioral response function would then be r = R(x, Θ), where θ is a parameter wit h the followin g property : by varyin g Θ, it is possible to cover the entir e feasible region. An appropriat e value for Θ, say θ = θ', yieldin g r(x) = R(x,6'), can then be estimated fro m data (either by eye or as described in the followin g section); or else θ can be retained as a parameter in the analysis. Two examples wil l suffice to indicate how the method is applied. Consider first the airlin e insurance company in Exercise 7.18. It wishes t o know what proportio n r of traveller s wil l pay χ dollar s for an insurance wort h S dollars. By definition , 0 < r < 1. I f χ = 0, then everyone wil l tak e out the insurance, implyin g r(0) = 1, but if χ > S, then nobody wil l buy the insurance, implyin g r = 0 if χ > S. Thu s the behavioral response functio n is confined t o the shaded region in Fig. 8.1(a), wit h the dots ac› tuall y lyin g on the curve. We know more than this, however. Th e higher th e value of the stimulus, x, the lower the proportio n of traveller s buy› in g the insurance; hence f(x) < 0. I f a stimulus of one dollar induces, say, only 99% of traveller s t o buy the insurance, then the percentage in› duced by a stimulus of tw o dollar s wil l surely not exceed 98%. By an extension of thi s argument, we have r"(x) < 0. It seems reasonable t o assume, moreover, that there is some critica l percentage of S, say 10…Æ% , above which the premiu m would be regarded as too high by everyone; r(x) = 0 if χ > aS. Thus, by a more refined application of the method of extremes, the feasible region is reduced fro m the shaded rectangle of 1
You may wish to review your solutions to Exercise 4.12 and Exercise 7.18 before proceeding.
282
Chapte r 8
Usin g a Model : Choic e and Estimatio n
r
S
0
(a)
r
0
S
aS (b)
Fig. 8.1 Refining the limit s of the feasible region.
Fig. 8.1(a) t o the shaded triangl e of Fig. 8.1(b), wit h the dots actually lyin g on the curve. Th e region shaded in Fig. 8.1(b) is covered by the one-parameter famil y of curves 0 < χ < aS; = 0,
(8.12)
aS < X < oo.
Th e value θ -> oo corresponds to the horizontal and vertical boundary of th e triangula r region, the remaining boundary of the triangl e corresponding t o θ = 1. N o te that (8.12) satisfies ¸ ) < 0, r"(x ) < 0. M y guess is that the best value of θ almost certainly lies between 1 and 2 and is probably rather close t o 1, but the value appropriat e t o any particula r circumstance would have t o be determined empiricall y (see Section 8.4). Naturally , (8.12) is rather crude, but a more complicated functional for m would not retain th e correct balance between the complexity of the mathematical model and our understanding of th e intricat e psychological processes that actually determine the public’ s response t o a stimulus. A s a second example, we’ll continue our study of island biogeography begun in Exercise 4.12. Both that exercise and th e remainder of thi s section are very simplified treatments of the work of Gilpi n and Diamond (1976) and Diamond and Ma y (1976). I n particular , I have simplified their results by all but ignorin g the way in which extinction rates depend upon
8.3
Model s withi n Models . Choosin g a Behaviora l Respons e Functio n
283
an island’s area, and immigratio n rates upon distance fro m the colonizing source (the mainland territor y or other islands). I f interested, you should consult these authors for furthe r details. Let χ denote the number of species of bir d on an island and E(x) the number of species that become extinct per unit of time; then £ is a be› havioral response function, wit h χ as the stimulus. Because extinctions are impossible in the absence of species, E(0) = 0. Because an abundance of species wil l increase competition for available resources and hence encour› age extinctions, E'(x) > 0. I f extinctions occur at the rate of one per year when there are χ species, then we would expect at least two per year when there are 2x species confined to the same finite area. By an extension of thi s argument, E"{x) > 0. When we combine these assumptions, one ex› treme of the feasible region wil l be the most downward sloping curve that satisfies E"{x) > 0, £ ( 0) = 0, namely, a straight lin e through the origin , as shown in Fig. 8.2. Now, the main reason we expect E\x) > 0, E"(x) > 0 is that the island has a finite amount of resources for the birds, enough, let’s imagine, to support at most Xo species. We might call x the species capacity of the island. Although it’ s possible that there might be no extinctions if the number of species is less than or equal to x , if χ > xo then extinc› tions are inevitable; the worst case occurs when the extinction rate suddenly becomes infinit e at χ = x . Thus the other extreme of the feasible region in Fig. 8.2 is given by an L-shaped curve. The curve Ε = E{x) must pass through the dot and li e in the shaded region. One set of curves that covers thi s region and satisfies E(0) = 0, E'(x) > 0, E"[x) > 0 is given by 0
0
0
(8.13) where θ varies between 1 and oo and E is the extinction rat e at species capacity. You should check that θ = 1 corresponds t o th e lin e through the origi n in Fig. 8.2 and that θ -»· oo corresponds t o the L-shaped curve. 0
Ε
0
Fig. 8.2 Feasible region for E{x).
.v
o
284
Chapte r 8
Usin g a Model : Choic e and Estimatio n
Similarly , if I(x) is the number of species immigratin g per unit of time, then 1(0) = ν and I(x ) = 0, where ν is the maximum immigratio n rat e and x is the maximum number of colonizing species available for immigratio n t o the island. Because of competition for available resources, I'(x) < 0, and th e fact that the best colonists wil l tend t o arriv e first suggests that I"(x) > 0. Hence the feasible region for I(x) is the shaded one in Fig. 8.3, wit h dots denoting points through which the curve must pass. One set of curves that covers thi s region is m
m
i -£>
’
IM=U l
= 0,
x
m
°- - ' X
Xm
(8.14)
< χ < oo,
for σ lyin g between 1 and oo. You should check that σ — 1 corresponds t o the lin e between (Q,v) and ( x , 0) and that σ —• oo corresponds t o the remainin g 1-shaped boundary of the triangle. Gilpi n and Diamond (1976) applied the response functions (8.13) and (8.14) t o several islands, including, in particular , th e Solomon island of Vatilau , for which the maximum number of (lowland) bir d species available for immigratio n fro m the mainland is x = 106 (see p. 4132 of their paper). Using techniques similar t o those we shall describe in th e followin g section, Gilpi n and Diamond determined best values of θ and σ to be θ = 2.37 and σ = 7.23 (for details, see their paper). We wil l adopt these values here, denoting the corresponding response functions by I(x) and E(x). We wil l also adopt Gilpi n and Diamond’s estimate that E l(vx* ) = 0.276 10~ . Wit h these parameter values, Elu and llv are plotted against χ in Fig. 8.4. A s discovered in Exercise 4.12, the dynamics of immigratio n and ex› tinctio n are governed by the differentia l equation m
m
0
^
= / - £.
Q
5
(8.15)
Because E(x) increases wit h χ and I(x) decreases , there is a unique equilib› riu m at χ = x', defined implicitl y by the equation I(x*) = E(x*). Moreover, because the right-han d side of (8.15) is positive if χ < χ* and negative if
Fig. 8.3 Feasible region for I(x).
8.4
Estimatin g Parameter s fo r Fitte d Curves : A n Erro r Contro l Proble m
285
Elv. l/v
Fig. 8.4 Behavioral response functions for immigration , I(x), extinction, E(x), and graphical determination of equilibriu m number of bir d species for Solomon island of Vatilau. Based on the work of Gilpi n and Diamond (1976). x > x", our model implies that χ —• x* as / —• oo. It appears fro m the graphs in Fig. 8.4 that x* = 44. According t o Gilpi n and Diamond (1976, p. 4133), th e actual number of bir d species on Vatila u is 41, suggesting that th e island is close t o it s predicted equilibrium . N ow it’ s your tur n t o specify the for m of a behavioral response func› tion ; see Exercise 8.4.
8.4
Estimatin g Parameter s fo r Fitte d Curves : A n Erro r Contro l Proble m
A n error control problem arises whenever we attempt t o compress the essential features of a set of data int o a single functional relationship. I n Fig. 1.5, for example, we approximated a set of 37 economic data points 2
{K (f),lK0 );i=-9,...,27} by a linear relation of the for m φ = ιιξ. Fittin g th e lin e by eye, we guessed that u ss 0.75. But was thi s really the best value? I n the present section, we wil l begin by considering the problem of fitting a straight lin e t o data. We wil l then proceed t o address nonlinear curve-fittin g problems. Our treat› ment, however, is a simplified one. I n particular , we shall ignore possible error s in the data itself, restrictin g our attention t o error s that arise fro m th e curve-fitting . We would lik e the straight lin e in Fig. 1.5 t o li e as close as possible to th e data points. We must therefore construct a suitable measure of closeness You may wish to review Sections 1.6, 1.9, and your solution to Exercise 4.15 before proceeding. 2
286
Chapte r 8
Usin g a Model : Choic e and Estimatio n
and minimiz e it . Thi s measure of closeness wil l depend upon u, th e slope of the line, which is the only parameter we can control (because definition s (1.26M1.28) constrain th e lin e t o pass through the origin) . Therefore, de› note th e measure by L(u) . H ow shall we define L ? One possibility is as th e sum of th e perpendicular distances fro m the lin e to the data points; a second i s as th e sum of the vertical distances fro m the lin e t o th e data points. But each of these choices has th e disadvantage that th e resulting mathematical expression is difficul t to minimize. I t i s therefore conven› tional to opt for a thir d measure of closeness , defining L to be the sum of th e squares of th e vertical distances fro m the lin e t o the data point s (thi s i s a simpler expression than th e sum of the squares of th e perpendicular distances). Hence we have 27
Σ
L(u)=
M0-«eW} .
(8-16)
2
i=-9
Thi s i s an infinitel y differentiabl e function of u, wit h first derivativ e 27
L'(u) = -2
Σ
ίW M O " «e(')}
(8.17)
t=-9
and second derivativ e
27
L"(u) = 2 Σ
r=- 9
( ’ ) > 0.
(8.18)
2
I t follows readily fro m the calculus that L has an absolute m i n i m u m at u = u*, where L'{u*) = 0. Fro m (8.17) we readily obtain
Hence, fro m Table 1.1 and (1.28), we obtain *
« y y ^ f « 0.734.
(8.20)
I n fitting a straight lin e to th e data in Fig. 1.5, only a single parameter had t o be estimated. I n fitting a straight line, say y = u, - u x, to the U.S. population data in Fig. 1.7, however, tw o parameters must be estimated. Recall that th e lin e in Fig. 1.7 was fitted (by eye) to the first 15 data points. We shall label these as {(x(t), y(t)Y- f = 1 . . . .. 15} by defining y(t) = D(t)/x(t), where D is defined by (1.55). Then the s um of squares of vertical distances between data point s and the lin e y = w - u x is 2
(
2
is i(«i,«2)=EW’)-«i+M’)} . 2
(8.21)
8.4
Estimatin g Parameter * fo r Fitte d Curves : A n Erro r Contro l Proble m
Let us define
Ø41 2
Ø 15
.
IS
=
S
„
IS
>(0-*)
= >(’) 2
2
7s
’ ’
15x , 2
,s
=
5,2 =
287
(8-22)
w o - *w o- Λ = >αΜ0 - ^ > 1 5
1=
I
f=
5 =i:(y(i)-y) 2
2
i:>
=
2
1
(=1
2
(=1
Then a straightforwar d calculation shows that L{u ,u )= lS(u -xu )(u -xu -2y) + S ul + 2S u + SJ- lSy . (8.23) (Mor e general expressions for a straight lin e fitted t o k data points are obtained fro m (8.21)-(8.23) by replacing 15, wherever it appears, by k.) Now, let’s imagine that the value of u is fixed and regard (8.23) as a functio n of u alone. Then it is easily shown that an absolute minimu m occurs where (8.24) u = u' (u ) = xu + y. Th e corresponding value of the loss function is L{u\{u ), u ) = S}u\ + 2S u + S . (8.25) Because the cluster of points in Fig. 1.7 stretches down and toward the right , it is clear that an χ value in excess of the average wil l be associated wit h a y value that is below the average; thus S is negative. Hence (8.25) has an absolute minimu m where 2
l
2
l
2
l
1
2
n
2
r
2
{
l
l
2
2
2
2
2
l2
2
2
[2
(8.26)
u = u* = 2
2
Th e corresponding value of u, is u\(u ) = y 2
-
^
(8.27)
.
Hence the optimal values of the parameters «, and u are given by (8.27) and (8.26). From the data in Tables 1.3 and 1.4, it is straightforwar d t o calculate that 2
χ = 52.4,
y = 0.23,
5, = 163.4,
S
l2
= - 4 4 . 3.
(8.28)
Fro m ( 8 . 2 6 M 8 . 2 8 ), the optimal values of u, and u are 0.317 and 0.00166, respectively, whence the capacity of the logistically growing population is u , / u « 191. N o te that the parameter estimates 0.317 and 191 differ fro m 2
2
288
Chapte r 8
Usin g a Model : Choic e an d Estimatio n
th e estimates 0.31 and 198 obtained by eye in Section 1.9. I n fitting by eye, one is more likel y t o succeed in minimizin g th e sum of perpendicular distances, and one tends t o overlook points that seem to li e outside the overall pattern (whereas minimizin g L gives equal weight t o all points); see Exercise 8.5. But because either of these visual "corrections " may actually be desirable, you should beware of concluding too readily that the estimates obtained in the present section are improvements upon th e ones obtained i n Chapter 1. Th e fitted curve need not be a straight line. I n the previous section, we discussed a method for suggesting a nonlinear curve that might reasonably be fitted t o data, just as Fig. 1.5 and Fig. 1.7 suggested a straight line. Suppose that the response t o a stimulus x has been measured as r for i = 1 k. Suppose, moreover, we have reason to believe that the essential features of the response’s relationship to the stimulus can be captured by th e (nonlinear) functional model t
h
(8.29)
r(x) = R(x,u),
where Μ is a suitable parameter. Then a best value for u can be determined by minimizin g the sum of squares of vertical differences
£(") = E{ <-*(*" » k
r
(• >
M 2
8 30
1=1
Because L’(« ) is a nonlinear function of u, however, it is no longer possible t o determine a general expression for W, as in (8.19). Mor e generally, we might believe that the essential features of a rela› tionship can be captured by a functional relationship of th e for m y{x) = G{x, u), where u = ( u , u , u ,..., u ) is a vector of m control parameters. Suppose that we have k data points {(x >>,): i = 1 , 2 , . . ., k). Then th e sum of squares of vertical differences is T
(
2
L(u ) = L ( u
3
m
u ,..., 2
u) = £ m
{y, - C7(x,,u)} . 2
(8.31)
i'=i
Because L(u ) is now a nonquadratic function of several variables, it cannot be minimized by analytical methods; and we are obliged t o tur n t o numerical ones. These numerical methods belong to a field that has come t o be known as nonlinear programming. For the most part , nonlinear programmin g is beyond the scope of thi s text, but there do exist computer packages for computing the vector u* that minimizes L(u) . Although they are not 100% reliable, you wil l find such routines adequate for the problems discussed here, for which I used th e IMS L routin e Z X S S Q. Your computing center wil l have a copy of thi s routine, or a similar one, and be able t o show you how t o use it (if necessary th e documentation that accompanies the
8.4
Estimatin g Parameter s fo r Fitte d Curves : A n Erro r Contro l Proble m
289
routin e makes it very simple t o use). Th e routin e wil l always requir e you t o guess a value u , near which you believe the minimu m of L t o lie. Thi s is the point in «i-dimensional space where the routin e wil l start searching for the minimum . Th e better thi s guess, the sooner the minimu m wil l be located. A s our first example of minimizin g (8.31), let’s take m = 2 and retur n t o th e problem of fitting the logistic growth model t o th e U.S. population data for the years 1 7 9 0 - 1 9 4 5. We have just attacked thi s problem by fitting a straight lin e t o the data point s in Fig. 1.7. But we could also have fitted th e nonlinear logistic growth function c
Μ
. g«..,) = O
f
3 929u
t
3
; 2 9 | | ;
+
( U |
_ ’ }
n 9 K 2 ) e
.
,
(8.32)
directl y t o the data given in Tables 1.3 and 1.4. Here th e control parameter u, corresponds t o r in Section 1.9, and u corresponds t o rIK. I f you supply th e observed data and the function (8.32) to a routin e such as ZXSSQ, then it wil l quickl y infor m you that L{u u ) takes it s minimu m value where M, = 0 . 3 16 and u = 0.00168, so that the optimal value of Κ is w,/w = 188. Again, these values differ fro m previous estimates (which provid e a suitable u ). Thi s time, however, the main reason for the discrepancy is that we are estimating the parameters by solving a different control problem! For our second example, let’s take m = 3 and retur n t o Exer› cise 4.15(vii). There we conjectured that the mortalit y law 2
lt
2
2
2
G
(ζ)=αβ
(8.33)
+ δ
€ζ
μ
might yield a better fit to the lif e table data for U.S. females in 1966, for ages ζ > 20, than the Gompertz mortalit y law μ(ζ) = αέ . Th e law defined by (8.33) is known by demographers as Makeham’s law. Recall that the probabilit y /(z) of survivin g t o age is related t o the mortalit y μ by ζ
/(z) =
e x p| - y % ( 0 ^ } .
(8.34)
o
Let us define control parameters u by u = b, t
« 2 = ~>
w = c.
(8.35)
3
Then the nonlinear curve we shall fit t o the lif e table data is given by l(z) = G(z, u) = G(z, m, u , II ) = -"< V - < " 2(|
2
3
5t)
.
(8.36)
Th e observed pair s of values {(z /,•): / = 1 , 2 , . . ., 14} for age and survival probabilit y are reproduced, correct t o 3 significant figures, as the second and thir d columns of Table 8.2. I f you supply these values and the function (8.36) to a computer routin e such as ZXSSQ, then it wil l quickl y infor m
290
Chapte r a
Usin g a Model : Choic e and Estimatio n
Table 8.2 Fittin g the mortalit y laws of Makeham and Gompertz to the lif e table data for U.S. females in 1966. Index i
Age
1 2 3 4 5 6 7 8 9 10 11 12 13 14
20 25 30 35 40 45 50 55 60 65 70 75 80 85
//
Survival probabilitie s Gompertz Makeham 0.977 0.970 0.963 0.955 0.945 0.932 0.913 0.887 0.849 0.792 0.709 0.593 0.444 0.277
0.971 0.967 0.963 0.957 0.948 0.935 0.915 0.887 0.847 0.791 0.707 0.593 0.447 0.276
0.996 0.993 0.989 0.982 0.972 0.958 0.936 0.904 0.857 0.791 0.699 0.580 0.436 0.283
The observed values of / appear in column 3, those predicted by the best fitted Makeham law in column 4, and those predicted by the best fitted Gompertz law in column 5.
you that L(w, , u , u ) takes it s minimu m at u = u*, where 2
3
u* = 10"
3
( 1 . 0 8 7 , 0 . 2 5 3 4 , 9 9 . 4 8.)
(8.37)
r
I actually took logarithm s of (8.36) and fitted ln(/) t o u {l - e x p( M j z ) } " . Thi s was suggested by the attempt u z. M y guess was u = (ˇ,ˇ,ˇ. ) i n Chapter 4 t o fit Gompertz’s law (u, = b = 0) t o the same data. Th e corresponding minimu m value of L is 2
7
c
x
L(u* ) = 0.954
ˇ"
4
.
(8.38)
Th e corresponding optimal values of the parameters a, b, and c are a' = u* u\ = 0.252 1 0 " , b* = u\ = 0.1087 1 0 " , and c* = u* = 0.9948 1 0 . Using the same computer routin e but fixing b to be zero, we easily obtain the optimal values for fitting Gompertz’s law; they are 1 0 " ’ . Th e corresponding minimu m a = 0.846 1 0 " and c = 0.839 value of L is 0.492 1 0 ~ . Because thi s exceeds (8.38), we have estab› lished that Makeham’s law gives a better fit to the data than Gompertz’s law for ages ζ > 20. Th e predictions of Makeham’s and Gompertz’s laws are compared t o the observations in the final columns of Table 8.2. I t is clear fro m thi s comparison that Makeham’s law gives an excellent fit to th e data and represents a considerable improvement over the law of G o m› pertz. 4
2
2
3
- 1
4
2
8.5
8.5
Assignin g Probabilities : A Brie f Overvie w
291
Assignin g Probabilities : A Brie f Overvie w
Ther e is broad agreement among mathematicians that probabilitie s can be assigned in at most three ways: i. conceptually, by theoretical arguments rooted in symmetry; ii . empirically , by relativ e frequencies of independent outcomes; (8.39) iii . intuitively , by inspired guesswork. A n example of (i) would be t o say that th e probabilit y of obtaining a head when tossing a coin is 1/2, on the grounds that heads and tail s are equally likely . An example of (ii ) would be t o say that the probabilit y of a spruce budwor m egg turnin g int o a larv a is 0.81, on the grounds that, on aver› age, 38 of the 200 eggs an average female has been observed t o lay have failed to hatch (because of predation, parasitism, and other phenomena); successive generations of spruce budwor m can be assumed independent because adults do not survive fro m one breeding cycle t o the next (Lack, 1980, p. 831). And an example of (iii ) would be for a candidate t o say, " I know in my bones I have a 60% chance of success, " and then assign prob› abilit y 0.6 t o being successful. Wh o could argue? The first tw o ways can be described as objective: tw o rational people would be expected t o agree on the values assigned. The thir d way can only be described as subjective: tw o rational people would be expected t o disagree, however slightly. What mathematicians and philosophers hotly dispute, however, is whether probabilit y can be assigned in as many as three ways. When you toss a coin, for example, wouldn’t theory suggest there is a very small prob› ability , e say, that the coin wil l land on it s edge? (Have you seen the movie Mr. Smith Goes to Washington?) Then, by symmetry, the probabilit y of obtaining a head should be (1 - e)/2, not 1/2. Therefore, when you say that Prob(Heads) = 1/2, mustn’t the basis for your judgment be empirical rather than conceptual aren’ t you saying that Prob(Edge) = 0 because you’ve never seen a coin land on it s edge? Thi s suggests that apparently conceptual assignments of probabilit y are really empirical, after all. But are they even empirical? For example, 8 1% of spruce budworm eggs have been known to survive until hatching in the past. But probabilitie s are statements about the future . I f a prophet told you that there was going to be a sudden surge in parasitism, predation, disease, or conflagration, would you still say that Prob(Egg becomes larva) = 0.81? I f so, then your intuitio n is tellin g you that the prophet is wrong; and isn’t the basis for your apparently empirical assignment of probabilit y really intuitiv e after all? Similarly , you could argue that Prob(Heads) = 1/2 has an intuitiv e ba› sis because you assume that the coin-tosser wil l not acquire sufficient skill as to influence the outcome of the toss, one way or the other. Argument s such as these have led some mathematical philosophers t o th e view that the basis for assigning probabilitie s is always (iii) , not (i) or
292
Chapte r 8
Ualn g a Model : Choic e and Estimatio n
(ii) . Let’ s call these people th e subjectivists. They would see nothing wrong i f each of tw o candidates for the same position declared a 60% chance of success for herself and a 40% chance for her competitor. To subjectivists, it would be natural for tw o different observers t o have tw o different sets of probabilities . Others, however let’ s call them objectivists woul d argue that at least one candidate would have t o be wrong because 0.6 + 0.6 φ 1. I n their view, one candidate’s probabilit y of success would have t o be the other’ s probabilit y of failur e because there is a single "objective " probabil › it y for each event (which a supreme genius might be able t o assign). By good fortune, however, we need never decide whether subjectivists or objectivists have righ t on their side. Even if there di d exist objec› tiv e probabilitie s that a supreme genius would invariabl y assign to futur e events, no mortal decision maker would ever have either th e theoretical insight or empirical evidence t o know what they were. We wil l therefore adopt th e view that, although (i) and (ii ) may guide our thinking , the ul› timat e basis for assigning probabilitie s is (iii) , simply by virtu e of our ig› norance. We wil l add, however, that there are some circumstances (e.g., tossing a coin) in which so many assignors would heartil y agree wit h the values assigned by (i) or (ii ) that the ultimat e recourse t o (iii ) would seem rather petty. Our position, if we had to give it a name, might be labelled reluctant subjectivism. Broadl y speaking, a reluctant subjectivist would assign probabilitie s 1. solely according to (i) only (a) when there is so littl e informatio n that mutually exclusive possi› bilitie s must be regarded as equally likely, or (b) when deducing the probabilit y of a compound event from probabilitie s assigned to simpler ones; (8.40) 2. solely according to (ii ) in some circumstances; 3. by a combination of (i), (ii) and (iii ) in most circumstances; or 4. solely according to (iii ) only if all else fails. A s an example of ( l a ), suppose you knew that a woman was pregnant wit h one child but had absolutely no informatio n about the child’ s sex. What probabilit y would you assign to the child being a girl ? Thi s possibility excludes the possibility that the child is a boy, and together these are the only possibilities. Hence ( l a) might lead you to say that Prob(Girl ) = 1/2. Indeed if absolutely all that you knew was that the baby would be either a boy or girl , then what else could you assign? On the other hand, you might know that approximately 105 boys are born for every 100 girls and prefer to assign Prob(Girl ) = 100/205 « 0.4878. But then you would have too much informatio n to apply ( l a )! 3
Encyclopaedia Britannica, 15th edition, 1980, Volume 14, p. 817.
8.6
Empirica l Probabilit y Assignmen t
293
A s an example of (lb) , suppose that you are conducting a sequence of Ν independent trials , for each of which the probabilit y of success is known t o be p. Then the possibility of r successe s in the Ν trial s is
φ^Μ-Ρΐ-'·
(8-41)
Note, however, that the value of ρ itself must have been assigned by one of the other methods. Examples of (2) and (3) are the subject of the followin g tw o sections. We conclude the present one wit h a remark about (4). Whenever possible, a purely subjective probabilit y should remain a parameter in the analysis. Thi s is what happened in Section 8.1, where the probabilit y that pirates roamed in the waters around Nands was retained in the analysis as the pa› rameter q, wit h the evident advantage that we were ultimatel y able t o give q it s worst possible value, thus minimizin g the effects of our ignorance. Even if it s worst possible value cannot be found, retainin g a subjective probabilit y as a parameter adds to a model’s usefulness by keeping it flex› ible, as discussed in Sections 4.15 and 7.8. Further examples of retainin g subjective probabilitie s as parameters wil l appear in Chapter 12.
8.6
Empirica l Probabilit y Assignmen t
W e have so far encountered two mathematical models for which prob› abilitie s were assigned purely by empirical means, namely, the lif e table model in Exercises 4 . 1 5 - 4 . 17 and Exercise 5.11, and the workforc e model in Section 6.6. We omitted, however, to describe the data fro m which the rel› ative frequencies were computed. The purpose of thi s section is to make amends. These two examples, together wit h an additional one, should suf› fice to indicate how probabilitie s are estimated for purely empirical distri › butions (parameter estimation for theoretical distribution s is the subject of the followin g section). We begin wit h the lif e table. You wil l recall fro m Exercise 4.15 that the probabilit y l(z) of survival t o age can be identified wit h the fractio n of a birt h cohort that survives t o age z, and is therefore related to the specific death rat e (or force of mortality ) μ(ζ) by 4
You wil l also recall that lif e tables specify l(z) only for certain discrete values of age. Let tw o consecutive such ages be denoted by = a and ζ = a + h. Then I'(a + hl2) can be approximated by {l(a + h) - 1(a)}/h, and l(a + h!2) can be approximated by {l(a + h) + l(a)}/2. It is easy t o show, You may wish to review Section 6.6 before proceeding.
294
Chapte r 8
Usin g a Model : Choic e and Estimatio n
by using a Taylor expansion of l{z) about = a + h/2, that the error in› volved in each approximation is 0(h ). But 0(h ) is not a small number if h = 5, as is so often the case in demographic work . Thus the approxima› tio n requires more careful justification . Thi s is a book about mathematical modelling, not numerical analysis; therefore we wil l simply observe that each approximation would be exact if / = /(z) were a linear function, and i s therefore adequate if / = /(z) does not depart too much fro m linearity . Thus, evaluating (8.42) at = a + h/2, we have 2
2l(a)-l(a -ηΚα)
2
+ h) ^ Κα
+
+
η
) *
μ
/ {
α
+
Λ\
,
2 ) >
( 8
a
·
... 4 3 )
whence
Ka + h) ^\-\μ{α+1) 1(a) ~ 1 + § (α+$)' μ
Because 1(0) = 1, approximations to the survival probabilitie s can be gen› erated recursively fro m (8.44), provided that μ(α + h/2) can be estimated fro m census data. Suppose that there were C(z) females aged in the 1966 U.S. pop› ulation , in the sense that the number aged between a and a + h would have been a+h C(z)dz. (8.45) la Ja Then the number of deaths between those ages would have been a+h μ(ζ)€(ζ)άζ. (8.46) r
f
J
f
Ja n ages a and a + h would have been Hence th e fractio n dying betwee
£^f^ . //
(M7,
C(z)dz
A rough approximation t o the integral of f(z) between is given by the formul a that earlier yielded (3.91): £f(z)dz
= z, and ζ = z
2
« (z - z,)/(i(z + z )) . 2
1
(8.48)
2
Thi s formul a is exact i f / varies linearl y between = z, and ζ = z ; and th e mor e linearl y it varies, the better the approximation. A s a special case, the formul a is exact i f / i s constant; and the mor e nearly constant / i s , the better th e approximation. Now, suppose that population is mor e or less uniforml y distribute d between a and a + h, whil e force of mortalit y varies more or less linearly . Then C(z) is approximately constant and μ(ζ) approximately linear, so that ( )Ł ) is also approximately linear. Then both numerator 2
8.6
Empirica l Probabilit y Assignmen t
295
and denominator of (8.47) are adequately approximated by (8.48); whence th e fractio n dying between ages a and a + h is approximately
MijJ)£(£–j)
/
hC{a+J)
=
¸
(*+
5
)•
(8-49)
Census data for U.S. females in 1966 are presented in Table 8.3. Fro m th e first lin e of the table, we see that 1,793,000 U.S. infant girl s were alive in 1966 (at mid-year) and that 36,353 died. Th e fractio n of infant girl s dyin g was therefore
OTo*
'
002027
Hence on using (8.49) wit h a - 0 and h = 1, we obtain / i ( 0 . 5 )w 0.02027.
(8.50a)
Similarly , on using (8.49) wit h a = 1 and h = 4, we get (3 ) *
and wit h a -
^ ^ m o
*
0
· °
0
0
8
5
,
(
8
" ° 5
b
)
5 and h = 5 we get
^ · 7
5
)
^ϊο^δο« · 0
0
0
0
3
7
·
Table 8.3 Mortalit y data for U.S. females in 1966. Source: Keyfit z and Flieger, 1971, p. 354. Age last birthda y 0 1-4 5-9 10-14 15-19 20-24 25-29 30-34 35-39 40-44 45^9 50-54 55-59 .60-64 65-69 70-74 75-79 80-84
Number of females Number of (thousands) deaths 1793 7922 10226 9542 8806 6981 5840 5527 5987 6371 5978 5498 4839 4174 3476 2929 2124 1230
36353 6706 3752 2906 5171 4981 5137 7010 10958 17841 25363 34308 44368 56592 77775 102041 118314 115335
( 8
-
5 0 c )
296
Chapte r 8
Usin g a Model : Choic e an d Estimatio n
Continuin g in thi s manner, we obtain the set of approximations t o μ(ζ) contained in Table 8.4. Fro m (8.44) wit h a = 0 and h = 1 we obtain
Fro m (8.44) wit h a = 1 and h = 4 we obtain
Fro m (8.44) wit h a = 5 and ¸ = 5 we obtain
Continuin g in thi s way, we easily obtain the lif e table presented in Table 8.5, which you should verif y for yourself by using a calculator (Exercise 8.6). Th e final column of Table 8.5 agrees wit h that computed by Keyfit z and Flieger (1971, p. 354) to between tw o and four significant figures. Th e discrepancy is partl y due t o roundin g error , but mainly due t o th e fact that demographers use more accurate approximations than (8.43) and (8.48). Th e values appearing in Table 8.5 are adequate for many purposes, however, and the accurate computation of lif e tables is as much as a matter of numerical analysis as of mathematical modelling. We wil l therefore not pursue it further ; see Keyfit z (1968) and Maro n (1982) for furthe r details. Table 8.5 can be used to construct the transitio n matri x for Exer› cise 5.11. Let U be the event that an individua l survives t o age a, and ˚ the event that she survives t o age a + h. Then, clearly, U — V= V. Thu s th e conditional probabilit y of survivin g t o age a + h, given that one has already survived t o age a, is 5
Prob(K |
u) -
P r o b ( c / )
Table 8.4
ζ 0.5 3.0 7.5 12.5 17.5 22.5 27.5 32.5 37.5 See Supplementary Note 8.1.
- p73b(Z7) ~ HUT'
Mortalit y estimates.
μ(ζ) 0.02027 0.00085 0.00037 0.00030 0.00059 0.00071 0.00088 0.00127 0.00183
ζ 42.5 47.5 52.5 57.5 62.5 67.5 72.5 77.5 82.5
μ(ζ) 0.00280 0.00424 0.00624 0.00917 0.01356 0.02237 0.03484 0.05570 0.09377
( 8 , 5 2 )
8.6
Empirica l Probabilit y Assignmen t
297
Table 8.5 Lif e table for U.S. females, 1966. l(z-5) 0 1 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85
0.9767 0.9982 0.9985 0.9971 0.9965 0.9956 0.9937 0.9909 0.9861 0.9790 0.9693 0.9552 0.9344 0.8941 0.8398 0.7555 0.6202
/(*) 1.0000 0.9800 0.9767 0.9749 0.9734 0.9705 0.9671 0.9629 0.9568 0.9481 0.9349 0.9153 0.8872 0.8474 0.7918 0.7079 0.5945 0.4492 0.2786
Th e values would differ slightly fro m those given in Exercise 5.11, however, for the reasons already stated. We shall need (8.52) in Section 9.7. A s our second example of purely empirical probabilit y assignment, we wil l retur n t o our Marko v model for the structur e of a workforc e and es› timat e it s transitio n matri x P. You wil l recall fro m Section 6.6 that there are seven states, denoting seven classes of occupation, and that X(n) de› notes the occupational class of an individua l chosen randomly fro m the nt h generation. Thu s Py = P r o b W n +l)
= j\X(n)
= i)
(8.53)
i s the probabilit y that a son or daughter of a member of occupational classi wil l become a member of occupational class j . For convenience, the class definition s are recorded in Table 8.6. W e should first explain that the transitio n matri x in (6.63) was esti› mated, by David Glass and John Hall , about 1953; see Glass (1954, p. 183). A t that time, the workforc e was still predominantly male. Accordingly, Glass and Hall’ s data was based on a sample of 3497 pair s of fauiers and sons and excluded the female workforce. Nowadays, you would replace father by parent(s), son by son or daughter (as reflected in Section 6.6), and you would have to exclude fro m your data any parent-son/daughter pairing s where two parents belonged to separate occupational classes. The
298
Chapte r 8
Table 8.6
Usin g a Model : Choic e and Estimatio n
Numbers of fathers and sons in various occupational classes . Number Number of of fathers sons
State Class of occupation 0 1 2 3 4 5 6
Professional and higher administrativ e Managerial and executive Higher grade supervisory and nonmanual Lower grade supervisory and nonmanual Skilled manual and routin e nonmanual Semi-skilled manual Unskilled manual
129 150 345 518 1510 458 387
103 159 330 459 1429 593 424
numbers of fathers and sons in each class in the sample of 3497 pair s are shown in Table 8.6. Transition s between classes are recorded in Table 8.7. Here i/, denotes the number of fathers in class i, and v denotes the number of fathers in class i wit h sons in class Thus, for example, of the i/ = 129 fathers in class 0, I/<M = 18 had sons in class 4; and of the i/ = 1510 fathers in class 4, 1/40 = 14 had sons in class 0. Th e proportio n of class 0 fathers wit h class 4 sons is therefore 18/129, and the proportio n of class 4 fauiers wit h class 0 sons is 14/1510. Proceeding in thi s manner, these and the 47 remaining proportion s yield the matri x tj
0
4
50/129 16/150 12/345 11/518 14/1510 0/458 . 0/387
19/129 40/150 35/345 20/518 3671510 6/458 3/387
26/129 34/150 65/345 58/518 114/1510 19/458 14/387
8/129 18/150 66/345 110/518 185/1510 40/458 32/387
18/129 31/150 123/345 223/518 714/1510 179/458 141/387
6/129 8/150 23/345 64/518 258/1510 143/458 91/387
2/129 "j 3/150 21/345 32/518 189/1510 71/458 106/387 . (8.54)
wit h Uijlvi in the yth column of row i. By evaluating the above fraction s to three decimal places, you can check that (8.54) is equivalent to the transitio n matri x of (6.63). The apparent discrepancies between the underlined elements and the corresponding ones in (6.63) are simply due to the fact that the probabilitie s in each row of a transitio n matri x must sum to 1. When first rounded to three decimal places, the first row of (8.54) sums to 1.002, and row s 2, 4, and 6 each sum to 1.001. Accordingly, Glass and Hall made corrections to ensure that the estimate in (6.63) was indeed a transitio n matrix . (Why they chose to round 19/129 to 0.146, when it would appear mor e consistent to leave it as 0.147 and round down either the fifth or sixth element of the first row instead is a mystery to me but of littl e consequence ; (6.64) obtains in either case.)
8.6
Empirica l Probabilit y Assignmen t
299
Table 8.7 Transitions between occupational classes over one generation. Son’ bonss class class
F a t h e r > S
class l
"I'O
Number of
"I 2
"I 3
"i4
"16
"f
0 1 2 3 4 5 6
50 16 12 11 14 0 0
19 40 35 20 36 6 3
26 34 65 58 114 19 14
8 18 66 110 185 40 32
18 31 123 223 714 179 141
6 8 23 64 258 143 91
2 3 21 32 189 71 106
129 150 345 518 1510 458 387
Number of sons
103
159
330
459
1429
593
424
3497
N ow that the origi n of (6.63) has been revealed, let’s understand what we have actually done. We have 1. assumed that intergenerational movement of the work force between occupational classes is a Marko v process, i.e., that a son’s occupa› tional class in no way depends upon his grandfather’s; and (8.55) 2. having made this assumption, we have used v lv to estimate (8.53) from a sample of 3497 actual transitions. ii
i
Th e first step is a matter of choice, the second a matter of estimation; and a few remark s are in order. I f (1) is true, then p exists quit e independently of the sample data on 3497 transitions. Al l we have done is to estimate it . I f our sample had consisted of a different 3497 pair s of fathers and sons, then our estimate would almost certainly have differed, too. Let’ s suppose that (1) is tru e and (wit h due respect t o subjectivists) furthe r suppose that there is some "true " probabilit y of moving fro m class i t o class j in one generation. Then thi s probability , which a supreme genius might be able t o supply, is the objective one, and j/y/i/,- is merely our subjective view of it . Th e subjectiveness is introduced by the process of sampling. But we would lik e to thin k that fro m a second sample of 3497 transition s would not th e estimate ujp/u\ differ greatly fro m ν^Ιν and that (νψ + ” •)/( > + ",•) would be even better still . Indeed the estimation procedure we have used has the very desirable propert y of "maximu m likelihood," as discussed in the followin g section. tj
2)
{
7
But how can we be sure that (1) was an appropriat e choice t o begin with ? How can we be sure that a son’s occupational class depends only on his father’s, not on whether his father rose or fell in rank ? To justif y our choice or , which is exactly the same thing, t o validate our model w e would have t o propose tests for it in accordance wit h the guidelines devised
300
Chapte r 8
Usin g a Model : Choic e and Estimatio n
i n Chapter 4. One test could be based on the supposition that if such a Marko v process had been operating for several generations, then π should now be approaching a stationary distribution . Two successive estimates of , the y’th entry of which records the probabilit y that a worker chosen at random wil l be in occupational class are obtainable immediately fro m Table 8.6. We have
( 0 ) « 3 ^ ( 1 2 9 , 1 5 0 , 3 4 5 , 5 1 8 , 1 5 1 0 , 4 5 8 , 3 )8 7 * (0.037,0.043,0.099,0.148,0.432,0.131,0.111) , (8.56) (1)
ˆ
Œ
103,159,330,459,1429,593,424 )
«(0.029,0.045,0.094,0.131,0.409,0.170,0.121) . (8.57) Th e relativ e closeness of (8.57) t o (6.64) is some indication that our choice i s at least along th e righ t lines, though th e appropriateness of th e class definition s in Table 8.6 might be subject t o furthe r debate: see the remark s at the end of thi s section. Th e success of the transitio n matri x estimation procedure we have just discussed is strongly dependent upon having a detailed data set, such as that contained i n Table 8.7. I f the only available informatio n concerns state vectors, such as those i n Table 8.6, then a different estimation procedure must be used. To illustrat e this, we wil l consider a simple example. Table 8.8 describes the movement through a hospital i n N ew Haven, Connecticut, of 471 coronary patients. T h e data set, condensed fro m Ka o (1974, p. 688), shows the number of coronary patients at three levels of care after a given number of moves between levels. T h e first level, labelled / = 0, contains th e coronary care unit (CCU), the post-coronary care unit (PCCU), the intensive care unit (ICU) , and the medical unit (MED) . Th e second level, labelled = 1, contains the surgical uni t ( S U R G) and ambu› lator y unit (AMB) . Th e thir d level, labelled i = 2, contains the extended care facilit y (ECF) and patients w ho have either gone h o me or died. I n other words, level 2 contains all those patients who have left th e hospital’s heart-patient facility . I s it possible that th e levels of care could be states of a Marko v chain, wit h m o v es corresponding t o transitions? I f so, how do we estimate th e transitio n matrix ? Table 8.8 Movement of patients through coronary facility . Level of care, j 0 1 2
0
Number of moves, η 1 2 3 4
471 417 26 12 0 0 5 6 0 0 0 49 439 459 471
8.6
Empirica l Probabilit y Assignmen t
301
Notice how this problem differs from the one we have just considered. There, in the case of the workforce, we had information on how individuals moved between states. Here, we know how many patients occupy each state after each transition, but we do not know where they came from. Let us assume nevertheless that patient movements do indeed form a three-state Markov chain, with time being measured nonlinearly. Our problem is then to estimate the transition matrix Ñ from knowledge of patient numbers at each level after η moves, for η = 0, 1, 2, 3, and 4. In fact, we will estimate Ñ from the data for η = 0, 1, 2, and 3. Thus data for η = 4 could be used as a test of our model. Notice that all patients enter the hospital at level 0. Hence π(0) = (1,0,0) '.
(8.58)
7
Moreover, patients do not re-enter the coronary facility after leaving it (at least not as part of this cohort of 471 patients). Hence, on using the fact that the rows of a transition matrix must sum to 1, the most general allowable form of the 3 χ 3 transition matrix is P =
«3
«4
0
0
1 - w, - u 1- « - u 1 3
2
(8.59)
4
where the entries of the vector u = ( u , , u , u , u ) , satisfying 0 < M, < 1, 0 < " 2 < 1, 0 < M < 1, and 0 < w < 1, are to be determined. On using (5.83) and (8.58), we find that T
2
3
3
4
4
ˆ (1) = π ( 0 ) Ñ = («„ « , 1 — W| — ã
(8.60)
u),
Γ
T
2
2
u] + u u 2
π(2) =
" ( «l 2
3
(8.61)
+ « 4>
.(1 - w , - w )(w, + l) + u ( l - u - w ) J 2
U {U i
2
+ U Uy)+
2
t
π(3) =
tt U (W,
2
M {u} + u u 2
2
t
3
2
4
+ « )
3
"
4
+ « (1 + w )} 4
(8.62)
4
(1 - Μ, - M )(«? + «2«3 + " l + ˇ 2
L
+ M ( 1 - « 3 - « ) ( « ! + W + 1) 2
4
J
4
The model predicts that there will be 47ln (n) patients at level k at time n. Let O be the observed number of patients at level k at time n. If patient movements do indeed correspond to a Markov chain, then 471π («) should be close to O . Thus the differences 4 7 1 π ( « ) - O should be close to zero for all values of k and n. From (8.60H8.62), these differences are functions of u,, w , w , and w ; hence so is the sum of their squares. If we define k
kn
Λ
Λ
kn
2
3
kn
4
3
3
L(u) = L(«,, u , u , M ) = 2
3
W") ~
4
n=lk=l
0
^
2
>
( · > 8
6 3
302
Chapte r 8
Usin g a Model : Choic e an d Estimatio n
then L is a quantity that should be close to zero if Table 8.8 is evidence of a Markov chain; and the closer L is to zero, the better the fit between theory and observation. Thus we calculate a best estimate of the matrix Ñ by minimizing the function L. As discussed in Section 8.4, minimizing L is a problem in nonlinear programming. If we blindly use a computer package like the IMSL routine ZXSSQ to minimize (8.63), then it will quickly inform us that the minimum occurs at u = u * , where, to four significant figures, u* =(0.8851,0.01111,-65.01,-0.8446) "
(8.64)
7
and that f(a') = 0.0002271. This is clearly an absurd result because it fails to satisfy 0<M <1,
1 < J < 4,
;
(8.65)
and highlights the importance of constraints on the decision variables in nonlinear programming. Properly posed, the problem we face is the constrained nonlinear programming problem 3
3
minimize L(u) = L(w,, w , w , « ) = 2
^(n) - O } , 2
4
3
kn
(8.66)
n =l k=l
subject to 0<«,<1,
;=1,2,3,4,
(8.67)
i - «ι - M > 0,
(8.68)
1 - M - w > 0.
(8.69)
2
3
4
This is just a special case of the more general nonlinear programming problem minimize L(u) = L(u,, u , . . . , u„), 2
subject to £,(ti ,H ,...,w ) >
0,
/ = l , . . . , m,
A / ( « i . «2
0.
j=l,...,q,
l
2
…
=
(8.70)
where g,, 1 < / < m, and Ay, 1 < j < q, are (usually) differentiable functions of their arguments. You can easily verify that the linear programming problem (3.20) is just a special case of (8.70). Constrained nonlinear programming remains an active area of ongoing research. The state of the art is nowhere near as complete as for linear programming, however, and computer routines for solving (8.70) are neither as common nor as reliable as for (3.20). Nevertheless, methods do exist for solving (8.70), among the most efficient being those known alternatively as augmented Lagrangian or multiplier methods. A discussion of these would be quite beyond our brief, however, and the interested reader is referred
.
Empirica l Probabilit y Assignmen t
303
to Jeter (1986, Chapters 9 and 10) or Luenberger (1984, Chapters 10, 12, and 13). Your computer library may not have a routine that copes with (8.70). Nevertheless, by using a multiplier method, it is possible to show that the minimum of (8.66) subject to (8.67)-(8.69) occurs at u = u*, where, to four significant figures u* = ( 0 . 5 0 2 8 , 0 . 1 1 0 7 , 0 , 0 ) r
(8.71)
and/(u*) = 0.3628. Notice, however, that constraints (8.68) and (8.69) are inactive at the solution, so that we would obtain the same answer if we simply ignored them. The problem of minimizing (8.66) subject to (8.67) alone is much more likely to be covered by a library routine. In particular, if you have access to the IMSL package ZXMWD, then you can verify (8.71) for yourself. On substituting (8.71) into (8.59), we find that our best estimate of Ñ is P =
0.5028 0 0
0.1107 0 0
0.3865" 1 1
(8.72)
On using (8.60M8.62), our model predicts that there will be 471 («) patients at level k at time n, where 471 («) is given in Table 8.9 for 1 < k < 3, 1 < η < 4. Comparing with Table 8.8, we see that the Markov model yields a very poor fit to the observations, and we have no hesitation in rejecting it. Recall, however, that our three levels of health care were an amalgamation of nine: CCU, PCCU, ICU, MED, SURG, AMB, ECF, HOME, and DIED. If we knew patient numbers at each of these nine levels after a given number of moves, then we could attempt to model the coronary care unit as a nine-state Markov chain, with the 9 9 transition matrix Ñ being estimated by the same procedure as we used to determine (8.72). It turns out (Exercise 8.7) that the fit is then a good one. Thus whether or not a dynamical system has the Markov property depends upon how we define the states; and it is wise to group data in as natural a way as possible. º
`
Table 8.9 Predictions by best fit Markov model of movements of patients through coronary facility. Level of care, k 0 1 2
0
Number of moves, η 1 2 3 4
417 237 119 60 30 0 52 26 13 7 0 182 326 398 434
304
Chapte r 8
Usin g a Model : Choic e an d Estimatio n
8.7
Choosin g Theoretica l Distribution s and Estimatin g Thei r Parameter s
In Section 7.1 we constructed a buying model in which demand for a product was a random variable, there denoted by Z . Allowing the random variable to have an arbitrary distribution gave the model flexibility, but the model could not be used until the distribution had actually been specified, i.e., until probability had been assigned. Accordingly, we will now discuss the assignment of a distribution to a random variable. We will begin with some definitions. Let X , X , AT, . . . , X denote η random variables, e.g., demands for a product in the last η buying periods. Assume that these random variables are independent and all have the same distribution as the random variable, X, whose distribution we wish to assign. Then a sample from that distribution consists of η realizations, one for each of the random variables X , X , X , . . . , X„, and is denoted by {x ,x ,...,x }. Because X , X , X , X are random variables, so are the quantities {
y
i
2
n
x
2
2
3
n
3
2
3
n
Χ= -ΣΧ>,
(8.73)
Χ
i= l
S'H^D*/-*) . 2
(8.74)
i'= I
The value the random variable (8.73) actually takes, or realizes, i.e.,
*=^I> >
(8-75)
is known as the sample mean, and the value ˛ -^-5>,•- ) , (8.76) " /=! that (8.74) realizes is known as the sample variance. The random variable S has the desirable property that E[S ] = σ . This simply means that if we take a sequence of samples from the distribution, and hence obtain a sequence of sample variances, then the average value of the latter sequence should be close to the value of σ . For large n, however (and it is always desirable that η be as large as possible), the divisor in (8.76) is approximately n, so that the sample variance is approximately the sample's average squared deviation from its mean. As remarked in Section 8.5, assigning distributions may involve all of (8.39)'s three methods of probability assignment; namely, the conceptual, the empirical, and the intuitive. The principal determinant of the relative weight given each of the three methods is the size of any sample taken from the distribution. Broadly speaking, the larger the value of n, the more 2
2
2
2
2
1
8.7
Choosin g Theoretica l Distribution s an d Estimatin g Thei r Parameter s
305
empirical and objective the assignment; the smaller the value of n, the more intuitive and subjective the assignment. Examples below will illustrate this. In all cases, however, the assignment will involve the following two steps, the first a matter of choice, the second a matter of estimation: 1. First choose a known theoretical probability distribution from which all probabilities can be derived immediately once values have been assigned to one or two parameters. (8.77a) 2. Estimate the value(s) of the free parameter's). (8.77b) In principle, one could use theoretical distributions with more than two free parameters; but their use is rarely justified in practice, and we will avoid them altogether. A theoretical distribution embodying everything that is known about a certain random variable (e.g., demand) may properly be regarded as a model in its own right—a statistical model, as it is often called. This model can then be used as an input to another model, such as those encountered in Chapter 7. It becomes, in the process, a model within a model, just like the behavioral response functions of Section 8.3. Indeed the first of the statistical models derived in this section has effectively been used as an input already, in Section 5.4; and the second will be used as an input in Section 10.6. When the sample size η is large, the frequency distribution of the sample—i.e., the frequencies with which various values of χ occur in the sample—is used to perform step (8.77a); and (8.77b) is most easily achieved by setting the mean and/or variance of the distribution equal to the sample mean and/or variance. An example will clarify what is meant by this. Let X denote the time gap between cars in a stream of traffic, and let X , X , Xy, . . . , denote 214 particular time gaps that in a certain experiment realized values {χ ,χ ,χ ,... , x } . The experiment in question was performed on the Arroyo Seco Freeway in October, 1950, between 2:00 and 2:30 in the afternoon. The 214 observed gaps totalled 1753 seconds. Thus x
2
χ
2
3
2 l 4
2 14
£ j c
t
=
1753.
(8.78)
The sample frequency distribution is presented in Table 8.10. From this information we can easily deduce the cumulative frequency distribution of the sample, denoted by F (x), i.e., the frequency with which gaps in the sample were less than or equal to x. For example, because 43 gaps were less than or equal to 2 seconds, we have ^,(2) = 43; and because 182 gaps were less than or equal to 14 seconds, we have ^ ( 1 4 ) = 182. Naturally, F (0) = 0, and because no gap exceeded 31 seconds, F (3l) = 214. The sample cumulative frequency distribution is plotted in Fig. 8.5. s
s
s
306
Chapte r 8
Usin g a Model : Choic e an d Estimatio n
Table 8.10 Time gaps between cars in an experiment on the Arroyo Seco Freeway. The data are due to Gerlough and Barnes (1971, p. 39). Gap χ satisfying
Observed frequency
Gap χ satisfying
Observed frequency
0<x< 1 1 <x<2 2<x<3 3 < x< 4 4<x<$ 5<x<6 6<x<7 7 < x< 8 8 < x< 9 9 < x < 10 10 < x< 11 11 <x< 12 12 <x< 13 13 <x< 14 1 4 < x < 15 15 <x< 16
29 14 22 13 11 14 16 11 12 11 9 12 6 2 3 3
16 < x < 17 17 <x< 18 18 <x< 19 19 < x < 20 2 0 < x < 21 21 < Λ: < 22 22 < χ < 23 23 < χ < 24 24 < χ < 25 25 < * < 26 26 < χ < 27 27 < χ < 28 28 < χ < 29 29 < χ < 30 3 0 < χ < 31
7 3 2 3 1 1 1 0 1 0 1 2 1 2 1
Our sample is large, and so we would expect F (x) to resemble 214 · P r o b ^ < x). Multiplication by a constant does not alter the shape of a curve; hence we would expect F (x) to have the shape of P r o b ^ < x). But F (x) has a similar shape to the cumulative distribution function s
s
s
P r o b ( * < x) = 1 - e~
Xx
(8.79)
of the exponential distribution as sketched in Fig. 5.1, suggesting that the random variable X is distributed according to (8.79). This completes (8.77a) for the problem at hand. Because the exponential has a single free parameter, namely, λ, we estimate it by equating the mean of the distribution to the mean of the sample. But the mean of the exponential distribution is l/λ, by (5.33), and the mean of the sample is
2 4
( -8°) 8
Thus, from (8.78) and (8.80), we estimate λ as 214/1753 = 0.122. Having chosen a distribution and estimated its free parameter, we now propose Prob(X < x) = 1 - e -
2 l 4 x m 5 3
(8.81)
as a statistical model of time gaps in traffic on the Arroyo Seco freeway. Note that if F (x) had suggested a two-parameter theoretical distribution s
8.7
Choosin g Theoretica l Distribution s an d Estimatin g Thei r Parameter s
307
200
150 h
100 h
50
ˆ-
10
20
30
Fig. 8.5 Cumulative frequency distribution for the sample in Table 8.10, denoted by dots, together with the graph of 214· Prob(J < x), denoted by the dashed curve, where Pidb(X < x) is denned by (8.81).
(such as the normal distribution), then we would have estimated the parameters by setting both mean and variance of the distribution equal, respectively, to the sample mean and variance; see Exercise 8.8. How good is the statistical model (8.81)? The function 214· P r o b ( * < x) = 214(1 - ~ ) is plotted in Fig. 8.5 alongside F (x). The agreement appears to be quite acceptable. It is possible to be more precise than this, however; and we now provide a brief general description of a suitable "goodness of fit" test. Let the sample space of a random variable X be subdivided into k intervals, and let Pj denote the theoretical probability that the value of X will lie in class j , 1 <j < k. Suppose that a sample of size η is about to be taken (i.e., we are about to obtain η realizations of η random variables with the same distribution as X). Now, after the sampling has been performed, the frequency of realizations in class j , denoted by o,, will be fully determinate. Before the sampling, however, the frequency of observations in class;' is a random variable, which we will denote by Oj, 1 <j
e
s
308
Chapte r 8
Usin g a Model : Choic e an d Estimatio n
that the random variables <9,, 0 , 0 ,..., 2
O are not independent because
3
k
O, + 0 + 0 +
· + O = n.
3
2
(8.82)
k
Now, the quantity
» * £ ^ . j=l
>
ψ
being a function of random variables, is itself a random variable, with the positive real numbers as its sample space; but its distribution is extremely complicated. If η is large, however, then it can be shown that χ has approximately the distribution with probability density function 2
-1//2-U-Z/2 / ^ >
˛
2
W 2
r
(
g )
’
(
8
•
8
4
)
where (8.85)
u=k - m - \ , where the Gamma function Γ is denned b y
6
yO O
r ( j ) = / f- e~ dx (8.86) Jo for s > 0, and where m is the number of parameters to be estimated in (8.77b); see, for example, Meyer (1972, p. 333). The distribution with probability density function f„ is known as the Chi-squared distribution with ν degrees of freedom. A typical density function, namely / j , is sketched in Fig. 8.6; f has a similar shape whenever l
7
x
t
u
/,7
o.ost
Fig. 8.6 f for ν — 17. The χ probability density function always takes its maximum where 2 = ν - 2, in this case 15. v
2
The Gamma function can be shown to satisfy T(s) = (s- l)T(s - 1). Thus T(s) = (s- 1)! if i is an integer, because Γ(1) is clearly 1. It can also be shown that Γ(1/2) = y/ir, a result that is needed for (8.88).
6
8.7
Choosin g Theoretica l Distribution s an d Estimatin g Thei r Parameter s
309
ν > 2. The Chi-squared distribution is widely tabulated; see for example Lindley and Miller (1953, p. 7). Hence we can compute the probability that if a large number of samples were taken from the distribution, then χ would exceed the value it actually realized in our particular sample. If this probability is exceedingly small, then we can say that a value of χ as high as or higher than the one that occurred could almost certainly not be due to chance. Then a value of χ as large as the one we have obtained must be due to the fact that our statistical model does not provide a good fit to the data. We should not then accept it. But if this probability is more than, say, 0.1, then there is, say, a I in 10 chance that differences between theoretical frequencies and expected frequencies could be due to random variation; and we have no good reason to reject our statistical model. Before we apply the Chi-squared test to (8.81) and Table 8.10, a few remarks are in order. First, the derivation of the above result would take us far beyond our brief; the interested reader is referred to Meyer (op. cit.). Second, because the supporting theory strictly applies only in the limit as η -* oo, it isn't possible to say precisely how large η must be for the Chisquared test to be applicable; but statisticians appear to agree that it is unwise to apply it if η is less than about 50 and that it is desirable for η to exceed 200. Third, and most important, applied statisticians usually insist that the sample space should be subdivided into intervals satisfying 2
2
2
npj > 5,
(8.87)
l<j
We will follow this convention in our example, even though, as remarked by Kendall and Stuart (1967, p. 440), there seems to be no theoretical underpinning for (8.87); and circumstances are known when the validity of the Chi-squared test does not depend on it. In practice, if (8.87) is violated when intervals are first chosen, then a fresh subdivision is obtained by combining neighboring intervals, as in the following example. We now return to our statistical model (8.81). Because k = 19, from Table 8.11, and because we have estimated a single parameter, namely λ, it follows from (8.85) that ν = 17. Hence χ has the distribution with density function 2
(8.88) This is plotted in Fig. 8.6. The value actually realized by χ is calculated in Table 8.11 as 22.06. From Lindley and Miller (1953), the probability that χ exceeds 24.77 is 0.1. This area is shaded in Fig. 8.6. Because 22.06 lies in the unshaded region, there is a greater probability than 0.1 that differences between the observed frequencies Oj and expected frequencies npj are due purely to chance. We should therefore not reject our statistical model. On the other hand, we would have been happier if the value of χ lay somewhere near the peak of the distribution at ζ = 15, i.e., if the value 2
2
2
310
Chapte r 8
Usin g
Model : Choic e an d Estimatio n
Table 8.11 Calculation of value realized by χ sample of values in Table 8.10.
(Oj -
Interval 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 Totals 19
for
2
°j
0<x< 1 1 <Λ:< 2 2<x< 3 3<x< 4 4 < x< 5 5<x< 6 6<x< 7 7<x< 8 8<x< 9 9 < x< 10 1 0 < x < 11 11 <x< 12 12 < x < 13 13 < x < 14 1 4 < x < 16 1 6 < x < 18 18<x<20 20 < χ < 23 x> 23
29 14 22 13 11 14 16 11 12 11 9 12 6 2 6 10 5 3 8
0 < χ < oo
214
n
24.59 21.77 19.27 17.05 15.09 13.36 11.82 10.46 9.261 8.197 7.255 6.421 5.683 5.030 8.393 6.574 5.150 5.711 12.91
npj)
2
Pj
0.7898 2.771 0.3882 0.9625 1.109 0.0309 1.476 0.0275 0.8099 0.9585 0.4197 4.847 0.0176 1.825 0.6821 1.785 0.0044 1.287 1.869
214
22.06 Entries in the fourth column are obtained from (8.81). For example, nm = 214(e-° - - - ) = 19.3. For gaps exceeding 14 seconds, intervals must be longer than a second to satisfy (8.87). Note that the table on pp. 38-39 of Gerlough and Barnes (op. cit.) contains several errors, which is why the calculation is presented in detail here. 244
0
366
e
actually realized by χ were one of the most probable. But although we accept our statistical model with caution, we have at least demonstrated that it was not unreasonable, in the crossing control model of Section 5.4, to assume that cars passing a fixed point on an unrestricted highway may be regarded as arrivals in a Poisson process. A few remarks are now in order. Achieving (8.77b) by equating means and/or variances involves a special case of what is often called the method of moments, the mean and variance of a distribution being its first two moments. But (8.77b) need not be achieved by the method of moments. Indeed statisticians usually recommend that whenever the χ test is being applied parameters be estimated by a different method, namely, the method of maximum likelihood (see below). Moreover, these are not the only two methods by which (8.77b) can be achieved, and there is already a large literature on what has come to be known as statistical inference. The 2
2
8.7
Choosin g Theoretica l Distribution s an d Estimatin g Thei r Parameter s
311
larger the value of n, however, the smaller the differences between results obtained by the various methods. Thus, as almost always in statistics, difficulties arise mainly when the sample size η is small. Then the cumulative distribution of the sample need not suggest the shape of the underlying distribution, and the χ test may not be used. In these circumstances, the assignment pendulum swings heavily across from the side of objectivity to that of subjectivity. When is η small? No precise answer can be given, though statisticians would appear to agree that η is small if η < 30. As if to leave the matter beyond all reasonable doubt, however, let's consider the second extreme by taking η - 6. The model that results is inevitably very subjective. General (i.e., national) elections were held in the United Kingdom (of Great Britain and Northern Ireland) on the dates shown in Table 8.12. L denotes a victory by the Labour party, C a victory by the Conservative party. No other party has been in power since World War II. For ease of computation, the postwar years have been broken into quarters. The dates of transitions between quarters are year's end, winter/spring, mid-year, and Fall. Each general election has been assigned to its nearest transition date. 7
1
Table 8.12 Waiting times between postwar general elections in the United Kingdom. Data prior to 1970 are taken from Childs (1979), later data from personal memory. Election date July, 1945 March, 1950 October, 1951 May, 1955 October, 1959 October, 1964 March, 1966 June, 1970 February, 1974 October, 1974 May, 1979 June, 1983 June, 1987
/
0 19 25 40 57 77 83 100 115 117 136 152 168
Labour Conservative Winner waiting waiting time time L L C C C L L C L L C C C
19 6
6 17 2 19
15 17 20 15 16 16
Indeed the method of moments and method of maximum likelihood yield identical results for some of the commoner distributions, in particular the normal and exponential, regardless of the value of n. For a concise introduction to statistical inference, see Chapter 10 of Ross (1980). 7
312
Chapte r
Usin g a Model : Choic e an d Estimatio n
Thus the July, 1945, election is regarded as having taken place in mid-year, or at the end of the second quarter of 1945. Similarly, the February, 1974, election is regarded as having taken place in winter/spring, or at the end of the first quarter of 1974. The number of quarters that have elapsed at the time of each general election is denoted by /, with / = 0 corresponding to the July, 1945, election. These "quarter dates" appear in the second column of Table 8.12. The government of the U.K. may stay in power for at most five years, or 20 quarters, but may call a general election at any time within that fiveyear period. Thus the waiting time between general elections is a random variable, taking integer values between 1 and 20. Let's denote this random variable by W , if Labour are in power, or by W , if Conservatives are in power. What kind of probability distribution is associated with W and h
c
L
The last columns of Table 8.12 together reveal that since World War II an election has always been called either in the last year and a half or the first year and a half of the governing party's five-year term. A mid-term postwar general election has yet to take place. There is conceptual support for these empirical findings. In theory, a government is elected to do five years' work. If its majority is so slim that it cannot govern effectively, then it may return to the polls quickly, in the hope of obtaining a firmer mandate. Because the parliamentary majority is determined at the general election and can change only in the rare event of a by-election, it is most unlikely that a government will perceive its majority as adequate in the early years but not in the middle years. As a consequence, a mid-term election is virtually impossible. On the other hand, if a government waits a full five years before calling an election, then it virtually admits that it fears defeat at the polls. The confidence that gives to the opposition is likely to weaken the government's effectiveness in Parliament. Thus the fiveyear Conservative term from October, 1959, until October, 1964, should be regarded as an event that had low probability, even though it actually took place (note that the Conservatives were promptly defeated). But it is also clear from Table 8.12 that Labour are more prone to return to the polls early than Conservatives are. Thus W and W do not have identical distributions, even though they are not totally dissimilar. Let Prob(W = k) be denoted by w (k) and Prob(W^ = k) by w^k). Because mid-term elections are so unlikely, I'm going to stick my neck out and say that c
L
L
c
0
w (k) = 0 = w,(fc), 0
9 < k < 12.
(8.89)
Thus elections are impossible in the middle year of a government's potential life span. In practice, there is a tiny probability that such an election might occur, but (8.89) is not a bad approximation. In my opinion, the five-year Conservative term, from October, 1959, until October, 1964, was
8.7
Choosin g Theoretica l Distribution s an d Estimatin g Thei r Parameter s
313
an aberration. Even though it actually happened, I don't consider it any more likely than a quick return to the polls by Conservatives. On the other hand, I do think that Conservatives are more likely to call an election after about four years than at any other time. Indeed, after election victory in 1987, the Conservative leader actually predicted seeking re-election in 1991! I will therefore take U l 4
’
l 9
’
« »
2 0 ;
I expect that u will be much larger than í (see below). Notice that I have made a four-and-a-half-year term as likely as a four-year term, even though there have been none of the former and two of the latter. This is largely to keep the mathematics simple while getting across the ideas. Nevertheless, we cannot be sure that W = 18 isn't just as likely as W = 17. Now, because c
c
20
£ > . ( * ) = 1,
(8.91)
it follows immediately from (8.89) and (8.90) that 12v+ 4 u = 1.
(8.92)
I therefore assume the following one-parameter theoretical probability distribution for the random variable W , whose sample space is the integers between 1 and 20: c
iA-? ’ "i<*>=
0,
if 1 < A: < 8,fc= 13,14,19,20; if9<*<12;
la,
(8-93)
if 15 < k < 18,
where 0 < u < 1/4 (why?). Thus (8.77a) has been accomplished for the Conservatives. How do we accomplish (8.77b)? Perhaps the most popular method for estimating u is the method of "maximum likelihood." Suppose that (8.93) is indeed the probability distribution for W . Then what is the probability of the joint event c
{
= 16} , (8.94) if the random variable W$ denotes the Conservatives' waiting time during their ith postwar term in office? If we assume that the random variables c' > 1 < ι < 6, are independently distributed according to (8.93), then the probability of the event (8.94) is w/
= 15,
= 17,
= 20,
= 15,
= 16,
)
*.(«) =uu(-^-j)uuu=u>
(yj-f)-
(- ) 8
95
314
Chapter 8
Using a Model: Choice and Estimation
The function φ, denned on 0 < u < 1/4, is known as a likelihood and is sketched in Fig. 8.7. Bear in mind that the graph actually shows 105^, so that the probability (8.95) is negligible, except perhaps in the neighborhood of the peak at u - 5/24, where <j> assumes the scarcely enormous value of 0.000005451. Yet the joint event (8.94) actually happened! We might thus conclude that the most appropriate value for u in (8.93) is the one that maximizes (8.95), because that attaches maximum likelihood to the event that was realized. This value of u, namely, 5/24, is known as a maximum likelihood estimate. From (8.92), the corresponding value of v is 1/72, which is 15 times smaller. I thus propose the following statistical model for Conservative length of stay in office:
J_
72' ?TOb(Wc = k)= 4 0, _5_ 24'
if 1 < £ < 8,fc= 13,14,19,20; if9<*<12;
(8.96)
if 15
The form (8.96) relies heavily upon my intuition that an early Conservative dissolution of Parliament is about as likely as a tardy one, even though there has never been an early dissolution. You might have a different idea. You might, for example, agree to take wt(k) = u for 15 < k < 18, wt(k) = v for 1 < k < 8, k = 13,14, as before, but prefer to take w,(fc) = z for k = 19 and 20, with z larger than v in mind. Because (8.91) then yields lOv + 4w + 2z = 1, you would replace (8.95) by 4>(u,z)=u5z
(8.97)
and maximize it subject to the constraints 0<«<1,
0
l-2z-4u>0,
10% ▲
0.5 -
0
0.1
0.2
Fig. 8.7 Graph of the likelihood function defined by (8.95).
(8.98)
8.7
Choosin g Theoretica l Distribution s an d Estimatin g Thei r Parameter s
315
the last of which ensures that í is nonnegative. This is a nonlinear programming problem of the form (8.70). Its solution does not require a computer, however, because it is obvious from Fig. 8.8, in which the shaded region corresponds to (8.98). The curves above it are of the form u z — constant, with the value of the constant increasing toward the top right. It is clear from this diagram that (8.97) has its maximum on the line 4u + 2z = 1, at the point where the line is tangent to one of the curves. This point is easily found to be given by u = 5/24 and ζ = 1/12 (Exercise 8.9). The corresponding value of í is zero, yielding the alternative statistical model 5
?rob(W
c
0,
ifl
= k)= { A
ifl5<*<18;
-i,
(
8
9
9
)
if 19 < A:< 20.
Now ζ is certainly larger than v; but it is also impossible for Conservatives to call an early election, and the probability that they might call one after about four years of government remains unchanged. For this reason, I prefer the first of the two statistical models because a single early election call by Conservatives would cause (8.99) to be rejected in favor of (8.96) or some other statistical model. Although Labour's early dissolutions all occurred within the first year and a half of a parliamentary lifespan, I see no special reason they might not have occurred at any time during the first two years. Likewise, although the late dissolutions all occurred within the last year of a parliamentary lifes-
Fig. 8.8 Curves u z — k in the u-z plane, for various values of k, as indicated on the sketch. The shaded region corresponds to (8.98). 5
316
Chapte r 8
Usin g a Model : Choic e an d Estimatio n
pan, I see no special reason they might not have occurred sooner. Moreover, I see no special reason to distinguish one early quarter from another, nor one late quarter from another. I will therefore assume that w (k) - u for 1 < k < 8 and w (k) = í for 13 < k < 20. From (8.89) and (8.91), however, it then follows that 8u + 8v = 1. Accordingly, I assume the following form of distribution for Labour stays in power: Q
0
f
if 1 < k < 8;
u,
w (k)={ 0
*
0,
if 9 < fc< 12;
l-u,
if 13 < fc < 20.
(
8
1
0
0
)
This accomplishes (8.77a) for Labour. It is now straightforward (Exercise 8.10) to show that the maximum likelihood estimate of u is 1/16. Hence I propose yg, Prob(W = k)= { 0, L
-^,
if 1 < k < 8; if9
(8.101)
ifl3<*<20,
ID
as a statistical model of length of Labour terms in office. Though we shall find them useful in Chapter 10, the models (8.96) and (8.101) are extremely subjective, and you may not agree with them. They assume in particular that the distributions of W and Wc do not change with time, which may not be true; yet there is no way to test this assumption. No matter how much you know or might learn about British politics, you could hardly construct more objective statistical models from so little data. What you can do, however, is to transfer the subjectivity from me to you, replacing (8.96) and (8.101) by models of your own. You are most welcome to try. But an easier task would be Exercise 8.15. L
8.8
Choosin g a Utilit y Function . Cautiou s Attitude s to Ris k
A buyer who seeks to maximize the expected value of her company's profit from an item, over any given period, may be acting rationally only if the number of periods is large. To see this, let the random variable P denote profit from a single period when the quantity ordered is u. Let P™ and denote, respectively, the minimum and maximum values that the random variable P can take. Let u* denote the quantity that maximizes E[P ]. Then P$ is almost certainly negative. Suppose, for example, that demand, Z, is uniformly distributed between a and b. Let p, c , and c, 8
u
n
u
in
U
0
You may wish to review Section 7.1 before proceeding.
8.8
Choosin g a Utilit y Function . Cautiou s Attitude s t o Ris k
317
denote, respectively, unit selling price, unit cost price, and unit holding cost. Suppose that delivery cost is either zero or absorbed into the cost price, i.e., that k = 0 in the terminology of Section 7.1. Then, from (7.6), we have (pZ - c u-
Z),
c,(u-
a
l (Ρ - c )«-
ifZ
0
Μ;
and from either (7.10) or (7.63) we have \P+cJ It follows readily that P = (p - c )u, P = (p + c )a - (c + c,)u and P$ < 0 if [p + c + 2c, )a < (c + c )b, i.e., if a is sufficiently small. Thus, because of the uncertainty in P , choosing the optimal value for u cannot rule out the possibility that a negative profit be realized. If the number of periods is large, then periods when P . > E[P . ] are likely to compensate for periods when P . < E[P . ], including those for which P . < 0, so that maximization of expected profit is a rational long-term policy. If the number of periods is small, however, then the company stands to suffer if P™ " < 0, because later periods may not be able to compensate. In such circumstances, shouldn't the buyer order u < u* to reduce the loss that the company would suffer if the worst possible outcome were actually realized? In other words, shouldn't she adopt a more cautious attitude to risk? In an attempt to indicate how the buyer might do so, we will confine our attention to cases when she orders for a single period only. Moreover, to keep the mathematics as simple as possible, we will assume henceforward that a = 0; then certainly P$' = - ( c + C | )«* < °- Let's define a normalized profit by m a x
m i n
H
u
0
0
{
m
0
0
{
u
u
u
U
U
u
1
n
0
ρ
_
pmin
Lin -
(8-104)
where P ^ = - ( c + c )b and P^ = (p - c )b are, respectively, the least and the greatest profit that could possibly be realized from the period; 0 < R < 1. Thus an actual profit of zero corresponds to a normalized profit of È, where, on setting P = 0 in (8.104), we have i n
x
0
{
0
u
u
q Cq =
+ c P+ c
(8.105)
1
{
Because P and P^ are independent of u, the value of u that maximizes E[P ] is the same as that which maximizes E[R ]. Thus the long-term buyer maximizes E[R ]. The short-term buyer, however, must have an alternative goal. Let's simply suppose that she maximizes E[M(R )], where Μ is a merit function taking values between 0 and 1. For the long-term buyer, min
n
ft
U
U
U
U
318
Chapte r 8
Usin g a Model : Choic e an d Estimatio n
we have M(R) = R. Our problem is to determine a form of Μ for the short-term buyer. The long-term buyer's merit function is shown in Fig. 8.9(a) as the solid straight line. The value Θ, corresponding to the break-even profit P = 0, is arbitrarily marked on the diagram. Now, high values of Λ are associated with high risk, because only by ordering a quantity close to b can the buyer hope to obtain them; but these are precisely the circumstances in which the company will suffer a heavy loss if demand is unexpectedly low. Hence, whereas the long-term buyer can justifiably be 90% satisfied with R = 0.9, we would expect the short-term buyer to be 90% satisfied with rather less than this; thus Af(0[) = 0.9 for some 0, < 0.9. We have marked a possible point as a dot on the diagram in Fig. 8.9(a). By deciding how much profit will make her 90% satisfied, the buyer can attach a merit value to the (normalized) profit è,. Continuing in this way, the buyer can attach a merit value to all values of Λ for which è < R < 1. The point (è , Μ(è )), for example, is indicated (arbitrarily) on the graph. The shape of the associated merit function is also indicated. Note that it lies completely above the line u
2
2
Fig. 8.9 (a) Feasible region for short-term buyer merit function, (b) Possible form of merit function, used in subsequent analysis.
8.8
Choosin g
Utilit y Function . Cautiou s Attitude s t o Ris k
319
M(R) = Rin this range because the short-term buyer is obliged to be more satisfied with less. In the range 0 < R < Θ, however, we would expect the short-term buyer's merit curve to lie below that for the long-term buyer, because the actual profit here is negative. A very negative profit is a worse outcome for the short-term buyer, who must therefore assign it a lower merit value. Again the probable shape of the merit curve is indicated. Summarizing, we have M"(R) > 0 for R < è and M"(R) < 0 for R > Θ, assuming that Μ is twice differentiable. The shading in the diagram indicates the feasible region for short-term merit functions. As usual when applying the method of extremes (Section 8.3), we must now find a one-parameter family of curves that covers the shaded region. To keep the mathematics tractable, it will be convenient to relax the assumption that Μ be twice differentiable and use the piecewise linear form depicted in Fig. 8.9(b), namely, ifO?<0(l-a); if 0(1 - ó ) < Λ < 0(1 -σ) + σ; if 0(1 -a) + a
(8.106)
1.
Note that we still have M"{R) > 0 for R < 0 and M"(R) < 0 for R > 0; but now, as it were, all the "twice-differentiability" is compressed into the two corners at 0(1 - a) and 0(1 - α) + a (where there is infinitely much of it). The risk parameter σ satisfies 0 < σ < I. The greater its value within that range, the less cautious the buyer, the value a = 1 being the one our long-term buyer would adopt. The buyer's attitude to risk is a subjective matter, therefore we retain a as a parameter in the analysis. From (8.102), (8.104), and (8.105):
(8.107)
From (8.106) and (8.107), and from the fact that è, a, and ulb all lie between 0 and 1, we find that Μ = 0 only if 0 < X < (w - äσ)è; Μ = 1 if either X>u>baotu>X>{uba)6 + ba (implying u > ba); and 0 < Μ < 1 if either X < u and (« - ba)0 < X < (u- ba)6 + ba or X > u and u < ba. Thus, if u < ba, then we have (Exercise 8.11)
M(R {X))={ U
^ - ^
+ 0,
* i^i^ ba
+
if0<*<M;
(8.108) tf.
i(u<X
320
Chapte r 8
Usin g a Model : Choic e an d Estimatio n
but if u > be, then we have
M(R (X)) U
0, X-Bu ba 1.
=
ιΐÏ + Θ,
<X<(u-ba)B; + ba; (8.109)
ii(u-ba)B<X<(u-ba)B \{{u-ba)e
+ ba <X
A straightforward integration (Exercise 8.11) now yields rb
=J
J{u) = E[M(R {Z))] U
u(\-B) ba
M(R (z))^u
u 2Ρσ'
if u < ba;
1-^ + ^(ó-|),
ifu>Z>
Θ+
(8.110)
Maximizing J is a simple calculus problem (Exercise 8.11). We find that the maximum occurs at u = í*(ó), where v »
=
ba,
if 0 < σ< 1 -è;
(1-0)*,
ίÐ-0<ó<1.
(8.111)
Note, on setting a = 0 in (8.103) and using (8.105) and (8.111), that u* - v*(l), as required. The function v* is sketched in Fig. 8.10(a); the corresponding maximum expected utility, if 0 < σ <
Av») =
l-è;
(8.112) 0-g) if 1 -è < σ < 1, 2σ is sketched in Fig. 8.10(b) and the maximum expected normalized profit, z
è + σ(\-è)-^è , 2
E[R . (X)] V M
ifO<<7
=
(8.113) if 1 -è < σ < 1,
appears in Fig. 8.10(c). Thus, as σ -* 0, the buyer orders nothing and makes no profit (normalized profit Θ) but is perfectly happy because she has assigned no merit to any negative profit and full merit to any positive profit, however small, as is clear from Fig. 8.9(b) on taking the limit ó - » 0 . The moral in this is Thoreau's: happiest are those who desire least! As σ increases from zero, a buyer becomes more daring. The optimal order quantity increases and so does the expected profit, but the expected merit decreases. The more narrowly the buyer defines maximum satisfaction (by increasing σ) the less attainable it becomes. Figure 8.10 yields a qualitatively accurate portrayal of the effect of decreasing aversion to risk (increasing σ) on the optimal buying policy,
8.8
Choosin g a Utilit y Function . Cautiou s Attitude s t o Ris k
321
v*lb
Fig. 8.10 (a) Optimal order quantity (8.111) for a single period as a function of increasing risk, when demand is uniformly distributed between 0 and b and 1 - è = (p-c )l(p ). (b) Graph of 7(v*(
+C{
{σ)
though the corner in Fig. 8.10(a) would disappear if we chose a smoother merit function, like that drawn in Fig 8.9(a). Although our analysis of using the utility function to embody attitudes to risk has been deliberately simplified, it includes most of the important ideas. If you wish to pursue the
322
Chapte r 8
Usin g a Model : Choic e an d Estimatio n
matter further, however, then you should consult the literature on decision theory, which will indicate in particular how a buyer might be able to determine her personal (or her company's) value of σ. See, for example, the books by Holloway (1979) and Lindley (1985).
Exercise s 8.1 Verify (8.2). 8.2 Verify (8.4). 8.3 (i) Verify (8.9). Hint: Use the fact that f/(t)W) (ii) Verify (8.11).
= 0.18(1 - /)/3p(0)).
"8. 4 Use the method of Section 8.3 to devise a set of behavioral response functions for the fast-food restaurant model of Section 7.6. 8.5 (i) Verify (8.23)-(8.27). (ii) Suppose that the datum for 1850 (t = 6) is removed from the data set that was used to obtain (8.28). Show that the line that best fits the reduced data set, in the sense of Section 8.4, is closer than the line obtained in that section to the one that is drawn in Fig. 1.7. (Hi) Suppose that the data for the years 1840-1860 (5 < / < 7) are removed from the data set that was used to obtain (8.28). Show that the line that best fits the data, in the sense of Section 8.4, is closer even than (ii) to the line drawn in Fig. 1.7. (tv) Comment. *8.6 (i) Verify Table 8.5. (ii) Pine trees in a Scottish forest are grouped by girth into six classes, as described in Section 5.8. The following "data for a single census period are taken from Usher (1966, p. 361):
Girth Number of trees remaining Number of trees remaining class at start of period in class during period 0 1 2 3 4
4461 2926 1086 222 27
3214 2029 813 171 17
Use these data to estimate transition matrix S for the model of Section 5.8; i.e., estimate (5.93).
Exercise s
323
* 8.7 After up to four moves through a coronary unit, patient numbers at nine levels of health care are given below. The data set, which was used to obtain Table 8.8, is taken from Kao (1974, p. 688).
Level of care e cu
PCCU ICU MED SURG AMB ECF HOME DIED
0
Number of moves, η 1
2
471 0 7 0 349 2 0 4 8 64 0 9 0 2 3 0 3 3 0 0 25 0 3 341 0 46 73
3
4
0 12 0 0 0 0 26 360 73
0 0 0 0 0 0 27 369 75
(i) Using data for 1 < η < 3 only, find the best fit Markov model by using the procedure of Section 8.6 to estimate P. (ii) Compare your model's predictions for η = 4 with the observations. Note. For this exercise, you will need access to a nonlinear programming routine. Even if there is no suitable package in the computer library, there is almost certainly at least one faculty member somewhere on campus who can lend you such a package if you ask her nicely (the physics department is often a better bet than mathematics). Alternatively, you may wish to write your own.
* 8.8 There are numerous fields from which I could have drawn an example to illustrate the fitting of a two-parameter statistical model by the method of moments. Because I was thinking about elections while writing Section 8.7, however, the following sprang most readily to mind. As we saw in Section 8.7, only two political parties, Labour and the Conservatives, have governed the United Kingdom since World War II. As indicated by Table 8.12, Labour were elected to govern in 1945. The election was decided on the basis of 640 parliamentary constituencies (there are now only 635). From each constituency, a candidate was elected by simple majority to be a member of the House of Commons; and Labour enjoyed victory in the greater number of constituencies. There were 576 constituencies in which Labour and the Conservatives each fielded a candidate for Parliament. Of votes cast for either Labour or Conservative in these 576 constituencies, the proportions accruing to Labour were as follows, the data being taken from Kendall and Stuart (1950, p. 187):
324
Chapte r
Usin g a Model : Choic e an d Estimatio n
Proportion, χ 0.00 0.05 0.10 0.15 0.20 0.25 0.30 0.35 0.40 0.45
Number of constituencies
Proportion, χ 0.50 0.55 0.60 0.65 0.70 0.75 0.80 0.85 0.90 0.95
1 0 0 0 3 8 29 28 59 62
< χ < 0.05 < χ < 0.10 <x< 0.15 <x< 0.20 < χ < 0.25 < χ < 0.30 < χ < 0.35 < χ < 0.40 < χ < 0.45 < χ < 0.50
Number of constituencies
< χ < 0.55 < χ < 0.60 < χ < 0.65 < χ < 0.70 < χ < 0.75 < χ < 0.80 < χ < 0.85 < χ < 0.90 < χ < 0.95 < x < 1.00
64 89 90 60 37 19 20 5 2 0
Let the random variable X denote Labour's proportion of the vote, assumed identically distributed in each constituency. Use the method described in Section 8.7 to propose a statistical model for Xs distribution. Hint. At some stage, you will have to make an appropriate assumption or approximation because the above sample frequency distribution does not yield as much information as perhaps you would like. 8.9 Verify that the solution of the constrained nonlinear programming problem (8.97H8.98) occurs where u = (u,z) = (5/24,1/12). T
8.10 For the data in Table 8.10, find the maximum likelihood estimate of the parameter u in (8.100). 8.11 Verify the calculations in Section 8.8. **8.12 For what proportion of the 21st century will the president of the United States be a Democrat, for what proportion a Republican? Attempt to answer this question by choosing a known model and finding data to estimate its parameters. State any assumptions you make about voting behavior in the United States. *8.13 A chemical in solution occupies the region on either side of a porous membrane of thickness h. Assume that the solution on each side of the membrane is perfectly mixed, with φ denoting the concentration of chemical outside the membrane and φ\ the concentration inside. (i) In which direction will there be a flux of chemical if φ > φ 1 (ii) In which direction will there be a flux of chemical if φ > φ{1 (HQ Use a known model to suggest a general expression for the outward flux per unit area. Can you propose a suitable name for any new parameters) you introduce in this expression? What are the dimensions of the parameters)? 0
χ
0
0
Supplementar y Note s
325
(iv) The concentration of glucose inside a spherical cell with permeable wall of inner radius a is initially 10% of the concentration of glucose outside the cell. Write down a differential equation describing the subsequent uptake of glucose by the cell. To which known mathematical model does this equation correspond? Assuming that this glucose uptake does not affect the ambient concentration, deduce the time that elapses before the glucose concentration inside the cell reaches 90% of that outside (as a function of a, h, and any parameters) you have introduced). *8.14 An irreversible chain reaction between η reactants A , A , ..., A _ product A is represented symbolically by Q
x
N
{
and
N
A
0
—• Λ, —• A —• 2
•A_ N
t
—•
A. N
Let Xj(t) = [Aj] be the concentration of Aj at time / in moles per unit volume (of solvent), and let kj denote the forward rate of reaction from Aj to A (in moles per unit of time). Answer the following with the help of what you have learned about chemical dynamics in Sections 1.10 and 1.11. (i) Write down a set of differential equations that describes this chemical reaction. (ii) Which known set of equations from Part III is mathematically equivalent to this (deterministic) model? (iii) Why, however, will the previously calculated solution to those equations be incorrect for present circumstances? jJf
t
*8.15 In a United Kingdom general election on April 9, 1992 the Conservative party was returned to power. What, if any, effect does this result have on the statistical models in Section 8.7 for length of stay-in-office?
Supplementar y Note s 8.1 For values of ζ other than those appearing in Table 8.5, Z(z) can be estimated by using numerical interpolation. This is the process by which the graph of a function / = l(z) is approximated by polynomials that are constrained to pass through known data points, such as those appearing in Table 8.5. If / = l(z) is sufficiently smooth and if sufficient data are known, then arbitrary accuracy can be obtained by using polynomials of successively higher and higher order. Rarely, however, are both conditions satisfied; and in practice there is usually little justification for using polynomials of higher order than the third. Linear interpolation, i.e., use of a first order polynomial, is often adequate for practical purposes. Suppose, for example, that we wished to estimate /(4). The first order polynomial constrained to satisfy the data for ζ = 1 and ζ = 5 is clearly 1(1) + 0.25 χ {/(5) - /(1)}(ζ - 1). Because 1(1) = 0.98003 and /(5) = 0.97672, from Keyfitz and Flieger's data, we obtain 1(4) « 0.9775. Care is needed in selecting known data points. For example, the second order polynomial constrained to satisfy the data for ζ = 0, ζ = 1, and ζ = 5 is φ(ζ) = 0.2(z - l)(z - 5) + 0.25z{0.2/(5)(z - 1) - /(l)(z - 5)}.
326
Chapte r 8
Usin g a Model : Choic e an d Estimatio n
This yields /(4) « 0.9661, which is absurd, because it is lower than /(5), and clearly a worse approximation than previously obtained by linear interpolation. The absurdity arises because φ has positive curvature (everywhere); whereas / = /(z) has negative curvature at ζ = 4. Thus the quadratic polynomial does not adequately model the survival probability. We have made a poor choice of three data points through which to constrain the quadratic to pass. We should have begun by selecting the nearest datum to ζ = 4 (i.e., ζ = 5), then the nearest on the other side of ζ = 4 (i.e., ζ = 1), then the next nearest on the other side again (z = 10). The quadratic polynomial that satisfies the data for ζ = 1, ζ = 5, and ζ = 10 is clearly rUl )(z - 5)(z - 10) - -U5)(z - l)(z - 10) + ^/(10)(z - l)(z - 5). 36 20 45 Because 1(10) = 0.97493, this yields the approximation /(4) w 0.9774; and you would probably agree that any additional accuracy is scarcely worth the extra labor of computation. For an extended description of the leapfrogging scheme suggested above and the efficient Newtonian scheme for computing interpolants, see Maron (1982). An unfortunate (though understandable) omission from Maron's text is that of Aitken interpolation, for which see Frfiberg (1969).
— BUILDIN G A MODEL: if ADAPTING , EXTENDING, AND COMBINING
The models encountered in Parts I to III, though useful and important, are but a small fraction of known mathematical models and an even smaller fraction of all the models there could be. Then what do you do if you meet a problem to which none of these models applies? By and large, there are only three things you can do: adapt, extend, or combine. First, you may recognize that the new problem resembles an old problem in some abstract way, as though the old one had merely donned a fresh disguise. Then the old model can be adapted to your present purpose. The plant model of Section 1.3 and the population model of Section 1.9 are just two adaptations of the same logistic growth model. The momentum flux law of Section 2.6 is an adaptation of the temperature flux law of Section 2.5. And in Section 5.6 we adapted the idea of a metered model to a probabilistic view. You've seen several other examples of adaptations. How many can you recall? Second, you may recognize that today's problem, although having new features, also has features in common with yesterday's. Then yesterday's model can be extended to account for the new ones. The model of bird flight in Section 3.1 is an extension of the equilibrium rowing model of Section 2.2 (to account for induced power losses). The model was further extended in Chapter 4 to account for a tailwind. And a Markov chain can be viewed as an extension of a birth and death chain. You've seen several other examples of extensions. See how many you can recall (don't forget the exercises). Third, you may recognize that different aspects of today's problem are separately covered by models you know. Then the known models can be combined. The traffic model of Section 4.7 is a combination of two quite separate assumptions about the way that drivers brake and accelerate. The growth/harvest model in Exercise 1.12 is a combination of a pure growth model and the pure harvesting model of the previous exercise. And, of 327
328
Chapte r 9
Buildin g a Model : Adapting , Extending , an d Combinin g
course, the classic example of a combination is that of a metered model. Again, can you think of others? If you had paused in class to recall such examples then you would have been bound to discover that one person's combination is another person's extension or adaptation. Indeed experienced modellers adapt, extend, and combine simultaneously. They neither are aware of which label most aptly describes what they are doing, nor consider it especially useful to know. But while you are learning, the labels, though subjective, are useful. Moreover, although all are part of improving a model, I reserve that phrase for critical mode, when you review your model with the eyes of a harsh parent. We are switching to creative mode, so put validation out of your mind, for now is the time to play and experiment. You can always validate your models later; then, but only then, it's compulsory. Remember, too, that modelling is fraught with trial and error. Don't give up easily, and be disposed to learning from your mistakes. But what if, after so much effort, all three options fail? Well, I suppose you could ask your professor. But you may not need to if you study the following examples well!
9.1
How Many Paper s Shoul d a News Vendo r Buy ? An Adaptatio n
In the simplest circumstances, adapting a model hardly differs from using a known one. Nevertheless, understanding the simplest adaptations is an important step toward understanding more complex ones. Suppose that you're selling newspapers on the corner of a street in a large city. Every day you buy quantity u; the cost is c cents per paper. You sell as many as you can for price p; this demand, Z , is a random variable. At the end of the day, you are able to return the unsold papers to the distributor; the unit salvage price is s cents. How many papers should you order each day? This ought to remind you of the rose vendor in Section 7.2. In one sense, the problem is just as simple: there are no holding costs. A day is too short to worry about unearned interest, the stock is hardly worth insuring; and if you need an extra bit of sidewalk for stacking the newspapers early in the morning, then it's absolutely free of rent. But, in another sense, the problem is more difficult: no mention was made in Chapter 7 of a salvage price. Does this mean that you need a new model? The answer is no, for a moment's thought reveals that a salvage price at the end of the day is mathematically equivalent to a negative holding cost, at the end of the time unit in the model of Section 7.1. Hence, on setting c, = -s, the optimal daily order u* can be immediately deduced 0
9.2
Whic h Tree s In a Fores t Shoul d b e Felled ? A Combinatio n
329
from (7.12) as the solution of the equation r
c A
z
)
d
z
=
A Z l .
(9.!)
Note that the right-hand side must lie between 0 and 1 because s < c < ρ (why?). Then, assuming that the delivery cost is k = 0, the optimal reward is 0
J(u') = (p-s)
Γ Jo
zRz)dz,
(9.2)
on using (7.12). For an application of this result, see Exercise 9.1.
9.2
Whic h Trees in a Fores t Shoul d be Felled ? A Combinatio n
In Sections 3.4 and 4.8, we calculated an optimal rotation time for a forest, denoted by s*. We assumed that a forest had Ν trees at any given time and that their ages were identical, because they had been planted at the same time. At the end of each 5*-year cycle, or rotation, the forest was completely harvested, then replanted. The value of the parameter s* was found to be of the order of 50 years or more. Thus the forest yielded income only once or twice a century. What would a forester do if he needed income from the forest more frequently; say, every σ years, where σ is much smaller than s*l A possible option would be to harvest Η trees every σ years and plant Η replacements at the same time, so that the number of trees in the forest would remain constant. In this way, the forester would derive an income every σ years. By keeping the size of the forest constant, he could hope to sustain this income indefinitely. Let's assume that the parameter σ is already known. Then the problem the forester faces is, in some respects, the mirror image of that encountered in Sections 3.2 and 4.8. There, the forester knew how many trees to fell, namely, the entire forest; the question was when. Here, the forester knows when to cut, namely, every σ years; the question is which and how many. Don't forget that, by assumption, if the forester knows how many trees to fell, then he also knows how many to plant. Now, if the forester genuinely hopes to derive a sustained income, then it is not enough merely to keep the size of the whole forest constant. The foresters in Chapters 3 and 4 did that and rarely saw an income. The problem there was that, because the trees were equal in age, trees hardly ever reached the age for felling (but then all together). Thus our new forester must keep trees of several sizes (and hence ages) in his forest, so that some of them will always be ripe for cutting. For the sake of definiteness, and because age and size are not quite the same thing, we will assume
330
Chapte r 9
Buildin g a Model : Adapting , Extending , an d Combinin g
henceforward that our forester classifies trees according to girth. Thus a balanced girth distribution must be maintained, so that after each harvest, enough trees remain of sufficient girth as to reach harvestable girth σ years later. The easiest way to maintain this balance is to keep a fixed number of trees in each class. To be quite specific, let's suppose that there are Ν + 1 girth classes, labelled ι = 0, 1, 2, N, where /' increases with girth; i = 0 is the "seedling" class, consisting of trees that have just been planted, and i = Ν corresponds to maximum girth. This means that we cannot use Ν to denote the total number of trees. Let's denote it by Μ instead. Let each σ years correspond to a unit of time, and let «,·(/) denote the proportion of trees in class ι at the beginning of cycle / + 1 (so that Μu,{l) is the actual number in class /). Then, by definition,
-<)= • /
1
(9.3)
At the end of each cycle, to maintain the girth balance the forester must restore each class to the size it had at the beginning of that cycle. In other words, the forest must satisfy < = 0,1,2
«,(/) = « , ( / + ! ) ,
N,
/ = 0,1,2,....
(9.4)
Let's take a look at what happens during cycle / + 1, i.e., during the interval / < t < / + 1. For most of this time—i.e., during the interval / < t < I + 1 - €, where e is very small—the trees are simply growing. It is possible that during this period, some trees grow enough to move from one girth class into the one above. Hence the proportion of trees in class ú at time t, denoted by u,(i), will not remain constant throughout / < t < I + 1 - c. In particular, «,·(/ + 1 - e) will not be the same as «,·(/)· Therefore, let's denote «,·(/ + 1 - e) by 7,, 0 < i < N. Just before the beginning of cycle i+2, the forester harvests Η trees. Let v- denote the proportion of trees taken from class i, 1 < / < N, so that HVj is the actual number taken. We will assume that no trees are harvested from the seedling class (or, if you prefer, v = 0). Note that v, + v + · · · + v = 1. At the same time as these trees are harvested, the forester adds Η trees to the seedling class i - 0. The combined effect of this harvesting and replanting is to keep both the girth distribution and the total number of trees in the forest constant. In other words: (
0
2
Mj + H = Mu ; Mfj-Ην - Muj, 0
N
(9.5a)
0
(
1
(9.5b)
Let us define (N + l)-dimensional column vectors 7 , v, r, and u by 7 = (7 .7Ø 7ΛΓ) . r = /f(l,0,0,...,0) , Γ
r
v = (0,v,,...,v^) , u= (u ,u ,...,u ) . r
T
0
l
s
(9.6)
9.2
Whic h Tree s in a Fores t Shoul d b e Felled ? A Combinatio n
331
Then (9.5) may be written in vector form as Mf -
HY + T
= Mu.
(9.7)
The first term in (9.7) represents the girth distribution after growth (during the interval / < / < / + 1 - e), the second term harvesting, the third term replanting. The term on the right-hand side of the equality represents the restored girth distribution. Our new harvesting model is essentially a metered model like the ones we met in Sections 1.7 and 1.8. The long-term dynamics are described by (9.4)—if dynamics is the right word because, in the long term, the forest is kept in static equilibrium! To describe the short-term dynamics, let us agree to dub a vector like Λ/u a tree-count vector, because each entry records a number of trees in each class (whereas entries of u record proportions). Then, if Y is used to denote the tree-count vector within each cycle, the initial tree-count vector is Y = Mu. As a result of growth, the tree-count vector changes to Y = Mf. As a result of harvesting, the tree-count vector changes to Y = Y - H\. As a result of replanting, the tree-count vector changes to Y = Y + r. This is the final tree-count vector within each cycle; hence Y = Mu. Eliminating Y , \ , and Y from these relations, we obtain once more (9.7). To continue our study, we need an expression for -ã in terms of u (or, which is the same thing, for Y in terms of Y). In other words, we need an expression for the girth distribution after one cycle of pure growth (no harvesting) in terms of the girth distribution at the beginning of that cycle. Now, we have already seen a model for pure tree growth, namely, the one introduced in Section 5.8. We may therefore wonder whether the latter model can be combined with (9.7) to yield an expression for u. In Section 5.8, the cycle was six years long (ó = 6) and there were six girth classes (N = 5); which therefore, henceforward, we assume. We predicted that if *•(/) denoted the girth distribution after / cycles, then the girth distribution after / + I cycles would be i r ( / + t), where ir(/ + l ) = ir([) S and the matrix S is defined by fl
0
B
c
B
c
a
b
c
e
r
T
S =
<*0 1 -a 0 0 0 0 0 0 0 0 0
0
0 1-fl, «2
0 0 0
0 0 l-a
0 0 0
2
l0 0
f l 3
0
0 0 0 0 l-a I
(9.8) 4
Strictly, π(ί) is a probability distribution vector. If Μ is large, however, then it is reasonable to interpret jr,(/) as the proportion of forest actually observed in class ί at time /. With this interpretation, we may identify u with π(/) and 7 with *•(/ + l). In other words, we may suppose that one
332
Chapte r 9
Buildin g a Model : Adapting , Extending , an d Combinin g
cycle of pure growth is described by the equation t using (9.8), we obtain
= u S. Thus, on
T
T
7o = #0 0> 7/ = 0 - flf-1)"/-1
+ a,u„
1 < i < 4,
(9.9)
7 = (1 - a ) « + « . 5
4
4
5
From (9.5b) with Ν = 5, / / í , = Affr,- - «,·) trees must be harvested from class i, 1 < /' < 5, to keep the girth distribution stationary. Hence, on using (9.9), we get o,_,)«,_, - ( 1 - « , ) « , } ,
Ην, = M{(1-
1 < ι < 4,
Hv = M(l - â ) κ . 4
s
4
Clearly, we cannot take a negative harvest from classes 1 to 5 because trees can be added only to class 0. Thus í,· > 0, 1 < i < 5, implying in particular that ( 1 - â , _ ι ) « / _ , - ( 1 - « , ) « , > 0,
1 < i < 4.
(9.11)
v
Subject to this constraint, the total harvest is (verify) 5
=
= Λ/(1-α )"ο·
(9-12)
0
1=1
(You can also obtain this result from (9.5a) and (9.9) as Η = M(u - 7 ) = M(l - α )« ·) Let's now assume that the matrix S corresponds to a = 0.72, a, = 0.69, a = 0.75, a = 0.77, and a = 0.63, i.e., the values obtained in Exercise 8.6 and used in Section 5.8. Then, on using (9.3), (9.11), and (9.12), the sustainable harvest every six years is 0
0
0
0
0
3
2
4
0.28MM
(9.13)
0
subject to - 0 . 2 8 u + 0 . 3 l M j < 0, 0
-0.31w, + 0.25u < 0, 2
(9.14)
- 0 . 2 5 « + 0.23« < 0, 2
3
- 0 . 2 3 u + 0.37u < 0, 3
4
t / + M , + U + Wj + M + U 5 = 1, 0
2
(9.15)
4
and, of course, «o>°'
«i>0,
M >0, 2
u >0, 3
w >0, 4
M > 0.(9.16) 5
We conclude immediately that the sustainable harvest is not unique. The girth balance of the forest could be maintained, for example, either
9.2
333
Whic h Trees In a Fores t Shoul d b e Felled ? A Combinatio n
by the distribution u = (0.25,0.2,0.2,0.2,0.1,0.05) "
(9.17)
7
or by the distribution u = (0.3,0.2,0.15,0.15,0.05,0.15) .
(9.18)
r
Distribution (9.17) would yield a total harvest of 0.0ΊΜ trees every six years, with harvest vector Hv = M(0,0.008,0.012,0.004,0.009,0.037) ",
(9.19)
7
and (9.18) would sustain a total harvest of 0.084M trees, with harvest vector H\ = Af(0,0.022,0.0245,0.003,0.016,0.0185) .
(9.20)
r
You should verify that (9.17H9.20) satisfy (9.10) and (9.12M9.16). Now, although (9.18) sustains a greater yield than (9.17), it may not be a more profitable distribution because trees in girth class 5 have the most commercial value, and (9.19) has twice as many trees in this class as (9.20). Moreover, there may be distributions that are more profitable than either. How, then, shall we determine the most profitable of all possible distributions satisfying (9.14)-(9.16)? Let p, denote the selling price of a tree from class i, and c, the cost of felling it and planting a replacement. Let pi = pi - Ci denote profit per tree. Then the profit from each harvest is 5
4
/= 1
/= 1 4
= Y^PiM {(1 - fl,-_,)«,_, - (1 - a,)u } + p M(l t
-
5
a )u A
4
1=1
= Μ |
P l
( l - a )u 0
0
+ Σ(Ρί+ι ~ P/Xl - «,)",} .
(9.21)
on using (9.10) and rearranging. Suppose, for example, that only trees in class 5 have commercial value. Then ñ = pi - Pi ~ PA 0. thai (9.21) reduces to Áίñ (1 — a ) H = 0.37Mp n . Even though we do not know its value, 0.37Μp is just a constant. Multiplication by a constant does not alter the values of the variables for which a utility function obtains its maximum. Hence the problem facing our forester is equivalent to the following optimization problem: find u = («ο, «i, « 2. " 3 . " 4 . « s ) which maximizes =
s o
ã
5
4
5
4
4
5
r
/(u) = J(M , M, , M , u , w , M ) = w 0
2
3
4
5
4
(9.22)
subject to constraints (9.14)-(9.16). By writing down the relevant matrix of coefficients A, and column vectors b and c, you can easily verify that this problem belongs to the class of linear programming problems discussed in Section 3.2. The optimal value of u, i.e., u*, can thus be obtained by
334
Chapte r 9
Buildin g a Model : Adapting , Extending , an d Combinin g
using a computer package like IMSL's ZX3LP. On using this program, or a similar one, you will easily find that u* = (0.2001,0.1807,0.2241,0.2436,0.1514,0) , r
(9.23)
with /(u* ) = 0.1514. Notice that we avoided calling u a control because the forester cannot control the number of trees in each class directly. Rather, he controls these quantities indirectly, through harvesting and planting. Of greater interest, therefore, is the optimal harvest vector Hv*. From (9.10) and (9.23) we obtain Hv* = (0,0,0,0,0,0.056Λ/) ". 7
(9.24)
Thus the forester's optimal policy is to have no trees in girth class 5 at the beginning of a cycle and harvest all trees that have entered class 5 by the end of the cycle. The associated harvest 0.056Λ/ is the one that maximizes the forester's profit. If trees in class 5 are the only ones with commercial value, then it isn't surprising that the optimal policy is one in which only trees in class 5 are harvested. It is surprising, however, that, if trees in class 4 yield more than a certain fraction of the profit from those in class 5, then the optimal policy is to harvest all trees when they enter class 4; and thus, by preventing trees from ever entering class 5, to ignore completely the commercial value of the latter. Or is it? See Exercise 9.2.
9.3
Cleanin g Lak e Ontario . An Adaptatio n
In Section 1.1, we constructed a model that predicted how pollution would decay in a lake if all pollution input had suddenly ceased. Let x(t) denote the concentration of contaminant at time t, V the lake volume (assumed constant), and r the flux of water through the lake, i.e., the volume of water that flows in or out per unit of time. Then the model of Section 1.1 predicts that x(t) = x(0)e-" , T
(9.25)
where Τ = Vlr is the drainage time—i.e., the time it would take the water to flow away at rate r if water inflow suddenly ceased. Where does all this pollutant go? It flows out of the lake at the rate -^• {Vx{.t)) t
= rx{t),
(9.26)
on using (9.25), or on using (9.28) below with zero pollution inflow. We might, for example, apply this model to Lake Erie. Then, if we use a subscript Å to denote Lake Erie, our model predicts that its pollution flows away at the rate r x (t), where E
E
x «) = x (0)e-« * T
E
t
(9.27)
9.3
Cleanin g Lak e Ontario . A n Adaptatio n
335
and Γ = V /r is the drainage time for Lake Erie. From Section 1.1, Γ is approximately 2.6 years. We have already seen in Section 4.2, however, that (9.25) cannot be applied to Lake Ontario, even if, as we shall assume, all pollution inflow to the Great Lakes as a whole has ceased. This is because the pollution that was already in Lake Erie will continue to flow into Lake Ontario. Because the existing model cannot be used, let's therefore adapt the model Å
E
Å
E
Rate of chang e _ Pollutio n _ Pollutio n of pollutio n ~~ inflo w outflo w
j {Vxit))
=
t
?
-
(9 28)
rx{t)
to our present purpose. In this equation, x(t) now denotes concentration of contaminant in Lake Ontario, f i t s volume, and r its water outflow. We will assume that the water inflow to Lake Ontario (including rainfall) balances the water outflow (including evaporation), so that the water inflow is also τ. We know from Section 4.2 that 5/6 of this inflow is the outflow from Lake Erie; i.e., r = 5r/6. The pollution outflow from Erie is r x (f)> and so the pollution inflow to Ontario must be r x (f) = 5rx (f)/6. We can therefore replace the question mark in (9.28) by 5rx (i)/6. Dividing by r, we thus obtain the equation E
E
E
E
E
E
E
(9.29)
T~+x=^(t),
where Τ = VI r is the drainage time for Lake Ontario. From Section 4.2, Τ is about 7.8 years. On using (9.27), the solution of this differential equation is (Exercise 9.3) x{t) = e~" jx(0) -
- 1)} ·
{e - ™
T
(UT l
(9.30)
Let's assume that Τ = 3 T , which is an excellent approximation, and define E
A _
Xg(0) x(0)-
(
y
i
U
We thus obtain x«) = xiO)e-"
T
{1+ ^
(1 - e- " )} 2
T
.
(9.32)
We do not know the value of λ, but Erie is more polluted than Ontario, so that λ > 1. Let / denote the 5% cleaning time for Lake Ontario—i.e., the time it takes to reduce x(t) to 0.05x(0)—and define a 0 5
ζ = e- ' . 100 17
(9.33)
336
Chapter 9
Bullding a Model: Adapting, Extending, and Combining
Fig. 9.1 Graphical determination of ζ*(λ). Then 0 < z < 1, and from (9.32), 5λ 7Λ<*
12
- l ) = l - *20r s z"
(9.34)
It is clear from Fig. 9.1 that this equation has a single solution, z \ satisfying 0 < z* < 1. For any given λ, it can be found numerically by the Newton-Raphson method. In this way, we can determine /0.05 = -7.81η(ζ*(λ))
(9.35)
as a function of Λ. The results are shown in Table 9.1 for values of A between 1 and 2. Notice, however, from Fig. 9.1 that z* is small and gets smaller and smaller as A increases. For larger A, therefore, it is quite permissible to ignore the term z2 in (9.34) on the grounds that it is negligibly small.
Table 9.1 Five percent cleaning times for Lake Ontario, rounded to three significant figures.
A
Ό.05
1.0 1.2 1.4 1.6 1.8 2.0
26.1 26.5 26.9 27.3 27.7 28.1
9.4
Cleanin g Lak e Ontario . A n Extensio n
337
Then (9.34) is easy to solve and yields / .05 = -7.8In(2*(A))« 7 . 8 1 n |
5 ( 5 A
0
+ 1 2 ) 3
|.
(9.36)
You can easily check that this approximation is acceptable even for the low values of A in Table 9.1. (Note that the table appears to suggest a linear relationship dt /d\ = 2, but this is an illusion caused by rounding. From (9.36) we obtain directly that dt ld\ * 7.8/(A + 2.4). To one significant figure, this equals 2 for any A satisfying 1 < A < 2.) 005
QS)5
9.4
Cleanin g Lak e Ontario . An Extensio n
In the previous section we tacitly assumed that pollution was uniform throughout our lake at any given time. But might not pollution vary in intensity from one end of the lake to the other? We can extend our model to allow for this possibility. Before doing so, we remark once again that the creative process of extending a model may be hindered in the early stages by undue attention to validation. Therefore we shall assume freely, suspending judgment upon those assumptions until the end of the section. Consider, therefore, a lake with constant vertical cross section A, occupying the region a < ζ < b. Thus the length of the lake is b - a, and any horizontal section is rectangular (Fig. 9.2). The primary inflow of water is at 2 = a, and the primary outflow is at ζ = b. The concentration of contaminant (in grams per cubic meter, say) at time t now also depends upon z, and so we will denote it by φ(ζ, t). Let F(z, t) denote the flow (or "flux") of pollution at station ζ at time t, i.e., the amount of pollution (in grams) that crosses the section of area A in a unit of time. Let Q(z, t) be the horizontal water flux—i.e., the volume of water (in cubic meters) that crosses the section of area A per unit of time—in the direction of increasing z. Because the volume crossing per unit of time is simply the velocity of water times the cross-sectional area of the lake, the flow velocity is given by v(z,i)=^j^-
(9.37)
Primar y inflow
Fig. 9.2 Ideal lake occupying a < ζ < b. Vertical cross section A is constant. Any horizontal cross section is rectangular.
338
Chapte r 9
Buildin g a Model : Adapting , Extending , an d Combinin g
Moreover, a moment's thought reveals that _, . . Flux of pollutio n ... = per unit of tim e
F(z,t)
Amoun t of ^ pollutio n perunr t . . . volum e of water
... . . Volum e of water ., . flowin g per unit of tim e
φ(ζ,Þ
QHz,t)
u
=
(9.38) ’
/ n v
for all z(a < ζ < b) and all /(> 0). The volume of water contained in the infinitesimal interval from ζ \äζ to z + 5<5z isASz. Hence the amount of pollution contained therein is Αäζ {φ(ζ, Þ + 0{äζ)} = Αφ(ζ, Þäζ + ο(äζ), on using the notation introduced at the beginning of Chapter 1. Thus the amount of pollution in the entire lake is *(/)=
(9.39)
(Αφ{ζ,ΐ)Üζ,
Ja
the error terms vanishing during the limit process of integration. Instead of (9.28) we obtain Rate of chang e _ Pollutio n of pollutio n inflo w
Pollutio n outflo w
-
r b
j f t
Αφ(ζ,ÞÜζ=
F(a,t)
-
(9-40)
F(b,t).
We use the symbol dldt in place oidfdt for differentiation with respect to time, because the quantities involved now also depend upon z. Similarly, we shall use dldz in place ofd/dz to denote differentiation with respect to z. On using Leibnitz's rule, we deduce from (9.40) that
whence
Now imagine the lake to consist of many sublakes, each with the same cross-sectional area A; and let a typical sublake stretch from ζ = z - f to ζ - z + (. The entire argument that led to (9.42) is also valid for the sublake; hence 0
0
If φ{ζ, t) has continuous derivatives at ζ = z , then the only way in which (9.43) can remain true in the limit as e —• 0 is for the integrand to vanish at ζ = z . For let ω(ζ, t) = Αèφ(ζ, t)ldt + dF(z, t)ldz. Then we wish 0
0
9.4
Cleanin g Lak e Ontario . A n Extensio n
339
to show that ù(ζο, t) = 0. Suppose w(zo, t) Φ 0. Then either ù(ζο, t) > 0 or ù(ζο, 0 < 0. If ù(ζο, t) > 0 then, because ù is continuous, there exists η > 0 such that ζο-η<ζ<ζο + η implies ù(ζ, t) > 0. Choose 0 < e < η, permissible in the limit as e - » 0 . Then the left-hand side of (9.43) is positive, a contradiction. For ù(ζο, t) < 0, the argument above can be repeated with -ù in place of ù. We thus establish that ù(ζο, t) = 0. But Zo is arbitrary. Hence A 4- + — = 0 at oz or on using (9.38), d
for all a < ζ < b, 0 < t < oo,
(9.44)
ΊΓ. + 7ª (0*) = 0. α< ζ < 0 < r < oo. (9.45) oz In practice, <£(z, 0 may be discontinuous across isolated curves in the z-t plane, but (9.44) is still valid everywhere between those curves. (An example is provided by the solid curves in Fig. 9.4, for which φ(ζ, Þ is discontinuous across the curve ζ = vt in the z-t plane.) Equation (9.45) is a partial differential equation for φ(ζ, t), whose solution can be found once Q(z, t) has been specified. For partial differential equations, as for ordinary differential equations, initial or boundary conditions are needed to make the solution unique. In this particular case, it is sufficient to prescribe the boundary values φ(α, t) and the initial values Ö(ζ,0). To make matters simple, let's assume that Α
(2(z, t) = R = constant,
(9.46)
for all a < ζ < b and 0 < t < oo. Now, the primary inflow to Lake Ontario is from Lake Erie, through the Niagara river. Let this inflow correspond to ζ = a, and let the lake's discharge into the St. Lawrence River correspond to ζ = b. Then, from (9.38), (9.46), and Section 9.3, the pollution inflow to Ontario is r x (t) = F(a, t) = Êφ(α, t); whence E
E
(9.47)
φ(α,ί)=^ψ^.
All we know about existing pollution levels is that Erie is more polluted than Ontario. Therefore, we simply define (9.48)
φ(ζ,0) = Ρ(ζ) and assume that P(z) < jc (0), e
(9.49)
a
The solution of (9.45) subject to (9.46)-(9.48) is (Exercise 9.5) _ r -^x (t - A(z - a)IR), r
E
Ö(Æ, t) =[p( _ z
R ( / A ) )
if t > A(z — a)IR; j
f t
<
_
a
)
/ R
(9.50a) ( 9
5
Q
b )
340
Chapte r 9
Buildin g a Model : Adapting , Extending , an d Combinin g
In practice, we would expect φ{ζ, t) to be continuous everywhere, including and either of the two strict inequalities ζ = α; thus P(a) = r x (0)/R, in (9.50) can be interpreted as a weak one. In theory, however, the wave phenomena apparent in Fig. 9.4 do not require the continuity of φ at ζ = a. (In Fig. 11.5 and Fig. 11.3, for example, φ(ζ, t) and v(z, t) are discontinuous across the curve ζ = v / . ) Now the volume of the lake a < ζ < b is V = Αφ - a), so that the drainage time is VIR = Αφ - a)/R. The cleaning time is bound to exceed this, and hence exceeds A(z-a)IR for any value of z. Thus the 5% cleaning time will be obtained from (9.50a), or on using (9.27), from E
£
m w
^z,0=^H(0)exp{-
( <
-^ -
a ) / J ? )
E
},
(9.51)
where t > A(z - a)IR. Notice that (9.51) is an increasing function of z. Thus the 5% cleaning time, which varies with z, will be longest at the St. Lawrence end, ζ = b. The longest time is perhaps the one that is most of interest to environmentalists. Therefore, let's denote by / 5 the time it takes to reduce φφ, t) to 5% of its initial value φφ, 0) = Ρφ). Then, from (9.51), we have 0 0
(9.52)
0.05TO = ^ ( ) e x p { - ^ 5 ^ ) | , E
0
which on defining (9 53)
u=*<® yields
.
i 0
O 5
=£ r ln(^p). +
(9.54)
E
Note that μ > I from (9.49). Now we have been assuming all along that total (horizontal and vertical) water inflow balances total water outflow; both are equal to the constant r. But we have assumed in this section that the horizontal water flow is also a constant, namely, R. We are therefore obliged to assume that rainfall and evaporation are both equal to r - R. Moreover, if we assume that the only river inflow to Lake Ontario is from Lake Erie, then we are also obliged to assume that r = R; otherwise (9.46) would be false at ζ = a. Thus R = r = 5r/6, and (9.54) becomes E
E
ίο.ο =^+Γ 1ç(20ì), 5
(9.55)
Å
where Τ = Vlr is the Ontario draining time. Because Τ = 3 Γ from Section 9.3, (9.55) is approximately Å
i o . = (2.2 + i l n p ) r . 05
(9.56)
9.4
Cleanin g Lak e Ontario . A n Extensio n
341
Comparison with the model of the previous section is facilitated by assuming that P{z) = constant. Then the parameter μ defined by (9.53) is identical to the parameter λ defined by (9.31). When we divide (9.56) by (9.36), the ratio of the later model's 5% cleaning time to that of the previous section is 2.2+ilnA
A(A)
=tajpiTT2)) ’
<9
•
5 7)
which is tabulated in Table 9.2 for values of λ between 1 and 8. Notice how slowly this function varies: its value never differs much from 2/3 for moderate values of A. Hence, even though we have no information about A (other than A > 1), we can say with confidence that cleaning Lake Ontario according to the model of the present section is always about a third faster than cleaning it according to the model of Section 9.3. But why should this be so? Why, moreover, should the cleaning time predicted by (9.56) be smaller than even the cleaning time predicted by the model we rejected in Section 4.2, for moderate values of A(l < A < 11)? The answer is that the slower cleaning of Section 9.3 is due to the assumption of perfect mixing, which makes φ independent of z. To understand this, let us consider the ideal lake of length 4v meters depicted in Fig. 9.3, where í = RIA is the velocity of water. In a unit of time, water travels í meters to the right. We will assume that pollution input has ceased but that, initially, each í meters of lake contains 16 grams of pollutant. Pollution levels are then recorded at the end of each unit of time. In the left-hand column of Fig. 9.3 it is assumed that immediately before a reading is taken—i.e., immediately after the pollution in the last í meters of lake has been lost—a magic stick swoops down from the sky and stirs the lake perfectly. In the right-hand column of the figure, no such mixing occurs. You can readily see that in the first case the lake will never be completely clean and will Table 9.2 A
Ä(λ)
1.0 1.5 2.0 2.5 3.0 3.5 4.0 5.0 6.0 7.0 8.0
0.658 0.671 0.675 0.675 0.674 0.672 0.669 0.664 0.658 0.653 0.648
342
Chapte r 9
Buildin g a Model : Adapting , Extending , an d Combinin g
Perfect mixin g
Zero mixin g
16
16
16
16
(=0
16
16
16
16
12
12
12
12
t= 1
0
16
16
16
9
9
9
9
1=2
0
0
16
16
6.75 6.75 6.75 6.75
1=3
0
0
0
16
5.06 5.06 5.06 5.06
t=
0
0
0
0
4
-* •
Fig. 9.3 The difference in cleaning time between an unmixed lake (right-hand column) and one that is perfectly mixed. The lake is assumed to be 4v meters long; water flows to the right; and the numbers in the boxes represent the amounts of pollution in lengths of í meters. take a long time (11 time units, see Exercise 9.6) to reach a lower pollution level than 5% of the initial one. In the second case, however, the lake is completely clean after only 4 time units. The diagram further suggests that in the absence of fresh pollution, a lake of length b- a meters should be absolutely clean after a time ί .ο = Φ - o)tv = Mb - a)IR if no mixing takes place. We can verify this by supposing that the pollution input from Lake Erie to Ontario can magically be prevented (x = 0). Then, according to (9.50), 0
E
P(z - vt),
if t < ζ - a
0,
ifr >
z-a
(9.58)
so that there are no positive values of φ for t > t . We have made our first encounter with an important phenomenon, namely, that of a propagating wave. In (9.58) we have the simplest example of a wave that propagates with velocity í in the direction of increasing z. For the initial pollution level at ζ = z is P(z ). According to (9.58), the same pollution level will subsequently be found wherever P(z-vt) = P(z ), i.e., wherever ζ - vt = z or ζ = vt + z . But this is just the equation of motion that the cross section ζ = z would have if it moved to the right with velocity v. The effect is illustrated in Fig. 9.4 by the solid curves for an 00
0
0
Q
0
Q
0
9.4
Cleanin g Lak e Ontario . A n Extensio n
343
XT
z=a
r = 0.5(« + />)
z=b
Fig. 9.4 Seven "photographs" of the pollution distribution in the lake a < ζ < b, taken at times j{b-a)/6v for j = 0, 1,..., 6; ζ increases to the right; time increases upward. The solid curves alone are a pictorial representation of (9.58). The dashed curves and solid curves together are a pictorial representation of (9.50).
arbitrary humpbacked initial pollution distribution P(z). Equation (9.50) is also that of a wave propagating to the right with velocity í because (9.50) is also a function of the single argument ζ - vt (you should satisfy yourself that this is so). It is represented pictorially in Fig. 9.4 by a series of "photographs," the first taken at / = 0 and the later ones every (b-a)/6v units of time. See how Ontario's old pollution (solid curve) is convected out at velocity v, dragging behind it the fresh pollution (dashed curve) that is decaying in Lake Erie. The real Lake Ontario is crudely sketched in Fig. 9.5. Its horizontal section is not rectangular, and its vertical section is not constant. Moreover, according to the article on the Great Lakes in Encyclopaedia Britannica by Professor Beeton, only 26 of Ontario's 34 inches of annual rainfall evaporate, so that rainfall and evaporation cannot both be equal to r/6. Does this mean that our model is useless?
344
Chapter 9
Bullding a Model: Adapting, Extending, and Combining
Si. Lawrence River
Depth {meierst Dry land Niagara River
0-100 100-200 100 ■ 250
Fig. 9.5 Cartoon map of Lake Ontario (sketched freehand after the map of Ontario in the Great Lakes article in Encyclopaedia Britannica).
Of course not. It simply means that predictions from the model must be applied with caution and that further refinements are desirable; and this statement will always be true, no matter how much the model is refined and tested. Some refinements are quite straightforward and are broached in Exercise 9.7. Other refinements are more involved but are broached in Chapter 11. Still further requirements are possible but lie far beyond the scope of this text. What about our expectation in Section 1.1 that poor mixing would prolong the cleaning? Has this been scotched by the present model with zero mixing? By no means. A lake that is fed by, and discharges into, a major river will have strong central currents sandwiched between more sluggish regions where water recirculates. A speculative rectangle has been superimposed on Fig. 9.5 to denote the region of strong centralflow.Cleaning would be rapid here and might well be adequately modelled by (9.54) if we took Fin that formula to denote the volume of the sublake corresponding to the rectangle. Because of poor mixing between this region and the more sluggish outer ones, however, the pollution in the outer regions can escape only by "diffusing" (a slow process, Section 9.5) into the central core and being swept out—so that these regions take longer to clean than if the lake were thoroughly mixed. We remarkfinallyon a further distinction between the present model and that of Section 9.3. There, horizontal fluxes of water could not be distinguished from vertical ones, so that pollution could escape by evaporation. Here, thefluxesare separated, so that pollution can escape only by river. In this respect, the present model is definitely an improvement, because most pollutants are known not to leave with water vapor, the major exception being DDT; see, for example, Harte (1985, p. 37).
9.5
9.5
Pur e Diffusio n of Pollutants . A Combinatio n
345
Pur e Diffusio n of Pollutants . A Combinatio n
Toward the end of the previous section we remarked that lakes may have strong central currents sandwiched between more sluggish flows, with minimal mixing between the two regions. Pollution in the central core will be swept out rapidly; but how does pollution leave the sluggish regions? To make matters simple, suppose that the sluggish regions are as sluggish as possible: the water is at rest. Assume, moreover, that the central core is thoroughly clean at all times, on the grounds that no new pollution is being added to the lake; that which has diffused across from the sluggish regions has negligible concentration, in view of the rapidity of the central current. Let us further assume that, initially, the sluggish regions have constant concentration of contaminant, φ . (These assumptions greatly simplify the mathematics with little loss of generality, in the sense that the important features of the solution would be the same for any other initial distribution.) The water flow is therefore as shown in Fig. 9.6(a), and the initial pollution distribution is as shown in Fig. 9.6(b). The rectangle represents the central core of the lake; the shape of the outer regions is arbitrary. 0
Now consider the rectangular sublake, with constant vertical crosssectional area B, which occupies the region y > 0, î < ζ < î , shaded in Fig. 9.6(c). This region is finite, of course, but if we are mainly interested in how the pollution in the vicinity of y = 0 interacts with the adjacent core, then it is quite permissible to pretend that the lake extends forever in the direction of increasing y. In this subregion, therefore, the remarks of the previous paragraph ensure that ι
4>{0,t) = 0,
2
0 < / < o o,
Φ&0) = Φ ,
0
0
R =
0
Z
=a
ˆ = ˛ .
.- = ˛ ,
z=b
y=0 (a)
(b) (O
Fig. 9.6 Idealized lake with rapid core between regions at rest. C denotes core, 5 denotes sluggish.
346
Chapte r 9
Buildin g a Model : Adapting , Extending , an d Combinin g
where 4>(y, t) denotes the concentration of pollution at station y at time t. As we will discover shortly, the initial discontinuity at y = 0 poses no mathematical problems and is therefore a convenient idealization of what would, in practice, be a very sharp pollution gradient. Now the sublake 4, <ζ<î , 0
5 ^ + ^ = 0, at ay
0
(9.60)
But why should pollution flow (have a flux) to begin with? To understand this, we have to combine the ideas we borrowed from Section 9.3 with those we developed in Sections 2.5 and 2.6. Temperature is just the concentration of heat. In Section 2.5, we observed that heat flows from regions of high heat concentration to regions of low heat concentration, and that the flux per unit area is proportional to minus the gradient of heat concentration. Velocity is just the concentration of momentum (per unit mass). In Section 2.6, we observed that momentum flows from regions of high momentum concentration to regions of low momentum concentration, and that the flux per unit area is proportional to minus the gradient of momentum concentration. Is it therefore not reasonable to assume that pollution will flow from regions of high pollution concentration to regions of low pollution concentration, and that the flux p e r unit area is proportional to minus the gradient of the concentration? Let η be the constant of proportionality. Then the actual flux is given by CCM)=-*7^ .
(9.61)
It is important to understand the physical difference between this pollution flux and the pollution flux F(z,t) = AvMz,t)
(9.62)
of Section 9.4. In the previous section, pollution was swept out of the lake with the flow of water, as though the pollutant particles took piggyback rides on adjacent particles of water. We call this process convection. But here there is simply no flow of water, piggyback rides are not available. How, then, is pollution transported? The answer is that in the absence, as it were, of public transport, the pollution moves privately, by virtue of its
9.5
Pur e Diffusio n of Pollutants . A Combinatio n
347
molecular motion. The water may be motionless at the visible level, but it moves continually at the invisible, microscopic level. The microscopic motion of the water molecules does not concern us because it plays no part in cleaning the lake, but the microscopic motion of the pollutant molecules can be imagined to occur in discrete time steps, in each of which a pollutant molecule leaps forward or backward with equal probability. Imagine that there are infinitely many stations along the y-axis where a molecule can be; label them m = 0, 1,2, Interpret the initial pollutant profile i f > = 0,
φ(ã,0) = 0
Φ&,0) = φ ify>0 • ' as meaning that there are no molecules at station 0 but 100 1. This corresponds to the first row of Table 9.3, where the factor σ is omitted and molecules are shown as a percentage of the original number. This table should be interpreted as merely the first few rows (time) and columns (stations) of an infinite matrix. Because a molecule at station m leaps to either m - 1 or m + 1 with equal probability, during the first time step roughly 50 of every 100 molecules that were at m will have moved to m - 1 and the remainder will have moved to m + 1. Imagine that the 50 molecules leaping from 1 to 0 are swept away instantly by the rapid core, all others remaining in the system until at least the next time step. After the first time step, the molecule distribution is as shown in the first row of Table 9.3. Be sure you appreciate that none of the molecules at (say) m = 2 at time / = 1 were there at / = 0; 50% came from m = 1, and the other fifty percent from m - 3. The evolution of the molecule distribution over the next six time steps is given by the remaining rows of Table 9.3. You may extend this table for higher values of m and / yourself if you wish, but the pattern is already clear. There is a slow migration of molecules to the left—slow because, having taken a step to the left, an individual molecule is just as likely to step back to the right as move on to the left at the subsequent time step. This slow migration of pollutant molecules is known as molecular diffusion. At the macroscopic (
0
Table 9.3 First seven time steps of schematic representation of molecular diffusion. / 0 1 2 3 4 5 6 7
m
0
1
0 100.0 0 50.0 0 50.0 0 37.5 0 37.5 0 31.25 0 31.25 0 27.34
2
3
4
5
6
7
8
100.0 100.0 75.0 75.0 62.5 62.5 54.69 54.69
100.0 100.0 100.0 87.5 87.5 78.13 78.13 71.09
100.0 100.0 100.0 100.0 93.75 93.75 87.5 87.5
100.0 100.0 100.0 100.0 100.0 96.88 96.88 92.97
100.0 100.0 100.0 100.0 100.0 100.0 98.44 98.44
100.0 100.0 100.0 100.0 100.0 100.0 100.0 99.22
100.0 100.0 100.0 100.0 100.0 100.0 100.0 100.0
348
Chapte r 9
Buildin g a Modal : Adapting , Extending , an d Combinin g
or visible level, where the pollution appears as a continuous substance because the individual molecules are invisible, this molecular diffusion manifests itself as a flow in the direction of decreasing concentration of contaminant. This diffusive flux is represented microscopically by Table 9.3 and macroscopically by (9.61). The constant of proportionality, y, is known as the (molecular) diffusivity and has the dimensions of L E N G T H / T I M E , as you should verify for yourself. The diffusivity is typically a small number because it represents the magnitude of the net molecular motion, and most of the molecules' individual leaps just cancel each other out. The size of the diffusivity is the basis for ignoring molecular diffusion in the longitudinal direction. It will be clear from the arguments above that there is a diffusive flux in the ζ direction also, namely, -ηβφίäζ per unit area. Thus, on using (9.62), the total flux of pollutant in the ζ direction is 2
Α
{
ν
φ
" ¸ ) ' ú
( 9
'
6 4 )
The first of the two terms in (9.64) so dominates the second when 7 is small,' however, that we may ignore the second one entirely. In the molecular world, public transport is always better than private! Substituting (9.61) into (9.60) we get ^
(9 65)
= 7 ^
Both this equation and initial and boundary conditions (9.59) are satisfied (Exercise 9.8) by Φ&,,
ψ ί ^ - ^ . . Jo This solution is plotted in Fig. 9.7 as a function of y for various fixed values of t. The 5% cleaning time at station y, r , is given by φ(ã, r ) = 0.05^ . Thus on using (9.66), we obtain ί
)
=
€
0 0 5
¼.05 = 4 ^ 2 .
ξ
( 9
0 0 5
6 6 )
0
(9.67)
where β is (uniquely) defined by
r
ert'dt = 0.025v^. (9.68) JO Jo To four significant figures (Exercise 9.9), we have β = 0.04434; whence ¼.05 * ^ Z £ .
(9.69)
More accurately, when the dimensionless parameter v(b - a)lf is large. This parameter is a first cousin of the Reynolds number we met in Section 4.10. 1
9.5
Pur e Diffusio n of Pollutants . A Combinatio n
349
Fig. 9.7 Pollution concentration given by (9.66), plotted as a function of y when t = s/y, for various values of s. Thus cleaning time increases with the square of distance from the rapidly flowing core. The precise value of 7 depends, of course, on the chemical properties of the pollutant but is probably of the order of 1 0 " square miles per year. At this rate, it would take about 12.7 billion years to clean the water even one mile from the core, almost certainly longer than most environmentally conscious people would be prepared to wait! Fortunately, no lake is ever completely stagnant, especially one with a rapid core; and the effect of the mixing will be to accelerate the cleaning time. But our model shows clearly how little we can rely on pure diffusion as a purifying process. It is much too slow. This is also apparent in Fig. 9.7, where the pattern suggested by Table 9.3 is clearly discernible. In our studies of lake purification, we have encountered three different cleaning times. These are listed in Table 9.4 as rough, order of magnitude estimates, together with verbal descriptions of the mechanisms that produced them. Because 7 is so small, we find 8
2
T
D
< Γ, « T , 2
(9.70)
where < denotes "very much less than." In practice, all three mechanisms would occur together, but it is important to begin modelling them by isolating their separate effects. Thus the simple mathematical models of SecOr 10 cm /sec. The diffusivity of sugar in water at room temperature, for example, is only 0.3 χ 10 cm /sec (explaining why coffee has to be stirred), and that of common salt is 1.1 χ 10~ cm /sec. See Landau et al. (1967, p. 332). 2
-5
2
-5
2
5
2
350
Chapte r 9
Buildin g a Model : Adapting , Extending , an d Combinin g
Table 9.4 Order of magnitude estimates of 5% cleaning time, by various mechanisms, for ideal lake into which all pollution inflow has ceased. Cleaning mechanism Convection, no mixing Convection, perfect mixing Pure diffusion
Order of magnitude Symbol Drainage time 3T Area/7 D
T„ ¢
T
2
Reference in text (9.54) (1.11) (9.69)
tions 1.1, 9.3-9.5 may be regarded as paradigms, which describe the effects of convection, diffusion and mixing in their purest form. Once understood in isolation, these basic mechanisms provide the foundations for more advanced, more realistic models, such as the ones derived in Section 11.6 and Exercise 11.15, in which all three mechanisms can be combined. We conclude this section by noting that, strictly, we have not described the mixing mechanism—we have merely made the assumption of perfect mixing. The invisible spoon that stirs the water is a phenomenon known as turbulence. Certain features of it can broadly be described by assuming the concentration flux to have the form (9.61), with a very much larger value of 7 (the turbulent, or "eddy," diffusivity) than would be appropriate for molecular diffusion; but, beyond that, modelling turbulence is extremely difficult and remains an active topic of ongoing research.
9.6
Modellin g a Population’ s Ag e Structure . A Firs t Attemp t
In planning for its future, a nation needs to know, among other things, how many schools to build, how many hospitals to build, how many teachers and doctors to train, and how much tax to collect for social security and medical care. All these things require a knowledge of the population's age structure—how many old people there will be, how many children there will be, the size of the potential labor force. Whether the logistic model of population growth is true or false, the best it can do is to predict a total population at time t, denoted by x(i). It cannot predict the number of people aged ζ within that population. We must therefore build a new model, one that is capable of providing such information. The model we develop here is an adaptation of the lake core model of Section 9.4. Let us think of life as a fast flowing river, along which distance is measured in years. The usual term for distance along the river of life is age; we'll denote it by ζ. Let us take the extremely morbid but nevertheless convenient view that an individual is just a particle of contaminant in life's 3
Before proceeding, you may wish to review your solutions to Exercises 4.15-4.17 and the first part of Section 8.6. 3
9.6
Modellin g a Population’ s Ag e Structure . A Firs t Attemp t
351
river. Accordingly, let φ(ζ, t) denote the amount of age-z "contaminant" in unit length of life's river at time t (also measured in years), in the sense that the number of people between a and b years of age at time / is b
r
Φ(ζ,ÞÜζ.
Ja
(9.71)
In particular, if u is the greatest age to which anyone can live (say, 115 years), then the nation's population magnitude at time / is given by ß φ{ζ,ί)Üζ, (9.72) Jo and life's river extends from ζ = 0 to ζ = Ù. For many purposes, a more useful measure of the population's age structure than (9.71) is the proportion of the total population aged ζ at time t. We therefore define x(t)=
(
• ’
2
)
3
É ª
( 9
•
7 3 )
Then the proportion of the population between ages a and b is rb
and
/
tt(Z, t)dz,
(9.74)
Ja
ir(z,t)dz = 1. (9.75) Jo 10 Our lake core, or river, model cannot be adapted in its present form because it assumes that all "contaminant" enters the river at ζ = 0 and leaves again at ζ = Ù. If, as we shall assume in this section, our nation is closed to immigration, then it is certainly true that everyone enters life's river at ζ = 0. Indeed we shall define the instantaneous annual birth rate to be B(t) = φ(0,Þ.
(9.76)
This is the annual rate at which babies are added to the population at time t and may be regarded as 365 times the number of babies born during the interval t-1/730 < î < t+1/730. It is allowed to vary within a calendar year and is therefore not the same thing as the "crude" birth rate, or number of babies per year; the latter would be r’o+i
B(t)dt
(9.77)
J" to o
for the year beginning at t = t . But only a very fortunate few leave the river of life at the ripe old age of ζ = Ù. Most cross its banks, as it were, somewhere in the interval 0 < ζ < Ù. We must therefore extend our river model, allowing "contaminant" 0
352
Chapte r 9
Buildin g a Model : Adapting , Extending , an d Combinin g
to be removed from the river anywhere between ζ = 0 and ζ = ù. Let the removal rate per unit river length be d(z, t) at station z. Then the number of deaths per unit time at time t, between ages z and z ( > z,), is 2
{
L Z2
(9.78)
d(z,t)dz.
In particular, by analogy with (9.76), the instantaneous annual death rate is Γ d(z,t)dz. (9.79) Jo Again, D should not be confused with the "crude" death rate, which is its average value over the year in question. Now, the river model (9.40) was developed in terms of concentration of contaminant, i.e., amount of contaminant per unit volume; whereas φ measures "contaminant" per unit length. If the river has unit cross section, however, then the two quantities coincide. Accordingly, setting A = 1 in (9.40) and incorporating extension (9.78), the river of life satisfies D(t)=
Rate of chang e _ Populatio n Populatio n _ inflo w ~ outflo w of populatio n
d f fj^ φ(ζ,ΐ)Üζ= Zl
Death rate
t jf
(9 80) '
Zl
F(z t) lt
-
F{z ,t) 2
-
d{z,t)dz,
K
z, < ζ < z , 2
where F(z, t) is the flux of people of age ζ in the direction of increasing age. It now follows, in the same way as (9.44) follows from (9.40), that ^ + ^ + = 0, 0<ζ<ω, 0<ί<οο. (9.81) ot oz But the number of people crossing age ζ per unit of time is simply the number of people per unit of age (or river length) at station z, because both time and distance are measured in years. Hence F ( z , 0 = * ( z , 0.
(9.82)
Let us define » = WJ)
(
9
·
8
3
)
to be the fraction dying of people aged ζ (usually called force of mortality by demographers). We will assume that μ is a known function and depends only on z. We thus assume that d is proportional to φ. Hence, from (9.81)(9.83), we obtain the following partial differential equation for φ(ζ, t): ^
ot
+ ^
oz
+ μ(ζ)φ = 0,
0 < ζ < α - , 0 < f < o o.
(9.84)
9.6
Modellin g a Population’ s Ag e Structure . A Firs t Attemp t
353
Exercise 9.10 shows how to obtain the unique solution of (9.84) when B(t) = φ(0, t) and C(z) = 4(z,0)
(9.85)
are given. By making μ independent of φ, we exclude the possibility that a highly populated nation may suffer increased mortality at all ages, due to crowding and competition for resources conducive to health. But there is little evidence that this effect is important for human populations at the present, though it may become so in the near future if population increase does not slow down. By making μ independent of t, we ignore improvements in health care and safety. For certain nations at certain times, this may not be such a bad assumption, especially if we restrict our attention to a span of two or three decades. Recall Exercise 4.15(i), where mortality was found to depend more strongly upon age than upon time. There is, however, another factor on which mortality depends and which has so far been ignored. What is it? We'll return to it shortly. Unfortunately, the solution given in Exercise 9.10 is of limited use because it requires Β to be known in advance as an explicit function of time. This is most unlikely, however, because Β depends in quite a complicated way on the behavior of women of childbearing age. No