zz1
r)
.
-)s)
y ',
J
.g ,..
-) .
-
l lnvestment
tlnder
Uncertainty
f'shri11:1 s 11 1Q.1)ixi t
:.1114.1 Illl...
378 downloads
4789 Views
20MB Size
Report
This content was uploaded by our users and we assume good faith they have the permission to share this book. If you own the copyright to this book and it is wrongfully on our website, we offer a simple DMCA procedure to remove your content from our site. Start by pressing the button below!
Report copyright / DMCA form
zz1
r)
.
-)s)
y ',
J
.g ,..
-) .
-
l lnvestment
tlnder
Uncertainty
f'shri11:1 s 11 1Q.1)ixi t
:.1114.1 Illlbert
S. I'i lltl),ck-
....--ee
>e
.'
14X'aZl>l&l 1%; , ..
N #-1
a a
I'rincetoll Prillcetoll,
UI1
ivers ity I'ress
NcAy
Jersey
jl
.
u
lnvestment under Uncertainty
Avinash K. Dixit and Robert S. Pindyck
Princeton University Press Princeton, New Jersey
Investment under Uncertainty
Ft? //?t?
Copyright @ 1994 by Princeton University Press Publlshed by Princeton University Press, 41 William Street, Princeton, New Jersey 08540 In the United Kingdom: Princeton University Press, Chichester, West Sussex A1l Rights Reserved Library of Congress Cataloging-in-ablication Data Dixit, Avinash K. Investment under uncertainty / by Avinash K. Dixit and Robert S. Pindyck P. Cn1. Includes bibliographical references and index. ISBN 0-691-03410-9 making. 1. Pindyck, Robert S. 1. Capital investments-Decision II. Aritle. 11G4028.C4D58 1993
658.15'54-dc20
93-26321 CIP
This book has been composed in Times Roman Princeton University Press books are printed on acid-free paper and meet the guidelines for permanence and durability of the Committee on Production Guidelines for Book Longevity of the Council on Library Resources http://pup.princetcm.edu Printed in the United States of Merica 10 9 8 7 6 5 4 3
r-:I,k ...,t.yjjI;;tjk. vt'' '1:4--91k1' (1 iih-'
jykjhtt
V*Q*Q::.
Nv
Y C1 W .
,
./i
ttl d?-f-z
Contents
Preface
Part 1. Introduction A New View
l 2 3 4 5
()f
Investment
3 4 6 8 10 23
The Orthodox Theory The Option Approach Irrcversibility and the Ability to N'Vllit An Ovcrviewof the B()()k Noneconomic Applications
2 Developing the Concepts Through Simple Examples I
2 3 4 5 6
Price Uncertainty Lasting Two Periods Extending thu Example to Three Pcriods Uncertainty over Cost Uncertainty over Interest Rates Scale versus Flexibil ity G uide to the Literature Part II. Mathematical
26 27 41 46 48 51 54
Background
3 Stochastic Processes and lto's Lemma l Stochastic Processes 2 The Wiener Process 3 Generalized Browninn Motion Ito Processes 4 Ito's Lemma
59 60 63 70 79
5 Barriers and Long-lkun Distribkltion 6 Jump Processes 7 Guide to the Literature Appendix
The Kolmogorov Equations
Dynamic
Optimization under Uncertainty Dynamic Programming l Contingent Claims Analysis 2 Relationship between the Two Approaches 3 4 Guide to the Literature Appendix A Recursive Dynamic Progralnming Appendix B-optimal Stopping Regions Appendix C Smooth Pasting
83 85 87 88 93 95 114 l20 l25 l26 128 130
Part 111.A Firm's Decisions
5
Investment
1 2 3 4
Opportunities and Investment Timing The Basic Model Solution by Dynamic Programming Solution by Contingent Claims Analysis Characteristics of the Optimal Investment Rule Alternative Stochastic Processes Guide to the Literature
l35 l36 140 147 l52
6 The Value of a Project and the Decision to Invest 1 The Simplest Case: No Operating Costs 2 Operating Costs and Temporary Suspension 3 A Project with Variable Output 4 Depreciation 5 Price and Cost Uncertaipty 6 Guide to the Literature
175 l77 l86 195 l99 207 21 l
7 Entry, Exit, Lay-up, 1 Combined Entry
213 215 229 242
and Scrapping
and Exit Strategies Lay-up, Reactivation, and Scrapping
Guidc to the, Literature
Part lV. Industry
Equilibriunl
8 Dynamic Equilibrium in 11 Competitive l The Basic Iattlition 2 Aggregate Uncertainty 3 I ndtlstry Eqtlilibrium with Exit 4 Firm-specific Uncertainty 5 A Gene ral Mode I 6 Guide to the Literature 9
Policy Intenrention
lndustry
247 Ozttl
252 'R
6l 2(:7 277 280
and Imperfect Ctpmpetition
2 82 283 ?)(b
1 Social Optimality 2 Analyses of Some Commonly Used Policit!s 3 Example of an Oligopolistic lndtlstry 4 G u id e to t he Lit e ra tu re
3t)i) 3 l4
Appendix
3 I5
Stlme Expected Present Valut!s Part V. E xtensitlns
and
Applictltilylls
10 Sequential Investment l Decisions to Start ltnd Ctlmplete :t Nltlltistagd Pnlject 2 Contilluous Investment and Timc to Btlild 3 The Lutarning Curve anl Optilnltl Prlldtlction Dccisons 4 Cost Uncertainty and Learning 5 Gu ide to the Literatu re Appendix Numerical Solution D iffe r (., n t ia l E q u a t io 1-1
()f
328 339 345 35l
Pltrtial
Incremental
1 2 3 4
3l9 32l
Investment and Capacity Choice G radual Capacity Exptnsion with Diminish ing Returns Increasing Rttturns and Lumpy Additions to Capacity Adj ustment Costs Guide to the Literature
12 Applications and Empirical Research 1 Investments in Offshore Oil Reserves 2 Electric Utilities' Compliance with the Clean 5 Tilt: Timing of Environmentai Poiicy
357 359 377 38l 39I 394 396
Air Act
4()5 4 I2
(?ontents 4 Explaining Aggregate Investment Behavior 5 Guide to the Literature
4 19 425
References
429
Symbol Glossary
445
Author Index
449
Subject Index
455
Preface
Bool provides a systematic treatment of a new theoretical approach capital investment decisions of firms. stressing the irreversibility of most to and decisions the ongoing uncertainty of the economic environinvestment which in those decisions are made. This new approach recognizes the ment value waiting of better for (but never complete) information. It option analogy with options in financial markets, which thc theory of exploits an much richer dynamic framework than was pllssible with the permits a of theory investment. traditional The new view of investment opportunities as optitlns is the product of over a decade of research by many economists, and is still an active topic in journal articles. It has led to some dramatic deptrtures from the orthodox theory. It has shown that thc traditional present value'' rule. which is taught to virtually every business school student and student of economics, can give very' wrong answers. The reason is that this rule ignores irreversibility and the option of delaying an investment. For the same reason, the new theoly also contradicts the orthodox tcxtbook view of production and supply going back to Marshall, according to which firms enter or expand when the price excceds long-run average cost, and exit or contract when price falls below average variable cost. Policy prescriptions based on the traditional theory, for example. the use of interest rate cuts to stimulate investment and antitrust policies based on price-cost margins, are also called into question. In this book we have tried to present the new theory in a clear and systematic way, and to consolidate, synthesize, and in some places extend the various strands of this growing body of research. While there is a Iarge and burgeoning Iiterature of journal articles, including a survey article by THls
ttnet
xii
/5-(:/l(.'t.
each of us, :1 book l'ormat has d istinct advan tages. l t tll/fe rs tIs the space t() develop the different themes in more detail and better order. and to place them in relation to one another. It also gives us the opportunity to introduce and explain the new techniques that underlie much of this work, to economists. We hope that the result is 11 but that are often unfamiliar better pedagogic treatment, of use to students, researcllers, and practitioners. However, perhaps even more important than pedagogy is the ability of the book tbrmat to provide a broad vision of the subject, and of the mechanisms of the dynamic, uncertain economic world. Our main aim is to clarify and explain the theory, but we think this is often best done by applying it to the real world. Therefore we often obtain numerical solutions tbr our theoretical models using data that pertain to some specific industries or products. We believe that the cumulative weight of these calculations constitutes strong prima facie evidence for the validity and the quantitative significance of the new theory of investment. However, more rigorous econometric testing, and the detailed work that is needed to devise improved decisionmaking tools for managers, await further research. We believe that this is an exciting and potentially important subject, and hope that our book will stimulate and aid such
research.
Who Should Read This Book? The first audience This book is intended for three broad audiences. consists of economists with an interest in the theory of investment, and in its policy implications. This includes graduate students engaged in the study of micro- and macroeconomic theory as well as industrial organization, and researchers at universities and other institutions with an interest in problems relating to investment. The second broad audience is students and researchers of financial economics, with an interest in corporate finance generally, and capital budgeting in particular. This would includc graduate students studying problems in capital budgeting (that is, how firms should evaluate projects and make capital investment decisions), as well as anyone doing research in finance with an interest in investment is finance decisions and investment behavior. Finally, the third audiece practitioners. This includes people working in financial institutions and concerned with the evaluation of companies and their assets, as well as corporate managers who must evaluate and declde whether to go ahead with large-scale investments for their firms. Some parts of this book are fairly technical, but that should not deter
r/-(!/c(.z the interestetl rellder. Tllc first twt) cllapters provide 11 lirly brie ( kllltl self-con t:linetl introtluct itdn to thtr tlltltlr.y of irreve rsible investnl e 1) t u ntlc r uncertainty. Tllese chapters convey many of tllc basic ideas, wllile llvtlitling technical details anl any l'nathenliltical tbrmalisln. Rttading these trhapters that is a low-risk investment we can alnlost gtlaralltee will have a high those practitioners whose knoWledge ot- econol-nics and fireturn. Even nance textbook's is vefy rtlsty should be able to follow tllese two chapters without too m uch effort t)r di fficul ty. %9eanticipate that many read ers will want to go into tlle tlltlory in mtre detail and address some of the technical issues. but Iack sonle ()f the necessary mathematical tools. With those readers in mind we hllvtl included two chapters (Chapters 3 and 4) that provide a self-contained introduction to the mathematical ctlncepts and tools that underlie this work. (These tools have applicltbility tllat goes well beyond the theo!z of investment under uncertainty, and so we anticipllte thltt some readcrs will find these chapters useful even if their applied interests lie elsewhc re, for example, macroeconomics, international trade, ()r labor economics.) .
However. wtl think that techniques are best Iearned by usi ng thcnl. Theretbre we do not attempt to bc very rigorllus t)r thorough in the mathematics as such. Nv'e rcly on intuition as far as possiblc. sktz tch stlmtl simple formal arguments in appendiccs, and reikr the reatlers whl) wish greater mathematical rigor or depth to mllre advanced treatises. Ftlr mtlst readers. we rccommend reading Chapters 3 and 4 onct:, and prllceeding t() the later chapters where thtt techniques arc used. Nve tllink tlltly will ()f thtl mathematics in this way tllan l7y emergc with a mtlch better grasp trying to master it first and in the abstract. Finally, we expect that many rcaders will wilnt to sec the ncw view t)l' investment develtlped in detail, including as many of its ram ificatitlns as possible. along with examples and applications. Chapters 5 through l2 provide just that. building up slowly from a basic and fairly simple model of irreversible investment in Chapter 5, to more complete modcls in Cilapters 6 and 7 that acctlunt lbr decisions to start or stop producing. t() the modklls in Chapters 8 and 9 that account tbr the interactions ()f firms within industries, and finally to the more ad vtnced extensions of thc theory and its applications in Chapters 10, l 1, and l 2.
Acknowledgments This book is an outgrllwth of the researcll that cach of us hlts been doing and over the past several years on the theory of investment. That research
xiv
Prelce
ormously from our interactions with hence this book-have benefitted colleagues and friends at our home institutions and elsewhere. To try to list all of the people from whom we received insights. ideas. and encouragement would greatly lengthen the book. However, there are some individuals who have been especially helpful through the comments, criticisms, and suggestions they provided aer reading our research papers and draft chapters of this book, and they deserve special mention: Giuseppe Bertola, Olivier Blanchard, Alan Blinder, Ricardo Caballero, Andrew Caplin, John Cox, Bernard Dumas, Gene Grossman, Sandy Grossman, John Leahy, Gilbert Metcalf, Marcus Miller, Julio Rotemberg, and Jiang Wang. In addition, we want to thank Lead Wey for his outstanding research assistance throughout the development of this book. Our thanks. too, to Lynn Steele for editorial help in preparing the hnal draft of the
manuscript.
The second printing of the book gave us the opportunity to correct several errors. We thank al1 the readers who brought these errors to our attention, most particularly Marco Dias of PUC, Rio de Janeiro, and David Nachman of Georgia State University. We are sure that more errors remains but we practice the preaching of capital theory: manuscripts should not be improved to the point of pertkction. but only to the point where the rate of further improvement equals the rate of interest. Finally, we want to thank Peter Dougherty, our editor at Princeton University Press, for his encouragement and advice as we prepared manuscript, and his guiding hand in seeing the book through to the
production. Both of us also received hnancial support for which we are very grateful. Avinash Dixit acknowledges the support of the National Science Foundation and the Guggenheim Foundation. Robert Pindyck acknowledges support from the National Science Foundation and from MIT's Center for Energy and Environmental Policy Research. Avinash K. Dixit Robert S. Pindyck
l part
lntroduction
Chapter
1
A New View of lnvestment
investnlent lts tllc ltct tlf illctlrring an inlnlcd itte cost in thc expectation o' ftlture rewitrtls. Fi rms thllt cllllstruct plants and instkyll equipment. mercllllnts whll Ilty in 11 stock of gllllds lr sltle. llnd persons whl) spend time ()n voclltitllll cdtlclltitln klrtr tll investors in tllis sense. Stln-lewhlt less obviotlsly. :t firm that slluts dlpwn lt ltlss-lnltking plant is :lls() the p:tyments it mtlst mllk-tl t() extract itself l'rllm cllntratrttlltl ctllmmitnlents. incltltlingseverance pllynlents t() I:tl7()r.ltre tlle initiltl expcllditu rtl. lnd tlle prllspcctive rcward is the retltlctitll, il1 l'uttlre lllsses. Viewed frllm tllis perspective. investnlent detrisilllls lre tllliqui tlltls. Ylltlr purchase ()f this tntltlk' wlls an investment. Tlle rewltrd, we I1()pe. will be 1111 ()f understanding invcstment decisitlns if ytlu are 1kn ccontlmist. and imprtlved ()1' lbility to makd sucll decisilllls in the imprllved cklu rse ytltlr l'tlture carecr an dtEtIines
E(.-oNtlMlcs
--illvesting'':
if ytlu artt
a business schotll student. investment decisillns sllare
in three imptlrtant characteristics comple the In partilll Iy degrees. Fi i is Iy te rst, nvestmen t varying or other wllrds, the initial cost ()f investment is at least partially sunk; yotl cannot recover it alI should you change ytltlr m ind. Sectlnd, t he rut is ttlt.'ertll'v over the futtlre rewards from thtt invdstment. Tlle best y()u can do is t() assess the probabilities of the alternative outcomes that can me:tn greater or smaller profit (or loss) for yllur vcnture. Third, you have somc leeway of your investment. Yotl can postpone action to get about the tnlg ()f about the certainty) coursc, complete more intbrmation (but never, Most
-rcb'o-sible.
future.
'Tllese th rct: cllari.ti-iit.: ritii itisill ic I itt;i ((? dcfcl I l 111lc i.llc t?I?(ilI lul dcttisioldsol' investors. is interacton is the focus ()f t his bf.)tlk.bl'.t dklvclllpth e theof'y ()f 'l-h
lntrodttcliolt irreversible investment applications-l
under uncertainty,
and illustrate it with some practical
The orthodox theory of investment has ntt recognized
the important
qualitative and quantitative implications of the interaction between irreversibility, uncertainty, and the choice of timing. We will argue that this neglect explains some of the failures of that theory. For example. compared to the predictions of most earlier moels, real world investment seems much less sensitive to interest rate changes and tax policy changes, and much more sensitive to volatility and uncertainty over the economic environment. We will show how the new view resolves these anomalies, and in the process offers some guidance for designing more effective public policies concerning investment. Some seemingly noneconomic
personal decisions also have the charac-
teristics of an investment. To give just one example, marriage involves an up-front cost of courtship, with uncertain tbture happiness or misery. It may be reversed by divorce, but only at a substantial cost. Many public policy decisions also have similar features. For instance. public opinion about the relative importance of civil rights of the accused and of social order lluctuates through time, and it is costly to make or change Iaws that embody a particular relative weight for the two. Of course the costs and benehts of such noneconomic decisions are difhcult or even impossible to quantify, but our general theory will offer some qualitative insights for them, too.
1 The Orthodox Theory How should a tirm, facing unccrtainty over future market conditions, decide whether to invest in a new factory'? Most economics and business school students are taught a simple rule to apply to problems of this sort. First, calculate the present value of the expected stream of prohts lhat this facto:y will generate. Second, calculate the present value of the stream of expenditures required to build the factory. Finally, determine whether the difference between the two the net present value (NPV) of the investment-is greater than zero. If it is, go ahead and invest.
' Some dccisions that are the opposite of investment gettingan immediate benefit in return for an uncertain future cost- are also irreversible. Prominent examples include the exhaustion uf Ilaiural rain forcsts. 0ur methods appjy to thcse resuurces and (he dcstruclion of lropicai decisions, too.
/k?T-t!.y/??Ic/,/ .,z1lfebv lzkzw'0J*
Of course, there are issuds that arise in calculating this net present value. Just how should the expected stream of profits from a new factory be estimated'? How should intlation be treated'? And what discount rate (or rates) should be used in calculating the present values'? Resolving issues like these are important topics in courses in corporate finance, and especially capital the NPV of an budgeting. but the basic principle is fairly simple--calculate whether and it is positive. investment project see The net present value rule is also the basis for the neoclassical theory of investment as taught to undergraduate and graduate students of economics. Here we lind the rule expressed using the standard incremental or marginal approach of the economist: invest until the value of an incremental unit of capital is just equal to its cost. Again, issues arise in determining the vaiue of an incremental unit of capital, and in determining its cost. For example. what production structure should be posited? How should taxes and depreciation be treated? Much of the theoretical and empirical literature on the economics of investment deals with issues of this sort. We ind two essentially equivalent approaches. One, following Jorgenson ( l 963). compares the per-period value ofan incremental unit ofcapital (its marginal product) and an percost'' that can be computed from the purchase pcriod rental cost'' ()r price- thc intercst and depreciation rates, and applicable taxes. The (irm's desired stock ofcapital is tbund by equating the marginal product and the user cost. The actual stock is assumed to adjust to the ideal. either as an ad hoc Iag process.or as the optimal response to an explicit cost of adjustment.The book by Nickell ( 1978) provides a particularly good exposition of developments of 'bequivalent
'&user
this approach.
The other tbrmulation. due to Tobin ( l 969), compares the capitalized value of the marginal invcstment to its purchase cost. The value can be obscrved directly if the ownership ()f the investment can be traded in a secondary market', otherwise it is an imputed value computed as the expected present value of the stream of proGts it would yield. 71e ratio of this to the cost) of the unit. called Tobin's ty, governs the purchase price (replacement should be undertaken or expanded if q exdecision. lnvestment investment should undertaken. and existing capital should be reduced, if it 1 be not ceeds ; < 1 The optimal rate of expansion or contraction is found by equating the q adjustment which depends on the difference of benefit, marginal cost to its T:IX rules alter somewhat, and this but the basic principle 1. between ty can of investis similar. Abel (1990) offers an excellent sulwey of this fy-theory mcnt. In alI of this, the underlying principle is the basic net presen: valuc rule. .
Ilttrollltctioll
The Option Approach
2
llusiness practice lil'td tllltt stltrl'l Iltlrtlltl tes ()r Iltlrdle--- rattl. (lbstt l-vers Illes l 11 t)t Iltlr Nvortls. lil-llls tlt) typical lu i ly llree tlle ctlst of capittl rt t or are not invest until price ristls substantially above Itlng-rtln average cllst. (311tlle downside, lirlns stay in busi ness for lengthy periotls svllile absorbi ng opktryting t)f
k-
I-:
.-'
Yh
net present value rule, however. is based on some implicit assumptions that are often overlooked. Most impllrtants it assumes that either the investment is reversible, that is, it can somehow be undone and the expenditures recovered should market conditions turn out to be worse than anticipated.
or, if the investment is irreversible. it is :1 now or never proposition, that is, if the firm does not undertake the investment now, it will not be able to in the future. Although some investments meet these conditions, most do not. lrreversibility and the possibility of delay are very important characteristics of most investments in reality. As a rapidly growing Iiterature has shown, the ability to delay an irreversible investment expenditure can profoundly affect the decision to invest. It also undermines the simple net presentvalue rule, and hence the theoretical lbundation ofstandard neoclassical investment models. The reason is that a firm with an opportunity to invest is holding an analogous to a hnancial call option it has the right but not the obligation to buy an asset at some future time of its choosing. When 11 firm makes an irreversible investment expenditure, it exercises, or its option to invest. It gives up the possibility of waiting for new information to arrive that might affect the desirability or timing of the expenditure; it cannot disinvest should market conditions change adversely. This Iost option value is an opportunity cost that must be included as part of the cost of the investment. As a result. when the value of a unit of capital is at least as large the NPV rule and its purchase installation cost'' must be modised. The value of the unit as must exceed the purchase and installation cost, by an amount equal to the value of keeping the investment option alive. Recent studies have shown that this opportunity cost of investing can be large, and investment rules that ignore it can be grossly in error. Also, this opportunity cost is highly sensitive to uncertainty over the future value of the project, so that changing economic conditions that affect the perceived riskinessof future cash tlowscan have a large impact on investment spending, Iarger than, say, a change in interest rates. This may help to explain why neoclassical investment theory has so far failed to provide good empirical models of investment behavior, and has led to overly optimistic and tax policies in stimulating forecasts of effectiveness of interest itoption''
'kills,''
''invest
lll substantially below average vllriable cost without in(ar alsla exit. Tllis disinvestmen! ducing seenls tt) conllicl vit 11sttllltlfkrd tlltloryNvill tlnctt explained irrcversibility ltntl optioll valtle arc be see. it can but as sve
Iosses. and price can
accotlnted tbr.
Of course, one can always redehne NPV by subtracting frol'n the convtl ntional calculation the opportunity cost of exercising the option to invest- and if NPV is positivo-' holds once this ct'rrection has then say t hat t he rule made. However. to do so is to accept otlr criticisnA. To highlight the inlbeen values, in this book we prefer tt) keep them separate fron) option portance of NPV'- terthe conventional NPV I f others prefer to contintle to use u-arcful option nclude all rclevllnt they tt) are minology, that is 5ne as long as ()f who readi tllat ly PV. N Readdrs usage can values in their deti nition pre fer translate our statenlents into tllat language. ()f In this book we develop the basic theory irreversible investlnent under Ginvest
'-positive
uncertainty, emphasizing the optitln-like charllctdristics ()f investnltlnt ()pptlr(lbtained fronl nlethods tunities. Nv show how optimal investment rtlles can bt2 options financial nlark in ets. Skc also dethat have been developed for pricing ()1* optimal matllematical theor,y velop an eqtlivalent approach based on the tlncertainty illustrate dynamic programming. sequentiai decisions under the optimal investment decisions of Iirms in :1 v:triety of sittlatiolls nt!w entry. determination of the initial scale of the hrm and futtlrc talstly changes of scale, choicc between diilk re nt forms of investment that offer d iftkrent dc01* succttssive stages grees of llexibility to meet future condititlns. completion of a complcx multistage project. temptlrary shutdown and rcstart. pcrmanent exit. and so forth. Nv'ealso analyze how the actions ofsuch f'irmsare aggregated to determine the dynamic eqtlilibrium of an industry. 'bgc
Iinancial assets. thtt (lppllrtunities t() Therefore optitlns.'' called this book sometimes real assets are acquire could be titled S'The Real Options Approach to lnvestment-''
To stress the analogy with options
()n
-treai
'rate
investment.
The option insight also helps explain why the actual investment behavior wisdom taught ln business schools. Firms to yield a return in excess ()f a required.
ol' firms differs from the received invest in projects that are ttxpected
zsummcrs ( l987. p. 31)())fllund hurdle nlltts ranging frtlm 8 !t) 3f) pcrcent, wlh a median :tl of 15 and a mcan of l 7 pcrcent. 7-he cost of riskless capital was mucll lllwer; ltlwing ftlr the and rcal rate cltlse tlltt 4 intcrest the nominal rate was percellt, deductibility of interest cxpenscs. i'tlr investments with a!. (s!9911 p f. I Thd. bllrlltt rilttt Jlpprtlpri:lle tc zere. See alse Dertuuztts systematic risk will exceed tht: risk Iess rate. bu t not by enough t() jusliIk the n umlltrrs used by many companies. .ct
Illtrziltctizlll
3
lrreversibility and the Ability to Wait
Before proceeding, it is important to clarify the notions of irreversibility, the ability to delay an investment, and the option to invest. Most important, what makes an investment expenditure a sunk cost and thus
irreversible'?
Investment expenditures are sunk costs when they are firm or industry specific. For example, most investments in marketing and advertising are firm specihc and cannot be recovered. Hence they are clearly sunk costs. A steel plant, on the other hand. is industry specihc it can only be used to produce steel. One might think that because in principlethe plant couid be sold to another steel company, the investment expenditure is recoverable and is not a sunk cost. This is incorrect. If the industry is reasonably competitive. the value of the plant will be about the same for all lirms in the industly so there would be little to gain from selling it. For example, if the price of steel falls so that a plant turns outa expost, to have been a ttbad'' investment for the tirmthat built it, itwill also be viewed as a bad investment by othersteel companies, and the ability to sell the plant will not be worth much. As a result, an investment in a steel plant (or any other industrpspecific capital) should be viewed as largely a sunk cost. Even investments that are not hrm or industly specific are often partly irrcversible because buyers in markets for used machines, unable to evaluate the quality of an item, will offer a price that corresponds to the average quality in the market. Sellers, who know the quality of the item they are selling, will be reluctant to sell an above-average item. This will lower the market average quality, and therefore the market price. This problem (see Akerlof, 1970) plagues many such markcts. For example, office equipment, cars, trucks, and computers are not industry specific. and although they can be sold to companies in other industries, their resale value will be well below their purchase cost, even if they are aimost new. lrreversibility can also arise because Of government regulations or institutionai arrangements. For exampie. capital controls may make it impossible for foreign (or domestic) investors to sell assets and reallocate their funds, and investments in new workers may be partly irreversible because of high costs of hiring, training, and Iiring. Hence most major capital investments are in large part irreversible. Let us turn next to the possibilities for delaying investments. Of course, srms do not always have the opportunity to delay their investments. For example, there can be occasions in which strategic cons' iderations make it imperative for a 5rm to invest quickly and thereby preempt investment by '%lemons''
zdNev Pcw
t#'
Illj-(:-lltleltt'
existingor potential competitors.3 However. in most cases. delay is at Ieast feasible. There may be a cost to delay tlle risk of entry by other tirms, or simplyforegone cash tlows but this cost must be weigled against the benehts of waiting for new intbrmation. Those benetits are oen large. As we said earlier. an irreversible investment opportunity is much like a
financialcall option. A call option gives the holder the right, forsome specified amount of time, to pay an exercise price and in return receive an asset (e.g.. a share of stock) that has some value. Exercising the option is irreversible: although the asset can be soid to another investor, one cannot retrieve the option or the money that was paid to exercise it. A lirm with an investment opportunity Iikwise has the option to spend money (the price''). in the future. in of for value. project) return Agains asset an or some now (e.g..a the asset can be sold to another tirm, but the investment is irreversible. As with the financial call option. this option to invest is valuable in part because the tkture value of the asset obtained by investing is uncertain. lf the asset rises in value. the net payoff from investing rises. If it falls in value, the tirm need not invcst, and will tnly lose what it spent to obtain the investment opportunity. The models of irreversible investment that will be developed in texercise
Chapter 2 and in later chapters will help to clarity' the optionlike nature of an investment opportunity. Finally. one might ask how firms obtain their invcstment opportunities. that is. options to invest. in the first place. Sllmetimes investment opportunities result from patents, or ownership of land or naturai resourccs. More generally, they arise from a firm's managerial resources. technological knowledge, reputation, market posititn, and possible scale, alI of which may have been built up over time. and which enable the tirm to productively undertake investments that individuals or other lirms cannot undertake. Most important. these options to invest arc valuable. Indeed, for most firms, a substantial part of their market value is attributable to thefr options to invest and grow in the future, as opposed to the capital they already have in place.'l Most of the economic and financial theory of investment has focused on how hrms should (and do) exercise their options to invest. To better understand investment behavior it may be just as important to develop better models of how firms obtain investment opportunities, a point that we will return to in Iater
chapters.
3See Gilbert ( 1989) and Tirolc ( 1988, Chapter 8) for surveys of the literature on such strategi aspects of investlnegt. 4For discussions of growth options as sources of firm value, sec Mycrs ( 1977), Kester ( 1984). and Pindyck ( 1988b).
Illtrotlltctioll
4
An Overview of the Book
In the rest of this chapter, we outline the plan of the book and give a flavor of some of the important ideas and results that emerge from the analysis. 4.A
A Few Introductory
Examples
The general ideas about treal options'' expounded above are simple and intuitive, but they must be translated into more precise models betbre their quantitative signiEcance can be assessed and their implications for firms, industries, and public policy can be obtained. Chapter 2 starts this program in a simple and gentle way. We examine a firm with a single discrete investment of two decision periopportunity that can be implemented within a of undergoes ods. Between the two periods, the price the output a permanent shift up or down. Suppose the investment would be profitable at the average price, and therefore a tbrtiori at the higher price. but not at the Iower price. By postponing its decision to the second period, the firm can make it having observed the actual price movemcnt. It invests if the price has gone up. but not if it has gone down. Thus it avoids the loss it would hjwe made if it had invested in the hrst period and then seen the price go down. This value of waiting must be traded off against the loss of the period- l profit flow. The result-the decision to invest or to wait-depends on the parameters that specify the model. most importantly the extent of the uncertainty (whichdetermines the downside risk avoided by waiting) and the discount rate (which measures the relative importance of the future versus the present). We carry out several numerical calculations to illustrate these effects and build intuition for real options. We also explore the analogy to financial options more closely. We introduce markets that allow individuals to shift the risk of the price going up or down, namely contingent claims that have different payoffs in the two eventualities. Then we construct a portfolio of these contingent claims that can exactly replicate the risk and return characteristics of the hrm's real option to invest. The imputed value of the real option must equal that of the replicating portfolio, because othemise there would be an arbitrage opportunity an investor could make a pure profit by buying the cheaper and selling the dearer of the two identical assets. We also examine some variants of the basic example. First, we expand window of investment opportunity to three periods, where the price can the down between periods 2 and 3 just as it could between periods 1 go up or and 2. We show how this changes the value of the Option. Next, we examine uncertainty in the costs of the project and in the interest rate that is used to 'window''
discotlnt futtt re p rtlh-t Ilows. F inallv. &ve consiler clloictl bc tNveel) prtlittcts (-81* differen t scltles. 11 Iarce r oroiect llllvil1c hicller Iixed u'tlsts btlt ltlvver()7e rtttilltt costs. Even with tllese extensions
antl variations,
the analysis remaills
at the
level of an illustrative and very simple example rather than that of a theory with some claim to general ity. In Iater chapters we proctrtld t() ulevelop a broader theoretical framework. Btlt the example does yield some valuable insights that survive the generalization- and we summarize tllcm ht, re. First, the example shows that the opporttlnity cost of thk! option to invest
is a significant component of the firnl's investment decision. The option value increases with the sunk cost of the investment and with the degree of uncertainty over the future price, the downside component of the risk btling the most important aspect. These restllts are conlirmcd in more general models in Chapters 5-7. Second- we wiIl see that the optilln va Itle is not affected if t he firm is able the risk by trading in forward or futtlres marke ts. In t2flicien t markets hedge to risk is fairly priced, so any decrease in risk is offset by the decretstl in such The fonvard transaction is a financial operation that Ilas nt) eflkct ()n return. firm's real decisions. (Tl1is is another tlxample the of the Nlodigliani-M iIlt!r
theorem at
work
.
)
Third, whcn future costs arc tlncertltin- thoir dflktzt on the investment decision depends ()n thc particular llrm t)f the tlnccrtainty. l 1*tlle uncertainty pertains to tlle pricc the Iirm must plty for :111 inptlt. the eftkct is jtlst like that of output price risk. The freedom not to invest if the input price turns out t() have gone up is valuabld, st) immediat.e investment is Iess readily matle. l-lowever, instcad suppose that the project consists of several steps. the uncertainty pertains to the total cost of investment. and intbrmation about it will l7e rttvealed only as the first few steps of the project are undertaken. Then these steps have information value twer and above their contribution t() the c()nventionally calculated NPV Thus it may be desirable to start the project evcn if orthodox NPV is somewhat negative. Nvereturn to this issue in Chapter l () and model it in a more general theoretical framewllrk. Fourth, we will see that investment t)n a smaller scale. by increpsing future flexibility,may have a value that offsets to some dcgree the advantage that a larger investment may enjoy due to economies t)f scale. 4.B
Some Mathematical Tools
In reaiity, investment prqects can have ditlerent windows ol opportunity, and of the future can be uncertain in different ways. Thereforc the
various aspects
Itltrltittf:tit)tj
simple two-period examples of Chapter 2 must be generalized greatly before tlley can be applied. Chapters 3 and 4 develop the mathematical tools that are needed for such a generalization. Chapter 3 develops more general models of uncertainty.
We start by
explaining the nature and properties of stochastic processes. These processes combine dynamics with uncertainty. In a dynamic model without uncertainty, the current state of a system will determine its future state. When uncertainty is added. the current state determines only the probability distribution of future states, not the actual value. The specifcation in Chapter 2, where the current price could go either up or down by a Iixed percentage with known probabilities, is but the simplest example. We describe two other processes that prove especially useful in the theory of investment Brownian motion and Poisson processes-and examine some of their properties. Chapter 4 concerns optimal sequential decisions under uncertainty. We begin with some basic ideas of the general mathematical technique for such optimization: dynamic programming. We introduce this by recapitulating the two-period example of Chapter 2. and showing how the basic ideas extend to more general multiperiod choice problems where the uncertainty takes the form of the kinds of stochastic processes introduccd in Chapter 3. We establish the fundamental equation of dynamic programming, and indicate methods of solving it for the applications of special interest here. Then wc turn to a market setting, where the risk generated by the stochastic process an be traded by continuous trading of contingent claims. We show how the sequential decisions can be equivalently handled by constructing a dynamic hedging strategy a portfolio whose composition changes over time to replicate the return and risk characteristics of the real investment. Readers who are already familiar with these techniques can skip these chaptersaexcept perhaps for a quick glance to get used to our notation. Others not familiarwith the techniquescan use the chapters as a self-contained introduction to stochastic processes and stochastic dynamic optimization-even if their interests are in applications other than those discussed in the rest of the
book.
.,d Nev Izclv o)' /?lTr.y/nTc?l/
uncertainty. Then the investment decision is simply the decision to pay the sunk cost and in return get an asset whose value can lluctuate. This is dxactly analogous to the financial theory of call options the right but ntlt the oblivalue tbr a preset exercise price. gation to purchase an asset of ouctuating
Theretbre the problem can be solved directly using the techniques developed in Chapter 4. The result is also familiar from financial theory. The option can is the money'' . when the value of the asset rises be profitably exercised above the exercise price. However, exercise is not optimal when the option is onlyjust in the money, because by exercising it the lirm gives up the opportunity to wait and avoid the Ioss it would suffer should the value fall. Only when the value of the asset rises sufsciently above the exercise price the option is in the money''--does sufhciently its exercise become optimal. An alternative tbrmulation of this idea would help the intuition of economists who think of investment in terms of Tobin's q. the ratio of the value of a capital asset to its replacement cost. In its usual interpretation in the investment literature. the value of a capital asset is measured as the expected present value of the prolit tlow it will generate. Then the conventional criterion for the firm is to invcst when (/ equals or exceeds unity. Our option value criterion is more stringent', q must cxceed unity by a sumcient margin. It must equal or excced a critical or threshold value (?*. which itself excceds unity, beibre investment becomcs optimal. We perform several numerical simulations to calculate the value of the option and the optimal exercise rule, and examine how these vary with the amount of the uncertainty, the discount rate. and other parameters. We (ind that tbr plausible ranges of these parameters, the option value effect is quantitativelyvery important. Waiting remains optimal even though the expected rate of return on immediate investment is substantially above the intcrest rate ()k' return on capital. Return multiples of as much as rate or the two or three times the normal rate are typically needed before the 5rm will exercise its option and make the investment. 'in
Gdeep
wtnormal''
4.D The Firm's
lnvestment
Decision
These techniques are put to use in the chapters that follow. Chapters 5-7 constitute the core theory of a hrm's investment decision. We begin in Chapter 5 by supposing that investment is totally rreversible. Then the value of the project in place is simply the expcctcd prcscnt valuc of th stream of prolits (or losses) itwouid generate.This can be computed in terms of the underlying
Interest Rates and Investment
Once we understand why and how (irms should be cautious when deciding whether to exercise their investment options, we can also understand why interest rates seem to have so Iittle effect on investment. Econometric tests of the orthodox theory generally 5nd that interest rates are only a weak or insignihcant determinant of investment demand. Recent history also shows that inlerest rate cuts tetld to llavr unly a limited stimuiative effect on investment', the experience of 1991-1992 bears the latest witness to that. The
IntroflLtctiolk
'
options approach offers a simple explanation. A reduction in the interest rate inakes the ftlture generally more important relative to the present, but this increases the value of investing (the expected present valtle of the stream of proEts) and the value of waiting (the ability to reduce t)r avoid the prospect
of tkture losses) alike. The
net effect is weak and sometimes even ambiguous. real apprtach also suggests that various sources of unThe options
certainty about future prolits quctuations in product prices, input costs, exchange rates, tax and regulatory policies have much more important effects on investment than does the overall Ievel of interest rates. Uncertainty about the future path of interest rates may also affect investment more than the general level of the rates. Reduction or elimination of unnecessary uncertainty may be the best kind of public policy to stimulate investment. And the uncertainty generated by the very process of a lengthy policy debate on alternatives may be a serious deterrent to investment. Later, in Chapter 9, we construct specisc exaniples that show how policy uncertainty can have a major negative effect on investment. 4.E
Suspension and Abandonment
Chapters 6 and 7 extend the simple model. As future prices and/or costs Iluctuate, the operating profit of a project in place may turn negative. In Chapter 5 we assumed that the investment was totally irreversible, and the hrm was compelled to go on operating the project despite Iosses. This may be true of some public selwices, but most firms have some escape routes available. Chapters 6 and 7 examine some of these. In Chapter 6 we suppose that a lossmaking project may be temporarily suspended, and its operation resumed Iater if and when it becomes profitable again. Now a project in place is a sequence of operating options; its value must be found by using the methods of Chapter 4 to value all these operating options. and then discount and add them. Then the investment opportunity is itself an option to acquire this compound asset. In Chapter 7 we begin by ruling out temporary suspension, but we allow permanent abandonment. This is realistic if a live project has some tangible ()r intangible capital that disappears quickly if the project is not kept in operation-mines Ilood, machines rust, teams of skilled workers disband, and brand recognition is Iost. If the hrm decides to restart, it has to reinvest in alI these assets. Abandonment may have a direct cost; tbr example, workers may have to be given severance payments. More importantly, however, it often has aIl uppurtunity cusi-ihe loss uf the optiun to preserve the capitai so it can be used prohtably should future circumstances improve. Theretbre a firm with
Nvill
tlllt!ratc some Iosses to k'ektp th is opt ion a proiect in place sufficientlyextren'le losses will il'ldtlctl it to abandon.
al ive, and ollly
have he re an interl i1) ketl pa ir of options. svlltlll t he fi 1-11-1exe rcises its option ttl invest, it gets :1. proiet:t i11 place antl an opt il'n to abandtln. If it exercises the option to abandllll. it gets the option to invest again. The two options must htl priced simultltndously to determine tlltl opti nlal investment and abandonment policies. Tlle link age has important implitrations', for examples11 higher cost t)f abandonment makes the firm even more cautious about investing, and vice versa. 'We illtlstrate tlle theory using numbers that are typical of the copper industry. and tind a very wide range of fluctuation of the price of copper between the investment and abandonment thresholds. 'We also consider an intermediate situation. where both suspension and at di fferen t costs. A project in suspension requ ires abandonment are llvailable expenditurt't. ongoing for exannplc, keeping a ship Iaid up. but restarting some is cheap. Abandonment saves on the rnaintenltnce cost. and may even bring some immediate scrap value. but then the l'ull investment cost must be incurred again if proti t potential recovers. Now we must determine the optimal switches between tllrce altcrnlltives an idle jirm, an operating project. and project. suspended We tllis. antl dk) illustrate it lbr the case ()f crudd oil a I n tct
&ve
tankers. 4.F
Temporary
versus
Permanent
Employment
While most ofour attention in this book is k)n tirms-capital investment choices. similar considcrations apply to their hiring and Iiring decisions. Each of these choices entails sunk costs, each decision must be made in an uncertain environment, and each allows some freedom 01' timing. Thereforc the above ideas and results can be applied. For exampltt, a new worker will not be hired until the value of the marginal product of labor is sufliciently above the wage rate, and the required margin or multiple above the wage will be higher tlle grcater the sunk costs or the greater the unccrtainty. The U.S. Iabor market in mid- 1993 offered a vivid illustration of this theory in action. As the economy emerged from the rccession of the early 199()s.hrms increased production by using overtime and hiring temporary workers even for highly skilled positions. But permanent new full-time hiring was very slow to increase. The current Ievel of prolitability must have been high, since firms were willing to pay wage premiums of 5() percent for overtime alld io usc ugeflcies that suppiied temporar.ywgrkors and charged fees Of wufk 25 percent or more of the wktge. But these same firms were not willing to make
lntrlllctioll
z.l Ne' Izc'w o)- /ll I'tz.$;f/?
the commitment involved in hiring regular new workers.s Our theory offers 11 natural explanation for these observations. A high level of uncertainty about future demand and costs prevailed at that time. The robustness and durability of the recovery were unclear-, it was feared that inllation would return and lead the Federal Reserve to raise interest rates. Future tax policy was very uncertain, as was the level of future health care costs that employers would have to bear. Therefore we should have expected firms to be very cautious, and wait for greater assurance of a continued prospect of high Ievels ofprofitability before adding to their regular full-time labor force. in the meantime, they would prefer to exploit the current proit opportunities using less irreversible (even if more costly) methods of production, namely overtime and temporary work. That is exactly what we saw. 4.G
IcpTf
The path dependence can leatl to the lbilowing kind of sequence ot' events. When the tirm (irst arrives on the scene and contemplates investment. the current protit is in the intermediate range between the two thrcsholds.
Theretbre the lirm decides to wait. Then proiit rises past the upper thresllold.
so the lirm invests. Finally. profit falls back to its old intermediate Ievcl. btlt that does not take it down to the Iower threshold where abandonment would occur. Thus the underlying cause (currentproiitability) has been restored to its old level. but its effect (investment)has not. Similar eftkcts have Iong been known in physics and other sciences. Tlle most familiar example comes from electromagnetism. Take an ironsar andt' loop an insulated wire around it. Pass an electric current throtlgh the wire--k the iron will become magnetized. Now switch the current off. The magnetism is not completely lost; some residual effect remains. The cause (the current) was temporary, but it Ieaves a longer-lasting eftkct (the magnetized bar). This phenomenon is called Ilvsresis. and by analogy the failure of investment decisions to reverse themselvcs when the underlying causes are fully reversed can be called cconomic hysteresis. A striking example occurred during the l 980s. From l98() to I984. thtt dollar rose sharply against other currencies. The cost advantage of foreign lirms in US markets became very substantial. and ultimately Ied to a Iarge rise in US imports. Then the dollar fell sharply. and by l987 was back to its l t)8() Ievel. However, the imptlrt penetration was not fully reversed: in fact it hardly decreased at :111. It took :1 largcr fall in the dollar to achieve any signihcant rcduction in imports.
''
Hysteresis
When we consider investment and abandonment (orentry and exit) together. a firm's optimal decision is characterized by two thresholds. A suffciently high current level of proEt, corresponding to an above-normal rate of return on the sunk cost, justilies investment or entry, while a sufficiently large Ievel of current loss Jeads to abandonment or exit. Now suppose the current level of protit is somewhere between thcse two thresholds. Will we see an active firm? That depends on the recent history of protit iuctuations. If the protit is at its current intermediate level having most recently descended from a high level that induced entry. then there will be an active firm. However, if the intermediate Ievel was most recently preceded by a 1owIevel that induced exit, then there will not. In other words, the current state of the underlying stochastic variable is not enough to determine the outcome in the economy'. longer histor.y is needed.a-he economy isgathdevendent. ideaofpathdependence and illustrated, hasbeen recentlyexplored rominently and by Artlaur 19aa). p (l9a6) oavid(19as, vheyallow an possibility: evenverylong-run propertiesof theirsystems more extreme altered by slight differences in initial conditions. uere we have a more kind of path dependence.-rhe long-run distribution of the possible o t economy is unaltered, but ti:e short- and medium-n,n evolution still be dramatically affected by initial conditions.
4.H 1 .1
a 'rhe t mos even are moderate stateshe can
'j 1,
!
-...
,.z.''
.
Industry Equilibrium
In Chapters 8 and 9 the focus turns from a hrm's jnvcst mtl n t decisit) ttl ns the equilibrium ot a wbolu industry composcd ot many such urms. o ne.s srstreaction might be tat tlae competition among urmswill destroy anyone firm's option towait- eliminating the efocts ofirreversibilty and uncertainty that we found in 5-7. does each destroy firm's option chaptcrs competition to wait, but this does not restore the present value approach and results of the orthodox theoe. on tlae contrary, caution when making an irreversible decision remains important- but different reasons. orsomewhat Iirmcontemplating its investment-knowingthat the considerone oture of induste demand and its own costs are uncertain, and knowing that thereuqre many other firms facing similar decisions with similar uncertainty. The Iirrlais ultimatelyconcerned with tue.eonsequences of its decision for its Own profift, but it must recognizc htok't'he similar-dcisions of otllrr Iirms will affect it. In this respect, two types ofcertainty must 6'v distinguished because q j j
patla
./ s,av,'' ovcrtimc -v----ti-l--d----ibi-gth---d---l-p---t--pp----di-th-x--v--kvimesonthesame
Jzbs Filled as Factories Rcly on day.sunday,May !6, !993: Sbaky Economy. Even Professionals Are Temps.'' uyeq-ver
and '.In a
jj
i'x
't. u yt L Nt, k 'h.h
.
,, .
,
..i
..
'$-
'ikyk
,;
..q
11 u .
'fK
.''e
ot
..............,,....
..
... .
,-
. ...... . . .
. ..
'''
.
i
l8
lntrodttctil
they can have different implications for investment: aggregate uncertainty that affects all hrms in the industly and Iirm-specilic or idiosyncratic uncertainty facing each Iirm. To see this, tirst suppose that investment is totally irrcversible, and consider an industrrwide increase in demand. Any one Iirm expects this to lead to a higher price, and so improve its own prolit prospects, making investment firms are making more attractive. However. it also knows that several other effect of the dea similar calculation. Their supply response will dampen the mand shift on the industry price. Therefore the upward shift of its own protit potential will not be quite as high as in the case where it is the only rm and has a monopoly on the investment opportunity. However, with investment being irreversible, a downward shift of industry demand has just as unfavorable an eftkct in the competitive case as in the monopoly case. Even though other competitive hrms are just as badly affected, they cannot exit to cushion the fall in price. Thus the competitive response to uncertainty has an inherent asymmetry: the downside exerts a more potent effect than the upside. This asymmetry makes each tirm cautious in making the irreversible investment.
The ultimate effect is very similar, and in some models identical, to that ofthe option value for a firm possessing a monopoly on the investment opportunity and waiting to exercise it. In fact, the theory of a competitive industry can be formulated by giving each tirm the option to invest, valuing these real options the competitive as in Chapters 5-7, and fnally imposing the condition that in should value be option this zero. equilibrium If we allow some reversibility, the exit of other lirms does cushion the effect of adverse demand shocks on price. But then each firm*s exit decision recognizes this asymmetric effect of demand shocks in an initially poor situation: their upside effect is more potent than the downside. Thus competitive firms are not quick to leave when they start to make operating losses; they wait a while to see if things improve or if their rivals leave. The overall effect is just like that for a single monopoly firm's abandonment decision that we found in Chapter 7. ln fact, the competitive equilibrium model of joint entry and exit decisionswith aggregate demand shocks thatwe analyze in Chapter 8 has exactly the same critical Ievels of high and Iow prices to trigger entry and exit as the corresponding monopoly model of Chapter 7. Firm-specific uncertainty does not lead to this kind of asymmetly. lf just experiences a favorable shift of its demand, say some idiosyncratic hrm one switch of fashion, then it knows that this good fortune is not systematically shared by other Erms, and therefore does not fear tht entry ofother firmswill erode its prol'it potentiai in the same way. However, then llc vuluc uf waitillg reemerges in the older familiar form. The lucky hrm does have a monopoly
./4 Nebv P'c! $.' (
)j-
11l l
'(j'.b'tlt
ltv l
t
on the opporttlnity to enter witll its Iovvcost. Tl'lcrt.lt'oreit alstl llas 1111 optitln value Of waiting-v it can thereby avoid a Itlss if its Itnv cost sllould ttlrn otlt to be transitory. Tllus tirm-specitictlncertainty in industry equilibritlnl also Ieads to investment decisions si milar lo those fotl ntl in Cllaptc rs 5-7 l'or :111 isol a tetl srrn. 4.I
Policy Toward Investment
Some readers might interpret the rcsult that uncertainty makes li rnls Iess eager to invest as indicating a need for government policy intervention to stimulate investment. That would be a hasty reaction. A social planner also gcts information by waiting, and therefore should also recognize tlle opportunity cost of sinking resources into 11 project. A castl rorpolicy inte rvention will arise only if firms face :1 diftkrcnt value (.)f waiting than does society as :1 whole. in other words, if some market failure is associated with the decision
process.
Chapter 9 focuses on these issues. Our lirst result is :1 confirmatitln
01'
the standard theory of gene ral eq uil ibrium. lf markots for risk are complctc, and if Iirms behave as competitive price- takers (in this stochastic dynanlic context this must be interpreted to mean that ttach firm takes as given the stochastic proccss of thc pricc and has ratillnal expectations about it). then the equilibrium evolution ol' the industry is stlcially cfficient. A stlcial planner would show the same degree of llesitancy in making the investment dccision. If markets for risk are incompletc, bcnelicial plllicy intervtlntions dt) exthe correct policy needs some carcful calculation and implemttntlltion. The biunt tools that are often used for handling unccrtainty can havc adverse ()1* . effects. We illustrate this by uxamining the consequences prce ccilings and floors. For example, price supports promote investment by reducing the downside risk. However, the resulting rightward shift of the industry supply function implies lower prices in good times. Averaging over gotld times and bad, we tind that the overall rcsult is a Iower long-run averagtt price. In othllr words, the polic-yis harming the very group it sets out t() hclp. Pricc tll.ltlror ceiling policies. for example, urban rent controls and agricultural prictl stlpports. are usually criticized because they reduce overall econtlmic efficiency. Our finding is perhaps a politically more potent argument against thtm: their distributional effect can be pelwerse, too. We also study the effect of uncertainty concerning future policy itself. For example, if an investment tax credit is being discusscd, firms will recognize iiiot'e kalue 11'1wl'tl'llg, bcuausu llt;lc i: u pl ubabiliiy tilat the ctlst t)iinvestment to the firm will fall. We hnd that such policy uncertainty can have
ist, but
llttroelltctiolt
,,4New Iztl'v of
wish to a powerful deterrent eftkct on immediate investment. lf gtwernments spend a long stimulate investment, perhaps the worst thing they can do is to right way to do so. time discussing the
4.J Antitrust
Nrmscontinue their export operations at :1 loss, domestic firms allege predatory dumping and call for the standard trade policy response of countervailing import duties. However. our analysis suggests that the foreign firms may be simply and rationally keeping alive their option of future operation in our market, with no predatory intent whatever. Only a sufficiently Iong time series of data will allow us to test whether the supposed collusive or predatory actions are merely natural phases in the evolution of a competitive industry or genuine failures of competition.
and Trade Policies
Chapters 8 and 9 paint a very diftkrent picture of competitive equilibrium than the one familiar from intermediate microeconomics textbooks. There lhe industry if the price rises to equal the we are told that firms will enter long-run average cost, and they will exit if the price falls as low as the average variable cost. Our theory implies a wider range of price variation on either side. For example. in the face of aggregate uncertainty, firms' entry as soon will not constitute an industry as the price rises to the long-run average cost equilibrium. Each tirm knows that entry of other similar firms will stop the price from ever rising any higher. while future unfavorable shifts can push the price below this Ievel. Also, a future price path that sometimes touches the long-run average cost and otherwise stays below this level can never offer normal return on the firm's investment. Only if the price ceiling imposed
a by entry is strictly above the Iong-run average cost can the mix of intervltls of supernormal proit and ones of subnormal profit average out to a normal return. Similarly, tirms will exit only when the price ills sufhciently far below the average variable cost. They will tolerate some losses, knowing that thc cxit of other firms puts a Iower bound on the price. The equilibrium level of this qoor is determined by averaging out the prospects of future losses and profits to Zero.
Thus we hnd that competitive equilibrium under uncertainty is not a stationary state even in the long run, but a dynamic process wherc prices can luctuate qute wfdely. Periods of supernormal profits can alternate with perfods of losses. A similarviewofdynamic equilibrium as astochastic process has become quite common in macroeconomics, but is sumrisingly uncommon in microeconomics. particularly with regard to its implications or antitrust polic'yor international trade policy. The conceptual framework of such policies in practice are based on obseris generally static, and the recommendations particular of of industry instant. We :nd that the at a vations an rethinking of view substantial both the theory and the calls for a dynamic tsnapshots''
practice.
For example, in industrial organization theory, excess prohts suggest collusion or entry barriers, calling for antitnlst action. ln our dynamic perspective, substantial prriods of supernormal prohts w'ithout ncw cntry can occur cvcn though al1 hrms are small price takers. In international trade, when foreign
J?l1.t;'./?'?7t.vIl
4.K
. :: ..
Sequential and Incremental
Investment
In Chapters 10 and l 1 we return to a single tirm-s investment decision and examine some other aspects of it that are important in applications. Chapwhich must ter 10 deals with investments that consist of several stages, aIl of be completed in seuence before any output or prolit flow can commence. The 5rm can constantly obselwe some indicator of the future protit potential, and this fluctuates stochastically. At any stage. the firm may decide to continue immediately, or wait for conditillns to imprtwc. At an early stage ()f the investment sequence, most of the cost remains to be sunk. Therefore the will go ahead with the program only if it sees a sufficiently high threshold 517)1 level of the indicator of profitability. Gradually. as more steps are completcd and less cost rcmains to be sunk, the next step is justified by ap ever smaller threshold. In this sense, bygones affect the decisions to come. In Chapter 10 we examine another effect of current decisions on the f'uture, namely the learning curve. According to this theory, the cost ofproduction at any instant is a decreasing function of cumulated output experience. Thus the current output t1()wcontributes to a reduction in alI future production costs. This additional value must be added to the current revenues before comparing tem to the current costs of production to decide on the optimal level of production. We examine the dynamic output path under these conditions. We 5nd that greater uncertainty lowers the value of future cost reductions, and that Ieads to a reduction in the pace of investment. In Chapter 11 we turn to the study of incremental investment, where outand profit flow are available al1 the time as a I'unction ot' the installed stock put capital. The aim is to characterize the optimal policy for capacity expansion. of When production shows diminishing returns to capital, we can regard each new unit of capacity as a fresh project, which begins to contribute its marginal product from the date of its installation. Then the criterion derived in ChapiIl tel 6 for illvrstlllellt suel'l it pfojet contknues to apply. If pi'oduction shows increasing returns to capital over an interval, then all the units of capacity in
22
Iltlrodttctiolt
:tn appropriately constructed range must be regarded as a single project. and the criterion tor its installation is again a natural generalization of thpt tbr a .j, single project described in Chapter 6. When the Iirm can choose its rate of capacity expansion, we must specify'
how the costs of this expansion depend on its volume and pace. Different assumptions in this respect imply different optimal policies. We construct a general model that places the alternatives in context. and in particular shows the relationship between the adjustment costs models that have been the mainstay of theoretical and empirical work over the last decade and the irreversibility approach that has been the focus of our book. Empirical
and Applied Research
In Chapter 12 we turn to some examples that illustrate applications and extensions of the techniques developed throughout the book. We also discuss the relevance of the theory for empirical work on investment behavior. We begin Chapter 12 with a problem of great interest to oil companes how to value an undeveloped offshore oil reserve, and how to decide when to invest in development and production. Aswewill see, an undeveloped reserve is essentially an option; it gives the owner the right to invest in development of the reserve and then produce the oil. By valuing this option we can value the reserve and determine when it should be developed. Oil companies regularly spend hundreds of millions of dollars for offshore reserves, so it is clearly important to determine how to value and best exploit them. We then turn to an investment timing problem in the electric utility industry. The Clean Air Act calls for reductions in overall emissions of sulfur dioxide, but to minimize the cost of these reductions, it gives utilities a choice. They can invest in expensive to reduce emissions to mandated Ievels, or they can buy tradeable that Iet them pollute. There is considerable uncertainty over the future prices of allowances, and an investmcnt in scrubbers is irreversible. The utility must decide whether to maintain Pexibility by relying on allowances or invest in scrubbers. We show how this problem can be addressed using the options approach of this book. To show how the principles and tools developed in this book have relevance beyond hrms' investment decisions, we address a problem in public policy when should the government adopt a policy in response to a threat to the environment, given that the future costs and benehts of the policy arc uncertain? We will argue that the standard cost-benefit framework that cconomists havc traditionally uscd to uvaluate envii-onnpental policies is dellcient. The reason is that thcre are usually important irreversibilities associated with environmental policy. These irreversibilities can arise with respect to '<scrubbers''
'allowances''
environlnental dnlnage itself. btlt also with respect to tlld costs of adapting t() policies to reduce the daluage. Since tlltr atloption of ::n envinlnnlental policy is rarely a now or ntwer proposition. the sanle tdchniques used to sttldy tllt.l to the optinlal tim ing of an optimal ti m ing ot' an investment can be lpplied environmental policy. At the end of Chapter 12. we disctlss some of the enlpirical inlplicat itlns
of irreversilnility nnd unccrtainty for investl-nent behavior. Tllere is trollsitltlrable anecdotal evidence that firms make investment decisions in :1 way tllat is at least roughly consistent with the theory developed in this book. tbr tlxalmple, the use of hurdle rates that are much larger than the opportunity txlst of capital as predicted tnythe capital asset pricing model. Some ntlmdrical simulations based on plausible parameters for costs and tlncertainty are found to replicate features of reality. However, more systematic econolnetric testing of the theo!y is still at a very early stage. Nve review some work of this kind. point out its difficulties, and suggest ideas for ftlture research.
5
Noneconomic Applications
Our tbcus in the book will be ()n investment decisions implications for industry equilibrium. Tllese matlers are
()f
lirms antl their
01'
primary interest
to economists. their conditions (technologyand rcstlurcc avktilability) antl of the value t)f the firm) arc gcnerally agrced uplln, antl criteria (maximization theory leads to quantiliable predictions about them. lnvestment decisions of consumers (purchas:ofdurablcs) and workers (educationand human capital) have obvious parallels. Research on these issues already cxists. and wtl will sketch some of this literature in Chapter I 2. Many other personal and societal choices are made undcr the same basic
conditionss namely irreversibility, ongoing uncertainty, and some leeway in timing. Therefore we can think about them in terms of some tlf the models and results outlined above, and offer some qualitative speculations. We believe there is scope for more seriotls research along these Iines. This would amount to extending work such as that of Becker ( 1975. l 98()) on econtlmic approaches to social phenomena by incorporation of option values. Indecd, some recognition Qf this aspect can be read nto Becker's own remarks on the subject, for example, in Becker (1962,pp. 22-23), but a more thorough and formal analysis along these lines remains a potentially fruitful project tor the future. Although we cannot spare much splce in an already lengthy book, we believe that readers will Iind some speculations along tllese Iines both interesting and thought-provoking.
Introdttciotl
5.A Marriage and Suicide Marriage entails signilicant costs of courtship, and divorce has its own mon-
etary and emotional costs. Happiness or misery within the marriage can be only impertkctly tbrecast in advance. and continues to lluctuate stochastically even aler the event. Therefore waiting tbr a better match has an option value, and we should expect prospective partners to look for a sufhciently high initial threshold of compatibility to justifygetting married. We should expect the option value to be higher in religions or cultures where marriage is less reversible. Therefore we should expect that. other things being equal, individuals in such societies will search more carefully (andon the average, search Ionger), and will insist on a higher threshold of the quality of the match. On the contrary. when divorce is easy. we should see couples entering into marriage (or equivalent arrangements) more readily. Of course. other things are not equal. Societies that make divorce more
difficult presumably attach higher value to marriage. Therefore we should expect them to counteract the rational search and delay on the part of individuals technologies.'' Emby social pressure. and provision of bettcr of these will carefully ideas designed have be tests to pirical to distinguish the and only raises the interest and opposing often influences. but that separate research. such of challenge ''matchmaking
Perhaps the most extreme example of economics applied to sociological phenomena is the Beckerian theory of suicide developed by Hamermesh and Soss (1974). According to them. an individual will end his or her own life when expected the present value of the utility of the rest of Iife falls short ofa benchstandard cutoff Most people react by saying that the model mark or view rational of what is an inherently irrational action. gives an exccssively opposite. Whatever its merits or demerits as the Our theory suggests exactly descriptive theofy, the Hamermesh-soss model is not rational tr/ltll/q/l from the prescriptive viewpoint. because it forgets the option value of staying alive. Suicide is the ultimate irreversible act, and the future has a lot of ongoing will uncertainty. Therefore the option value of waiting to see if improve'' should be very large. The circumstances must be far more bleak than the cutoff standard of the Hamermesh-soss model to justifypulling the trigger. This is true even if the expected direction of life is still downward; all that is needed is some positive probability on the upside. Now return to the argument that most suicides are irrational, and ask exactly how they fail to be rational. There are' several possibilities, but one seems especiaiiy pertinent. Suicidesproject the bieak present into an equaiiy bleak future, ignoring uncertainty, and thereby ignoring the option value of 'tzero.''
ttsomething
,4 tge.v Piku,
tp-/' lllb
'tl-//'?lt.vl/
life. Then religious or social proscriptions against suicide selwe a useftll ftlllction as measurcs to compensate for this tiltlre of rationality. By raising the perceived cost of the act. these taboos lower the threshold of quality of litk that leads to suicide when option value is ignored. This can correct the failure of the individuals' forethought, and bring their threshold in contbrmity with the optimal rule that recognizes the option value. 5.B
Legal Reform and Constitutions
Finally, consider law reform. Different t-undamentalconstitutional or legal principles often conllict with one another in specific contexts', for examplethe civil rights of the accused often stand in the way of better enforcement of law and order. Public opinion as to the appropriate rdlative weight to be attached to these contlicting principles can shift over time. How quickly sllould the 1aw respond to the latest swing of opinion'? G iven some legislative antl administrative costs of changing laws. our theory suggests that the option to wait and see if the trend ()f opinion will reverse itself has some valutl. Reform should be delayed until the forcc of current opinion is sufticicntly overwhelming to offset this value. But there is good reason to believe that market failure.-' At the proccss is subject to a kind of myopia or all timess people and politicians tend to believe that at last they have got it right; the balance ()f opinion that has just been reached will prevail tbrcvor. Thereforc they will ignorc futurc unccrtainty and (lption values, nnd change the laws too frequently. The time to anticipate and defcat this tendency is when the cllnstitution is framed. Knowing that futurc generations will be too trigger-happy in changing laws. the founding fathers can artilicially raisc the cost ()f change, thereby making the politically flawed thresholds for Iegal changc coincide with the truly optimal thresholds. Thus various supermajority requirements for c()nstitutional change can be seen as a commitment device that corrccts for the shortsightedness of future generations. These are just a few examples of how the theory and ttlchniques ddveloped in this book are applicable to some fairly far-reaching problems. Wk have deliberately stated them in speculative and provocative ways. hoping to attract interest and research along these Iines from a broader spectrum of social scientists. In te rest of the book, we will focus largely on investmenta but ask the reader to keep in mind the much broader potential applicability of the thcory. t&ptllitical
Illttlttllillg
Chapter
2
Developing the Concepts Through Simple Examples
illvestnldllt Ilrl'jl'llt'tllls il1clllltintllptls tillle. Fillktlly. ve hvill stage for ilxlhn-lille 01* t l1eillvestlllellt vllell tlle illvestlnent tlecisitlns brielly (:lst'p:ll'!tl tlnccrttti posed to its payllff) is n- when futtl 1.t? i1-1ttt rest rates 1.1re tlllce rt :1 111.().t
when one must choose the scllle
01-
an investnlent.
1 Price Uncertainty Lasting 'lWo Periods Consider a firm thllt is trying to ddcide whether to invest in :1 widget factory. The investment is colnpletely irreversible the facto!y can only l7e tlsed to make widgets, and Should the nlarket for wdgets evaporate. t he firlu cannot teuninvest''and recover its expenditure. To keep Inattors as silnple :'s possible. we will assume that the factory can be built instantly, at a cllst / and will produce one witlget per year forever. with zero operating cost. Currently the price of a widget is $2()()-but ncxt year the price will change. Witll prtlbltbility t/it will rise to $3()().and with probability ( l t/ ). it will 1*1111 to $ 1()(). Tlpe price will then remain at this new level tbrever. (stltlFigtlre 2. l Again. to keep things simple, we will assunle that the risk ('ver tlle futtlre price of widgcts is fully divcrsitiable (that is. it is tlnrdlatcd tt) wllat llappens with the overall economy). I-lence the Ii rln slltltlltl tliscoullt futtl rc cash sows tlsing the risk-frce ratc ()f interest. wI1ich wtl will tlk'e t() be l () -
-
.)
FlltMs
MAKE,
implement, and sometimes revise their investment decisions con-
tinuously through time. Hence much of this book is devoted to the analysis problems. Idowevdr, it is best to of investment decisions as continuous-time begin with some simpl examples, involving a minimal amount of mathematics, in which investment decisions are made at two or three discrete points in time. In this way, we can convey at tle outset an intuitive understanding of tlf the basic concepts. In particular, we want to show how the irreversibility and how it requires an investment expenditure affects the decision to invest, modihcation of the standard net present value (NPV) rule that is commonly taught in business schools. We also want to show how an opportunity to invest is much Iike a hnancial option, and can be valued and analyzed according.
This chapterbegins by discussing these ideas in the context of a simple example in which an investment decision can be made in onlyone oftwo possible periods now or next year. We will use this example to see how irreversibility creates an opportunity cost of investing when the future value of the project is uncertain, and how this opportunity cost can be accounted for when making the investment decision. We will also see how the investment decision can be analyzed usng basc option pricing techniques. We will examine the characteristics of the firm's option to invest in some detail, and see how the value of that option, and the investment decision, depend on the degree of uncertainty over the future value of the project. Extending the example to three periods will provide more insight into the problem o investment timing, and set the
26
percent.
For the time being we will set / ().5. (Lalcr we will slltl 1($1)()and t/ how the investment decision depends ()11 / and t/ G ivcn tlltlstl vlllutls Iklr / and q, is this a gool.l invcstment'? Should the firm invest nllw, or wtluld it lptt better to wait a year and sce whether the price ()1' widgets gtles up ()r tlown? Suppose we invcst now. Calculating the net present value ()f th is investnlent in the standard way (and noting that the expeaetl future price of widgets is =
=
.)
l
1
=
l
P,
=
$300
P:
=
$10 O
%
----'-
q Po
=
=
2
=
30O
=
1 O0
$200 (1
-
q)
2b*i;: Iz p-tl
.33.
j/
pz lJt?bz't.
.
ryj4'
je'itlltk.t.
'--'*-
Illtrlltitt:til';
always S200), we get NPV
=
-
1600 +
x
x() V (1.1)
=
t
J=()
-
1600 + 2200
=
$600.
(l)
It appears that the NPV of this project is positive. The current value of a widget factory, which we will denote by f.$l, is equal to $2200,which exceeds the $ 1600 cost of the factory. Hence it would seem that we should go ahead with the investment. This conclusion is incorrect, however. because the calculations above ignore a cost the opportunity cost of investing now. rather than waiting and keeping open the possibility of not investing should the price fall. To see this. let us calculate the NPV of this project a second time, this time assuming that instead of investing now. we will wait one year and then invest only if the price of widgets goes up. (Invsting only if the price goes up is in fact ex post optimal.) In this case the NPV is given byl NPV
=
(0.5) -
1600
l.1
'''Z Y'N
+
''
I
=
l
300 (1.1)/
=
850 1. j
=
Developing ?/lc Cllll()epls F/l/-f?/(/l
f-rtl/?l/p/t'-
How much is it worth to llave the flexibility to makd the investment decision next year, rather than llaving to invest either now or never'? (NVc know that having this tlexibilityis of some value, because wtt would pretkr option-f is easy to wait rather than invest now-) The value of this to calculate; it is just the difference between the two NPV-S. that isp$773 $600 173. In other words, we should be willing to pay $ 173 more tbr an investment opportunity that is llexible than one that only allows us to invest biflexibility
-
=$
n0W.
Another way to Iook at the value of tlexibility is to ask the following question: How high an investment cost l would we be willing to accept to have a llexible investment opportunity rather than an inllexible or never'' one? To answer this, we tind the value of 1, which we denote by 7, that makds the NPV ()f the project whtln we wait eqtllkl to the N PV whe n I $ I (A()() and we invest now. that is. equal to $6t)().Substituting l for the $ l )()() and substituting $600 for the $773 in etluation (2): --now
=
N PV
$773.
(Note that in year (), there is no expenditurc and no revenue. In year 1. the $1600 is spent only if the price rises to $30(),which will happen with probability 0.5.) If we wait a year betbre dcciding whether to invest in the factory, the project's NPV today is $773.whereas it is only $600 if we invest in the factory now. Clearly it is better to wait than to invest right away. Note that if our only choices were to invest today or never invest. we would invest today. In that case there is no option to wait a year, and hence applies. no opportunity cost to killing such an optionv so the standard NPV rule We would likewise invest today if next yearwe could disinvest and recover our $ 1600 should the price of widgets fall. Two things are needed to introduce an irreversibility, and the ability to opportunity cost into the NPV calculation invest in the future as an alternative to investing today. There are, of course, situations in which a firm cannot wait, or cannot wait very long, to invest. (One example is the anticipated entry of a competitor into a market that is only large enough for one hrm. Another example is a patent or mineral resource lease that is about to expire.) The less time there is to delay, and the greater the cost of delaying, the less will irreversibility affect the investment decision. We will explore this point later in this book as we develop more general models of investment.
vb-llplc
(().5)
=
-7 l l
x
-/
3(j()
+
.
=
l
( l l )l
=
$()1)
.
.
-1
$ l t.)8(). In tlther Solvingthis for yields (l/lf/ ()lllv ltobv llow :tt a ctlst factory widgct the widget llctory llob' build opportunity to
vvords.
the (lpportunity to build :t v:tlue 1 the $ t)()()has sanle as an (,1, fJr llext S 1t?8(). yctlr at a ctlst with the fulr widgets. Finally, suppose therc exists 11 l'utures market tlxpected (ne equal thu price for delivery futtlrc sptlt t() tures year thlm ntlw price. that is. $2()().2N'Wluldthtt ability t() hetlge on the futurcs market changc =
tlt-
our investmcnt decision'? Specilically, wlluld it Iead us to invest now, rlther than waiting a year? The answer is n(). see this. consider investing now ttnd hedging the price risk with futures cllntracts. X) hedge all price risk. we wtluld need to sell short futures for l 1 widgets; this would exactly offset any fluctuations in the NPV of our project next year. (If the price of widgets rises to $3()(). our project would be worth T33()().but we would lose Sl l ()() on thc futurcs contract. If the price tkll to $ 1()t),our project would be worth only $ 1l ()()- but we would earn an additional $ l l()()from the futures. Eithcr way, wll end up *1'il
:ln this exampie. the futures pric? woultl equai thc expcctcd future pricc because wc assumed that the risk is fully diversiliablt!. ( If the price ()1* widgets were ptlsitivttly ctlrrclatcd wilh the markct portfolio, thc futures price wtluld be less than the expected future sptlt price.) Ntpte that if widgets were storablc and aggrcgllte storage is pllsitive. the marginal ctlnveniencc yield from holding inventory would havc to be I 1) percent. The rcason is that since thc futurus price equals the current sptlt price. thc nct htllding cllst (thc intcrest ctlst ()f I t) pcrcvnt Icss thc marginal conveniencuyield) lnust be zerl).
Llevelqalg
Illl-ltlllcitlll
3()
with 11 net project value of $220().)But this would also mean that the NPV of less the 1&)0 cst ()f the investment), exactly our project today is Slt) ($2200 withotlt hedging.s what it is Hence there is no gain from hedging. and we are still better off waiting until next year to make our investment decision. This result is a variant of the .$
Modigliani-Miller ( l 958) theorem. Operating in te futures market is only policy. and barring the possibility of bankruptcys it has a form of snancial value of the tirm's no real consequences for investment decisions or for the investment opportunities.
to Financial
Analor
1.A
Options
Our investment opportunity is analogous to a call option on a common stock. It gives us the right (whichwe need not exercise) to make an investment expenditure (theexercise price of the option) and receive a project (a share of stock) the value of which lluctuates stochastically. ln the case of our simple the lz?/n(.,y,'' meaning that if it were example, we have an option that is option is said to be payoff. (An would yield positive net a exercised today it negative exercising of tlte lnoney'' yields net payoff.) We today if it a it is money,'' better the to wait rather found that even though the option is will exercise our rises to $300. we than exercise it now. Next year if the price will worth fz'l which receive be $33()() option by paying $1600and an asset will be worth only $ l 1()(), asset falls 10(),this If the price 300/( to S 1 )f Ej'''j and so we will not exercise the option. that We found that the value of our investment opportunity (assuming the actual decision to invest can indeed be made next year) is $773. It will be helpful to recalculate this value using standard option pricing methods, because laterwe will use such methods to analyze other investment problems. To do this, let F'tl denote the value today of the investment opportunity, that is, what we should be willing to pay today to have the option to invest in the widget factory, and 1et Fl denote tbe value of this investment opportunity nextyear. Note that Fl is a random variable', it depends onwhat happens to )Jthe price of widgets. lf the price rises to $300,then Fk will equal S'') 300/( 1 1600 $1700.On the other hand, if the price falls to $100,the option to invest ''f??
Lkout
nin
=
=
.1
.
.1
-
=
aexnl.q., tc horizens of a uea.r or so. If tb.ere wf.wre f' .3Ntzst futures markets r' r . for widgets over the indeh' nite future, an equivalent hedge wou ld be to sell short one each futu re year, that is, to sell forward tht! enti re output stream. The resul t wou Id be tznlv
.
J
:k
Itl,res
4,nrd rk'et
widget
in
the same.
//1tJ
oll(.'t:ilts F/l?'t'pI/g/?
'?llp&,
E--b-tllllil..b'
willgo unexercised. and in that case /--1will equal (). Tllus wtl know al I ptlssible values for F3 The problem is to Iind 6-). the value of thd optitln today.i .
To solve this problem, wc will creattl a portlbl io that has two tron-lptlntt 1-1ts: the investment opportuni ty itsel anl :1 certain Iltllnbe r of widgets. NVe wil I pick this number of widgets so that the portfolio is risk-fret!, that is- so that its value next year is independent of wllether the price ()t' widgets gtes up t)r down. Since the porttblio will be risk-frce. we know that tlle rate of rettlrn (lntt can earn from holding it must be the risk-gree ratc of interest. (I f the rettlrll on the portfolio were Iligher than the risk-frec rate. nrbitragetlrs cotlld earn unlimited amounts of money by borrowing at the risk-frt!tl rnte and btlying the portfolio. If the portfolio's return were Iess than the risk-free rate. arbitrageurs could earn money by selling short the porttblio and investing tlle funds at the risk-free rate-) By setting the portfolio's return equal to the risk-free rate, we will be able to calculate the current value of thc investment opporttlnity. Specitically. consider a portfol io in wllich one l:()ItIs the investment (3pportunity, and sells short n widgets. ( Ifwidgets were a traded commodity. such as oil, one could obtain a short position by borrowing frllm nnllther prodtlceror by going short in the futures market. For tlle moment, howevera sve need not be concerned with the actual implementation of this pllrtfolio-) The value of this porttblio today is m4) /$) tl J.1) /$) 2()()??. The value of the ptlrtF 1 lt /$ This depends ()n l9b I1' Pl turns llut to be folio next year is * I that Fi l 7()0, then * l l 7()() 3t)()??. If /RI turns out t() be $ l ()(). $300. so 1t. that then F ()() * l (). N()w, let us chotlse 11 s() that the ptlrtfolil) I so risk-free, that that * I is independent t)f what hitppens t() tlle price. is, s() is do this, just set =
=
=
-
.
=
.
=
=
-
-
=
-
-
-l')
)() 3()()11 177( --
=
--
l ()()l l
.
whether the price ()t' 8.5. With /1 (lhosen in this way, tp I widgets rises to $3()()or falls to $ 100. Now let us calculate the return from holding this portfolio. That return is the capital gain, *1 *), minus any payments that must bc made t() hold tht.l short position. Since the expected rate of capital gain ()n a widget is zero (the expected price next year is $200, the same as this year's price). n() rational investor would hold a Iong position unless he or she could expect to earn at least 10 percent. Hence selling widgets short will require a payment of -85()-
or, n
=
=
-
4In this example. aII uncertainty is resolved next year. Therefllre an ()p(i()n to wllit has Ilt) convttntillnal NI'V critcrilln at that timc. Waiting has relevance only this year. ln Iatt!r chapters we will ctlnsider mllre gencnll sl'tuatitlns to wait rtltllins value al :111 times. where uncertainty is never fully resolved. and the tlption
value next year. and investment is made accordina t() the
/?l/p-t'pt/t..li'f..)/l 0. l J1) $20 perwidget peryear. (This is analogous to selling short a dividendpaying stock; the short position requires payment of the dividend. because no rational investor will hold the offsetting Iong position without receiving that dividend.) Our portfolio has a short position of 8.5 widgets, so it will have to pay out a total of $ 170. The return from holding this porttblio over the year is theretbre =
-850
= = 680 Because this return is risk-free.
free rate, which we have assumed is portfolio, *4) 6) 11 C3: =
6,
-
-
+ 1700
-
l70
Fi).
we know that it must equal the risk10 percent. times the initial value of the
-
680
-
6)
=
0. 1 (6)
l700).
-
=
Ektllllples
dynamic programming approach. In this case it gives exactly the same answer. because all price risk is diversitiable. Later in this book we will explore this connection between option pricing and dynamic programming in more detail. 1.B Characteristics of the Option to Invest We have seen how our investment decision is analogous to the tlecision to exercise an option. and we were able to value the option to invest in much the same way that financial call options are valued. To get more insight into the nature of the investment option. Iet tls see how its value depends on various parameters. ln particular, we will determine how the value of the option and the decision to invest depend on the direct cost of the investment. /. on the initial price of widgets, Jl,, on the magnitudes of the up and down movements in price next period. and on the probability t/ that the price will rise next period.
Changink /e Cost ofthe Investment So far
we have Iixcd the cost of the
investment. 1, at $ 16()(). I-low much would were above or below this number'? We can Nnd out by going through the same steps that we did before. Doing so, it is easy (lbtain a risk..frce porttblio depends to see that the short position nacded to
the option to invest be worth if /
on l
as follows--s
11 16.5
=
-
up??/.'?/c
(5)
We can thus determine that 6) $773. Note that this is the same value that we obtained before by calculating the NPV of the investment opportunity under the assumption that we follow the optimal stratebry of waiting a year before deciding whether to invest. We have found that the value of our investment opportunity, that is, the value of the option to invest in this project. is $773. The payoff from investing (exercising the option) today is $2200 $ 1600 $600. But once we invest. our option is gone, so the 5773 is an opportunity cost of investing. Hencc the /1// cost of investing today is $ 1600 + $773 $2373 > $2200. As a results we should wait and kecp our option alive. rather than invest today. We have thus come to the same conclusion as we did by comparing NPV's. This time, however, we calculated the value of the option to invest, and explicitly took it into account as one of the costs of investing. Our calculation of the value of the option to invest was btsed on the construction of a risk-free portfolio, which requires that one can trade (hold a long or short position in) widgets. Of course, we could just as well have constructed our portfolio using some other asset, or combination of assets, the price of which is pertkctly correlated with the price of widgets. But what if one cannot trade widgets. and there are no other assets that span'' the risk in a widget's price'? In this case one could still calculate the value of the option to invest the way we did at the outset by computing the NPV for each today versus Mzait a year and invest if the price goes investment strategy (invest up), and picking the strategy that yields the highest NPV That is essentially the =
Deb'elopil'g Ille Ctp/lctz/p/-Tllrottgll
=
The currcnt
value
of the option to invcst is thcn given by
6) Equation
0.4)05 1.
-
(7)gives the value
=
l5t)() t).455 1. -
of the investment opportunity as a tnction of $16()(),it is of / for which
the direct cost of the investment, 1. We saw earlier that if l better to wait a year rather than invest today. Are there values investing today is the pretrred strategy'? To answer
=
this. recall that we should invest today as Iong as the payoff
from investing is at least as Iarge as thel// costs that is, the direct cost, 1, plus the opportunity cost 6). Since the payoff from investing today is ), $22()0. =
5As before. the valud of the portfolio next year is * j = F, t If Pl = $3(1(),F = 336#)- /, = 33t)t) l 31)4)l1. lf Pb = 51()1).and 1 is not so low that we wlluld invcst anyway, Fb = (). l0() ?l. Setting the 4)1 for each price scenario equal gives the equation above for tt and *1 = -n
,
so tl)h
-
-
's
-
.
34
Iltlrodllction
we should invest today if 2200 we should invest as Iong as
6,. Substituting in equation
I +
>
I + 1500
0.455 /
-
(7) for FI.).
22()().
<
Thus, if I < $ l 284- one should invesl today rather than wait. The reason is that waiting means giving up revenue in thtl tirst year, and in this case the lost revenue exceeds the opportunity cost of committing resources rather than keeping the investment option opcn. However, if l $ 1284, Ph) 1. and one would be indifferent between investing $9 16 6) today and waiting until next year. (This can also be seen by comparing the project's NPV if we invest today with the NPV if we wait until next year-, in either case the NPV is $9 16.) And if J > $1284. one is better off =
=
=
-
waiting.
Ljt..'b-ellpbq//?t; C-()?1(..(,J7/A. Tlllzllqlt 5??lJ?&-/.i2rt???lJ)&: l 11u'l'ltllntpfili vtit illg (l 11c (the sacridice t)f tl'le irllrnediilte prtplit) Nvhtltlle (lpti k)f lnal ly :t fter tlbservillg ttJ decide ;.l17iI tlle ity r t ilc prictl l'ltts value I1l;.tl. and i beconltls exercise down). ilnnlediate t)I)t gone up t)r
Price Cltanging the .l'z1lWt# btlt now vary the initial Let us again fix the cost of the investment- l at $ l (,11)(), price of vvidgets. J1,. To do this, we will assulne tllat whatever /1) happens t(.' Nvith be, with probability 0.5 the pricc next year will be f () percent higher. antl probability ().5 it will be 5t) percent lower. (See Figtlre 2.3.) .
portfolio in vvllich To value the option to invest, we agai n stl t up :1 risk and sell short some ntlluber of widgets. The value of this hold the option we porttblio today is r.p4/ 6) 11 J1,. lts valtle next yttar tlepends ()11 l Tht, value of a Nvidget t'actorynext year is 1,-1 )7:-')/31/ ( l l )r l l li but we wil l l )t)t). the cost ()f tllc invcsfnlent. only fnvest in the tcqlr.y if its value ttxcfceds l l P, l (:)()1. Stlppllse /:1)is in the range wllere if thc pritrtl Hence max 11). that is, if 1) = l /1)) it wil 1be worthwhi le to invest, bu t if goes up next year ( (ltht!r pllssibilitics sI1llrtly.) will down it not. (We will consitler price the goes klntl t'p 11 /1) 11 thd = tlp, f1, 6.5 l (,1)() if prictl * l J1) l l Then l glltls sctlnltritls the these * gives Equating thtt down. prictl 1 twt) tlr if the goes nAak' risk I'retz : the portfolil) /1 of t hat cs value -free
=
The dependence of 6) on I is illustrated in Figure 2.2. This graph shows the value of the option. 6), and the net payoff from investing today, lz't) /, both as functions of 1. For I > $1284, 6) 150() ().455 l > l$j /, so the option should be kept alivea that is. we should wait until next year betbre deciding whether to invest. However. if I < $ l284. 6) 1500 ().455 / < 1$) /. s() the option should be exercised now- and hence the valtle ()f the option is jtlst its net payoff, K) I In the terminology of options. when / is small. tht, nttt payllff thlm imin the mtlney.'' At mediate investment becomes large. ()r the (lption is critical threshold where point or it is stltliciently deep. the ctlst of waiting a -
=
-
-
=
-
-
-
.
(?1%
tllltyvtriglls
-
.
=
=
.
.
,$
-l
-
=
.5
-.().5
.5
=
-
's
-
K&dtlep
/1)+ 81)1)whtlther tlle price gtles Note that with 11 chosen this way. tp I up t)r down. Ntlw let us calculate the return ()n tilis ptlrtllitl- rel-nembcring that the short position will require a paymdnt ()1- (). 1 ?? J1) I /1) l ()t). That return 6:1(). Since the return is risk-free, i t mtlst cqtlal (). l *t) is 6.6() /-1) -8.25
=
2000
W l
.4,5
-
.-.1 r
tt
1600
=
ww
-
--w
12Oo 80O
y-1500
-
--.
'.0.455 / ..-
.-.
--
I I
1 l I '
400
80O
=
-
Fz l )
--
400
O O
-
.6)
l
xw
N
x. xv
N
1600 12O0N 1284 /
Pa
'-'->' Nw
N
N
N
N
2000
=
2
=
1.58
=
o
--*'
Pz 1 2
r
t
n r E) o2 0 1 f'-izure 2.3. Prdrt?f (' IVlqcL =
N.z
.
%.J I
'
.
%''
'
q p
.h#'
.
t)
36
llltrodttclioll
0. 1 /7i) 1
.Jl)+ l60. Solving
.65
-
tbr F() gives the
Fll
=
7.5 fl)
value
Table 2. 1-
of the option to invest:
727.
-
We have calculated thevalue of the investment option assuming thatwe would only want to invest if the price goes up next year. Howevera if Jl) is Iow enough we might never want to invest, and if C) is high enotlgh it might be better to invest now rather than waiting. Below what price would we never invest'? From the equation above, we see that 15) owhen7.5 C)= 727, or /$ = $97. If /l) is less than $97, 1Z1 will be Iess than the $1600cost of the investment even if the price rises by 50 percent next year. Forwhat values of /$ should we invest now rather than wait? Once again, should invest now if the current value of a widget factory, K),exceeds its we . total cost, $1600 + &). Hence the critical price, which we will denote by C*) satisfies F4) 1600 + 6), that is. 11 #t*) 1600 + 7.5 C7 727, or #(*j= $249. If f1) exceeds $249. we are better off investing today rather than waiting. The option is sufficiently deep in the money that the cost of waiting (the sacrifice of period-o profit) outweighs the benefit.: We obtained this critical price by tinding the value of the investment option, but we also could have found it by calculating (as a function of /1)) the NPV of the project assuming we invest today. and equating it to thtt NPV assuming we wait until next ycar and then decide whether to invcst based on the outcome for price. (We leave this for you as an exercise.) The value of the investment option is thus a piecewise-linear function of the current price, lj, and the optimal investment rule Iikewise depends on Jl). If C) s $97. 6) 0. and one should never invest in the factory. If $97 < C) S $249, then 6) = 7.5 J$) 727, and one should wait a year and invest if the price goes up. lf J1) > $249. then 6) = 11 /1) 1600, and one should invest immediately. This solution is summarized in Table 2.1. In Figure 2.4 we have plotted 6) as a function of Jl,. Suppose our only choice were to invest today or else never invest. Then the option to invest would be worth the maximum of zero and 11 C) 1600, that is. the value
Lxalllples
cj/?l/?/t!
Tllr()ltgll Developing tlle Ct?plcf-zp/of Izis/t/t.r
OJJf#?/l
Region
Option Value
/70S 97 97 < f1) S 249
6) 6)
C)> 249
/-1)=
= =
/t)
Iltbbesttlllt/ lllb?estlnentR!//t: Optimal Investment Rule
Never invest. Invest in period l only if price
0 7.5 /-1) 727 -
l l C)
has gone up. lnvest in period ().
1600
-
=
,
=
=
-
of a widget factory today, Pi), less the $ 1600 cost of building the factory. (In Enancialjargon.this is the ltrinsic pflftl of the option the maximum of zero and its value if it were exercised immediately-) Also, we would nvest today > > 4 as long as 11C) > $ l600, that is. as Iong as /1) $ 1 6. When Jl) $249. the lhen it is f)(), value l worth f1) I because of l intrinsic its invest optil)n to shown l 60() l wait. is today rather than 1 fl) Hence a solid invest as optimal to < $249, however- the option valucs of J1) When than /!) $249. for grcater line unexorcised- at to invest is worth lnore than I l J$) 1()()1),and should be Ie until next least year. '
-
-
-
y'
1800 1600
=
1400
-
1 1 Pz
1200
-
ur
z
1000
.
.
800
,'
7.5/% 727 -
-
'Ybu might think that immediate investment woultl be justifie only if we wouitl invest ncxt
year irrespective of whether the price went up or down. In fact. thc critical price for immediatll investment is Iower. Assuming we wait, we will invest next year if f''j 16t)0 1l 1$ 1600 > (). 0.5 Jl,, we would invcst ()nly if 5.5 /l) l6t)0 > (). t)r so if the price gocs down. that is. P, /1) > $291 which exceeds Jl; $249.Tlle problem with the faulty intuition is that it ignorcs thc protit we could elkrn thiq year by inves4 ir!g now lndt-txd f. a .!; of. say, $260. it is better tt) invust today even though if we did wait, we would ?7:J/ invest next year if it turned klut that tlle price wen down, -
=
:
=
=
for
,
.--..w.
.
6O0
.'
.
40O
0
40
80
120
160 ra
Cz
1 1 l j l l
I I l l
,'
'
O
'
,
1
.'
200
.
.
l
' ''
-
-
1600
-
200
24O
280
320
38
Developtj; J/rf.! C-llllw.'pts7W/'(Jf
Il3rotLtctl'llll
Note from Figure 2.4 that 6) is a convex function k)f /1), and that 6) is greater than or equal to the net payoff from exercising the option today. 1$)- 1, up to the optimal exercise point ($249in this examplc). As we will see, the value of an option to invest typically has these charactcristics.
Changing the Probabilitiesfor Price We can also determine how the valtle of the option to invest depends on
t/,
the probability that the price of widgets will rise next year. (So far we have assumed that this probability is 0.5.) To do this. we will let the initial price, J1,, be some arbitrary value, but we will fixthe cost of the investment, /, at $ 1600.
We can then follow the same steps as before to find the value of the option and the optimal investment rule. The reader can verify that the short position in widgets needed to construct a risk-free portfolio is n 8.5, and is independent of (The reason is that n depends on the possible values tbr the portfolio in period 1, * 1 and not on the probabilities that the portfolio will take on those values.) However, the payment required for this short position does depend on /, because the expected capital gain from holding a widget depends on t/. X) calculate thisa !et 7()4#1 ) denote the expected price of widgets next year. calculated conditional on the knowledge of the period-l) price.? Thus rt)(Pb) ((/ + 0.5) f'1). Therefore the expectcd rate of capital gain on 11 widget is g-()( P3) Jl)J/C) q 0.5. Hence the required payment per widget in the short position is 0.5)1 /l) (0.6 f/ ) J1).Setting * 1 *t) ((1.6 t/ ) l /1) t).I *()s t0. l ( and setting 11 8.5, we find that if Jl) > $97, the value ()f the option is =
.
,
=
=
-
-
-
=
-
-
-
-
=
-
=
8)
=
15 (? Jl)
l455 q
-
.
Note that 6) increases as q increases (aslong as f1) > 97). This is as we would expect, because a higher q means a higher probability that the price will go up and the option to invest will be exercised. If C) S $97,we will never invest. whether or not the price goes up, and 6) 0. How does the decision to invest depend on :/? Recall that it is better wait rather than invest today as long as /-1) > 1)) 1. In this case. )'() = to /X'4 f1)/( l (6 + 10 q) /$. Hence it is better to wait as fl) + S l q + 0 5) =
-
.1)1
.
Igh
t'trl//lp/t.,, LL-
-t'//'l/a#(.z
long as I 5 /1) l 455 q > (t) + l () t/ ) /1) - l (',(2)(),t llat is. as Iong as /1) < :1..; t/ increasds. tllat is- :t ( l ()()() 1455 (1 )/((' - 5 t/ ). >Nlso-l'*11 tlecreases #* () higher probability of a price increase intluces the lirnl t() invest nlortl reatlily. Why'?The cost of waiting is the revenue foregone by not selling a widget this with /''(). Since a Iligher ty makes a batl otltcollle next Period. which increases period less likely. it rctluces the valtle of vvaiting. Tllus :1 higher q implies tllat of svaiting exceed the value of waiting. a smaller 3-1)suffices to make tlle cost (/
-
-
Increasing the Uncertaint.y over f'Wt'c When we changed the probability t/ wllile keeping alI tlle othttr parametors flxed.we changed the expected price in period l Suppose the expectttd price in period l remains fixed at the initial price Ievel. #(), btlt we increase the size of the up and down changes so that the variance of tlle period- 1 price spreatl in tlle distribtltion increases. %vhat e ffect wotlld such 11?zI:*tl?l-J??-c'.c'?7.'/Ig PI have of value the investment option. 6-). and on the critical price. for on the svhich rather t han wait? optimal it is to invest inAmedilltely #*, above 0 will (/ is ().5. btlt now the pricc wi 11t2ithe r rise 'We assume as before that rather than l7y5() percent as before. Thus or fall in ptlriod 1 by 75 percent, expected value is st ill fl1. To lind /$ ). the variance of l>b is grcate r. but its port f(llio and we go t hrllugh the sanle steps as be tbre. creat ing a risk equating its return to the risk-free return. Again. let the ptlrttblio bc Iong the 1$) 11 /!). I11 investment option and short 11 witlgets. s() its vClltltl ntlw is thl will bc worth period l thtl price will rise t() l /!), in which cilse the prlject (h wil ?? /1). ()r l tltl ual l 9.25 /.:1)- l (k)() ) 1zr1 l 1 141 19.25 J1l so that I which will equal -().25 11 J:1y.Equating case t' l the price will fall to ().25 P(,.in these two possible values ()f tp 1 and solving for ?? gives .
.-free
=
-
.75
,
.75
=
=
-
n (Then, *
-
C) + 267 irrespective
-3.21
1
l 2.83
=
=
1()f)7/ /!)
.
t)f 141 Remembcring .)
/'$) position will require a payment of (). l n J'll l portfolio is 8.34 Jl) 8) 693. Setting tllis equal to t).l 107 and solving for 6) gives .28
=
-
-
-
that thtl shtlrt l ()7, the return ()n the /El) (). 1 1$) - l + *4) .28
=
=
/$) 8.75 /-1) 727. =
7We will use C to denote the expectation
(mean)of a random
variable,
on C will indicate that the expectation is conditional on information
and a time subscript
available
as of that time. Similarly, we will use b' to denote variances. These symbols are used consistently throughtlut thc book. Other notation is specific to each chapter ur even section. A symblll glossary at the end of the book collects the signiticant symbtlls and states what they denote.
-
If Jl) is $200, 6) is $1023, which is substantially larger than the value of 5773 that we found before when the price could only rise or l'all by 5() percent. Why does an increase in uncertainty increase the value of the option to invcst'?
Because it increases the upside potential payoff from the option. leaving the
lntroductioll
40
downside payoff unchanged at zero (sincewe will not exercise the option if the price falls). We can also calculate the critical initial price. 131. that is sufhcient to warrant investing now rather than waiting. Again, just equate the current value of the widget factoly Ftl 11 J$, to its total cost, $1600 + ). Utilizing equation (12)for F(), this gives Pl $388,which is much larger than the value of $249 that we found before. Because the value of the option is larger, the opportunity cost of investing now rather than waiting is larger, so there is a greater incentive to wait.
Developing
Ille
Cf-nlcz/pf.Tllrollgll .ki7lJ?/t3Erflp?lp/p-j'
It is easy to show (andshould be intuitively clear) that the point of indift-erence between investing now and waiting occurs in the range of Jl) where investment in period l is warranted if the price goes tlp but not if it goes down. In this case the NPV in equation ( 14) simplifies to
=
NPV
=
tbad
'ibad
Suppose that the initial price is J$, but in period l the price becomes
/1
(1 +
ul/$
with
probability q,
(1
J) J
with
probability l
= -
=
-
/ + #; + q
''= (1 + !/)/1) (1.1) f l ,
(1
-
(1
q)
=
JIIJ.
I/)
t
=
j
J) J1) (1.1) , -
On the oiher hand, if we wait the NPV is
Equation
I
=
( j( 0. 1
t'. 1 + ( I
0. l + ( l
l.1
-
t/)
(F)( l
-
-
J)
t'bad
srstspelled
out by Bernanke
j
.
(16) has one detail that is important
#(*jdoes not depend $ to note upward the size of It only depends in any way on an move. on the size of (/ and of 11 downward d, the probability downward l ( ) move. move. Also. a the critical the magnitude of the is ds larger is the prices Jl'j it is Iarger the ; wait-g news'' that drives the incentive to Possible spread in l in a We can also examine the effect of a mean-preserving J/( lt + J). Then more general way than we did betbre. Suppose we set q (/ #(2j lt and tt J S /5 ) Jl), and k'4P ) Hcnce if we increase proportionally. we keep fy and 7( P3) unchanged while increasing the variance of 1) Observe from cquation ( 16) that if J is largdr but (y is unchanged. C; incrcases. Again. we hnd that a mean-preserving spread increascs the incentive to wait. tt.
-
ttbad
=
=
=
.
.
Extending the Example to Three Periods In our example, we made the unrealistic
assumption
that there is no uncer-
tainty over the price of widgets after the first year. in most markets. future prices are always uncertain, and the amount of uncertainty increases with the time horizon. In otherwords, while the expected future price of widgets might always equal the current price. the variance of the future price will typically be greater the farther into the future we look. Later in this book we will model 9If current proht can be negative and the 5rm is contemplating
B'Fhis news principle'' was be found in Cukierman (1980).
( l5)
.
'>D
+
+ 1l ( 1 +
-
To keep things general, we will 1et the cost of the investment be 1. In this case, the NPV if we invest now is NPV
(- l
Equating the NPV of equation ( l3) tbr investing now with the NPV of equation ( l5) for waiting and solving for J1)gives Jl;
tgood
q l l .
X ''Bad News Principle'' We can take this one step t'urther by allowing both the probability q of an upward price move as well as the sizes of the upward and downward moves news'' (an upward move) to vary. ln so doing, we can determine how news'' (a downward move) separately affect the critical price, C7, and that warrants immediate investment (inthe above calculation the upward and downward moves had to increase or decrease together). We will see that /l; depends only on the size of the downward move, not the size of the upward of it is the ability to avoid the consequences move. The reason is that wait-S news'' that leads us to
=
( 1983), and
the ideas can also
a costly disinvestmcnt
or
abandonment of a project, the bad news principle turns into a good news principle: the size and probability of an upturn are the driving forces behind the incentive to wait. Rccalling our discussion of suicide in Chapter 1. we should emphasizc this point. If the potential bad outcomes become even worse. that does not increase the incentive for immediate abandonment. However, if potential good outcomes become better, that increascs the value of staying alive.
Illtr(;tltt'tl'tlll
the stochastic evolution of price in just this way. At this point, however. we dan obtain additional insight into the nature of the investment problem by extending our example so that there arc three periods in which the investment decision might be made. We will asstlme some level Jl1,and at /71 l C) or /71 again either increase .5
=
('!
h
1
l i .
=
() the price of widgets begins at as before that at ? 1 it will either increase t)r dccrease by 50 percent (to 2. it will 0.5 J1,), each with probability 0.5. Then, at t =
/
=
=
or decrease by 5() percent with equal probability. Hence values tbr Pj-.2.25 f1)-0.75 C), and 0.25 C).The price three possible there are remains this level for :111 l t 2. (See Figure 2.5.) We will again fix the at then of 1, at $ 1600. investment, the direct cost adding of price uncertainty, our investment problem period By one more becomes quite a bit more complicated. One reason is that there are now Iive different possible investment strategies that might make sense and must be considered. In particular. it might be optimal to (i) invest immediately; (ii)wait a year and then invest if the price has gone up. but never invest if the price has gone down; (iii)wait 11 year and invest if the price has gone up, but if it went down wait another year and invest if it then goes up; (iv)wait two years and only invest if the price has gone up both times; or (v)never invest. Which rule is optimal will depend on the initial price and the cost of the invdstment. and the value of the investment option must be calculated for eat:h possible rule. The second complicating factor is that while we can still compute the value of the investment option by constructing a risk-free portfolio, the makeup of that portfolio will not be constant over the two years; we will have to
1,/1 It-t.zr?fs -L'121-(.33 lrl f /1t!C't?? Si' ?lp/c E.a-tl?) llllctb flcvtrrff-lp?
change the at t
l
=
number
of
'widgets
in the short posititln after tlle price cllklnges
It)
.
We wil l again approach this problenl tlsi ng option prici ng n'let hotls. %Ve ()- /7().as :1 l'tlnction want to obtain the value of tlle option to invest at / of the initial price. /1,, as well as the optinaal investnient rtlle. Tllk) trick is to work backwards. We will solve tsvl) separate investment prllblenls looking l first for l ().5 /-1),and then for l fonvard from t l /1)-asstl lning in both cases that Nve have not yet invested. In each case we will tltlttlrlnine Fb, the value of the investment option at t = 1 by constructing a risk-free portfolo and calculating its rttttlrn. Given the tsvo possble values for (one for PL = t).5 1) and one for J''! = l /,1,(),we then back up to / () and determine 6) by again constrtlcting a risk-free portfol io and calculat ing its =
.5
=
=
.
=
,
-l
.5
=
return().5 J'l). and that /1) is such tllat we wtptlld Suppose that at / l PI invest in period 2 if the price goes up, but not if it goes down. Now construct a portfglio that incltldes the option to invest and is sllort slln-le ntlmber /1 I t'f J-.1 11 l /31 I f tlle price goes up widgets. The value ()f ths portlblio is * 1 in period 2 (to (3.75 /l), we wi lt invest. so Fz wiII ttqual (3.75 Jl)/ ( l l JJ (p: will cqual 8.25 C) lt()() ().75 11 1 1)p. lf t htlprice 1600 8.25 f-1) I()()()-and ().25 down in pcriod 2 /1) t() ), we will not invest. fC':will eqtlll ()allntl *2 will ( goes /1 ! f$,. Eqtlating the expressillns )r (pa under thc twl) sccnltrills. equal llio the wi be find hat risk t d' 21 11 free I6 )/ /$)-, t Ilen *2 i 324)1 ptprt , we will equal 8(3() 4. l 25 /l, whether tl3e prit:e gtes up t)r tltJwn. Caltrulnting tlle portfolio's return (ma t'p I (), l 11 ! 1) ) and se tt ing it eq tlal t() thc risk return (().l ml ) gives us the valtle of the investment optitln: /th 3.75 /1) 727.3. Also. note from this tllat F 1 () Nvhen J1) l 93.94. I-ldnce if the price ' has gone down in pcritld l and /$) < 193.94, we will never invest. We must now repeat this exeruise assuming that priue has gone up in period l that is, that /71 = l /1). Y()u can verify that in this casc the riskfree portfolio requires a short position ()f n 1 = 16.5 1()67/ J'1)widgets, and the value of the investment optilln is F I lI J$) 727.3. In this casc Fl = () when J'l) = 64.65. I-lence if /$) < 64.65 wtt will never invest at 1111, even if the price goes up in both periods. Als(?. suppllse we invest in peritld 1 rather than waiting until period 2. Then &ve would obtain a net value 1z'1- l 11 ( 1 #()) 1600. Setting this equal to h and solving for /1)gives /'!) l 66.23. =
=
,
=
-
.
)-N't7
-
.
=
-
-
-
-().25
.5
=
-
-
-
-fr(2tl
-
-
=
E)
=
l 0
l= 2
=
l
=
3
-
=
.5
J2 J2
Pj
=
1
Pa
=
2.25/%
-'--'>'
Pz = 2.25P
-'-'''>-
.
-
.25
=
.5/%
L 2
Pv
Pz = 0.75/%
'-''-'>'
Pz
=
Q.75Pz
'--'->'
=
..
J2
2
%
=
-
.5
-
=
0.5/%
L 2
%
=
0.25/%
-''-*'
Pz = 0.25/%
'--'*-
''l''l''hcmethod of kecping a ptlrtl'lllitl riskless by changing its ctlmpllsititln through repeatcd hedging str:ltetzy.'' llnd is of considerable irnpl3rtanctt in financial trading is called :1 economics. We will devktlopit in a gtlneral setting of continutlus tirnt in Chaptttrs 4 and 5. bsdynamic
Figure 2.5.
Prc: of Widgets
Itllrodttctioll
44
Hence if J1) > 166.23, we should invest in period 1 if the price has gone up, rather than wait another year. we have We now know Fl and the optimal investment strategy (assuming /1 of possible we can the tbr each so outcomes two invested) for not yet and calculating portfolio risk-free constructing again Fi) by a determine once its return. Since the optimal investment strategy depends on Jl,, this must be which done for diterent ranges of Jl), that is. for 64.65 < & S 166.23 (in periods), for both tbe in price only if period in 2 up invest goes case we would the price would if 1 which invest in period 193.94 < we case 166.23 C) :jE (in would never invest), and for J'1)> 193.94 (in goes up, but if it goes down we whichcase we wouid invest in period l if the price goes up, but if it goes down wait and invest if it goes up in period 2). The solution, which the reader might
E-b'tllllplf.n.
up/?/l/tr
Dcvc/trp/s/lt#?c Collt'.'pt-b-Tlll-otqqll
2800 ?400 11Pz
,
want to verify, is summarized in Table 2.2. Figure 2.6 shows 6) plotted as a function of f'1).As in the two-period model, it is a piecewise-linear function. but now therc are more pieces. each corresponding to an optimal investment strategy. Also, suppose the only choice were to invest today or else never invest. Then the option to invcst would be worth l 1 /1) l60t and we would invest today as long as 1l f1) > $1600,that is. as long as /l) > $146.When l) > 301.19, the option is worth this much, because thcn Fu 9.2 C) 1057.9 l 1 /1) l 600. and it is optimal to invest today rather than wait. Hence 11 Jl) 1600 is shown as a solid
2000 u!:'
1600
-
-1
1600
' .
.* -
1 200 ..
400
'
*
0
40
80
120
. I 160
1'
. ,
l
-1 I
j
I
I
200
I 1 1 l
.'
.*
l 1, ,1
j
1 )
e
.*
800
O
--.hw
240
280
320
360
400
-
=
=
-
-
-
Iine for J$) > 3()l 19. l7ut is shown as 11 dotted line for l 46 < /1) < 3()l l 9. Finally, notc once again that /$) is 11 convex function of Jl,, and that f;;.)ls grcater than or equal to thtl nct payoff from exercising the (lption today, l$) /, up l l 9 in this case). to the optimal exercise point ($3() As butbrc. we could examine the dependenc: of 6) and the optimal exercisc point #*() on the cost of the investment. /, or on the variance of price ' changes. (Going through these caculations is no'w a bit more laborious. howexample, we ever. because three periods are involved instead of twt).) For could show that if the variance of the price changes increases, while the expected price changes rcmain the same. the value of the option /-1)will increase, reader might want as will the critical exercise price C*)As an exercise. the ()r decrease by 75 percent in each period. check P this Ietting increase by to instead of by 50 percent as in Figure 2.5. If we wanted to, we could now extend our example to four periods. allowing the price to again increase or decrease by 50 percent at t = 3. We could then work backwards. sndingFz for each possible value of Pz, then hnding Fi for each possible value of P3 and hnally hnding Ff). In Iike manner, we could then extend the example to five periods, to six periods, and so on. As we did this, we would tind that the curve for 8) would have more and more kinks. We will see in Chapter 5 that as the number ot- periods becomes Iarge, the .
.
-
Table 2.2.
ofoption 1//1/14:
/kvt!Jl
to
Optimal Investment Rule
Option Value
Region
Never invest.
=
0
=
5.11 Jl)
166.23 < C) :; 193.94 5)
=
7.5C) 727.3
301.19 Fo
=
9.2 C)
C) S 64.65 64.65 < C) :; 166.23
8) 6)
attd lnvestment Rttle
-
330.6 Invest in period 2 only if price goes up in period 1 and in
period 2.
193.94 < C)
.s
-
-
Invest in period l if price goes up. If price goes down in period 1, then never in-
vest.
1057.9 Invest in period l if price goes up. If price goes down in period 1, then wait and invest in period 2 if price
goes up.
/% 301 19 >
.
Fi)
=
11 J$
-
1600
Invest in period 0.
.
.
,
46
llltl-oflttcioll
curve fklr 6) will approllcll a smootll culwe tllat starts at zert) and rises to nleet the curve showing tlle net payoff from irnlnedilte investnlent ( fz$) I ). In ltct th two curves meet tangentially, and the point where they meet dehnes the threshold #4,*where immediate investment is optimal. -
Adding more and more periods
will make
our example
tlnreasonably
complicated. howevcr, and in any case wtluld be less than satisfactory because ultimately we would like to allow the price to increase or decrease at every future time 1. Thus we need a better approach to solving investment problems of this sort. In Chapter 5 of this book we will extcnd otlr example by allowing the payofffrom the investment to tluctuatecoltiltllottsly over time. As we will see, this continuous-time approach is quite powerful, and ultimately quite simple. However, it will require some understanding of stochastic processes, as well as Ito's Lemma (whichis essentially a rule for differentiating and integrating functions of stochastic processes). These tools, which are becoming more and more widely used in economics and qnance. provide a convenient way of analyzinga broad range of investment timing and option valuation problems. In the next two chapters we provide an introduction to these tools for readers who are unfamiliar with them.
Uncertainty over Cost We now return to our simple two-period example and examine some alternative sources of uncertainty. In this sectiona we will consider uncertainty over the cost of the investment. Urkertainty over cost can be especialy important for Iarge projects that take time to build. Examples include nuclear power plants (where total construction costs are very hard to predict due to engineering and regulatory uncertainties). large petrochemical complexes, the development of a new line of aircra, and Iarge urban construction projects. Also, large size is not a requisite. Most R&D projects involve considerable cost uncertainty', the development of a new drug by a pharmaceutical company
is an
example.
In the context of our rwo-period example, suppose that the price of a widget is now $200, and we know that it will always remain $200. However, the direct cost of building a widget factory, 1, is uncertain. We will consider two different sources of uncertainty regarding 1. The first, which we will call input cost lfactrrftzfn/y, arises because a widget factory requires steel. copper, and labor to build, and the prices of these construction inputs fluctuate stochastically over time. ln addition. government regulations
jleveloping
F/l/'f'.?l/t/l
//?c Qhlll-)lL
vsitttill'
C-b'tlll'lillfu'vb'
t llis call cllltllgtr tl'le reqtlil'trtl tltltlltititrs change unpredictably (lver tilntl, llesv salkty regtllllt illlls of one or more constrtlctitlll inputs. ( Ft'r tlxlllllple. add to labor requirenzents. cllallging envirtlllnltlntal rcgtllltilllls I'lltty or may require more capital.) Tllus. altlltlugll I l'nigllt be kntlNvn today- its vllltltl llext year is uncertain. kllltl
As one might expect- this kind of
tlncertainty
has the sal'ne eflct
()11
the
investment decision as uncertainty over the l'tlturc value of the paytpff fronl the investment, IZ it creates an opportunity cost of investing now rather tllan waitingfor new intbrmation. As :1 result- :1 projoct could have :1 conventitlllally measured NPV that is positive, but it might still be tlneconomical to begin investing. As an example. suppose that I is $ l6()()today. but next year it will increase $2400 or decrease to $8t)().each vvith probability ().5. As before. the interest to is l0 percent. Should we invest today, or wait until next year? lf wtl invest rate NPV is again given by equation ( l ). that is- l ()() + 22()t) the $()()(). today. =
-
This NPV is positive. but once again it ignores an (lpportunity cost. X) stle tlntil &ve recalculate this time the assulming wait NPV.but let next year. this, us in which case it will be ex post optimal to invest tlnly if / falls to $81)().l n this case the NPV is given by N PV
...-.84)() (().5) + l l t
'-<'
.
(1n year () therc is no
expenditure
S8()(),which
=
l
2()t) l ( l 1) .
7()4) I l
$()3t).
.
and n() revenue. I 11 ye:yr l wc invest (lnly happcn with probabil ity ().5.) I1*wtl wait a year to investp the project-s N PV ttlday is $4)36.s() wtiting ,
will
. if l falls to before deciding whether is clearly better than investing now. At this point it might appear that uncertainty alwltys lellds llne t() ptlstpone investmentss t)r at Ieast incrcase the hurdle rat: that the investment must meet. but this is not the case. If investing provides inlrmatitln- tlncttrtainty can lower the hurdle ratc for a project. Consider uncertainty ovklr the physical diffculty of completing a project. g'V'ewill call this lccllnical I//?tz?-?tI??/p-. assuming factor costs are known, how much time. tlffort, and materials will ultimately be required to complete a project'? This k ind ()f uncertainty tr:ln ' only be resolved by actually undertaking and completing the project-l One ' l This is a simplilication in that, for some projects, cost u ncertainty ca n btl rtld uced by Ii rst performing additional engineering studies. Thc investmcnt prtlblenl is tllcn more compl icated because one has three choices instead of two: start constructilln n()w, undcrtakc :ln engineering study and then begin construction only if thc study indicates costs are likely t() be 1()w.()r abandlln the project com pletely.
48
llltrotlltctioll
then observes actual costs (andconstruction time) untbld as the project proceeds. These costs may from time to time turtl out to be greater or less than anticipated (as impediments arise or instead the work moves ahead faster than planned), but the total cost of the investment is only known tbr certain when the project is complete. With this kind of uncertainty, a project can have an expected cost that makes its NPV negative. but if the variance of the cost is sufticiently high, it can still be economical to begin investing. The reason is that investing reveals information about cost, and thus about the expected net payoff from investing further. It therefore has a value beyond its direct contribution to the completion of the project. This additional value (calleda shadow valtte because it is not a directly measurable cash tlow) lowers the full expected cost of the
investment.
The following simple example will help to illustrate this. Suppose that the
price of a widget is and always will be $20(),but the cost of building a widget factory is uncertain. To build a factoly one must initially spend $10()0:With probability 0.5 the factory will then be complete, but with probability 0.5 an additional $30()0willbe required to complete it. Since the expected cost of the factory is 1000 + (0.5)(3000)$2500.and its value is $220().the NPV of the investment seems to be negative. suggesting that we should not invest. But this ignores the value of the information obtained from complcting thc (irst stage of the project. and the fact that we can abandon the project should a second phase costing $3000be required. The correct NPV is 1000 + (().5)(2200) $ 100. This is positive, so one should invest in the first phase of the project. =
-
=
We see, then, that the uncertainty ovcr the cost of a project can Iead to one postpone investing or to speed it up. If the resolution of uncertainty is independent ot what the firm does. it has much the same effect as uncertainty over the payoff from investing, and creates an incentivc to wait. But if the uncertainty can be partly resolved by investinp ir has the opposite effect. We will return to uncertainty over cost Iater in this book, and examine its implications in more detail.
Developing tlle Collcepts Tllrough <$W?w/(,a E-altlples Interest rate uncertainty
=
=
=
=
This makes the investment more attractive, 2 invest.l
Z1 =
Next suppose that the cost of the investment and the payoff from investing are both known with certainty, but the interest rate used to discount future cash flows changes in an unpredictable manner. Howwill uncertainty over the interest rate affect the decision to invest'?
x
c()()
( l 1)t
=
$2200.
.
t=()
ln ourexample.the expected value of the interest rate nextyear and thereatker is 10 percent. but the actual value is unknown. So, thc value ofthe factory next year will be with probability 0.5. q'''=1) 200/( l 15)? $ 1533 l
=
.
=
=
S=()200/4 l f
Uncertainty over lnterest Rates
and increases the incentive to
Nonetheless, uncertainty over future interest rates can still Iead to a postponement of investment. The reason is that the second effect of interest rate uncertainty works in the opposite direction .- it creates :1 value ofwaiting (to see whether interest rates rise or fall). This effect works in much the same way as uncertainty over the payoff from the investment. To clarify this, let us again return to our two-period example. This time we will assume that the price of a widget is xed at $2()0aand that the cost of building the widget factory is (ixed at $2000.The only uncertainty is over interest rates. Today the interest ratc is l0 percent. but next year it will change. There is a 0.5 probability that itwill increase to 15 percent. and a ().5 probability that it will decrease to 5 percent. It will then rcmain at this new level. What will a widget factory be worth ndxt ycar? lf there wcre no uncertainty over interest rates, that is, if we knew that the interest ratc will rcmain 10 percent. then the value of the factory next year would be
Zl
4
can llavc two eftkcts on an investment decision.
First, unpredictable lluctuations in interest rates can increase the npectetl value of a future payoff from investing. For example. suppose the investment yields a perpetuity that pays $ l per year forever. The present value of this l () percent, the value Perpetuity is $1/r, where r is the interest rate. lf r 1- is uncertain. and But $10. $1/0.10 equal either 5 percent is suppose can each with probability 0.5. so that 7(r) 15 percent, 10 percent. Then the or expected value of the perpetuity is 0.5( 1/0.05) +0.54 1/0. l5) $ 13.33 > $ l 0.
=
.05)f
=
$42()t)
with probability 0.5.
l2ln technical languagev this result is an implication of Jensen lnequality. combined with the fact that the prcsent value of a future cash tlow is a convex function of the interest rate. 'x
Jensen's lnequality says that if x is a random variable and 7'(-r)is a convcx function of then 7(./-4x)1> 7'(-(.,r1). Thus if the cxpected value of remains the same but (he variance of increases.ft/t-rllwill increase. In the case at hand. if the expectedvalue of nextyear's interest rate remains fixed but the uncertaine around that value increases, the expected present discounted value of a payoff reccived next year will increastt. .v&
.r
.r
Illtrothloqioll vltlue
Llence the expected
(.)1'
(().5)(42()()) $2867,wllicll
1.z')is (().5)(l 533) +
=
rdtes are certain. the future interest rate (holding the increases the expected value of the constant) value ot rate interest expected uncertainty the investment decison? First. affect l4ow project. But dlles the that if there were no uncertainty over interest rates, we wotlld clearly
is higher than it is when ftlture intcrest We sec. thens that
uncertainty
(lver
notc want to invest today. The N PV of the 5:/
! 13
=
:!()()()
-
project if we invest today is 7e ky ()()
-#-
:::::1
l
whereas the N PV today if $2000 $0.
l
J ( l l)
zuz
$:!1)() .
.
we wait until next year is only
$2200/ l 1 .
-
N PV
If we invest now.
is different if interest rates are uncertain.
The situation the NPV is
'
+ 20() +
-20()()
=
C Z1)
=
-
1.1
l 800 +
2867 I.1
=
=
(0.5)
1 -2()()() + l 1 l 1 .
'M
200 .05)J
.
l
=1)
(1
=
Scale versus Flexibility
t)l' scllltt trltll As students of ectlnonlics or btlsiness IklltI-I1 etlrly 0n- tltztllloluit?s be an important sotlrce of cost sltvings. By btlilding 11 Iarge plant instelttl tlf I'nigllt btt :tl7I(l to retltlt!e its avtlrltge tnlst lllltl two or three smaller ones, a lirm increase its prolitability. This stlggests tllat lirlus sllotlld respond tt) groNvtll iI1 demand for their prodtlcts by btlnching their investments, that is. investing in neNv capacity only infrequently, btlt atltling ICrgll ltntl efticient plllnts eatlll
time. Wllllt sllotlltl firnls dlla Ilowevtlr. when t Ilcre is untrertlkin ty
$806.
( I f we invest today we can mak: and sell :1 widget now tbr $2()().and we will have a factory whose expected value next year is $2867.)This NPV is positive, but suppose we wait until next year before deciding whether to invest. lf the interest rate rises to 15 perccnt, thtl value of the factory wfll be only $ 1533which is less than the $2000cost 01- the investment. Hence we will only invest if the interest rate falls to 5 percent. Since there is a t).5 probability that this will happen, the NPV assuming wtl wait is NPV
5
$ 1()()().
Tllis NPV is higher, so it is better to wait than invest now. This is a simple analysis of interest rate uncertainty. but it has some important implications. First, mean-preserving volatility in interest rates will value ofa project. but will also create an incentive to wait ncrease the expected rather than invest now. The reason is that, as with unccrtainty over future cash flows.uncertainty over future interest rates creates a value to waiting for new information. Second. if an objective of public polic.yis to stimulate investment, the stability of interest rates may be more important than the Ievel of interest rates. Policies that Iead to lower but more volatile interest rates could end up depressing aggregate investment spendingal; Aswe will illustrate in Chapter 9, with
tlelll:tntl
'Tllis prlllllttln is an inlpllrtant tlI1e 1-4.)1' l I'le e lect ric ut ility intltlst ry. I t is cheaper per unit (lf cllp:lcity t() btlild :1 Iargc cllal-li red plhver plltnt tlllkn it is tt) add capacity in srnall anltltln ts. Istlt ltt the sllnle tin-ltl. tltilities litce (.rtlnlr tlleir electricity siderable uncertainty over the rrlte Iy vvllicll tlle denAClnd gives the utility Ilexilpil ity. lltlt will gro:v.l4 jNtlding capacity in slnall ilnltlunts is also frlortt ctlstly. I-lence it is inlptlrtant t() be able tl) vllltle this llexillil ity. 7-heoptions approach used in t Ilis bt)()k'is sve II suited t() tI() t 11is. I Ie rc Tvt.t vi II illustrate the basic idtla with a sinlple exllnlple in wllich lemantl gnlwtll is certain. but there is uncertainty (lver relative fuel prices. 15 Consider a uti lity that faces constant dc mand grllwt 11()f I()() n'lcgawrt tts (&l'W) per year. l-ldncc the utili ty mtlst add to capacity; thc qtlestilln is l)(3w. There arc tsvo altcrnatives. The utility can build a 2t)()-MSV ctllll-lirtld pllnt (enough capacity for two ycars worth ()1- additional demand) :tt a capital ctlst of $190 million (Plant A), t)r it can build a l())-MW (lil-fired plant at a capital Inuch
14The reason is nllt justthat theril is ullcertainty tlvcr llle grtlwtll
'3lngersoll and Ross ( l992) have developed a continuous-time model of invejtment interest rate uncertainty, and it leads to more or Iess the same cllnclusions.
(lver
growth (as therc tlstlally isl'? I1*tlltl Iirln irrevklrsibly invests in :t lltrge adtlit i(1l1 llnly sltlvly ()1- even sh ri 11ks. it &v Il IiI'ltl itse If to capaci ty- and tlenlltnd grow,s holding capital it dllcs ntlt neetl. I Ience svllell t l1e grllwtl'l ()f tlel-nlntl is tlncertain. tllere is a tradeofl' between scltle ectlnlll'n ies antl the llexilnility tllktt is gained by invcsting I'ntlre frcqtlcnt ly iI1 slnilll increnlents t() ctptcity lls tlley are neetled.
tlj'
ttltal eluctricity denlltlltl. ric pllwk!r
but also bccause utilitics now (lftcn Iind thcnlselvcs ctlmpet ing with (lther slltlrct:s flftllecl (such as ctlgenerlltion). ls-rhis is 11 nltldified vcrsitln t)f an example prcsented in liwhill ( It?89).
Illtrltlla
frlrl/p
Annual Fuel Costs
Plant A
t 1
t 0 19
l= 2
=
=
19
--*
--*'
19
'''-*'
the second year. To decide which choice is best. let us calculate for each the P resent value of the expected cost of generating 100 MW of power per year forever starting this year, and an additional 100 MW per year starting next year.
First, suppose we commit the full 200 MW to either coal or oil. Then, if coal. the present value of the tlow of cost is choose we
200 MVV
(21) Plant B l= 2
l= 1
l 0 =
I
30
--*-
30
--+-
Note that 180 is the capital cost for the full 200 MW and that 19 is the annual operating cost tbr each 100 MW the hrst of wbich begins now and the second next year. Next. suppose we choose oil. Since te expected operating cost for oil is $20 million per year, the present value is
2
100 MVV
20
PVn
l00 +
=
10() + 1l .
L 2
Figure 2.7.
=
lo
Cloosing zlrltlllg Eleclric
-->
t
---
PIants r()w't.r
cost of $100 million (Plant B). At current coal and oiI prices. the coal-fired plant is not only more economical in terms of its capital cost ($90million per 100 MW of capacity), but also in terms of its operating cost; operating Plant A will cost $ 19 million per year for each 100 MW of power, whereas Plant B will cost $20 million per year. We will assume that the discount rate for the utility is 10 percent per year. and that each plant lasts forever. In this case, if fuel prices remain constant, Plant A is clearly the preferred choice. Fuel prices are unlikely to remain constant, however. Since what matters is the relative price of oil compared to coal (andsince the price of coal is in fact much less volatile than the price of oil), we will assume that the price of coal will remain fixed, but the price of oil will either rise or fall next year, with equal probability, and then remain constant. If it rises, the operating cost for Plant B will rise to $30 million per year, but if it falls, the operating cost will fall to $10 million per year. (See Figure 2.7.) The choice of plant is now more complicated. Although Plant As capital cost is lower because of its scale, and its operating cost is lower at the current oil price, Plant B affords the utility more tlexibility because it only requires a commitment to one year's worth of demand growth if the price of oiI falls, the utility will not be stuck with the extra l00 MW of coal-burning capacity in
20 + )J ( 1.1 .
)
=(
'X'
l=
l
20 ( l 1)l'
=
$61 1.
.
(22)
Thus it would seem that Plant A is preferred. afforded by the smaller oilBut this calculation ignores the oexibility sred plant. Suppose we install 10() MW t)f oil-red capacity now. but then if the price of oiI goes up next year, we install 20() MW of coal-fired capacity. rather than another oil-hred plant. This would give us a total of 30() MW of capacity, so to make the cost comparison meaningful, we must net out the present value of the additional l ()()MW. which would be utilized starting two ' years from now: PV' 1.1=
100 +
'x'
2()
(j j 1............::1) .
+
1
''
1 +i
l ()0
1..1 180 l.l
;
I
'X'
+ I
=
l
10 (l.1)f
9() -
(1.1)2
-'*
19
+ l
=
l
( 1.l)f
=
$555.
Note that the second line in equation (23)is the present value of the capital and operating cost fqr the second 10()-MW oil plant (whichis built only if the price of oil goes down), and the third Iine is the present value of the capital and operating cost of thehrst 100 A'/1zIZ of a 200-MW coal plant. This present value turns out to be $555 million, so installing the smaljer oil-hred plant and thereby retaining flexibility is the preferred choice.
Illtl-lltt-tilltl
One way to value th is llexibility is to ask how much lower wou ltl the capital cost of Plant A have to be to n-lnke it t he prc ferred choice. Let l be the capital cost of Plant A. Then the gresent value t)f the costs of installing and operating Plant A is .1
C*
+ /-1 '
/
=
()
''M
l9 + 1 ( 1)t
19
I + 399. .1
.
/
=
l
(' I l )l
'
.
The present value of the cost of providing the 2()()MW of power by installing Plant B now and then next year installing either Plant A or B (dependingon whether the price of oiI goes up or down) is
*
10()+
(.1 .1)1
f (1 =
+
20
1
i
I
.1 ' -
1.l
+
'M
10()
1 ''i
1.1
0.5 IA + (1.1)2
(=
-.:%D
t
=
l ()
+
l
l
(1.1.),
l9 (1.1)/
To find the capital cost that makes the utility indiffcrent betwllen thdse choices. just equate these present valtles and solve for /..1:
/z1+ 399
=
5 I 0.5 + 0.248 /..1.
$148.3 million. Hence thkleconomies
of scale wlluld
have to be quite Iarge (so that a 2()()-MW coal plant was less than 75 perccnt ()f the cost of two 100-MW oiI plants) to make giving up the flexibility of the smaller plant
or,
1)
=
economical.
6
Guide to the Literature
The net present value criterion and its application to investment decisions is an important topic in corporate Nnance courses, and is the starting point for much of what we do in this book. Readers unfamiliar with NPV calculations, including the use of the capital asset pricing model to determine risk-adjusted discount rates, may want to review a standard textbook in corporate hnance. A good choice is Brealey and Myers (1992). Although we largely ignore the implications of taxes in this book, they affect the choice ot discount rate for NPV calculations. Taggart ( 1991) can
provitles a rtzvievv of tlltl varitltls apprllacllk!s t(.)c:llctllating tliscotlnt rlttes (adtaxes) Ibr tlstl in tlle st tntlct rtl NI7V Illtpde l Rtlbltck' ( l 9S()) J'ustetl for risk antl Il()l'l1inlll tnlsll I1()&vs llfttlr-tax sllolyld ltlsvilys 17t)dist-tluntctl shows that riskless I'y at the after-tax risk-free rate (l'or cxanlple. tlle Treasu bill rate tinlt!s 1 Iu illtls ttnd Nlytl rs antl iuback l 992) derive t siluple ltlltl ratd tax ( ). the corporate lloNvs in N PV c:llculations. robust rule for discounting risky cash .
betNvettn
invcstThroughout this book Nve vvill enlphasize the tronnectiolls valuatitln exercising of linancial opt itns. Al t htlugll and the and decisions ment ('ptitlns itnd option pricing tecllccrtainly not necessary, stlnle l'anlliarity vvitll niqtles will be helpful svhen reading tllis botlk. Brealtly and N'lyers ( l9t)2) provide :1 simple introduction: so do thtl expository stllweys by Rubinstein tlctIlilttd treatnlonts, sec Ctlx and Rtlbin( 1987) and Varian ( 1987). F()r more JarrtlNv ltnd Rudtl l t)83). Nlthotlgh soluewhat 989'). and 1 l I-lull ( stein ( 985). ( also nally. for hdtl ristic 97f) ftl1. Fi article is tlse Sn1it11 1 by ( datcd. the survey ()pl illns. ;ts Nlllslln and N'jttrttln Kester of 1984 ( see )discussions investmenls ltnd t)f Clpe land. K()lIe ltnd ltstln l Chapter 2 l 987), :1 r. ( ( 1985), Trigeorgis and N1u rrin ( l gg I ).
part11
Mathematical Background
3 chapter
Stochastic Processes and lto's
Lemma
THls
t()()Is stllcllastic c:llctlcl lAIvI'IIl and thc next prtwide the mathematical lussdynamic prtlgranlming. and cllntingcnt claims an:tlysis that will be ttsed throughout the rest t)f this b()()k. Witll these t()llls. wc clln study investment decisions using a continuous-time apprtlach. which is both intuitiveiy tppealing and quite ptlwcrful. I11 addition, thtl concepts and techniqtles that we introduce herc are becoming widely used in 1: 11tlmbcr ()f arcas ()' ccllnomitrs and finance. and so are worth learning even ap:trt fnlm tlleir ttpplicatilln t() investment problems. This chapter begins with a discussitln of stllchastic proeesses. We wiil begin with simplc discrctc-time processesp and thu!n ttlrn t() the Svicnt!r prllcess (or Brownian motion), an important ctlntinuous-time process that is a fundamental building block Ibr many of the models that we will develllp in this book. Nvewill cxplain the mcaning and properties of the Wiener pnlcessa and shtlw how it can be derived as the continullus Iimit of a discrete-time random walk. Wc will then see how the Wiener process can be generalized to a broad class of continuous-time stochastic processes, callo,d Ito processes. lto processes can be used to represent the dynamics of the value ()f a prtlject, output prices, input costs. and other variables that evolvc stochastically over time and that affect the decision to invest. As we will see. these processes do not have a tmc derivative in thtl conventional sense. and as a result, cannot always be manipulated using the ordinary rules of calculus. To work with these processes. we must make use
slalllelllalictll
Xtz-/fyrcv//lz/ t)f
t
of Ito's Lemma. This lemma, sometimes called the Fundamental Thcorem stochastic calculus, is an important result that will allow us tt7 diftkrentiate and integrate functions of stochastic processes. We will provide a heuristic derivation of Ito's Lemma and then, through a variety of examples. show how it can be used to perform simple operations on functions of Wiener processes. We will also show how it can be used to derive and solve stochastic differenthat make tial equations. Next, we will introduce jumpproccsses processes continuously and show infrequent but discrete jumps.rather than tluctuate the ApFinally, in how they can be analyzed using a version of lto's Lemma. equations.which describe pendix to this chapterwe introduce the Kolmogorov the dynamics of the probabilitydensity function tbr a stochastic process. and show how they can be applied.
1 Stochastic Processes A stochastic process is a variable that evolves over time in a way that is at Ieast in part random. The temperature in downtown Boston is an example: its variation through time is partly deterministic (risingduring the day and falling winter). and partly at night, and rising towards summer and falling towards examplc: it anther unpredictable.l of is stock lBM The price and
random suctuates randomly. but over the Iong haul has had a positivc expected of growth that compensated investors for risk in holding the stock.
rate
Somewhat more formally, a stochastic process is detined by a probability over time t Thus. for given times law for the evolution xt of a variable < < t, etc., we are givcn. or can calculate. the probability that the h fl etc.. lie in some specitied range, for example corresponding values .r
.
-r2.
.rl
Stochaslic f's-tpcc--c-and Ito
'.
Lemlna
The temperature in Boston and the price of IBM stock are processes differ in an important respect. The temperature in Boston is a slatiolull' that This means, roughly, that the statistical properties of this variable process. long periods of time.'s For example. although the expected twer are constant temperature tomorrow may depend in part on today's temperature. the expectation and variance of the temperature on January 1 of next year is Iargely independ'ent of today's temperature, and is equal to the expectation and variance of the temperature on January 1 two years from now. three years from llonsuliolltlty now,etc. The price of IBM stock, on the other hand, is a process. value of this price can grow without bound- and. as we will soon The expected see, the variance of price F years from now increases with F. The temperature in Boston and the price of IBM stock are both contlltotts-tinle stochastic processes, in the sense that the time index / is a continuous variable. (Even though we might only measure the temperature or stock price at particular points in time, these variables vary continuously through time-) Although we will work mostly with continuous-time processes in this book, it is easiest to begin with some examples of t/-crc/c-/?ne processes. that is, variables whose values can change only at discrete points in time. Similarly, the set of aII Iogically conceivable values for (often called the states) can be continuous or discrete. Our dehnition above is general enough to allow alI these possibilities. One ()f the simplest examples of a stochastic process is the discrete-ltle t-crc/c-'/trl/crandom walk. Herea xt is a random variable that begins at a known takes a jump of size l cither up or down. value and at times t l 2. 3. each with probability 1. Since the jumps arc independent of ttach other, we 2 can describe thc dynamics of with the following equation-. -p
-r(),
=
.
.
.
.,
.
,p
.r3.
,
arrives and we observe the actual value xl we can condition the of probability future events on this information.z
When time
fl
r/
where 6/ is a
random variable
with
xt
I
-
+
6t
.
probability distribution
.
probte/
.!
1)
=
probt6t
=
=
-
1)
=
2
(J
1 2.
=
,
.).
.
.
We call a discrete-state process because it can only take on discrete values. For example, set m) = ()- Then for odd values ()f t, possible values /), and for even values of ?, possible values of of xt are (-f l l 0, 2. t ). The probability distribution for xt is found xt are (-/, -r?
' One might argue that the randomness is a rcdcction of (he limitations uf metcortlltlgy, and that in principlc it could be eliminatcd if we could build sufhcicntly complete and accurate meteorological models. Perhaps. but from an operational point of view, ncxt wcek's tempcraturc is indeed a random variable. In this book we will not attempt any detailed or rigorous treatment of stochastic processes. offering instead the minimal explanations and intuitions that sufhce for our applications. R)r detailed and general treatments. see Cox and Miller ( 19fi5), Feller ( 197 l ). and Karlin and Taylllr ( 1975).
-
.
.
,
.
-
,
,
.
.
.
.
.
.
.
,
-2.
.
.
.
,
3'I-his ignores the very Iong-run possibilitics of giobal warming
()r
cooling.
/3t?-/kj(?-J?/7?/ ibltltllzltltlliz-tll
fronl the binornial distribu tion. Fllr / steps. t he prllbllbi Iity tllat there downward
Jklmps
ltlld
/
-
11
(1
tl()Wll
Jtlmps is
are
1/
,
.
.
-r/
.t'f
--a
-
11
will take t7n the val ue J
.I
-r,
.
(')--.
Therelbres the probability that
for xt+ l depdntls on Iy (711 antl lltlt lttltl 1t itpnklIly (31! vvh:lt llappelletl bt.?l'(l1,t.? tirrleI For exalnplt!- in t htl cllse t)f t 11esi l'nple rlt 11t1tlnl hval k give 11 l)y eq uat it)11 ( 1), if xt zzz t''. t he 11 xt .y.I ca 11 etI tli.t I 5 (lr 7- (2 ltcll v it 11p rlllplb iIity J.a Tl) t, va ltlcs of xt I -Fl1eN'llll'kt'v prtlperty is e tc.. ltrtl irrelevltllt (lnce we k Ilow becausd it cllll greatly silnplify tlle :tl'lktlysis (41*:1 sttpcllttstic prklctlss. j-mportant svill see tllis shortly lts we tu rn tk) ctntilltltltls-t inlt, prtlcesses. e
2ll 11t time
-
J
is
.
-
.
2 The Wiener Process 'Wk will use this probability distribution in thtl next section when we derive the Wiencr process as the continuous limit of the discrete-time random walk. At this points however. note that the range of possible values that can take .%-t
t)n increases
with
?,
t,11'
as does the variance
Hence
-r,
.
is a nonstational'y
-r,
PVOCCSS.
Because the probability of an upward or downward jtlmp is 1. at time 2 value of is zero for alI t. (Likewise, at time tn the = () the expected for T > / is xt One way to generalize this process is expected value of by changing the probabilities for an upward or downward jump. Let p be the probability of an upward jump and t/ ( l #) the probability ()f tt downward //n7 f), the i; 1lt time J jump. with p > t/. Now we have a randonl ww/ wilh with and is incrcasing t expected value of xt for t > () is greater than zero. Another way t() generalize this process is to let thc size of the jumpat each time t b e :1 continuous random variable. For example. we might let thc sizd ol' each jump be normally distributed with mean zero and standard deviation fr. Then we rc fer to m as a discrcte-tinle ctpn/nlttxf'-xltl/f.l stocllaslic prfpctzw. stochastic process Anothcr example of a discrete-time continuous-state is the (zt-order ta//tr/rcgrt.'.s'.s'/r ll/-fpcc.-.abbreviatcd as AR( 1). l t is given by lhe -r,
.)
-rr
=
-
=
.
equation x?
=
t5
+ pxt
-
I
(t
+
(3)
,
where J and p are constants, with l < p < l and ts is a normally distributed hs the random variable with zero mean. This process is stationary, and value. of g'I-his value p), expected its current irrespective long-run /( 1 equation value setting in expected is found by (3) xt- l x; long-run and solving for -r.JThe AR( 1) process is also referred to as a mean-reverting expected value. We process, because xt tends to revert back to this long-run version of this process Iater in this chapter. will examine a continuous-time -
,
.r/
-
=
=
.r
Both the random walk (withdiscrete or continuous states, and with drift or without) and the AR( I ) process satisty' the Nlarkovproperty, and are thereThis property is that the probability distribution fore called &Ial-k-ov,;;l')ces-.e.b..
A
svienerprocess
also called 1.: Bl-ovltitlll ??lt)/?')?? is :t colltilltltltls-tilutt stochastic process t hree important prllpe rt ies.4 Fi rst- it is :1 :Il-l()b.' //?wcess. As explained abllve. th is rneans that t hc prtlbllbil ity tl ist ribtltitln llr :111 future values tlf tlltl prtlccss depends (Jnly t'I1 its ctlrrent vltle. llntl is tlI)llIL fected by pllst valtles 01' thc prtlcess ()r l)y ltlly tltller ctlrrent il'll'tlrllllttitlll. As :1 result. the current value ()f the prtlcess is ltIIt'lntl needs t() Illtlk'tl :1 Ilest lklrttcrtst of its futu rut vllltlt). Sectlnd, tlle Wie l'le r prllcess l'lrlsd'/lt/t.z/?t.vit(?/// l('l''lll,ll'. This means tllllt tlle probllbil ity distribtltitln jklr t 11tlcllktnge il) tlle prllcess (lveI()1tinle illte 1ar111. tny ('t Iler ( ntlnllverllppillg) any time interval is independent ()!' Third. cllllllges in tlle prtlctlss (lvtlr ally fin ite intervkll t ill'le llre ll()l'l3l(lIh' distribttted,with a variance that increuses Iinettrly vvith the tinle intef-val. The Nlarkov propcrty is particularly iI'npllrtltnt. Agltin. it impIies t I11tlt'Illy current inlbrm:ttilln is tlscll I )r lrec:lst ing the l'tlttlril plttl) ()f thc pnlcdss. Stock prices arc (llktln nltldtzlltld as Nlltrktlv prllcesses. ()11 tlle gnltl nds tllttt public in fllrmatilln is quickly incorptlrated in thc ctl rrent prictt ()f t 11estllck'- s() vllltle. (Tl1is is called tl'!c vveltk' that the past pattcrn of prices has n() tklreclksting forrn of market dfliciency. I1*it did not h()Id. investlprs clltlltl in principle the market'' through technical analysis. that is- by tlsing the pltst prkttel-n ()1* prices to forecast the futurtl-) The fact that a viener pnlcess has independen t increments means that wc can think of it as a ctpntintltltls-tinle versilln ()f 11 random vvalk. a point tllat we will return t() belosv. The three conditions discussed above tht.t Mtrk'tlv pftlperty. independent increments, and changes that are normltlly distributetl may seem tltlite restrictive, and might suggest that there arc vefy ft)w real-wllrld variallles Nvith
--lpeltt
41n 1827. the blltanist Rtlbtzrt Brllwn lirst (lbscrvetl and dttscribcd thtt nplltitln tll' snpltll particles suspendud in a Iitluid. resllting I'r()n1tlle Clppllrent successive llnd r:lntltlnl inlplcls ()1' neighbllring pilrticles; hcnce thc term Brllwniltn mtplitln. In l t?()5, Alltzrt l inslcin pr( )pt lsctl lt mathematical thet'r.y ()1' Brtpwnian mtltilln. which was furthtlr develllpetl illld nl:tdtt nltlrt.l rigt )r( 3tls by Ntlrbert Wiener in l923.
f'ltzc/cgrol//lf
Matllematical
64
while
that can be realistically modelled with Wiener processes. For example, it probably seems reasonable that stock prices satisfy the Marktw property and have independent increments, it is not reasonable to assume that price stock ehanges are normally distributed; after all, we know that the price of a changes in that can never fall below zero. It s more reasonable to assume logarithm stock prices are Iognormally distributed. that is, that changes in the of the price are normally distributed.s But thisjust means modelling the logarithm of price as a Wiener process, rather than the price itself. As we will see. used through the use of suitable transformations, the Wiener process can be extremely broad range of variables that vary as a building block to model an continuously) almost and stochastically through time. continuously (or of a Wiener process somewhat more useful properties the restate lt is to z(J) then Wiener is any change in z, Az, corresponding process, formally. If a conditions: following satishes the A/, interval to a time l The .
relationship
between Lz and Lt is given by Az
=
where Et is a normally distributed and a standard deviation of 1.
random variable
with a mean of zero
1 0 for 2. The random variable Et is serially uncorrelated, that is, t # s. Thus the values of Lz for any two different intervals of time with independent are independent. (Thus z(J) follows a Markov process increments.l -(6t6.&.
=
Let us examine what these two conditions imply for the change in z over this interval up into n units of some hnite interval of time F. We can break change the = in z over this intelwal is given length Lt each, with n F/f.Then
by z(. + r)
z(.)
Ei
=
1lo 'J Lelttlna
We will make considerable use of this property later. Also. note that the Over the long run its variance will go to Wiener process is nonstationary.
insnity.
By Ietting ht become intinitesimally small, we can represent ment of a Wiener process, dz, in continuous time as Jz
dt.
6J
=
the incre-
0- and Fttcj since et has zero mean and unit standard deviation. :((z)2) dt. Note, however, that a Wiener process has no time erivatiye, i Et (11)-1/2 which becomes inh ite as in a conventional sense; hz/zt . XZCUCS 20 FO@ app -ltz)
v''-f.
=l
The 6's are independent of each other. Therefore we can apply the Central is normally LimitTheorem to theirsum, and say that the change z(J+ F) which point, Iast tt fhis and variance F. with n distributed mean zero particularly and Lt, is Lt Lz depends fact not on the that on follows from important; the variance ofthe change n a Wienerprocessgrows Iinearly with the time horizon. -z(.)
=
=
=
'$
At timeswe maywant to workwith two or more Wienerprocesses. and we be will interested in their covariances. Suppose that zl (J) and ca(;) are Wiener h .. dz?) p1: JJ, where pIc is the coejhcieltt processes. Then we can write of ctprrtl/zlfon between the two processes. Because a Wiener process has a (z-(((/z)21/JJ 1)a variance and standard deviation per unit of time equal to 1 also the covariance per unit of time tbr the two processes.b is p!c -ttzl
=
2.A
Brownian Motion with Drift
We mentioned
earlier
that the Wiener process can easily be generalized into generalization of equation (5) is the
more complex processes. The simplest Brownian motion w#7 tryi: dx
a
=
(t
+ c dz.
where Jz is the increment of a Wiener process as defined above. In equatfon (6), a is called thtt drift parameter, and f.r the variance parameter. Note ihat is normally disover any time intelwal L, the change in denoted by a2 Lt. tributed. and has expected value CL-%.b a AJ and variance )J(-r ) ..r,
-t7,
=
Figure 3.1 shows three sample paths of equation (6),with trend a = 0.2 per year, and standard deviation t'z = 1.0 per year. Although the graph is shown in annual terms (overthe time period 1950 to 2000). each sample path wasgenerated by taking a time intelwal, Lt, of one month. and then calculating a trajectory for x(/) using the equation
'' Rccall that if and F' are random l CovfzrF )/(cx (.v ). In this case t'z r Jv
variables.
zr
5we always use natural logarilhms. that is, those with base e.
=
=
=
n -
(??lt/
=
l.
Et
-//c/ltlyffc Processes
=
=
.
their coefscient
of correiatitln
is pxt.
=
6(t
l Jltlt.'q?'r/tlplt/
lltlthelltatictl
Stochasic /''/'tzt:'cxxtts.(1,1,-1
'.$'
//tJ
l-cltlllla
>'! 20
!'
66% Confidence Intewal
15
-,----
-
10
z e t -
'
,,.'
e
-
-
.
-
-
-
.
-
-
-
.
.
.
L
..
-
/
(*- r >' l C 1-xk -
jl
'J
.
k
#
-
-'
-
-
#
!l
'
->--.-ys
?..
w ..
-
.
-jj ..
.
.
''
-
--
-
--'
-
-
--
-
-
-w
4 'hr $
5
.e
.j
( ,
..-. .,.. -
''
,.
...
-
..-
-
...1
.'
/
l
'- Reallzatlon .
.
O -5
55
50
60
70
65
Time
=
80
85
90
95
1O0
Time
(). In equation (7), at eah time ? 6, is drawn fnlm a normal with with distribution zero mean atld tlnit standard deviation. (AIs() note that the t'z have been put in monthly terms. A trend of ().2 and parameters a per ytlllr of ().()!67 per mllnth. A standard deviation of l per year implies a trend (1.()833 per implies a variance of l per year- and hence 11 variancc of i1 month, so that thc standard deviation in monthly tcrms is ().()833 ().2887.) -t1()5()
75
,
t ikln prllcess grtlvvs linea rIy wi tl1 t l1e t inle Iltlriztlll. ! Ile stlplldlt rtl (41' tlle ?-r?f?/ fitltl Iltle i Iltlrizlpll.l'1 he ellctl t f')(')-I7e rck!n t ctpn t rne grows t I1esqllfllv ltllelttl lrtlcklst is F ;t given I)y t I-ls interval t'llr nn1111
tlevii.t
Wiener
;.s
.()
A' 1 ) 74
+ () () l t''l()7 F + () 2887 .
.
r
.
.()
=
=
Also shown is a trend Iine, that is. equation (7) with (qt (). Figure 3.2 shows an optimal forecast of the same stochastic process. Here, a sample path was generated from l 95() t() the end of l 974, again using b)-15 equation (7), and then forecasts of to 2()()(). ) were constructcd tbr l (For comparison, a rcalization, that is. continuation of the sample path, was also generated.) Recall that because of the Markov property. oll-%' the value of -r(J ) for December l 974 is needed to construct his forecast. The forecasted value of for a time T months beyond December 1974 is given by + 0.t)1667 F. -l974+r =
.r(/
-r
=
-rlt974
The graph also shows a 66-percent forecast conndence interval, tllat is, plus or minus one standard deviation. (A the forecasted trajectory for gs-percent conhdflnce interval would be given by the forecasted trajector.y plus or minus 1 standard deviations.) Recall that since the variance of the -r(/)
.96
One can sinlilarly clpnstrtlct 9()- t)r tls-percent ctln litltrllce illtervltls. (ll-lselwe klld alsl' l'nlnl 3.2 tllat. in tlle ltlng rtl n. tlle On(l can Figures 3. 1 ()f nltltitlnvvllereas in the shtlrt the Brllwnian dominant dcternlinilnt ' trend is Atgain. t'lf volatility the pnlcess dtlminates. t 11is is :tn inlplicat itpl) t)I' run. the ()t' (.p ) is a t and the stand:krd tleviat ikln is f'.r ? the fact that the mean hlllds. for large / that is- thc lklng run. / <<::I btlt I'(lr small I tlle (lppllsite when f.x > t). Another way t() see th is is to ctlnsider the prllbabil ity that xf < This probability is ver.y snal I Ibr large ? btlt is abllut .!. I'(lr snlall ? 2 The Brllwnian mtltilln with dri is a fai rly simple stllcllastic prtlccss. but it is impllrtant that it be clearly understolld. At this ptlint- t he delinititln of t Wiener process and tlle properties of' its general izatilln in ctltl:ttitln (f) ) nlay t/-r dtlpend t)n thut square seem somewhat arbitrary. svhy.for examplc- should (// changes in ? And is i reastlnable expect of and t() uve r dt t ust not j on root mlltivatc be ntlrmally bcttcr distributed'? One Fnite interval t() vvty t() any equation (6) and its propcrties is to show llovvit rdlates t() a random walk in discrcttl ti me We turn to th is next. -,
.r()
-
.
.
-
-t)l
.
.
-t'
,
.
68 2.B
Nlillllenlatical
Random Walk Representation
of Brownian
l'lt/c/cqrr..lldll/
Motion
stocllastic
J'sptrtr--tzx tlpz(/ lto
'.
(')9
-crrl/?ifl
Let us examine the distribution for future values ofx. First. observe that ) Lh. Also, the mean of l-r is I (p -gl-r
Here we show how equation
(6)can be derived as the continuous limit of :1 discrete-time random walt.7 To do this. we will divide time up into discrete periods of length Lt, and we will assume that in each period the variable A' either moves up or down by an amount h. Let the probability that it moves 1 p. Figure 3.3 up be p, and the probability that it moves down be q shows the possible values of x in each of three periods. assuming it begins at For each possible combination of t and the point the probability of it being reached is also shown. Note that from each period to the next, is a random variable that can take on the values id./l. Also note that follows a Markov process with independcnt increments the probability distribution for its future value depends only on where it is now. and the probability that it will move up or down in each period is indepedent of what happened in previous periods. =
.v().
=
(t,((
2
)
-r
-
1
=
2 2 p ( t h ) + q ( A/; ) -
.r
.r
l
3ih
xc 2h
p2
''-'-'---
MN
Vt-rl
-.
=
((
A-)21
-
(tt;(A.tj2)
tl
=
p
.M
Nw
.<
3/)2(7---.Nw
2pq
q xc 2h -
AAv 'w
'N
M
NM
-
qa
Fkure 3.3-
l= 1
t= 2
4 pq (A/;)2.
=
(8) -.r())
/? ( p and variance
l (l
-
(p
h
q)
-
-
t/
/
=
(#
)2) ( Lh )2
q ) z /7lt
-
,
4pq t ( A/1)2/
=
tt
.
To interpret this. consider a series of n independent trials.where a success in any one trial counts as 1 and occurs with probability p, while a failure counts with probability of successes in n 1 t/ p. The number as 0 and occurs independent trials has a binomial distribution with mean np and variance npq'' see Feller ( 1968. pp. 223. 228). The expressions above are analogous. Now 11 variance, for example. is success counts as L11 and a failure as -A/?, so the 4Lh )2 times that ()f the usual binomial exprcssion. So far the probabilities p and q and the increments /1 and Lt have been chosen arbitrarily. and shortly we will want to Iet Lt go to zero. As it does. variance of (m m)) to remain unchanged, and we would Iike the mcan and choice of p, :?. Lll, and Lt. In addition, particular independent of thc be to would Iike to reach equation (6) in the limit. We can ensure that this will we indeed be the case by setting
t
---
'''w
I != 0
q )2j(A/2 j2
-
-
-
3pq2--
2
xo 3h
(p
-
A time interval of length t has 11 = t/ht discrete steps. Since the successivesteps of the random walk are independent, the cumulated change (xt is a binomial random variable with mean
=
MNM h
xc +
.
Thus the variance of A..r is
...<
#3
+
2
-
-r,
Xa +
(Aj, )
=
l= 3
and P
Random W/k Reprasenlalpn of Brownian Motion
Then
-
-
g
-'
l +
p ''rhis approach is developed in detail by Cox and Miller ( 1965). Our exposition is based on Dixit ( 1993a).
h
4
-
J'l-f q
=
-
-v()),
c
J''''-l t ,
q
.
a
(T
Substitute these expressions for the mean and variance of (-p -
j
=
Af
!:
-
(z =
U (T
g I
-
,/-f
-
(T
j
.
Lh.
and p q into the formulas above for and Iet Lt approach zero. For any snite -
Backyroltllzl
A./tl//?t'??It?/(.-(l/
/, tlle nulmber of steps, ?l. then gtes converges to lt nornlal dist ribtltion, t
a tr
/
1
2h
(y)
-J -
''i:
A/1
2
and variance
to intinity. and the bintlnliltl distribtltitll) witll I'neltn z
/?
af
=
t :
where. again. tlz is tlle increment (.)f a Wiener process- and (.r. J') antl /?(.r- t ) the d l-i ltl'ld variare knovvn (nonrandonl ) functions. Tlle new feattlreltntlis t hat 111: current stattt tilne. Tlltt tnllltnutltlsance coeflicicnts artl functions of represented stochastic equation by a-(t't ( 1l ) is tralled :111 lto process time p r(7cc*' ()f ()1* 11
(,.2
t
.(j
t
2 o. t
-.-s
At
.
These are exactly the values we need for Brownian motion-, a is the drift. and (,2 the variances per unit time. ln the Iimit as ti .-..> (). both the mean and are independent of Lll and Lt. variance of (-p We see, then, that Brownian motion is the Iimit of :1 random walk, when the time interval and step Iength go to zero together while preserving the relationship of equation (9). Furthermore, this relationship between Lll and (-rI ) Lt is not an arbitrary one: it is the Qnly way to make the variance of should now be clear depend on t and not on the number of steps. Thus it why dx in equation (f))depends (via l.zj on the sqtlare root of tl and not on dt. And it should also be clear why changes in over inite periods are normally distributed; as the number ()t- steps becomcs very Iarge. the binomial distribution approaches a normal distribtltion. (), thc total An interesting property of Brownian motion is that as Lt distance travelled over any finite interval of time becomes inhnite. This lbllows A/7 with certainty. t'rom the relationship between Lh and t Since 12-rl 7(1A.,r1) Lh. Then the total expected length of the path ovcr a time interval ' of length t is .r1))
-
.r()
-
.
the incrernellts this palcess. Sillcc Consider the mean and variancc t// equal variance of t-t' is to tl (), The 12) (-r t ) -t#zl - t-(J-t-) l ( ilt )2, antl (lt, tlf orkler dt )5/2 vllich is (tz)contains in ((lt in ) ternls in which For dt infinitesinnally snlall. terms in ((// )2 and ((/J )'1/2 can be ignored. and to order tlt the variance is Flt/-t-) b? ( t ) dt -ltt'z
--lt/-t'
-
.
.
,
.
.t-
.
.
tll-lj
iIlstl ntrllleotls
'We re l'br to t? (-r l ) ls the expected and to /?2(.r l ) lls tlle instantanellus .
'tln'tlll.-(:
i ?-tl/tz
(')f'
t lle Itf.) prtlcess.
/-41//-...
.
.r
-...
=
.
Geomctric Brtlwnian Nlotion ltlotiolt
(')j' tlqtllttitln An ilnpllrtant speci:tl cllse ( l l ) is t llc gctlttetric /..;D-r)l$???tl?? 11t.1 tryi lt I'1c rc tl ( / ) tt /?(a- / ) f z'.r vvllt.trtl a lt 11tl f'r :1re ct')llst lt 11ts. witll In this clkse eqtllttitln ( I l ) bectlrnes -t'
.r
.
.
=
112 /?
=
J
2 11 . 2t
I fz =
,
(l
x
.
-
.
-r
x
-r
t lt
+
t'r
-t- t / z
.
From (lur discussion ()1*the simple Brownian I'notitln of eqtlatillll (f)).we k nllw are ntlrn-lally distribtlted. Since tllcse that perccntage changes in a'a absolute ehanges in logarith m of naturktl are tlle changt!s in are Iognormallv distributed. The relation between and its logarithm is stlmewhat mtlre compl icatttd in this context. In thtt nttxt section we will show that if ( ) is givt!n l7yequation . (12), thcn F(-r ) log is the lollowing sinnple Brownian motilln wth drif t: -t-/-r.
t
t
-t'.
.r,
+x, depending which goes to inlinity as tt goes to zero. Likewise, Lx/tt th motion of thd sample whether l-r Brownian +A/l paths Thus a or on will and such and and not paths downs, look very jagged, must have many ups will speak of and exist, we cannot not be differentiable. The derivative t/-r/J/ /t/I will exist. will and (1 ) 8 t#-v/Jf ). However, -W-r) in general so --,
=
-
.
(t7t#-rl.
.v'
-r
(
-t'
=
fl /--
=
2 (a - .!a f'.r ) d t + c t Jz
.
()f-r
3
Generalized Brownian Motion-lto
Processes
*
;
broad range of alI of which lre
nllrmally
is so that over a finite time interval2 t the change in the2 logarithm .!. variance tscl 1k) with and f, it can l)e r.r t As r .r i dstributed menn (c - rz ) t 2 val / of expected the ( ) is give n I)y ue shown that if currently ( ()) .
.
.t-
The Wiener process can selwe as a building block to model stochastic variables. We will examine t number of extmples,
-r,
=
.t-
.r4),
-gr (/ ) I
=
at
(-JU''
)
klthematical
72
and the
Stslci-#l-tXl?lf
stocltastic '/-tlc'c--t...
'.
of x(/) is given by8
variance
F(-r(?) 1
-vk)
=
2
e
7a I
e
t.y a
f
' -
jj
15000
.
This result for the expectation of a geometric Brownian motion can be used to calculate the expected present discounted value of -r(I) over some period of time. For example, note that G)
(r
-
alld /'/t'p Len,ln:a
x(1) e-r' dt
e-qr-lt
()
()
dt
m)
=
m)/(r
=
-
( 14)
(z)-
provided the discount rate r exceeds the growth rate a. This will prove useful in later chapters when we will need to calculate the discounted present value of a prost flow that follows a geometric Brownian motion. Geometric Brownian motion is t'requentlyused to model securities prices, well as interest rates. wage rates. output prices, and other economic and as tinancial variables. Figure 3.4 shows three sample paths of equation ( 12)a 0.2, that 0.09, that is, 9 percent per year, and fr with a drift rate of a numbers particular chosen because they were is, 20 percent per year. These
#
are approximately equal to the annual expected rate of growth and standard deviation of the New York Stock Exchange lndex, expressed in rea. (constantdollar) terms. As with Figure 3. 1. the sample paths were generated by taking is calculated using the equation a time interval. Lt. of one month. Then,
',t
: ff:l :,$pC l; j,. l
1OOO0 7500
''
I
)' 5000
,
''*b
,)' l ; . ? $, ; , I
0
' ,
'
..-
50
55
/'
'N
,.
.-
...
.>
60
65
.wd
..-
o
w
# =
<'..J >
/
1J $
f
.
85
90
.z
.)
jj
r s)I j
,
,,,,%r
. .)
a-+wk /xa
.
%,
t%Mjz
e'
otcf.w
*
.
l
1*
-
.
,
.
2500
'
'
k /
,
.)
k
=
=
l; 4$ l'1
12 5O0
,-
j
.
N
.* .-.z'
-
70
75
80
95
10O
Time
.r(?)
!i I
'
xt
! '
( .
!
kl-.
1
=
.0075
x?-
l
+ 0.0577 xt-
l
t
,
(15)
100. (Again, at each time 1, 61 is drawn from a normal diwtribution with with zero mean and unit standard deviation.) Also shown is the trend line. that is, equation (15)with Et 0. Note that in one of these sample paths the d'stockmarket'' outperformed its expected rate ofgrowt, but in the other two sample paths it clearly underpedormed. .r195:
15000
/ / J /
12 500
66% Confidence lnterval
=
z'
10 0OO
=
Figure 3.5 shows an optimal forecast of this process. As before, a sample path was generated from 1950 to the end of 1974, and then forecasts of x(/) were constructed for 1975 to 2000. For comparison, a realization. that is, a continuation of the sample path. is also shown. Once again, because of the Markov property, only the value of -r(I) for December 1974 is needed to construct the forecast. The forecasted value of is given by -r
-iI974+r
=
(1.0075)r
z'
7500 z'
5000
.,e
A'
Aitchison and Brown and its properties.
( 1957)
A
/'
z'
z
z
/
Z
Z
#'
z'e
Forecas
A
-**'
2500 'e .e .-
.
0
1970
1975
1980
1985
-
.-
-
--
1990
1995
-rl974,
Time Figure 3.5.
Bsee
z'
/ /
for a dctailed discussion
()f
the Iognllrmal distribution
Opt?Tfz/
Forecast
t?JGeometnc
Brownian ifcft'pn
+
fytlc'/t--prrcpff/lt/
/k/tI//!tz,?ItI//t'fI/
utoclltls ic
l1lLl Ito r/-tzlt-t.tk(.'-
'.j.
Lclnllltl
the tigwhere F is moasured in months starting in January l975. Als() sllllwn in stantlllrd leviation the ctlnfidence interval. Since ure is a (nti-pereent ibrecast in changes grows with tlltl square root of the til'e horizon. percentage ot the upper and lower botlnds of this contidonctl intelwal are given by .r
(l
F
.0075)
.
.
YF ( l 0577) rlty7g and
F
.()()75)
(1
.
.
.0577)
(1
--V-U -
'
, tn4
.
.i
realNote that this contidence intelwal becomes qtlite wide. In this particular tlnderpertbrmed its forecast. market'' ization, the Hstock
3.B
Processes
slean-Reverting
gsee the Appendix to this chapter for a derivation of equations ( l 7) and ( 18). I Observe frol'u thesc equations that the expectcd value ot' xt converges to as t becomes Iarge. and the variance converges to c.r2/2??. Also. as ) cxa. l,7l)-r/l 0, vvhich means that can never deviate frolu even l'nolnent:lrily. -....
-....
-i:,
-t'
(7.2 ()- becomes t simple Brownian motion. and F1-: Finally. as ?? / ) Figure 3.6 sllows four sample paths of equation ( l 6) Ib r di ffe rtln t valtlcs 1 and of n. ln each case, t:r 0.(5 in nlontlllv terms, J l ) begins at The first is for 4 (), wllich corresponds to a simplt) Broqvnian motion Nvithtlut drift. Note that (/ ) tends t() dri ft l-ar fronl its initial val tle tlf I Sam ple pat hs are also sllown for q = 0.0 l 0.02, and ().5. Nllte that tlle larger t) is. thc Itlss (3.5, ( I ) rnakk!s only smal I and When 1) x (f) tends to dri away from short-lived exctlrsions away from Figure 3.7 shows an optimal forecast 01* this process. tbr t) = ().t)2. I 11 this case :1 sample path was generuted frol'n l t.)5() to the tlnd (lt' l t.)8(). and for l 98 I (t) 2()()4).I'--t'rcllmpltristlna 11 then tbrecasts of ) wcre ctlnstructed realization, that is. a contintlatitln of the sannple pllth. is ltIs() slltlvn. as is :1 .r
-..+
...-+
.
-r(/
=
-t'()
=
,
=
As the sample paths in Figures 3. 1 and 3.4 illustrate. Brownian motions tend realistic for some economic to wander far from their starting points. This is Others. Ctanvariables for examplc. speculative asset prices btlt not lbr such as copper or oil. sider, for example. the priccs of raw commodities motions, Brownian Although such prices are often modelled as geometric marginal related somehow should to long-run be one could argue that they !he pritx of oi1 migll! production costs. ln other word s, while in the shtlrt run revtplutions in oiltluctuate randomly up and down (in response to wars t)r weakening ()i- the producing countries, or in response to the strengthening or marginal OPEC cartel), in the longer run it ought to be drawn back towards th tlil should of btl of producing oil. Thus one might argue that the price
.r
-
,
-i
=
.
-i.
-t-(?
-.
cost modelled as a metll-reknet'tillgpt-ocess.
also known as an Onlsleill-
The simplest mean-reverting process is thc following: Uhlenbeck prcew
J-r
n (.i
=
.v -
) lt + c dz.
Ievel of x, that is. is the Here, n is the speed of revcrsion, and commodity price, then might the Ievel to which tends to revert. ( If x is a commodity.) Note that this be the long-run marginal cost of production of and If x is the expected change in depends on the difference between short interval greater (less)than it is more likely to fall (rise)over the next of time. Hence this process, although satisfying the Markov property, does not have independent increments. and x follows equation ( 16)s then its lf the value of is currently ttnormal''
-i
-i
-r
-i.
-:
-r
-i,
m)
-r
expected value at any future '
(.rI
time f is
)
.i
=
+ (m)
Time -i
-
-'lf
)e
.&-
=
.
76
Matllelnatical ftzc-/tvrtxf?lt-/ <j' '
'v' %'
t'1
and tben
.75
).
1 50
,1:
.
1.25 p
/
I
, I
(5
1#
9
,
I
$
I
%t
I9 1
l
$
I
$
l l
,'.e
.
.
# k
, I
1
l I
w
z
z
9%
/
1d1 J ' 1,
,.
?
'& ,
11
.
; f
,'
bb ze .>
q
.
I
p 9
,
j''
'
*
't..
J'
'
> 11
j
1
t
j
1
z
w '
'
-
'
1 ''
)1 h $ l?
1980
j
$
Forecast -
..*
-
-
-
---
-
---
-
'-
-
-
---
-
-
-
t-v
*
.
j
1985
1990
1995
=
=
(16)is the Iimiting case
-.+
(19) 6/
is normally distributed with mean zero and standard deviation
fnk,
Thus one could estimate the parameters of equation (16) using discrete-time data (theonly data ever available) by r'unning the regression
xt
-
xt-t
=
.r) -
dt + rz dz. .v'
(20)
a + b xt-
l
+
t
,
-r
-
.x'
We will examine the implications of different mean-reverting processes for investment decisions Iater in this book.
2000
version of the first-order autore-
gressiveprocess in discrete time. Specihcally, equation 0 of the following AR(1) process: as Lt
where and
z? (.i
Alternatively. proportional changes in a variable might be modelled as a simp1emean-reverting process.This is equivalent to describing-rt/) by the process J-x ?? (-i x) dt + a Jz.
43%
continuous-time
=
.
OptimalForecast of Mtlfzn-flzt'r/z?!l Process
(16)is the
.
1
-
-r.
t-percent conhdence interval for the forecast. Note that after four or tive c2/24 0.0()25/0.04 0.()65. years. the variance of the forecast converges to conhdence the 66-percent 1 interval so (+ standard deviation) convergcs to the forecast +0.25. Equation
+ b)
-
( l + /7)2
-i
I
Time Figure 3.7.
log ( l
,
-r(f)
,
=
1975
log (1 + bj, and
-
, is the standard error of the regression. It is easy to generalize equation ( 16). For example, one might expect to revert to as in ( 16), but the variance rate to grow with Then one could use the following process:
'
-
...
..,
--
=
=
where
l
)'
j
?'i
=
l
2 lz'f ? ---
j
--r---
IJ
.
-t1//7,
-i
Ii
)...f
' '
Ltlvllzlt.l
1
rj 1
I j
's
J'
h
' .
1 I '
'
calculating
' %.
)
1,
I
a'-
#
, e
,.
-
lk'I
:
i
t
1
11 j
0 50
I
.yj?
I
%
,
I
$1
,
l '
.
,
/%.', j
'j
'
,
'''
.
''
'1
,1
j
l
R6
j
'
'
''
-
/
.
'
*
,,.
,e''
l
0.25 1970
z
/
l
$.
11.;
js
..
'''''
..e
'
,
'
n te r'va
l
.
I f
.a'-'''--z-'-.----'-
confidence j I
66oz
'
)
*;!
, 1 '
JI
/1
()
klscti-lic Processes tl?1l Io
Betbre closing this subsection. let us return to question we asked earlier: a are the prices ofraw commodities and othergoods best modelled as geometric Brownian motions or as mean-reverting processes'? One way to answer this is to examine the data for the price variable in question, and in particular to estimate equation ( 19) and test whether the coefficient of xt- I on the righthand side is significantly different from zero. There are two problems with this. First, under the null hypothesis that this coefficient is indeed zero (so that xt follows a random walk), its ordinary least squares estimator is biased towards zero, so one cannot use a standard J-test to determine whether the estimate is signiticantly different from zero. However, there are alternative ' tests, called ttnit root Jc'a, that can easily be applied instead. () Second and more serious. it usually rcquires many years of data to determine with any degree of contidence whether a variable is indeed mean reverting. As an illustration, Figures 3.8 and 3.9 show the prices of crude oil and copper, in constant 1967 dollars. over the past 120 years-lt' A cursory Io()k at these hgures suggests that these prices are mean reverting, but that the rate of mean reversion is very slow. This is indeed confirmed by running unit root tests on the data. Running these tests on the full 120 years of data, tnne can ''The tcsts wcre originally developed by Dickcy and Fuller 1981), and have since been ( extended and rehned. See Chaptcr 15 of Pindyck and Rubinfcid 1991) for ( an introduction to thesc tcsts. ld'''l''he data for 1870 to 1973 are frt)m Manthy ( 1978); data after 1973 are from publications of the U.S. Encrgy Information Enttrgy ald U.S. Bureau of Mines. Prices were etlated by the Wholesale Price Indcx (now the Producer Price lndex).
/bltltllt'ltltltik'tll pltlc'/lrflll/lt
80
15.0
70
12.5
60
10.0
50 7.5
40
5.0
30
2.5 O
20 10 1870
.0
1870
1890
1 910
1930
1950
1970
1990
1910
1890
1930
1950
1970
1990
Tim Iziqtttp-tr 1?.?l.
())'
/:rl't'c,
lt/t'
('r7
(lil ilt l t/f) ;r /)(,IItt?:j' J)t'r l/ztln-.l
easily reject the random walk hypothesis: that is, the data conlirm that thd prices are mean reverting. However, if ont, performs unit root tests using data for only the past 30 or 40 years. one fails to rtject the random walk hypothdsis.
This seems to be the case for many other economic variables as well; using 3() random or so years of data. it is difscult to statistcally distinguish between a walk and a mean-reverting proccss. As a result, one must often rely on thcoretical consideratitlns (for example, intuition concerning the operation of equilibrating mechanisms) more than statistical tests when deciding whether or not to model a price or other variable as a mean-reverting proccss. Another criterion that may enter into this modelling decision is analytical tractltbility. As we will see in Iater chapters, valuing a project and solving for an optimal investment rule is oen much simpler when the underlying stochastic variables are modelled as geometric Brownian motions.l l
4
Ito's Lemma
'We have seen that the I t() prllcess ()f cqtlatitln ( I l ) is ctlnt inutlus iI1 time- btlt is not diflkren tiable. l-lowever. we wiIl oen nced to wllrk wi t 11functions o1* Ito processes. and s'vtr will want to take the diffcrenti:tls ()f stlch functions. thtt vllltle of an tlptillll t() invest in it ctppper For example. we might tltlscrilltt mine as :1 function of thc price ()ir ctlpper- which in turn might be rttpresentild by a geometric Brownian motion. In this case we wlluld wrtnt tt) determine the stochastic process that the value of the (lption fkllltlws.-R)do this. and in general tt) differentiate or integrate ftlnctions of I to processes, we will ntted to make use of 110 I-clllllla Ito-s Lemma is easiest to understand as a Xtyltlr sdries expansion. Sup) follows the process of equation ( l I ), and consider a function pose that Fx, t) that is at Ieast twice differentiable in and once in t We would like to hnd the total differential ()f this function, J F The usual rulcs of calctllus dehne this differential in tc rms of first-order cllanges in and t : '.
.
-r(/
-r
.
.
ll It is usually impossible to obtain analytical solutions for optim:ll investment rules when the underlying stochastic variables are modelled as mean reverting, so that one must instead usc numerical solution techniques. For a strong argument ugainst modtllling the prices ()f oil and other exhaustiblc resources as gcometric Brownian mlltions. sec Lund ( l99 lb).
.r
JF
;) F p.r
(/-v'
+
)F t
J/
.
Stocllastic f-'rti,cc''t,- fl/lz lto :3'Lc/llp/'Itz
Nlatllelutical Btlckgrollllil
80
dF
=
)3 F (J-r)3 + (J.r)2 + 1 J? + 12 + t: i).r3 ().:-2 ?t ;): F
JF
) F Jx 0r .
dt and cannot be ignored when writing the differential of in equation (25) captures exactly this offect.
in x.-
changes But suppose that we also include higher-order tcrms for
We can easily extend this Taylor serics expansion to functions of several t ) is a function Ito processes. For example. suppose that F = F-txl x,,,, where of time and of the ??l lto proeesses .v,,,
.
.
. .
dx ()2
=
J2(.r
(J/ )2 +
j'j
.
-
,
with C(#-n dzy.)
dF
=
bl (x t ) it ,
=
=
.
.
.
.
.
.
.
.#-
t
..'.'=
l
=
??l
pij /? Then Ito's Lemma gives the differentia! J F as .
.)F
pF tt + lt
Again. we can substitute
infinitesimally Terms in (Jf)3/2 and dtlz go to zero faster than J/ as it becomes small, so we can ignore these terms and write
(t-v)2
.
i
(:/1).1/2 + /p2(x, t) dt.
a (.r, t ) gpt-r.f )
.
.
-v)
vanish in the limit. To see In ordinary calculus, these higher-order terms all the whether that is also the case here, expand the third and tburth terms on for 11 to equation r ( ) right-hand side of equation (22).First. substitute determine (Jx)2: '-!
F. The extra ttlrm
;)F
p.v'i
fl i
pt
( .r
l
,
.
.
.
/
:
i
(26) for J.rf
.+
p2 F
.!.
dxi +
.
dxi
px p-r./
./
t-r/
and write this in expanded
t)
2)F
.+
!z.
bz ( r I ;
a
)
.j-i
'
-
.
.
.
.
.
'
form as t)
,
i
C)2F
)
.,r
.
ci
.
(28)
equation (22). every term As for the fourth term on the right-hand side of raised to a power greater than l in the expansion of (t.r)3 will include dt the case will to zero faster than (J in thc Iimit. This is likcwise .
and so go for any higher-order differential d F as
the terms. such as (#.r)4, etc. Hence Ito's Lemma gives
pF dbt =
.
(lt
+
;) F pr
.!.
dx +
2
Example: Geometric Brownian Motion. Let us return to the geometric Brownian motion of equation ( 12). We will use Ito's Lemma to show that the process followed by Ftx ) log x is indeed given by equation ( l 3). Since 1/.r2,we have from (24): (), ) F/)-v l /.v and p2 >-/J).r2 )Flt
p: F (r)2. i) :.2
=
=
equation We can also write this in expanded form by substituting
dF
=
DF
at
&1F
)F
a + alx t ) . + 1. 2 b (.r. t ) px a ;)x .
1)x
F/0-2 > 0), and negative if F is a F is a convex function of (that s, 02F/p.2 < 0). For Ito processes, dx behaves concave function of (thatis, effect of convexity or concavity is of order the and (J.r)2 Jl, like so like dt, er
.x
-
(29)
C)FJz. dt + :(-t-, t )
=
just
=
.
( 11) for J-r:
Compared to the chain rule for differentiation in ordinary calculus. equation simplicity that the (25) has one extra term. For some intuition, suppose for 0. Now Cdxl = 0, but CdF # 0. drift rate J(.x. 1) (), and that ) Fjt will be positive if This is an implication of Jensen's Inequality. t(dF) =
=
Hence over any hnite time interval F, the change in log is normally distz2) F and variance c2 F. tributed with mean (c log less than (x? The reason is that log x Why is the drift rate of F(x) is a concave function of so with x uncertain, the expected value of log changes by less than the logarithm of the expected value of (Once again this isjust a consequence of Jensen's Inequality.) Uncertainty over is greater the longer the time horizon, so the expected value of log x is reduced by an amount that increases with time; hence the drift rate is reduced. -v
-
=
-v
.v
-t.
.v.
.r
G.:ltltrll.rrcv//pJ
klalhonatiall
82
Example: Correlated Bnlwnian Motions. As a sectlnd examplc. consider and v each follow gcome t ric Brownian = where the tunction F(.' motio ns: .1,)
f'/t'p Stocltastic
5
/7?'(?(..t!-t$t'A'
tllltl
b. /..-c'??sF?lt/
kjl t 3 '>
Barriers and Long-Run Distribution
.r
.r.!',
-
t/a-
(/J
-x'
a
=
..
+ a'.
-r
.r(),
.1.tz
t/.7,.
-'t-
and 1'(.)1 Suppostl starts at Iosvs t I1e si nlple Brlqnvniann'lotiol: (lt' eqtl:tt ion (6). Left to itse 1$at ti rfle I it will llave a norlnal distributitln &vi t 11I'nttan (.:) ?) and variance t'r: l'. However, now wtt constrain the process 017 not to an upper rellecting barrier at T. Using our random walk representation- t llis means that starti ng at Jf 2. 11 if tf ies to taktt 7111 upward step it is mttvetl right back to T th (A step down to T 2 h is allowed to occtlr witlltlut interference.) Similarly, we place tt lower retlecting barrier at &. In economic applications, stlcll barriers often occur because tlf tlquil ibratmechanisms in the market. For examplc. if x is the price of a commolity. ing subject to an upper barrier where new tirms enter, and :1 Iower barrier it is where incumbent Iirms will exit. gv'ewill encounter stlch mllddls in Cllaptdrs 8 and 9. Here we want to consitler what llappens when follows sucll a process for a long time. The intluence o 1-the initial .rll wi II tl isappear when one tlf the barriers is hita because of thtl Markov prllperty. As tlle motitln goes back and forth trapped betweutn the twt) barriers- we cxpect it will settle lown t() a stationary long-run prouess. Nve want to Sind the probability density of this distribution. which we denote by / ( ) Once again we use thc rltndtlm walk representatitln. Clnsitler any three Lll I n :t ny llI1e sma lI t inle i17te 1-::11 adjacent ptli nts. say a nd x + th Lt, the probability mass 4 (-r Lll ) mtlves tlp witl) Ilrlll'habil ity /?- lntl tlle mass / (-r + ll ) movt!s tlllwn with pnlbability /, where p knd f/ Ctrtt given I7y equation ( I()). These mtlves const itutc the probability mass ltt ilfter thc entl of the interval. If the probability distribution is tt) be statillnary. this must be - t $ (.r) Thus Jus
,
'ross
-'
(1v'
a
=:
,
: tl ;
.
+
t'.rl
.
.v f l
--
,,
.
with Jz,.J p dt 'We will tind the proccss followed by F (-4the process followed by G log F. .3/),
'd-z.v
=
.
.
and
=
;)2 FjL) dF
for
Now substitute dF
f/x
.r
=
t/
v+
!'
tlx
+
1 we have from
=
,
(27):
d)'.
f
a
F J/ + lt7'xJzx +
f.r).)
+ p qv
:.
F.
t'r,. tzr)
(3l )
Hence F also follows a geometric Brownian motion. What about G = log F? Going through the same steps as in the previous example, we hnd that
i
(av. +
=
er
! o.z
-
2
.
-
2
j.
.
c,2) dt + r,v .
.
dzv +
(32)
cz,, dzv. .
.
.
From equation (32)we see that over any time interval T. the change in Iog F (ybl. 1 fyjz, ) T and variance is normally distributed with mean (ex + r 1: 2 . 2 + o'l + 2p tyv crl T. lt7'r -
-
,
.
xf', where x follows Example: Present Discounted Value. Suppose F (-v') the geometric Brownian motion of equation ( l2). We will show how to calculate the expected present discounted value =
C ()
tz -r
db-
=
(?tz +
! 00 2
Observe from equation Hence we can use equation motion to write
dt +
t'.r
JJj
.r
c2j F dt + p - 1)
-
(r
1)
/)j
.rP-2
a2 r2 ''
dt
F du.
=
xejfr ()
.
.r
.r.
-
,
-
.
-
.t'
4( (33)
(33)that Ffollows ageometric Brownian motion. (14)for the expectation of a geometric Brownian
F(m)) exp ((pa + 1.0 (# 2 and the present discounted value is
-(
-(-r,
.t-
-r
1 9(0 + .2
-rp-'
0
.r
.
First. use Itofs Lemma to write =
-
.
and d 1, and rearrange'.
t(4r+
=
0 antl i)2F/2).rp p
=
.
-
=
Since 1)2Fjll.l
-r
-
pa
-
provided the denominator is positive.
1 99 2
-
1) tz2),
-
l ) /z2)/J.
Now we substitute
)
=
p $ (A-
for p and
L 11) +
-
(/
t/
expand
.
4(
-r
+
t:. /1)
(35 )
.
thc right-hand
side by X'tylllr's
theorem, and collect terms together. This gives
4 (-r)
=
2) 1 + tct//.z A/2 1gr) (x ) hh (j' (.r) + ).( .!. ag + .$I1 (rz//'r2) A/,?) :.)(x ) + 2/, /rtx ) + -
-
= 4 (-r)
2 ta/('z2) ( 2. /? ) $ (-r) + '
-
2
11) 4'' ( r ) +
t
(
)2 r)'' (.r) +
//l
()'' ( ty./7)2 ( r ) +. .
The omitted terms all go to zero faster than (kA/7)2 (or AJ
from both sides, divide by lLh )2, and takc Iimits as
.
.
.
-
Lll
,
.
.
) .
.
)
. ,
). S() we canccl 4 (-r ) --,.
(). This gives the
Nlatherrtaictll
84
diftk re nt iaI eq ua tion where y
4'' (-r)
y
=
4' (-r)
Sflc/fgprll/l'
The general solution of this equation
4(.r)
6 Jump Processes
is easily seen to be B,
zl eYx +
=
consider where and B are constants to be determined. For that we mtlst what happens at the barriers 7 and Consider the upper barrier. The mass rellected right of probability 4 (;f' A) moves up with probability p, but is probabitity the balancing equation masses is the hh. Therefore back to rf modised to ..4
:.
-
-
Expanding this and simplifying as before. we Iind 4'(T)
=
y
z,'1
/(2)
lz expty
.t')
/
7) (expt)z
-
exply
'tsudden
-r
we
-
.
other words
:.)1.
The long-run stationary probability density is thus a simple exponential. It is natural that if the x process has a positive drift rate (a > 0 and therefore exponential should be rising toward the upper barrier. and if it y > 0), the negative drift rate, the density should be falling to the right. If y. > t), has a :!. and consider a process with we can in fact Iet the lower barrier go to stationary distribution whose will have long-run 2) it a only an uppcr barrier at < (), if left the of 7. exponentially Likewise, we can Iet the y to density falls Ef upper barrier go to x. We will have occasion to make use of this distribution at severl points in Chapters 8 and 9. On a couple of occasions we will generalize the argument to death.'' More substantial extensions include allow ajump process of general Ito process, and examination of the acfollows a the case where distribution o x rather than only its Iong-run tual dynnmics of the probabilily require extensions the development of a differstationary state. Both these ential equation for the probability density the Kolmogorov equation and treat this in an Appendix to this chapter. -cx)
So far we have considered only diffusion processes. that is. stochastic processes that are everpvhere continuous. Often. however, it is more realistic to model an economic variable as a process that makes infrequent but discrete jumps. An example would be entry by a new competitor in a market with tkw value of :1 rms. so that price suddenly drops. Likewise. one might model the patent as subject to unpredictable but sizable drops in response to competitors' success in developing related patents. Or, one might view the price of oil as a mixed Brownian motion-jump process', during normal times the price tluctuates continuously, but the price can also takd Iarge jumps or falls if a war or revolution begins or ends. In this section. we discuss Poisson (>lpllp) processcs' and we introduce a version of Ito's Lemma that will help us to work with them. A Poisson process is a process subject to jumpsof (ixed or random size. which the arrival times follow a Poisson distribution. We call these jumps for lrrrfl/ rate of an event. during a time Letting denote the lneall the dt, probability that an event will occtlr inhnitesimal length of interval will and probability that not occur is given by by dt, the an event is given which l/, of size itself be is dl The event can a random variable. a jump 1 with analogy the Wiener by denote Poisson Let q a proccss; in process 'Ievents.''
4(7).
Substituting the general solution into this, we hnd B = 0. The same conclusion could have been obtaincd by considering the Iower barrier &. must be choscn to cnsure that the whole probaFinally, the constant bility mass between ,. and T must sum to one. This givcs =
'.j'
.
2 ajo'l.
=
11t1 //('? Lcntttla t'f Stochaslic farrpcctswfzt'
t Then
we write
with probability l with probability
() lf
=
tlt,
-
tlt
.
the stochastic process for the variable x as a Poisson differential corresponds to the Ito process of equation ( 1l ) as follows:
equation, which
Jx
=
J'x. t ) dt
+
,g(-r.
t ) dq
(38)
.
t ) and gt-r, f ) are known (nonrandom)functions. function of and t, and Suppose that S(-r. f ) is some (differentiable) expression expected change in H, that would for the like derive that we an to expand follows: d H as is, CdHl. To do this.
where fx,
-r
6IH
=
1)H )J
dt +
pH = )t dt
+
/?H 3 -):
pH
px
dx
(39)
g.t.r. /)
J/ + g(-t. t) dqj.
(Note that higher-order terms go to zero faster than dt because. unlike for the Ito process. dx does not depend on dt Thus changes in cause changes in S in two ways. First, Hx. t ) will change continuously and deterministically .)
-r
sltlllletnatical /.?fl()'/v-l?-t'Jd/'?ltl
86
! ;L.
.
in rcsponse to the dri in Second, thertt is 11 possibility that a Poisson event willoccur; if it does, will change by the random amoullt d/ gt-r. f ), and Hx. t ) will change accordingly. Since the probability that :1 Poisson event will occtlr over the interval dt is dt, we have .r.
-r
(40) where the expectation to the size of the jump lt. given by ()n
'tT
Hj
'H
=
)t
+
.
J (x. / )
side of the equation is wth respect Hence the expectation of the differcntial of H is
-tlz'
)
=
(J Iz-/f 11/3
=
ps J-
dt
-r
+
u (( Hx
+ g(-v'.t4 l/. /)
H (-r. t )1l (lt
-
dt
tl (.r t ) .
H (x +
pH
+ 1? /J a (x t ) .
ar ,g(.v .
/)
11 -
t)
-
;)2 H
lU
a-ra
Hfx t ) 1) tl .
P
(42)
Example: Present Value of Wages. Suppose an individual who lives forever receives a wage F41) which rises by a constant amount 6 at random points in time. If l is the mean arrival rate of raises, we can write the differential
-
t//',
.
so that
E:
+
#2
.
wage
Suppose a nlachi ne prt'd tlcos 11 kxlnstan t tltnv Exanlple: Value ef a Nlachine. :' it It reqtli res no ma i11tenance. btl t at son'le plli nt Iong operates. t of pro as as will will and have to be discartldd. I1' is the arrival rate time it break down in I'nach breakdown. and the discotl intl va Itle'? is /? of a n t ratd. what is t he Tht value of the machine follows the prtlcess 's
where an becomes
%eevcnt''
is lt
p P'
.
Note that the second-order derivative is relevant only for the variance contributed by the continuous part of the process. The jump part contributcs the last term on the right-hand side involving a difference in values of H at discretely different points'.
/) tt' tlle
Thus l'' is equivalent to 11 perpettlity that pays out forever the current 11/plus the capitalized valtle of the averagtl raise per tlnit tinle.
f
(lt
Stl I )
(1 6/p)
=
.
(4 1)
i)H + i)/' + Cu((
equation for the individual's
E:
fz-(Izl'''l
value of the change in the function Hfx, / ) is given by
' (J H 1
1/-
-
lz' J(/
.
=
l with probabil ity l Tllen the asset return equatilln
t/l
=
.
zr (/J + C(JJ,'' )
Thus, F=
7r
=
dt -
1/ J/
.
X .
p+
Hence we can treat the profit flow as a perpetuity, and valuc it by increasing This is a very goneral idea: if a profit llow can the discount rate by an amount when with arrival rate occursa then wll can calculate the a Poisson event stop value of the stream as if it never stops, but adding t() the expected present will discount rate. We come across this in many applications in later chapters. .
wage as
J )F 1 with probability l with tt earnings stream? expected =
In this case.
IZUIJ) t// +
=
=
.
tlse
then the expected
JJ
p 1ze
the right-hand
equation (4l ) in the same way that we used Ito's Lemma when with continuous processes. working Sometimes we meet a combination of an lto process and :1 jump process. The tbrmer goes on aII the time; the Iatter occurs infrequently. Then the appropriate version of Ito's Lemma also combines the two effects. Thuss if We can
We call treat 1..-as an llsset and cquate the nllrnnktl rettlrn on it at rate sum of the dividelld (currentwage) and tlle expected capital gttin:
.
=
(F (lq
,
(43)
What is the present value of the individual's
Guide to the Literature Our treatment of stochastic processes and Ito's Lemma has been at an introductory and heuristic Ievel. For a more in-depth development of stochastic
Stochastic f'Yrpce.yc.5'alld /'/(p Ltavl?//?t'l '.
fzci-qrlr/l/?lt
Matltematical
processes and
their properties. see Cox and Miller ( 1965), Feller ( 1971), and
and XtyKarlin and Taylor ( 1975. 1981). Cox and Miller ( l 965) and Karlln equations. of Kolmogorov the nice treatments lor (1981)provide particularly fora discussion ofthe use ofcontinuous Also, see Chapter3of Merton (1990) modelling. For a much more and economic and jump processes in snancial and Shreve ( 1988). Karatzas stochastic processes, see rigorous approach to of Ito's Lemma and discussions For more detailed but still introductory and Brock ( 1982), Malliaris Chow (1979), its application, see Merton (1971), of Poisson discussion nice also and Hull (1989).(Merton (1971) prtwides a Kushner rigorous treatments, see (1967), processes,with examples.) For more Also, for and Chapter 4 of Harrison (1985). Arnold ( 1974), Dothan (1990), of expected present values, see more detailed discussion of the calculation
a
(1993a).
Dixit
point
+ tll
-r
.
Hence
We recognize this as a dynamic generalization of the stationary-state computation in the text; see equation (35). Lll t Now expand $ (m),f(); x t ) in a Xaylor series around t) (-'E0 r(1 -'E J 1: -
-
.
.-
'.
.
/
(.r()/() ,
.'
-t -
lXh /'
t
-
.
t)
$ (-r()tt ;
=
,
-r
.
/)
$
2. /
-
Lt
-
2:./7
2)4 p-r
+
al
(t h )
'z
Note that third- and higher-order terms are of order (Al)3/2
hence will go to zero faster than Lt. Expand 4 (.r4).?()'. and substitutc these expressions into equation (44):
+ Lh
-r
:24
2
px2
(AJ)2, .
/
-
+
.
.
.
etc.. and
t.t ) Iikewise.
Appendix - (p
The Kolmogorov Equations
A
follows a At timeswe will want to answer questions of the following sort: If what probability the value is is x), particular stochastic process and its current that it will be within a certain range at time t later'? Or, what is the probability will have reached a point xl within a time f :G F? To answer questions that like these we will need to describe the probability distribution tbr x and its evolution over time. This can be done using the Kolmogorov eqttations. We will derive the Kolmogorov equation for the simple Brownian motion .x(l)
Finally, we use p + q
also substitute
Lll
=
=
o'
-
(1
;)4
) L lt
i)t.
+
,
2.
2
(p +
ty
) (25./?)
a
/924
-
.
2)v..'.!
1 and from equation ( 1()), p f/ ) Lt. We t(y/t7' J, divide thrllugh by Lt, and rearrange'. -
.
=
.,:(1)
representation with drift of equation (6).using the discrete-tme random that we introduced in Section 2.B of this chapter. Recall that we broke a with time interval of length t into n tjLt discrete steps, and in each step, probability p, would increase by an amount h, and with probability q 1 p, it would decrease by hh. Finally, to keep the variance of (m x()) f o. independent of the particular choice of Af. we set Lh Let /(m), /0; J) be the probability density function for -(I), given that walk
Equation (45)is called the Koltnogorovl-ward ctzllt?ltpn for the Brownian motion with drift. and it describes the evolution over time of the probability density function f) (m)- /4)', x. f ). In a similar manner. one can derive the Kolmogorov fonvar d e q uation for the gene raI Ito process of equation ( l 1): l 2
=
=
-r
-
-
=
.
.z.
at an earlier time
f() we
have x(0)
=
-v().
Thus
(46) Equations (45)and (46)are called t'forward'' equations because they have at time /#), and are solved forward as bounda:y conditions the initial value for the density function for future values of One can Iikewise describe the evolution of the density function backward in time, that is. taking at time t as the boundaq conditions and solving for the density function for previous .rt)
-r.
.r(/)
Over the interval of time t A/ to J, the process can reach the pont in one Lh, or by decreasing from the of two ways. by increasing from the point -x'
-
.r
-
I2Sce Karlin and Tayltlr ( l98 1) for dcrivations mogorov forward and backward cquatitlns.
.
and more dctailed discussion!i
()1'
thc Kt)l-
t'
'' .
i
l
!
1
:7
I 2
.4:
1
, '
. .
1i y t !
@ ) ). :j l ' kE ' jt : '! $
:k
Iue S
va
Of
PI-OCCSS
time
1t
-r()
lxlckbllll r. The K///?rltl,l.lt//-&t'
f4) <
.
.
r
'C !.' ,'r
,j
g,
.! b 2 (.-r()/()) ,
z
) y.a u
(-r() ?t)',
/
t ) -F.t'l (-rt)/0)
-r-
.
-
i) A () -
.
p ::::z
-
) l()
4 (-vi)/()
/)
-r
',
-
-
()
(-r() f() ,
',
-r
.
j
6F
'' ,
x tf +
. .
sy
jy c,
..y.
g.
j.a
j
.,yj
2
.
2
.y
o
.
t)
u)t)
c .a
jjy
,y
(y.y y
.
( g- (.yy )
((), t ) a jyqj t.-(.ry)
.jv)
..
(l 8 )
..
y,lto ( () t j, ( jao .
qjo
y,e rj
y. (ya j.y
.
.
....'
.
'
.
.r#
''
'
.
'
,
.
j,
.
,
..
,
.,
-
,..
.
.
.,
-
.,j
.
.
,'
.p),
,
,
. ') ..;.. t
',
'
uz
i)/
'x
vgz.
.....
ihi;k t-
-,,-:::-
I
t
.Ltz 2
...
;)a4
:
-
:
)..r
n
,t
-
;)() il-r
+
. 2 .j
(j ! )
n 4.
'jjjt
....'j
r---
y' j,
.-.!,. b'i
a
1.
o.l ()2 M
-
,
.
3A'/
)()
=
0A'J
(52)
.
t)t
v,: ...
,
.
y
...
. j .y q
,;,.'
'''.=
1
.-
.
ikl'v
(0 ()) .
=
m),
and
V/(())1
=
kV&f? (0, 0)
-
-r-()
a
=
0.
.
.,. f
.
1.,
'%
'
.. '
r!
jyj
g
'
'j
q q
f'.
tt
c.,'. .?
'
.1 .;1
(y
(.,r) Jdt +
rr (-r) dz.
(54)
tnc/tpn
'
j (-min)
j (-max) $). .
=
=
for the resource, ' 3nd
.
j (a )
>
0
and is concave. with fOr
-rnlin
<
-r
<
-rm:lx
.
)..j
'
',
-
.
'-
.
!
is the growth
.
'.
j ir
Here,
.(-r)
t.
.
)?
,j.
.
*,4
t,
'
gy(-r)
=
j..
:
'
t/-r
,
..,
'.
This partial differential equation must be solved subject to the boundary conditions:
Now consider a more complicated stochastic proccss. which clltlld btt used to describe the evolution of a rencwabie resllurce stock. )- sublect t() -r(?
:r
v..t
the text. and the solution pnlceeds as
.
.
<:'
,t.
ry9
(36) in
,.
?,,: ,,
J '(t,
'i
tlquation
-.
,
.!.
Ttjjtirsnis the same as
...,
.
t his for ls/bt in equation (50),and integrate by parts to get tj-j: substitute following equation for Ivle- 1):
,
.
'
=
,,
.'''
;
The Kolmogorov forward equation for this process is 0/
g k!
q.
.
,.')
(..5())
-?x
=
.
.
;!.).
)'. 6l
,yr
..
pM k,lL,-
A'f((), )
.
.
;
,
p
Then
.
..,,
.r(l
-N
! 4 l
j
,
.
..2j
-,
In the textwe asserte d thatequations (17)and (18)givethe mean andvariance claim. x(/). we can use the Kolmogorov forward equation to prove this aS ) 'Write the momen t-generating function f0r
.
k
y.yyj
Exatnple.. The Steadpstate Distribution lor a Renewable Resllurce. Tlle Kolomogorov cquations are partial difterential eqtlations. antl so (tre usulllly $.2 dificult to solve. However, ;k. we are often interestcd in the Iong-run steady-state ;'. . jaaracteristics variables. Not all stochastic of stochastic c t t processes will have . j bablity distributions that pro converge to some steady-state function (tlle getric Brownian motion for examplea will not but the Ornstdin-ulllenbeck ome .;. ., k' exists. in most cases it can process will). However. if :1 steady-state tlistribution '-' '. readily found using the Kolmogorov gorward equation-wllich be then redtlces rLb to an ordinary dierential equation. :, As a simplc first exercise-we begin by rcdcriving the negativc uxpt,nentiltl g, k..: distribution tor a Iong-run stationa:y Brownian motion between reqecting barriers dfrectly trom eqtlation (45).Tllis tlistributitln is independent ol thll i 1. pt' initial /(). and the currcnt t so we get an ordinafy difikrcntifll equltilln t')r
w
w
i i1
gyj g
( l 7) and
.
tlq
1
solutiol...
.
:
! :
yy
(a'
=
yt
,'
:,
' . 1. 9.' t 7 h'
lllosving
',.
of
''
)
,y..,,ty.
?
(.48)
dz.
tr
ve rify equa tions
-)
,
'; ! '
f
In this example we will return to the ornstein-uh ing) process of equation (16).For simple Ornstein-uhlenbeck (mean-revert equation becomes 0, so t h a t the simplicity,set =
/
.
li J #' jt t
lenbeck Process.
t/ v
(0 .
; ,,..vijjt
j
''
.
- -
,(. ',
-:
'
.
4:
--
u
.
.
il
Llsing t h e l'act t jla
i), )LL
qjq. vl. 4
.
I
,
.
,
I,as tl..c
(.:
:$,
jzt )v: i
it
t)
'
...
.
'.
J .t'ln:l'tlJ
can verj-y that the equation
jjyy,t;
).:'
(4.y)
.
-n
vhereadcr
:.4 .;
:
f)
'.
r.
1 j,;' j;, k, t1)$;..
this point it wewill use tbe Kolmogtrov eqtlat iof:sj tater in this btltlk, but at is useful to consider a couple ot oxamp eS. Example:
;
Ito
t//lt
tl'
''
)
lAl'll(:esse.%
.
ib.tt 'i7''
uftpc/lfl-lt;
.,;na .
.tt
is iiz
.
,
:j .. q.
.
-
=
i iJj'
:
.)
-i
;
'
.
.
..
. the lto iott tbr
tlf/ldf/f
; ,. .
'
:k
''1
:
'
l.
;
'
..,g5. (), . jjtkvi,
'fvk
B(lL..kjIr(-IlI' lt
/,.JtI//lt.,??ltlJ'f;l/
Q()
'.
' 5'..
t'
i
.
. '
rf. ;@' .'.tl. ;gk
.
t''.j. .,L6
' .?. ! .
Much of the literature on renewable rcsources deals with detcrministic versions of equation (54,),and compares the socially optimal t/(-r) with that resulting lrom a competitive market. However, as biologists and population ecologists have long recognzed. most renewable resource stocks ttvolve .
MathematicillSf-lckgrtplt?l Although tlucstochastically, and (54)is a natural for density probability x in study the tuate stochastically, it is of interest to steady-state equilibrium. /(), or / in the forIn steady-state equilibrium, 4 does not depend on x(), function density as 4co(a').Then the ward equation (46).Write the stationary once): equation becomes (afterintegrating representation.i3
'l
J
a (A')
(-t') /x (.:)1 L.1 .
J-r (c
=
This can be rcwritten as
#ltrz (x) 4x(x )1 (7.2 (x) 4. (x) =
-
2
.l
o.c (.r)
.
t?
(-r)1px
(-r)
will
-r(l)
(-E)
4
Dynamic Optimization under
.
Uncertainty (55)
q (.x)) dx.
-
Chapter
steady-state This can be integrated to give the followingequation for the
density:l'l
$x (-K) where ln is a constant
=
q (p) dv a a (p )
'r
m
o'a(-r)
yw )
2
eXp
-
of integration, chosen so that
As an example, suppose that
.f(.r)
=
JX
.
Sxxldx
fx, is the logistic tunction. (r
x (1
x/ K4
-
1
=
.
that is, TIME
,
that
capacity'' of the resourcc stock. Also, suppose wherc K is the fz Then equation there is no harvesting, that iss q (-r) 0, and that (.r) c-r. v2 < 2(z: when that applies density steady-statc (56) yields the following tcarrying
=
=
2a/frS
4...(-)
2 (2a/tz K4
=
-
I
za/rrs 2 e
2.r/rr
-
-
.r
:
&-
/
F-(2(z/rx 2
-
1)
,
(57)
determine that the where r' denotes the gamma function. From this we can expected value of in steady-state equilibrium is -x'
1
2 2a
a particularly important role for investment decisions. The payoffs
In this chaptcr
CT ..-
I>l-.kys
to a tirm-s investment made tllday accrue as a strcam over the future, and are affectcd by uncertainty as well as by tlther decisiuns that the firm or its rivals will make later. The (irm must look ahead to aIl these dtwelopments when making its currcnt dtlcision. As we emphasized in Chapter 2. one aspect ()f this future is an opportunity to make thtl same decision later: theretbre the option t)f postponement should be included in today's menu of choiccs. The mathematical techniques we employ to model investment decisions must be capable 01' handling :111 tese considerations.
.
reduce the steady-state expected value Note that stochastic suctuations &2 2e. Also, if of x, and as c2 approaches 2a, Cl-%.xlapproaches zero. is, stochastic Nuctuations will drive the resource stock to extinction, that 4x 0 with probability l jlzora more detailed discussion of collpses and well as a derivation of the this and related models of renewable resources, as optimal stochastic harvesting rule q' (-v),see Pindyck (1984).1 .x(;)
-.+
.
For a 13Sec, for example. Beddington and May ( 1977) and Goel and Richter-Dyn ( 1974). economics in a deterministic context. sec Clark ( l976). rcncwable of overview resource good applied '4Mertt)n ( 1975) also provides a erivation of this equation. and shows how it can be populatien. evolving with stochastically a to a neoclassical model of growth
we
devclop two such techniques-.
dynamic programming
and contingent claims analysis. They are in fact closely related to each others and Iead to identical rcsults in many applications. However, they make different assumptions about financial markets, and the discount rates that hrms use to value future cash tlows. Dynamic programming is a
vely
general tool for dynamic optimization,
and is particularly useful in treating uncertainty. It breaks a whole sequence of decisions into just two components: the immediate decisions and a valuation function that encapsulates the consequences of aIl subsequent decisions, startingwith the position that results from the immediate decision. If the planning horizon is finitea the very last decision at its end has nothing following it, and can therefore be found using standard static optimization methods. This solution then provides the valuation function appropriate to the penultimate 93
?J(/
ltltlltntlttictllStlckgrtplf and
so decision. That. in turn, serves for the decision two stages from the end. condition. This sequencd initial on. One can work backwardsall the way to the of computations might seem difficult, tlut advances in computing hardware obtan soluand software have made it quite kasible. and in this book we will what inlinite. is horizon tions to several problems of this kind. If the planning simplilied by its recuris calculation might seem like an even more diflicult exactly like the sive nature: each decision leads t() anotllcr problem that looks but also often numericttl computation, original one. This not only facilitates solution, and characterization of the makes it possible to obtain a theoretical sometimes an analytical solution itselt.
Contingent claims analysis builds on idcas from financial economics. Beof costs gin by observing that an investment project is dehned by a stream uncertain of and benefits that vary through time and depend on the unfolding the right to an investment Opportuevents. The lirm or individual thar owns completed project. owns an nity, or to the stream of operating prolits from a markets for quite a rich menu asset that has a value. A modern economy has be of assets of all kinds. If our investment project or opportunity happens to However, price. market even will known have it traded assets. a one of these value for it by relating if it is not directly tradeda one can compute an implicit traded. other that asscts are it to will All one needs is some combinatit)n tar portfolio of traded assets that at exactly replicate the pattern of returns from our investment project. every composition of (The eventuality. unccrtain future and in every future date the of prices thtl comchange cotlld it fixed; be as this portfolio need ntat project must equal ponent asscts change-) Then the value of the investment would present an discrepancy because of portfolio. any that the total value the two assets or of cheaper buying the profit by arbitrage opportunity'.a sure this calculation in Implicit valuable one. combinations, and selling the more opportunity in the its fnvestment should firm use is the requirement that the could inthe buy arbitrager did not, if an most efhcient way, again because it value of the know Once profit. and make positive we a vestment opportunity and timing of inthe investment opportunity, we can find the best form, size, optimal investment the determine value, and thus vestment that achieves this
policy.
In the first section of this chapter we develop the basic ideas of dynamic that programming. For continuity we start with the same two-period example time it Ionger extend to spans, in was the mainstay of Chapter 2, and then consider the two special discrete periods and in continuous time. There we namely 3, lto and Poisforms of uncertainty that were introduced in Chapter claims to of contingent tbe general ideas son processes. Section 2 develops
uncertain future payoffs. and tlle detcrnlination of tlleir prices by llrbi trtgt!. Again the focus is on lto and Ilisson prllcesses. Section 3 explains tlltt r(2lationsbips between tlle tsvo pproacbes. slc illsl) tlevelop tllis relationsllip to obtain a simple nlethod lr discounting and valtling paytlffs vith vtlrying
degrees of
risk.
Throughotlt, vd enlphasize the intuition bellintl the nltltllods ratlpcr tll:lll forlnal proofs. A sketcll of the techniclll detllils is placctl in an appentlix.
1 Dynamic Programming In this section we introduce the basic ideas of dynanpic progntnlming. We start with the two-period exanlple t'ron-lCh:hpter2. thtls provitling a sinlple concrete setting for the ideas and contilltlity with the previotls analysis. Tllen we extend the itleas and tlevelop the general thetlf.y of nlultiperiotl decision strategies. Finally. we Iet time be continuous- antl reprtlstlnt the tlntlerlying uncertainty with either Ito or Poissiln processes. That is the stttting for nAost of the applications that will appear in later chapters.
1.A The Two-period Example An extended
example
in Chapter 2 intnltltlced the ideas
()1*
(lptimal
timing of
investment ddcisions and ofoption val ues. We Ilegan by cllmparing thc present values that result from immediate investment and from wltiting. Dyntnlic programming is in cssence a systematic method of making stlch comparisons for more general dynamic decisions. In trder to illustrate this. Iet us prtlcettf.l to generalize our example. As the first step. in this section we rework the simple
twlJ-pcrilld
dxample
from Chapter 2 in a more general wty. Belrc. we chose specific numerical values for most of the parametcrs in the example; now we will Iet them have arbitrary values. Let I denotc the sunk cost ()f investment in the factory tllat then produces one widget per period forcver, ltnd Iet 1- be the intcrest rate.
Suppose the price of a widget in the current period () is J.!). From period 1 onward, it will be ( l + tt) /1)wth probabi Iity t/, and ( l t/) /$) with probability (1 q ) First, suppose that the invcstment opportunity is available only in period 0,-if the firm decides not to invest in period (), it cannot change its mind in period 1 Let lz'i)denote the expected present valuc of thd revenues tht! firm gets if it invests. Weigllting the two altcrnative possibilities )r widget prices -
-
.
.
Matllonatical Sltrl.-qlrr-pld/lt/
by their
respective
llallic
t7J7?/?l.::tlJI'tr-???
ltlltlel-
t7/lt.r(,'/'/tliil/p
This outcome of future optimal dccisions is sometimes called the cltlttatioll p//l/tr. From the perspective of period 0, the period- l price /)1 and therefore the values Pr1and $ are alI random variables. Let &)denote the expectation (probability-weightedaverage) calculated using the information available at period 0. Then we have
probabilities, discounting, and adding, we have
,
,
the invest(Note that we need r > 0 for convergence of the sum.) If K) > 1, not made is investment the 1, < l,. if l, ment is made and the firm gets Kj and investing between indiftkrent = firm is 1, )$l the and the 5rm gets 0'. if of payoff the net the f2() denote Let not investing and gets zero in either case. whether t)n invest, decide to a () period in to project to the firm, if it is forced that now-or-never basis. Thus we have shown -
m:ux ( r$) 1. () ).
f2()
-
=
Now consider the aclual situation, where the investment opportunity remains available in future periods. Here the period-t) decision involves a when period l different tradeoff'. invest now, or wait and do what is best actions in different ahead to its own arrives. To assess this. the tirmmust Iook will change. so not the conditilans future eventualities. From perigd l onward 1 Hence period beyond there is no point postponing any prohtable projects period 1 we need look ahead only as far as Suppose the irm does not invest in period 0, but instead waits. In period l .
.
the price
will
be
/1
Jl) with probability q'
(1 +
tt)
(1
J) Jl) with probability 1
= -
-
The present lt will stay at this level for periods 2. 3, is period 1 back to of revenues, discounted .
.
.
.
(/
.
value of this stream
,
periods For each of the two possibilities (theprice going up or down between 0 and 1), the firm will invest if 1Z1 > 1, realizing a net payoff Fj
=
max
gP'j
-
l 0) ,
.
This could be called the expected continuation value. orjust the continuation value- with the expectation being understood. Now return to the decision at period 0. The irm has two choices. If it invests immediately, it gets the expected present value of the revenues minus the cost of invcstment. 1z$) 1. If it does not, it gets the continuation value &)() Iderived above, but that starts in period 1 and must be discounted by the factor l /( 1 + r) to express it in period-t) units-The optimal choice is obviously the one that yields the larger value. Therefore the net present value of the whole investment opportunity optimally deployed, which we denote by &, is -
1;.)
=
m ax
l.$)
-
l
l ,
l
+ r
'.)-4 ) (Fb1
.
The firm's optimal decision is the one that maximizes this net present value. This capturcs thc essential idea of dynamic programming. We split the whole sequence of decisions into two parts: the immediate choice. and the remaining decisions. aII of whose effects are summarized in the continuation value. To tind the optimal sequence of decisions we work backward. At the last relevant decision point we can make the best choice and thereby tind the continuation value (h in our example). Then at the decision point betbre that one, we know the cxpected continuation value and therefore can optimize the current choice. In our example there were just two periods and that was the end of the story. When there are more periods. the same procedure applies
repeatedly. The decision where the investment opportunity remains available at period 1is Iess constrained than the one where it must be made on a now-or-never basis in period (). Equation ( 1) shows the net payoff f24)for this latter case; since that situation terminates the decision process at time 0, Iet us call it the termination vtrl/lleut time 0. N()w we have the net worth 6) of the less constrained decision problem from equation (3).The difference (Fi) f2()) is just the value of the extra freedom, namely the option to postpone the decision. ln Chapter 2 we calculated the value of the investment opportunity, Fi), and the termination value, Q(), for some specihc cases of this general model, -
khltllenlaticalStlcqrtplfnt/
98
where the parameters C), etc., were given numerical values. Readers can now refer back to those examples and place them in the context of th general theory. Hcre we point otlt one fcature of those results. by reference to Figure 2.4, which shows these values as functions of the initial price, C).When C) exceeds the critical level of 249, the tirm finds it optimal to invest at opce. Then the option to postpone is worthless, and 6) coincides with f2f), which equals 1-r() I in this range of the price. Nvllen 1) < 249, it is optimal to wait; then the graph of 6) lies above that of ftl. A similar property holds as other parameters are varied in other figures in Chapter 2.The idea is that the critical point where immediate investment just becomes optimal is tbund where the lines representing the value of the full opportunity, ), and the termination f2(), meet. value, ,
-
To get a better idea of the factors that affect the value of the option to postpone, let us examine more closely the sources of the dit-ferences between -()and Q(). First, by postponing the decision the firm gives up the period-o revenue /-1).This difference favors immediate action. Second, postponing the decision also means postponing the cost of investment; this favors waiting since the interest rate is positive. (More generally, the cost of investment could itself be changing over time, and that would bring new considerations; for example, if the firm expects capital equipment to get cheaper over time. that is an additional reason for waiting-) Third. and most important, waiting allowsa separate optimization in each of tht: contingencies of a price rise and a price fall, whereas immediate action must be based on only the avcrage of the two. This ability to tailor action to contingency, specifically to refrain from investment if the price goes down, gives value to the extra freedom to wait-l 1.B
Many Periods
1)t)
they can be regarded as limits ()f randlln) each time period and ()f each stcp 01' the W2y.
Nvith our application
I In technical terms- the mltximum is a convex function. so by Jensen's Inequality the averof age the separate maxima in equation (2) is greatttr than the maximum o1' the corresponding
avera gCS,
to investment in mind. we will retkr to the decisitllls
of a firm, but the theory is ofcotlrse perfectly general. The firm's curront stattls as it affects its operation and expansion opportunities is described by a state variable F()rsimplicity ofexposition we taktt this to be 11scalar (realntlmberlp but the theofy extends readily to vector states of any dimension. At any date is known. btlt ftlttlrc or period t the current value of this variable random variables. We values + l are suppose that the process is .r.
.rf
.
erf
-p+a,
,
.
.
.
Markov. that is. aIl the intbrmation relevant to the determination of the probability distribution of ftlture values is summarized in the ctlrrent sta t e xt At each period t, some choices tre Ctvltilable to the firm. and we represent them by the control variablets) l/. In the Ill3llve cxample where the only clloice was whether to invest at once or wait. we could let lt btl a scalar binary variable, whose value () reprcsents waiting and l represents investing at once. In other applications, for example. if the scale of inveslment is a matter of choicc. lt can be a continuous variable. I f the firm has choices in :ltldition to those bearing on invcstment, lbr cxample. hiring labtlr at time / then lt can be a vectllr. Thtl value lIt of the control at time / must be chllsen tlsing (lnly thll inlbrmation that is available at that time, namely The state and the contrlll :lt time / aftkct the firm-s immttdiate prtllit I1()wwhich we denote by n.t (m lIt ). I'Iere thtt relevant contnll variable s/, migllt be the quantity of labor hired t)r raw matcrials purchased. The and ltI ()f period t also affect the probability distribution ()f future states. I-lere ltt can be the amount of investment or Rct D. or evcn a decision to abandon the enterprise. Let *? ttt ) denote the cumulative probability distributilln l'unction ! 1 of the state next period conditional upon the current information (state and .
,
-rf
.
.
-rf
.%-t+
We now generalize the two-period example above. 0ur applications in subsequent chapters are mostly to situations where time is continuous and thc uncertainty takes the form of Wiener processes or more general diffusion processes for the state variables. However, in this subsection we develop the theory of dynamic programming in a setting where uncertainty is modelled using discrete-time Markov processes. Some general properties are easier to demonstrate in this format. Also, the setting ofthe rest of the book is a limiting case. Diffusion processes are Markov processes, and as we saw in Chapter 3,
walks in discrete tinne :ls tlle ltlngt11ol' snlall in a stlitClble t'leta'lllle
walk both
-rf
.
control variables).
The discount factor between any two periods is I /( l + p). where p is the discount rate. The aim is to choose the sequence tli' controls jlff) ovflr time so as to maximize the expected net present value of thc payoffs. Sllmetimes we will force the decision process to end at some periotl T, with a hnal payoff that depends on the state reached; we de note th is termittation J,vl.vf.#/' function by Q r fx.r ) We are ready to apply the basic dynamic programming technique. Rcmember the idea is to split the decision sequence into two parts, the immediate period and the whole continuation beyond that. Suppose the current date is t and the state is xt Let us denote by F)(.p ) the outcome - the expected net '
.
.
s'latllel:lilticalJ'ltkckqrtpl/llt/ present value of a1lof the firm's cash flows when the Iirm makes all decisions optimally from this point onwards. When the 5rm chooses the control variables
ltt,
it gets an immediate Optimal
profit Ilow n.t xt, ur). At thtz next period (1+ l). the state will be decisions thereafterwill yield, in the notation we have establisheds
l)y,/lfl??lcOplilnizaion I/nJt!?-Ullcertall' lf the many-period problem has a tixed finite time horizon T. we similarly start at the end and work backward. At the end of the horizon firm gets a termination payoff f2rl-rrl. Then the period before,
can the
-p+1
.
(-rf+l).
';+1
This is random from the perspective of period /. so we must take its expected value ',(F;+l (m+l)).That iswhatwe called the continuation value.2 Discounting back to period t, the sum of the immediate payoff and the continuation value is (-rI
n't The frm will choose #) xt ). Thus
ut
ttt
,
)+
1
1+
-,
p
(&+l (-r?+ l )1.
to maximize this, and the result will be
just the
value
Thus we know the value function at F 1. That in turn allows us to solve the maximization problem for llr-c, leading to the value function Fr-al-rr-a), and so on. At one time this was thought to be too complex a procedure to be practicable. and aIl kinds of indirect methods were devised. However, advances in computing have made the backward calculation remarkably usable, and several of our numerical simulations in later chapters use it. Later in this chapter we will oftkr an example of it. -
lnhnite Horizon
1.C The idea behind this decomposition is formally stated in Bellman*s Principle lil/fl/fltffl/l, Of Optimality-.adl Optnalpolicy has J/l(?J7rt@t!r@l/lflJ. Wlliletrtlle Ihe
rtrrrlflrlrl#
ChOiCC.% Conlitute
(ln
Optimulpolic'y
114//1
rlMpo':t
10 J/lfJ SlbproblClll
starting at the state that results rrrl //lfJ initial fltW(?ll.. Here the optimality of the remaining choices uf+I l/+2, etc., is subsumed in the continuation value, so only the immediate control ttt rcmains to be chosen optimally. ,
The result of this decomposition, namely equation
(4), is called
the Bell-
Ltjelndamental equation sfpplfrnl/l-y. Tt) reiterate, the hrst man eqttation. or right-hand side is the immediate proht, the second term constithe term on continuation value. and the optimum action this period is the one the tutes
maximizes the sum of these two components. In the two-period example, immediate investment gave P'4) /, waiting & )/ had no period-o payout but only a discounted co'ntinuation value (1 + r), and the optimal bina:y choice between these alternatives yielded
that
-
'()(
the larger of these two. Thus our earlier equation the general Bellman equation (4).
(3) is a special case
tf
lf there is no tixed finite time horizon for the decision problem, there is no known final value function from which we can work backward. Instead, the problem gets a rccursive structure that facilitatcs theoretical analysis as well as numerical computation. The crucial simplilication that an intinite horizon brings to equation (4) is independence l'rllm timc t as such. Of course the current state xt matters. but the calcndar date / by itself has no effect. This works provided the Ilow profit function :., the transition probability distribution function *. and thu discount rate p arc themselves al1 independcnt of the actual Iabel of the date. a condition that is satisied or assumed in many economic applications. In this setting, the problem one period hence looks cxactly like the probIem now, except of course for thc new starting state. Therefore the value hmction is common to all periods, although of course it will be evaluated at Therefore we writc the function as Fxt ) without any time different points symbol. The Bellman equation for any f becomes the function label on -rf
.
Flxt ) tn71eexpectation notation is generally clear enough. However, to make it precise that the information at time t includes the state and the control at that time. we slatc it formally once for reference'.
Since
=
max ,,,
n' (.,p u: ,
)+
1 l + p
(
I
-(.rI+
l
)l
and xt-vbcould be any of the possible states: write Then, for all we get form as and -rr
-r'.
.,r
.r,
.
them in general
rlfz,?? ic.
!()2 wherc we have now denoted the expectation as conditioncd ()n tlltl kpowledge Illlinitely ot. the current period s and ll. This is the Beliman eqtlation Ior the repeating, or recursive. dynamic programming problem. ?
.
;
,
-t-
.
,
-r,
equations
,
as the
hmciollul
Despite superticial appearances, this equation is not Iinear. The optimal choice of lt depends on all the values Flx'j that appeara weighted by the appropriate probabilities. in the expectation on the right-hand side. When this optimal control is substituted back. the result can be nonlinear in the Fx') values. In general we do not know whether nonlinear functional eqtlations have solutions, let alone unique ones. Fortunatcly. the recursive Bcllman equalion has a very special structure that allows one to prove existence and uniqtleconditions typical of our economic ness of a solution function F(-r) under side technical issue for our more practical concerns. applications. This is a sketch the ideas in Appendix A to this chapter. and of We include a brief excellent readers treatments in more theoretical books, can find interested with and example, Lucas Prescott ( 1989, Chapters 4,9). But the Stokey for technical argument does have an indirect payoff: it is essentially a practical solution method. This takes the form of an iterative procedure. Start with any guess tbr the l' side of equation (5) true value function, say Ft (-r). Use it on the right-hand l which rule choice tt can now be expressed and hnd the corresponding optimal right-hand side becomes the as a function of x alone. Substituting it back()f Ft2)(-r). Now use it as the next guess t)f the true call it a new function value function, and repeat the procedure. Then the successive guesses F3 (x), F4b ( v), etc., will converge to the true function. Convergence is guaranteed with a good initial guess no matter how bad the initial guess, but of course the procedure will reach the desired accuracy of the approximation in fewer ,
.r;
steps.
lil ? li--tl
t rl/ l
:tl
Jt/t/?-
Ivllrc't','/:, ilI
b'
Tlle key lies in tlle ltcttlr l / ( l + /)) 017 tlle rigllt-hand siule. Tllis beillg less than l it scales down, or contracts, any errors i11 the guess from one stcp to the next. As Iong as the profit llows are botllldetl. any errors in tlle clloice of soltltion is Ieft. u cannot blow up. Gradually. only the correct .
Now that we have no fixed terminal date from which to work backwarda we value function F seem to have Iost an explicit or constructive way to tind the And without knowing the function F we cannot find the optimal control tt by solving the maximization problem on the right-hand side of the Bellman equation. Thus we need assurance that a solution actually exists. and a way to find it. Luckily, neither question is vey diflicult. The recursive Bellman equation (5) can be thought of ts a whole list of equations. one for each possible value of with 71 whole Iist of unknowns, namely all the values F(.r). If x took on only a tinite number of discrete values
-rf this would be a simultaneous system with exactly as many number of unknowns Fxi ). More generally. we can regard (5)as F as its unknown. equation, with the wholehtltction
t';I/J
This procedtlre is very easy to
understand-
progranx- and conlpute.
I t can
take :1 long tilne on tlle computer. especially if tlle discount rate p is very small doNvn. I-losvever. that is no Ionger so that each step does only a little scaling consideration when individtlals can Ieave their (nvn personal prohibitivd a computers running for days without tying up scarce mainframe resources.
Theret-ore this method is increasingly used in many applications- and even in econometric work 'Wewill givtt a nunnerical exanlple of this method, too. Iater in the chapter. .
1.D Optimal Stopping One partictllar class of dynamic progrilnlnling problems is very importltnt for our applications. Here the choico in any period is binary. One alternative corresponds t() stopping the prllcess to taktl the termination paytll-- and the other entails contintlation for onc periotl. when ttnother similar binaf'y choice will be available. In the investment nlodel tlf Chapter 2 and the tirst setrtitln of this chapter. stopping correspllnds t(' mllking tlle investment. ltnd continuation correspllnds to waiting. l-lere continuatitln dtles not generate any prlllit flow within the period. Howevera in other contexts thtlre may I7e sonle such flow. Ftlr example- for a firm in bad ttconom ic ctlndi titlns t hat is con te nl piatltnd ing shutdown, continuation nlay givc a prtltit flow (positive ()r negative). eqtlipment. vltlue minus ol' tllc and plant termination may yicld some scrap tlther any severancc payments thc lirm is required t() make to its workers and restorlltitln, of site breaking contracts. etc. costs Let zr (-r) denotd the Ilow prolits antl t'''z(.r ) thc tcrnlination payoff. Then the Bellman equation becomes F( ) -r
=
m ax
t' (x )
zr ( ) + .r
,
l
For some rangc ofvalues of-r. the maximum
,
1. (F ( ) ..
I+ p
()n
-r
i
-r
1
.
the right-lland
(f)) side of this
will be achieved by termination. and for other values ()f it will be achieved through continuation. In general this division could be arbitrary; intervals where termination is optimal could alternate with ones wherc contintlation is optimal. However, most econtlmic applications wili have more structure. -r
with torminatitln optimal on one side and There will be a single cutoff continuation on the other. For example, in the invttstment problem ()f Chapter 2 we had a critical Ievcl of thc initial price. /1) 249, such that in perilld (), -r*,
=
Matllcmatical Stzc/grlfnt
104
investmentwas optimal to its right butwaitingwas optimal to its Ieft. All ofour applications will have a similar property, and in each case it will be intuitively clear which action is optimal on which side of the threshold or cl:toff point. To complete the reader's understanding of this result. we should explain the general conditions that lead to it. We stat these intuitively here, and explain them somewhat more formally in Appendix B. For sake of dehniteness we concentrate on the case where continuation for x > x' and stopping is optimal for x < x*. Let us examine the forces that will make continuation more attractive relative to termination for higher values of First, the immediate protit from continuation should become larger relative to the termination payoff. Since the former is a :ow and the latter is a stock, we need to express them in comparable terms. The precise condition turns out to be that
ttlltler naltlic O/p/l'l?lzt7fibpl
f.7?,(7n-Jt.2j??(v
1()5
time is continuotls. We Lt goes to zero n.(a- lf 1) for t he rate of the profit llow, so that the actual protit over the time period of Iengtll AJ is gx. l/. /) Lt. Similarly, Iet p be the discount rate per unit time. so the total discounting over an interval of length L is by the factor 1,/(l + p lf ). and
write
The Bellman equation
(5) now
becomes
and rearrange
to write
,
,
is optimal
Multiply by ( l + p
1)
-r.
n.(x) + ( 1 +
p4
-
l
-
(7)
(Q (x lx1 t'-z(-v) ')
-
should be increasing as increases. Second. any current advantage should not be likely to be reversed in the near future. For this, we need positive serial To correlation, or persistence, in the stochastic process of evolution of be more precise, if this period's rises. the conditional distribution *(.r'1-r) of next period's values x' should give greater weight to larger values, that is. it should shift evelywhere to the right. (In technical language, this is the dominance.'') These two conditions together concept of are sufEcient to ensure the desired result. lf the expression in (7) is decreasing as x increases, then continuation will Note that the second be optimal to the left and termination to the right of require negative persistence condition stays unchanged', we do not switch it to of the stochastic process.
Divide by
l and
let it go to zero. We get
-r
p F(
-r
-r.
-r
thrst-orderstochastic
-r*.
that both of these properties will always bd satished for our applications. The srstis easily veried in each instance', the second is tnle for random walks, Brownian motion. mean-reverting autoregressive processes, and indeed in almost all economic applications we can think of. For ease of notation in conveying te concept, we did not allow the protit payoff to depend on time t as such, but that extension presents no terminal or difhculty.The threshold simply becomes a function of time, (/). This will be the case in much o the rest o the chapter and in many o Our appliations. We repeat
-r*
1.E
Continuous Time
Now return to the general control problem of Section 1.B, but suppose each time period is of length Lt. Ultimately we are interested in the limit where
.
t)
=
m ax 1/
;'r
(
-r
.
1/
.
t)+
l tlt
t.-gtF j
,
where ( 1/Jl ) JII(IFl is the limit of 7qty Fj l We must remember that the expectation is conditioned on the current and II, and we must rcmember to include the inlluence of changes in both x and / when we calculate the change in Fx, 1) ovcr the interval Jl. .
.r
This form of the Bellman equation makes explicit the idea that the en-
titlement to the Ilow of prolits is an asset, and that t) is its value. On the left-hand side we havc the normal return per unit time that a decision maker. using p as the discount rate. would require for holding this assct. On -(-r.
' thv right-hand side. the first term is the immediate payout or dividend from the asset, while the second term is its expected rate of capital gain (loss if negative). Thus the right-hand side is the expected total rcturn per unit time from holding the asset. The equality becomes a no-arbitrage or equilibrium condition, expressing the investor's willingness to hold the asset. The maximization with respect to tt means that the current operation of the asset is being managed optimaily, of course bearing in mind not only the immediate payout but also the consequences for future values. The limit on the right-hand
side depends on the expectation
correspond-
ing to the random f a time Lt later. There are two classes of stochastic processes in continuous time that allow such limits in a form conducive to further analysis and solution of the function Flx. t) in the continuation region.
Luckily they are particularly useful for many economic applications. In fact and Poisson processes we discussed in Chapter 3. We will
they are just the Ito
develop the theory of dynam ic programmi next two subsections.
ng in the ir spet:i Iic contxts
i1,1the (
valtle function F
,
we Illlve
.
The above analysis is local to the sllort time interval (/ t + dt ), and the resulting equation holds for any 1. We can complete the analysis by choosing :1 terminal payoff, gr lctting the horizon a finite time horizon T and imposing using rccursive the structurea or some other way. ln any of be infinite and of existence and uniqueness of solutions mathematical proofs these. rigorous continuous Since the details are immaterial ftlr time. become quite hard in applications, we omit them and refer the reuder to Fleming and Rishel our ( 1975) or Krylov ( 1980). Our mathematics has been simplilied in another respect. We have treated will conthe limit to continuous time in a very casual and heuristic way, and tricky reader quite that some tintle to do so. However, it is fair to warn the rigorous carcfully treatments. in more issuesare hidden, and must be handled In discrete time, we stipuiated that the action llt taken in the current period t but not on the random could depend on the knowledge of the current state the two coalesce. We have to be careful l In continuous time future state about not to allow choices to depend on intbrmation abotlt the futtlre. evcn with of would hindsight. benefit the acting be tthe next instant-'' Otherwise we requiring and could make insnite profits. Technically this can be avoiddd by strategies while the time right'' in from the the uncertainty to be in thc stochastic processu!s left-'' Then the from any jumps are change until//-/ alter Jf:' installt. occur at an n-s-fclnf,while the actions cannot 39-44)1. For a discussion and rigorous analysis, See Duffie ( 1988. pp. l -
-k
,
-p+
.
t'continuous
''continuous
t-. !
1.F
Ito Processes
stochastic process that yields a simple form for (8) The lirst continuous-time is the Ito process we discussed n Chapter 3. Equation ( 11) of that chapter dehned the formula for its increment. which we recapitulate here, but now allowing the drift and the diffusion parameters to depend on the control variable as well as the state variable:
dx
=
a (-r ,
1/
.
t ) dt + bx
.
11
,
t ) Jz-
where dz is the increment of a standard Wiener process. As before, we the proht llow as zrt-r, tt. t) and the value of the hrm (asset)as Fx. t ). ='
.x
.
tt
.
t ) b;. ,. (a. t ) .
) .
We can express the optinal If as function of Fl a (.t f )a Fx(.v ). F a. (.' / ) well as x. f and thc various paramete rs t hat govtlrn t Ilc functional lbrm ()t' Jr as s a, and b. Substituting this expression for the ('ptimal 1/ back into the right-hand side ofequation ( l ())- vve get a partial diftrcntial eqtlltion of the second tlrder. with F as the dependent variable and x tnd / as tlle independcnt variables. In general this equation is very complieated. However. in many applicatillns we can develop wasys to solve it analytically or nunaerically. . The solution methods are gencrally clllltl(.lglltls to thf lse I'(lr discrete time. lf there is a (ixed time Iimit F when a terminatilln payllff f2 fxv F ) is tlnlklrctttlthen the eqtllltion has 11 boundllry contlititln -
,
.
,
.
.
-.( r .
We can start at timc
r
.
r)
and work
f2 (
.r
()u
.
F)
r w:ly backward to find F (-r J ) for al I .
earlier times. In fact. in practice we have to chollse 11 discretc grid t)I' values of A. and t on which to calcuiate the slllu tion. We will oflkr twt) examples ()f this procedurca onc later in this chapter when we directly solve the underlying dynamic programming problem. and one in Cllapter l t) where we solvc the partial differcntial eq uation itsel f. If thc time horizon is inhnite and the l'tlnctions
zr t/, ttnd ,
/?d() not deptlnd
explicitlyt)n time the neither does the value i'unction depend equation ( 10) becomcs an ordinary differential equation with independent variable'. ,
()n .r
time, and as its only
write
+ dx the Let x be the known starting position at time f and x' ftar Lemma A/. lto's of time of small interval end the a random position at the of Applying it to 3. equation Chapter stated in (25) such a process was ,
4..2.! bl (-r
Note that we have followed standard calculus notation and used primes tt) denote total derivatives of a function ofone independcnt variable, and subscripts to denote partial derivatives of a function 01' several independent variables.
Mathematical fkckgrtxlnf,l
108
We will generally adhere to this, but will occasionally use subscripts even for superscript for total derivatives, for example if the function symbol needs a some other reason. will ln most of our models of investment throughout Chapters 5-9, we will and develop have occasion to fofmulate and solve equations like (11), appropriate solution methods for them gradually. We turn to one special kind of control, namely optimal stopping of an Ito process. that is of particular
importance in all of our applications. 1.G
Ullcertatty
Now the Bellman equation
l ()9
for the optimal
stopping problem,
(6),
becomes Fx
.
t)
=
( 2(.r. t )
max
zr (.,r t ) +
,
-
l ( 1 + p dt )-
z.-(Ft-r
+ dx t + ,
In the continuation region, the second term on the right-hand
of the two. Expanding it by Ito's Lemma and simplity'ing as partial differential equation satished by the value function: 12 bl ( v' t ) Fra.(.v t j + 9
Optimal Stopping and Smooth Pasting
,
.
tl
tx I ) F).(.x t ) + .
.
/7)(.: t ) ,
-
JJ
) I A'l
)
.
side is the larger above, we get the
p F(x t ) + zr j..r t ) ,
,
=
0
.
(l 3)
where subscripts denote partial derivatives. > This holds for (/), and we must Iook for boundary conditions From the Bellman equation, we know that in the that hold along stopping region we have F(x, / ) Q (x. /). so by continuity we can impose the condition F(.r* (J ) J ) (-r*(/ ) t ) for alI t (l4) .r*
.r
Here we consider a binary decision problem. At every instant, the 5rm can either continue its current situation to get a proft Cow, or stop and get a termination payoff. Both the prost flow xx. t) and the termination payoff Q (x. t) can depend on a state variable x and on time f where x followsan Ito ,
process
Optilllizatiolt I/lltcr ??t'???lc
-r*(/).
.r
=
=
''z
.
=
,
.
This is oten called thc condition'' because it matches the values of the unknown function F(.r. / ) to those of the known termination pyoff function f2 (a'. t ). But the boundary itself is an unknown'. the region in (-r. tq space over which the partial differential equation ( 13) is valid is itself endogenous. The boundary of tllat region. namely the culwe -E*(/), is called a boundary,'' and the whole problem of solving the equation and determining its region of validity is called a free-boundary problem. It is clear that we need a second condition in addition to ( l4) if we are to find x*(1) jointlywith the function F(x, I). The general mathematical theory of partial differential equations is of Iittle help in this regard; the conditions applicable to free boundaries are specific to each application and must come from economic torphysical or biological. as the case may be) considerations. For us the right condition turns out to require that for each t, the values F@. t) and 62(-t, t), regarded as functions o'f x, should meet tangentially at etvalue-matching
dx
=
a (x t dt + bx ,
.
(12)
t ) #z.
The most obvious example is of a 5rm deciding whether to cease operation and sell its equipment for its scrap value. lnvestment decisions can also be put in this form: continuation means waiting, and the flow payoff is zero; stopping expected present value means investing. and the termination payoff isjust the minus the of investment. cost of future protits from the project Intuition suggests that for each t there will be a critical value x*(f ), with continuation optimal if xt lies on one side of x. (J), and stopping optimal on the other side. We saw in Section 1.D that some conditions must be imposed on the proht flow and termination payoff functions to ensure this. Continuation will be relatively more attractive for larger values of if the expression in (7) is an increasing function of x. In continuous time, if x follows the Ito process (12), then the analysis of Appendix B shows that .x'
xtxl -
p
f2(x t4 + ,
(1(.x,
t)
tt + t'-2xt.x.
lj bx. J)2 fzxxtx. tj + fzf(x, f )
should be increasing in x for each t. Similarly, continuation will be less attractive relative to stopping for larger if the expression is decreasing. In each of will hold. For sake of exposition we our applications, one of these conditions the former takc up case. (/) for various Given such conditions, we can regard the critical values ?) space into two regions, with contindivides frming the that (-r, a curve t as uation optimal above the curve and termination optimal below it. Of course = x.(t) in advance, but must hnd we do not know te equation of the curve x problem. programming solution of of the dynamic the it out as a part .x
.x*
ttfree
the boundary
-r*
(J),
or b (x*(/ ) t ) ,
=
Q.r(-x*( I ) t ) .
for all
I
.
( l5 )
This is called the contact'' or condition'' because it requires not just the values but also the derivatives or slopes of the two functions to match at the boundaly. t'high-order
t'smooth-pasting
While continuity is very intuitive, continuity of slopes or smooth pasting
is more subtle and remarkable. However, the argument for it is somewhat technical, so we relegate it to Appendix C. Here we merely illustrate how it works.
Nlathenlatical f'ltlc/v-qrot//?t/ 1.H
Optimal Abandonment
Example
1;h.p?7:l??1/c(jlilliltli--flkl'llllI/??r/cr
of a Machine
IvlllQ'Q,t.t(lillI.
x
that follow are full t)f applications of dynamic programming and contingent claims analysis. Here. however. having developed the theory at a general and rather dry Ievel. it wtptlld be useful to offer a concfete example. We do not solve it in detail, but merely state the solution backed by some intuition. We hope this illustrates the various steps in a specihc context, and prepares the reader for more detailed agplications to come. Suppose the asset is a machine used to make widgets, with a total physical life of T years. Its profitability declines over this Iife, both because it wears out gradually and thus produces less output or rcquires more maintenance, and because technical progress elsewhere in the economy makes this machine less competitivewith newer ones.rrhere are also random shocks to its productivity, because of the general business cycle, or because o idiosyncratic variations in the demand for widgets. Let the state variable x be the current operating and suppose it evolves according to profit The chapters
0 05 .
0
2
4
6
-0.05
10
8
x
-0.1 0 -0.15
now,
J-r
=
t? dt +
b t/z.
0 to rellect the gradual decline over the Iifetime. At any time during the physical life. the firm can abandon the machine. If the current prost tlowbecomes negative. this may seem an attractive alternative. Once abandoned, however. the machine will rust quickly and be very costly to restart should the protit llow recover. Therefore the abandonment decision will have to Iook ahead to such future possibilities. The tirm will condition. Of course, acccpt some losses to keep the machine in operating Iife of the machine is physical accepting losses will be less compelling if the variables, the currcnt drawing to a close. Thus we must keep track of two there will that profit, x, and the age of the machine, t. Intuitively, we know this curve the be a threshold culwe x't ) such that if the current x falls below machine will be abandoned. 10 The actual parameters used in the calculation are F = l() years. p which = standard implies a 0.2, l per year, and b percent per year, a deviation of 0.2 over one year, or a variance of 0.04 per year. To obtain a numerical solution, we use a discrete approximation to Brownian motion, 0.01, or 3.65 days. Correspondingly,each discrete step of the profit with Lt
where a
<
=
-0.
=
=
0.02. b Al We solve the dynamic programming problem directly using the method outlined at the end ofsection 1.B, starting at F when there is no future consideration, and marching backward one time step at a time. Figure 4.1 shows the solution. Part (a) shows the optimal threshold curve the free boundary
variable x is th
=
=
Figure 4 1. .
f-lfzrrtrca/fp?'land
zl/;fJ?'lt/t'prl??lc/J/
*(1)
l
/V/'tl//lt:'/?lflfl'cfl/Backgl-oltlltl
-v*(J) in (1 space. At each Js if the current is above this curve. the machine is kept in operation and has a value Fx. t ) that satisfies the differential eqtlation corresponding to (13),namely, .r)
-v'
,
Below the curve. the machine is abandoned tbr the termination value 0. (We value could have also obtained a solution by specifying some other scrap approaches machine the the of age function.) Note how the culwe goes to 0 as
the physical limit of 10 years there is no reason to keep alive :1 loss-making project in the hope of a future turnaround if the machine is going to die remaining physical Iife of the machine, the very soon anpvay. The greater the effect ultimately greater is the willingness to absorb some losses. However, this will be kept operating Ievels off. With a lo-year horizon. a brand-newmachine
loss is about 0.15. f ) as :1 of figure shows graphs of the value function the (b) the values would greater of t. As we expect, function of x for some particular machine has valutl thc of the value machine. However. the is the greater is that we assumed even if = 0, because, given the simple Brownian motion that the valuethe in Note will risc that there is t'uture. possibility A', the for matching and smooth-pasting conditions hold; for cach of the chosen /, both (/ ). Fx. t) and l (.r, t) fall to zcro as approaches What if the machine has a very long physical life that we can regard as effectively inlinite? Now we can leave calendar time out of the picture and solve a recursive functional equation for F(x), or we can remove time from the partial differential equation ( l3) and writc it as an ordinary differential
even if the
current
-(-r.
Part
.r.
-v
fihvllf7llltp(lillit'liztllilll'
lt?lf/c?-
Illtoz>l-ltlilllbt
called the mean arrival rate. I1*a jumpoccu rs- it is ofsize gt-r / ) l/. vvlle re t) is a known tknction and lt is a random variable. Witll probability ( 1 - t// ) there is no randon: jump. and moves by :1 deterministic anlount /'(.r. t ) d. -(-v'
,
.
-t-
We write this compactly by analogy with the notation for Brownian motion as J-r
where iIq is othenvise.
11
random
./'(-r
=
t)
-
variable
iit
+ g(.r t ) tlq .
that equals
lt
.
with probability
tit
and 0
Now consider dynamic programming when the state variable tbllows a Poisson process. We illustrate this for the optimal stopping problem. since this will be our most common application in this context. Once again the values of x will fall into two subsets, one where immediate stopping is optimal with the termination value f2 (a-. t ), and the (lther where continuation is optimal for at least the next short interval JJ, with the llow payoff n' (.r. / ). What happens to the asset value return equation (8) in this case? First suppose lt is :1 known nonrandom number. Then thdre arut two possibilities for the change in vatue tl F depending on whether a jump from J lt takds us into the stopping rcgion or not. I1'it does. then ..rto + ,
.g(.'.
.-
.r
.r*
.t.
equation
! b: F'' ( r ) +
2
a F' ( r ) ''
*
p F( ) + x -r
-
=
() .
The solution and the threshold can be found using the value-matching and 0. In Chapters 5-7 we will smooth-pasting conditions F(x.) = t). F'(.r*) develop this procedure in some detail, so here we merely invite interestcd readers to tly it out. The result in our numerical example is that lhe critical 17. Thus a lo-year life is already quite close to for abandonment equals innity as far as the effect of the future on the willingness to absorb current .t*
=
-r*
-0.
losses is concerned. 1.I
Using this in (8) and Ietting
If
g() tt) zero- wll have
region. we get a similar equation t )tt remains in the continuation ) (-r+ g(.t. J )tt) replaced by Fx + g(.r, / )11).More generally, when lf is random, we must allow both of thesc cases, and obtain a combined equatilln by taking the expectation over the distribution of u. ct-r.
+ with but -r
Note a new feature'. unlike the partial differential equation ( 13) for the Ito process case. the equation ( l7) is not 1)a11to the continuation region. We cannot hope to solve it separately and then paste it to the terminal payoff at the stopping boundary. Therefore the problem for the general Poisson proccss is quite hard. However, there are some simple cases. Suppose the jump. if one occurs, is always to the same known point, say Then we have -r().
(p
Poisson Processes
We introduced Poisson ump) processes in Chapter 3. Over a short interval dt of time. the probability of ajump in the random variable x is J/, where is
tlt
+
! F (-r
,
t)
=
n. (x t ) + ,
F (x ) / ) .
,
if is in the continuation region, and a similar equation but with f2 (-r().1) if it is in the stopping region. For example, if corresponds to a sudden stoppage vr(l
.zkl
l )/ ( /) + ) 1-Ie re t he 7r ( () :1 ntl 1-.(-r t ) f2 (.1..(4/ ) ltddition rllte /). disctltlnt the tt) Poisstln arrival rate sinlply acts Iikklall ulltlcrlying Mvill applicatitlns vvllere thtl develtlp stlme In Iater chapters we ltnalysis. I an-lenable n a couple simpltt Poisson process to uncertainty follows a untlergoes variable the wllere a ot' instances we will have a combined model, there is if lto proctlss Poisson jurnpwith :1 specified hazard rate- and follows an (.)tltl ined tions conlbine thtl featu res and equations the slllu ir the Then nlaj
of t he I'low payof then
.r
.
-
.
-
.
.r
ump.
here.
wllere a is t Ile grtlqvtll rltttl p:trllllleterand t/c tlle incre lnt!l: t ()1' t Ile stttlltlartl generlll prtlcess latklr.
t'r
tlle prtlportit'jlllll vktriltllce p:lrlkl'l-letdl-. ltlltlq.v 1' ) 1- 11 nltpl-e prtlcess. 5Ve
Nviene
tll:tt tlltl firnl-s (ltltptlt call itself bt't traded as :ln asset in Tllis Nvotl Id litc raIIy be t 11etrase i1-t l1eotl tptlt is :1 conp nltltl ity Iike oil ()r ctlpper. Il1 tllc Ilext section we Nvill slltlsv thltt it is stlfficient that tlle risk i11 t ht.)dyllttn-licsof I'lanlo Iy t he te rn1 tll.'l(.lve. clln l)e rtlpl icllted l7ysol-ne port folio tlt' t radetl assets. Like any llsset. the (ltltptlt is Ileld l7y investtlrs tlll ly il' it prtlvitles l stlll ficiently high rettlrn. Pltrt ()1* the rtlttlrn ctlllles il) tlltl I'(lrnl t)l' tlle expccttltl (.)f 11 divitlelltl. u. Flltltller prictl ltpprtltzikltitll'l. pltrt nllly ktlst.) ctlrne in t 11e lrll'1 l'nigllt 1')e tllat tl'le t'lr 11 intlirectly &v()()tI prlldtlct tretl dircctly ( grlqlvs n-lllre ) (the holtler ()1' tlil t'lr cllpper I-n igllt be lt firll'l tlltkt !7lilllstt) tlse tllese kts illptlts and jintls it ctlnvellient tt) I)()ltI its tlvvn illvellttlry rtttller tlllll'l rely t)I1 tlle spllt yvi rnarket t l'lcn t 11edivitle nd is t llt2ilnpl icit n itlnce yieltl-- ). Nve ll tl isctlss kkl-ltl (11' ().' Ilerc we tl1is ctlnvelliellce yicld in slln-le tletltil in Cllllptklrs 5 the rllle tlividentl ltlltl tlelltlttz its rktte l)y (. Le( stiptllltte tllttt tilcrk.t lt is pt a ..hJ sifnply (11* cxpected l1e r:lte retu rll. denllte t t()t1lI Tllis expcctcd rcttlrn nltlst l')eentltlgll t() ctln-lpellsrtte tlle Illlltlers lklr risk ()f ctltl rse it is nllt risk' :ls stlcll t l'lat nlllt ters. btl t ()11 ly 11()11t1 iversi Iiltlnlc risk 'rlle wl1()Ie rnltrket pllrtl'(llit) prllvides tlle nlllxirrltlnl ltvltilltlAle tliversificlttillll. ()1* the rlte ()t' rettl rn on tlle rtsset Nvitll tlltt ()n tllc &vl1()lt! so it is the cllvllrillnce tlt 1*4.4)1 rnark ptlrt it) t illtt detc rnl ines t l1e risk prenl itl 111 tllat tlltl riskless rltttt ()1* rcttl rn ''Fhrlltlgllllut (lur ltnalysis we will ltssunle lied. nously speci l'or exarnple thc lts re tu rn ()n gllvern rnen t b()I1tIs.3 r is extlge (.)f tlll cllndititln R-ht'tnt he I'undln-len equ ilibriu n'1frtlrll t i-lecapi tll tsset p rici ng rnodel (C.A PN1) sltys tllltt Nosv Nve
llsstlnle
finallcialIllllrktlts.
2
Contingent Claims Analysis
'lz
-r.
Wllen wc studied the optinAal stopping problem in dynanpic progrtmnling. we interpreted Fx. l ) as the nlarket valu of an asset that entitles the owner to dquatilln (8) expressetl the condithe Iirm's futurc prolit lltlws x(.-. t ). The short interval of til-neathe who asset tklra holds this tion that tbr an investor prtlvide :1 totlll eapital together gain and thc expecttld imnzedittteproht flow exogcnouslybtl t in pritctice specified this disctlunt rate rate of return p. bkk tllerefore it and of capital. opportunity cost it has the interpretation as the darned ()n other investment have should equal the return thc investor could make thtl ide:l characteristics. N()w risk we opportunities with comparable t)f risk. :1 more cxplicit, and extend it to providtt better trcatment economics has develtlped sllphisticatetl theories describing the
Financial
aggregation
decisions of investors. the markct equilibfia restllting i'rom the ()1* assets. Tlle basic sctting is of such decisionss Ilnd the equilibrium prices with dilkrcnt rcturn and risk' rich menu of tradt!d assets an economy with a replica its return and risk characteristics. 7b value :1 new asset, we try to ()f the ()f traded existing assets. Thc price characteristics through a portfolio equal the market value of this portfolio. Any discrepnew asset must then by arbitrageurs who Iook lr sure protits by buying would exploited be ancy repackaging it, and selling it in the mtlre valuable form. is cheaper, whichever Thercfore price discrepancies for equivalent assets or portfolios could not analpersist in equilibrium. The asset held in the continuation region of our assumed that thd ysis can be analyzed in ttlis way. Much of this theory has and wc shall begin Ito described by be an process, uncertainty underlying
w-k.rlll'lvc
',
.
.
.
'can
likewise. Replicating Portfolio We begin
variable
-r;
the simplest setting. Suppose the profit j1()w depends on a think ()t- it as the tirm's output price. Since we will be dealing
with
where () is an
aggrttgate
market
paramcter
(the
I'nitrkct
3In reltlity even plvernnlent bllntls have sl3nle risk becaustt complicat ifln I'''llra fulle r genc ral ctlu ilibri u In mtldc I t hat klete rn1 ines rates. set! C()x. l ngerstyl 1. antl lttlss ( l 985). .
pricc
(,1'
l Ilc
()1*
risk ) that is
inlllttitln: wc neglcct tllis tklrn1 st ructu re t) 1*i11terttst
Mathematical Jfzc/v-/lrtpaltk
116
between pxp, is the coefficient of correlation and the whole market portfolio ln.4 We hnd the value F'(-r. tj of a firm with proht flow n. @. J ) (reallythe value of the asset that entitles the owner to the protit flow stream) by replicating its
exogenous to our analysis. and returns on the particular asset
(5-r
=
Thus the total return per dollar invested is +
a + J).t
??
1+
nx
dt
+
t:r
nx
Jz.
l + nx
The total return per dollar invested is
; (.r t ) + s
e-r Fx ( r t ) + 1 2 c .
Fx
.
-
t)
2 -
r2 Faa (x t ) .. J/ + ,
f.y
x Fv.(x t ) .
)
/
) thd right-hand
pl-r
side becomes
,
?'
l
A-
l.(-r J )
F.%- )
F.v(.r t ) Fx t )
-r
.
+
(J
+
t
.
)
a
On simpI1h-cation. t he re t tl rn eq u at ion becomes
for the
.
.
al d 1ffe re n tial eq uation
11 parti
value:
This is strik-ingly similar to the corresponding equcttion ( l3) that we derived by dynamic programmng methods. Indeed. the analogy s almost exact if we rewrite the dynarnic programming equation tbr the geometric Brownian f',r motion process using tl (-r ? ) = t.z and /?(-r.t ) The only remaining differktncttis that the risk-less interest rate 1- is used in place of tbe exogenously specihkeddiscount rate pa and the coeflicient of the F.vterm has an '- ( instead of a. NVewill discuss this ctlrresptlndence between the dynamic programming and contingent claims valuatilln approaches in Section 3. An alternative and equivalent way to derive the same result is to construct 01* t he firm and 11 un its of a short pt'W/f-vl in t 11easset a porttkllio that tnlnsists 11 chtlsen Then is t() make this ptlrtllit) riskless. This is algebraically somewhat sinlpler. s() wtt will generally use this methlld in the luture. l'Iowever. the one given ltbllve denlllnst rates the cllncept of ctlnstructing 11 lvplicatlg pf/rr/b/ta morc diructly and clearly. =
.r.
-
-t'
.
we must
tz.
2.B
there-
Even if the risk in x is not tlirectly traded in the market. it suffiees to be able to tradc some (lther assct whtlse risk tracks ()r spans the uncertainty in Now we show how this works. In the process we generalize the above analysis by Ietting follow an arbitrafy Ito proccss t)f equation ( 12) above. We also demonstrate the alternative approach to replication mentioned above. We suppose therc is a traded asset whose stochastic fluctuations are perfectlycorrelated with the stochastic process for x. (This traded asset could be a simple asset such as a stock or futures contract. or a dynamic portfolio of simplttassets, that is. a portlblio of assets whose contents are adjusted continuouslys() that the value of the porttblio is perfectly orrelated with the process To remind ourselves that the traded asset is track-ing or spanning the for risk in we call it the spanning (i.e.,replicating asset. Let A'denote its market price. Then the stochastic proccss of X must take the form
fore choose
The Use of Spanning Asscts
-r.
-r
However, in the market. two assets with identical risk must earn equal return. Therefore this choice must also ensure
(.r. 1)
+
(.r
c2 x2 F Fx (.: J ) + 1. x,r (x t ) 2 .
Fx,
.
J)
.
=
r + n
(a
+ jlar
1 + nx
.
4lD'or more on the capital assct pricing modclv see any standard text on financial economics'. Brealey and Myers ( 1992) is relatively elementary, and Huang and Litzenberger ( 199f)) is more
advanced.
5To be rigorous. in continuous timc r(.r. t ) can ciange even over this short interval, and the is of magnitude and we can ignorc it.
evolution of it is random. However. the differcnce made by this consideration
dIl
(l +
.
Ft-r
If our portfolio is to replicate the risk of owning the firm,
.Tr
lzb'/
.r
-r
,
Substituting for
'ttttlcr
.
Compare this with holding ownership of the 5rm for the same short intelwalof time dt. This costs Fx. J) to buy. The dividend is the prolit zrt-r. /) J/; this involves no uncertainty since is known when the initial decision is being made.s The asset also yields a random capital gain, which we calculate using Ito's Lemma as
z (.,r t ) +
JJ/j???j--t?/jc'?? Ikbvlltl''ki-f'7--
-r
return and risk characteristics using traded assets of known value. Speciticallys consider investing a dollar in the riskless asset and also buying n units of the hrm's output', we will choose n shortly to achieve the desired replication. This portfolio costs (1 + nx4 dollars. Hold it for a short interval of time dt. In this time, the riskless asset pays the sure return r dt, while the other asset pays a dividend n dt and has a random capital gain of /1 dx n e-r dt + /1 tz'-r Jz. r
cwtzlct.zl-/tljli''
-r.)
.r,
llltl Sti/t.-'t/-/4l
Ibltlllleltltlt't'll
Note two points. Firsts the coefficients z1, (.r. t ) and Bfx. t ) llre I-unctions ()1' thd not the price of the replicating asset. X. This is in kecping state variable, with the notion that the state variable summarizes all the intbrmation about the current state of the economy. Second. the coefficients z:ll-r t ) and St-r, t ) of the asset price process (2l ) need bear nt) relation to the t1 (.t-.l ) and /?(-r.t ) of the state evolution process ( 12),.but the two 'Wiener process increments dz must be the same if X is to track the stochastic tluctuations in (Wllen we say same, we mean that the two must have identical realizations, not merely that they have the same probability law.) Suppose the replicating asset also pays a flow dividend at rate D(-r, t ). Then one dollar invested in this asset over the small interval of time from t to (/ + dt ) generates the total return: -r,
.
-r.
This has basically t l1e salme forn) as the earl ier (2()'). The merit of the contingent clainps valuation approach in this context is that all the coefficie nts of these equa tions are e ither k nown frona the specilication of the mode I stlch as (1 (.r t ) t)r can btl obse rved or dstimated from the market- as with ii ( / ) Tllen the pa rtia I d ifferential eqtlation can be solved to obtain the valtle t)f the firnl. .
.r
.r
.
Next we ask what rate of return will make an investor willing to hold this
replicating asset. The capital asset pricing model (CAPM) formula for the required expected return. which we denote by /z,r(-r- t ), is Jz .r (..r-J )
=
r +
4 ;)b St-r t ) ,,,
(22)
.
.
To understand
The market this, compare it to the earlier lbrmula ( l 9) lr is it the in the is aggregatc two cases. an so same parameter, 4 is S(.t--t ). and since tllc changes The standard deviation of the return on tiX and t-r are pertctly corrclated, the correlation coemcient Inetwecn the zzrates of return on and the markct is the same as that between and the market, namely pv.,,,. Finally, note that in an equilibrium wherc thtl asset X is actually held, we must have
price of
-r.
risk
'
.r
.
Srnooth Pasting The above analysis assunles (lnly that the varitlus assets are held dtlring a very short intcrval ol' tinle t/J Wllllt happens lfter til'ntl / + t// is ()f nk) tzllncern. and does nklt alkct tlle validity ()f tlle partial diflkrential eqtlatitlns (24) ()r (2(),).I.lowever. sllltltillns t() these eqtlat ions rctluire bllu ntlary conditions. antl .
there
lre sllme attentit) n tt) Illnger ti nAe spans. I f the firm thltt is l'leing vltltletl abilvt, Iltks: Iixetl tilne Illlriztln T svhen it is forced to take lt te rn4 ination payoff f2 (.t-r F) then &ve can solve t htl pa rtial .
.
d iftk rll nt ia I (lq ua t io n su bject to t he b()tl nda lz c() nd it i()n 1--( F ) f2 (x T ) for aIl Likewise. thtl fi rm may be-/brccf/ t() take t l1e te rm inatilln pityllff at an ( l ) I-!ere the boundary earlier time l if the state variable hits a threshold condition is clearly .t-
.
.
-t.
-r*
.
;; (-r t ) .v
.
=
D(.r t ) + zlt-r ,
,
/
)
(23)
.
Now consider a portfolio that consists of the firm and
11
units of a short
dollars to buy. I-lold it for a position in the asset X. This costs (F(-r. t ) n short interval of time J?. During this time the firm pays a dividend of Jrt-r, t ) dt. z''l
-
Further, since a unit of X pays a dividend of D(-r. / ) Xdt the holder of a short position must pay this to some corresponding holder of the long position. Tlle capital gain on the portfolio is ,
dF
-
6IX
n
=
g ; + a F.v+
bl Fxx
.51 .,z1 -
n
dt +
g!l&
-
?1
B
.'1
Jz.
ctlndition ( l 4) we found in the setztitln ()n This is exactly the value-matching dynamic programming. Sometimes the firm can clloose its tcrmination optimally. knowing its termination payoff function f2 (.,r / ). This decision will be made so as to maximize the firm's value. We know from our dynamic programming analysis that such choicedetermines a threshold or free boundary (/ ), and that the appropriate additional condition ( 15) is the property, .
-r+
where we have used Ito's Lemma, and have omitted the arguments of the functions for brevity. To make this portfolio riskless, we must choose n b F / ( BzY)
tsmooth-pasting''
=
.
#
l.( (/ ) t ) ..r
,
:=
f2 t. (
-'t'
#
(t ) t ) ,
f()r a ll /
.
/ltlthi-jl/'f?l//lf/ 1bf1(llIlL'IlltlliL'(II
120 2.D
Poisson Processes
Suppose the state variable follows the Poissonjump process t)f equation ( l ()). rather than an Ito diffusion process. Can we create a rcplicating portfolio and use it as we did above to obtain an equation analogous to (20)? ln principle, it might be possible to 5nd an asset that duplicates the stochastic dynamics of a'(/). For example. if x(/ ) is the price of oil (andwe believed that it followed a Poisson process), the replicating asset could be a near-term tktures contract on oil. More generally, however. we would have to with a dynamic porttblio of assets. the components ofwhich were replicate follows a diffusion process. this continuously adjusted as ) tluctuates. lf continuous. is itself feasible, because the path of is so the porttblio can be value It is not feasible if another. from time to one adjusted as moves over takes discrete follows and Poisson a jumps. process x This means that when working with Poisson processes, we will tlsually have to make one of tw() assumptions. First. we can assume that stochastic changes in associated with the Poisson process are uncorrelated with market portfolio. Then there is no adjustment tbr risk. and equation (24))will again (Note that this is equivalent to dynamic progranlming hold, but with - r ?-.) Altcrnatively. cqual we can use to thd risk-free ratc. with the discount rate with programming, discount rate, p. dynamic an exogenous .z
-r(f)
.v(l)
-v.(/
-r
.r
-t'
-a.
3
Relationship
between the
rmo
Approaches
By now the reader should begin to see the close parallels between dynamic programming and contingent claims valuation. The value function of dynamic programming and the asset value in contingent claims analysis satisfy very similar partial differential equations. The Bellman equation of dynamic programming has an interpretation in terms of asset value and the willingness of investors to hold the asset. The boundary conditions in the contingent claims approach are based on the idea that investors want to choose the option ex-' ercise date optimally to maximize the value of their assets. However, there are some differences, too. The dynamic programming approach started by specifying the discount rate, p, exogenously as a part of the objective function. In the contingent claims approach the required rate of return on the asset was derived as an implication of the overall equilibrium in capital markets. Only the riskless rate of return, r, was taken to be exogenous (and even that can be endogenized if the theory is taken to an even more
genentl equilibrium lcvtll ()1' anltlysisl. Thus the offers 11 better t reatment ()1' tlle d iscount rate. Balancillg this considdration.
the contingent
contingent
claims approach
claims approach
requires
the existence of :1 sufficiently rich set of markets in risky assets. The crucial requirement is that the stochastic component dz of the return on the asset we are trying to value be exactly replicated by the stochastic comptnent of the return on some traded asset tordynamic portfolig of traded assets). This can be quite demanding we require not only that the stochastic components obey the same probability law. but also that they are perectly correlated, namely that each and every path (realization) of one process is replicated by th other. Dynamic programming makes no such demand: if risk oannot be traded in markcts. the objective fnction can simply reflect the decision maker-s subjectivc valuation t)f risk. Tlle tlbjective function is usually assumed to have the form ()f the present valtle of 11 tlow function calculated tlsing 11 constant discount rate. p. This is restrictive in its own way. but it too can lnt2generalized. Of course we Iave ntl objective or tllnsklrvabltl knowludge t)l' private preferences, so testing the thet'ry can be hardu r--utility--
Thus
we see that the
twl' mcthllds have offsetting advantages and disadtllgether they can handle quitc a large variety of applications. v:tntages. In specific applications ()11e may be mtlre convenient in practice than the (lther. and diftkrunt rcaders mlly develtlp a better feel Ibr one rather than the other. but there is no diflrence ()1' principle between thtl two ()n their common grotlnd. In the chapturs that l'ollllw. we will often track the two approaches in parallel. and switch from one to the other as convenient. For example. in Chapter 5 we will first ustl dynamic pnlgramming and then use contingent Ctnd
clain'ls analysis to solve a vcry basic investment problem when to nnake a sunk expenditurc I in return for 1. factllry tzurrcntly worth )' wherc )' tbllows a getlmetric Brownian motion. This will let us explore the differenctls in the in mllre detail. twl) ltpproaches ,
Equivalent Risk-neutral Valuation A further exploration of the relationship between d ynamic programming and contingent claims valuatilln Ieads to a usetkl way of writing down and interpreting slllutions to partial diftkrential equations for asset values. We will illustrate tllis in the familiar context of a firm whose profit flow ;rrt-r. / ) depends We will also force termination at a finite time F, with on a state variable a terminal payoff Q (x.r F ). We will assume that the state variable foklows -r.
,
/'?JJr?'?lI'.zf?JJ'fpl'?
l-a-hvblttlltlio
Tllis is ust tllkl tlyllllrn ic progranlrnillg t'ttltllttitlll ( I2) 1)1-tlle presellt cltse of geornetric BroNvn iklll nlot i()n. 'Flze boun(.l:tl'ytztpntli itdtlis t
11gttometric Brownian motitln
(1x
ilt
-t-
a
=
+
('r
a'
t/--
.
Nvill allow us to develop the exptlsition in the simThese special assumptions much plest ptlssible way, but the reader will see tha! tlle underlying itleas are more generally valid. valtle of Stlppose at time t the curre nt state is Let 1--(.r t ) denote the the lirm, namely, the title to the stated strealn of profits. We will derive this in each of the two ways developed before in this chapter. Begin with dynamic programming. Here we stipulate an exogenotls disvalue count rate. p. Then F(.r, /) is just the expected present .r.
.
F
F (-r I )
Ct
=:
,
(;'
-/?(r
-1
)
.7r
(
.
r
.
r ) ( j r '+ e
1111(1.,1- /....'5?f'(??-/t'??l/:-
-/'t
r-f
)
)( r -r
.
r)
F a- F )
f? (-r F )
.
('(.)1- l lI
.
.t'
,
which our expression (25) slltisti!s by const rtlctitlll. I11 ('ther pression is the solutitln to the pflrtial tlifferential tlquation. I-lad Nve lnelltlllby tleriving
tlle equntitln nnd thtt bllundal'y
.r
.r
-
-
-
.
.
as of time t If we consider the situation a short time dl later, the state variable will (af tlle asset will have changed to have moved to (-r + J-r). and thc value Fx + dx t dt ). X) express this in time-l equivalent units. we must discount
where t-; denotes the expectation based on the information
+
.
Further, (/.r is a random increment from the perspectve must take an expectation. Thtls
:-P2f
,
(2t4) This idea of splitting the whole time interval from t to F into twl) parts the wholu immcdiatc short interval t/J and the continuation bdyond that is thc is Bellman equation. essence of dynamic programming. Thus euation (26) a during the interval JI, is taken action instance this kind. trivial In no but of a right-hand side. so there is no maximization on the (lmit side terms right-lland of the (26) using Ito-s Lttmma- and Expand yields (). than This dt dt as that go to zero faster --
+ e
,
=
dt
-/'
n.(-r t ) (
7t (F (-r + J-r t + d ) j ,
x (.z-.t ) J/ + ( 1 - p ''6
1k!jF ( r / ) c . t
.
1.'
''
-(.r,J) -
+
''
9
ga .!
=
2 :.2
/7.2
(lt ) ( A'(-r. / ) + Fi (-r, ) + F. (-r t ) a
(lt
,
antl
--3
.
l
it by the factor of time / so we
tronditioll-
tlx-
then started look ing for :1 solution. that woultl have seelmed t fornlidktble task. Howeve r- th is is lt vtt fy lucky and excptional instancc Nvhtlre vvtt kneqv the solution (25) even be 1'()re vvtl t1e rivetl the eq uation. O f cou rse it neetls a Iot of wllrk to eval tlate the expectation. We k novv that given tlle ini tial at time /. the state at any ftlture t inle is llpgntqlrnlalIy d ist ribtl ted. >Xlso-lbr > ) ltntl v:triktnctl r 2 /. the Iogarithnl of a-r has l'nean I()g + (tz ..ty ) ( r Il /' ) tlnd / ). ( f2 tlllctiollltl r have (.r/. ient (.r. ) l x ver.y ctlnvell f'r ttlrnls- tor exllluple.povvers t)r tlxplpnelltialsit is ptpssibte (t) evltlultte thtt expression (25) explicitly.Othenvise tln(2 Inust rtlsllrt t() Iltlnlericlll stpltltitllls. I''Illwever. tlle expression llktssome conceptutl use. as we sot'n see. Tllc result thktt (25) is tlle stlltltilln t() tlle tlil'lkrelltiltl etltlatitpll 27) Nvitll ( the blltlndkry cllllditil'n (28) is :t speci:ll case ()1- :1 ver.y generttl result k nllsvll I'(lr as tllc Fttyllnlltn-lllc lklrmtlllt: see Kltr:ltzlls tlld Sllreve ( l 988. pp. 2671*1*) ()!' it.f' a mtlre detailed Ctnd rigllrlltls tlisctlssilln -
.
svortls- tllat
-r
dt
.
.
'will
N()w cllnsider tlle prlllpleln
()1*
v:ltli ilg
contingent clltinls s'lklltlCltitlll. I Iere sve itlreiltly the partial diftk rll ntial equktitln (2()), svhich
Recall tllat
tlle lirnl l'rtlnl t l'le perspective (11' slltpwetl t I):tt tlle vllltle skttislies we restttte lk,r t! ase klt' re ferencc:
is the riskless in terest rate. C'ntl tti pt a is the dividend t)r conveniencc yield t)n the asset. The boundafy conditikln is again (28). I-lerc we do nllt k now thll stllutilln in advance. I'Illwever- we can write it down immediately by ntlticing the formal analogy between this partial differcntial tlq uat ion and thkl ()ntl (ll7titi netl us ing t he dynam ic progranlm ing 1.
=
-
.r
dt j
.r2
Fvx(.r. t) +
.
p Fx- t) + zr (-v-t)
a
.r
Fv(-r. /) +
) (.r- /)
1J/.
Substituting in (26)and simplifying, we see that Fx. t) satisfies the following partial differential equation:
(27)
'' In qtlantum elcctrtldynlmics tlle result prklvcs t() hllve inlnlense Ilrltctical tltilily. In lct it :111 underlies Fttynnlltn's t I949 ) diclgrammatic tcchnique I'(lr sunlnlillg prt ll'y:ll'lilities (lver ptpssible paths of u particle. l-lis apprllach, develllpetl beforc dynamic pnpgrlmmiflg ltnd l t()'s Lenlnla had ()f. becn thought lhc prtll'lttbility was ;1n amuzing acllievement. Since the deptrlltlcnl vari:lble amplitude in quantllm ttlectrodynanl ics is ctlruplex valued, tht! anilltlgy with dynarrlic prllgrCtrnming ltnd cllnti ngttnt cIa inls val uat illn m:ly nllt extttllf.lbcytlntl l 11emrtt Ilenllll icitI lrrnal isnl. I1*it r( does. then in addititln t() :tII his acllievements in physics. Feyllnl:lll clltlld be claimcd ;ls tlle l'atllt!r tf (inancial econlymics.
s'liltllellaticill
'ltlc/g/-tpl//lt/
L'yllal'lic Op/l'?l?ztzlll ltllder
approach, (27).The exogenously specified diseotlnt rate p tbr the latter is growth rate a of the genow replaced by the riskless market rate r. and the J). replaced In other words. we can ot' motit)n by is (l' ometric Brownian evaluate the future payoff by discounting it at the riskiess rate r. provided we with a different growth rate are willing to pretend that follows a process a' J. r parameter -r
Uplc-cr/t/ll/.y
! 25
-r/
Next suppose f2 (-r) Ibr some given on the lognormal distribution.
p. Now.
=
using standard
results
-
.v
=
-
and Fx. ())
Therefore the solution is
For
C(A,
f)
=
where is an t, but thereaer -r'
(29)
S't that starts at the same initial point follows a new geometric Brownian motion
artificial variable
.r
at time
0.2
xtl exp
=
((1a p(#
l ) + (?.
-
e-& F
J)
-
p
-
r)
r j.
1 this reduces to tk we get just tz-'' F' the as above. For p H riskless and theretbre discounted at the rate r. Finally, if is 1 is payoff p a root of the quadratic equation
p
-t'
=
=
-r0
1 0.2 2 pp
l ) + (r
-
J)
-
p
-
r
().
=
then we get F(.r. 0) Here t I1etbrce of growth is exactly offset by that of discounting; thus we can just evaluate the terminal payoff function at the initial state a- and call that the asset value. Nve will see this used later in Chapter (b and elsewhere. -r#
=
The expectation
t-' is taken l
with respect to this stochastic process, from the (namelythe value of at time ?. .r)
perspective of the information
risk-neutral valuation-'' a proWe have here an instance of economics: see financfal applicability in wider interest and with much cedure Dufhe ( 1988, Section 17) and Huang and Litzenberger ( 19t?(3,Chapter 8) for rigorous and general theory.
3.B
Examples
We illustrate the procedurc with somc simple examples. In each case we Cind the initial value F(.r. t)). First consider the simplest case whcre therc is no protit tlow, and the Then terminal payoff is f2 (-t) =
For a somewhat
Seequivalent
-r.
F (-r ()) -
-
e
=
P F
.
Taking the equivalent risk-neutral perspectivesthe expectation cess is E-Er 1t) 1 ..'
,
=
.E e
4r...
)
r
trickier cxample. consider the case of risk neutrality tl and b. detine
of the
)
1 i1-tl
( ) -r
<
.t-
-
(s
/7 .
() otherwise.
Now F(-t. ()) is simply the probability that the geometric Brownian motilln,
starting at the initial value will aftcr time F end up in the interval (tl. bt. By letting b converge to anwc get the limit of F (-r. 0)/(: as the corresponding probability density. .r.
-fp)
Either of our approaches
12 /7'2
.r'
pro-
.
and
tbr numbers
and
shows that this function satisfies
differential equation
S() (v'r 1 -
no discounting.
.
-r
2
F ,.x ( r t ) + a . .
,
.r
6r (
.r
,
t)+
6.(x t ) ,
=
the partial
()
.
In other words. we have derived the backward Kolmogorov equation Appendix to Chapter 3) as a corollary of our asset-pricing formula.
(seethe
Therefore
4 In other words, we reeognize that grows at rate as and discount its future value at the risk-adjusted rate y.. This is obvious, but serves as a simple way reader's conhdence in it. to clarify the general formula and build up the
Guide to the Literature
-r
Dynamic programming was developed by Richard Bellman and others in the 1950s.It s a standard tool in economic analysis and operations research. and
ail'ned
is treated in several textbooks. For a partictllarly sil-np.Ie exptpsitilln expositions can l7e at economists, see Dixit ( I9t)(), Cllapter 1I ). fltl'ler gilod llntl t)87). Schwartz ( l tlt? l ). and Kanlie n ftlund in Dreyfus ( 1965). Harris ( l
For an outstanding and very thorough treatment. with sevdral applicatitlns economics. and to dynamic general equilibrium theory. growth theory, Iabor 98t)). other topics, see Stokey and Lucas with Prescott ( 1 In this book we use dynamic programming only in the context of optimal control and stopping et- Brllwnian motion. For morc details but still at :,11 intuitive level, see Dixit ( 1993a). For vel'y rigorous treatments. see Fleming and Rishel ( 1975) and Krylov ( 1980). Contingent claims analysis was systematically developed tbllowing the t?73), aIpioneering papers of Black and Scholes ( l 973) and Merton ( I 97 I I though an early contribution by Samuelson ( 1965) is noteworthy in thltt it introduced stochastic calculus and the smotlth-pasting condition. Contingent claims analysis has now become an establishetl part of the literature on linancial economics, and has textbooks devoted to it, for example. Cox and Rubinstcgn ( 1985), Hull ( l 98t)), and Jarrtlw and Rudd ( l983.). A beginner 987) and Varian ( 1987) in can beneht from the expositions of ()lRubinstein ( l Ecllntlmic Perspcctivcs. C()x Ctnd Rtlss special symposium in tlle Jtlurnal a t),79) develop cllntingent claims vll( I 976) and Cox. Ross, and Rubinstein ( l (.)1%Balwnian mllt illn fhat we uation using the random walk rcprcsttntatilln discussed earlier in this chapter. Mortl advanced treatments include Dulie t?9()). ( l 988, l992), Dothan ( I9.)(3), and I-iuang and Litzenbergcr ( I For a pioncering rigorotls treatment of equivalent risk-neutral vltltlation related ideas, see ldarrison and Krcps ( l 97t?). Prccursors of these idcas and and Cox and Ross ( l976). can be tbund in Arrow ( !97()) (lxcellent and vtlry enjoyable history ()f the devel1 Bernstein ( 992) is an opment of thesc ideas. -
Appendix A
Recursive Dynamic Programming
l-qhlttl'tl I'li'l't I1:'tl1tI l1:'t Itlv'v tl-lr'k '''k'e Iltl itltl lls :t 1-1 'We sec k :1 ftl Ilct i(.)11 J'-( ) t 1.1 lt t s:l t is 1ies (5) I'0g;.l rtl t Ile rigll ts jlk:t itpl-l('11* 11 ftI Ilctilll''l. 1-1:t(.'I'- t'yl' :.1 f1.1 Ilt-tit'll (..-.i ivel't :t ftl /7-(.r). t 11c l'igll t tppe side tle li Iltls :.1 l'ltlyv l'tlllct i()I1 ()I'-r. 'T-lles(.)Itl t i()I1 is 11l'tlllct itlll t- vlllll''l()1)e itrlpI te I'11'!s11 (', 1* lle on i11 t 11is Svtty. Ie:tds 1(.) itse If. I11 tec 1111 see k l.t lixetl !7(.'1 t t .r
.
-
'sve
(lpera to r.
Ft')1 :.1141ittlrllt ive prtlcetltl re t st trts t 11 l I'ly i1)it itll clltpictl /St 11 ( r ) NoNv tl1 is () rigllt-llantl sitlc 1'(5). tlse tlle rigll t-ha ntl sitle is ftllly kIltlv.vll. ol'l t he st) t he restl Its k) (''ltpplyi ng t I1e() pt! rt t(')1- tra 11 be ca lctl1:1ttltl lk'lr evtl lz C:lll t 11tl 1 resuIt 11 neqv ftlnct io 11 Ii-b (.r ) Next tlse it (./1-1 t I'ltlrigI1t- l1and s ide to gtlt the next iterate F S1( r ) and so tln. Wllltt Illkppells to t I'le seqtlence t) 1'stlch llntrtitlns F$ l ( t- ) as ??l goes to in fi n ity-? Supptpstl tllllt instekptl of l---l ' ( r ) vve tlse 11tli l't'krtlllt st:lrt ing functitln. sity. l' .z'f ( r 1 F' 11 ( :' ) -h. 1-for sonAe posit ive tztpnstant l Subslituting inlo t he righthand s ide o 1'(5 ). Iirst 114.)t t't t I1:tt 'svi
.
.r
.
-'
.
.
'''
.
''rllus Nvt! ge t :.111 ext r:t te rn1 ( l I'nizi 11g cllllice ntlt ;.tIter tlle I'nltxi
'Fllus. lr ftlnct i(')n
:tl
t I1e restll t
.r.
2
Proceeding in this
t)l'
()1* klpplyi
.Z ) (a ) .
..4
/-
l
1'
t I'le rigll t- I1;lI)tl
sitle. is lldes 11 I-l(')r t I1evlll tlc t)l' Ckny ()1' llt2 (')t I1e t r tt.lrnls. ' ng t 11etlperllttlr t() Z 1 (.r ) &vi ll I')t211 Ilesv -
(111
-1-11
.
2)
l
( . ) + ( l + /) ) ... J. .t
.
vvay.
ln other vvllrds, changes (')r in the initilllly chllscn ftlnctilln tleclly the in l ( proportitln geomctrically / l + /? ) ltt each step ())- our iterlltitln. Then it is intuitively clear, and not too hard tt) provu rigtlrously- that the iteratitln procceds to the same limiting functitln 1-2(.t-) regardless ()f the inititl chllice. In l the Iim it, ( t ) bcctlmes the same as >-t?''' ( r ) the limiti ng functilln F.( ) is of the Iixed pllint iteration step. l t obviotlsly satisfies the functitlnal equatitln a ()f The (5). geometric reductilln in crrors (technicallytlle property mapping tion property'-) has alltlwed us to prtlve existence and un iqueness of the solution. and the iterative procedurd ctlnsti tutes a numcrical algorithm. tettrrllrss-
-t'''
Here we sketch some tcchnical arguments that prove the existent:e and uniqueness of the solution ()f the Bcllman equation (5) for infinitc-horizon ()f reference'. dynamic programming. We restate the equation for ease
I
-h /? )
+
'
'
.r
-bcllntrac-
B
Ffl(XXrf)N?1t/
Nltlletntlilull
128
Here we consder the case of a bina:y choice between continuation and stopwhich we repeat for ease of reference'. The Bellman equation is
(6),
F(x)
=
max
t' (x) z (-v)+ .
1111(1e1.fl/'lc-tz/-&lpl/)' f.?J7???li'-:'t??'&,?
(11:The
Assulnptioll
Optimal Stopping Regions
ping.
ilyllalltic
1 l+p
'
1-(Fx )
I -K!
.
Continuation is optimal for those values of for which the maximum on the right-hand side of (6)is attained at the second argument, that is, .v
region'' Call the corresponding divisions of the range of the ttstopping of the interested respectively. in structure We region.'' are and the &continuation
.r
these regions.
For arbitrary speciscations of zr(.r), f2(.r), and *(.r'l-r), the regions could be any sequence of alternating intelwals. Thus continuation may be optimal for a lowest range of values of stopping optimal for a range above that, then of continuation again. and so on. However, one expects that in many problems and high low into the division of will range be a clean economic interest, there such that continuation is optimal for values separated by a threshold. say, and stopping optimal for x > (orperhaps the other way around). -t' < We hnd some conditions on the payoff and distribution functions that yield such a division. f) (-r) by G (x) Subtract Q (x) from both sides of (6),and denote Fx) for brevity. Then -v.
-v*,
-v'*
-x*
-
expression
n'(a-) + ( l
+ p )-
1
'
'
Q ( r ) d * (a-I ) -r
.
-
f2 (-v)
is a monotonic
function of x; tbr dehniteness. make it increasing. This is just the difference between the value of waiting for exactly one period before stopping, and that of stopping right away. The nice point is that the advantage of waiting for exactly one period translates into an advantage of waiting until an optimally chosen stopping time. If the function is increasing, it, we expect continuation to be optimal for high a' and termination forjow decreasing, the other way around. $. ,'
-r;
.
.'
Assltlnption
and immediate termination is optimal when the opposite inequality holds.
l29
There (21-.
is positive persistence of uncertainty, in the sense that shifts uniprobability distribution *(.v'l.r) of future values right when the current value x increases. If this failed. a larger current relative advantage for high x would be more likely to be reversed in the near future. This assumption will hold for alI the processes we will considcr.
the cumulative formly to the
.v'
Given these two assumptions,
the solution
function G(x) for
(3l) must
bc increasing. To see this. note that thc second argument of the max operator on the right-hand side consists of two parts. The tirstswhich is just the expression in Assumption I has been directly assumed to be increasing. The other. namely the integral, is incrcasing if G(.v) is. To see this, note that by Assumption (2J,a larger x shis the probability weights attached to the increasing set of values G(-r') to the right. and thereforc raises the expected value. Thus. startingwith an increasing function. the right-hand side yields another increasing function. Then the lixed point of the ittlration step, namely the solution of (31), is itself an increasing function.7 ,
We have proved that the second argument
in (31)is increasing. Therefore
there is a unique x' such that the second argument is positive if and only if and stopping is optimal Then continuation is optimal to the right of x> to the Ieft, as we set out to prove. -v*.
.r*,
In continuous time, we must replace p by p dt and zr(.v) by zr(-v) dt. Suppose x' follows the geometric Brownian motion dx + J.r, and =
+ (1 +
p)
-
:
-v
=
J* (x'I.r) G (-x'/)
Now make two assumptions that together sufhce to establish the desired
property.
-v
7To be technically prccisc. the operator
is closed on the convex cone of nondecreasing
functions. and therefore has a fixed point in this subspace. That is also a sxedpoint on f)f space functions. However, wc have already shown in Section A of the Appendix that xed point is uniquc.
the whole the latter
z'
l 3()
t'Yltllllolltltictll /.?tl('/v',r'pll?l(/
Then. on expanding j''z (A') using It()-s Lelnma and sinlplifying. (l I becomes silnply the requirement tlllt
dt + rr Assumption Jz
tlz.
-r
.v'
l 3.l
.n'(-r)
-
p f2 (
.
2
pz S''z(-r) + a t'r
)+
-r
-''
'
.
.
'
f2 (.r)
be monotonic. +'
C
Smooth Pasting
Here we consider the optimal stopping problem with a finite horizon and time
dependence, when the state variable follows an Ito process. We demonstrate somewhat more formally the value-matching and smooth-pasting conditions for (14)and (15)that determine the free boundary that separates the continuation and stopping rcgions. Over a short intcwal Fx
t)
.
=
max
time dt, the Bellman equation
()f
( f2 (.r)
zr (x / ) .
.
+ (l
(//
(6) becomes p dt ) Fx / ) + -(J F'J)
-
.
.
Stopping is optimal if the first term in the braces on the right-hand side is the Iarger of the two. and continuation is optimal if the second dxpression is larger. Fix a particular t. For dehniteness we consider the case where continuation is optimal tbr x > x* t ) and stopping for a- < x* (/ ) First suppose. contrary to the assertion in ( 14), that F'(x*(? ). t ) < f) (.r*(?)- J ). By continuity, we will have Fx, t ) < fz (.v t ) tbr just slightly to the right of (/ ). The second expression on the right-hand side diffdrs from Fx ? ) only by terms of order d so for sufficiently small t//, it. too, will be Iess than 2 (-r t ) over this range. Then immediate stopping wili be optimal tbr such contrary to the definition of (?) as the thrcshold. Next suppose that Ffx' t ) t ) > t'l (-r* (?). / ). By continuity, we will have F(.r / ) > (.v t ) for just slightly to the left of JJ, small continuation will yield a value that is x*(/). Then, for sufhciently /). also greater than f) (.v. so stopping cannot be optimal there, contrary to the definition of x* t ). The argument for the smooth-pasting condition also proceeds by contradiction. We develop it with the aid of Figure 4.2. Again consider just the case where continuation is optimal to the right of ) and stopping to the Ieft. If the functions F(x, /) and f2(.r. / ) do not meet tangentially at x*t ), they must meet at a kink. This cannot be an upward-pointing kink as in part (a) of the hgure; else by continuity f2(-r '/ ) would exceed F(-r / ) for slightly greater than (/), and termination rather than continuation would be optimal tor such x, contrary to the desnition of as the threshold. Next consider a downward-pointingkink as in part (b) of the figure. Here we show that (J) .
-r
.r
*
,
.
,
,
.t-.
.r
indil-l'klrtl'llccI'ltltsvtlel'ltlle twl) cllklices: contintlatilln for cannot be :1 pllint short interval of t in)e A / is tltl li ni tely t he be tter p()Iicy. 'I-he in tui tive idell is 11 thltt l7yNv:iting 11 little l7itItlnger. vtl c:ln (.'ll'lstlla!ll the next step of and cl)lltlse ()1* the twro dlles better tllan ptlsitillns t)l1 tlitht?r sitle (.)1' the k illk 'Xn llverkge tlllltlgh Intlst be discotllltetl kink itself. tllllt ltver:lge ptlint is trtlc the even zN/ tlccurs I'(1r it inle is th:lt lkter. Brllwnirtn t n'llltillll t he bccause rtlllsl')n ()f lntl ltre tlle A/ prtlpllrtitlnal ()n the elkct tlleir t() stltllrtt rollt s() is steps tl vvhilc t)f eflkct tlle A/ isxltln Wllcn ting is pnlpllrtillllal t() tl valtle. is snlltl 1. the prrner effect is rclatively nlucll lilrger. argunlellt needs t() be spelled ou t in :.1 Iitt Itl nlorut tlgebraic dc tail ('lt'
.t'
.
'l-llis
-1-11t:
-
.
''rllis
.
C.s
*
.
'z
.v
.
,
-v*(/
steps
in Chapter 3sizu A/? /)(.r
yvtl
(:,1'
JIl + tl (a-
/7
.
I
)
.
treat the pnlcess ('1* as lt rtntltlnl wltl k t hat cltn take ) A / tl p ()r dtnvll wi t 11respttot ive prtllatbi lities .r
/
zx t
/ /7(
/)
-v.
1
kI n Chapter 3 the drift they are mtlre general
1.2 l
I
q
.
tl
(
/)
-r -
Al
/ b(
-t-
.
/)
l ,
and diffusion ctpefficittnts u and t'r werc cilnstant: httre lnctitlns u (.r / ) and /?(-t. / ) l llltlwed cllnsider thc alternative Ntlw ptll icy: continuatilln j'tlr tin'le tt Clnd stopping t() take by further continuation if the next step of is upward. .
,
,
.r
the ttrmination payoff if it is dllwnward. Witll the appropriate probability weighting and d iscounting, this yields
.r
.
,
.
.x
n' (
-r
*
( ) t ) L J + ( 1+ p L / ),
1
gp F (
*
A-
(t ) +
tf:5.
/1 / + A t ) + .
.v*(/)
-r*
Expand this in a Tayltlr series anlund
condititln just above, and
remtll-nbering
(/
)(
.r
*
(/ )
-
f
/? / + ,
f.
/
)
J
(-r* (/ ) t ), using tlltt val ue-matclling that A/ is ()1* order ( A/; )2. Tl'1tlfirst ,
,
Matllematical Slci-qrt/l/?lr
132 >0
terms are F(x* t ) / ) + .
) !'Fr (-r*t )
,
t)
-
Q v (x t ) J )12./l *
,
.
If the functions meet with a downward-pointing kink as in part (b) of Figure 4.2, then lr > f2.v at -r*(J), so the second term is positive. Therefore the alternative policy does better than the common value of continuation or contradicting its dehnition as the threshold where the termination at optimal policy is a matter of indifference between the two. -r*(f),
partlll
A Firm's Decisions
5
Chapter
lnvestment Opportunities and lnvestment Timing
Wl-rl I -rI IIE nlathematical
preliminidries
bellind
tls, we can
now turn to the anal-
(.)f
I1,1this chapter and tllrotlghtlut ysis investment decisions under tlncertainty. will witll main cxpenditures tlur that have booka be investment this cllncern characte ristics. the expendittlres Ieltst important vttry First. partly are at twt) llther wllrds-.u//lktllltt l7e recovered. coxts in Second. these cllllnllt irrcversible; llle oppllrtunity tllat b(l the I'irnl has delayed. so investments tlan to wait for (ltller arrive abtltlt and nlarket conditions information prices, costs. t() new betbre it commits resourccs. As the simple ktxamples in Chapter 2 suggdsted. the ability to delay an ircxpenditure revcrsible invcstment can prolbundly affect the decision to invest. simple In particular. it invalidates the net present value rule as it is commonly studcnts in busincss schools: Invttst in a project when the prcsent taught to expected cash tlows is at least as large as its ctlst.-' This rule is value of its incorrcct because it ignllrcs thc (lpptlrtunity cost of making a comnlitment waiti ng for new in formation As and the option of thereby givi ng up now, we saw in Chapter 2, that opportunity cost must be included as part of the total cost of investing. In this chapter and those that follow. we will examine this opportunity cost and its implications for investment at a greater Ievcl of generality and in more detail. In this chapter, we will set forth and analyze in considerable detail one models of irreversible investment. In this of the most basic continuous-time model, which was originally developed by McDonald and Siegel ( 1986), a firm t-
.
adFirm l5-Decisiolts must decide when to invest in a single project.The cost of the investments /, is known and fixed, but the value of the project. 1Z, follows a geometric Brownian motion. The simple net present value rule is to invest as Iong as > /, but as '
McDonald and Siegel demonstrated, this is incorrect. Because
htturevalues
of V are unknown, there is an opportunity cost to investing today. Hence the optimal investment rule is to invest when P' is at least as large as a critical value F* that exceeds /. As we will see, for reasonable parameter values. this critical value may be lwt? or three times as Iarge as /. Hence the simple NPV rule is not just wrong; it is often very wrong. After describing the basic model in more detail, we will show how the
optimal investment rule (thatis, the criticalvalue 1Z*) can be found bydynamic programming. An issue that arises, however, is the choice of discount rate. If capital markets are (in a sense that will be made clear). the viewed problem be investment as a problem in option pricing, and solved can the techniquesof contingentclaims analysis. Wewill re-solve the optimal using of the examine the characteristics problem in this and then investment way, option Finally, invest and its dependence key frm's we will to parameters. on value model considering stochastic for the the by alternative extend processes will V. characterize optimal the project, find and the In particular, we of investment rules that apply when P' follows a mean-reverting process, and then when it follows a mixed Brownian motion/poisson jump process. Stcomplete''
1 The Basic Model Our starting point is a model srstdeveloped by McDonald and Siegcl (1986). They considered the following problem: At what point is it optimal to pay a sunk cost l in return for a project whose value is lz', given that V evolves according to the following geometric Brownian motion:
J?l !.,-t?-'???lt?/
1/ t)/'-yJt'p?-?'l/?lities
f llli
Ill !.zt!.???lt..'? l / Til'l ll
costs are positive and managers have the option to shut down the factory temporarily when tlle price of output is below variable cost, and/or the option to abandon the project completely, l'' w'ill not follow a geometric Brownian motion even if the price of widgets does. (We will develop models in which the output price follows :1 geometric Brownian motion and the project can be temporarily shut down and/or abandoned in Chapters 6 and 7.) If variable cost is positive and managers do not have the option to shut down (perhaps because of regulatory constraints). Pr can become negative, which is again in conflict with the assumption of lognormality. In addition, one might believe that a competitive product market will prevent the price from wandering too far from Iong-run industrpwide marginal cost. or that stochastic changes in price are Iikely to be infretluent but large. so that F should follow a meanreverting orjump process. For the time being we ignore these possibilities in order to provide the simplest introduction to the basic ideas and techniques.
We allow exogenously specihed mean rcversion in Section 5(a) of this chaptera and consider industry equilibrium in Chapters 8 and 9. Note that the tirm's investment opportunity is equivalent to a perpetthe right but not the obligation to buy share of stock at uaI call (lption a a prespecified price. Thercfortt the decision to invest is equivalent to deciding when to exercise such an (lption. Thus. the investmcnt decision can be viewed as a problem of optilln vtluation (as we saw in the simple examples presented in Chaptttr 2).1 Altern:tively. it can be viewed as a problem in dynamic programming. Wc will derive the (lptimal investment rule in two ways, first using dynamic programming. and then using option pricing (cntingent claims) methods. This will allow us to compare these two approaches and the assumptions that each rcquires. We will then examine the characteristics of
the solution.
In what follows. we will denote the
value
of the investment opportunity
(that is, the value of tht) option to invest) by F( P'). We want a rule that maximizes this value. Since the payoff from investing at time I is /'1 J, we want to maximize its expected present value: -
dF
=
a )' dt +
.>'
/' Jz.
where dz is the increment of a Wiener process. Equation ( 1) implies that the current value of the project is known, but future values ate lognormally distributed with avariance that grows linearlywith the time horizon; the exact formulas are in Section 3(a) of Chapter 3. Thus although information arrives over time (the hrm observes V changing), the future value of the project is always uncertain. Equation
ample, suppose
(1) is clearly
an abstraction from most real projects. For exthe project is a widget factory with some capacity. If variable
F( p' )
=
max
k6jt
Zr
-
/ )d-/'F
1
where i denotes the cxpectation, T is the (unknown) future time that the investment is made, p is a discount rate, and the maximization is subject to lThe investmcnt opptlrtunity is analogous to a perpetual call option on a dividend-paying stock. (The payout stream from the completcd project is equivalent to the dividend on the stock.) A soI utitln to this option valuatiun and cxtlrcise problem was (irst found by Samuelson ( 1965).
zl Iirln
138
'.
Inecisiolls
eqtlation (1) for P- For this problem to make sense. we mtlst also assume that a < p,. othenvise the integral in equction ( l ) could be matle indehnitely larger by choosing a larger F. Thus waiting Ionger would always be a better policy,and the optimum would not exist. $Ve will let denote the differncc > p e; thus we are assuming J 0. .
Finally- by substituting expression so Iu t ion f0 r F-( 1. ) :
ing
-
(4) illto eqtlatilln (.3).we
obt:lin the
llltlsv-
(
-
1.A The Deterministic Case
(1z
=
euT
14
-
e-PT
(3)
or fall over time- s() it is clearly > and 1, l'' if never invest otherwise. Hence optimal to invest immediately (P/. 01. Fj max What if 0 < a < p? Then F(F ) > () evcn if currcntly lz' < 1, because eventually P' will exceed 1. Also. even if )' now excceds 1, it may I7ebetter to with wait rather than invest now. To see this, maximize F( lz') in equation (3) condition is respect to F. The lirst-order
o--rhenPe(/) will remain constant
=
.
=
-
.
*
=
-
.
=
=
F(Iz') a :s
*
Figtlre 5. l shows F 1/-) as a ftlnct ion of I for / l p ().1()- antl a = (10.03, and 0.()(' ln each ease. the tangency point of F IS ) with the line F I (.r). is at the critical value Pr Note that F F ) incrcases when a p //(p increases. as does the critical valtle lz'e G rowth in lz' crcates 11value to waiting. and increases the valtle of the investnAent opportunity. =
future time T is Suppose
l''
'
Although we will be mostly concerned with the ways in which the investment decisionis affected by uncertainty, it is useful to first examine the case in which there is no uncertainty, that is, t'z in equation ( 1) is zero. As we wiil see, there can still be a value to waiting. P-(()). Thus given a ctlrrent P-, )'0 cal, where P'() 0, P' (/) lf c assuming opportunity we invest at some arbitrary value investment the of the =
for U' >
l.B
The Stochastic Case
'sve will now return tt) the general case in which cr > (). The prl'blelu is t() determine the ptlint at which it is optinlal to invcst / in rettlrn for 1111 asset worth V Since l'' evtllves stochastically. we will not be able to determine 4 time T as we did ltbllve. Instcad. our investment rule will take tlle form of .
-
2
.0
1
.8
.6
# F( )' ) JF
-(p
=
a
-
whichimpliesz
1
) p'
r + P l e
f?-t/l-tz,
-p
r
=
(;
1 .
1
.4
p/
() (p a ) )' a Note that if IZ is not too much larger than J, we will have F* > ().The reason for delaying the investment in this case is that in present value terms. the cost e-PT whereas the payoff is reduced of the investment decreases by a factor of e-sn-x'r of factor smaller the F*
=
max
-
Ioi!
,
%-'
.
-
by
Fo/ what values of )' is it optimal to invest immediately'? By setting T* 0, we see that one should invest immediately if lzr k: P' where :,
=
*
rz-
7
=
#-a
l
>
J
.
1 l
1.2 K-
(g'
1
'
I I I I i
o
0.8 0
l
I l
.6
a
O.4
=
0.06
1
l
ct 0.03 =
02 0.0
j
Ct
=
0
I
0.0
O.5
1.0
1.5
2.0
1 1 I I
2.5
3.O
Tinkillg lnveslntelttOpptrp?-/ll/ld-sand p?lvc-j-p?'lfa>n/
140 will
As we a critical value P'* such thtt it is optimal to invest tlnce F : value to that /'*, is. will result higher greater value in a of tr a see, a higher growth both genera. mind, that in however, waiting. It is important to keep in thereby waiting and value > uncertainty to (a > 0) and ((z 0) can create a affect investment timing. In the next twosections.we will solve this investment problem in twowayss following the techniques described in Chapter 4. First, we will use dynamic programming, and then we will solve the same problem over again using contingent claims methods. This will enable us to carefully compare these two approaches. F*.
the deterministic case), we assume that a < p, or J > (). With this the Bellman equation becomes the tbllowingdiftkrential equation be satished by F( r' ):
(9) In additions F F) must satisty' the tbllowingboundary conditions: F(0) F( F
*
)
Condition
ln the terminology of Chapter 4. we have an optimal stopping problem in continuous time. Because the investment opportunity, F( 1/,), yields no cash flows up to the time F that the investment is undertaken. the only return from holding it is its capital appreciation. Hence. as we saw in Chapter 4, in the continuation region (valuesof l?' for wllich it is not optimal to invest) the Bellman equation
is
=
C(dFj.
Equation (7)just says that over a timc intelwal t/. the total expected return equal to its expected rate of capital on the investment opportunity. p F f, is
appreciation.
We expand iIF using Ito's Lemma, and we use primes to denote derivatives. for example. F' dl-hlll, F'' = dlb-/dl'' etc. Then =
F'( p-) dv + 12 F''( p-) (J)')2
db-
=
gives
( 1) t'or#lz into this
*)
=
*
1
-
1
.
( 10) arises from the obselwation that if
)' goes to zero. it will stay of the stochastic is implication at zero (this an process ( 1) for P' J.Therefore when will of value option P' invest be 0. The other two conditions to the no consideration optimal from Z* is the price at which it is investment. of come in investp the Ianguage of Chapter 4, the free boundary of the optimal to or region.Then continuation ( 1l ) is the value-matching condition: itjust says that rcceives investing, the lirm a net payoff 1z'* 1. Finally, condition ( l2) is upon condition. discussed in Chapter 4 and its Appendix C. the If F( V ) were not continuous and smooth at the critical exercise point P-'a one could do better by exercising at a different point. Note that equation (9) is a second-order differential equation, but there are three boundary conditions that must be satissed. The reason is that aI()) is known. the position of though the position of the first boundary ( other second words, boundary is not. In the boundary'' /'* must be the determined as part of the solution. That needs the third condition. Equation ( 11) has another useful interpretation. Write it as P'* F( P'*) When the hrm invests, it gets the project valued F, but gives up the oppor1. fu?i/.yor option to invest, which is valued at F( F). Thus its gain, net ()f the F Z). The critical value F* is where this net gain opportunity cost. is P equals the direct or tangible cost of investment, 1. Equivalently, we could write the equation as V* = / + F( F*), setting the value of the project equal to the full cost (directcost plus opportunity cost) of making the investment. We will discuss this point in more detail later. To find F( P), we must solve equation (9)subject to the boundary conditions ( 10)-4 12). ln this case a solution is easy to find; we can guess a functional form, and determine by substitution if it works. We Iirst state the solution and derive some of its properties, and then discuss it in more detail. =
-
'
=
-
*
expression and noting that f'ttfz)
a P' F?( Z ) dt +
Hence the Bellman equation
1 (7.2
becomes
)
(7.2
P' 2 F''( Izr) dt
=
0
.
by dt):
(afterdividing through
72 F'' 1z) + a P' F'/l
-
p F
:::s
=
tefree
-
SLJF')
2
/'
( l0)
ttsmooth-pasting''
p Fdt
Substituting equation
0.
=
=
F' ( P'
Solution by Dynamic Programming
notation. that must
(8)
0.
Itwll be easier to analyze the soiuton and to compare it to that obtained using 6. To ensure p contingent claims analysis if we make the substitution with connection in explained already existence of an optimum (for reasons =
-
=
:'
il-l?l lLlc'isit'-u lzl 1-2 -.
'
'T'osatisfy tlle blltl ndary cond ition ( 1())-tlltl sol u tion
t:tktl t Ile fornl
fntlst
.I J /' l
F ( )' )
a I'Id
( 13 )
'
where z.l is a constant that is yet to be detc rl'n ined, and pl > I is lt k ntlwn constant whose val ue dklpends on the paramete rs fz /)- nnd J o f the di ffe rd ntial equation.
t). so t Ile gel'le ral
.!. a
( /)
*
*
Pr
#l
=
p
l -
l
( l4)
1.
2
g( /)
) yr)'
stll tl t ioll tk) eq tlttt itln F-(
.
The remaining boundary conditions. ( l l ) and ( l 2)- can btl tlsed to solvtz for the two remaining unk nowns the constant z1, and the critical value )' at which it is optimal to invest. By substituting ( l 3) into ( 1 l ) and ( 12) antl rearranging, we Iind that
f5
'
.!. S + a
1
'
/rT
)
-
(9) c:tl'l 14e vri ttel'l
zzl
)
t
I
l''-# ' +
z 1a
'n
-
/)/f'' 2
:ts
l-'01
where Ctnd zla are constants tt) be deterluilltttl. ln otlr pnlbldnl. tlle blltllldary (). leltving tlltl soltltion ( I 3). condition ( I()) implies that zrh Tg answer our econom ic quest ions conctt rn ing t I1eInu It iple p I / (#1 I ) we nAust therefore examine t he qtladratic equation (.l 6) in mtlre dtlta i1.Si ntre this equation- or something closely sinAilarp Nvill appear in ltlnnost every chapter. it he lps to establish 11 standa rd terfn inology and obtain sonle general rcsults at the tlutset.
,41
-
.
vvill general Iydtlnllte tlltt variable in the eq uation by p- and the wllold quadratic expression (thc Ieft-hltnd side) by t'2.Thus O-wist function 017 the vari%9Q
and
able /J, as well as the parameters /.)aand unless it is important to d() so. explicitly (''r,
Equations ( 13)-( l 5) give the value of the investment opportunity and the optimal investment rulep that is, the critical value 1.! at which it is optimal to invest. We will examine the characteristics of this solution in some detail later. For the time being, the most important point is that since pb > l we have /31/4/$1 l ) > l and r' > l Thus the simple N PV rule is incorrect; uncertainty and irreversibility drive a wedge betwecn the critical vltlue P' and 1. The size of the wedge is the I-actor pb/(Jl1- 1). and it becomes important t() examine its magnitude for realistic values of the undcrlying parameters, and its response to changes in these parameters. Tt) do that we must examine the solution (l 3) in more detail. *
,
*
-
.
*
2.A The Fundamental
qwlplp
-
5)p
p
-
=
p,
=
-
< () ren-lklnlbt)r Iy parabtlla that gtlcs to c.'o as p glles t() Als(). C'')( ( we are assuming J > ()) ltnd k?(()) -p < (). Tllerelbre the grilph crllsstls tlle horizlpntalaxis llt llne pllint t(.) thc rigllt t)l' I and ltnlpthtl!- t() t i1e lel't ()1' (). ''I-llat is. (lne rtlot, clll it p, excecds I and the (lther. pz, is Ilegative. sve lcus on tlltl ptpsitive rlult pl I'I()w dtles it changtl il' 11 pllrameter. sty changes'? Tllis is answered l)y standard ctlnlparative stilt ics. Diflrentilte c .,.l-':x).
-
,
.
.
,
f!a
(p
-
.5l/c,.
2+
-
tl/'-..,.
2
-
J. 2
2
l
0.
1 + 2p/r.r
2
>
l
.
$,
1
-p ()(/J
tlependence
.
I
The two roots are .)
sllow this
O
Since the second-order homogeneous differential equation (9) is Inear in the dependent variable F and its derivatives, its general solution can be expressed as a Iinearcombination of any two independent solutions. Ifwe try the function .,zlP'/3, we see by substitution that it satisfies the equation provided p is a root of the quadratic equation 1) + (p
svewill not
Althtlugh the r()()ts ()f a tltlltdratic are k ntlwn in explicit algebraic ftlrm. helps t() show them gellmetrically. F igtlre 5.2 shlnvs kl as lt ftlnctilln ()f p it The coetlicient of p? in k1(p ) is positive. so the graph is lln upsvard-pllinting
Quadratic
-
J.
-8
(3
zl l
-j
Dectxlolls
lll
tlplt/ Ill k'(-z'/p?l (?? It Fj/?litlg
7fJ-J??1cnt f?p/7',)?'/I t ? lities
and tll'' is given by equation long as Vt : 1, or n't : (p the firm should invest when
totally:
exprcssion
the quadratic
Irnl
( l ). The
e) 1.
-
) Q )/$1 + p Jc all derivatives are evaluated
where at pk Also
i) Q
(),
=
i)c
#1. Figure 5.2 shows that ) (? lp
at
>
pp
t'z
=
1)
-
at pj > 1. Therefore p3yl(7'< 0. In otherwords, as tz increases. #! decreases. and therefore /21/(Jl 1) increases. The greater is the amount o uncertainty wedge between 1Z* and 1, that is, the over future values of V, the larger is the
Iarger s the excess return the firm will demand before it is willing to make the irreversible investment. Readers can likewise verify two other properties of this quadratic. First, 1). increases as 6 increases, so a higher means a lower wedge pk/(/1 p, Second, p, decreases as p increases. so a higher p implies a larger wedge. We will discuss these results in greater detail and offer some numerical values in Section 4 of this chapter. Some limiting results concerning p, are also intbrmative. We merely state oa, them; they are easily verised using the algebraic formula. First, as (.. f.r is inlinite. lhe invests if is, firm F* that never and 1 x, we have pt (). We have Next consider what happens as t'z -
-..+
-.+
-.
If a
>
0. then /31
-.+
p,
If a S 0. then
-.+
p/tp (x7
t5)
-
and P'*
and 1!%
(p/)
.-->.
pI pI
Relationship to Neoclassical Investment Theoc
To push this analysis a bit further, suppose that the project itself is an inhnitely lived factory that produces a profit tlow, zt, that follows the process
(1n.
(z
n' dt +
f;r =
dz.
X =
C
Jrs. I
e
--- /,
( 16'
---
l
) jj
t
s
=
e) I
>
p
tz) /.
-
a)
-
=
! 2 p + a o'
x! ,
p-a
to
#1.
2 p + 1a t'z pt ) /
=
p 1.
>
=
JTJ
=
Jr()
e
/'?
max F
p
-
=
r
.7r1)
/
-
a :1
time T n'
can verit
t ,.-
that a
r
=
>
v
-
1 t;p- p-tz
=
)F
/ e
-
p
a
-
-
P
y. .
when
tzr
7r1)C'
=
# /
.
() is the sccond-order
condition
for this
maximization.) Therefore the firm should wait to invest even if there is no uncertainty, because waiting allows the postponement (and thus discounting) of the payment /.4 As equation ( 18) shows. with unccrtainty there is an additional 1 v2 pk term, so that the firm must wait even Ionger betbre investing. 2
This additional
term can be thought of as a correction
investment model.
Hence V is given by
)$
-
Since we have assumed zero depreciation, pl is the Jorgensonian user cost of
(The readcr
=
(p
capital'. the Jorgensonian rule is to invest when n.t p 1. Equation ( l8) says that when t-uturcprolits are uncertain. the threshold 7r* must exceed this user cost of capital. ln the absence of uncertainty. the Jorgensonian investment rule has the firm investing when (p a) 1. As we saw before. this p /. ll() when zt viewed timing rule. agains the firm must choose F be optimal Oncc as an can to maximizc
The solution is to invcst at
earlier.
(p
I
-
zr*
These results conform to those of the deterministic case that we examined
2.B
1
-
Thus the critical profit Ievel x* can be written as
/.
/.
-.>.
p
,
-
-.+
#
=
investment-3From
0
>
A: n'*
Another way to Iook at this is in terms of the Jorgensonian approach the quadratic eqtlation ( l6) satistied by p, we have
.
p Q /pf.r
xt
0
usual Marshallian rule is to invest as I-lowever. equation ( l 4 ) tells us that instead
slorgenson ( I 963) shtlwt!d that absent uncertainty. proht from an extra unit of capital cquals the user cost for suggesting this viewpllint in this cllntcxt.
to the neoclassical
thc tirm should invcst when the marginal to Giuseppe Bertola
of capital. Our thanks
Z-Ii.)our knowledge. this pllint was Iirst noted by Marglin
( 1963,
Chapter 2),
1 Frr/l
146 2.C
Relationship
''
Dccisiot
to Tobin's q tthe
value introduced 11 magnittlde q, defined lts the ratio of reprtduction ctlrrent lo of existing capital goods. or of titles them'' to cost.'' This haj become a central concept in the orthodox theory of investment. The idea is that if this ratio exceeds unity. :1 5rm can incrcase its market value by increasing its capital stock. Hence we should see a firm investing when the value of q tbr the irm is above 1 but not when it is Iess than l Furthermore, market value of f/ we can aggregate by calculating a based on the average firms in an industry (orthe whole economy) and the corresponding average replacement cost of capital. We should then observe at the aggregate level that investment spending is potitively reiated to the value of this (/. and interA number of issues arise with respect to the measurement pretation of q. An important one is that what should matter for investment is lnarginal q, that is, the (2 that applies to the (irm or industry's incremenproject, as opposed to the ab'erage c? that applies to the entire investment tal stock of the firm or industry. We will address the concept of capital and value in marginal q more detail in Chapters l l and l2. Here we want to emphasize a different problem. As stated. the numerator in t/ is the market value of existing the llc.rl assets. What is relevant for thc investment dccision is the eftkct of project on the value of the hrm. We have seen that to get this. the cost of using subtracted from the valud of a project. Thereup the option to invest must be and option value F Pr) is installed. the value value )' when project of a fore, should 1/ by F P' ). not V Correspondingly, q should increase of the firm ratio F 1. 1z') be defined as the (1z' ( 1/ Then the critical value of q that justifies will indeed be 1, as we see from equation ( 1l )swhich dehnes the investment
Tobin
( l969)
fnvc-sl/llcll f
.
-
.
ies
perspective on the decision.
tI?l(/ IlLbestllelz
effect
I
TilkI'??t)
of irreversibility
on the
hrm's
investmeut
In Chapters l 1 and l2, we will have occilsion to discuss the Iiterattlre
-btller
,
l-lpporttLllil
()11
investment that uses the t/ conccpt. Some articles have used the lirst t)f tht! above definitions of q and others the secontl. Thcretbre we will have to bkl careful to distinguish them. We will call the first net of the option valtle. antl of the tirm--concept, and the sotlontl having l as the upper Iimit the omitting the option value, and having pk/(/1 l ) as the critical Ievtll the .
tvalue
-
Gvalue
of assets in place'' concept.
Solution by Contingent Claims Analysis If the firm doing the investing is publicly held and its managers
w:lnt thcir
decisions to reoect the shareholders' interests- they should try to maximize the market value of the firm. Llow do we know that thtl invcstment rtllc derived above will do this'? One problem with this investment rule is that it is based on an arbitrary and constant discount rate. p. It is not clear where this disclltlnt rate should come from. ()r cvcn that it shlltlld be constant over time. As we saw in Chapter 4. we can use contingent claims (optionpricing) methods to derive a slightly modised invdstment rule that will indeed maximize the mllrkct value of the (irm. In this sectilln. we will go thnltlgh the reqtli red steps in detail.
-
critical F*.
However. it is difficult to allocate the portion of a firm's market value that (/ comes from the marginal unit of capital. Partly because of this, has come to namely, differently. measured, somewhat as the ratio be dehned. or at least would flow from value profits that of a completed of the expected present lo the value construction. using This corresponds investment, to the cost of its exercised and been already where has the option to invest of an existing asset. V(I. defining notation, this means q as its opportunity cost is a bygone. In our We can express the correct investment criterion in terms of this notion of q : the threshold q. that justihesinvestment is given by
(/* Jl/(Jl =
-
IZ
Reinterpreting
the Model
The use of contingent claims analysis requires (lne important assumptitln: V must be spanlled l7y existing assets in the ecllntlmy. Specihcally, capital markets must be sufliciently so that, at Ieast in principle, one could Iind an asset or construct a dynamic porttblio of assets (that is, a portfolio whose holdings are adjusted continuotlsly as asset prices change). the price of which is perfectly correlatcd with )z' This is etluivltlent to saying that markets are sutxciently complete that the firm's decisions tlo not affect the opportunit'y set available to investors.s The assumption of spanning should hold for most commodities, which typically traded on both spot and futures markets. and lbr manufactured are
stochastic changes in
etcomplete-'
.
1) > 1.
lluctuates, there will be stretches of time when the conventionally measured q exceeds 1 without attracting investment. This gives a new
As
3.A
5For a more rigorous and deta iled d iscussion oI' spanning and its ifnpl ica titlns. sce 1.Iuang and Litzenberger ( I 9t)()) and Du fhe ( I992). Du ffic and I'juang ( I 985) Iay ()u ( thk! lb 11sc t ()1* conditions needed for spanning.
ald l/l!./f;w/r?/tz/ll Invesllellt tEl/?ptr.l/-/'l/pljljf;t Til,llg
goods to the extent that prices are correlated with the values of shares or portfolios. However, there may be cases in which this assumptivn will not hold; an example might be a project to develop a new product that is unrclated to any existing ones, or an R&D venture, the results of which may be hard to P redict.
We will assume in this section that spanning holds, that is, that in princiuncertainty over future values of V can be replicated by existing assets. With this assumption, we can determine the investment rule that maximizes the hrm's market value without making any assumptions about risk preferences or discount rates. Also, the use of contingent claims analysis will make it easier to interpret certain properties of the solution. Of course, if spanning does not hold, dynamic programming can still be used to maximize the present value of the hrm's expected llow of profits, subject to an arbitrary discount rate. See the discussion in Chapter 4, Section 3 for more on the relationship between the two approaches. We follow the theoryof contingent claimsvaluation outlined in Chapter4, Section 2, but repeat some details for reinforcement and clarity. Let be the price of an asset or dynamic porttblio of assets perfectly correlated with V and denote by px,,, the correlation of with the market portfolio. Since is perfectly correlated with P' px,?, pf.,,, We will assume that this asset or portfolio pays no dividends, so its entire return is from capital gains. Then
ple the
.,t
.
.r
-
=
,
.
-r
evolves according
to
dx
/.z
=
-r
J/ +
tr
x dz.
where #t, the drift rate, is the expected rate of return from holding this asset or portfolio of assets. According to the Capital Asset Pricing Model (CAPM), risk. As explained in g should reflect the asset's systematic (nondiversihable) Chapter 4. Jz wiil be given by
Jz
=
1-
+
4 pxm t7',
where r is the risk-free interest rate, and 4 is the market price of risk.fi Thus, y. is the risk-adjusted expected rate of return that investors would require if they are to own the project. We will assume that a, the expected percentage rate of change of V, is Iess than this risk-adjusted return p.. (As we will see, the hrm would never invest if this were not the case. No matter what the current where r. is the expected rcturn on the markct. and fr,,, is the b'rhat is. 4 (r?a r/a standard deviation of that return. If we take the New York Stock Exhange lndex as the market. 0.08 and tz. ().2. so / Qz 0.4. For a more detailed discussion of the Capital Asset rm r =
-
rkC
-
,
i:k;
Pricing Model, see Brealey and Myers
( 199 I ) or
Duffie ( 1992).
level of V the firm would always be better off waiting and simply holding on to its option to invest.) We will let J dcnote the diftkrence between pt and a. > (), and this plays the same role that is. a. Thus we are assuming y corresponding assumption the the in dynamic programming tbrmulation as of Section 2. .
(5
=
-
(
The parameter ( plays an important role in this model. We discussed its role as an explicit or implicit dividend in Chapter 4'. here we elaborate on those remarks. It will be helpful to draw upon the analogy with a hnancial call option. If lz'were the price of a share of common stock, J would be the dividend rate on the stock. The total expected return on the stock would be yz = ( + a. that is. the dividend rate plus the expected rate of capital gain. If the dividend rate were zero, a call option on the stock would always be held to maturity. and never exercised prematurely. The reason is that the entire return on the stock is captured in its price movements, and hence by the call option. so there is no cost to keeping the option alive. However. if the dividend rate is positive. there is an opportunity cost to keeping the option alive rather than exercising it. That opportunity cost is the dividend stream that one forgoes by holding the option rather than the stock. Since 6 is a proportional dividend ratc. the higher is the price of the stock. the grcater is the tlow of dividends. At some high enough price, the opportunity cost of foregone dividends becomes great enough to make it worthwhile to exercise the option. For our investment problem./z is the expected rate ()f return from owning the complcted project. It is the equilibrium rate established by the capital market, and includes an appropriate risk premium. If f > (), the expected rate of capital gain on the project is less than p.. /'/zTc, J is an opportttny cto'l of delaying constntction rJ the project. tIITJinstead keep'g /c option to inves alive. If ts were zero. there would be no opportunity cost to keeping the option alive, and one would never invest. no matter how high the NPV of the project. > 0. On the other hand, if J is That is why we assume very large, the valuc of the option will be very small, becausc the opportunity cost of waiting is large. As x, the value of the option goes to zero; in effect, the only choices arc invest now or never, and the standard NPV rule again applies. to Tbe parameter t5 can be interpreted in other ways. For example, it could re:ect the process of entry and capacity exp