0, there exists an
n r= N, take S = ,-,. Then for each n, there exists p,, E E such that
0
and
If(Pn)-LIae.
Thus pn -+ p, but {f(pn)) does not converge to L. This contradiction proves the re-
sult. p
The following uniqueness result is an immediate consequence of the previous theorem.
122
Chapter 4
4.1.4
Limits and Continuity
If f has o limit at p, then it is unique. Theorem 4.1.3 is often applied to show that a limit does not exist. If one can find a sequence {p"} with p" -- p, such that {f(p")} does not converge, then lim f(x) does not exist. Alternatively, if one can find two sequences {p"} and {r"} both converging to p, but for which COROLLARY
litn .f(p,,) * iim f(rM),
-00
1W
then again 1 m f(x) does not exist. We illustrate this with the following two examples.
4.1.5
EXAMPLES
(a) Let E = (0, oo) and f(x) = sin (11x), x E E. We use the previous theorem to show that lim sin x-.0
1
X
does not exist. Let p" = zi + 1 r;. Then
sin(2n + 1)2 = (-1)". Thus ii f (p,) does not exist, and consequently by Theorem 4.1.3. liim f (x) also does
"7
not exist. The graph of f(x) = sin(1/x) is given in Figure 4.3.
n
1
2rr
V
Figure 4.3 Graph of f(x) = sin(l/x), x > 0
4.1
limit of a Function
123
(b) As in Example 4.1.2(f) let J0, X E Q, AX) = lx, x qE Q. Suppose p E R, p * 0. Since Q is dense in R, there exists a sequence C Q with pn * p for all n E N such that pn -> p. Hence, lim 0. On the other hand. since R \ Q is also dense in R, there exists a sequence " *00{qn} of irrational numbers with
qn -? p. But then lim n-+oo
lim q = p. Thus since p * 0, by Theorem 4.1.3,
n- 00
lim f (x) does not exist.
Limit Theorems 4.1.6 THEOREM Suppose E C R, f. g : E -+ P. and p is a limit point of E. If limf(x) = A
and
lim g(x) = B,
x-4p
then
(a) xlim [f(x) + g(x)] = A + B, (b) 1 m f(x)g(x) = AB, and
(c) lim
x
= B, provided B * 0.
Proof. For (a) and (b) apply Theorem 4.1.3 and Theorem 2.2.1. We leave the details to the exercises (Exercise 11). Proof of (c): By (b) it suffices to show that 1
1
lim g(x)
=B
We first show that since B # 0, g(x) * 0 for all x sufficiently close to p, x * p. Take e = IBI/2. Then by the definition of limit, there exists a St > 0 such that
Ig(x) - BI <
11 2
for all x E E, 0 < Ix - pI < SI. By Corollary 2.1.4, Ig(x) - BI > Ilg(x)I - IBII. Thus
forallxEE,0< Ix - pI < Si. We can now apply Theorem 4.1.3 and the corresponding result for sequences of Theorem 2.2.1. Let { pn} be any sequence in E with pn -+ p and pn * p for all n. For
124
Chapter 4
Limits and Continuity
the above S1, there exists an no E Rl such that 0 < jp" - pl < S1 for all n ? no. Thus g(p") * 0 for all n ? n0. Therefore by Theorem 2.2.1(c), lim
1
"°° g(p")
=
1
B.
Since this holds for every sequence p" -> p, by Theorem 4.1.3,
lmg(x) =
1 B.
L1
The proofs of the following two theorems are easy consequences of Theorem 4.1.3 and the corresponding theorems for sequences (2.2.3 and 2.2.4). First, however, we give the following definition.
4.1.7
DEFINITION A real-valued function f defined on a set E is bounded on E if there exists a constant M such that V(x)l t M for all x E E.
4.1.8
THEOREM Suppose E C R, p is a limit point of E, and f, g are real-valued functions on E. If g is bounded on E and lim f (x) = 0, then t-.p
lim f(x)g(x) = 0.
Proof. Exercise 12.
4.1.9
THEOREM Suppose E C R, p is a limit point of E, and f, g, h are functions from E into R satisfying g (x)
If lire g (x) =lim h(x) = L, Proof,
f (x) : h (x) for all x E E. then
1 m f (x) = L.
Exercise 13.
We now provide several examples to illustrate the previous theorems.
4.1.10
EXAMPLES
(a) By Example 4.1.2(a), lim x = c. Thus, using mathematical induction and Theorem 4.1.6(b), x.+c lim x" = c" for all n E N. If p(x) is a polynomial !unction of degree n, that is,
.+a,x+ao, where n is a n o n n e g a t i v e i n t e g e r and a 0 ,
. .. , a" E R with a" * 0, then a repeated application of Theorem 4.1.6(a) gives lim p(x) = p(c). (b) Consider lim
x-.-2
x'+2x2-2x-4 x2 - 4
4A
Limit of a Function
125
By part (a), xlim2 (x' + 2x2 - 2x - 4) = 0 and dint (x2 - 4) = 0. Since the denominator has limit zero, Theorem 4.1.6(c) does not apply. In this example, however, for
x # -2, (x+2)(x2-2)
x3+2x2-2x-4 x2-4
(x+2)(x-2)
x' -2
x-2
Since slim (x - 2) = -4, which is nonzero, we can now apply Theorem 4.1.6(c) to conclude tat lim
x3+2x2-2x-4= lim x2-21 x--2x-2 2 x2-4
(c) Let E = R \ {0}, and let f : E -r R be defined by f (x) = x sin
x.
Since I sin (l /x) I <- I for all x E i8, x # 0, and Ii m x = 0, by Theorem 4.1.8
lim x sin 1 = 0. x
x-w
The graph of f(x) = x sin(1/x) is given in Figure 4.4.
-0.2
Figure 4.4 Graph of f(x) = xsin(1/x), x # 0
(d) Let E = (0, oo) and let f be defined on E by
f(t) _
sin t
We now prove that
lim
r-0
-smt= 1. 1
126
Chapter 4
Limits and Continuity As we will see in the next chapter, this limit will be crucial in computing the derivative of the sine function. From Figure 4.5, we have
area(LOPQ) < area(sector OPR) < area(DOSR).
Figure 4.5
In terms of t, this gives
2sintcost<2t<2tan:. Therefore,
sin t
cost <
<
1
cost
t
Using the fact that lim cos t = 1 (Exercise 5), by Theorem 4.1.9 we obtain li m
sin t 1
= I.
Limits at Infinity Up to this point we have only considered limits at points p E N. We now extend the definition to include limits at oo or -oo. The definition of the limit at oo is very similar to
lim f(n) where f : N , R; that is, f is a sequence in R.
4.1.11
DEFINITION
Let f be a real-valued function such that Domf tl (a, oo) * ¢ for
every a E P. The function f has a limit at oo if there exists a number L E R such that given e > 0, there exists a real number M for which
lf(x) - LI < e
4.1
Limit of a Function
127
for all x E Dom f fl (M, oo). (See Figure 4.6.) If this is the case, we write lim (x) = L. X-*00f
Similarly, if Dom f fl (-oo, b) * O for every b E R,
lim f (x) = L
X--00
if and only if given e > 0, there exists a real number M such that
If(x) - LI < e for all x E Dom f fl (-oo, m). The hypothesis that Dom f fl (a, oo) * 0 for every a E R is equivalent to saying that the domain of the function f is not bounded above. If Dom f = N, then the above definition gives the definition for the limit of a sequence. Readers should convince themselves that all theorems up to this point involving limits at a point p E R are still valid if p is replaced by o0 or -oo.
L+E L
L-E
Figure 4.6
4.1.12
lim f(x) = L
x-t=
EXAMPLES
(a) As our first example, consider the function f(x) = (sin x)/x defined on (0, oo). Since Isin xl
1,
U(x)I
x
for all x E (0, oo). Let e > 0 be given. Then with M = 1/e, I f (x)I < e Therefore, 1
(sin x)/x = 0.
for all x > M.
128
Limits and Continuity
Chapter 4
(b) For our second example consider f(x) = x sin irx. If we set p" = (n + ;). n E N. then
f(p") = (n + !)sin(n + ;)ir = (-1)"(n + 2). Thus the sequence {f(p")}n°_ I is unbounded, and as a consequence, lim x sin zrx does not exist. x
EXERCISES 4.1 1. Use the definition to establish each of the following limits. b6 fim2 (3x + 5) = -1 *a. lim (2x - 7) = -3
*c. I m
_
x
l+ x
I
d.
2
i
e..-- I x + 1 - 3
lim 2x2-3x-4=
x-+-i
L lim
x3-2x-4 = 5 x2-4
2
2. Use the definition to establish each of the following limits.
a. lim c=C x-v
b. lim x = p
C. lim x3 = p3
d. lim x-0 x" = p", n E RI
x-+v
-v
I
p>0
v
x +o
x
2Vp
, p>0
3. For each of the following, determine whether the indicated limit exists in R. Justify your answer!
*a x-.° limWx-
b.x-.i limx2x +- I
*C. lim cos-
d. lim
I
X-O
e. lim
x
f. lim
14
4. *Define f : (-1, 1)
cos x
)2 (x + lx
1
R by
f(x)=x2-x-2
x+l Determine the limit L of f at -1 and prove, using e and S, that f has limit L at -1. 5. *a Using Figure 4.5, prove that I sin hl -- jhI for all It E R. b. Using the trigonometric identity I - cos It = 2 sin 2 2, prove that (i) limo cos h = I.
00lim
1 - cosh h
0.
6. Let E C R, p a limit point of E, and f : E -* R. Suppose there exist a constant M > 0 and L E R such that [f(x) - LI c Mix - pl for all x E E. Prove that lim f(x) = L. X-P
4.1
Limit of a Function
129
7. Suppose f: E -i R, p is a limit point of E, and limf(x) = L. x-p *a. Prove that lint If(x)I = ILI x-o
= VL.
b. If, in addition, f(x) >- 0 for all x E E, prove that lim c. Prove that lim (f(x))" = L" for each n E N.
8. Use the limit theorems, examples, and previous exercises to find each of the following limits. State which theorems, examples, or exercises are used in each case.
.a, littt 5x2 + 3x - 2
b. lim
se lint
d.
x-1
_-'-+
m 2x + 5
x-.-t
x3 _ x2 + 2 x+1 Ix + 13n
xm2
x + 2)
f lim-
x-4
I
-
.r(
'1 1
Ix+21
s 9. 'Suppose f : (a, b) -+ R, p E [a, b], and + m f (x) > 0. Prove that there exists a 8 > 0 such that f (x) > 0 for all
x E (a, b) with 0 < Ix - pi < S. 10. Suppose E C R, p is a limit point of E, and f : E -+ R. Prove that if f has a limit at p, then there exists a positive constant M and a S > 0, such that [f(x)I s M for all x E E, 0 < Ix - pi < 6. 11. a. Prove Theorem 4.1.6(a). b. Prove Theorem 4.1.6(b).
12. 'Prove Theorem.4.1.8. 13. Prove Theorem 4.1.9.
14. Let f, g be real-valued functions defined on E C R and let p be a limit point of E.
a. If limf(x) and lim (f(x) + g(x)) exist, prove that lim g(x) exists. xrp x-p x-p b. If lim f(x) and lim (f(x)g(x)) exist, does it follow that lim g(x) exists? x-ap X-P X-P
15. Let E be a nonempty subset of R and let p be a limit point of E. Suppose f is a bounded real-valued function on E having the property that iiin f(x) does not exist. Prove that there exist sequences (p.) and {q"} in E with
lim p" = lim q" = p such that lim f(p") and lim f(q") exist, but are not equal. .-CO "-W
16. *Let f be a real-valued function defined on (a, oo) for some a > 0. Define g on lim f (x) = L if and only if lint g(t) = L.
by g(t)
17. Investigate the limits at oo of each of the following functions defined on (0, oo).
a. f(x) =
c. f(x) =
3x2
2+ +x
!
V-47+ 1
e. f( x) =
X
b. f (x) =
1 + x2
d. f(x) - 2x + 3 x+l V x - 2x AX) =
2NA + 3x h. f(x) = x sin R be such that lim x f (x) = L where L E R. Prove that lim f (x) = 0.
g. f (x) = x cos x
18. Let f : (a, oo)
1
Prove that
130
Chapter4
Limits and Continuity
19. Let f : R -> R satisfy f(x + y) = f(x) + f(y) for all.r. v E R. If lim f(.r) exists, prove that a. lim f(x) = 0, and b. lim f(x) exists for every p E R. =-v
4.2j Continuous Functions The notion of continuity dates back to Leonhard Euler (1707-1783). To Euler, a continuous curve (function) was one that could be expressed by a single formula or equation of the variable x. If the definition of the curve was made up of several parts, it was called discontinuous. This definition was sufficient to convey the concept of continuity in Euler's time as mathematicians were primarily concerned with elementary functions; namely, functions built up from the trigonometric and exponential functions, and inverses of these functions, using algebraic operations and composition. The more modern version of continuity is credited to Bolzano (1817) and Cauchy (1821). Both men were motivated to provide a clear and precise definition of continuity in order to prove the intermediate value theorem (Theorem 4.2.11). Cauchy's definition of continuity was as follows: "The function f (x) will be, between two assigned val-
ues of the variable x, a continuous function of this variable if for each value of x between these limits, the numerical value [i.e., absolute value] of the difference f(x + a) - f(x) decreases indefinitely with a'. Even this definition appears strange in comparison with the more modem definition in use today. Both Bolzano and Cauchy were concerned with continuity on an interval, rather than continuity at a point.
4.2.1
Let E be a subset of U8 and f a real-valued function with domain E. The function f is continuous at a point p E E, if for every e > 0, there exists a S > 0 such that DEFINITION
IA(x) -f(P)I < e for all x E E with Ix - pI < S. The function f is continuous on E if and only if f is continuous at every point p E E. This definition can be rephrased as follows: A function f : E - IR is continuous at
p E E if and only if given e > 0, there exists a S > 0 such that
f(x) E NE(f(p)) for all x E N5(p) fl E. This is illustrated in Figure 4.7.
Remarks (a) If p E E is a limit point of E, then f is continuous at p if and only if
Lmf(x) =f(p).
X-P 1. Cauchy Course d'Analyse, p. 43.
4.2 Continuous Functions
131
Figure 4.7
Also, as a consequence of Theorem 4.1.3, f is continuous at p if and only if
f(p) for every sequence
in E with p, -+ p.
(b) If p E E is an isolated point, then every function f on E is continuous at p. This follows immediately from the fact that for an isolated point p of E, there exists a S > 0 such that N8(p) (1 E = { p}. We now consider several of the functions given in previous examples, and also some new examples.
4.2.2
EXAMPLES
(a) Let g be defined as in Example 4.1.2(c), i.e.,
1xZ-4 g(x)= 2,
x-2.
x#2,
x=2.
At the point p = 2, lim g(x) = 4 # g(2). Thus g is not continuous at p = 2. However, if we redefine g at p = 2 so that g(2) = 4, then this function is now continuous at
p=2.
(b1 Let f be as defined in Example 4 . 1 . 2(f ): i . e., f (x) =
{0. x E O, x x Q
132
Chapter4
Lindta and Continuity
Since
limf(x) = 0 = f(0), f is continuous at p = 0. On the other hand, since limf(x) -P fails to exist for every p * 0, f is discontinuous at every p E Il, p * 0. (e) The function f defined by
-
11, xE0,
f(x)
x VE Q,
0,
of Example 4.1.2(e) is discontinuous at every p E R. (d) As in Example 4.1.2(g), the function f (x) = 1/x is continuous at every p E (O,x). Thus, f is continuous on (0, a).
(e) Let f be.defined by
x = 0,
0, f (X)
x sin
-x
,
x:# 0.
By Example 4.1.10(c),
li mf(x) = 0 = f(0). Thus f is continuous at x = 0. (f) In this example we show that f (x) = sin x is continuous on R. Let x, y E R. Then
If(s) -.f(x)l = Isiny - sinxl = 2 cos (y + x) sin 2(y - x) I 2
{2lsinI(y-x+ ).
By Exercise 5 of the previous section, I sin h I < Ih 1. Therefore,
If(y) -f(x)I S Iy - xl, from which it follows that f is continuous on R. (g) We now consider a function on (0, 1) that is discontinuous at every rational num-
ber in (0, 1) and continuous at every irrational number in (0, 1). For x E (0, 1) define
0, AX)
= in1,
if x is irrational,
if x is rational with x =
m in lowest terms. n
The graph of f, at least for a few rational numbers, is given in Figure 4.8. To establish our claim we will show that
lira f(x) = 0 X-P
4.2
Continuous Functions
133
for every p E (0, 1). As a consequence, since f(p) = 0 for every irrational number p E (0, 1),f is continuous at every irrational number. Also, since f(p) # 0 when p r= 0 fl (0, 1), f is discontinuous at every rational number in (0, 1).
2
4
8 16
-
1
16
I
3
I
5
3
7
8
16
4
16
8
16
1
9
S
11
3
13
'7
U
2
16
8
16
4
16
8
16
Figure 4.8
Fix p E (0, 1) and let e > 0 be given. To prove that lim f (x) = 0 we need to show X __*P
that there exists a 8> 0 such that
lf(x)I < E for all x E Na(p) 11(0, 1), x * p. This is certainly the case for any irrational number x.
On the other hand, if x is rational with x = m/n (in lowest terms), then f (x) = I/n. Choose n0 E 1\J such that 1/n,, < E. There exist only a finite number of rational numbers m/n (in lowest terms) in (0, 1) with denominator less than no. Denote these by
rl, ... , rk, and let
8=min{Ir1-pI:i= 1,.. ,k,r,*p}. (Note: Since p may be a rational number and thus possibly equal to r, for some i = 1, ... , k, we take the minimum of fir, - pI) only for those i for which r, # p). Thus 8 > 0, and if r E 0 fl Na(p) fl (0, 1), r * p, with r = m/n in lowest terms, then n ? n0. Therefore, if(r)I
< E.
Thus I f (x) I < e for all x E Na(p) fl (0, 1), x # p. If f and g are real-valued functions defined on a set E, we define the sum f + g, the difference f - g, the product fg, and the absolute value lfl off on E as follows: For x E E.
(f + g) (x) =1(x) + 8(x).
(f - 8)(x) = f(x) - 8(x),
134
Chapter 4
Limits and Continuity
(fg) (x) = f(x)g(x), Ifl(x) = V(X)1-
Furthermore, if g(x) * 0 for all x E E, we define the quotient fig by
\g/(x)
g(x)*
More generally, if f and g are real-valued functions defined on a set E. the quotient f/g can always be defined on E, = {x E E : g(x) * 0}. As an application of Theorem 4.1.6 we prove that continuity is preserved under the algebraic operations defined above. The proof that Ifl is continuous whenever f is continuous is left as an exercise (Exercise 6).
4.2.3
THEOREM
If E C R and f, g : E -> 68 are continuous at p E E, then
(a) f + g and f - g are continuous at p, and (b) f g is continuous at p. (c) If g(x) * 0 for all x E E, then fig is continuous at p.
Proof. If p is an isolated point of E, then the result is true since every function on E is continuous at p. If p is a limit point of E, then the conclusions follow from Theorem
4.1.6. Q Composition of Continuous Functions In the following theorem we prove that continuity is also preserved under composition of functions.
4.2.4 THEOREM Let A, B C l18 and let f : A -+ R and g : B - l be functions such that Range f C B. If f is continuous at p E A and g is continuous at f(p), then h = g e f is continuous at p.
Proof.
Let e > O be given. Since g is continuous at f (p), there exists a S, > 0 such that
lg(y) - g(f(p))I < e for ally E B fl NN,(f(p)).
(2)
Since f is continuous at p, for this S,, there exists a S > 0 such that
Lf(x)-f(p)I <S, for all xEAf1N8(p). Thus, if x E A with Ix - pl < S, by (2)
lh(x) - h(p)I = Ig(f(x)) - g(f(p))I < e. Therefore h is continuous at p.
4.2.5
EXAMPLES
(a) If p is a polynomial function on R, then by Example 4.1.10(a), lim p(x) = p(c) for every c E R. Thus every polynomial function p is continuous on i$.`~`
4.2
Continuous Functions
135
(b) Suppose p and q are polynomials on P and E _ {x E R : q(x) = 01. Then by Theorem 4.2.3 the rational function r defined on H \ E by r(x)=p(-,
q(x)
xER\E,
is continuous on H \ E.
(c) By Example 4.2.2(f), f(x) = sin x is continuous on P. Hence if p is a polynomial function on R, by Theorem 4.2.4, (f o p)(x) = sin(p(x)) is also continuous on R.
Topological Characterization of Continuity Before considering several consequences of continuity, we provide a strictly topological characterization of a continuous function. In more abstract courses this is often taken as the definition of continuity.
4.2.6
THEOREM Let E be a subset of P and let f be a real-valued function on E. Then f is continuous on E if and only if f -'(V) is open in E for every open subset V of R.
Proof. Recall (Definition 3.1.14) that a set U C E is open in E if for every p E U there exists a 8 > 0 such that Na(p) fl E C U. Suppose f is continuous on E and V is an open subset of R. If f ''(V) we are done. Suppose p E f -(V). Then f(p) E V. Since V is open, there exists e > 0 such
that N1(f(p)) C V. Since f is continuous at p, there exists a S > 0 such that f(x) E NE(f(p)) for all x E Na(p) fl E; i.e., Na(p) fl E C f-'(V). Since p E f -t(V) was arbitrary, f -'(V) is open in E. Conversely, suppose f -'(V) is open in E for every open subset V of R. Let p E E and let e > 0 be given. Then by hypothesis f -'(N,(f(p))) is open in E. Thus there exists a S > 0 such that
E fl Na(p) C f -'(Nf(f(p))); that is, f(x) E N.(f (p)) for all x E Na(p) fl E. Therefore f is continuous at p. O 4.2.7
EXAMPLES
(a) We illustrate the previous theorem for the function f(x) = \, Dom f = [0, oo). Suppose first that V is an open interval (a, b) with a < b. Then
f-,(V)=
1
¢,
b < 0,
[O,b2),
as0
(a2, b2),
0 < a.
Clearly 46 and (a2, b2) are open subsets of H and hence also of [0, oo). Although [0, b2) is not open in R,
[0, b2) = (-b2, b2) fl [0, oo).
Thus by Theorem 3.1.16, [0, b2) is open in [0, oo). If V is an arbitrary open subset of R, then by Theorem 3.1.13 (or Exercise 17, Section 3.1) V = U 1,,, where is a fi-
136
Chapter 4
Limits and Continuity
(Theorem nite or countable collection of open intervals. Since f -'(V) = U f is open in [0, oo), f -'(V) is open in [0, oo). Therefore 1.7.14) and each f f(x) _ N/x is continuous on [0, oo).
That f -'(V) is open in 10, x) for every open set V can also be proved as follows: Let p E f"'(V) be arbitrary. Since f(p) E V and V is open, there exists an open in-
terval I with f(p) E I C V. But then p E f -'(I) C f -(V). By the above, f -'(I) is open in [0, cc). Thus there exists a 8 > 0 such that N8(p) fl [0, x) C f -'(I) C f - '(V ). Since p E f -'(V) was arbitrary, f -'(V) is open in (0, oo). (b) In this example we show that if f : E -> R is continuous on E and V C E is open in E, then f(V) is not necessarily open in Range f. Consider the function f : R - R given by
f(x)
x2,
- {3-2x,
x < 1,
x> 1.
Then f is continuous on R and Range f = R (Exercise 10). However, f((-I, 1)) [0, 1), and this set is not open in R. (See Figure 4.9.)
I
Figure 4.9 Graph of f(x) _
X2
13-2x,
xx> I.
>I
Continuity and Compactness We now consider several consequences of continuity. In our first result we prove that the continuous image of a compact set is compact. In the proof of the theorem we use only continuity and the definition of a compact set. An alternative proof using the Heine-Borel-Bolzano-Weierstrass theorem (Theorem 3.2.9) is suggested in the exercises (Exercise 25).
4.2.8 THEOREM If K is a compact subset of P and if f : K -.> H is continuous on K, then f (K) is compact.
4.2
Continuous Functions
137
Proof. Let { V,},EA bean open cover of f(K). Since f is continuous on Kj -'(V.) is open in K for every a E A. By Theorem 3.1.16, for each a there exists an open subset U. of l such that
f -'(V,) = K n U,. We claim that {U,}0EA is an open cover of K. If p E K, then f(p) Ef(K) and thus f(p) E V. for some a E A. But then p is in j-'(V.) and hence also in U,. Since each U. is also open, the collection { U«}.eA is an open cover of K. Since K is compact, there
exists a,,.
.
.
, an E A such that
K C ,U U.. I
Therefore, n
n
K =U (u.fl K) = Utf j- -'(V,), j=t and by Theorem 1.7.14(a), n
f(K) = Uf(r'(V0,)) Since f (f -'(V.,)) C V,, f (K) C U; _ IV.,. Thus f (K) is compact. As a corollary of the previous theorem we obtain the following generalization of the usual maximum-minimum theorem encountered in calculus.
4.2.9
COROLLARY Let K be a compact subset of R and let f : K -+ R be continuous. Then there exist p, q E K such that
f(q)<_f(x)sf(p) forallxEK. Proof. Let M = sup{f(x) : x e K}. By the previous theorem f(K) is compact. Thus, since f(K) is bounded, M < oo. Also, since f(K) is closed, M E f(K). Thus there exists p E K such that f(p) = M. Similarly for m = inf{f(x) : x E K}. We now provide examples to show that the result is false if K C 68 is not compact: that is, not both closed and bounded.
4.2.10
EXAMPLES
(a) Suppose E is a subset of R. If E is unbounded, consider
f(x) =
x2
I +x" Then f is continuous on E, sup { f (x) : x E E} = 1, but f(x) < I for all x e E. To see that the supremum is 1, we note that since E is unbounded, there exists a sequence {xn} in E such that x2. --* oo as n -+ oo. But then
lim f(zn) = lim
R-00
n-xl + X 1
1.
138
Chapter 4
Limits and Continuity
Thus if 0 < (3 < 1, there exists an integer n such that f (x.) > p. Hence sup{ f (x) : x E E} = 1. The graph of f with E = (0, oo) is given in Figure 4.10.
I
4 1
2
3
E=(0.-)
Figure 4.10 Graph of f(x) =
4
x2
+z2
5
6
x E [0,oo)
(b) If E is not closed, let x be a limit point of E that is not in E. Then 1
8(x) _ .
1 + (x - x,)2
is continuous on E, with g(x) < 1 for all x e E. A similar argument shows that sup{g(x) : x E E} = 1. This is illustrated in Figure 4.11 with E = (0, 1) and xo = 1.
Intermediate Value Theorem The following theorem is attributed to both Bolzano and Cauchy. Cauchy, however, im-
plicitly assumed the completeness of R in his proof, whereas the proof by Bolzano (given below) uses the least upper bound property. An alternative proof is outlined in the miscellaneous exercises.
4.2.11
THEOREM (intermediate Value Theorem) Let f: [a, b) -> R be continuous. Suppose f(a) < f(b). If y is a number satisfying
f(a) < y < f(b), then there exists c E (a, b) such that f(c) = y.
4.2 Continuous Functions
139
I
0.5
E=[0, I)
0
Figure 4.11
Graph of g(x) =
I
I+
(x
- 1)2, x E (0, 1)
The statement and conclusion of the intermediate value theorem is illustrated in Figure 4.12. The theorem simply states that if f is continuous on [a, b] with f(a) < f(b), and y E 68 satisfies that f(a) < y < f(b), then the graph off crosses the line y = y at least once. Proof.
Let A = {x E (a, b) : f(x) 5 y}. The set A * 45 since a E A, and A is
bounded above by b. Thus by the least upper bound property, A has a supremum in R. Let c = sup A. Since b is an upper bound, c s b. We now show that f(c) = y. Since c = sup A, either c E A or c is a limit point of A. If c e A, then f(c) < y. If c is a limit point of A, then by Theorem 2.4.7 there exists a sequence in A such that x -* c. Since x. E A, f 5 y. Since f is continuous,
f(c) = lim f(x,,) <_ y Thus in either case, f(c) s y. Suppose f(c) < y. Then e = 2(y - f(c)) > 0. Since f is continuous at c, for this e there exists a S > 0 such that
f(c) - e < f(x) < f(c) + e
for all x E
fl [a, b].
Since f(c) < y, c # b. Thus (c, b] fl N5(c) # 0. But for any x E (c, b] with c < x <
c + S,
1(x)
140
Chapter 4
Limits and Continuity
Figure 4.12 Intermediate Value Theorem
But then x E A and x > c, which contradicts c = sup A. Therefore f (c) = y. The intermediate value theorem is one of the fundamental theorems of calculus. Simply stated, the theorem implies that if I is an interval and f : 1 R is continuous. then f(!) is an interval. Due to the importance of this result we state it as a corollary.
4.2.12
COROLLARY If I C R is an interval and f :I -> R is continuous on 1, then f(1) is an interval.
Proof. Let s, t e f(I) with s < t, and let a, b E I with a * b be such that f(a) = s and f(b) = t. Suppose y satisfies s < y < t. If a < b, then since f is continuous on [a, b], by the intermediate value theorem there exists c E (a, b) such that f(c) = y. Thus y E f(1). A similar argument also holds if a > b. There is an alternative way to state the previous corollary using the terminology of
connected sets. If I is a connected subset of R and f : I-+ R is continuous on I, then f(!) is connected. This result can be proved using only properties of continuous functions and the definition of a connected set (Exercise 28). The corollary now follows from the fact that a subset of R is connected if and only if it is an interval (Theorem 3.1.18). The proof of Theorem 3.1.18, however, also requires the least upper bound property of R. Consequently, the supremum property of the real numbers cannot be avoided in proving Corollary 4.2.12. The following two corollaries are additional applications of the intermediate value theorem. Our first result is the proof of Theorem 1.5.3.
4.2.13
COROLLARY For every real number y > 0 and every positive integer n, there exists a unique positive real number y so that y° = y.
4.2
Continuous Functions
141
Proof. That y is unique is clear. Let f(x) = x", which by Example 4.2.5(a) is continuous on R. Let a = 0 and b = y + 1. Since (y + 1)" > y, f satisfies the hypothesis of Theorem 4.2.11. Thus there exists y, 0 < y < y + 1, such that
f(y) = y" = y
4.2.14
COROLLARY
If f : [0, 1 ] -* [0, 1 ] is continuous, then there exists y E [0, 1 ] such
that Ay) = y.
Proof. Let g(x) = f(x) - x. Then g(0) = f(0) ? 0 and g(1) = f(1) - I there exists y E [0, 11 such that g(y) = 0; i.e., f(y) = y. Q 4.2.15
0. Thus
EXAMPLES
(a) In the proof of Theorem 4.2.11 continuity of the function f was required. The following example shows that the converse of Theorem 4.2.11 is false; that is, if a function f satisfies the intermediate value property on an interval [a, b], this does not imply that f is continuous on [a, b]. Let f be defined on [0, 2] as follows,
0<xs?,
- -1,
x = 0.
1
f(x) =
x
or,
Then f(0) _ -1, f(r) = 1, and for every y, -1 < y < 1, there exists an x E (0, such that f(x) = y. However, the function f is not continuous at x = 0 (see Figure 4.3).
(b) In this example we show that the conclusion of the intermediate value theorem is false if the interval [a, b] of real numbers is replaced by an interval of rational numbers.
Let E _ {x E 0 : 0 5 x < 2}, and let f (x) = x2. Then f is continuous on E with f(O) < 2 < f(2). However, there does not exist r E E such that f(r) = 2. 0
EXERCISES 4.2 1. For each of the following, determine whether the given function is continuous at the indicated point x".
2x2-5x-3 x03, f(x)
o
x 6, 3
1- cos x `c. g(x) =
x
x= 3,
x# 0,
x = 0, 2. Let f : R -' R be defined by 0,
f(x) _
8x,
2x2 + 8,
at x" = 3
at x° = 0
when x is rational, when x is irrational.
a. Prove, using e and 8, that f is continuous at 2. b. Is f continuous at 1? Justify your answer.
h(x)
d. k(x)
Vc-2 x#4,
_
x
-
J
4
4
x2,
1 4 - x,
x
x 5 2,
x>2.
4
at x" = 4
at x, =.2
142
Limits and Continuity
Chapter 4
3. Let f : R -r R be defined by
x E Q,
x2,
f(x) __
x+2, x0Q.
Finds all points (if any) where f is continuous. 4. *Prove (without using Example 4.2.7) that f(x) = V is continuous on [0, oo). 5. Define f : (0, 1 ] - R by
f
x+l x
a. Justify that f is continuous on (0, 1]. b, Can one define f(0) so that f is continuous on [0, 1]? 6. Let E C R, and suppose f : E --+ R is continuous at p e E. *a. Prove that Ifl is continuous at p. Is the converse true?
b. Set g(x) =, x E E. Prove that g is continuous at p. 7. *Let E C R and suppose f : E-*R is continuous on E. Prove that f" defined by f'(x) _ (f(x))" is continuous on E for each n E N. 8. a. Prove that f (x) = cos x is continuous on R. b. If E C R and f : E -+ R is continuous on E, prove that g(x) = cos (fix)) is continuous on E. 9. For each of the following equations, determine the largest subset E of R such that the given equation defines a continuous function on E. In each case state which theorems or examples are used to show that the function is continuous on E.
*a. AX) =
x
4x
4)5
d. k(x) =cos
*c.
h(x)
b. g(x) = sinz
sin x
x2 +
10. Prove that
f(x) _
x2,
x s 1,
{ 32x, x> 1,
is continuous on R and that Range f = R. 11. As in Example 4.2.7(a), use Theorem 4.2.6 to prove that each of the following functions is continuous on the given domain.
a. f(x) =
1, X
Dom f = (0, oo)
b, g(x) = x2, Dom g = R
12. Suppose E is a subset of R and f, g : E -+ R are continuous at p E E. Prove that each of the functions defined below is continuous at p. *a. max{f, g}(x) = max{f(x), g(x)}, x E E b. min{f, g}(x) = min{f(x), g(x)}, x E E
c. f'(x) = max{f(x), 0), x E E 13. Suppose f : [a, b] -* R and g : [b, c] - R are continuous on [a, b] and [b. c], respectively. Leth : [a. c] -+R be defined by
h(x) _ {f
(x a s x s b,
g(x).
b < x s c.
Prove that h is continuous on [a, c] if and only if f(b) = g(b).
4.2
Continuous Functions
143
14. Use the intermediate value theorem to prove that every polynomial of odd degree has at least one real zero.
15. Prove that there exists x E (0, z) such that cos x = x. 16. *Suppose f : [ -1, 1 ] -+ R is continuous and satisfies f(- I) = f(l). Prove that there exists y E [0, 17 such that
f(Y) = f(Y - 1) 17. Suppose f : [0, 1 ] --? R is continuous and satisfies f(0) = f(l). Prove that there exists y E (0, ;] such that ICY) = f(y + D. 18. *Let E C R and let f : E -a R be continuous. Let F = {x E E : f(x) = 0}. Prove that F is closed in E. Is F necessarily closed in R? 19. Suppose f : (0, 1) -- R is continuous and satisfies f(r) = 0 for each rational number r E (0, 1). Prove that
f(x) = 0 for all x E (0, 1). f(x) + f(y) for all x, y E R. a. If f is continuous at some p E R, prove that f is continuous at every point of R. *b. If f is continuous on R, prove that f(x) = cx for all x E R, where c = f(1). 21. Let E C R and let f be a real-valued function on E that is continuous at p E E. If f(p) > 0, prove that there exists an a > 0 and a S > 0 such that f(x) 2- a for all x e N$(p) fl E. 22. *Let f : E.- R be continuous at p E E. Prove that there exists a positive constant M and S > 0 such that
20. Let f be a real-valued function on R satisfying f(x + y)
lf(x)I sMforallxEEflN6(p). 23. Let f : (0, 1) --> R be defined by
f(x) _
-
0, In,
if x is irrational, if x is rational with x=m/n in lowest terms.
a. Prove that f is unbounded on every open interval I C (0, 1). b. Use part (a) and the previous exercise to conclude that f is discontinuous at every point of (0, 1). 24. Suppose E is a subset of R and f, g : E -- R are continuous on E. Show that {x E E : f(x) > g(x)} is open in E. 25. *Let K be a compact subset of R and let f : K -a R be continuous on K. Prove that f(K) is compact by showing that f(K) is closed and bounded.
26. Let E C R and let f be a real-valued function on E. Prove that f is continuous on E if and only iff-'(F) is closed in E for every closed subset F of R. 27. Let A, B C R and let f : A -- ). R and g : B -a R be functions such that Range f C B.
a. If V C R, prove that (g -f)-'(V) = f-'(g-'(V)). b. If f and g are continuous on A and B respectively, use Theorem 4.2.6 to prove that g of is continuous on A. 28. Suppose 1 is a connected subset of R and f : I--> R is continuous on I. Prove, using only the properties of continuity and the definition of connected set, that f(1) is connected.
29. *Let K C R be compact and let f be a real-valued function on K. Suppose that for each x E K there exists e, > 0 such that f is bounded on NE,(x) n K. Prove that f is bounded on K.
30. Let A C R. For p E R, the distance from p to the set A, denoted d(p, A), is defined by d(p, A) = inf{Ip - xJ : x E A}. a. Prove that d(p, A) = 0 if and only if p E A. b. For x, y E R, prove that Id(x, A) - d(y, A) Jx - y1. e. Prove that the function x -+ d(x, A) is continuous on R. d. If A, B are disjoint closed subsets of R, prove that d(x, A) AX) = d(x, A) + d(x, B) (x)
144
Chapter4
Limits and Continuity
is a continuous function on R satisfying 0 s f(x) 0, x E A.
1 for all x E R. and
f(x) - 11, xEB.
31. Let f be a continuous real-valued function on R satisfying f(0) = I and f(x + v) = f(x)f(v) for all x.y E R. Prove that f(x) = a` for some a E R. a > 0.
Uniform Continuity In the previous section we discussed continuity of a function at a point and on a set. By Definition 4.2.1, a function f : E -i R is continuous on E if for each p E E, given any
e > 0, there exists a S > 0 such that Lf(x) - f(p)I < e for all x E E fl N5(p). In general, for a given e > 0, the choice of S that works depends not only on a and the function f, but also on the point p. This was illustrated in Example 4.1.2(g) for the function f(x) = 1/x, x E (0, oo). Functions for which a choice of S independent of p is possible are given a special name.
4.3.1
DEFINITION
Let E C P and f : E - R. The function f is uniformly continuous
on E if given e > 0, there exists a S > 0 such that 1f(x) - fCv)I < e
for all x,vEEwith x-v1 <S. The key point in the definition of uniform continuity is that the choice of S must depend only on e, the function f and the set E; it has to be independent of any x E E. To illustrate this, we consider the following examples.
4.3.2
EXAMPLES
(a) If E is a bounded subset of R, then f(x) = .r` is uniformly continuous on E. Since E is bounded, there exists a positive constant C so that 1x1 C for all x E E. If x, y E E, then
Lf(x) - f(v)I = 1x2 - y2I = Ix + yI Ix - v1
(Ix1 + yI)Ix - yI 2CIx - v1. Let e > 0 be given. Take S = e/2C. If x, y E E with Ix - yI < S, then by the above
Lf(x) -f(y)1 s 2CIx - yI < 2C8 = Therefore, f is uniformly continuous on E. In this example, the choice of S depends both on e and the set E. In the exercises you will be asked to show that this result is false if the set E is an unbounded interval.
(b) Let f(x) = sinx. As in Example 4.2.2(f),
Lf(y) -f(x)I < Iy - xI for all x, y E R. Consequently, f is uniformly continuous on R.
4.3
Uniform Continuity
145
(c) In this example we show that the function f(x) = I /.r, x E (0. oo) is r= uniformly continuous on (0, oo). Suppose, on the contrary, that f is uniformly continuous on (0, oo). Then, as in Example 4.1.2(g), if we take e = 1, there exists a S > 0 such that If(x) - f(Y) I
X- y < I
for all x, y E (0,-oo) with Ix - yl < S. Choose no E Rl such that 1/n < S, and for n E f i set x = 1/n. Then for all n ? no, X. - X.+1 = I
n-n+1 <
n
<
but
If(x.) -f(xn+i)I = In - (n + 1)I = 1. This however contradicts that If(x) - f(y) I < 1 for all x, y E (0. oo) with Ix - yl < S. Thus f is not uniformly continuous on (0, oo). The function f(x) = l/x, however, is uniformly continuous on (a, oo) for every fixed a > 0. Suppose x, y E [a, oo). Then
[f(x) - f(y)I = ly xyx l 5 a21x - yl. Hence, given e > 0, if we choose S such that 0 < S < a2e, then as a consequence of the above inequality, if(x) - f(y)I < e for all x, y E [a. oo) with Ix - yi < S.
Lipschitz Functions Both of the functions in Example 4.3.2(a) and (b), and the function f(x) = 1/x with Dom f = [a, oo), a > 0, are examples of an extensive class of functions. If E C R, a function f : E -+ R satisfies a Lipschitz condition on E if there exists a positive constant M such that [1(x) - f(Y) I < Mix - Y I for all x, y E E. Functions satisfying the above inequality are usually referred to as Lipschitz functions. As we will see in the next chapter, functions for which the derivative is bounded are Lipschitz functions.. As a consequence of the following theorem, every Lipschitz function is uniformly continuous. However, not every uniformly continuous
function is a Lipschitz function. For example, the function f(x) = V is uniformly continuous on (0, oo), but f does not satisfy a Lipschitz condition on [0, oo) (see Exercise 5).
4.3.3
THEOREM Suppose E C R 'and f : E - R. If there exists a positive constant M such that
V(x) - f(y)I <- MIx - yI for all x, y E E, then f is uniformly continuous on E.
146
Chapter 4
Limits and Continuity
Proof. Exercise 1. O
Uniform Continuity Theorem If the function f does not satisfy a Lipschitz condition on E, then determining whether f is uniformly continuous on E is much more difficult. The following theorem provides a sufficient condition on the set E such that every continuous real-valued function on E is uniformly continuous.
4.3.4 THEOREM If K C R is compact and f : K -+ R is continuous on K, then f is uniformly continuous on K.
Let e > 0 be given. Since f is continuous, for each p E K, there exists a 6P > 0 such that
Proof.
(3)
If(X) - f(p) I < 2 for all x E K fl N2s,(p)
The collection {Nso(p)},eK is an open cover of K . Since K is compact, a finite number of these will cover K. Thus there exist a finite number of points P i . . . . . p in K such that
K C U Ns,(pi). i=[ Let
S = min{SP, : i = 1,
, n).
Then S > 0. Suppose x, y E K with Ix - yi < S. Since x E K, x E N,&(pi) for some i. Furthermore, since k - yI < S s Sp, x, y E Nzs,.(Pi)
Thus by the triangle inequality and inequality (3),
LAX) - f(y)I C If(x) - f(pi)I + U(pa) - f(y)I < 2 + 2 = e.
4.3.5
COROLLARY A continuous real-valued function on a closed and bounded interval [a, b] is uniformly continuous. The definition of uniform continuity and the proof of Corollary 4.3.5 appeared in a paper by Eduard Heine in 1872.
4.3.6
EXAMPLE In this example, we show that the properties closed and bounded are both required in Corollary 4.3.5. The interval [0, oo) is closed, but not bounded. The function f(x) = x2 is continuous on (0, oo), but not uniformly continuous on [0, co) (Exercise 2). On the other hand, the interval (0, 1) is bounded, but not closed. The function f(x) = 1/x is continuous on (0, 1), but is not uniformly continuous on (0, 1).
4.3
Uniform Continuity
147
EXERCISES 4.3 1. Prove Theorem 4.3.3. 2. Show that the following functions are not uniformly continuous on the given domain.
*a. AX) = x2, Dom f = [0, oo)
b, g(x) =
I.
Dom g = (0, oo)
c. h(x) = sin x,
Dom h = (0, co)
3. Prove that each of the following functions is uniformly continuous on the indicated set.
*a. AX)
1 + x , x E [0. oo)
c. h(x) = x2
xER
+
e. e(x) = x + 1, x E (0, oo)
b. g(x) _ .r'-,
x E hi
d. k(x) = cos x, x E R
*1 f(x) =
sinx,
x E (0, I)
4. Show that each of the following functions is a Lipschitz function.
*a. f(x) =
,
Dom f = [a, oo), a > 0
c. h(x) = sin x, Dom h = [a, oo), a > 0
b. g(x) = x2 + 1, Dom g = (0. oo)
d. p(x) a polynomial, Dom p = [ -a, a], a > 0
5. *a. Show that f(x) _ \ satisfies a Lipschitz condition on [a, oo), a > 0. b. Prove that V is uniformly continuous on (0, oo). c. Show that f does not satisfy a Lipschitz condition on (0, oo). 6. Suppose E C R and f, g are Lipschitz functions on E. a. Prove that f + g is a Lipschitz function on E. b. If in addition f and g are bounded on E, or the set E is compact, prove that fg is a Lipschitz function on E.
7. Suppose E C R and f. g are uniformly continuous real-valued functions on E. a. Prove that f + g is uniformly continuous on E. *b. If, in addition, f and g are bounded, prove that fg is uniformly continuous on E. c. Is part (b) still true if only one of the two functions is bounded? is a Cauchy sequence in E, prove that { f(x )} is a 8. Suppose E C R and f : E - R is uniformly continuous. If Cauchy sequence.
9. Let f : (a, b) -+ R be uniformly continuous on (a, b). Use the previous exercise to show that f can be defined at a and b such that f is continuous on [a, b]. 10. Suppose that E is a bounded subset of R and f : E - R is uniformly continuous on E. Prove that f is bounded on E.
11. Suppose -oo s a < c < b <_ oo, and suppose f : (a, b) - R is continuous on (a. b). a. If f is uniformly continuous on (a, c) and also on (c, b), prove that f is uniformly continuous on (a, b). b. Show by example that the conclusion in part (a) may be false if f is not continuous on (a, b).
12. Let a E R. Suppose f is a continuous real-valued function on [a, oo) satisfying lim f(x) = L. where L E R. Prove that
a, f is bounded on [a, oo), and b. f is uniformly continuous on (a, oo).
148
Chapter 4
Limits and Continuity
13. Let E C R. A function f : E E is contractive if there exists a constant b, 0 < b < I. such that If(x) - f(y)I b Ix - yI. *a. If E is closed, and f : E -* E is contractive, prove that there exists a unique point x E E such that (Such a point xo is called a fixed point of f.)
x,,.
b. Let E _ (0,;]. Show that f(x) = r' is contractive on E. but that I 'does not have a fixed point in E.
14. A function f : Il -> R is periodic if there exists p E R such that f(x + p) = f(x) for all x E R. Prove that a continuous periodic function on R is bounded and uniformly continuous on R.
44.4
Monotone Functions and Discontinuities In this section we take a closer look at both limits and continuity for real-valued functions defined on an interval 1 C R. More specifically, however, we will be interested in classifying the types of discontinuities that such a function may have. We will also investigate properties of monotone functions defined on an interval I. These functions will play a crucial role in Chapter 6 on Riemann-Stieltjes integration. First, however, we begin with the right and left limits of a real-valued function defined on a subset E or R.
Right and Left Limits 4.4.1
Let E C I8 and let f be a real-valued function defined on E. Suppose p is a limit point of E fl (p, oo). The function f has a right limit at p if there exists a number L E IB such that given any e > 0, there exists a S > 0 for which DEFINITION
Lf (x) - LI < e for all x E E satisb,ing p < x < p + S. The right limit of f, if it exists, is denoted by f (p +), and we write lim f(x). A p+) = x lim- Ax) = x-.p x>p
Similarly, if p is a limit point of En( - oo, p), the left limit off at p, if it exists, is denoted by f( p- ), and we write
f(p-) = lim.f(x) = limf(x). x
The hypothesis that p is a limit point of E fl (p, oo) guarantees that for every
S > 0, E n (p, p + S) * 4i. If E is an open interval (a, b), -oo < a < b s oo, then any p satisfying a s p < b is a limit point of E fl (p, oo). Similarly, if -oo <- a < b < oo, then any p satisfying a < p s b is a limit point of (-oo, p) fl E. If 1 is any interval with Int(!) # 0, and f : I -> R, then f has a limit at p E lnt(I) if and only if
(a) f (p+) and f (p-) both exist, and
(b) f(p+) =f(p-). The hypothesis that p E Int(!) guarantees that p is a limit point of both (-oo, p) fl 1 and I fl (p, oo). If p is the left endpoint of the interval 1, then the right limit of f at p
4.4 Monotone Functions and Discontinuities
149
coincides with the limit off at p. The analogous statement is also true if p is the right endpoint of I. We also define right and left continuity of a function at a point p as follows.
4A.2
Let E C R and let f be a real-valued function on E. The function f is right continuous (left continuous) at p E E if for any e > 0, there exists a S > 0 DEFINITION
such that
If(x) -f(p)I < e
for all xEEwith p<_x 0 such that E fl (p, p + S) = 4,. Thus if f': E -+ R and e > 0 is arbitrary, then If (x) - f (p)l < e for all x E. E fl ['p, p + S). Thus every f : E -> R is right continuous at p. In particular, if E is a closed interval [a, b], then every f : [a, b] -+ R is right continuous at b. Also, f is left continuous at b if and only if f is continuous at p. The following theorem, the proof of which is left to the exercises, is an immediate consequence of the definitions.
4A.3 THEOREM A function f : (a, b) -+R is right continuous at p E (a, b) if and only if f (p+) exists and equals f (p). Similarly, f is left continuous at p if and only if f (p- ) exists and equals f (p).
Proof.
Exercise 1. Q
Types of Discontinuities By the previous theorem a function f is continuous at p E (a, b) if and only if
(a) f (p+) and f (p-) both exist, and
(b) f(p+) =f(p-) =f(p). A real-valued function f defined on an interval I can fail to be continuous at a point p E 1 (the closure of I) for several reasons. One possibility is that lim f(x) exists but xZ either does not equal f (p), or f is not defined at p. Such a function can easily be made continuous at p by either defining or redefining f at p as follows: lim f(x). f(p) = X-P
For this reason, such a discontinuity is called a removable discontinuity. For example, the function
-4
g(x)
x-2'
x #.2,
2,
x = 2,
of Example 4.2.2(a) is not continuous at 2 since
1 m g(x) = 4 * g(2).
150
Chapter 4
Limits and Continuity
By redefining g such that g(2) = 4. the resulting function is then continuous at 2. Another example is given by f (x) = x sin(] /x), x E (0, oo), which is not defined at 0. If we define f on [0, oo) by
x=0
0,
f(x)
x sin
i , x > 0,
x
then by Example 4.2.2(e), f is now continuous at 0.
Another possibility is that f(p+) and f(p-) both exist, but are not equal. This type of discontinuity is called a jump discontinuity. (See Figure 4.13.)
4AA DEFINITION Let f be a real-valued function defined on an interval I. The function f has a jump discontinuity at p E Int(1) if f(p+) and f (p-) both exist, but f is not continuous at p. If p E I is the left (right) endpoint of 1, then f has a jump discontinu-
ity at p if f (p+) (f( p- )) exists, but f is not continuous at p.
Ap+)
AP-)
p
Figure 4.13 Jump Discontinuity off at p
Jump discontinuities are also referred to as simple discontinuities, or discontinuities of the first kind. All other discontinuities are said to be of second kind. If f( p+ ) and f (p-) both exist, but f is not continuous at p, then either
(a) f(p+) # f(p-), or
(b) f(p+) =f(p-) #f(p)
4.4
Monotone Functions and Discontinuities
151
In case (a) f has a jump discontinuity at p, whereas in case (b) the discontinuity is removable. All discontinuities for which f (p+) or f (p-) does not exist are discontinuities of the second kind.
4.4.5
EXAMPLES
(a) Let f be defined by x,
0<x-1,
f(x)= 3-x2, x> 1.
The graph off is given in Figure 4.14. If x < 1, then f(x) = x. Therefore,
f(I-)= lint f(x) = limx= 1 =f(1). X +F X-1 Likewise, the right limit off at 1 is
2
1
Figure 4.14
f(1+)=Xlimf(x)=lim(3-x2)=2. Therefore, f (I -) = f (l) = 1, and f (I +) = 2. Thus f is left continuous at 1, but not continuous. Since both right and left limits exist at 1, but are not equal, the function f has a jump discontinuity at 1.
(b) Let [x] denote the greatest Integer function; that is, for each x, [x] = largest integer n that is less than or equal to x. For example, [2.9] = 2,[3.1) = 3, and [
1.5] = -2. The graph of y = [x] is given in Figure 4.15. It is clear that for each n E Z,
lim [x] = n - 1
and
lim. [x] = n.
Thus f has a jump discontinuity at each n E Z. Also, since f (n) = [n] = n, f (x) = [x]
is right continuous at each integer. Finally, since f is constant on each interval (n - 1, n), n E Z, f is continuous at every x E R\7L.
152
Chapter4
Limits and Continuity
34-
24-
I +
-1
2
1
3
00 -1 Figure 4.15
Graph of [x]
(c) Let f be defined on R by if x<_0,
0,
f(x) =
sin
X
if x > 0.
Then f(0-) = 0, but f(0+) does not exist. Thus the discontinuity is of second kind. (d) Consider the function g : R -+ R defined by g(x) = sin (21rx[x]).
For x E (n, n + 1), n E Z, x[x] = nx, and thus g(x) is continuous on every interval (n, n + 1), n E Z. On the other hand, for n E 71,
lim sin(2ax[x]) = sin(21rn2) = 0, sn+
and
lim sin(2irx[x]) = sin(2an(n - 1)) = 0. Since g(n) = sin(21rn2) = 0, g is also continuous at each n E Z. Thus g is a bounded continuous function on R. The function g, however, is not uniformly continuous on R
(Exercise 7). The graph of g for x E (-4.4) is given in Figure 4.16. 0
Monotone Functions 4.4.6
DEFINITION
Let f be a real-valued function defined on an interval I.
(a) f is monotone increasing (increasing, nondecreasing) on I if f(x) < f(y) for all x, y E I with x < y.
4.4
AAIA
I
A
Monotone Functions and Discontinuities
153
A
AA
IV
TV-11-
Figure 4.16
A
V
Graph of g(x) = sin(2ax[x]), x E (-4,4)
(b) f is monotone decreasing (decreasing, nonincreasing) on I if f (x) at f (y)
for all x, y E I with x < y. (c) f is monotone on 1 if f is monotone increasing on I or monotone decreasing on I.
A function f is strictly increasing on I if f (x) < f (y) for all x, y E I with x < y. The concept of strictly decreasing is defined similarly. Also, f is strictly monotone on I if f is strictly increasing on I or strictly decreasing on I. Our main result for monotone functions is as follows.
4A.7 THEOREM Let I C R be an open interval and let f : I -+ H be monotone increasing on I. Then f (p+) and f (p-) exists for every p E I and
inff(x). supf(x) =f(p-) :5f(p):5 f(p+) = p<x x
Furthermore, if p,q E I with p < q, then f(p +) 5 f(q-). Although we stated the theorem for monotone increasing functions, a similar statement is also valid for monotone decreasing functions.
Proof. i+ix p E I. Since f is increasing on 1, {f(x) : x < p, x E I} is bounded above by f (p). Let
A = sup{ f (x) : x < p, x e I}. Then A
f (p). We now show that
lim f (x) = A.
X- +P
The proof of this is similar to the proof of Theorem 2.3.2. Let e > 0 be given. Since A is the least upper bound of {f (x) : x < p}, there exists xo < p such that
A-e
Lf(x) - AI < e x+p
f(x) = A. Similarly,
f(p) f(p+) = inf{f (x) : p < x, x E l}.
154
Chapter 4
Limits and Continuity
Finally, suppose p < q. Then
f(p+)=inf{f(x):p<x,xE1}sinf{f(x):p<x
4.4.8
sup { f (x) : x < q, x E l } = f (q - ).
COROLLARY If f is monotone on an open interval 1, then the set of discontinuities
off is at most countable.
Proof. Let E
p E 1: f is discontinuous at p}. Suppose f is monotone increasing
on I. Then
p E E if and only if f (p-) < f(p+). For each p E E, choose r1, E 0 such that
f(p-) < r, <.f(p+). If p < q, then f(p+) s f(q-). Therefore, if p. q E E, r, * r,, and thus the function p -), ro is a one-to-one map of E into Q. Therefore E is equivalent to a subset of 0 and thus is at most countable.
Construction of Monotone Functions with Prescribed Discontinuities We now proceed to show that given any finite or countable subset A of (a, b), there exists a monotone increasing function f on [a, b] that is discontinuous at each x E A and continuous on [a, b] \A. We first illustrate how this is accomplished for the case when a finite subset of (a, b). To facilitate this construction, we define A = {a,, ... , the unit jump function Ion R as follows.
4.4.9
DEFINITION
The unit jump function 1: R -> R is defined by
1(x) = 10.
1,
when x < 0, when x ? 0.
The function I is right continuous at 0 with 1(0+) = 1(0) = 1 and 1(0-) = 0. For
aER,set la(x) = I(x - a) =
0 1,
when x < a, when x ? a.
Then la has a unit jump at a and is right continuous at a (see Figure 4.17). Suppose {c,, ... , are positive real numbers. Define f on [a, b] by
f(x) _
ck1(x - ak). k- l
The reader should verify that the function f is
(a) monotone increasing on [a, b],
(b) continuous on [a, b]\{a,, a2, ... , aj,
4.4
Monotone Functions and Discontinuities
155
I
a
Figure 4.17
Graph of 1(x - a)
(c) right continuous at each ak, k = 1, 2, ... , n, and (d) discontinuous at each ak with f(ak+) - flak-) = ck for all k = 1. 2, ... , n. of (a, b) is not surprising. That such a function exists f o r any finite subset {a,, ... , However, that such a function exists for any countable subset A of (a, b) may take some convincing, especially if one takes A to be dense in [a, b]; e.g., the rational numbers in (a, b).
4A.10 THEOREM Let a, b e R and let
be a countable subset of (a, b). Let be any sequence of positive real numbers such that 7,0,0. , c converges. Then there exists a monotone increasing function f on [a, b) such that c,,, (a) f(a) = 0 and f(b) _ (b) f is continuous on [a, b]\ {x : n = 1, 2, ...},
for all n, i.e., f is right continuous at all x,,, and (d) f is discontinuous at each x with (c)
f(xJ Proof.
For each x E [a, b], define 00
AX) _ 7, c 1(x =t
Since 0 s c I(x -
x E [a, b], we have 00
Ck <
Ckl(X - Xk) S
s (X) = k-t
Ck.
k=t
Thus for each x E [a, b], the sequence {s (x)} of partial sums is monotone increasing and bounded above, and hence by Theorem 2.7.6 converges. Since
n= 1,2,.. .
156
Chapter 4
Limits and Continuity
for all x, y with x < y, f is monotone increasing on (a, b). Furthermore, since x > a for all n, 1(a 0 for all n. Therefore f(a) = 0. Also, since 1(b I for all n,
f(b) = 7, C. k-l
This proves (a).
We now prove (b). Fix p E [a, b), p # x for any n. Let E = {x : n E N}. There are two cases to consider.
(1) Suppose p is not a limit point of E. If this is the case, there exists a S > 0 such
that NB(p)flE= ¢. Then
I(x-xk)=1(p-xk) forallxE(p-6,p+6) and all k = 1, 2, .... Thus f is constant on (p - 8, p + 8) and hence continuous. (ii) Suppose p is a limit point of E. Let e > 0 be given. Since the series 7, 1 Ck converges, by the Cauchy criterion there exists a positive integer N such that Ck < E.
k-N+1
Choose S such that
0 < S < min{1p -
n = 1, 2, ... , N}.
With this choice of 8, if xk e N6(p) fl E, we have k > N. Suppose p < x < p + S. Then
1(p-xk) =I(x-xk) forallk= 1,2,...,N. Furthermore, for any x > p, we always have
021(x-xk)-1(p-xk): 1 forallk6N. Therefore, for p < x < p + S, 00
0 t f(x) - f(P) 5
'0 k-N+l
Ck(I(x - xk) - 1(P - xk)) 5.7, Ck < E. k=N+1
Thus f is right continuous at p. Similarly, f is left continuous at p, and therefore f is continuous at p.
For the proof of (c), fix an x E E. If x is an isolated point of E, then as above, for all y, x < y < x + S. Thus f(x ). Suppose x is a limit point of E. Let e > 0
there exists a S > 0 such that En (x,,, x + S) = ¢. Therefore, f(y) = be given. Again, choose a positive integer N so that
I 00
kN+l
Ck < E.
4.4
Monotone Functions and Discontinuities
157
As in (b), there exists a S > 0 such that if xk. E (x,,, x,, + S) fl E, then k > N. Thus a 7, ck < e for all y E (x,, x + S). 0 s f(y) k=N+l
f is right continuous at each x,,. Therefore, For the proof of (d), suppose y < x,,. Again, if x is an isolated point of E, there ex-
ists a S > 0 such that (x - S, for all y <
n E = 4. Therefore, for all k * n,
xn,
I(xn-xn)=1(0)= 1. Therefore,
f(xn) - f(y) = cn
for all y, x - S < y < x,,.
N+I ck < e. For
Suppose x is a limit point of E. Given c > 0, choose N such that
fl E then k > N. Then for all
this N, choose S > 0 such that if xk E (x - S,
<x,,
yE[a,b] with C.
f(xn) - f(y) < C. + 7, ck < C. + e. k-N+1
Therefore, f(xn) - f(xn-) = Cn O
4A.11
EXAMPLES
( a ) T a k e c = 2', x = 1 = 1/(n + 1), n = 1, 2, ... , and (a, b) = (0, 1). As in Theorem 4.4.10, let 00
Ax) _ 71
n-1
< I. If 0 < x <
In this example, the sequence {xn} satisfies 0 < xt < x2 < 0 for all n. Thus xt = 1, then I(x -
f(x)=0, xE [0'2). If x1
x < x2 = 3, then !(x - x1) = 1 and !(x - xk) = 0 for all k =- 2. Therefore,
f(x)=c1=2,
X
If x2 5 x < x3 = 4, then I(x - xk) = 1 for k = 1,2 and I(x - xk) = 0 fork a 3. Therefore, AX)
+c2=
1
2+
34,
xE
and so forth. The graph off is depicted in Figure 4.18.
J23. 34 ,
158
Chapter 4
Limits and Continuity
7
0-0
8
.-o
4
2
S
0
4
0 I
2
3
4
2
3
4
S
Figure 4.18
(b) Let c" = 2-", and let {x"} be an enumeration of the rationals in (0, 1). Theorem 4.4.10 guarantees the existence of a nondecreasing function on [0. lj, which is discontinuous at each rational number in (0, 1). and continuous at every irrational number in (0, 1).
(c) If in the proof of Theorem 4.4.10, we take to be a countable subset of R and choose {c"}"EN (c" > 0) such that Z'n'o- , c" = 1, then we obtain a nondecreasing, real-valued function f on R satisfying lie f(x) = 0 and lim f(x) = 1. (See Exercise 20.) Such a function is called a distribution function on d. Snch functions arise naturally in probability theory.
Inverse Functions Suppose f is a strictly increasing real-valued function on an interval I. Let x, y E I with
x 0 y. If x < y, then since f is strictly increasing. f(x) < f(y). Similarly, if x > y then f(x) > f(y). Thus f(x) # f(y) for any jr, y E I with x # y. Therefore, f is one-to-one, and consequently has an inverse function f -' defined on f(1). In the following theorem we prove that if f is continuous on 1, then f -' is also continuous on f(1).
4.4.12 THEOREM Let I C R be an interval and let f : I-+ R be strictly monotone and continuous on !. Then f -' is strictly monotone and continuous on J = f(1).
Proof. Without loss of generality, we consider the case where f is strictly increasing on I. Since f is continuous, by Corollary 4.2.12, f(1) = J is an interval. Furthermore, since f is strictly increasing on I, f is a one-to-one function from I onto J. Hence f is a one-to-one function from J onto I. Suppose y,, y2 E J with y, < y2. Then there exist distinct points x,, x2 E I such that f(x;) = y;, i = 1, 2. Since f is strictly increasing, we have x, < x2. Thus f -'(y,) < f -' (y2); i.e., f ` is strictly increasing.
4.4
Monotone Functions and Discontinuities
159
It remains to be shown that f ` is continuous on J. We first show that f `' is left continuous at each y, E J for which (-oo, yo) fl J * 0. This last assumption means only that y, is not the left endpoint of J. Let xa E I be such that f(xo) = y0. Then (-oo, x,) n l * ¢. Let e > 0 be given. Without loss of generality, we can assume that e is sufficiently small so that x, - e E I. Since f is continuous and strictly increasing,
f((xo - e, xo]) = (f(xo - e),f(xo)) = (yo - 5, yo] where S > 0 is given by S = f(x,) - f(x, - e). Thus since f-' is strictly increasing,
x, - E= f
for all y E (y, - 8, y,) (see Figure 4.19). Hence,
1f -'(yo) - f -'(y)l < e
for ally E (y0 - s, yo]
Figure 4.19
Therefore, f "' is left continuous at y,. A similar argument also proves that f -' is right continuous at each y, E J that is not the right endpoint of J. Thus f -' is continuous at
each y, E J. For a strictly increasing function f on an open interval I, an alternative proof of the continuity of the inverse function f `' is suggested in Exercise 14.
4.4.13
EXAMPLE The function f(x) = x2 is continuous and strictly increasing on I = [0, oo)
with J = f(I) = [0, oo). Thus the inverse function f `'(y) = N /y is continuous on (0, oo). As a consequence, the function g(x) = N/x is continuous on (0, oo). Applying the same argument to f (x) = x" shows that the function g(x) = 'Clx is strictly increas-
ing and continuous on (0, oo). 0
160
Chapter 4
Limits and Continuity
Remark. In the statement of Theorem 4.4.12 we assumed that f was strictly monotone and continuous on the interval 1. The fact that f is either strictly increasing or strictly decreasing on I implies that f is one-to-one on the interval 1. Conversely, if f is one-to-one and continuous on an interval 1. then as a consequence of the intermediate value theorem the function f is strictly monotone on I (Exercise 15). This, however, is false if either f is not continuous on the interval 1, or if Dom f is not an interval. (See Exercises 16, 17, and 18.)
EXERCISES 4.4 1. Prove Theorem 4.4.3. 2. For each of the following functions f defined on R \ {0}, find ,4 m_ f(x) and -Ii m, f(x), provided the limits exist.
a. f(x) = Ixl
*b. f(x) _
Ix[x].
X < 0,
[X]
X>0
X
C. f(x) = [I - x2]
d. f(x) = [x2 - 1]
e. f(x) _ [ X1,
*L f(x) = x[ x
3. For each of the functions f in Exercise 2, determine whether f has a removable discontinuity, a jump discontinuity, or a discontinuity of second kind. at x = 0. If f has a removable discontinuity at 0. specify how f(0) should be defined so that f is continuous at 0.
4. *Investigate continuity of g(x) = (x - 2) [x) at x = 2. 5. Let f(x) = x - [x]. Discuss continuity of f. Sketch the graph of f. 6. *Let f be defined by f(x) = _ {x x2[x}, + b,
x < -2. x > -2.
Determine the value of b such that f has a removable discontinuity at x = -2. 7. *Prove that g(x) = sin(2rrx[x]) is not uniformly continuous on R. 8. Prove that the function f of Example 4.4.11(a) is continuous at x = 1.
9. Let E C Fl and let f be a real-valued function on E. Suppose p E R is a limit point of E fl (p, oo). Prove that lim f(x) = L if and only if 1 m f(p") = L for every sequence {p"} in E with p" > p for all n E N and p" --> p.
X-P 10. Let f be a real-valued function on (a, b].
a. If f is continuous on (a, b} and lim f(x) exists. prove that f is uniformly continuous on (a, b].
b. If f is uniformly continuous on (a, b), prove that lint f(x) exists. 11. Let f : [0, 2] - R be defined by
f(x) -
X,
.'
a-
05x 1,
1 < x 2. Show that f and f -t are strictly increasing and find f([0, 2]). Are f and f 1 + x2,
respective domains?
12. *If m E 7L, n E N, prove that f(x) = x'"1" is continuous on (0, oo).
continuous at every point of their
4.4
Monotone Functions and Discontinuities
161
13. a. If f and g are monotone increasing functions on an interval I. prove that f + g is monotone increasing on I. b. If in addition f and g are positive on 1, prove that fg is monotone increasing on I. c. Show by example that the conclusion in part (b) may be false if f and g are not both positive on I.
14. Let I C R be an open interval and let f : I -+ R be strictly increasing and continuous on I.
a. If U C I is open, prove that f(U) is open. b. Use (a) and Theorem 4.2.6 to prove that f'' is continuous on f(I). 13. Let I C R be an interval and let f be a one-to-one continuous real-valued function on 1. Prove that f is strictly monotone on I. 16. Let f : [0,1 ) -' R be defined by
AX)
2x,
Osx<2.
3-2x,
?5xsl.
a. Sketch the graph of f. b. Show that f is one-to-one on [0, 1 ], but not strictly monotone on [0, 1 ].
c. Show that f([0.. I ]) = [0, 2). d. Find f-' (y), y E [0, 2]. and show that f-' is not continuous at y, = 1. 17. Let E = [0, 11 U (2, 3), and for x E E set
f(x) -
x2,
Q :!:-: x < 1,
I 4-x, 25x<3.
a. Sketch the graph of f. b. Show that f is one-to-one and continuous on E.
e. Show that f(E) _ (0, 2]. d. Find f-' (y), y g [0, 2], and show that f`' is not continuous at y, = 1. 18. Let f : [0, 1] -+ R be defined by x,
ll-x,
f(x) - S
x E dQ,
Prove that f is one-to-one, that f([0, 1 ]) _ [0, 1], but that f is not monotone on any interval 1 C [0, 11.
19. Let ! C R be an interval and let f : I -+ R be monotone increasing. For p E Int(I), the jump of f at p, denoted
Jf(p), is defined by Jf(p) = f(p+) - f(p -) If p is the left endpoint, set Jf( p) = f( p +) - f(p), and if p is the right endpoint, set Jf(p) = f(p) - f(p -). a. Prove that f is continuous at p E I if and only if Jf(p) = 0. b. If p e Int(I), prove that Jf(p) = inf{ f(y) - f(x) : x < p < y, x, y E I}. 20. Let be a countable subset of R and a sequence of positive real numbers satisfying E c = 1. Let
f:R -iRbe defined by
f(x) _
C. !(x -
Prove that lint f(x) = 0 and X__ lim f(x) = 1.
162
Chapter4
Limits and Continuity
NOTES The limit of a function at a point is one of the fundamental tools of analysis. Not only is it crucial to continuity, but also to many subsequent topics in the text. The limit process will occur over and over again. We will encounter it in the next chapter in the definition of the derivative and again in the chapters on integration, series, etc. Another very important concept that will be encountered often in the text is uniform continuity. Uniform continuity is important in that given e > 0, it guarantees the
a unique positive real number y such that y" = x. Even though the existence of nth roots can be proved without the intermediate value theorem, any such proof is simply the statement that the function f(x) = x" satisfies the intermediate value property on [0, a] for every a > 0. Other applications of the intermediate value theorem will occur elsewhere in the text.
The proof of the intermediate value theorem de-
on [a, b], a, b E R, is Riemann integrable on [a, b].
pended on the fact that the connected subsets of R are the intervals (Theorem 3.1.18) and that the continuous image of a connected set is connected (Exercise 28 of Section 4.2). Assuming these two results, the intermediate value theorem is an immediate consequence as follows: Sup-
Other applications of uniform continuity will occur in
pose f is continuous on [a, b]. Let I = f([a, b]). Then I
many other theorems and in the exercises. One of the most important results of this chapter is the intermediate value theorem (Theorem 4.2.11). The intermediate value theorem has already been used in Corollary 4.2.13 to prove the existence of nth roots; namely, for
is connected and thus must be an interval. Thus if y satis-
existence of a S > 0 such that If(x) - f(y) I < e for all x, y E Dom f with Ix - yI < 6. In Chapter 6 we will use this to prove that every continuous real-valued function
every positive real number x and n E 101, there exists
fies f(a) < -y < f(b), then y E I, and hence there exists c E [a, b] such that f(c) = y. That the continuous image of a connected set is connected follows from the definition. However, the proof that the connected subsets of R are the intervals requires the least upper bound property.
MISCELLANEOUS EXERCISES 1. Let f be a continuous real-valued function on [a, b] with f(a) < 0 < f(b). Let c, = 2(a + b). If f(c,) > 0, let c, = } (a + c,). If f(cl) < 0, let c2 = 1(c, + b). Continue this process inductively to obtain a sequence {c"} in (a, b) which converges to a point c E (a, b) for which f(c) = 0. 2. Let E C R, p a limit point of E, and f a real-valued function defined on E. The limit superior of f at p, denoted 1 m f(x), is defined by 1 m f(x) = anfo sup{ f(x) : x E (N8( p) \ { p}) fl E}.
Similarly, the limit inferior off at p, denoted lim f(x), is defined by =FP !,f f (x) = ssu$ inf{}(x) : x e (N8(p) \ { p}) fl }.
x-P
Prove each of the following:
a. lim f (x) <_ L if and only if given e > 0, there exists a S > 0 such that f(x) < L + e for all x E E,
0 0 and 8 > 0, there exists x e E with 0 < I x - p I < S such that J-P
f(x)>L-e.
c. If I m f(x) = L, then for any sequence {xn} in E with x" # p for all n E N. and limx" = P, lim f(x") 5 L. d. There exists a sequence {x"} in E with x" # p for all n E N, such that and limx" = P, lim f(xn) = lim f(x). xp 3. Let X C R and f a real-valued function on X. For p E X, the oscillation of fat p, denoted w(f; p), is defined as w(f; p) = inf sup{ If(x) - f(y) I : x, y e Na(p) fl X}. 8>0
Supplemental Reading
163
Prove each of the following:
a. The function f is continuous at p if and only if w(f: p) = 0. b. For every s E i8, the set {x E X : w(f; x) < s} is open in X. c. The set {x E X : f is continuous at x} is the intersection of at most countably many sets that are open in X. 4. Find w(f; x) for the functions f of Example 4.1.2(e) and Example 4.2.2(g). The following set of exercises involves the Cantor ternary function. Let P denote the Cantor ternary set of Section 3.3. For each x E (0, 1], let x = .aia2a3 denote the ternary expansion of x. Define N as follows: oo,
N
if a # I for all is E fJ,
min{n : a = 11, otherwise.
Define b = 1a for is < N, and bN = 1, if N is finite. (Note: b E {0,1} for all n.) 5. If x E (0, 1) has two ternary expansions, show that
"b
T,
n-i
2
is independent of the expansion of x.
I
The Cantor ternary function f on [0, 1 ] is defined as follows: f(0) = 0, and if x E (0. 1 ] with ternary expansion x = .aja2a3 . , set b
f(x)= _12
where N and b are defined as above. 6. Prove each of the following:
a. f is monotone increasing on [0, 1]. b. f is constant on each interval in the complement of the Cantor set in [0, 1 ]. c. f is continuous on [0, 1 ].
d. f(P) = [0, 1]. e. Sketch the graph of f.
SUPPLEMENTAL READING Bryant, J., Kuzmanovich, J. and Pavlichenkov, A., "Functions with compact preimages of compact sets:' Math. Mag. 70 (1997), 362-364. Bumcrot, R. and Sheingorn, M., "Variations on continuity: Sets of infinite limits,' Math. Mag. 47 (1974), 41-43. Cauchy, A. L., Cours d'Analyse, Paris, 1821, in Oeuvres compldtes d'Augustin Cauchy, series 2, vol. 3, Gauthier-Villars, Paris, 1899. Fleron, Julian F., "A note on the history of the Cantor set and Cantor function;' Math. Mag. 67 (1994), 136-140.
Grabinger, Judith V., "Who gave you the epsilon? Cauchy and the origins of rigorous calculus;' Amer. Math. Monthly 90 (1983), 185-194. Martelli, M., Dang, M. and Seph, T.. "Defining chaos;' Math. Mag. 71 (1999), 112-122. Snipes, Ray F., "Is every continuous function uniformly continuous?" Math. Mag. 57 (1994),169-173. Straffin, Jr., Philip. D., "Periodic points of continuous functions;' Math. Mag. 51 (1978), 99-105. Velleman, D. J., "Characterizing continuity," Amer. Math. Monthly 104 (1997), 318-322.
Differentiation 5.1 The Derivative
52 The Mean Value Theorem 5.3 L'Hospital's Rule
5.4 Newton's Method
The development of differential and integral calculus by Isaac Newton (1642-1727) and Gottfried Wilhelm Leibniz (1646-1716) in the mid-seventeenth century constitutes one of the great advances in mathematics. In the two years following his degree from Cambridge in 1664, Newton invented the method of fluxions (derivatives) and fluents (integrals) to solve problems in physics involving velocity and motion. During the same period, he also discovered the laws of universal gravitation and made significant contributions to the study of optics. Leibniz, on the other hand, whose contributions came
ten years later, was led to the invention of calculus through the study of tangents to curves and the problem of area. The first published account of Newton's calculus appeared in his 1687 treatise Philosophia Naturalis Principia Mathematica. Unfortunately, however, much of Newton's work on calculus did not appear until 1737, ten years after his death, in a work entitled Methodus fuxionum et serierum infinitorum. Mathematicians prior to the time of Newton and Leibniz knew how to compute tangents to specific curves and velocities in particular situations. They also knew how to compute areas under elementary curves. What distinguished the work of Newton and Leibniz from that of their predecessors was that they realized that the problems of finding the tangent to a curve and the area under a curve were inversely related. More importantly, they also developed the notation and a set of techniques (a calculus) to solve these problems for arbitrary functions, whether algebraic or transcendental. In Newton's presentation of his infinitesimal calculus, he looked upon y as a flowing quantity, or fluent, of which the quantity v was the fluxion or rate of change. Newton's notation is still in use in physics and differential geometry, whereas every student of calculus learns the 165
166
Chapter5
Differentiation
d (for difference) and f (for sum) notation of Leibniz to denote differentiation and integration. Many of the basic rules and formulas of the differential calculus were developed by these two remarkable mathematicians. In the paper A New Method for Maxima and Minima, and also for Tangents, which is not Obstructed by Irrational Quantities, published in 1684, Leibniz gave correct rules for differentiation of sums, products. quotients, powers, and roots. In addition to his many contributions to the subject. Leibniz
also disseminated his results in publications and correspondence with colleagues throughout Europe. Newton and Leibniz, with their invention of the calculus, had created a tool of such novel subtlety that its utility was proved for over 150 years before its limitations forced mathematicians to clarify its foundations. The rigorous formulation of the derivative did not occur until 1821 when Cauchy provided a formal definition of limit. This helped to place the theory on a firm mathematical footing. Cauchy's contributions to the rigorous development of calculus will be evident in both this and subsequent chapters. In this chapter we develop the theory of differentiation based on the definition of Cauchy, with special emphasis on the mean value theorem and consequences thereof. The first section presents the standard results concerning derivatives of functions obtained by means of algebraic operations and composition. In the examples and exercises we will derive the derivatives of some of the basic algebraic and trigonometric functions. However, throughout the chapter we will assume that the reader is already familiar with standard techniques of differentiation and some of its applications. Therefore, we will concentrate on the mathematical concepts of the derivative. emphasizing many of its more subtle properties.
5.1
The Derivative In an elementary calculus course, the derivative is usually introduced by considering the problem of the tangent line to a curve or finding the velocity of an object moving in a
straight line. Suppose y = f(x) is a real-valued function defined on an interval [a, b]. Fix p E [a, b]. For x E [a, b], x # p, the quantity Q(x) = f(x)
- f(p)
x-p represents the slope of the straight line (secant line) joining the points (p,f(p)) and (x,f(x)) on the graph off (see Figure 5.1). The function Q(x) is defined for all values of x E [a, b], x # p. The limit of Q(x) as x approaches p, provided this limit exists, is defined as the slope of the tangent line to the curve y = f(x) at the point (p,f(p)). A similar type of limit occurs if we consider the problem of defining the velocity of a moving object. Suppose that an object is moving in a straight line and that its distance s from a fixed point P is given as a function of t. namely, s = s(t). If t,, is fixed. then the average velocity over the time interval from to to t, t # to, is defined as
s(t) -
t-r
5.1
The Derivative
167
Figure 5.1
The limit of this quantity as t approaches to, again provided that the limit exists, is taken as the definition of the velocity of the object at time ta. Both of the previous examples involve identical limits; namely,
limf (x) - A p)
and
x-p
lira 1-.1,
s(t) - s(t°)
t - t,
These limits,. if they exist, are called the derivatives of the functions f and s at p and t respectively. The term derivative comes from the French fonction derivee.
5.1.1
DEFINITION Let I C R be an interval and let f be a real-valued function with domain I. For fixed p E 1, the derivative off at p. denoted f'(p), is defined to be
-f(p) Pp) = limf(x) x-,P x-p provided the limit exists. If f(p) is defined at a point p E 1, we say that f is differentiable at p. If the derivative f is defined at every point of a set E C 1, we say that f is differentiable on E.
If p is an interior point of I, then p + h E I for all h sufficiently small. If we set x = p + h, h # 0, then the definition of the derivative of f at p can be expressed as
f'(P) =
lt_mf(P
+ hh' - f(P)
provided the limit exists. This formulation of the derivative is sometimes easier to use.
In the definition of the derivative we do not exclude the possibility that p is an endpoint of I. If p E I is the left endpoint of 1, then P(P) = Rimp.
f(x) - f(p) =
x-p
ti!
f(p + h) - f(p) h
provided, of course, that the limit exists. The analogous formula also holds if p E I is the right endpoint of L In analogy with the right and left limit of a function, we also define the right and left derivative of a function.
168
Chapter5
5.1.2
Differentiation DEFINITION Let I C I be an interval and let f be a real-valued function with domain I. If p E I is such that I fl (p, oo) # 0, then the right derivative off at p, denoted f' (p), is defined as
f+(P) = lim h-4O
f(P + h) - f(P) h
provided the limit exists. Similarly, if p E I satisfies (-oo, p) fl I # 4,, then the left derivative off at p, denoted f'_(p), is given by
f'(P)=hli3t-
f(P + h) - f(P) h
provided the limit exists.
Remarks (a) If p E Int(/), then f'(p) exists if and only if both f"+(p) and f_(p) exist and are equal. On the other hand, if p E I is the left (right) endpoint of I, then f'(p) exists if and only if f+(p) (f_(p)) exists. In this case, f'(p) = f+ (P) (.f' (P)) The reader should note the distinction between f+(p) and f'(p+). The first denotes the right derivative off at p, whereas the latter is the right limit of the derivative; i.e.,
f'(P+) = lim f'(-). Here, of course, we are assuming that f' is defined for all x E (p, p + 8) for some
8>0.
(b) If f is a differentiable function on an interval 1, we will also occasionally use Leibniz's notation d dx
f(x),
"& ,
or
'*,
to denote the derivative of y = f(x). (c) If f is differentiable on an interval I, then the derivative f'(x) is itself a function on I. Therefore, we can consider the existence of the derivative of the function f' at a point p E I. If the function f' has a derivative at a point p E 1, we refer to this quantity as the second derivative off at p, which we denote f"(p). Thus
f"(P) =
hmf'(P + h) -f'(P) h
In a similar fashion we can define the third derivative off at p, denoted f'"(p) or f(')(p).
In general, for n E N, ft"t(p) denotes the nth derivative off at p. In order to discuss the existence of the nth derivative off at p, we require the existence of the (n - 1)st derivative off on an interval containing p.
The Derivative
5.1
5.1.3
169
EXAMPLES
(a) In the exercises (Exercise 2) you will be asked to prove that if f(x) = x", n E Z, then f'(x) = nx"- ' for all x E IB (x * 0 if n is negative). For the function f(x) = xz, the result is obtained as follows:
fi(x) =
,y9 (x +
z -
h
h) = 2x.
=
A similar computation shows that f"(x) = 2.
(b) Consider f(x) = N /x, x > 0. We first note that for h * 0,
f(x+h)-f(x)
-vrx h
=
( x+h-V)( x+h+V) h
x+h+Vx)
(
x+h+;7x Since h x -+h = ix, we have
f'(x)=h+
1
1
=
x + h + vx
2Vx
(c) Consider f(x) = sin x. From the identity
sin(x + h) = sin x cos h + cos x sin h, we obtain
sin(x + h) - sin x h
r cos
= sin x l
h-I
h
I+ cos x f
sin h h
By Example 4.1.10(d) and Exercise 5, Section 4.1, sin h lmi=l h
and
lim
cos h - 1 = 0.
Therefore,
f'(x).
sin(x + h) - sin x h
LIn
= sin x lim i
cos h - 11
= cos X.
+ cos x l
J
In Exercise 3 you will be asked to prove that
d (cos x) = -sin x.
[ sin h J
170
Chapters
Differentiation (d) Let f be defined by
x ? 0,
x
.f(x) = IxI =
-x, x<0.
Then
_
h
.f+(0) = lim
h
and
o h= 1,
h
ti
ii
01
= lim _h
Thus f (0) and f'_(0) both exist, but are unequal. Therefore f'(0) does not exist. (e) In this example let g(x) = x312 with Dom g = [0, oo). Then for p = 0, x3/2
8'(0) = 8+(0) =I-,Q limX- = Jim V = 0. .Ho Thus g is differentiable at 0 with g'(0) = 0. (f) Let f be defined by
x x#0, xsin, x
f(x) =
For x # 0, f'(x) _ -x cos X + sin I (Exercise 8). When x = 0,
f'(0) _ h m
h f(h)
- f0
=him sin h,
which by Example 4.1.5(a) does not exist. Therefore, f'(0) does not exist.
II
(g) Consider the following variation of (f). Let
g(x) =
x2 sin x 0,
,
x # 0,
x0.
This example is very important! In Exercise 9 you will be asked to show that g'(x) exists for all x E R with g'(0) = 0, but that the derivative g' is not continuous at 0.
When Cauchy gave the rigorous definition of the derivative, he assumed that the given function was continuous on its domain. As a consequence of the following theorem this requirement is not necessary.
5.1.4 THEOREM If 1 C R is an interval and f : I -+ R is differentiable at p E 1, then f is continuous at p.
Proof.
Fort # p,
f(t) -f(P) =
(f(t` _ P(P))(t
- P)
5.1
The Derivative
171
Since
limi(t) -f(p) '-+p t-p exists and equals f'(p), by Theorem 4.1.6(b),
lim(f(t) - f(p)) = lim _P r-+p
(f(t) - f(P)1Jlim(r - P) = Pp) 0 = 0.
t-p
r-+p
Therefore, lm f(t) = f(p) and thus f is continuous at p. In the above, if p is an endpoint, then the limits are either the right or left limit at p, whichever is appropriate.
Remark In both Examples 5.1.3(d) and (f), the given function is continuous at 0, but n o t d i ff e r e n t i a b l e a t 0. Given a f i n it e number of points, say p i, ... , pn, it is easy to construct a function f which is continuous but not differentiable at pI, .. . , p,,. For example, n
f(x)= k-I I Ix-Pk1 has the desired properties. In 1861, Weierstrass constructed a function f which is continuous at every point of 11 but nowhere differentiable. When published in 1874, this example astounded the mathematical community. Prior to this time mathematicians generally believed that continuous functions were differentiable (except perhaps at a finite number of points). In Example 8.5.3 we will consider the function of Weierstrass in detail.
Derivatives of Sums, Products, and Quotients We now derive the formulas for the derivative of sums, products, and quotients of functions. These rules were discovered by Leibniz in 1675.
5.1.5 THEOREM Suppose f, g are real-valued functions defined on an interval L 1f f and g are differentiable at x E 1, then f + g,fg, and fig (if g(x) # 0) are differentiable at x and
(a) (f + 8)'(x) = fl(X) + g'(x),
(b) (J)'(x) = f'(x)g(x) +f(x)g'(x) (c) ()'(x) = fl(x)8(x) -
f2x)g'(x)'
provided g(x) # 0.
(g(x))
Proof. The proof of (a) is left as an exercise (Exercise 4). For the proof of (b), by adding and subtracting the term f (x + h)g(x), we have for h * 0,
(fg)(x + h) - (fg)(x)
= f(x + h)(Ax
+ h) - g(x)
+ (f(x + h) - f(x)lAX) h
J
172
Chapters
Differentiation
By Theorem 5.1.4, since f is differentiable at r, i a f(x + h) = f(x). Thus since each of the limits exist, by Theorem 4.1.6,
(fg)'(x) = lim ti0
(.fg)(x + h) - Ug)(x) h
/
=ii mf(x+h)ii
mig(x+hh-g(x)
+\h)
- f(x)
+ g(x) him/f(x l
h
= f(x)g'(x) + g(x)f'(x). To prove (c), we first prove that (1/g)'(x) = -g'(x)/[g(x)]2, provided g(x) * 0. The result then follows by writing f/g as f (1/g) and applying the product formula (b). Suppose g(x) * 0. By continuity of g at x, there exists a S > 0 such that g(x + h) * 0 for all h, I h i < S. Thus for h sufficiently small and nonzero, 1
1
g(x + h)
g(x)
-
g(x + h) - g(x)'
h
1
) g(x)g(x + h)
h
Again, using the fact that lim g(x + h) = g(x), by Theorem 4.1.6, 1
1ll'
C-/ 8 (x)
1
g(x + h) __ lim h-0
g(x)
h
(g(x + h) - g(x)1
_ -lim 11-0 \
) lim n-o g(x)g(x + h)
h
-g'(x) = g2(x) ,
The Chain Rule The previous theorem allows us to compute the derivatives of sums, products, and quotients of differentiable functions. The chain rule, on the other hand, allows us to compute the derivative of a function obtained from the composition of two or more differentiable functions. Prior to stating and proving the result, we introduce some useful notation. Suppose f is differentiable at x E 1. For t E 1, t # x, set
Q(t) = f(t) - f(x) t - x
Then by Definition 5.1.1, Q(t) --+f(x) as tax. If we let u(t) = Q(t) - f'(x). then u(t) -- 0 as t -+ x. Therefore, if f is differentiable at x, fort * x,
f(t) - f(x) = (t - x)[f'(x) + u(t)] where u(t) -+0 as By setting u(x) = 0, the above identity is valid for all r E I.
(1)
5.1
5.1.6
The Derivative
173
THEOREM (Chain Rule) Suppose f is a real-valued function defined on an interval I and g is a real-valued function defined on some interval J such that Range f C J. If f is differentiable at x E I and g is differentiable at f(x), then h = g of is differentiable at x and
h'(x) = g'(f(x))f'(x) Proof. Let y = f(x). Then by equation (1),
f(t) - f(x) _ (t - x)[f'(x) + u(t)I.
(2)
g(s) - g(y) = (s - y)[g'(y) + v(s)],
(3)
where t E I, s E J, and u(t) -> 0 as t -> x and v(s) -+0 as s -+y. Let s = f (t). Since f is continuous at x, s --* y as t -> x. By identity (3) and then (2),
h(t) - h(x) = g(f(t)) - g(f(x)) [f(t) - f(x)I [g'(y) + v(s)] = (t - x)[f'(x) + u(t)][g'(v) + v(f(t))]. Therefore, for t * x,
h(t)- hx_ t-x
) = [f'(x) + u(t)N91(y) + v(f(t))).
Since v(f(t)) and u(t) both have limit 0 as t -+ x, lim
h(t) - h(x) =
r(X) g'(y) = g'(f(x))f'(x). O
t-x
To illustrate the previous theorem we consider the following examples.
5.1.7
EXAMPLES
(a) By Example 5.1.3(c) the function f (x) = sin x is differentiable on R. Hence if g :1 * R is differentiable on the interval 1, h(x) = If o g)(x) = sin g(x) is differentiable on I with
h'(x) = f'(g(x)) g'(x) = g'(x)cos g(x). In particular, if g(x) = 1/x2, Dom g = (0, oo), then by Theorem 5.1.5(c),
- 2x
g'(x) _ (x2)2 =
2 x3,
x E (0, oo).
Therefore,
d dx
2 -=-cossmx2 x2 .
1
1
2.
(b) By Exercise 2,
dx"=nx"-' forallnEfol.
Differentiation
Chapters
174
Thus if f : I -+ R is differentiable on the interval 1, then by the chain rule g(x) = [f(x) ]1.
n E N, is differentiable on I with g'(x) = n[f(x)]"-'f'(x). This formula can also be obtained from Theorem 5.1.5(b) using mathematical induction.
EXERCISES 5.1 1. Use the definition to find the derivative of each of the following functions.
*a. f(x)=x;, x E R
b. g(x) =
*c. h(x) = 1 X, x # 0
d. k(x) =
x+2, x> -2 x > -2
l '
*e. f (x)
x* -1
x+1
f. g(x) = xZ + 1' x E R
2. *Prove that for all integers n,
dx" = nx"-' (x * 0 if n is negative). 3. *a. Prove that
d (cos x) = -sin x. b. Find the derivative of tan x = sin x/cos x. 4. Prove Theorem 5.1.5(a). S. For each of the following, determine whether the given function is differentiable at the indicated point x°. Justify your answer!
*a. f(x) = xIxl,
at X. = 0
b.
x E 0'
f(x) = lo0, ,
*c. g(x) = (x - 2)[x], at x° = 2 e.
x
f()=
d. h(x) =
x00,
atx° = 0
x + 2, x E [ -2, oo), at x° _ -2
sin X, xEQ.
X. =0 x00. atx
x,
6. Let f(x) = lxI3. Compute f'(x), f"(x), and show that f"'(0) does not exist. 7. Determine where each of the following functions from R to R is differentiable and find the derivative.
*a. 1(x) = x(x]
b.g(x)=Ix-21+Ix+tI *c. h(x) = I sin x I
{x2[]. 0,
:::"
8. Use the product rule, quotient rule, and chain rule to find the derivative of each of the following functions.
a. f (z) = x sin
x*0
c. f(x)= x+1Y
b. f(x) = (cos (sin x) ), n, m E h!
d. f(x)=x°(2+sink), x * 0
5.1
The Derivative
175
9. Let g be defined by
g(x) =
x2 sin1, x0, x
a. Prove that g is differentiable at 0 and that g'(0) = 0. b, Show that g'(x) is not continuous at 0. 10. Let f be defined by f(x) = fx2 + 2, x s 2,
ax+b, x> 2.
a. For what values of a and b is f continuous at 2? b. For what values of a and b is f differentiable at 2? 11. Let f be defined by
x < -l, x3+1. -lsx:5 2, ax + b,
f(x) =
cx+d,
x> 2.
Determine the constants a, b, c, and d such that f is differentiable on R.
12. Assume there exists a function L : (0, oo) -+ R satisfying L'(x) = l/x for all x E (0, oo). Find the derivative of each of the following functions.
a. f(x) = L(2x + 1), x > -2
b.g(x)=L(x2), x#0 *c. h(x) = [L.(x)]', x > 0 d. k(x) = L(L(x)), x E {x > 0 : L(x) > 0} 13. For b real, let f be defined by
f(x) =
1x° sin 1-,
x > 0,
0,
x50.
x
Prove the following:
a. f is continuous at 0 if and only if b > 0. b. f is differentiable at 0 if and only if b > I. c. f is continuous at 0 if and only if b > 2. mfx
14. a. If f is differentiable at x, prove that li
,+h- fx, - h )
b. If Ii f (x
+h)-f(xo-h) 2h
=fI M
exists, is f differentiable at x0?
15. If f : (a, b) -+ R is differentiable at p E (a, b), prove that f'(p) = lim n[f(p + ,l,) - f(p)]. Show by example that the existence of the limit of the sequence {n[ f(p + f(p)j) does not imply the existence of f'(p). 16. Leibniz's Rule: Suppose f and g have nth order derivatives on (a, b). Prove that (nk) f (k)(X)e - kkX).
(fg)t11(x) _ 4-0
176
Chapter5
Differentiation
5.21 The Mean Value Theorem In this section we will prove the mean value theorem and give several consequences of this important result. Even though the proof itself is elementary, the theorem is one of the most useful results of analysis. Its importance is based on the fact that it allows us to relate the values of a function to values of its derivative. We begin the section with a discussion of local maxima and minima.
Local Maxima and Minima 5.2.1
DEFINITION Suppose E C R and f is a real-valued function with domain E. The function f has a local maximum at a point p E E if there exists a 8 > 0 such that f (x) s f(p)for all x E E fl Na(p)- The function f has an absolute maximum at p E E iff(x) 5 f(p) for all x E E.
Similarly, f has a local minimum at a point q E E if there exists a 8 > 0 such that
f(x) ? f(q) for all x E E fl %(q) and f has an absolute minimum at q E E if f (x) ? f (q) for all x E E.
Remark. As a consequence of Corollary 4.2.9. every continuous real-valued function defined on a compact subset K of I has an absolute maximum and minimum on K.
The function f, illustrated in Figure 5.2, has a local maximum at a, p,, and p, and a local minimum at and b. The points (p4,f(p4)) and (p,.f(p,)) are absolute maxima and absolute minima, respectively.
Figure 5.2
5.2
The Mean Value Theorem
177
The following theorem gives the relationship between local maxima or minima of a function defined on an interval and the values of its derivative.
5.2.2
THEOREM Let fbe a real-valued function defined on an interval 1, and supposef has either a local minimum or local maximum at p E Int(l). 1f f is differentiable at p, then
f(P) = 0. Proof. If f is differentiable at p E Int(1), then f'- (p) and f; (p) both exist and are equal. Suppose f has a local maximum at p. Then there exists a S > 0 such that f (t) f (p) for all t E I with I t - p I < S. In particular, if p < t < p + S, t E 1, then
f(t) - f(p) s 0. t-P Thus f+(P)
0. Similarly, if p - S < t < p,
f(t) - f(P)
t-p
0,
and therefore f'_(p)' 0. Finally, since f+ (p) = f'_ (p) = f'(p), we have f(p) = 0. The proof of the case wheref has a local minimum at p is similar. O As a consequence of the previous theorem we have the following corollary.
5.2.3 COROLLARY Lei f be a continuous real-valued function on [a, b]. 1f f has a local maximum or minimum at p E (a, b), then either the derivative off at p does not exist,
or f(p) = 0. Remark. The conclusion of Theorem 5.2.2 is not valid if p E I is an endpoint of the interval. For example, if f :[a, b] -- R has a local maximum at a, and if f is differentiole at a, then we can only conclude that f'(n) = f+ (a) 5 0. This is illustrated in the following examples.
5.2.4
EXAMPLES
(a) The function
f(x)= x- lZ , 05x2, has a local maximum at p = 0 and p = 2, and an absolute minimum at q = ;. By com-
putation, we have f'(0) _ -1, f' (2) = 3, and f (2) = 0. The graph of f is given in Figure 5.3.
(b) The function f (x) _ x 1, x E [ -1, 11, has an absolute minimum at p = 0. However, by Example 5.1.3(d) the derivative does not exist at p = 0.
Rolle's Theorem Prior to stating and proving the mean value theorem, we first state and prove the following theorem credited to Michel Rolle (1652-1719).
178
Chapter 5
Differentiation
24J 21
Il
4
U
Figure 5.3
5.2.5
Graph of f(x) _ (x - 1)2, 0 5 x 5 2
THEOREM (Rolle's Theorem) Suppose f is a continuous real-valued function on
[a, b] with f(a) = f(b), and that f is differentiable on (a, b). Then there exists c E (a, b) such that f (c) = 0. Since the derivative off at c gives the slope of the tangent line at (c, f (c)), a geometric interpretation of Rolle's theorem is that if f satisfies the hypothesis of the theorem, then there exists at least one value of c E (a, b) for which the tangent line to the graph off is horizontal. For the function f depicted in Figure 5.4, there are exactly two such points.
Proof. If f is constant on [a, b], then f'(x) = 0 for all x E [a, b]. Thus, we assume that f is not constant. Since the closed interval [a, b] is compact, by Corollary 4.2.9,f has a maximum and a minimum on [a. b]. If f(t) > f(a) for some t, then f has a maximum at some c E (a, b). Thus by Theorem 5.2.2, f'(c) = 0. If f(t) < f(a) for some t, then f has a minimum at some c E (a, b), and thus again f'(c) = 0.
Remarks (a) Continuity off on [a, b] is required in the proof of Rolle's theorem. The function
Ix, 05x< 1,
f(x)= 0, x=1
is differentiable on (0, 1) and satisfies f(0) = f(1) = 0; yet f' (x) * 0 for all x E (0, 1). The function f fails to be continuous at 1. (b) For Rolle's theorem, differentiability of f at a and b is not required. For example,
the function f(x) = - xZ, x e [-2, 2], satisfies the hypothesis of Rolle's theorem, yet the derivative does not exist at -2 and 2. For x E (-2, 2), fi(x) _
V4
- X2
and the conclusion of Rolle's theorem is satisfied with c = 0.
5.2 The Mean Value Theorem
Figure 5.4
179
Rolle's Theorem
The Mean Value Theorem As a consequence of Rolle's theorem we obtain the mean value theorem. This result is usually attributed to Joseph Lagrange (1736-1813).
5.2.6
THEOREM (Mean Value Theorem) If f : [a, b] -+ R is continuous on [a, b] and differentiable on (a, b), then there exists c E (a, b) such that
f(b) - f(a) =f(c)(b - a). Graphically, the mean value theorem states that there exists at least one point c E (a, b) such that the slope of the tangent line to the graph of the function f is equal to the slope of the straight line passing through (a, f (a)) and (b, f (b)). For the function of Figure 5.5, there are two such values of c, namely c, and c2.
Proof. Consider the function g defined on [a. b] by
g(x) = f(x) - f(a) -
{f(b)b
- a(a),(x - a).
Then g is continuous on [a, b], differentiable on (a, b), with g(a) = g(b). Thus by Rolle's theorem there exists c E (a, b) such that g'(c) = 0. But
g'(x) =f'(x) -
f(b) - f(a)
for all x E (a, b). Taking x = c gives f(c) = now follows.
b - a
f (b)
- a(a), from which the conclusion
180
Chapters
Differentiation
Figure 5.5
Mean Value Theorem
The mean value theorem is one of the fundamental results of differential calculus. Its importance lies in the fact that,it enables us to obtain information about a function f from its derivative f'. In Example 5.2.7 we will illustrate how the mean value theorem can be used to derive inequalities. Other applications will be given later in this section and in the exercises. It will also be used in many other instances in the text.
5.2.7
EXAMPLE In this example we illustrate how the mean value theorem may be used in proving elementary inequalities. We will use it to prove that x 1 + x
s ln(1 + x) < x for all x > - 1,
where In x denotes the natural logarithm function on (0, oo). This function is defined and considered in detail in Example 6.3.5 of the next chapter. There it is proved that the
derivative of In x is 1/x. Let f(x) = ln(1 + x), x E (-1, oo). Then f(0) = 0. If x > 0, then by the mean value theorem, there exists c e (0, x) such that In(1 + x) = f(x) - f(0) = f(c)x.
But f'(c) _ (1 + c)-' and (I + x)-' < (1 + c)-t < 1 for all c E (0, x). Therefore, x 1
+x
and as a consequence,
1
x +x`ln(1 +x)<x for all xz0.
5.2 The Mean Value Theorem
181
Now suppose -1 < x < 0. Then again by the mean value theorem there exists c E (x. 0) such that ln(1 + x) = f(x) - f(0) = 1 + c,
But since x < c < 0, 1 < (1 + c)-' < (1 + x)-', and since x is negative 1 + x
< ln(1 + x) < .r.
Hence the desired inequality holds for all x > -1, with equality if and only if x = 0.
U The following theorem, attributed to Cauchy, is a useful generalization of the mean value theorem.
5.2.8
THEOREM (Cauchy Mean Value Theorem) If f, g are continuous real-valued functions on [a, b] that are differentiable on (a, b), then there exists c E (a, b) such that [f(b) - f(a)]g'(c) _ [g(b) - 8(a)] .`'(c)
. Proof.
Let
h(x) = [f(b) -f(a)]g(x) - [8(b) - g(a)]f(x). Then h is continuous on [a, b], differentiable on (a, b) with h(a) = f(b)g(a) - f(a)g(b) = h(b).
Thus by Rolle's theorem, there exists c E (a, b) such that h'(c) = 0, which gives the
result. U The geometric interpretation of the Cauchy mean value theorem is very similar to that of the mean value theorem. If g'(x) * 0 for all'x E (a, b), then g(a) 0 g(b) and the conclusion of Theorem 5.2.8 can be written as
f(b) - f(a) _ f (c) g(b) - g(a) guppose.x = g(t), y = f(t), a s t s b, is a parametric representation of a curve C in the plane. As t moves along the interval [a, b], the point (x, y) moves along C from the
point P = (g(a),f(a)) to Q = (&)J (b)). The slope of the line joining P to Q is given
by [f(b) - f(a)]/[g(b) - g(a)] (see Figure 5.6). On the other hand, the quantity f'(t)/g'(t) is. the slope of the. curve C at the point (g(r), f(t)). Thus one meaning of Theorem:5.2.8 is that there must be a point on the curve C where the slope of the curve is the same as the slope of the line joining P to Q.
182
Chapters
Differentiation
Q=(g(b). f(b))
P=(g(a), f(a))
Figure 5.6
Applications of the Mean Value Theorem We now give several consequences of the mean value theorem. Additional applications are also given in the exercises. In the following, I will denote an arbitrary interval in R.
5.2.9 THEOREM Suppose f : 1--+ R is differentiable on the interval L (a) If f'(x) ? O for all x E I, then f is monotone increasing on 1. (b) If f (x) > O for all x E I, then f is strictly increasing on I. (c) If f'(x) 5 O for all x E 1, then f is monotone decreasing on L (d) If f'(x) < O for all x E 1, then f is strictly decreasing on I. (e) If f'(x) = O for all x E I, then f is constant on I.
Proof.
Suppose x1, x2 E I with x, < x2. By the mean value theorem applied to f on
[x1, x2].
f(x2) -f(xl) =f'(C)(x2 - xl) for some c E (x1, x2). If f(c) ? 0, then f(x2) ? f(x1). Thus, if f'(x) a 0 for all x E 1, we have f(x2) ? f(xl) for all xj, x2 E I with xi < x2. Thus f is monotone increasing on I. The other results follow similarly. O
Remark It needs to be emphasized that if the derivative of a function f is positive at a point c, then this does not imply that f is increasing on an interval containing c. The
function f of Exercise 18 satisfies f'(0) = 1, but f'(x) assumes both negative and positive values in every neighborhood of 0. Thus f is not monotone on any interval containing 0. If f'(c) > 0, the only conclusion that can be reached is that there exists
a 8 > 0 such that f(x) < f(c) for all x E (c - S, c) and f(x) > f(c) for all x E (c, c + 8) (Exercise 15). This, however, does not mean that f is increasing on
(c - 8, c + 8). However, if f'(c) > 0 and f' is continuous at c, then there exists a 8 > 0 such that f'(x) > 0 for all x E (c - 8, c + 8). Thus f is increasing on
(c-8,c+ 8).
5.2
The Mean Value Theorem
183
Theorem 5.2.9 is often used to determine maxima and minima of functions as follows: Suppose f is a real-valued continuous function on (a, b), and c E (a, b) is such that f'(c) = 0 or f(c) does not exist. Suppose f is differentiable on (a, c) and (c, b). If f'(x) < 0 for all x E (a, c) and f'(x) > 0 for all x E (c, b), then by Theorem 5.2.9. f is decreasing on (a, c) and increasing on (c, b). As a consequence, one concludes that f has a local minimum at c. This method is usually referred to as the first derivative test for local maxima or minima. The natural inclination is to think that the converse is also true; namely, if f has a local minimum at c, then f is decreasing to the left of c and increasing to the right of c. As the following example shows, however, this is false!
5.2.10
EXAMPLE
Let f be defined by
f(x) = {x4(2
x 0,
,
x = 0.
The function f has an absolute minimum at x = 0; however, f'(x) has both negative and positive values in every neighborhood of 0. The details are left as an exercise (Exercise 19). The graph of f'(x) = 4x3(2 + sin 1/x) - x2 cos l/x, x * 0, for x in a neighborhood of zero is given in Figure 5.7.
Figure 5.7
Graph of f'(x) = 4x3(2 + sin j)
- x2 cos , x * 0
The following theorem, besides being useful in computing right or left derivatives at a point, also states that the derivative (if it exists everywhere on an interval) can only have discontinuities of the second kind.
5.2.11
THEOREM Suppose f :[a, b) -+ R is continuous on [a, b) and differentiable on (a, b). If lim f'(x) exists, then f+ (a) exists and x-+a
f, (a) = 1 m, f'(x). Xa
184
Chapter5
Differentiation
Proof. Let L = lim' f'(x), which is assumed to exist. Given e > 0, there exists a x-ra S > 0 such that
If'(x)-LI <e for all x, a < x < a + S. Suppose 0 < h < 8 is such that a + h < b. Since f is continuous on [a, a + h] and differentiable on (a, a + h), by the mean value theorem f(a + h) - f(a) = f'(C,,)h for some Ch E (a, a + h). Therefore,
f(a + h) - f(a) _ LI h
= If'(Sh) - LI < e
for all h, 0 < h < S. Thus f; (a) = L. Q 5.2.12
EXAMPLES
(a) To illustrate the previous theorem, consider the function
f(x) ° For x < 1, f'(x)
Jx2 + 1, x < 1,
3-x, x> 1.
2x, which has a left limit of 2 at x = I. Thus by the theorem,
f'_(1) = lim 2x = 2. Similarly,
f+'(1) = lim (-2x) = -2. (b) The converse of Theorem 5.2.11 is false. The function Ix2 sin 1
$(x) =
0,
x
x # 0, x = 0,
of Example 5.1.3(g) has the property that g'(0) exists but lidg'(x) does not.
Intermediate Value Theorem for Derivatives Our second important result of this section, credited to Jean Gaston Darboux (18421917), is the intermediate value theorem for derivatives. The remarkable aspect of this theorem is that the hypothesis does not require continuity of the derivative. If the derivative were. continuous, then the result would follow from Theorem 4.2.11 applied to f
5.2.13
THEOREM (Intermediate Value Theorem for Derivatives) Suppose I C R is an interval and f : I - P is differentiable on I. Then given a, b in I with a < b and a real number A between [(a) and f'(b), there exists c E (a, b) such that f(c) = A.
Proof, Define g by g(x) = f(x) - Ax. Then g is differentiable on I with g'(x) _
f'(x) - A.
5.2 The Mean Value Theorem
185
Suppose f'(a) < A < f'(b). Then g'(a) < 0 and g'(b) > 0. As in the remark following Theorem 5.2.9. since g'(a) < 0, there exists an x, > a such that g(.r,) < g(a)-
Also, since g'(b) > 0, there exists an x, < b such that g(x.) < g(b). As a consequence, g has an absolute minimum at some point c E (a, b). But then
g'(c) = f'(c) - A = 0,
i.e., f'(c) = A. Q The previous theorem is often used in calculus to determine where a function is increasing or decreasing. Suppose it has been determined that the derivative f is zero at c, and c2 with c, < c2, and that f'(x) * 0 for all x E (c,, c2). Then by the previous theorem, it suffices to check the sign of the derivative at a single point in the interval (cr, c2) to determine whether f is positive or negative on the whole interval (c c,). Theorem 5.2.9 then allows us to determine whether f is increasing or decreasing on (cj, c2).
Inverse Function Theorem We conclude this section with the following version of the inverse function theorem.
5.2.14 THEOREM (Inverse Function Theorem) Suppose ! C R is an interval and f : I -+ R is differentiable on I with f'(x) * O for all x E I. Then f is one-to-one on I, the inverse
function f` is continuous and differentiable on J = f(!) with 1
(f-')'(f(x)) = f'(x) for all x E 1.
Proof. Since f'(x) * 0 for all x E 1, by Theorem 5.2.13, f is either positive or negative on 1. Assume that f'(x) > 0 for all x E I. Then by Theorem 5.2.9,f is strictly increasing on I and by Theorem 4.4.12, f -' is continuous on J = f(I). It remains to be shown that f -' is differentiable on J. Let y, E J, and let {y.) be any sequence in J with yn y0, and y 0 y for all n. For each n, there exists x E 1 such that y,,. Since f'' is continuous, x -+x0 = fHence
f1'
xn - x
f - `Cy0)
Y. - y0
- - oof(xx) - f(x0)
=f (xo)
Since this holds for any sequence definition of the derivative,
with y, -r y,,, y * y,,, by Theorem 4.1.3 and the
(f TO = rl(xo)' v
186
Chapter 5
Differentiation
Remark, The hypothesis that f'(x) # 0 for all x E I is crucial. For example, the function f(x) = x3 is strictly increasing on [ -1, 1 ] with f'(0) = 0. The inverse func. tion f -'(y) = y'13, however, is not differentiable at y = 0.
5.2.15
EXAMPLES
(a) As an application of the previous theorem, we show that f (x) = x'1", x E (0, oo), n E N, is differentiable on (0, oo) with n
for all x E (0, oo). Consider the function g(x) = x", n E N, Dom g = (0, oo). Then g'(x) = nx"-' and g'(x) > 0 for all x E (0, oo). By the previous theorem, g-' is differentiable on J = g((0, oo)) _ (0, oo) with
(g-')'(g(x)) =
g'(x)
=
1-1
If we set y = g(x) = x", then x = y"" and
(g-')'(y) = n(y )"-1 = n
yI/"-t.
Since f = g' the desired result follows. (b) As in Example 5.2.7, let L(x) = In x denote the natural logarithm function on (0, co). Since L'(x) = l/x is strictly positive on (0, oo), the function L is one-to-one, the inverse function L-' is continuous on Q8 = Range L, and by Theorem 5.2.14,
If we set E = L', then E'(L(x)) = x, or E'(y) = E(y) where y = L(x). The function E(x), x e 08, is called the natural exponential function on } and is usually denoted by e', where e is Euler's number of Example 2.3.5. The exponential function E(x) is considered in greater detail in Example 8.7.20.
(c) In this example we consider the inverse function of g(x) = cos x, x E [0, ir]. Since g'(x) = -sin x is strictly negative for x E (0, ir), the function g is strictly decreasing on [0, a] with g([0, a]) _ [- I, 1 ]. Therefore its inverse function g- 1, which we denote by Arccos, exists on [ -1, 1 ]. Thus for y E [ -1, 1 ], x = Arccos y if and only if y = cos x. Finally, since g'(x) 0 for x E (0, ir), by the inverse function theorem,
(8-,)'(g(x)) = g'(x)
-1 -sinx = N/l
z
'
or since y = cos x,
-l dy
Arccos y =
The graphs of both cos x, x E [0, ir], and Arccos x, x E [ -1, 13, are given in Figure 5.8.
5.2 The Mean Value Theorem
Figure 5.8
187
Graphs of cos x, x E [0, ar], and Arccos x, x E [-1, 11
EXERCISES 5.2 1. For each of the following functions, determine the interval(s) where the function is increasing or decreasing, and find all local maxima and minima.
*a f(x)=x3+Gx-5, xER
b.g(x)=4x-x°, xER
c. h(x) = 1+x2x2, x e R
d. k(x) _ V-
e.l(x)=x+7, x#0 2. Let f (x) _
2
x,
xz0
f f(x)x-b, a*b,x*b
(x - a,)2, where a,, a2, ... , a are constants. Find the value of x where f is a minimum.
3. As in Example 5.2.7, use the mean value theorem to establish each of the following inequalities. a.
1 +xs1+Ix, x> -I
b.exZI+x, xER
C., (I +x)a? I + ax, x> -1,a> I 1. For a E N, this inequality was proved by mathematical induction in Example 1.3.3(b). In this exercise, and in Exercise 4(b), you may assume that for a E R.
d x° = ax°-
188
Differentiation
Chapter 5
4. Prove each of the following inequalities.
a.all. -b""<(a-b)'/", a>b>0,nEE N,na: 2 *b.a°b'-°:S aa+(1 -a)b, a,b>0,0
*a. If f"(c) > 0, prove that f has a local minimum at c. b. If f"(c) < 0, prove that f has a local maximum at c. c. Show by examples that no conclusion can be made if f"(c) = 0. 6. Suppose f : (a, b) -> R satisfies If(x) - f (y)I <- Mix - yI" for some a > I and all x, y E (a, b). Prove that f is a constant function on (a, b). 7. 17ind a polynomial P(x) of degree less than or equal to 2 with P(2) = 0 such that the function
x s 1. x > 1.
x2,
f(x}
P(x),
is differentiable at x = 1. 8. Let g be defined by
g(x)- f2sinx+cos2x, xs0, axe+bx+c, x>0. Determine the constants a, b, and c such that g'(0) and g"(0) exist.
9. a. Suppose f is differentiable on an interval I. Prove that f is bounded on I if and only if there exists a constant
M such that If(x) - f(y)I s MIx - yI for all x, y E I. b. Prove that I sin x - sin y I < I r - y l for all x, y E R.
c. Prove that I N/x - V I c 2'-- Ix - yI for all x, y E (a. oo), a > 0. 10. a. Show that tan x > x for x E (0, ). b. Set
f(x) -
sinx x 1,
x E (0,;
x=0.
Show that f is strictly decreasing on [0, i ]. c. Using the result of pan (b), prove that x < sin x <- x for all x E [0, F].
11. Give an example of a uniformly continuous function on [0, 1 ] that is differentiable on (0, 1) but for which f is not bounded on (0, 1).
12. ea Suppose f'(x) exists for all x E (a. b). Let c E (a. b). Show that there exists a sequence {x"} in (a, b) with x" * c and x" -+ c such that f'(x") - +f'(c). b. Does f'(x,) -+f'(c) for every sequence {x"} with x" -* c? 13. Let f, g : [0, oo) - R be continuous on (0, oo) and differentiable on (0, oo). If f(0) = g(0) and f'(x) a g'(x) for all x e (0, oo), prove that f(x) z g(x) for all x E (0, oo). .
14. A differentiable function f : [a, b] - R is uniformly differentiable on [a. b] if for every E > 0 there exists a S > 0 such that
f(t) - f(x)
t-x
<E
5.2 The Mean Value Theorem
189
for all r, x E (a, b] with 0 < It - xl < S. Show that f is uniformly differentiable on (a. b] if and only if f is continuous on [a, b]. 15. *Suppose f : [a, b] -> R with f. (a) > 0. Prove that there exists a S > 0 such that f (x) > f(a) for all
x, a<x
16. Prove that the equation x3 - 3x + b = 0 has at most one root in the interval [ -1. 1 ]. M. 'Suppose gas differentiable on (a. b) with I g'(x) I s M for all x E (a. b). Prove that there exists an e > 0 such that the function f(x) = x + eg(x) is one-to-one on (a, b). 18. Let
I x+2x2 sin
f(x)
X,
x#0,
x=0.. 0, a. Show that f'(0) = 1.b. Prove that f'(x) assumes both positive and negative values in every neighborhood of 0.
19. Let f be defined by .
f(x) =
x'(2r.,+ all) X :A 0, ..
x=0.
0,
a. Show that f has an absolute minimum at x = 0. b. Show that f'(x) assumes both negative and positive values in every neighborhood of 0.
20. Let f(x)=x2,g(x)=x3,xE[-1,l]. a. Find c E (-1, 1) such that the conclusion of Theorem 5.2.8 holds. b. Show that there does not exist any c E (-1, 1) for which
Al) -f(-1) f(c) g(1) - g(-1) g'(c)' 21. For r E 0 and x > 0, let f(x) = x'. Prove that f'(x) = rx'-'. 22. Suppose L : (0, oo)
R is a differentiable function satisfying L'(x) = 1/x with L(1) = 0. Prove each of the fol-
lowing.
a. L(ab) = L(a) + L(b) for all a, b E (0, oo)
b, L(I/b) = -L(b), b > 0 c. L(b') = rL(b), b > 0, r E R d. L(e) = 1, where e is Euler's number of Example 2.3.5
e. Range L = R 23. Let g(x) - tan x, -f < x < . a. Show that g is one-to-one on (-f, i) with Range g = R. 'b. Let Arctan x, x E R, denote the inverse function of g. Use Theorem 5.2.14 to prove that
d
An:tan x
+ x2 .
24. a. , Show that f(x) = sin x is one-to-one on [ -i, f] with f([ - z, ]) _ [ - I,.1 J. z
b. For x E (- I, 1]. let Arcsin x denote the inverse function off. Show that Arcsin x is differentiable on (-1, 1). and find the derivative of Arcsin x.
190
Chapter 5
Differentiation
25. Let f : (0, oo) -> R be differentiable on (0, oo) and suppose that lim f'(x) = L. f (x + h f(x) a. Show that for any h > 0, lim = L. h
b. Show that lim f
5.3
-
x
)) = L.
L'Hospital's Rule As another application of the mean value theorem, we now prove ('Hospital's rule for
evaluating limits. Although the theorem is named after the Marquis de l'Hospital (1661-1704), it should be called Bernoulli's rule. The story is that in 1691, l'Hospital asked Johann Bernoulli (1667-1748) to provide, for a fee, lectures on the new subject of calculus. L'Hospital subsequently incorporated these lectures into the first calculus text, L'Analyse des infiniment petis (Analysis of infinitely small quantities), published in 1696. The initial version (stated without the use of limits) of what is now known as l'Hospital's rule first appeared in this text.
Infinite Limits Since l'Hospital's rule allows for infinite limits, we provide the following definitions.
5.3.1
DEFINITION Let f be a real-valued function defined on a subset E of R and let p be a limit point of E. We say that f tends to oo, or diverges to oo, as x approaches p. denoted
Jim f (x) = 00, X-+p
if for every M E R, there exists S > 0 such that
f(x) > M for all x E E with 0 < Ix - pI < S. Similarly,
lim f(x) _ -00, if for every M E R, there exists a S > 0 such that
f(x) < M for all x E E with 0 < Ix - pI < S. For f defined on an appropriate subset E of P. it is also possible to define each of the following limits:
lint, f (x) =too,
X+p
lim f (x) =too,
X-+p
Jim f (x) =too,
X- 00
Jim f (x) =too.
XH-x
Since these definitions are similar to Definitions 4.1.11 and 4.4.1 they are left to the exercises (Exercise 1).
5.3
!Hospital's Rule
191
Remark. Since we now allow the possibility of a function having infinite limits, it needs to be emphasized that when we say that a function f has a limit at p e I3 (or at ± oo), we mean a finite limit.
L'Hospital's Rule L'Hospital's rule is useful for evaluating limits of the form gx(x)
lim
where either (a) lim f(x) = lim g(x) = 0 or (b) f and g tend to ± oo as x -+p. If (a) holds, then 1 m W 419W) is usually referred to as indeterminate of form 0/0, whereas in (b) the limit is referred to as indeterminate of form oo/oo. The reason that (a) and (b) are indeterminate is that previous methods may no longer apply. In (a), if either lim f (x) or lim g(x) is nonzero, then previous methods discussed in x-ip
Section 4.1 apply. For example, if both f and g have limits at p and lim g(x) * 0, then p by Theorem 4.1.6(c),
f(x) lim -_ x-*p 8(x)
lim f(x) lim g(x)
On the other hand, if lim f (x) = A * 0 and g(x) > 0 with lim g(x) = 0, then as X-P x-ip, f(x)/g(x) tends to `Z oo if A > 0, and to -oo if A < 0 (Exercise 5). However, if lim f(x) = lim g(x) = 0, then unless the quotient f(x)/g(x) can somehow be simplified, previous methods may no longer be applicable.
5.3.2
THEOREM (L'Hospital's Rule) Suppose f, g are real-valued differentiable functions
on (a, b), with g'(x) # O for all x E (a, b), where -oo lim
f,x)
x-.a g 'W
a < b s oo. Suppose
= L, where L E R U {-oo, oo).
if
(a) lim f(x) = lim g(x) = 0, or x-sa* (b) lint g(x) = ±oo, then lim
f ((x()
x-.a' g(x)
Remark. The analogous result where x
= L.
b- is obviously also true. A more elementary version of 1'Hospital's rule, which relies only on the definition of the derivative, is
192
ChaprerS
Differentiation
given in Exercise 2. Also, Exercise 7 provides examples of two functions f and g satisfying (a) for which lim (f(x)/g(x)) exists but lim (f'(x)/g'(x)) does not exist. x-a x-a
Proof. (a) Suppose (a) holds. We first prove the case where a is finite. Let
be a
sequence in (a, b) with x -+a and x * a for all n. Since we want to apply the generalized mean value theorem to f and g on the interval [a, x,), we need both f and g continuous at a. This is accomplished by setting f(a) = g(a) = 0.
Then by hypothesis (a), f and g are continuous at a. Thus by the generalized mean value theorem, for each n E NI there exists c between a and /x such that p
[f(xa) - J
g(a))f (cn),
or f(xn)
_ f'(Ca)
g(xa)
g'(Cn)
Note, since g'(x) # 0 for all x E (a, b), g(x,) # g(a) for all n. As n --I- oc, c -> a'. Thus by Theorem 4.1.3 and the hypothesis,
'_°° AX-) =
l-
f' (x)
= L.
m g'(x) -
with x tea', the result follows. Suppose a = -oo. To handle this case, we make the substitution x = -1/t. Then as t -> 0+, x -> -oo. Define the functions (p(t) and *(t) on (0, c) for some c > 0 by Since the above holds for every sequence
ap(t) = f (- )
and
*(t) = g(- ! ).
We leave it as an exercise (Exercise 3) to verify that t-0 +G r)
x
lim
g(X)L,
and that
1m P(t) = lim iy(t) = 0. Thus by the above, t
xli.m- g(x) = 1-'0
00)
= L.
(b) Suppose I m, g(x) = oo. The case in which g(x) -+ -oo is treated similarly. Rather than treating the finite case and infinite case separately, we provide a proof that works for both.
5.3
CHospital's Rule
193
Suppose first that -oo s L < oo, and /3 E R satisfies /3 > L. Choose r such that
L < r < /3. Since lim f, (x)
r-.a g,(x)
< r,
there exists c, E (a, b) such that
r for all C, a < < c1.
g'(C)
Fix a y, a < y < c1. Since g(x) -* oo as x -+a+, there exists a c2, a < c2 < y, such that g(x) > g(y) and g(x) > 0 for all x, a < x < c2. Let x E (a, c2) be arbitrary. Then by the generalized mean value theorem, there exists E (x, y) such that
f(x) -AY) = f'(C) < r. g(x) - g(Y)
(v)
g'(C)
Multiplying inequality (4) by (g(x) - g(y))/g(x), which is positive, we obtain
f(x) - f(Y) < g(x)
r( l--
g(Y)1 g(x)
or
g(x)
<
g()
+ rl l -
(5) g(x
for all x, a < x < c2. Now for fixed y, since g(x) -+ oo, xm
g-) =
hm.
= 0. 8X)
Therefore,
1'm_IgX)+rl I L<
Thus there exists c3, a < c3
--ii =r3.
c2, such that
/
- +r(l for all x, a < x < c3. Thus by inequality (5),
f(x) x AX)
< /3 for all x, a < x < c3.
(6)
If L = -oo, then for any /3 E Q8, there exists c3 such that inequality (6) holds for all x, a < x < c3. Thus by definition,
f(x) 'tea' g(x )
-oo.
194
Chapter5
Differentiation
If L is finite, then given e > 0, by taking /3 = L + e, there exists c3 such that gXx))
x
for all x, a < x < c3.
(7)
Suppose -oo < L <_ oo. Let a E R, a < L be arbitrary. Then an argument similar to the above gives the existence of c3 (=- (a, b) such that
f(x) > a for all x, a
<x
.
g(X)
If L = oo, then the above implies that limf(x)
= oo.
,/
x-+a' g(x)
On the other hand, if L is finite, taking a = L - e gives the existence of c3 such that f(x)
x 8()
>L-e forallx , a<x
Combining this with inequality (7) proves that lim_
f(x)
x-*a 8(x)
= L. Q
Remarks (a) The proof of case (a) could have been done similarly to that of (b), treating the case where a is finite and -oo simultaneously. I chose not to do so since making the substi-
tution x = -I It is a useful technique, reducing problems involving limits at -oo to right limits at 0. Conversely, limits at 0 can be transformed to limits at too with the substitution x = 1/t. These new limits are in many instances easier to evaluate than the original. This is illustrated in Example 5.3.4(c).
(b) In hypothesis (b), we only required that lim g(x) = too. If lira f (x) is finite, then x-,a' x-a it immediately follows that f (X) lint-=0,
x+a 8(x)
and l'Hospital's rule is not required (Exercise 4). Thus in practice, hypothesis (b) of 1' Hospital's rule is used only if both f and g have infinite limits.
For convenience we stated and proved l'Hospital's rule in terms of right limits. Since the analogous results for left limits are also true, combining the two results gives the following corollary.
5.3.3
COROLLARY (L'Hospital's Rule)
Suppose f, g are real-valued differentiable functions
on (a, p) U (p, b) with g'(x) * Oforall x E (a, p) U (p, b), where -oo Suppose
lim' (x) = L, where L E R U {-oo, oo}. x-ip g'(x)
a < b < oo.
5.3
L'Hospital's Rule
195
If
f(x) = lim g(x) = 0, or (a) limf(x) (b) lim g(x)
00,
then
f(x)
limg(x) = L.
5.3.4
EXAMPLES
(a) Consider lira x-.0
ln(1+x X
where In is the natural logarithm function on (0, oo). This limit is indeterminate of form
0/0. With f(x) = In(1 + x) and g(x) = x,
f'x x
.O g'(x)_
10
1+x=1.
Thus by 1'Hospital's rule,
ln(1 + x)
lira A
X
= 1.
Although l'Hospital's rule provides an easy method for evaluating this limit, the result can also be obtained by using previous techniques. In Example 5.2.7 we proved that +xsln(1+x)5x
forallx> -1. Thus 1
:5
1 +x
ln(1+x) X
for all x > 0. Thus by Theorem 4.1.9,
ln(1 + x) x
11>o
-
1.
(b) In this example we consider 1 - cos x
O
xz
This is indeterminate of form 0/0. If we apply l'Hospital's rule we obtain 1
stn x 2x
196
Differentiation
Chapter5
which is again indeterminate of form 0/0. However, applying ('Hospital's rule one more time gives lim
x-O
cosx 2
I
=
2
Therefore,
lim
1-cosx
xti0
I
2.
x2
(e) Consider e-six
lim
x-.0-
X
Since lim a-11x = 0, the above limit is indeterminate of form 0/0. If we apply I'Hospix0' tal's rule, we obtain
0X e- tix
and this limit is more complicated than the original limit. However, if we let t = 1/x, then
e-11X
t
-,0 X = lim e
.
This limit is indeterminate of form oo/oo. By l'Hospital's rule, lim
t -= lim -=0. ,tea e' 1
roc er
Therefore, lim a-llx/x = 0.
EXERCISES 5.3 1. Provide definitions for each of the following limits.
a. A-P limf(x)=oo
b. limf(x)=oo x-4ao
2. *Suppose f g are differentiable on (a, b), xa E (a, b) and g'(xa) * 0. If f (xa) = g(xa) = 0, prove that
f(x)
f'(xa)
X _X, g(x)
g,(x0)
lim
(Hint: Apply the definition of the derivative.)
3. Let h(x) be defined on (-oo, b). Show that there exists a c > 0 such that rp(t) = h(-;) is defined on (0, c), and that l-.-aa lim h(x) = lim op(t). 1H04 4. 'Let f, g be real-valued functions defined on (a, b). If lim f(x) exists in R andx-a' lim g(x) = oo, prove that lint f(x)/g(x) = 0. xa'
5.4
Newton's Method
197
5. Suppose f, g are real-valued functions on (a, b) satisfying lim, f(x) = A * 0, lim* g(x) = 0. and g(x) > 0 for all x E (a, b). If A > 0, prove that lim f(x)/g(x) = oc. If A <0, prove that lim. f(x)/g(x) _ -oc. 6. Use I'Hospital's rule and any of the differentiation formulas from calculus to find each of the following limits. In the following, In x, x > 0, denotes the natural logarithm function. 1
a. lim
x5 +2x-3
b. ,Imi
2x3 - x2 - I
-x
c. lim
In x
d. lira _.0
e lim_ox° In x where a > 0 g. lim (i.
lim
=-o'
(In x)°
e` .r
,
f. lim ,-.o
h. lim Ay
where a > 0
x`+2x-3 2x' - x' - I I - cos 2Asin x sin x
(In x)" y
.r
,
p, q E fl
sin .rJ
7. Let f(x) = x2 sin(1/x) and g(x) = sin x. Show that lim
f( x)
exists but that lim
fg'(-x(x)
) does not exist.
box)
p(x), p(X) where p and q are polynomials of degree it and in. respectively. 8. Investigate lim and lim . q(x) x_'-« q(x) 9. Let f (x) = (sin x)/x for x * 0, and f (0) = I . a. Show that f'(0) exists, and determine its value. b. Show that f"(0) exists, and determine its value.
10. Let f be defined on R by, f(x) =
5.4
e_
for x # 0. and f(0) = 0. Prove that ft"'(0) = 0 for all n = I. 2. .
Newton's Method2 In this section we consider the iterative method, commonly known as Newton's method.
for finding approximations to the solutions of the equation f (x) = 0. Although the method is named after Newton, it is actually due to Joseph Raphson (1648-1715). and in many texts the method is referred to as the Newton-Raphson method. Newton did derive an iterative method for finding the roots of a cubic equation; his method, however. is not the one used in the procedure named after him. Suppose f is a continuous function on [a, b] satisfying f(a)f(b) < 0. Then f is of opposite sign at the end points a and b and thus by the intermediate value theorem (Theorem 4.2.11), there exists at least one value c E (a, b) for which f (c) = 0. If, in addition, f is differentiable on (a. b) with f'(x) * 0 for all x E (a, b), then f is either strictly increasing or decreasing on [a, b]. In this case the value c is unique; that is, there is exactly one point where the graph off crosses the x-axis.
2. The topics of this section are not required in subsequent chapters.
198
Chapter5
Differentiation
An elementary approach to finding a numerical approximation to the value c is the method of bisection. For this method, differentiability off is not required. To illustrate
the method, suppose f (as in Figure 5.9) satisfies f(a) < 0 < f(b). Let
c,=2(a+b). If f(c,) = 0, we are done. If f(c1) * 0, then c belongs to one of the two intervals (a, c1) or (c1, b), and thus Ic1 - ci < I' (b - a). Suppose (as in Figure 5.9) f(c1) > 0. Then c E (a, c1), and in this case we set co = a, and C2 = 2 (CO + CO-
If f(c2) = 0, we are done. If not, then suppose (as in Figure 5.9) f(c2) < 0. Then c E (c2, c1), and as above, we set C3 = I (Cl + C2).
c1,C2,...,cn,n?2
I//
C. = lCn-1 + C)
Figure 5.9
have been determined with , n - 2. If by happenstance f (cn) = 0, then we have obtained the exact value. If f(cn_ 1)f(cn) < 0, then c lies between cn_ 1 and c,, and we define
In general, suppose
for some j = 0, .
.
.
cnr1 = -2 2 (C. + Cn_1),
5.4
199
0, then c lies between c and c,, and in this case.
On the other hand, if we define
This gives us a sequence
Newton's Method
which satisfies
:2I(b-a). Thus lim c = c and by continuity, f(c) = 0. Although this method provides a sequence of numbers that converges to the zero off. it has the disadvantage that the convergence is rather slow. An alternative method, due to Raphson, uses tangent lines to the curve to find successive points c approximating the zero off. As we will see, this method will often converge much more rapidly to the solution.
As above, assume that f is differentiable on [a, b] with f (a) f (b) < 0 and f'(x) # 0 for all x E [a, b]. Let ct be an initial guess to the value c. The line tangent to the graph off at (c,, f (c,)) has an equation given by
Y =f(ct) +f(ct)(x - CO. Since f (c,) # 0, the line crosses the x-axis at a point that we denote by c2 (Figure 5.10). Thus
0 =f(ci) +f'(ct)(c2 - Cl), that, upon solving for c2, gives C2 = C, -
Figure 5.10
f(CI)
f'(CI)
Newton's Method
200
Chapter5
Differentiation
We now replace the point c, by the second estimate c2 to obtain c3, and so forth. Inductively, we obtain a sequence (cn) given by the formula c
-----
,
c"
n = 1,2...
(8)
in which c, is an initial guess to the solution f(c) = 0. As we will see, under suitable hypothesis, the sequence {c"} will converge very rapidly to a solution of the equation f(x) = 0. Before we prove the main result, we illustrate the above with an example.
5.4.1
EXAMPLE Let a > 0 and consider the function
f(x)=x2-a. If a > 1, then fhas exactly one zero on [0, a], namely \. If 0 < a < 1. then the zero off lies in [0, 1). Let c, be an initial guess to Va. Then by formula (8), for n ? 1,
cl. - a Cn+1 - Cn
2c"
l
a
- 2(C" + Cn).
This is exactly the sequence of Exercise 9 of Section 2.3, where the reader was ask to prove that the sequence converges to %/a-. With a = 2, taking c, = 1.4 as an initia guess yields c2 = 1.4142857, c3 = 1.4142135,
which is already correct to at least seven decimal places.
5.4.2
THEOREM Let f be a real-valued function on [a, b] which is twice differentiable on
[a, b]. Suppose that f(a)f(b) < 0 and that there exist constants m and M such that If'(x)I m > 0 and [f"(x) 1 s M for all x E [a, b]. Then there exists a subinterval I of [a, b] containing a zero c off such that {for any c, E 1, the sequence {c"} defined by J (Cn) T(c.), nEN, Cn+l=cn-f,(c),
is in 1, and n-co lim c" _. c. Furthermore,
C"+, - cl S
ICn - W.
(9)
Prior to proving Theorem 5.4.2 we first state and prove the following lemma. The result is in fact a special case of Taylor's theorem (8.7.16), which will be discussed in Chapter 8.
5.4.3
LEMMA Suppose f : [a, b] -a R is such that f and f' are continuous on [a, b] and f"(x) exists for all x E (a, b). Let x" E [a, b). Then for any x E [a, b], there exists a real number between x, and x such that
f(x) =f(xo) +f'(xe)(x - xo) + 2f"(C)(x - xo)2.
5.4
Proof.
Newton's Method
201
For x E [a, b], let a E R be determined by
f(x) = f(x,) +
CO -
Define g on [a, b] by
x,) - a(t - x,)2.
g(t) = f(t) - f(x.) -
If x = x, then the conclusion is true with C = x". Assume that x > x". Then g is continuous and differentiable on [x x] with g(x") = g(x) = 0. Thus by Rolle's theorem there exists c E (x0, x) such that g'(c) = 0. But
g'(t) = fi(t) -f'(x,,) - 2a(t - x,). By hypothesis, g' is continuous on [x c], differentiable on (x c), and satisfies g'(x,) _ g'(c) = 0. Thus by Rolle's theorem again, there exists C E (x c) such that 0. But
g"(t) = f"(t) - 2a. Therefore, a = if"(C)
Proof of Theorem 5.4.2. Since f(a) f(b) < 0 and f'(x) # 0 for all x E [a. b], f has exactly one zero c in the interval (a, b). Let x, E [a. b] be arbitrary. By Lemma 5.4.3 there exists a point C between c and x, such that
0 = f(c) = f (xo) + f'(xo)(c - x,) + f"(C)(c - x,)2, 2
or
- Ax.) = f' (xo)(c - x0) + 2 f "(3'xc - x,)2.
(10)
If x, is defined by X1 = X.
f(x.) - f,(xo),
then by equation (10).
X, =x,+(c- x,)+ 2 f,"(0 f )(c-x,)2. 1
0
Therefore, "
IX, - cl = 2
x,
Ic - x,12 s
Ic - x,12.
(11)
Choose s>0sothat 8<2m/M andI=(c-S,c+S] C [a,b].Ifc"E1,then lc - c"I < S. If c"+, is defined by formula (8), then by formula (11),
c"+,-c1<-
M
82<S.
Therefore, c"+, E I. Thus if the initial choice c, E I, then c" E I f o r all n = 2, 3, ... .
202
Chaprer5
Differentiation
It remains to be shown that 1 m c = c. If ct E 1, then by induction
ICn+I - CI <
2
n
-
I.
But by our choice of S. (M/2m) S < 1, and as a consequence cn -*c. Q
Remarks (a) For a given function f satisfying the hypothesis of the theorem, the constants M and m, and thus S can be determined. To determine the interval I, one can use the method of bisection to find an approximation xn to c satisfying Ix,, - x - I I < S. If cl is taken to be xn, then Icl - ci < S. In practice, however, one usually makes a judicious guess for c1 and proceeds with the computations.
(b) Let en = c - cn be the error in approximating c, and let K = M/2m. Then inequality (9) can be expressed as ien+1i C Kleni2.
Consequently, if I e,,I < 10', then I en + I I < K 10-2. Thus, except for the constant factor K, the accuracy actually doubles at each step. For this reason. Newton's method is usually referred to as a second order or quadratic method. (c) Even though Newton's method is very efficient, there are a number of things that can go wrong if c1 is poorly chosen. For example, in Figure 5.11, the initial choice of c1 gives a c2 outside the interval, and the subsequent cn tend to -cc. Such a function is given by f (x) = x/(x2 + 1). In Figure 5.12, the initial choice of c1 causes the subsequent values to oscillate between c1 and c2. A function having this property is given by g(x) = x - J Taking c1 = 1 gives c2 = -1, c3 = 1, etc. For this reason, the initial choice of c1 for many functions has to be sufficiently close to c in order to be sure that the method works.
(cl.ftc1))
(c2. f(c2))
Figure 5.11
Notes
203
Figure 5.12
EXERCISES 5.4 1. *For a > 0, apply Newton's method to f(x) = x3 - a to obtain a sequence of a.
that converges to the cube root
2. Use Newton's method to find approximations to the roots, accurate to six decimal places, of the given functions on the interval [0, 1 ].
*a. f(x) = x3 - 3x + 1
b. f(x) = 3x3 - 5x2 + I
c. f(x)=x`-3x3+1 3. Use Newton's method to approximate the real zeros of f(x) = x' - 4x - 3 accurate to four decimal places. 4. Show that f(x) = In x - x + 3, x E (0, oo), has two real zeros. Use Newton's method to approximate them accurate to four decimal places. 5. Suppose g : [a, b] -i, R is differentiable on an interval [a, b] and suppose that there exists a constant c, 0 < c < I, such that Ig'(x)I s c for all x E [a, b]. Prove, that there exists a unique point x, E [a, b] such that g(xo) = x,. (See Exercise 13, Section 4.3.) 6. Let f : [a, b] -* R be differentiable on [a, b] with f (a) < 0 < f(b). Suppose there exist constants m and M such that 0 < m <_ f'(x) s M for all x E [a, b]. Let c, E [a, b] be arbitrary, and define
C-1 = f(c,,) M Prove that the sequence
converges to the unique zero off on [a, b]. (Hint: Consider the function
g(x) = x - f(x)/M.)
NOTES Without question the most significant result of this chapter is the mean value theorem. The simplicity of its proof disguises the importance and usefulness of the result. The theorem allows us to obtain information about the funcdon from its derivative. This has many applications, as
was illustrated by the subsequent theorems and exercises. Additional applications will be encountered throughout the text. Although the mean value theorem is attributed to Lagrange, his proof, which appeared about 1772, was based
M
Chapter 5
Differentiation
on the false assumption that every function could be expanded in a power series. Cauchy, in his 1823 text Rfsumf des Lecons donnees a L'Ecole Royale Polytechnique sur le Calcul Infinitesimal, used the modern definition of the derivative to provide a proof of the mean value theorem. His statement and proof of the theorem, however, differ from the version detailed here in that he assumed continuity of the derivative. What Cauchy actually proved
was that if f is continuous on [a, b], then the quantity {f(b) - f(a)}/{b - a) lies between the minimum and maximum values of f on [a, b]. (See Miscellaneous Exercise 4.) Then by the intermediate value theorem (Theorem 4.2.1 1) applied to the continuous function f, there exists c E (a, b) such that
f(b) - f(a) = f'(c)(b - a). It is worth noting that our proof of the mean value theorem depends ultimately on the completeness property of R (through Rolle's theorem and Corollary 4.2.9). The mean value theorem can justifiably be called the fundamental theorem of differential calculus. It allowed the development of rigorous proofs of many results that were previously taken as fact or "proved" from geometric constructions. Although the modern proof of l'Hospital's rule uses the mean value theorem, it should be remembered that the original version for calculating the limit of a quotient where both the numerator and denominator become zero first appeared in 1696, over 70 years before Lagrange's proof of the mean value theorem. The original version was stated and "proved" in a purely geometric manner without reference to limits. For further details, including a history of calculus, the reader is referred to the text by Katz listed in the Bibliography.
The Bernoulli brothers, Jakob (1654-1705) and Johann (1667-1748), were among the first mathematicians in Europe to use the new techniques of Newton and Leibniz in the study of curves and related physical problems. Among these were finding the equations of the catenary
and isochrone.` Both brothers also contributed to the study of differential equations by solving the Bernoulli equation: y' + P(x)v = Q(x)y". Through their numerous publications and correspondence with other mathematicians, the Bernoulli brothers helped to establish the utility of the new calculus. The first text on differential calculus by ('Hospital also contributed significantly to popularizing the subject. Leonhard Euler (1707-1783), one of the most prolific mathematicians in history, contributed significantly to establishing calculus as an independent science. Even though the calculus of exponential and logarithmic functions was basically developed by Johann Bernoulli, it was Euler's expositions in the eighteenth century that brought these topics into the mainstream of mathematics. Much of what we know today about the exponential, logarithmic. and trigonometric functions is due to Euler. He was also among the first mathematicians to define the concept of a function. However, to Euler-as to the other mathematicians of that period-a function was one that had a power series expansion. It is important to note that most mathematicians of the eighteenth century. including Euler, were primarily concerned with computations needed for the ap, plications of calculus; proofs did not gain prominence until the nineteenth century. For this reason, numerous re-
sults of that era that were assumed to be true were subsequently proved to be true only under more restrictive conditions.
MISCELLANEOUS EXERCISES 1. Let f : (a, b) -> R and suppose f" exists at x E (a, b). Prove that
f"(z,)
limf(x,+h)+f(x0-h) -2f(x") h2
hn0
Give an example where this limit exists at x,, but f" does not exist at x,.
3. The catenary problem involves finding the equation of a freely hanging cable, whereas the isochrone problem involves finding the equation of a curve along which an object would fall with uniform vertical velocity.
Supplemental Reading
205
2. Let f be a real-valued differentiable function on R. a. If there exists a constant b < I such that I f'(x) I < b for all x E Ca, prove that f has a fixed point in R. (See Exercise 13, Section 4.3.) b. Show that the function f(x) = x + (1 + e`)-' satisfies I f'(x)l < I for all x E R but that f has no fixed point in R.
3. A function f is convex (or concave up) on the interval (a. b) if for any x, y E (a, b), and 0 < t < 1,
f(tx + (I -r)y)<-tf(x)+(I -t)f(y). a. If f is convex on (a. b). prove that f is continuous on (a, b). b. If f is convex on (a, b), prove that f+(p) and f _(p) exist for every p E (a, b). Show by example that a convex function on (a, b) need not be differentiable on (a, b). c. Suppose f"(x) exists for all x E (a, b). Prove that f is convex on (a, b) if and only if f"(x) at 0 for all
x e (a, b). 4. Suppose fis differentiable on [a, b] and that f is continuous on [a, bl.Without using the mean value theorem, prove that
min{f'(x):x e [a, b]} sf(bb
Q(a)
- max{f (x) :x E [a, b]}.
5. (T. M. Flett) If f is differentiable on [a, b] and f'(a) = f'(b), prove that there exists ( E (a, b) such that
f(C) - f(a) = C - a
R is differentiable at c E (a, b). If (s") and {t"} are sequences in (a, b) with s,, < c < t" and limoo (t" - s") = 0, prove that
6. Suppose f: (a, b)
lim
f(s") =
t"-s"
SUPPLEMENTAL READING Baxley, J. V. and Hayashi, E. K., "Indeterminate forms of exponential type," Amer. Math. Monthly 85 (1978), 484-486. Cajori, Florian, "Historical note on the Newton-Raphson method of approximation;' Amer. Math. Monthly 18 (1911), 29-33. Corless, R. M., "Variations on a theme of Newton;' Math. Mag. 71 (1998), 34-41. Flett, T. M., "A mean value theorem," Math. Gaz. 42 (1958), 38-39. Hall, W. S. and Newell, M. L., 'The mean value theorem for vector valued functions;' Math. Mag. 52 (1979), 157-158. Hartig, Donald, "L'Hospital's rule via integration;' Amer. Math. Monthly 98 (1991). 156-157. Langlois, W. E. and Holder, L. 1., "The relation of
f (a) to f'(a+)," Math. Mag. 39 (1966), 112-120. Katznelson, Y. and Stromberg, K., "Everywhere differentiable, nowhere monotone function;' Amer. Math. Monthly 81(1974). 349-354. Miller, A. D. and Vyborny, R., "Some remarks on functions with one-sided derivatives;' Amer. Math. Monthly 93 (1986),471-475.
Rosenholtz, "Mere is no differentiable metric for W." Amer. Math. Monthly 86 (1979), 585-586. Rotando, L. M. and Korn, H., "The indeterminate form 0°," Math. Mag. 50 (1977),41-42. Thurston, H. A., "On the definition of the tangent line;' Amer. Math. Monthly 71 (1964), 1099-1103. Tong, J. and Braza, P. A., "A converse of the mean-value theorem;' Amer. Math. Monthly 104 (1997). 939-942.
The Riemann and Riemann-Stieltjes Integral 6.1 The Riemann integral 6.2 Properties of the Riemann Integral 6.3 Fundamental Theorem of Calculus 6.4 Improper Riemann Integrals 6.5 The Riemann-Stieltjes integral
6.6 Numerical Methods 6.7 Proof of Lebesgue's Theorem
When Newton and Leibniz developed the calculus, both considered integration as the inverse operation of differentiation. For example, in the De analysi. t Newton proved
that the area under the curve y = a''(m/n # -1) is given by an
t
m+n by using his differential calculus to prove that if A(x) represents the area from 0 to x then A'(x) = ax'"/". Even though Leibniz arrived at the concept of the integral by using sums to compute the area, integration itself was always the inverse operation of differentiation. Throughout the eighteenth century, the definite integral of a function f(x) on [a, b], denoted fa f(x)dx, was defined as F(b) - F(a) where F was any function whose derivative was f (x). This remained the definition of the definite integral until the 1820s. The modem approach to integration is again due to Cauchy, who was the first mathematician to construct a theory of integration based on approximating the area under the curve. Euler had previously used sums of the form J'=, f(xk _ ,)(xk - x,-,) to approximate the integral of a function f(x) in situations where the function F(x) could not be computed. Cauchy, however, used limits of such sums to develop a theory of integration that was independent of the differential calculus. One of the difficulties with 1. "The Mathematical Works of Isaac Newton;' edited by D. T. Whiteside, Johnson Reprint Corporation. Ness York, 1964.
208
Chapter 6
The Riemann and Riemann-Stieltjes Integral
Cauchy's definition of the integral was that it was very restrictive: only functions that were continuous, or continuous except at a finite number of points, were proved to be integrable. However, one of Cauchy's key achievements was that using his definition, he was able to prove the fundamental theorem of calculus; specifically. if f is continu-
ous on [a, bi, then there exists a function F on [a, hl such that F'(x) = f(x) for all x E [a, b]. The modern definition of integration was developed in 1853 by Georg Bernhard Riemann (1826-1866). Riemann was led to the development of the integral by trying to characterize which functions were integrable according to Cauchy's definition. In the process, he modified Cauchy's definition and developed the theory of integration that bears his name. One of his achievements was providing necessary and sufficient conditions for a real-valued bounded function to be integrable. In Section 6.1 we develop the theory of the Riemann integral using the approach of Jean Gaston Darboux (1842-1917). In this section we also include the statement of Lebesgue's theorem, which provides necessary and sufficient conditions that a bounded real-valued function defined on
a closed and bounded interval be Riemann integrable. A self-contained proof of Lebesgue's theorem will be given in Section 6.7. The equivalence of the Riemann and Darboux approach will be proved in Section 6.2. In Section 6.5 we will consider the more general Riemann-Stieltjes integral that will give meaning to the following types of integrals: +
f1
f J '(x) d[xor
f(x) dx', J0
f(x) da(x), ,
11
where a is a monotone increasing function on [a, b]. These types of integrals were developed by Thomas-Jean Stieltjes (1856-1894) and arise in many applications in both mathematics and physics. The theory itself involves only minor modifications in the definition of the Riemann integral; the consequences, however, are far-reaching. The Riemann-Stieltjes integral permits the expression of many seemingly diverse results as a single formula.
6.1
The Riemann Integral There are traditionally two approaches to the theory of the Riemann integral: the original method of Riemann and the method introduced by Darboux in 1875 using lower and upper sums. I have chosen the latter approach to define the Riemann integral because of its easy adaptability to the Riemann-Stieltjes integral. We will, however, consider both methods and show that they are, in fact, equivalent.
Upper and Lower Sums Let [a, b], a < b, be a given closed and bounded interval in R. By a partition 91 of [a, b] we mean a finite set of points 91 = {xo, x1..
a=xo<x,<
.. ,
<xb.
such that
6.1
The Riemann Integral
209
There is no requirement that the points x, be equally spaced. For each i = 1. 2.... , n. set
Ax, = x, - x;_,, which is equal to the length of the interval [x,x,].
Suppose f is a bounded real-valued function on [a, b]. Given a partition of [a, b], for each i = 1.2.. ... n. let
9 = {xo, x......
in, = inf{f(t):x,_, <_ t <_ x,}.
M, = sup{f(t):x, _, 5 t s x,}. Since f is bounded, by the least upper bound property, the quantities m, and M, exist in R. If f is a continuous function on [a, b], then by Corollary 4.2.9. for each i there exist
points t s; E [x,_,.x,] such that M, = f(t,) and m, = f(sj. The upper sum °U(9, f) for the partition 9 and function f is defined by
1110"D = Y M;ox,. Similarly, the lower sum Y(9, f) is defined by n
20"D = I,8=1MAX, Since m, <_ M, for all i = 1, .
.
.
, n, we always have
s for any partition 91 of [a, b]. The upper sum for a nonnegative continuous function f is illustrated in Figure 6.1. In this case °lt(2P, f) represents the circumscribed rectangular approximation to the area under the graph off. Similarly, the lower sum represents the inscribed rectangular approximation to the area under the graph off.
Figure 6.1
Upper Sum U(9. j)
210
Chapter6
The Rlemann and Riemann-Stleltjes Integral
Upper and Lower Integrals If the function f satisfies m : f(t) <- M for all t e [a, b], then
m(b - a) c
--5 M(b - a)
(1)
for any partition 9 of [a, b]. To see that inequality (1) holds, let iI' = {x°, ... , any partition of [a, b]. Since M; <- M for all i = 1, ... , n, 61491, f)
M4Axi `-
M(X,
be
- xi -1) = M(b - a).
Similarly, -W(9, f) z m(b - a). Thus the set {°G.(91, f) : 91 is a partition of [a, b]} is bounded above and below, as is the set {2(9', f)}.
6.1.1
Let f be abounded real-valued function on the closed and bounded interval [a, b]. The upper and lower Integrals off, denoted fQ f and fa f respectively, are defined by DEFINITION
b f = inf{°U,(9, f) : 91 is a partition of [a, b]), rb
f = sup{.T(91, f) : 9' is a partition of [a, b]}.
Ja
Since the sets {° L (91j )j )} and {2(9,f)} are nonempty and bounded, the lower and upper integrals of a bounded function f : [a, b] -+ R always exist. Our first goal is to prove that f; f s f. f for any bounded real-valued function f on [a, b]. To this end, we make the f!1owing definition.
6.1.2
DEFINITION A partition 9* of [a, b) is a refinement of 9 if 9' C 9*. A refinement of a given partition 9 is obtained by adding additional points to 91. If 911 and 9'2 are two partitions of [a, b], then 9, U 9'2 is a refinement of both 91, and 912.
6.1.3
LEMMA If 91* is a refinement of 9, then
2(91,f) 2(91*,f) s w.(91*,f) < °u(91,f). Proof. Suppose 9' _ {x°, x1, ... , xa} and 91* = 9 U {x*}, where x* * x; for any j = 0, 1, ... , n. Then there exists an index k such that xk_ < x* < xk. Let 1
Mk = sup{f(t) : t E [Xk_ 1, x*]}, Mk' = sup{f(t) : t E [x*, Xk]}.
Since f(t) s Mk for all t e [xk_,, xk], we have that f(t) s Mk for all t E (xk_ 1, x*] and also for all t E [x*, xk]. Thus both Mk and Mk are less than or equal to Mk. Now k-1
n
M;Ax, + MM(X* - Xk-1) + Mk(xk - x*) +
1149'*,f) _ 1=1
MMAzr l-k-I
6.1
The Riemann Integral
211
But Mk(X*
- Xk-1) + Mi(xk - X*)
MkAXA.
Therefore,
The proof for the lower sum is similar. If P* contains k more points than 91, we need only repeat the above argument k times to obtain the result.
6.1.4 THEOREM Let f be a bounded real-valued function on [a, b]. Then
t
jaf :S:
f
Proof. Given any two partitions 9, 9 of [a, b].
2(91,f) S 2(9 U 9.,f) S 1(9 U 9.,f) t Thus 2(91,f) < °ll.(a f) for any partitions 9, 9.. Hence
Ji= up X(O,f) S Gll.(a,f) for any partition a. Taking the infimum over 9, gives the result. Q
The Riemann Integral If f : [a, b] -+ R is bounded, then the lower and upper integrals off on [a, b] always exist and satisfy fo f < f° f. As we will shortly see, there is a large family of functions for which equality holds: such functions are said to be integrable.
6.1.5
Let f be a bounded real-valued function on the closed and bounded interval [a, b]. If DEFINITION
then f is said to be Riemann integrable or integrable on [a. b]. The common value is denoted by Jb b Jf(x)dx,
or a
f
a
and is called the Riemann Integral or integral off over [a, b]. We denote by 9t[a, b] the set of Riemann integrable functions on [a, b]. In addition, if f E 9t[a, b], we define Jbaf
-Jabs
212
Chapter6
The Riemann and Riemann-Stieltjes Integral
If f : [a, b) -> R satisfies m s f(t)
M for all t e [a, b], then by inequality (1),
m(b-a): Jbf
Ihf <_M(b-a).
a
a
If, in addition, f E 91[a, b], then
m(b-a)<- Jf b sM(b-a). a
In particular, if f(x) ? 0 for all x E [a, b], then fa f >_ 0. If f E 9t[a, b] is nonnegative, then the quantity fa f represents the area of the region bounded above by the graph
y = f(x), below by the x-axis, and by the lines x = a and x = b.
6.1.6
EXAMPLES
(a) The following function, attributed to Dirichlet, is the canonical example of a function that is not Riemann integrable on a closed interval. Let f be defined by
f(x) =
x E Q,
11,
0, x0Q.
Suppose a < b. If 9 = {xo, ... , x} is any partition of [a, b], then m; = 0 and M; = 1 for all i = 1, ... , n. Thus
2(9,.f) = 0
°1L(9,f) = (b - a)
and
for any partition 9 of [a, b]. Therefore, fb
f=0
J f=(b-a),
and
1a
a
and as a consequence, f is not Riernann integrable on [a, b].
(b) Let f : [0, 1 ] -> l be defined by
0:5 x < 1
In this example we prove that f is integrable on [0, 1] 9 = {x°, x,, .
with f, f = 2. Let
.. , x,} be a partition of [0, 1 ], and let k E {1, ... , n} be such that
xk_, < I - xk (See Figure 6.2.) If mi and M; denote the infimum and supremum off on [xi _ 1, x;] respectively, then
- f0, f
m'
1,
i = 1,.. ., k,
i=k+I,..
,n,
and
M;
-
f0, 1,
i = 1,..
i=k,..
k - I, n.
6.1
The Riemann Integral
213
i
I
Xk
xn=1
2
Figure 6.2
Thus n
x(91, f) =
i-k+t
Axi = (1 - xk),
and
ft
a(L(P,f) = I Oxi = (I - xk-1) i-k
Since 1 - xk s 2 < 1 - xk_ 1, 2(91,f) s 2 <- °lt(91, f) for all partitions 91 of [0. 1 ]. Thus fo f s 2 s fo f. Hence if f is integrable on [0, 11, then fo f = 2. We conclude by proving that f is indeed integrable on [0, 1). Since I - xk _ , = (1 - xk) + (xk - xk _ , ), we have
`'ll(`',f) = 2(9',f) + (Xk - xk-1) Let e > 0 be arbitrary. If 9 is any partition of [0, 1) with i xi < e for all i, then nu(9P,f) < 2(91,f) + e. Thus I
f f - ifk49-1f)s°uP1,f) r1
s 2011f) +
e c
sup2(`9-,f)+e51 f+e, 0
where the infimum and supremum are taken over all partitions a of [0, 1). Since E > 0 was arbitrary, we have j' If = fo f. Thereforef is integrable on [0, 11 with f, f = 2.
214
Chapter 6
The Riemann and Riemann-Stieltjes Integral
(c) We now provide another example to illustrate how tedious even a trivial integral can be if one relies only on the definition of the integral. Luckily, the fundamental theorem
of calculus (Theorem 6.3.2) will allow us to avoid such tedious computations. Let f(x) = x, x E [a, b]. For the purpose of illustration we take a > 0 (Figure 6.3). Interpreting the integral as the area under the curve, we intuitively see that
tbx
=
-a)(b+a)=(b2-a22).
This is obtained from the formula for the area of a parallelogram. Let 91 be any partition of [a, b]. Since f(x) = x is increasing on [a, b], {x0, x,, ... ,
m;=f(x;_,)=x;_,
M;=f(x;)=x;.
and
Figure 6.3
Therefore,
4911f)
x; _ , Ox;
and
949, f)
x; Ax;-
For each index i,
x;-1 < 2(xi_, +x) <_x;. If we multiply this by Ox; = x; - x;_, and sum from i = 1 to n, we obtain
l (xi
-
_')
°d(g1,f)
But ;_, 2
(x?-xi_i)= 2 (xn-4o)= 2 (b2-a2).
6.1
The Riemann Integral
21S
Finally, if we take the supremum and infimum over all partitions 9' of [a, b], we have J6
xdxs2(b2-a2):5 f xdx. a
This in itself does not prove that f(x) = x is integrable on [a, b] with Jb
xdx = 2 (b2 - a2). a
To prove that f is integrable on [a, b], we note that for any partition 9' of [a, b], fb
0c a
rb
xdx - J x dx <_ alt(9i, f) - T(91,f) = I (xi - xi -1)Axi i-1 a
< (1ma5 Axi) (b - a).
Let e > 0 be given. If we choose a partition 9' such that Axi <. a/(b - a + 1) for all i, then fax dx - fax dx < e. Since this holds for every e > 0, we conclude that
fa x dx = fax dx. Thus f(x) = x is Riemann integrable on [a, b] with fax dx = 2 (b2 - a2).
(d) Consider the function f(x) = x2, x E [0, 1]. For n E Ni, let 9' be the partition {0, ,'- 2, ... , 1}. Since f is increasing on [0, 1 ], its infimum and supremum on each
interval [Y,11 are attained at the left and right endpoint respectively, with m, = (i - 1)2/n2 and Mi = i2/n2. Since Axi = 1/n for all i, and
2(9,,,f)°n3[12+22+.+(n- 1)2],
n
Using the identity 12 + 22 +
+ m2 = 6m(m + lX2m + 1) (Exercise 1, Section
1.3), we have
491.1f) = 6 C1
n/
(2 - n
and
1UP1,,,f) = 6 ( 1 -1
n)(2+1).
Thus sup.T(9D,,, f) = 1 and inf °lL(91,,, f) = 3. Since the collection 191.: n e N} is a subset of the set of all partitions of [0, 1 ], 1
3
= sup 201., f) :5
`-f( ',f) = Jx2 dx,
and
0
3 = inf °lt(9,,, f) f °lt( P, f) = J.x2dx. 0
Therefore f(x) = x2 is integrable on [0, 1 ] with fo x2 dx =
i
.
216
Chapter6
The Rietnann and Riemann-Stieltles Integral
Riemann's Criterion For Integrability The following theorem, the original version of which is attributed to Riemann, provides necessary and sufficient conditions for the existence of the Riemann integral.
6.1.7
THEOREM Abounded real-valued function f is Riemann integrable on [a, b] if and only if for every E > 0, there exists a partition 9 of [a. b) such that E. (2) RL(9',f) Furthermore, if 9 is a partition of [a, b] for which inequality (2) holds, then the in-
equality also holds for all refinements of 9.
Proof.
Suppose inequality (2) holds for a given e > 0. Then
0C I f- Jf_
a
a
Thug f is integrable on [a, b]. Conversely, suppose f is integrable on [a, b]. Let e > 0 be given. Then there exist partitions 9, and 92 of [a, b] such that
jbf °lL(92,f) -
<2
and
tbf - 491'-f) < 2
Let 9 = 91 U 92. Then
jh 0149V) 90149V)
L(92,f) < u
f + 2 < `-P(('1Pi,f) + E
E.
Therefore, °U.(9, f) - %(9,f) < e, which proves inequality (2). If D. is any refinement of 9, then by Lemma 6.1.3,
0 <_ qt(L,f) - 2(a,f) :9 6u(P,f) - e(91,f) < E. Thus inequality (2) is also valid for any refinement 2 of 9. Q
Integrability of Continuous and Monotone Functions As an application of the previous theorem, we prove that every continuous teal-valued function and every monotone function on [a, b] is Riemann integrable on [a. b]. As we will see, both of these results will also follow from Lebesgue's theorem (Theorem 6.1.13).
6.1.8 THEOREM Lei f be a real-valued function on [a, b]. (a) If f is continuous on [a, b), then f is Riemann integrable on [a, b]. (b) If f is monotone on [a, b], then f is Riemann integrable on [a, b].
Proof. (a) Let e > 0 be given. Choose nl > 0 such that (b - a)rl < E. Since f is continuous on [a, b], by Theorem 4.3.4,f is uniformly continuous on [a, b]. Thus there
exists a S > 0 such that
[f(x) - f(t) I < 77
(3)
6.1
The Riemann Integral
217
for all x, t E [a, b] with Ix - tl < S. Choose a partition 91 of [a, b] such that Ox; < S for all i = 1, 2, ... , n. Then by inequality (3),
Mi - misrl for all i = 1, 2, ... , n. Therefore,
61(P,f)-201,f)=
(M,-mi),%xi:S71
Ax,=rl(b-a)<e.
Thus by Theorem 6.1.7,f is integrable on [a, b].
(b) Suppose f is monotone increasing on [a, b]. For n E h1, set h = (b - a)/n. is a partition of . , n, set xi = a + ih. Then 9' = { x o , x,, ... , [a, b] that satisfies Axi = h for all i = 1, . . . , n. Since f is monotone increasing on
Also f o r i = 0, 1 , ..
[a, b], mi = f(xi_ i) and Mi = f(x,). Therefore,
[f(x;) -f(xi-1)]Ax,
NOV) - `^e(911f) = =h
(f (xi) - f (xi- 01
(b - a) n
[f(b) - f(a)].
Given e > 0, choose n E N such that
(b - a) n
[f(b) - f(a)] < E.
For this n and corresponding partition 9, OIL.(91, f) - 2(91j) < e. Thus f is integrable on [a, b].
The Composition Theorem We next prove that the composition iP -f, of a continuous function gyp, with a Riemann integrable function f, is again Riemann integrable. As an application of Lebesgue's theorem we will present a much shorter proof of this result later in the section.
6.1.9 THEOREM Let f be a bounded Riemann integrable function on [a, b] with Range f C [c, d]. If ip is continuous on [c, d], then tp -f is Riemann integrable on [a, b].
Proof. Since 9 is continuous on the closed and bounded interval [c, d], ip is bounded and uniformly continuous on [c, d]. Let K = sup{IQp(t)I: t E [c, d]}, and let e > 0 be
given. Set e' = e/(b - a + 2K). Since ip is uniformly continuous on [c, d]. there exists 8, 0 < S < e', such that (4) 19(s) - (P(01 < e' for all s, t E [c, d] with Is - tI < S. Furthermore, since f E 9%[a, b], by Theorem 6.1.7 there exists a partition 9 ' = {xo, . . . . . x}} of [a, b] such that
%(9',f) - _y(9', f) < S2.
218
Chapter6
The Rlemann and Riemann-Stieltjes Integral
To complete the proof we will show that (5)
°1491, (P of) - 201, (P of) C E.
By Theorem 6.1.7 it then follows that (p of E Jt(a, b]. For each k = 1, 2, . . . , n, let ink and Mk denote the infimum and supremum off on [xk_ 1, xk). Also, set
mA = inf{cp(f(t)) : t E [x,-,, xJ) M,*t = sup{p(f(t)):1 E [xk_I,xk]}.
and
We partiton the set 11, 2, ... , n} into disjoint sets A and B as follows:
A={k:Mk-mk<6}
and
B={k:Mk-mka6}.
We first note that I f(t) - f(s)l 5 Mk - ink for all s, t E [xk_,, xk]. Hence if k E A. then by inequality (4),
IcP(f(t)) - V(f(s))j < e' for all s, t e [xk_,, xk]. But Mk
- m4 = sup{cp(f(t)) -'p(f(s)): s, t E [Xk_1,xk]}.
lift*
- mk Therefore, Mk* -mk < 2K. Thus
s e' for all k E A. On the other hand, if k E B. then
11491, (P -f) - 2(9"P of) _
(Mk - mk )AX* + kEA
tea
(Mk - mk)AX&
5 E' 7, Axk + 2K T, AXk kEB
kEA
5 e'(b - a) + 2K Y, Axk. kEB
But for k E B, 6 s Mk - Mk. Therefore, 7' (Mk - mk)I&Xk s s (043V)
Oxk 5 kEB
S kEB
- 49V)) < S < e'.
Hence by the above,
'k(91, V o f) - £('P, qp o f) 5 e'(b - a) + 2KE' = e. This establishes inequality (5), and thus q) of E cJt[a, b]. U As a consequence of the previous theorem, if f is Riemann integrable on [a, b], then so are the functions If I and f2 . For emphasis we state this as a corollary.
6.1.10 COROLLARY If f E 9t[a, b], then If ! and f 2 are Riemann integrable on [a, b]. A natural question to ask is whether the composition of two Riemann integrable functions is Riemann integrable. In Example 6.1.14(b) we will show that the answer is an emphatic no!
6.1
The Riemann integral
219
Lebesgue's Theorem In Theorem 6.1.8(a) we proved that every continuous function on [a, b] is Riemann integrable on [a, b]. By Exercise 16, this is also true for every bounded function on [a, b] that is continuous except at a finite number of points. On the other hand, as a consequence of Theorem 6.1.8(b), every monotone function on [a, bJ is Riemann integrable. is an enumeration of the rational numbers in [0, 1 ] and Hence, for example, if c > 0 are such that T, c, converges, then by Theorem 4.4.10, 1
00
f(x) = 71 C. 1(x n=1
is monotone increasing on [0, 1 ], and thus is Riemann integrable on [0, 11. By Theorem 4.4.10, the function f is continuous at every irrational number and discontinuous at every, rational number in [0, 1]. We now state the beautiful result of Lebesgue that provides necessary and sufficient conditions that a bounded real-valued function on [a, b) be Riemann integrable. To properly state Lebesgue's result we need to introduce the idea of a set of measure zero. The concept of measure of a set will be treated in detail in Chapter 10. The basic idea is that the measure of an interval is its length. This is then used to define what we mean by measurable set and the measure of a measurable set. At this point we only need to know what it means for a set to have measure zero.
6 1.11
DEFINITION A subset E of P has measure zero if given any e > 0, there exists a finite or countable collection {1n)n of open intervals such that
ECUJ
and
e, n
where l(1n) denotes the length of the interval In.
6.1.12
EXAMPLES
(a) Every finite set E has measure zero. Suppose E = {x1,
. .
. , xN} is a finite subset of
R. For each n = 1, 2, ... , N, as in Figure 6.4 (with N = 6), let
/
E
Nxn+2N, .
Then N
N
ECU /
> l(!n) = e.
and
n=1
n=1
Therefore, E has measure zero. it
14
12
(0) (0) Xt
X4
X2
16
l5
X3 X6
XS
13
Figure 6.4
220
Chapter 6
The Riemann and Riemann-Stleltjea Integral
(b) Every countable subset of R has measure zero. Suppose E = {x,}00 I is a countable
subset of R. Let f > 0 be given. For each n E N. let E l
E
Since xn E 1 for all n, E C U. 11,,. Thus since 1(I4) = E12n, 00
j l(In) = E
w=1
2n = E. n=1
As an example, the set Q of rational numbers has measure zero.
(c) The Cantor set Pin [0, 1] has measure zero (Exercise 21). We now state the following theorem of Henri Lebesgue, the proof of which will be given in Section 6.7. This result appeared in 1902 and provides the most succinct form of necessary and sufficient conditions for Riemann integrability.
6.1.13 THEOREM (Lebesgue) A bounded real-valued function f on [a. b] is Riemann integrable if and only if the set of discontinuities off has measure zero.
Remark. If f is continuous on [a, b], then clearly f satisfies the hypothesis of Theorem 6.1.13 and thus is Riemann integrable. If f is a bounded function that is continuous except at a finite number of points, then by Example 6.1.12(a) the set of discontinuities off has measure zero. Hence f E 9t[a, b]. If f is monotone on [a, b], then by Corollary 4.4.8, the set of discontinuities off is at most countable, and thus by Example 6.1.12(b).
has measure zero. Hence again f E 9t[a, b]. As an application of Lebesgue's theorem we give the following short proof of Theorem 6.1.9.
Proof of Theorem 6.1.9 Using Lebesguevs Theorem. As in Theorem 6.1.9, suppose f E 9t[a, b] with Range f C [c, d], and suppose rp : [c, d] -, R is continuous. Let
E = {x E (a, b): f is not continuous at x} and F = {x E [a, b): rp of is not continuous at x}. By Theorem 4.2.4, F C E. Since f is Riemann integrable on (a, b], the set E has measure zero, and as a consequence so does the set F. Therefore. V of E 9t[a, b]. Q
6.1.14
EXAMPLES
(a) As in Example 4.2.2(g), let f be defined on [0, 1] by
11, x=0, f(x) =
0, 1n,
if x is irrational,
if x = n in lowest terms, x * 0.
6.1
The Riemann Integral
221
Since f is continuous except at the rational numbers, which have measure zero, f is Riemann integrable on [0, 1 ]. Furthermore, since $(P, f) = 0 for all partitions 9 of [0, 1 ],
Jf(x)dx = 0. (b) Let f be the Riemann integrable function on [0, 1 ] given in (a), and let g : [0, 1 ] - R be defined by
0, x0,
g(x) __ 11, x E (0, 1].
Since g is continuous except at 0, g E %[0, 1 ]. But for x E [0, 1 ],
(g of)(x) = J 1, if x is rational,
0, if x is irrational.
By Example 6.1.6(a), g of 6E Jt[O, 1).
EXERCISES 6.1 1. Let f (x) = 1 - x2, x E [ -1, 2]. Find Sf(9, f) and qt(9J) for each of the following partitions of [ -1, 2].
a. 9 = {-1,0, 1,2) b.9={-1,-12,12,1,2,2} 2. Show that each of the following functions is Riemann integrable on [0, 2], and use the definition to find f02 I
*a f(x) =
2, 15 x 5 2 '
b f (x)
1,
0, sx < 1
3,
25 x<2
-2,
sx 52
2 3. Show that each of the following functions are Riemann integrable on [a, b] and find f; f.
0,
*a. f(x) = c
(c a constant)
b. f(x) =
2, 1,
a s x < c, x = c.
c<xsb
4. Use one of the methods of Examples 6.1.6 to find fo f for each of the following monotone functions f. *a. f(x) = [3x], where (x) is the greatest integer function b. f(x) = x[2x]
c. f(x) - 2x + I
d. f(x) = 1 - x2
5. Prove that f. *f = 0 for any real-valued function f on [a. a]. 6 . *If f , g E 3t(a, b) with f ( x ) 5 g ( x ) f o r all x E [a, b], p r o v e that f f s f g.
7. a. Suppose f is continuous on (a. b] with f(x) z 0 for all x E [a, b]. If f. f = 0. prove that f(x) = 0 for all x r= [a. b]. b. Show by example that the conclusion may be false if f is not continuous.
222
Chapter 6
The Rlemann and Riemann-Stieltjes integral
& *Let f : [(0, 11 - R be defined by
xEa, f()= {0, X. xEQ Compute fo f and fo f. Is f integrable on [0, 11?
9. Suppose f is a nonnegative Riemann integrable function on [a, b] satisfying f(r) = 0 for all r E Q fl [a, b]. Prove that f; f = 0. 10. *Use the method of Example 6.1.6(c) to show that
Ja
xdx= 3(b3-a3)(0:a
11. Suppose f is monotone increasing on [a, b]. For n E N, set It = (b - a)/n. L e t 9n = {xo, x,, ... , xn} where for
each k = 0,.
.
., n,xk = a + kh.
a. Prove that
f
0 s Wt(9n,f) -
(b
a)
[f(b) -f(a)]
b. Prove that f; f = lim bU(9n, f). 12. Use the previous exercise to evaluate the following integrals. b (I (I c. J x3 dx d. x3 dx x dx b. J (3x - 2) dx *a. I
J0
-2
0
1a
13. Let f be a bounded function on [a, b]. Suppose there exists a sequence {9n} of partitions of [a, b) such that lim SC(9n, f) = lim QU (9n, f) = L (L E 18).
ntiPO
n-wo
Prove that f is Riemann integrable on [a, b] with fa f = L.
14. a. If f e 9t[a, b], prove directly (without using Theorems 6.1.9 or 6.1.13) that If I E 9t[a, b].
b. If Ill E 9t[a, b], is f e 9t[a, b]? 15. *a. If f e 91[a, b], prove directly that f2 E 9t[a, b].
b. Give an example of a bounded function f on [a. b] for which f2 E 9t[a, b], but f e 9t[a, b]. 16. *Suppose f is a bounded real-valued function on [a, b] that has only a finite number of discontinuities. Prove directly that f is Riemann integrable on [a, b].
17. a. If E has measure zero, prove that every subset of E has measure zero. b. If E,, E2 have measure zero, prove that E, U E2 has measure zero. ao
c. If each En, n = 1, 2, ... , has measure zero, prove that U E. has measure zero. n=I 18. Use Theorem 6.1.13 to prove that if f, g r= 9t[a, b], then f + g E 9t[a, b]. 19. Prove directly that the function f of Example 6.1.14(a) is Riemann integrable on (a, b). 20. Let f : [a, b] -+ R be continuous. Suppose that for every Riemann integrable function g : (a, b] -+ R the product fg is Riemann integrable and f; fg = 0. Prove that f(x) = 0 for all x E [a, b].
21. Prove that the Cantor set P in [0. 1) has measure zero.
6.2
S.2
Properties of the Riemann Integral
223
Properties of the Riemann Integral In this section we derive some basic properties of the Riemann integral. As in the pre-
vious section, [a, b], a < b, will be a closed and bounded interval in R, and dtra, b; denotes the set of Riemann integrable functions on [a, b]. 6.2.1
THEOREM Let f, g E aAt[a, b]. Then rh
b
(b
f g, with jci = c j f, and
(f + g) = J f +
(a) f + g E 1.[a, b] with Ja
b
(b) cf E It [a, b] for all c E
a
a
a
a
(c) fg E Ft[a. b]. Proof. (a) The integrability of f + g is actually a consequence of Theorem 6.1.13. However, in establishing the formula for the integral of (f + g), we will also obtain the be a partition of [a, b]. integrability of f + gas a consequence. Let 91 = { x 0 . . . . . For each i = 1, . .. , n, let
M;(f) = sup{f(t):tE [x,_I,x,]}, M,(g) = sup{g(t) :I E [x,- i, x,]}.
Then f(t) + g(t) s M,(f) + M, (g) for all t E [x,_ x,], and thus M,(f) + M,(g). sup{f(t) + g(t) : t E [x1_ 1,x1]} Therefore, for all partitions 9' of [a, b],
U49,f + g) c 'U(QP,f) + g). Let e > 0 be given. Since f, g E 9t[a, b], there exist partitions 91f and 91, of [a, b] such that b
°lt(9f,.f) <
jf+ a
2
Jg±.
and
a
Let 9 = al'fU 2P8. Since 91 is a refinement of both al'f and 9914, b
au(D,f + g) < 1u(9'f,f) + att(9g, g) <
j f+ f g + e. b
a
Therefore, b
f
b
(f+g) < f+
fb
ag+e.
Since the above holds for all e > 0, b
jb(f+ g) _- jaf+ f bg
a
224
Chapter6
The Riemann and Riemann-Stieltjes Integral
A similar argument proves that
jn(f + g) 2: J f +
f g.
Thus the lower integral of (f + g) is equal to the upper integral of (f + g), and as a con-
sequence, (f + g) E 9t[a, b] with
fb(f+g)=
ff+ fhg.
(b) The proof of (b) is left as an exercise (Exercise 1). (c) To prove (c), we first note that
fg =
4[(f+g)2- (f-g)2].
By part (a) the functions (f + g) and (f - g) are integrable on [a, b]. and by Corollary 6.1.10, (f + g)'- and (f - g)2 are integrable. Hence by parts (a) and (b),fg is integrable on [a, b].
6.2.2
THEOREM 1f f E 9t(a, b), then I f I E 9t[a, b] with I
f E 9t[a, b], by Corollary 6.1.10, I f (E 9t[a, b]. Let c = ±1 be such that I 5"f I = c fa f . Since cf(x)
I f(# for all x E [a, b], °11(9, cf) <_ °U(9, If I)
for any partition 9 of [a, b]. Therefore, since both cf and If I are integrable, fa cf f.' I f I. Combining. the above we have
ff1 =cff6.2.3
jhj<
li I
THEOREM Let f be a bounded real-valued function on [a, b], and suppose a < c < b. Then f E 9t[a, b] if and only if f e 9t[a, c] and f E 9t[c, b]. if this is the case, then
Jf=faf+ff
(6)
Proof.
Let c E R satisfy a < c < b. We first prove that if f is a bounded real-valued function on [a, b], then
ff= faf+ ff
(7)
Suppose 9, and 92 are partitions of [a, c] and [c, b], respectively. Then 9 = 91 U 92
6.2 Properties of the ltiemann Integral
225
is a partition of [a, b] with c E 9. Conversely, if 9 is any partition of 'a, b with c E 91, then 99 = 91, U 912 where 91, and 912 are partitions of [a, c] and [c, b]. respectively. For such a partition °.P,
°tt(P,f) _ °u(P1,f) + aLt(92,f) >
Ji + Ji. a
a
If 9. is any partition of [a, b], then 91 = 9. U {c} is a refinement of 9. containing c. Therefore, b
c
'149-1f) ' 014911f) ' J f
+ J
a
Takin$ the infimum over all partitions a of [a, b] gives
f
f
c
'
f-jaf+If
To prove the reverse inequality, let e > 0 be given. Then there exist partitions 91, and 91, of [a, c] and [c, b], respectively such that
%(91,.f)<
(f+2
fb
and
E
f + 2*
°lt(P2, f) < J
a
. Let 91 = 9', U 9'2. Then
J f S °u(oy,f) = °u(9'1,f) + gt(9D2, f) < J`f + J f+ a
a
c
Since e > 0 was arbitrary,
t f:5 fa'+
Jf c
which when combined with the previous inequality proves equation (7). A similar argument also proves
f f=
+ f 'ff f" c If f is integrable on [a, c] and [c, b], then by equations (7) and (8), a
.
(8)
a
b
af+jf=lfslf=Jf+Jf
J
Therefore, f E Jt[a, b] and identity (6) holds. Conversely, if f E 9t[a, b], then by equations (7) and (8),
Jf+if=lf+If
226
Chapter 6
The Riemann and Riemann-Stleltjes Integral
Since the lower integral off is always less than or equal to the upper integral off, the above holds if and only if
a
ff
f-ff
11
and
u
b
Hence f E k[a, c] and f E dt [c, b]. Q
Riemann's Definition of the Integral We close this section by comparing the approach of Darboux with the original method of Riemann.
6.2.4
DEFINITION
Let f be abounded real-valued function on [a. b] and let 9
{xo. xl,....x} be a partition of [a, b]. For each i = 1, 2, ... , n. choose t, E [xi _ 1, x,]. The sum
f(p.f) = ,if(oaxi I
is called a Riemann sum off cith respect to the partition 91 and the points {t,}.
Figure 6.5 A Riemann Sum f(91. f) of f
In the Riemann approach to integration, one defines the integral of a bounded realvalued function f as the limit of the Riemann sums off. Since 9(91,f) depends not only on the partition °,D = {x0, xi,... , but also on the points t; E [x;_ 1, xi], we first
6.2 Properties of the Riemann Integral
227
need to clarify what we mean by the limit of the Riemann sums &'(9, f ). For a partition
_ {x0, x1.... , xn} of [a, b]. set
max{oxi: i = 1,2,...,n}.
I1911
The quantity Il9 11 is called the norm or the mesh of the partition 9.
6.25
DEFINITION
Let f be a bounded real-valued function on [a, b]. Then
lim -Y(9, f) = 119)1-'o
if given c > 0, there exists a S > 0 such that
l f (oaxi - I < E
(9)
i=n[
for all partitions 9 of [a, bl with 11911 < S, and all choices of ti E [x, _ I, xi].
6.2.6 THEOREM Lei f be a bounded real-valued function on [a, b]. If lim SP(9, f) = I, 11911-'0
then f E 9t[a, b] and fa f = 1. Conversely, if f E 9t[a, b], then 111im0 &(91,f) exists and
el-
rb
lim 11911-.0
x(9,.1) = J f. a
Proof. Suppose , la tprt0 P(9, f) = I. Let e > 0 be given, and let S > 0 be such that inequality ( 9 ) holds f o r all partitions 9 = {x0, xl, ... , xn} of [a, b) with 11211 < S, and all ti E [xi_ 1, xi]. By the definition of Mi, for each i = 1, ... , n, there exists i E [xi_ 1, xi] such that f M, - e. Thus n
OU(911f) =
<
i=1
M4xi f(OAXi + E //
i=1
i.l
AX,
< 1+ E + e(b -a]= 1+ E[ 1 + b -a]. Similarly T(21,f) > I - E[ 1 + b - a]. Therefore, °U.(9, f) - 2(91,f) < 2E[ 1 + b - a]. Thus as a consequence of Theorem 6.1.7, f E 9t[a, b) with fa f = I. Conversely, suppose f r= Jt[a, b]. Let M > 0 be such that I f(x)I s M for all x E [a, b]. Let e > 0 be given. Since f E 9t[a, b], by Theorem 6.1.7 there exists a partition . of [a, b] such that Jb
e <,f)
U(,.f)< f f+E.
228
Chapter 6
The Rlemann and Riemann-Stieltjes Integral
Suppose % = {xa, . . . , x,,,}. Let S = e/NM, and let 9 = ( ) , 0 ,...,y . ) be any partition of [a, b] with 11 9 II < S. As in the definition of the integral, let
M;=sup{f(x):xE[x;_1,x;]}, i= I,.
.
.. N.
Consider any interval [yk_ 1, yk], k = 1, . .. , n. This interval may or may not contain
points x. E a. Since 9 . contains N + I points, there are at most N - I intervals [y,-,, yk] which contain an x, E a, i # 0, N. Suppose, as in Figure 6.6, {.x t, ... , xj+m} C [Yk- 1, Yk] [f xx * yk_ 1, set M k = sup{ f (x) : x E [yk_,, xj]}. Similarly, if xl+m * set Mk = sup{f(x) : x E [x, +m, y'k]}. Yk - 1
yk,
Y4
X1
xj+1
x142
X1
Figure 6.6
Let tk E [yk_ 1, Yk] be arbitrary. Since 1(t) - f(s)I s 2M for all t, s E [yk_,, yk], 2M + M1 s, s = 1, . .. , m, 2M + Mk, i = 1, 2.
f(tk) f(tk)
and
Therefore, m
f(tk)AYk =f(rk)(x,
Yk-1) + Y f(rk)OXI+, + f(1k)O'k - x,+m) $=1
< 2M.Yk + Mk(x, - Yk-1) +
M,+,'&x,+, + M4(Yk - X,-m)
M s=1
< 2M6 + 01L(9k, f ), where 2 - P , = { y k -, x,,
-
, x;+., yk} is a partition of [yk- 1, Yk]. If the interval [Yk-,. yk]
contains no x; E a, i * 0, N. we simply let 9k = {yk_ 1, yk}. Let 9' = U. Then 9' is a partition of [a, b] that is also a refinement of 2. Since at most N - I intervals [Yk-1, Yk] contain a point of 9, other than xo and xN, n
f(9j) _
n
f(tk)DYk < 2M(N - 1)8 +
6u(9k,f) k-1
k=1
b
<2e+04(9',f)<2e+Ru(a,f)<3e+
f. a
A similar argument proves that
`9'(P,f) > jfb - 3e. a
herefore,
f(P,f) -
JiI < 3e.
f.
6.2
229
Properties of The Riemann Integral
Since this holds for any partition QP _ {yo, ... , y,,} of [a, b] with 11 1,1P11 < a and any k = 1, . . . , n, choice of tk e rb O
6.2.7
EXAMPLE In this example we will use the method of Riemann sums to evaluate f; x dx. Since f(x) = x is Riemann integrable on [a, b], rb x dx = lim 9(91, f). Ja
Since the limit exists for any t, E [x1_,, x,], we can take t; = (x;_, + x;)/2. With this choice of t,, 1,
fyfy /!11
"(.7,f)
R
R
T
1 7,(x,_, + xj)(x, - x,_,) 2j_j
2
2
2
(x, - x?2 (b - Q ), 1
i -11
which proves the result.
EXERCISES 6.2 1. Prove Theorem 6.2.1(b). 2. a. Use the method of Riemann sums to evaluate f; x2 d, b. Use the method of Riemann sums to evaluate fa x" dx, n E N, n >_ 3.
3. a. Let fbe a real,valued function on [a, b] such that f(x) = 0 for all x # c, , ... , cR. Prove that f E A[a, b] with f; f = 0. *b. Let f, g E.9t[a, b] be such that f(x) = g(x) for all but a finite number of points in ra, b]. Prove that
faf=fog. c. Is the result of part (a) still true if f (x) = 0 for all but countably many points in [a, b]?
4. Let f E 9t[-a, a], a > 0. Prove each of the following. a. If f is even (i.e., f (-x) = f(x) for all x (E [ -a, a]), then f f = 25f.
b. Iff is odd (i.e.,f(-x) _ -f(x) for all x E [-a, a]), then f f = 0. 5. *Let f be a bounded real-valued function on [a, b] such that f E k[c, b] for every c, a < c < b. Prove that
fE
f; f= lira, f b f
6. Let f be continuo6s on [0, 1]. Prove that
f(jf(x)dx.
lim
7. Use the previous exercise to evaluate each of the following limits. (You may use any applicable methods from calculus to evaluate the definite integrals.) R
1 a. lim R-"OnYk k'
R
b. lim Y
i n2
R
k
k2
c. lim
n
R-rook=, n2 + k2
230
8.
Chapter 6
The Riemann and Riemann-Stieltjes Integral
AS in Example 4.4.11(a), let f be the monotone function on [0, 1) defined by
f(x) _
2" 1(x -
x = n/(n + 1), n E N. Find fo f(x) dx. Leave your answer in the form of an infinite series. 9. Suppose f E 9t[a, b] and c E R. Define f, on [a - c. b - c] by f.(x) = f(x + c). Prove that
ffEdt[a-c,b-c]with
Jf(x)ds = I f(x) dx. 6
10. Let f. g, h be bounded real-valued functions on [a. b] satisfying f(x) s g(x) S h(x) for all x E [a. b]. If
f. h E Il[a. b] with f. f = fu h = 1, prove that g E 'lt[a. b] with ff g = 1.
6.
I
Fundamental Theorem of Calculus In this section we will prove two well-known and very important results. Collectively they are commonly referred to as the fundamental theorem of calculus. To Newton and Leibniz, integration was the inverse operation of differentiation. In Leibniz's notation, this result would simply be expressed as f f'(x) dx = f (x), where the symbol f (denoting sum) was Leibniz's notation for the integral. This notation is still used in most calculus texts to denote the indefinite integral of a function. Since the modern definition of the integral is based on either Riemann or Darboux sums, we now need to prove that integration is indeed the inverse operation of differentiation. Both versions of the fundamental theorem of calculus presented here are essentially due to Cauchy, who proved the results for continuous functions. As was illustrated in Examples 6.1.6 and 6.2.7, the computation of the integral of a function, using either Darboux's or Riemann's definition, can be extremely tedious. For nontrivial functions, these computations are in most instances impossible. The first version of the fundamental theorem of calculus provides a major tool for the evaluation of Riemann integrals. We begin with the following definition.
6.3.1
Let f be a real-valued function on an interval L A function F on I is called an antiderivative off on I if F'(x) = f(x) for all x E 1. DEFINITION
Remark. An antiderivative, if it exists, is not unique. If F is an antiderivative off, then so is F + C for any constant C. Conversely, if F and G are antiderivatives off, then
F'(x) - G'(x) = 0 for all x E [a, b]. Thus by Theorem 5.2.9, G(x) = F(x) + C for some constant C.
6.3.2
THEOREM (Fundamental Theorem of Calculus) antiderivative off on [a, b], then
if f E R[a, b] and if F is
J f(x) dx = F(b) - F(a).2 2. The quantity F(b) - F(u} is usually denoted by F(x)l;.
an
6.3 Fundamental Theorem of Calculus
231
Let 9 = (x0, x 1 . . . . . xa} be any partition of [a, b]. If F is an antiderivative off, then by the mean value theorem, for each i = 1, ... , n, there exists t, E (x,_ x,) Proof.
such that
F(x,) - F(x;_,) = f(t,)Ox,. Therefore, a
a
FIf(y)Ox, _
[F(xi) - F(x;_1)] = F(b) - F(a).
Since a
i=1
we have
f f (x) A 5 F(b) - F(a) < J f (x) dx. Ja
a
Thus if f is Riemann integrable on [a, b],
Ibf(x)dx=F(b)-F(a). U a
Remark. The above version of the fundamental theorem of calculus is considerably stronger than the version given in most elementary calculus texts in that it does not require continuity of the function f. We only need that f is integrable and that it
has an antiderivative on [a, b]. We will illustrate this in part (b) of the following example.
6.3.3
EXAMPLES
(a) If f (x) = x", n E N, then F(x) _
+
a,bER,
1
X"11 is an antiderivative off. Thus for any
fb
x" dx = a
I n+l
(bm+1 - an+1).
(b) Consider the function F on (0, 11 defined by
F(x) =
xZ sin
X,
x # 0,
A straightforward computation gives
-cos lx + 2x sin 1x , x # 0 ' f(x) - F'(x) = I 0,
x=0.
232
Chapter6
The Riemann and Rlemann-Stieltjes Integral
Then f is bounded on [0, 1] and continuous everywhere except at x = 0. Thus f E 9t[0, 1 ], and by the previous theorem, i
J
f=F(1)-F(0)=sin1.
(c) Let f be defined on [0, 21 by f(x)_
1, 0 5x< 1, x- 1, 1 5x 52,
and for x E [0, 2] let F(x) be defined by rr
F(x) =
J0
'f(r) dt.
If 0 s x S 1, then F(x) = fo 1 dt = x. On the other hand, if 1 < x s 2, then
F(x)= 1 1dt+ 1(t- 1)dr= o
Thus
0sxs1,
x,
F(x)
2x2-x+Z.
i
2x2-x+2, 1 <x<-2.
The graphs off and F are given in Figure 6.7. Even though f is not continuous at x = 1, the function F is continuous everywhere on [0, 2]. This in fact is always the case, as will be proved in Theorem 6.3.4.
1
The following version of the fundamental theorem of calculus, also attributed to Cauchy, proves that for continuous functions, integration is the inverse operation of differentiation.
6.3.4
THEOREM (Fundamental Theorem of Calculus) [a, b] by
F(x) =
Ja
'f(t) dt.
Let f E 9t[a, b]. Define F on
6.3 Fundamental Theorem of Calculus
233
Then F is continuous on [a, b]. Furthermore, if f is continuous at a point c E [a, b:, then F is differentiable at c and F'(c) = f(c).
Proof. The proof that F is continuous is left as an exercise (Exercise 1). Suppose f is continuous at c E [a, b). We will show that F' (c) = f (c). Let h > 0. Then by Theorem 6.2.3, c+h
F(c + h) - F(c)
J
c+h
c
f(t) dt -
f(t) dt = {
f
o
f(t) A
c
Therefore,
F(c +
h) - F(c) - f(c) h
C
c+h
f(t)
hJ
-
1
h
f (C)
dt -
f" [f(t) - f(c)) dt.
Let E > 0 be given. Since f is continuous at c, there exists a S > 0 such that
NO - f(c) I < E f o r all t,
I t - c I < S. Therefore, if 0 < h < S,
F(c + h) - F(c) - f(c)
Jc+h
I
If(t) - f(c)I dt
h
c
h
Jc +h
Edt=E. c
Thus
m
F(c + h)' - F(c) =
hli-,o
h
Ac);
i.e., F+' (c) = f (c). Similarly, if f is continuous at c E (a, b], F'_ (c) = f (c), which proves the result. Q
Remarks (a) If f is continuous on [a, b], then an antiderivative of f always exists; namely, the function F given by
F(x) =
-f(t) dt, a 5 x :S b.
Since f is continuous, F'(x) = f(x) for all x E [a, b]. As a consequence, we obtain the following more elementary version of Theorem 6.3.2 normally encountered in the
study of calculus: If f is continuous on [a, b] and G is any antiderivative of f, then
f f = G(b) - G(a).
234
Chapter6
The Riemann and Rlemann-Stieltjes Integral
(b) Integrability of a function f on [a, b] does not imply the existence of an antiderivative off. For example, if f is monotone increasing on [a, b] and F(x) = f` f, then for
any c E (a, b), F' (c) = f (c+) and F_(c) = f(c-) (Exercise 14). Thus if f is not continuous at c, the derivative of F does not exist at c.
The Natural Logarithm Function As our first application of the fundamental theorem of calculus, we use the result to define the natural logarithm function In x.
6.3.5
EXAMPLE For x > 0, let L(x) be defined by
dt.
L(z) = i
Since f (t) = 1/t is continuous on (0, oo), by Theorem 6.3.4, L(x) satisfies L'(x) = l/x for all x > 0. Furthermore, since L'(x) > 0 for all x E (0, oo), L is strictly increasing on (0, oo). We now prove that the function L(x) satisfies the usual properties of a logarithm function; namely,
(a) L(ab) = L(a) + L(b) for all a, b > 0, (b) L(e) _ -L(b), b > 0, and (c) L(b') = rL(b), b > 0. r E R. To prove (a), consider the function L(ax), x > 0. By the chain rule (Theorem 5.1.6),
d L(ax) = dX
.a=X=L'(x). ax
Thus by Theorem 5.2.9, L(ax) = L(x) + C for some constant C. From the definition of L we have L(l) = 0. Therefore, L(a) = L(1) + C = C.
Hence L(ax) = L(a) + L(x) for all x > 0, which proves (a). The proof of (b) proceeds analogously. It is worth noting that for the proof of (a) and (b) we only used the fact
that L'(x) = l/x and L(1) = 0. To prove (c), if n E N, then by (a) L(b") = nL(b). Also by (b),
L(b-") = L\\b/"/
=
nL(b)
-nL(b).
Therefore, L(b") = nL(b) for all n E Z. Consider L('6) where n E N. Since nL(-6) = L(b), L(-6) _ L L(b). Therefore, L(b') = rL(b) for all r E 0. Since L is continuous, the above holds for all r E R.
6.3
Fundamental Theorem of Calculus
235
Our final step will be to prove that L(e) = 1, where e is Euler's number of Example 2.3.5. To accomplish this we use the definition to compute the derivative of L at 1. Since L'(1) exists,
1 =L'(1)= ]im n--,ao
L(l +
L(1) i
1mnL(l+nl
=
= lim L(t I +
!T) = L(e). n
The last equality follows by the continuity of L and the definition of e. Therefore, L(e) = 1 and the function L(x) is the logarithm function to the base e. This function is usually denoted by log, x or In x, and is called the natural logarithm function.
Consequences of the Fundamental Theorem of Calculus We now prove several other consequences of Theorem 6.3.4. Our first result is the mean value theorem for integrals.
6.3.6 THEOREM (Mean Value Theorem for Integrals) Let f be a continuous real-valued function on [a, b]. Then there exists c e [a, b] such that b
f
f =f(c)(b - a).
a
Proof.
Let F(x) = fa f. Since f is continuous on [a, b], F'(x) = f(x) for all x E [a, b]. Thus by the mean value theorem (Theorem 5.2.6), there exists c E [a, b] such that
Jbf = F(b) - F(a) = F'(c)(b - a) =f(c)(b - a). 0 a
An alternative proof of the above can also be based on the intermediate value theorem using the continuity of f. This alternative method will be used in the proof of the analogous result for the Riemann-Stieltjes integral.
6.3.7
THEOREM (Integration by Parts Formula) Let f, g be differentiable functions on
[a, b] with f, g' E 9t[a, b]. Then Jb fg' = f(b)g(b) - f(a)g(a) -
gf'.
'Proof. Since f, g are differentiable on [a, b], they are continuous and thus also integrable on [a, b]. Therefore by Theorem 6.2.1(c), fg' and gf' are integrable on [a, b]. Since
(fgY = gf' + fg',
236
Chapter 6
The Riemann and Riemann-Stieltjes Integral
the function (fg)' E 9t[a, b]. By the fundamental theorem of calculus (Theorem 6.3.2), b b Vg), b
= J gf + J fg',
f(b)g(b) - f(a)g(a) = J
a
a
a
from which the result follows. 0
6.3.8
THEOREM (Change of Variable Theorem) Let tp be differentiable on [a, b] with rp' E &[a, b]. If f is continuous on I = rp([a, b]), then h
v(b)
f(x) dx.
f((p(t))w'(t) de a
e(a)
Proof. Since tP is continuous, I = rp([a, b]) is a closed and bounded interval. Also, since f a rp is continuous and tp' E 9t[a. b], by Theorem 6.2.1(c), (f o W)tp' E 9t[a, b]. If I = r([a, b]) is a single point, then tp is constant on [a. b]. In this case rp'(t) = 0 for all t and both integrals above are zero. Otherwise, for x E I define
F(x) = J
f(s) ds.
(a) Since f is continuous, F'(x) = f(x) for all x E 1. By the chain rule,
d F(1P(t)) = F'((p(t))1P'(t) =f(tp(t))w'(t)
for all t E [a, b]. Therefore by Theorem 6.3.2, Jbf((p(t))tp'(t) dt = F((p(b))
F(,p(a)) = J b)f(s) ds. (a)
a
Remark Another version of the change of variable theorem is given in Exercise 10.
6.3.9
EXAMPLE To illustrate the change of variable theorem, consider fo t/(1 + t2) di. If we let (,p(t) = 1 + t2 and f(x) = 1/x, then Joe
1 + t2 which, by Theorem 6.3.8
dt = 2
_Js
102f(`p(t))(p'(t) dt
xdx=21n5.
2
EXERCISES 6.3 1. *Let f E 9t[a, b]. For x E [a. b], set F(x) = f' f. Prove that F is continuous on [a, b].
6.3 Fundamental Theorem of Calculus
237
2. For x E [0, 1 ], find F(x) = fo f(t) dt for each of the following functions f defined on [0, 11. In each case verify that F is continuous on [0, 11. and that F'(x) = f(x) at all points where f is continuous. 1,
a. f(x)=xz-3x+5
0 s x <2
*b. f(x) =
-2, 1 5 x <-1 d. f(x) = x[3x]
c. f(x) = x - [3x]
3. Let f(t) be defined by
f(t)
0st<1, {b'i2, 15t<-2, 0 s x 5 2.
and let F(x) be defined by F(x) = fo f(t) dt,
a. Find F(x). b. For what value of bin the definition off is F(x) differentiable for all x E [0, 2]?
4. Let f be a continuous real-valued function on [a, b] and define Hon [a, b] by H(x) = f; f. Find H'(x). 3. Find F'(x) where F is defined on [0, 1 ] as follows. 1
a. F(x) _
1+t
0
*b. F(x) = fcosf2dr
dt
t
e. F(x) _
1 + t3 dt
d. F(x) =
JIQ) dr, where f is continuous on [0, 1 ]. 0
6. *Let L(x) be defined as in Example 6.3.5. Prove that g1/x) _ -L(x). 7. Suppose f: [a, b] -+R is continuous and g, h : [c, d] -+ [a, b] are differentiable. For x E [c. d] define (AX)
H(x) =
f(t) dt.
1 Mx)
Find H'(x). & Let f : R -+ R be continuous. For a > 0 define g on R by
g(x) = J
f (t) dt.
a a
Show that g is differentiable and find g'(x).
9. *Let f be a continuous real-valued function on [a, b], g E 31[a, b] with g(x) 2z 0 for all x E [a. b]. Prove that there exists c E [a, b] such that
Jef(x)g(x)dx =-f(c) o
J°g(x)dx. a
10. Prove the following change of variables formula: Let rp be a real-valued differentiable function on [a, b] with (x) # 0 fof all x E [a, b]. Let 0 be the inverse function of rp on I = tp([a. b]). If f : 1-+ R is continuous on 1, then (o(b) f(t)4x'(t)dt. . f(rp(x))dx = a
)v(a)
The Riemann and RIemann-Stieltjes Integral
Chapter6
238
11. Evaluate each of the following integrals. Justify each step.
a
2 In x
+b
dx
X
I
(I
c. J
vx
dx
x
d.
x In x d x
0
J
t
at + b dr.
a, b> 0
0 I
e, 10 12.
(4 iI
1/X
1+V
f
j4
dx
dx I
x
Suppose f is continuous on [0, 1 ]. Prove that lim J0
'f
(x") dx = f (O).
13. Suppose f : (a. b] -> R is continuous. Let M = max{jf(x)j: x E [a, b]}. Show that
/b tim
I If(x)r dx
= M.
14. Let f be a monotone increasing function on [a, b] and let F(x) = fo f(t) dt. Prove that F' (c) = f(c+) and
F_(c) = f(c-) for every c E (a, b). 15. Use Theorem 4.4.10 and the previous exercise to construct a continuous, increasing function F on [0, 1) that is differentiable at every irrational number in [0, 11, and not differentiable at any rational number in (0, 1 ].
16. Cauchy-Schwarc Inequality for Integrals: Let f, g E &(a, b]. Prove that
(jb J,bf(x)g(x) dx I 2 5
f 2(x) dx/
(Lb g2(x) dl/
(Hint: For a, 0 E R consider fa (af - /3g)2.) 17. The Exponential Function: As in Example 6.3.5, let L : (0, oo) - R be defined by
f!df.
L(x) I
t
a. Show that L is strictly increasing on (0, oo) with Range L = R. b. Let E : R -i (0, oo) denote the inverse function of L. Use Theorem 5.2.14 to prove that E'(x) = E(x) for an x E R. (The function E is called the natural exponential function, and is often denoted by exp(x).)
c. Prove that E(x + y) = E(x)E(y) for all x, y E R. d. Prove that E(x) = e` for all x E R. where e is Euler's number, and e` is as defined in Miscellaneous Exercise 3 of Chapter 1.
6.4
d.4
Improper Riemann Integrals
239
Improper Riemann Integrals In the definition of the Riemann integral of a real-valued function f. we required that f be a bounded function defined on a closed and bounded interval [a, b. If these two hypotheses are not satisfied, then the preceding theory does not apply, and we have to modify the definition. In this section we will briefly consider the changes required if the function j is unbounded at some point of its domain, or if the interval on which f is defined is itself unbounded.
Unbounded Functions on Finite Intervals If f E It[a. b] with If (x)I s M for all x E [a. b], then by Theorem 6.2.3, f E A [c, b] for every c E (a, b), and
f of
- hf I
=
f I < Ja` U1 < M(c - a).
IJ
As a consequence, if f E lt[a, b], then f E k[c, b] for every c E (a, b) and e
limf
n
f=Jf. a
C
a bounded real-valued function defined only on (a, b] with f E R[c, b] for every c E (a, b). If we define f(a) = 0, then f is a bounded function on [a. b) satisfying f E 1t[c, b] for every c E (a. b). By Exercise 5. Section 6.2. f E %[a, b] with lim
C
a- J f
o
f.
f= a
Furthermore, by Exercise 3 of Section 6.2, the answer is independent of how we define
f(a). Using the above as motivation, we extend the definition of the integral to include the case in which f is unbounded at an endpoint. This extension of the integral is also credited to Cauchy.
6.4.1
Let f be a real-valued function on (a, b) such that f E dt[c, b] for even c E (a, b). The improper Riemann integral off on (a, b], denoted f,' f, is defined to be DEFINITION
b
b
Ja
limf f, Ca' f
provided the limit exists. If the limit exists. then the improper integral is said to be convergent. Otherwise, the improper integral is said to be divergent.
240
Chapter6
TheRlemann and Riemann-Stleltjes Integral
A similar definition can be given if f is defined on (a, b) and is unbounded at b. If f is unbounded at a point p, a < p < b, we consider the improper integrals off on the intervals [a, p) and (p, b]. If each of the improper integrals exists, then we define the improper integral off on [a, b] to be the sum b
i,
af+Jf.
l 6.4.2
EXAMPLES
(a) Consider the function f(x) = 1/x on (0, 1 ]. This function is clearly unbounded at 0. Since f is continuous on (0, 1 ],f e Jt[c, 1 ] for every c E (0, 1). By Example 6.3.5. 1
X
dx=Inc.
To evaluate lim In c we consider In r", where 0 < r < I and n E N. Since In r" _ C- Oo
n In r and In r < 0,
lim In r" = limn In r = -oo. Therefore, since r" _+0 as n -+ oo and In x is monotone increasing, lirm In c = -oo. Thus the improper integral of 1/x on (0, 1) diverges. (b) For our second example we consider the improper integral of L(x) = In x on (0, 1 ]. Since L(x) is continuous on (0, 1), L E 9t[c, 1 ] for every c E (0, 1). Consider ff' In x dx. If we take g(x) = x, then by the integration by parts formula, j In x dx =
L(x)g'(x) dx J
= L(l)g(l) - L(c)g(c) - J L'(x)g(x) dx
=-cInc-1+c. By the substitution c = 1/t, t > 0, and l'Hospital's rule,
lira c In c = lim
1-.0o
-1n t t
= -lim 1 = 0. t-00 t
Therefore, lim I In x dx = -1. C
c-+O'
Hence the improper integral of In x converges on (0, 1 ) with
I 0
lnxdx = -1.
6.4
Improper Riemann Integrals
241
(c) Consider the function f defined on [ -1, 1 ] by
-1 sx<-0.
0,
f(x)=
1,
x
0<xsl.
Here f is unbounded at 0. For this example, the improper integral off over [ -1, 1' fails to exist because the improper integral off over (0, 1 ] does not exist. (d) There are some significant differences between the Riemann integral and the im-
proper Riemann integral. For example, if f E 9t[a, bJ, then by Theorem 6.2.1. f2 E 9t[a, b]. This however is false for the improper Riemann integral! For example. if f (x) = 1/Vx, x E (0,1 ], then
Jldx ,l° x
z
Thus the improper integral off converges on (0, 1]. However, f2(x) = t/x, and the improper integral of 1/x on (0, 1 ] diverges. Also, if f E 9t[a, b], then [f I E 9t[a, b]. This .again is false for improper Riemann integrals. In Exercise 4, we provide an example of a function f for which the improper integral off converges, but the improper integral of L f I diverges.
Infinite intervals We now turn our attention to functions defined on infinite intervals.
6A.3
DEFINITION
Lei f be a real-valued function on [a, co) that is Riemann integrable on
[a, c) for every c > a. The Improper Rlemann integral off on [a. oo), denoted f, f. is defined to be
j= lim J f, C-400 n
provided the limit exists. If the limit exists, then the improper integral is said to be convergent. Otherwise, the improper integral is said to be divergent.
If f is a real-valued function defined on (-oo, bJ satisfying f E 9t[c, b] for every c < b, then the improper integral off on (-oo, b] is defined as
f
f bf,
provided the limit exists. If f is defined on (-oo, oo), then the improper integral off is defined as
xf+I
30f,
242
Chapter 6
The Riemann and Riemann-Stieltjes Integral
for some fixed p E R, provided that the improper integrals off on (-oo, p] and [ p, oo) are both convergent. For a function f defined on (-oo, oo), care must be exercised in computing the improper integral off. It is incorrect to compute
For example, if f (x) = x, then lim 1 x dx = c--tlim 1 (c2 oo 2 -c
C-.0o
- (-c)2) = 0.
However, the improper integral off on (-oo, oo) is divergent since
fc
JOO
f
lim c-.oo
1
x dx = lim - c2 = oo. c-.oo 2
Remark. If f is nonnegative on (a, oo) with f E Jt[a, c] for every c > a, then f.f is a monotone increasing function of c on [a, oo). Thus lim f. f exists either as a real number or diverges to no. For this reason, if f (x)
0 for C
all x E [a, oc), we use the notation rb
Jf(x)dx < oo
or
J
f(x) dx = 00
to denote that the improper integral off on [a, oo) converges or diverges to no respectively.
6.4.4
EXAMPLES
(a) Let f (x) = 1/x2, x E [ 1, oo). Since f is continuous on [ 1, co), f e Jt[ 1, c) for everyc > 1. Therefore,
Ji=l
c-+ao
Ix
imf'Idx=liml-1+1)=1.
c-.oo\
C
Thus the improper integral converges to the value 1. (b) In this example we consider the function f (x) = (sin x)/x, x E [v, oo). Sincef is
continuous, f E 9t[a, c] for every c > v. This function has the property that the improper integral off on [a, o0) converges, but the improper integral of VI diverges. The proof of the convergence of the improper integral off is found in Exercise 7. Here we will show that
IfI = r
Isin xl
=oo.
6.4
Improper Riemann Integrals
243
For n E N, consider sin xI J
J
km1
x
a
((k "i° Isin xl dx. x ka
dx =
Since the integrand is nonnegative, (k +3/4h.
(k+I)" {sin xf
>
x
J(k+1/4hr
I
>_
(k
t )ir
x
\/2. Also,
On the interval [(k + 1)1r, (k + ;)1r], sin xl
x
Isin
hr,+4)JrJ. forallxErlk+4(k / \\
/
(k+3/4)n Isin x
x
Ia 22(k+1)rr
ll
ll
k+ 1' and as a consequence, "+
f
sin xl
x
1,/2 4
dx
k_ik+l
By Example 2.7.4, the series 7,k 1 k diverges. Therefore,
(°° !sin J A
X
dx = ".4 lim
("+I)vIsinxI ]r
x
dx = oo.
As the previous example shows, the convergence of the improper integral off does imply the convergence of the improper integral of If 1. If f is a real-valued function on [a, oo) such that f e ,[a, c] for every c > a and the improper integral of If I converges on (a, oo), then f is said to be absolutely integrable on [a, oo). An analogous definition can be given for unbounded functions on a finite interval. We leave it as an exercise to prove that if f is absolutely integrable on [a, oo), then the improper integral off also converges on [a, oo) (Exercise 5). We conclude this section with the following useful comparison test for improper 'integrals.
244
Chapter 6
6.4.5
The Riemann and Rlemann-Stleltjes Integral
THEOREM (Comparison T e s t )
Let g : [a, oo) -+ R be a nonnegative f u n c t i o n satis-
fying g E 9t[a, c] f o r every c > a and f g(x)dx < oo. If f : [a. oo) --+R satisfies (a) f E Jt[a, c] for every c > a, and (b) I f (x) 5 g(x) for all x E [a, oo), then the improper integral off on [a, oo) converges, and
J
:5 J g(x)dx.
(x) dx
Proof. The proof is left to the exercises (Exercise 6).
N EXERCISES 6.4 1. For each of the following functions f defined on (0, 1), determine whether the improper integral off converges. If it converges, find fo f.
'a f(x) = Xp> 0 < p < I
1>
*d. f(x) = x In x
f(x) _
c. f(x) =
x
e. f(x) = (I + x) I
Inxx
f. f(x) = tan
+ x)
(Zx)
2. For each of the following, determine whether the improper integral converges or diverges. If it converges, evaluate the integral. *a.
fee*dx
b.
°O In.r
X ax
d.
Jx_'dx. p > I
C.
x
i
o
°D
dx
2
f'xZ+,dx h.
g.
dx
°G
*e. E x l n x
2
f(x2+ 1)pdx. P> I
x(l n x)P"
P> 1
f IV
I.
(x2+ 1)(x+
1)dx
3. For each of the following, determine the values of p and q for which the improper integral converges. *a. f I/2xpjlnxjpdx
c.
b.
0
Jaxp[ln(l +x)]°dx 0
2
4. Petfbedefined on(0, 1]by
f(x) =
±(X2 sin
X2)- 2x sin X2 -
cos X2.
Show that the improper Riemann integral off converges on (0, I ], but that the improper integral of VI diverges on (0,1 1.
5. *If f is absolutely integrable on [a. oo) and integrable on [a, c] for every c > a, prove that the improper Riemann
integral off on [a, oo) converges.
6. Prove Theorem 6.4.5.
6.5 The Riemann-Stieltjes Integral
245
x E [1r,oo). +a. Show that the improper integral of If I converges on [1r, oo).
7. Let f(x) _ (cos
*b. Use integration by parts on [ir, c], c > ir, to show that J
sin x dx exists. x
8. Show that fox-' sin x dx converges for all p, 0 < p < 2.
9. Forx>0,set
The function r is called the Gamma function. a. Show that the improper integral converges for all x > 0. b. Use integration by parts to show that r(x + I) = xr(x), x > 0.
c. Show that r(1) = I. d. For n r= Rl, prove that r(n + 1) = W.
The Riemann-Stieltjes Integral In this section we consider the Riemann-Stieltjes integral, which, as we will see, is an extension of the Riemann integral. To motivate the Riemann-Stieltjes integral we consider the following example from physics involving the moment of inertia.
6.5.1
EXAMPLE Consider n-masses, each of mass m;, i = 1, ... , n, located along the x-axis at distances r, from the origin with 0 < rt < < r (Figure 6.8). The moment of inertia 1, about an axis through the origin at right angles to the system of masses, is given by
1 = ; r?m;.
0
HIM
Figure 6.8
3. Since the results of this section are not specifically required in subsequent chapters, this topic can be omitted on first reading of the text.
246
Chapters
The Riemann and Riemann-Stieltjes Integral
On the other hand, if we have a wire of length I along the x-axis with one end at the origin, then the moment of inertia 1 is given by ! = jxp(x)dx.
where for each x E [0, 1). p(x) denotes the cross-sectional density at x.
Although these two problems are totally different, the first being discrete and the second continuous, the Riemann-Stieltjes integral will allow us to express both of these
formulas as a single integral. In the definition of the Riemann integral, we used the length Axi of the ith interval to define the upper and lower Riemann sums of a bounded function f. The only difference between the Riemann and Riemann-Stieltjes integral is that we replace Axi by
Aai = a(xi) - a(x; _ 1), where a is a nondecreasing function on [a, b]. Taking a(x) = x will give the usual Riemann integral. Although the modification in the definition is only minor, the consequences are far-reaching. Not only will we obtain a more extensive theory of integration, but also an integral that has broad applications in the mathematical sciences.
Definition of the Riemann-Stieltjes Integral Let a be a monotone increasing function on [a, b], and let f be a bounded real-valued function on [a, b]. For each partition 9 = {xo, x1 , .. . , of [a, b], set Aai = a(xi) - a(x;_ 1),
i=
..
, n.
Since a is monotone increasing, Aai ? 0 for all i. As in Section 6.1, let m, = inf{ f(t) : t E [x,_ i, xi]},
M, = sup{f(t):t E [xi_1,xi]}. As for the Riemann integral, the upper Riemann-Stieltjes sum off with respect to a and the partition 91, denoted all.(9, f, a), is defined by
kt(9, f, a) _
r=
M;Aa,.
Similarly, the lower Riemann-Stleltjes sum off with respect to a and the partition 9, denoted 2(9, f, a), is defined by -Y(9, f, a) _
miAai. i=1
Since m; s M, and Aai ? 0, we always have 2(91,f a) < all(9, f, a). Furthermore, if m s f(x) s M for all x E [a, b], then m[a(b) - a(a)] <_ Z(9, f, a) 5 Rt(9, f, a) < M[a(b) - a(a))
(10)
6.5
The Riemann-Stieltjes Integral
247
for all partitions 9 of [a, b]. Let 96 be any partition of (a, b). Since Mi s M for all i and
Aai ? 0, n
Mla1 = M
Mi4ai -.5
Lai = M[a(b) - a(a)).
i=1
i=1
Thus °U,(9), f, a) <_ M[a(b) - a(a)]. The other inequality follows similarly. In the above we have used the fact that n
I Aai = (a(xl) - a(x0)) + (a(x2) - a(xl)) + .
+ (a(xn) - a(xn-1))
i-
= a(xn) - a(xo) = a(b) - a(a)In analogy with the Riemann integral, the upper and lower Riemann-Stleltjes integrals off with respect to a over [a, b], denoted fQ f da and f; f da respectively, are defined by b
f da = inf{ott(91, f, a) : 9 is a partition of [a, b]},
Jfda = sup{f(9, f, a) : 9' is a partition of [a, b]}, n
By inequality (10) the set {qL(91, f, a) : 9' is a partition of [a, b]} is bounded below, and thus the upper integral off with respect to a exists as a real number. Similarly, the lower
sums are bounded above, and thus the supremum defining the lower integral is also finite. As for the Riemann integral, our first step is to prove that the lower integral is less than or equal to the upper integral.
6.5.2
THEOREM Let f be abounded real-valued function on [a, b], and a a monotone increasing function on [a, b]. Then
Jfda. e Jabfda:5 Proof. As in the proof of Lemma 6.1.3, if 9'* is a refinement of the partition 9, then X(91,f a) <_ X(91*,f, a) :5 gL(96*,f a) c ah(y,f, a). Thus if 91, 2, are any two partitions of [a, b],
f, a) s 2(9 U a j a) :S %(91 U ll, f, a) < 61L(,, f, a). Therefore T(91, f, a) <_ 6tL(9;, f, a) for any partitions 9, 9.. Hence
Jfda = sp96,f,a)
a)
a
for any partition 9.. Taking the infimum over a gives the result. O
248
Chapters
6.5.3
The Riemann and Riemann-Stieltjes Integral
Let f be a bounded real-valued function on [a, bl, and a a monotone increasing function on [a, b). If DEFINITION
h
h
fda = Jfda. f
then f is said to be Riemann-Stieltjes integrable or integrable with respect to a on [a, b). The common value is denoted by h
(h
fda
or
f (x) da (x),
! a
a
and is called the Riemann-Stieltjes integral off with respect to a. As was indicated previously, the special case a(x) = x gives the usual Riemann integral on [a, b).
6.5.4
EXAMPLES
(a) Fix a < c 5 b. As in Definition 4.4.9, let 1,.(x) = I (x - c) be the unit jump function at c defined by
= 1`(x)
f0, x
t 1,
x?c.
We now prove the following: If f is a bounded real-valued function on [a, b] that is con-
tinuous at c, a < c < b, then f is integrable with respect to 1, and
'f(x)
h
dl (x - c) = f (c).
f dl,. =
1
Ja
a
For convenience, we set a(x) = 1,.(x), which is clearly monotone increasing on [a, b). Let 91 = {xo, x1..... x,} be any partition of [a, b]. Since a < c b, there exists an
index k, 1 5 k 5 n, such that Xk- I < C 5 xk.
Then
Da* = a(xk) - a(xk_1) = I - 0 = 1,
and
Aa;=0, foralli#k. Therefore,
olt(91, f, a) = Mk&ak = Mk = sup{f(t) : xk_, <_ t 5 xk}, Z(91, f, a) = mk&ak = Mk = inf{f(t) : xk_ 15 t 5 xk}.
Since f is continuous at c, given e > 0, there exists a S > 0 such that
f(c) - e < f(t)
and
6.5
The Riemann-Stieltjes Integral
249
f o r all t E [a, b] with I t - cI < S. If 91 is any partition of (a, b] with x, - xx_, < S for all j, then AC) - E S Mk c Mk :5 AC) + E. Therefore, f (c) - E S Y(91, f , a) : 5U(91, f, a) <_ f(c) + e. As a consequence.
f(c) - E
b
f dc, _ I b f da
Jn
f (c) + E.
o
Since e > 0 was arbitrary, the upper and lower integrals off are equal, and thus f is integrable with respect to a on [a, b] with Jb
f da = f (c).
(b) The function f(x) _
1
x E
0, x6EQ, is not integrable with respect to any nonconstant monotone increasing function a.
Suppose a is monotone increasing on [a, b], a < b, with a(a) * a(b). If 91 = (xo, x,, ... , is any partition of [a, b], then m; = 0 and M; = 1 for all i = 1, ... , n. f, a) = 0 and Therefore, i a; = a(b) - a(a).
Rt(91,f, a)
Thus f is not integrable with respect to a.
Remark. It should be noted that in Example 6.5.4(a) only left continuity off at c is required (Exercise 2(a)).
The following theorem, which is the analogue of Theorem 6.1.7 for the Riemann integral, provides necessary and sufficient conditions for the existence of the RiemannStieltjes integral. The proof of the theorem follows the proof of Theorem 6.1.7 verbatim and thus is omitted.
6.5.5
THEOREM Let a 'be a monotone increasing function on [a, b]. A bounded realvaluedfunction f is Riemann-Stieltjes integrable with respect to a on [a, b] if and only if for every e > 0; there exists a partition 9 of [a, b] such that
a) -
a) < E.
Furthermore, if 9 is a partition of [a, b] for which the above holds, then the inequality also holds for all refinements of P.
We now use the previous theorem to prove the following analogue of Theorem 6.1.8. Except for some minor differences, the two proofs are very similar.
250
Chapter 6
The Riemann and Riemann-Stieltjes Integral
6.5.6 THEOREM Let f be a real-valued function on [a, b) and a a monotone increasing function on [a, b). (a) If f is continuous on [a, b), then f is integrable with respect to a on [a, b]. (b) 1f f is monotone on [a, b] and a is continuous on [a, b], then f is integrable with respect to a on [a, b].
Proof. (a) The proof of (a) is identical to the proof of Theorem 6.1.8(a) except that given e > 0, we choose 71 > 0 such that
[a(b) - a(a)),q < e. The remainder of the proof now follows verbatim the proof of Theorem 6.1.8(a). of [a, b] (b) For any positive integer n, choose a partition 91 = {x°, x,.... , such that
Aa; = a(x;)
- a(x;_,) = n [a(b) - a(a)].
Since a is continuous, such a choice is possible by the intermediate value theorem. Assumef is monotone increasing on [a, b]. Then M; = f(xi) and m; = f(x,_1). Therefore,
1!t(91,f a) - 2(91,f, a) _ i (Ax) - f(x+-,)]Dal
i-t
[a(b) - a(a)] n
U(x;) - Ax,-0] i=1
[a(b) - a(a))
n
U(b) - f(a)).
Given e > 0, choose n E N such that
[a(b) - a(a)] n
[f(b) - f(a)) < e.
For this n and corresponding partition 91, °ll(?, f, a) -
f, a) < e, which proves
the result. Q Remark. In part (b) above, the result may be false if a is not continuous. For example, if a < c < b, then the monotone function 1, is not integrable with respect to 1, on [a, b] (Exercise 2b). The article by Kenneth Ross, listed in the Supplemental Reading section, suggests an alternative approach to the Riemann-Stieltjes integral that eliminates this difficulty.
Properties of the Riemann-Stieltjes Integral We next consider several basic properties of the Riemann-Stieltjes integral. For rotational convenience, we make the following definition.
6.5
The Riemann-Stieltjes Integral
251
6.5.7
For a given monotone increasing function a on [a, bJ, 9R(a) denotes the set of bounded real-valued functions f on [a. b] that are Riemann-Stieltjes integrable with respect to a.
6.5.8
THEOREM
DEFINITION
(a) If f, g E gi(a), then f + g and cf are in %(a) for every c E R and Jb
b
b
fda + f
(f + g)da = 1a
a
b
g da,
a
b
cf da = c a
I
fda.
(b) If f E 9t(a;), i =Jfd(ai 1, 2, then f E 9R(a1 + a2) and
+ a 2) = Jfdai + Jfda2. (c) If f E °Jt(a) and a < c < b, then f is integrable with respect to a on [a, c] and [c, b] with b
a
b
fda= f.cf da+ Jcfda.
f
(d) If f, g E t(a) with f (x) <_ g(x) for all x E [a, b), then rb
rb
Ja
Ja
f da
g da.
(e) If I f(x)I 5 M on [a, b] and f E 9R(a), then If I E 9t(a) and b Ja
f
f da < blf I da
M[a(b) - a(a)].
a
Proof. We provide the proofs of (b) and (e). The proofs of (a), (c), and (d), along with other properties of the Riemann-Stieltjes integral. are left to the exercises. (b) Since f E %(a;), given e > 0, there exists a partition 9D,, i = 1, 2, such that
-U.(gli, f, ai) - X(`l...f a.) < Z Let 9' = 91, U 912. Since 91 is a refinement of both 91, and 912, inequality (11) is still valid for the partition 91. Thus since
A(a1 + a2); = A(a,)1 + A(a2)i
forall i = 1,...,n,
252
Chapter 6
The Riemann and Riemann-Stleltjes Integral
61L(@1 j, al + a2) - £(9, J, al + a2)
= °lL.(9,f a,) - `-e(91,f, a,) + °1L(J,f a2) - `-e(g,f a2) e
E
< 2 + 2 = 6. Therefore by Theorem 6.5.5, f E 9t(al + a2). Furthermore, for any partition 91 of [a, b),
2(91j, a, + a2) _ ZP,f al) + £(9j a2) t((b
rb
Jfda,+Jfda2 a
a
a, + a2).
< °d(91,f, a,) + °tt(9a,f, a2)
Thus since f E 9t(al + a2),
f
b
b
f d(a, + a2) =
f da, +
I
b
f f dal.
(e) Suppose f E 9t(a) and 91 _ {x°, x,. ... . xa} is a partition of [a, b]. For each
i= 1,. ..,n,let
M; = sup{f(t): t E [xi_,,xi]}, M* = sup{I f(t)I:t e [xi_,,xi]}, mi = inf{f(t): t e [xi_,,x.]}, m* = inf{I f(t)I : t E [xi_,,xi]}. If t, x E [xi_,, xi], then
II f(t) - If(x)II
1f(t) -f(x)I <_Mi - mi.
Thus M*i - m * 5 Mi - mi, for all i = 1, . .. , n, and as a consequence, °u(91, If 1 , a) - ,x(91, I f I, a) s tlL(91, f, a) - X(Ol, f, a).
Therefore by Theorem 6.5.5, If I E 9t(a). Choose c = t l such that c f f da -e 0. Then
JQfda =cJafda= J cfdas jbIfIdcr
MJ da
= M [a(b) - a(a)]. As for the Riemann integral, we also have the following mean value theorem and integration by parts formula for the Riemann-Stieltjes integral.
6.5.9
THEOREM (Mean Value Theorem) Let f be a continuous real-valued function on [a, b], and a a monotone increasing function on [a, b]. Then there exists c E [a, b] such that
J
f da = f(c) [a(b) - a(a)J-
6.5
The Riemann-Stieltjes Integral
253
Proof. Let m and M denote the minimum and maximum off on [a. b} respectively. Then by Theorem 6.5.8(d), b
m[a(b) - a(a)] s
f fda <_ M[a(b) - a(a)]. a
If a(b) - a(a) = 0, then any c E [a, b] will work. If a(b) - a(a) # 0, then by the intermediate value theorem there exists c E [a, b) such that b
f (c) = a(b) -1 a(a) J. fda. which proves the result.
6.5.10 THEOREM (Integration by Parts Formula) Suppose a and Pare monotone increasing functions on [a, b]. Then a E 91.(/3) if and only if fl E 9t(a). If this is the case, J b
a d$ = a(b)S(b) - a(a)9(a) - J
a
b/3
da.
a
Proof. By Exercise 9, for any partition 91 of [a, b], and
1u(91, a, (3) = a(b)(3(b) - a(a)f(a) - 2(91, (3, a),
`-x(91, a, 0) = a(b)j3(b) - a(a)f(a)