n
L1:=E'y:(a;-ai_1) and Ue:=Eri(ai-ai-1 i_1
i=1
in which
'yi := inf f([a1_i,ai])
and
ri :=supf([ai-l,ai]), i = 1,...,n.
If we set A:= A} and Ai := [ai_ 1 i ai], i = 1, ... , n, then n
n
1a=EyilA, and u,:=Eri1A4 are µ-integrable functions on II for which
L1=J 11dµ and U1=J ujdp. Riemann integrability of f means, by definition, that there is a sequence (.4n) of subdivisions of I such that each .,i,,+1 refines its predecessor an and the sequences and (Uk) tend to the same real limit value, the Riemann integral p of f over I. Because of the refinement feature of the sequence (en), (14) is an isotone and (u4) is an antitone sequence. Hence
exists (in R) on 1. If therefore we apply Fatou's lemma 15.2 to the sequence of
functions uj -1j > 0, there follows 0:5
I q dµ < lim (U,4 - Lin) = 0 n-+oo
and so by 13.2, q = 0 p-almost everywhere. Since in addition for every n,1.4 < f < uj holds p-almost everywhere (everywhere except possibly at the points of in),
92
11. Integration Theory
q = 0 almost everywhere entails that
lim 1 j = f
p-almost everywhere on I.
n-+oo
As has been noted, f is bounded, say If 1 <_ M E R. The sequence ([1.4. [) is therefore
majorized by the constant M, a p-integrable function, and so Theorem 15.6 on dominated convergence delivers the 1s-integrability of f as well as the convergence of (1k) to f in mean. From 15.1 finally follows
I fdp=lim J which finishes the proof. 0 Remarks. 1. Consider once again Dirichlet's jump function f on the unit interval (cf. Exercise 2 of §10). Being the indicator function of Q fl 10, 11, it is Borel measurable and almost everywhere 0 with respect to L-B measure .1011. Consequently it is Lebesgue integrable and fo f (x) dx = 0. But f is not Riemann integrable. So the roles of Riemann and Lebesgue integration cannot be reversed in 16.4. 2. Borel measurability of f need not be hypothesized: the above proof shows, even without it, that lim 1.4. = f p-almost everywhere and so f is -almost everywhere equal to the Borel function lim lj, . However, in this case it can well happen that f itself is not Borel measurable. 3. The ideas in the proof of Theorem 16.4 can be amplified into a non-trivial criterion for Riemann integrability. Namely, f : [a, 0] -+ R is Riemann integrable if and only if it is bounded and is continuous at V-almost every point of [a, fiJ. See Theorem 2.5.1 of COHN [1980] or the multi-part Exercise 12.51 of HEwITT and STROMBERG [1965].
16.5 Corollary. The non-negative, real-valued, Borel measurable function f is Riemann integrable over every compact interval. Then f is Lebesgue integrable over R if and only if the improper Riemann integral r+n
,0:= lim J
f (x) dx n
exists. In this case p = f f V. Proof. Denote by pn the Riemann integral of f over An := [-n, +n] for each n E N. According to the theorem just proved
pn=IA From 11.4 and the fact that IA f T f we get
sup p
=
JfdA'.
§16. Applications of the convergence theorems
93
The improper Riemann integral exists, by definition, just if this supremum is finite
and in that case its value g is that supremum. From these observations and the monotone convergence theorem our present result follows. 0
Utilizing the decomposition f = f + - f - into positive and negative parts, it follows from 12.2 and 16.5 that every Borel measurable real function f on R with absolutely convergent improper Riemann integral is also Lebesgue integrable and
f f dal coincides with the improper Riemann integral of f. Obviously too, any open or half-open interval I C iR can take over the role of R in 16.5. By contrast, from the existence of the improper Riemann integral off does not follow the Lebesgue integrability of f, even for continuous functions. Consider, for example, the function f : R -+ 1R defined by f (x) :_ (sin x) Ix when x 54 0 and f (0) := 1 m (sin x)/x = sin'(0) = 1. Of course, it is continuous. If for each k E N we set
ak
I(k+l)w
:=
sinx
dx = (-l)k I
sin t
t
dt,
we see that the signs of the ak alternate, their moduli decrease as k increases, and
r(k+1)n
Jakl < J
(k + 1)a kir
1
1 dx = log
k+r
= log (I +
0 as k -> oo.
00
Therefore the series > ak converges. Using this it is very easy to confirm that the k=1
improper Riemann integral
JrR sin x
lim R ++oo 0
X
dx
exists. On the other hand, k +1)R
L
n
IsinxJ
If I d,\' >
J fa,(n+1)w)
at.
2
(k + 1)lr
J0
= JR+
sin t
F+ kir dt - Jo it+ k7r
x
and so for every n E N
a
sin t
If ( dA'
n
(k+1)n
E k=lJka
dx >
2
n
E k+1 k=11
Since the harmonic series diverges, these inequalities show that fR+ If I dA' = +oo, and so by 12.2 f is not Lebesgue integrable over R+.
III. Calculation of the integral G. The preceding considerations show that integrals which the reader may already have encountered as Riemann integrals can, in the stated circumstances, be immediately interpreted as Lebesgue integrals. Known formulas and computational rules for the Riemann integral thereby become available to the Lebesgue theory as well.
94
H. Integration Theory
As an illustration, consider the non-negative function e-x(1+m2 )
f (x, w) :_
(16.5)
(x,w)ER x1R.
1 + w2
Both f and the function (x, w) t-+ f'(x, w) := -e-:(1+w2) are continuous. For fixed xo > 0 form the auxiliary functions ho(w) := e-220Iwl
and h(w) :_ (1 +w2)-1 ,
w E It.
Their A'-integrability (over R) follows from Corollary 16.5 and the fundamental theorem of calculus. For example, r+ J/
(1 + W2)-1
hm [arctan(W)]"n = r.
n-too
Obviously f (x, w) < h(w) for all (x, w) E HI+ x R. It follows from 12.2 that for each
x E It+ the function w H f (x, w) is A'-integrable. And the real function defined by
(16.6)
V(x) := Jf(z)dw
x E IR+
is continuous by the continuity lemma 16.1. Note that p(O) = r. Since 2 JWJ < 1+w2 for all w E R, we have I f'(x,w)J < ho(w) for all (x, w) E [xo,+oo[x]R. Consequently the differentiation lemma 16.2 insures that
xo > 0, that is, differentiable in JO,+oo[, and
(16.7)
(x) = -
e_2(1+")).1(dw)
for x > 0
and via the substitution t = w f this reads (16.8)
cp'(x) = -Gx-1"2e-z
forx>0
where G designates the integral (16.1) that we are trying to explicitly compute. Its existence is already fart of the preceding analysis, but can also be inferred from
the majorization a-' < e-t, which holds for t > 1. From (16.6), (16.8) and the
§16. Applications of the convergence theorems
95
fundamental theorem of calculus
V(x) - V(a) = GI t-1/2e-° dt = 2G 41. e" dw, for x > 0 and a > 0. Upon letting a run to +oo, we will get (16.9)
p(x) = 2G
+oo a-", dw
J,rif we notice that V(a) -+ 0 as a - +oo, which in turn is a consequence of the inequalities +w2)-1A1(dw) = p(O)e-0
w(a) < e-° f(i
for all a > 0.
Because cp is continuous on R+ we can pass to the limit x -+ 0+ in (16.9) and get
it = p(0) = 2G
r+ e-"'2 dw = G2,
J0
using the obvious (on grounds of symmetry) fact that f °. a-"'' dw = f0+00 e' dw. G = . That is, Since G > 0, it follows finally thatfe2
dx = r
(16.10)
or equivalently, in the form seen in probability theory,
2a.
(16.10')
This derivation goes back to ANONYME [1889J and VAN YZEREN [1979]. A par-
ticularly short alternative one is made possible by Tonelli's theorem (cf. Exercise 4 in §23).
Exercises. 1. Which of the two functions below are integrable, which are square-integrable with respect to Lebesgue-Borel measure on the indicated intervals? (a)
(b)
f (x) := x-1, f (x) := x-1/2,
x E I:= [l, +oo[; x E I:= 10,1] .
2. Show that for every real number a > 0 the function x H e" is A1-integrable over R+.
3. Show that for every real number a > 0 the function x
- a_°x [sinX x13 J
96
1 1. Integration Theory
is A'-integrablc over JO, +oo[ and that
rsinx13 A1(dx) x J
Jo is continuous Oil 10, +00[.
§17. Measures with densities: the Radon-Nikodym theorem Again let (12, dd, p) be an arbitrary measure space and E' = E'(f2, sd) the set of all W-measurable, non-negative numerical fimctions on 12. In 12.4 we defined the integral of every function f E E* over every set A E id'. We are interested here in how this integral behaves with respect to A. 17.1 Theorem. For each function f E E`JA the equation
v(A) :=
(17.1)
f du
defines a measure v on sd.
Proof v(0) = 0 and v > 0. For every sequence (An)nEN of pairwise disjoint sets
from W with A:= U A nEN
IAf =
IA, f n=1
and so by 11.5
v(An),
v(A) n=1
the final property needing to be checked in confirming that v is a measure on 0. 0
17.2 Definition. If f is a non-negative .d-measurable, numerical function on 11, then the pleasure v defined on .0' by (17.1) is called the measure having density f with respect top. It will be denoted by
v=fiz.
(17.2)
Concerning the relationship between v- and µ-integrals we will show
17.3 Theorem. Let f,, E E', v:= fu. Then (17.3)
1
§17. Measures with densities: the Radon-Nikodym theorem
97
or, written out,
Jd(f,i) = f Wf dµ -
(17.3')
An id-measurable function V : fl - R is v-integrable if and only if ,pf is µintegrable. In this case (17.3) is again valid. Proof. First suppose p =
a,lA; is an sad-elementary function. In this case (17.3)
holds because n
n
f ,pdvaiv(A1)a;f lA,fdµ=Jcof d µ. For an arbitrary p E E' there is a sequence (un) in E such that U. T V. Since then un f T W f as well, (17.3) follows from 11.4. Finally, consider any id-measurable numerical function p on Sl. By now we know that
fco+ dv = Jco+f dµ = J(caf)+ dµ and
f
W- dv = f V f du = f(f ) dp.
From these equations and the definition of integrability follows the second part of
the theorem. 0 It now follows that the formation of measures with densities is transitive:
17.4 Corollary. Let f, g E E', v := fit and P := gv. Then B = (gf )µ, that is,
9(fµ) = (9f)µ
(17.4)
Proof. For every A E id
g(A) = f gdv = A
f
lAgdv
and furthermore, according to 17.3
f lA9dv=
f
lA9fdµ= f(9f)dii.
We thus obtain p(A) = fA g f dµ, for all A E W; which is what had to be proved. 0
On the question of uniqueness of density functions we have
17.5 Theorem. For functions f, g E E' (17.5)
f =g
µ-almost everywhere
= f p = gµ .
If either f or g is µ-integrable, the converse implication holds as well.
98
IL . Integration Theory
Proof. If f and g coincide p-almost everywhere, then so do 1A f and 'Ag for each A E a(, whence JALgdp
for allAEd,
which just says that fit = gp. Now suppose that f is p-integrable and that fit = gp. Since g > 0 and f gdp = f f dp < +oc, g is also p-integrable. Let us show that the set
N:={f>g}, which lies in 0 by 9.3, is a p-nullset. For every w E N, f (w) - g(w) is defined and is positive, which means that the definition
h:= 1Nf - 1N9 makes sense. The functions 1N f, 1Ng, being majorized by the p-integrable func-
tions f, g, are themselves integrable. Because fit = gp, they have the same itintegral. From this we getr that
J
hdp=
r Ir fdp- /Ngdp=0.
Since N = {h > 0}, this equality and 13.2 tell us that p(N) = 0. With the roles of f and g reversed, this conclusion reads u(N') = 0, where N' := {g > f }. Since if 54 g} = N U N', the desired conclusion, namely that If 34 g} is a p-nullset, is
obtained. 0 The converse of implication (17.5) is not valid without some additional hypothesis on the densities f and g. The next example illustrates this.
Example. 1. As in Example 2 of §3 let fl be an uncountable set, 0 the a-algebra of countable and co-countable subsets of (1 (see Example 2 in §1). But the measure p will be defined on 0 by p(A) := 0 or +oo, according as A or CA is countable. If f and g are the constant functions on ft with the respective values 1 and 2, then indeed f p = gp, yet f (w) = g(w) holds for no w E ft. Of course, it then follows from 17.5 that neither f nor g is p-integrable. Before turning to the principal problem of this section, we will examine another characterization of a-finite measures which is important for what follows and is of interest in its own right.
17.6 Lemma. Let (fl,.ad,p) be a measure space. The measure is a -finite if and only if there exists a p-integrable function h on Cl which satisfies (17.6)
0
forevery wEf2.
Proof. If It is a-finite, there is a sequence in a0 such that p(An) < +oo for each n E N and A7, fi Cl. Choose positive real numbers gn satisfying both r) < 2-n
§17. Measures with densities: the Radon-Nikodym theorem
99
and i p(An) < 2-n, for each n E N. Then the function 00
h := L?In1A n=1
does what is wanted. It is measurable, 0 < h(w) < 1 for each m E 0, and f h dp < 1.
The converse implication is already known: it is contained in the second part of 13.6.
In the light of 13.2 this lemma has another formulation: For each or-finite measure R there exists a real, measurable function h > 0 such that the measure hp is finite and has the same nullsets as A.
We come now to the main problem, already alluded to: On the v-algebra sF of the measurable space (S2, 0) two measures v and p are given. We pose the question
of how to decide whether v has a density with respect to µ, that is, whether there is an .W-measurable, non-negative, numerical function f on St satisfying v = f p, satisfying in other words
r
v(A)=J fdp
for allAE.d.
a
For an affirmative answer it is necessary, as 13.3 shows, that every p-null set in a be a v-null set as well.
17.7 Definition. A measure v on W is called continuous with respect to a measure it on 0, for short, p-continuous, if every p-nullset from 0 is also a v-nullset. In the case of a finite measure v there is a condition equivalent to p-continuity which clarifies and justifies the terminology:
17.8 Theorem. A finite measure v on jzf is p-continuous if and only if for every c > 0 there exists d > 0 such that v(A) < e. (17.7) . A E O and u(A) 0 if A is a p-nullset. Hence v(A) = 0 and v is thus a p-continuous measure, even without the finiteness
hypothesis. For the converse we will show that if (17.7) fails, then v is not µcontinuous. Thus, for some c > 0 there is no 6, which means there is a sequence with the properties (An)nEN in p(An) < 2_n and v(An) > E for each n E N. We set
A := 41.s .up An := n U An nEN m>n
and have a set in ap which on the one hand satisfies 00
A(A) < µ( U Am) < E p(Am) <_ m>n
m=n
00
m=n
2-m = 2-n+1
for every n E N,
100
II. Integration Theory
whence p(A) = 0, and on the other hand, due to the finiteness of v and 15.3, satisfies
v(A) > limsup
E > 0,
nix
which proves that v is not p-continuous. 0 Examples. 2. Let 12 be an uncountable set, W the or-algebra of countable and cocountable subsets of .W (Example 2 in §1). As in the preceding Example, consider the measure v on .i which assigns to a set the value 0 or +oo according as the set or its complement is countable. Let is denote the counting measure C on at (from Example 6, §3). Since 0 is the only p-nullset, v is trivially µ-continuous. However, v cannot have a density with respect to p. For from v = f p with f E E* it would follow that
0 = v({w}) = f f dp = f(w)k({w}) = f(w) W}
for every w E S2, making f = 0 and therefore v = fit = 0, which is not the case because Sl is uncountable.
Let (R, 0, It) be the 1-dimensional Lebesgue-Borel measure space (so p = 'V) and denote by A" the system of all p-nullsets. Then is an example of a or-ideal in W1: The union of any sequence of its sets is another, as are the intersections of its sets with those of ,5d1 (cf. Exercise 5, §3). These properties insure that 3.
v(A)
-
10 +oo
ifAE-4 if AEJO\.X
defines a measure on 1 (cf. Exercise 6, §3). From its definition it is clear that v is p-continuous. Here however (17.7) falls, since for every b > 0
jp([o,ap = s and v([0,ap =+oo. Thus the finiteness hypothesis on v in 17.8 is not superfluous. Example 2 shows that for the existence of a density f E E' with v = fit, the µ-continuity of v, while necessary, is not sufficient. All the more noteworthy is the theorem of Radon and Nikodym which we will prove, after a preparatory lemma.
17.9 Lemma. Let or and r be finite measures on a o-algebra ii of subsets of 11 and let a := r - a denote their difference. Then there is a set S2o E W with the properties (17.8)
(17.9)
e(fl0) > LOW); @(A) >0
for all AESTOltW.
Proof. Let us first proof the weaker claim: (*) For every, e > 0 there exists 0e E 0 with the properties (17.8') (17.9')
N(1l) >- 9(f) ;
g(A) > -E
for all A ED, ft a/.
§17. Measures with densities: the Radon-Nikodym theorem
101
We may obviously suppose that p(l) > 0, since otherwise SlE := 0 does what is wanted. If then e(A) > -e for all A E .sad, it suffices to choose 1 := Q. So we consider the case that some Al E ad satisfies e(A1) < -e. From the definition of e and the subtractivity of the finite measures a and T, e(CA1) = e(fl) - e(A1) ? e(1) + e > e(11) .
Therefore, if e(A) > -e for all A E (CAI) fl 0, we can set S1E := CA1 and be done. In the contrary case there is a set A2 E (CAI) flsat with e(A2) < -e. Then because A1, A2 are disjoint
e(C(A1 U Az)) = o(Q) - e(A1) - e(A2) > e(fl) + 2e > e(n) and the preceding dichotomy presents itself anew. If after finitely many repetitions of this procedure we have not reached our goal, then we will have generated a sequence (An)nEN of pairwise disjoint sets in gd with e(Sl \ (A1 U ... U An)) > e(Sl)
and e(A.) < -e
for every n E N.
Because of the finite additivity of a and r, this would have the consequence that n
e(A1U...UAn)=Ee(A,) <-ne
for every n E N
i=1
00
and entail the divergence of the series 1 e(An). But the latter is untenable, n=1 because when the a-additivity of a and r is applied to the disjoint union A U An it shows this series to be convergent: nEN 00
00
E e(A,) = 1: (r(An) - a(An)) = r(A) - a(A) E R. n=1
n=1
This contradiction proves that the construction procedure must terminate after some finite number n of steps, with the set QE := C(A1 U ... U An) then satisfying (17.8') and (17.9'). We now take e = 1/n in (*) for successive n E N. The sets (1 can be chosen with
the additional property of isotoneity. For if Sll D 121/2 3 ... 3 Sll/n has already been realized, we simply apply (*) to fll/n as a new base space in the role of Sl, that is, we consider the restriction of the measures or and T to S21/n fl dd. Finally, the set Slo := n Sll/n will be seen to do the desired job. For since 01/n j Sla, nEN
(17.8) follows from (17.8'), and (17.9) follows from (17.9'), which insures that
e(A)>-1/nforallnENandeveryAESlofl.od. O As indicated, this puts us in a position to answer the important question we posed earlier.
17.10 Theorem (Radon-Nikodym). Let u and v be measures on a a-algebra .srd in a set Q. If µ is a-finite, the following two assertions are equivalent:
I l. Integration Theory
102
v has a density urith respect to A. (ii) v is 14-continuous. (i)
Proof. Only the implication (ii)=(i) is still in need of proof. To that end we distinguish three cases.
First Case: The measures µ and v are each finite. Form the set 9 of all d measurable numerical functions g > 0 on Sl which satisfy gµ < v, that is, which satisfy
for allAEd. The constant function g = 0 lies in 9, so 9 is not empty. 9 is moreover sup-stable, that is, g V h E 9 whenever g, h E W. Indeed, setting Al := {g > h}, A2 := CAI, every A E d satisfiees
J
gvhdµ= 1
Ana,
r
gdµ+J
ArA,
Since f gdµ < v(Q) < +oo for every g E 9, the number
ry:=suP{ f 9dµ:gE9) is finite and there is a sequence (g;,) in 9 such that lim f gn dµ = -y. Due to supstability the functions gn := gi V ... V gn lie in 9, and consequently ry > f gn dµ >
f gn dµ (since g,, > gn) for all n E N. Which shows that lim f gn dµ = ry. As the sequence (gn) is isotone, the monotone convergence theorem can be applied,
assuring that f := supgn is a function in 9 and that f f dµ = ry. All this proves that the function g H f g dµ on 9 assumes its maximum value at f. Now we prove that v = f µ. In any case we have f µ < v, since f E 9, and so
T:= V- f A is a finite measure on sat, evidently µ-continuous since v is by hypothesis. We have
to show that r = 0. So let us assume contrariwise that r(Sl) > 0. Due to the µ-continuity of r, this entails that µ(11) > 0 as well, and we may form the real number
Q:=2
(M}>0,
which satisfies r(Sl) = 20µ(Sl) > Qµ(St). The preceding lemma applied to r and a:= Q3µ supplies a set flo E 0 which satisfies
r(flo) - lµ(ilo) > r(1) - $µ(!l) > 0 and r(A) > Qµ(A) for all A E f o n 0. The .sat-measurable, non-negative function fo := f +,81n. therefore has the property
ffodiz=jfdii+I3(QonA)
jfd+r(A)=v(A)
§17. Measures with densities: the Radon-Nikodym theorem
103
for every A E sV. These inequalities put fo in 9. Since r is p-continuous and r(S2o) > Qµ(S2o), we must have µ(S20) > 0, leading to
f
fodµ= ffdµ+ap(no)=7+i3µ(Slo)>7,
an inequality which is incompatible with the definition of -f and the fact that fo E 9. The assumption r(S1) > 0 is therefore untenable, and r = 0, as desired. Second Case: The measure µ is finite and the measure v is infinite. We will produce 00
a decomposition SZ = U On of S1 into pairwise disjoint sets from d with the following properties
(a) A E 1o fl at (b)
n=0
either µ(A) = v(A) = 0 or 0 < µ(A) < v(A) = +oo . v(S1n) < +0o
for all n E N.
To this end let 2 denote the system of all Q E 0 with v(Q) < +oo and define a:= sup{µ(Q) : Q E _l} . This is a real number because the measure µ is finite. There is a sequence (Qm)mEN
in .l with limµ(Qn,) = a. Since 1 is evidently closed under finite unions, (Q,n) U Q,n is then a set from std satisfying may be assumed to be isotone. Qo mEN
µ(Qo) = a. We will show that 52o := CQo satisfies (a). So consider A E Stood with
v(A) < +oo. We need to see that p(A) = v(A) = 0, and since v is µ-continuous we really only need to confirm that p(A) = 0. Since v(A) < +oo and, as noted already, . is closed under union, each Q,n U A lies in 2, so that p(Q,, U A) < a, and consequently µ(Qo U A) = lim p(Qm U A) < a. "t-400
Since A is disjoint from 1o, u(Qo U A) = a + µ(A). Conjoined with the preceding inequality and the finiteness of a this says that indeed p(A) must be 0. Finally, to take care of (b) we merely define S21 := Ql, and u n := Qm \Q,n_1 for all integers m > 2 in order to get a decomposition of S2 with the desired properties. Now let An, vn denote the restrictions of µ, v to the trace a-algebra On fl 8d, for n = 0, 1.... and note that each vn is a µn-continuous measure. Moreover, for all n > 1 both An and vn are finite. Case 1 therefore supplies Cl,, n 0-measurable functions fn > 0 on Cl,, with vn = fnµn Taking fo to be the constant function +oo on Sto, vo = foµo also holds, thanks to (a). Finally, "putting all the pieces together" gives our result in this second case. Namely, the function f on Cl defined to coincide on each Cl,, with fn (n = 0, 1, ...) is non-negative, sad-measurable and satisfies
v=fp.
Third Case: This is the general case: only the a-finiteness of it is demanded. There
is according to 17.6 a strictly positive function h E 2'(µ). The measure hp is therefore finite and possesses exactly the same nullsets as does A. Consequently
v is also (hp)-continuous. By what has already been proved there is then an
104
II. Integration Theory
0-measurable function f > 0 on 1 with v = f (hµ). According to 17.4 v then has the density f h with respect to A. 0 The question arises whether, in the situation of Theorem 17.10 the density f of v is p-almost everywhere uniquely determined. From 17.5 we at least get a positive answer when f is p-integrable, that is, when v is a finite measure. But more is true:
17.11 Theorem. Let v = fit be a measure having a density f with respect to a a-finite measure p on 0. Then f is p-almost everywhere uniquely determined. The measure v is or-finite exactly when f is p-almost everywhere real-valued. Proof. First we show that f is µ-almost everywhere uniquely determined if the measure p is finite. In proving this we may assume that v(St) = +oo, since its truth is otherwise a consequence of the second part of 17.5. Furthermore, as we now find ourselves in case 2 of the preceding proof, the decomposition of St into %J11,... employed there lets us confine our attention to Sto, as 17.5 takes care of the remaining Stn (n E N). So it suffices to treat the case ft = Sto, that is, to assume that p and v are linked by the alternative: A E srp
=
either p(A) = v(A) =0 or 0 < µ(A) < v(A) = +oo.
The constant function +oo is then a density for v with respect to p and what has to be shown for uniqueness is that f = +oo holds p-almost everywhere. And for that it suffices to show that µ({ f < n}) = 0 for each n E N, which in turn is a consequence of the above alternative and the inequalities
v({f
f
fdp
coming from the finiteness of A. We will use 17.6 to reduce the general case of or-finite p to the case just treated.
That lemma supplies a strictly positive function h E 21(p). The measure by = h(fp) = f (hp) has the density f with respect to the finite measure hp, so f is (hµ)-almost everywhere uniquely determined. Since the measures p and hp have the same nullsets, f is therefore also uniquely determined p-almost everywhere.
Next, suppose v is a-finite. From 17.6 once again we get a strictly positive
function k E 21(v). Then kv = (f k)µ is a finite measure, that is, f k is µintegrable, consequently also p-almost everywhere real-valued. Because k takes only non-zero real values, this means that f itself is real p-almost everywhere. Conversely, suppose that f is p-almost everywhere real-valued. We want to 00
see that v is a-finite. First of all, there is a decomposition St = U On of f? n=0
into a sequence of pairwise disjoint sets from 0 each of finite p-measure. Set
An := in - 1 < f < n} for each n E N and Ao := { f = +oo}, the present
§17. Measures with densities: the Radon-Nikodym theorem
105
00
hypothesis being just that p(Ao) = 0. D = U (1li n AJ) is a decomposition of fl i.J=o
into a (doubly-indexed) sequence of pairwise disjoint sets from sat. If each has finite
v-measure, this proves that v is a-finite. Consider any i E Z+. Because p(Ao) = 0
and v = fµ, we have v(1l, n Ao) < v(Ao) = 0. Because v = fit and f < j in AJ, we have v(12i n AJ) < jp(ni) < +oo for all j E N as well. Thus all is proven. 0 In the generality presented here Theorem 17.10 was proved in 1930 by O.M. NIKODYtM (1888-1974). H. Lebesgue proved the theorem in 1910 for the case where At is the L-B measure A1. J. RADON (1887-1956) pushed things further in a fundamental work which appeared in 1913. So 17.10 is often also called the theorem of Lebesgue-Radon-Nikodym. The uniquely determined density f in 17.11 is called the Radon-Nikodym density or the Radon-Nikodym integrand (of v with respect top). A beautiful proof of 17.10 by elementary Hilbert-space methods was discovered in 1940 by J. VON NEUMANN (1903-1957) and appears in many textbooks, e.g., in RUDIN [19871, p. 130-131.
The history of the result to be presented next, the Lebesgue decomposition theorem, runs somewhat parallel, Radon and Nikodym having also made significant contributions. We need a concept complementary to p-continuity, namely p-singularity: 17.12 Definition. Let (Sly, sat) be a measurable space, µ and v measures defined on sat. Let us write v << p if v is p-continuous. v is said to be singular with respect
top (or p-singular), written v J p, if a set N E sl exists with µ(N) = 0 = v(CN). It is obvious that the relation v J p is symmetric in µ and v, so it is also expressed as p and v are singular to each other (or mutually singular). The definition
of v 1 p expresses the fact that for a suitable p-nullset N E W (17.10)
v(A) = v(A n N)
for all A E d,
as follows from v(A) = v(A n N) + v(A n CN) and v(CN) = 0. The condition that v J it thus says that the measure v is "carried by a p-nullset". From v << p
and v 1 p together follows that v(N) = 0, and so v = 0. In this sense the concepts p-continuity and p-singularity are diametral or antipodal. Relative to L-B measure Ad every Dirac measure ex on
d obviously satisfies Ad 1 ex.
17.13 Theorem (Lebesgue's decomposition theorem). If p and v are a -finite measures on a a-algebra sat in a set 12, then v can be decomposed in just one way as v = v, + v, with measures vv, v, on sat that satisfy v, << p and v. J p.
v, is called the continuous part of v with respect to p, v, the singular part. The Radon-Nikodym theorem is applicable to the part vc. Proof. We will carry out the proof in detail only for finite p and v and indicate in Exercise 4 how the reader can then handle the general case himself.
106
1 1. Integration Theory
Existence of a decomposition: Let ,, designate the system of all µ-nullsets in W. Since v(A) < v(Q) < +oo for every A E Of, a := sup{v(A) : A E Xµ}
(17.11)
is a real number. Since .X,, is closed under countable unions, there exists an isotone sequence (An) in .A', with v(An) T a. Since v is continuous from below, it follows
that
v(N) = a for the set N := U A E .A',,. We will show that via nEN
vc(A) := v(A n CN) and v,(A) := v(A n N) two measures are defined on W that do what is wanted. Evidently v = Me + v8, and V. 1 p since N E .NN. To prove that ve 4 it, it must be shown that v(A') = 0 whenever A E -A;, and A:= A n CN. As a subset of A E Xµ, the set A' and then also the set A' U N, is p-null. Therefore v(A' U N) < a by definition of a. But A' n N = 0 and v(N) = a. Hence
a + v(A') = v(N) + v(A') = v(N U A') < a, from which follows v(A') = 0 as desired, since a is finite. Uniqueness of the decomposition: Suppose (17.12)
v=VC +v,=vC'+v,'
are two decompositions of the kind described in the theorem. The measures v v, are carried by p-nullsets N, N' in the sense of (17.10); which means that (17.13)
v,(A)=v,(AnN) and v,(A)=v''(AnN')
Setting No := NUN' gives a set in
for all AEd.
so that from vi,, u< K p follows
v,,(AnNO)
=0
for every A E.Qd.
Therefore (17.12) and (17.13) give
v(AnNo) =v,(AnNo)+v,(AnNO) =v,(AnNO) =v,(AnNonN) = v.(A n N) = v,(A),
for every A E Ad.
Analogously of course, v(AnNo) = v,(A) for every A E 0. Thus we have v, = va. A return to (17.12), recalling that all measures are finite, gives v,; = v'' as well. 0
There is a short, elementary proof of 17.13 that does not make use of the Radon-Nikodym theorem; see Woo [1971).
Exercises. 1. Show that the Dirac measure e., on Rd has no density with respect to .1d, for any x E W'. (Physicists occasionally work with such a "symbolic" density d5,
calling it the Dirac. function at the point x. The correct mathematical object is nevertheless the Dirac measure es.)
§18*. Signed measures
107
2. Show that the relation << on the set of measures on a a-algebra d is reflexive
and transitive. The relation p - v defined as p << v and v « is is then an equivalence relation. Two measures p and v stand in this relation just when they
have the same nullsets. For a-finite measures p and v on d show that p - v is equivalent to v = f 1L for a density f which satisfies 0 < f (w) < +oo for p-almost all (or even for all) w E Q. 3. On a a-algebra 0 in a set 11 two measures a and v are related by v < A. Show that if further it is a-finite, then there is an d-measurable function f satisfying
0< f
4. Lebesgue's decomposition theorem was proved for finite measures p and v. Show
how to infer its validity for a-finite measures from this. [Hint: For the existence proof use 17.6. For the uniqueness proof choose a sequence (An) in 0 with An T Sl and a(An), v(An) finite for each n, and consider the measures vn(A) := v(Af1An),
AEd,nEN.]
5. Let v = vi+ve be the Lebesgue decomposition of a a-finite measure v on d with respect to a a-finite measure p. The singular part V. has the form v,(A) = v(AfN)
for all A E 0 and a suitable p-nullset N E d. Show that if N' is any other pnullset with this property, then u(N 0 N') = v(N A N') = 0. 6. Let (S2, .mot, p) be a measure space, v = f 1A a a-finite measure on d having density f with respect to p. Show that this density function is p-almost everywhere uniquely determined and is p-almost everywhere real-valued. Show that if f is strictly positive, then p itself is a-finite. 7. Let (11, d) be a measurable space. For every measure µ on s0 let .M,,, denote the a-ideal of its nullsets. Show that for any sequence (Pn)nEN of a-finite measures
on ae there is a finite measure µ on d for which /V,,= n N,,, nEN
8. The set n := 10, +oo[ is a group with respect to multiplication. Show that the measure on SZ f1.1 defined by p := han with density function h(x) := 1/x is
invariant under each self-mapping x H as of fI (a E fI). p is thus the Haar measure of the group f2 in the sense of the remark immediately following 8.2.
§18*. Signed measures It is worthwhile turning our attention back to Lemma 17.9. The measure concept in this book is that formulated in Definition 3.3: Measures are premeasures p on a a-algebra sad, and so are non-negative a-additive functions on d satisfying the additional condition u(0) = 0. In Lemma 17.9 we encountered a real-valued, aadditive function p which is the difference of two finite measures. Similarly for any f E 2' (p) the function A H fA f dp on W is the difference of two finite measures, for example f + p, and f -µ. We will call a real function p : sr' - R on a a-algebra a finite signed measure if it is a-additive in the sense of (3.2), non-negativity not being required. From
108
I l. Integration Theory
a-additivity applied to the constant sequence 0, 0.... follows immediately that (3.1) is also satisfied, that is, g(0) = 0, because g is only allowed to take real values. A second pass through the proof of Lemma 17.9 will convince the reader that this lemma is in fact valid for every finite signed measure. As a corollary we immediately get the following theorem on the existence a Hahn decomposition of g, a theorem that goes back to H. HAHN (1879-1934).
18.1 Theorem. Let g be a finite signed measure on a a-algebra and in a set Cl. Then there are sets Sl+, St- E of with Cl = Sl+ U fl-, Sl+ n fl- = 0, and g(A) > 0 for all A in the trace a-algebra Sl+ n 0, and g(A) < 0 for all A E Sl- n dd. Proof. Set
-y:= sup{g(A) : A E 0}
and choose a sequence (An) in 0 with limg(An) = y. By applying 17.9 to the restriction of g to An nad, we may replace An by a set Pn E 0 satisfying g(Pn) > g(An) and g(A) > 0 for all A E Pn n 0. We will then have
y=sup{g(Pn):nEN).
(18.1)
The decomposition of Cl that is sought can be realized by
Sl+ := U Pn,
S2- := S2 \ Q+ .
nEN
Indeed, all A E H+ n .ad satisfy g(A) > 0 because such an A has the form
A = U Bn nEN
with pairwise disjoint sets B. E P. n ad (by the disjointification procedure used in the verification of (3.10)). From this representation of A and the a-additivity
g(B,) > 0. Thus p assumes only non-negative real values
follows g(A) _ n=1
on Sl+ n .sad, that is, the restriction of g to Sl+ n 0 is a finite measure. Moreover, because @(P.):5 g(Sl+) < y and (18.1) this measure satisfies
y=Q(sl+) In particular, y < +oo since p assumes only real values. g(A) > 0 cannot hold for any A E Sl- n .sat, for otherwise g(C+ U A) = g(Sl+) + g(A) > y. Thus, g(A) < 0
for allAESl-n0. Measures (in the sense of Definition 3.3) have occasionally been interpreted as mass distributions on the underlying set Cl. A finite signed measure can be analogously interpreted as an (electric) charge distribution smeared over Cl. The foregoing theorem justifies this metaphor by showing that as with charge in electrostatics, there are two disjoint sets, one carrying all the positive charge, the other all the negative charge.
§18*. Signed measures
109
From this theorem another important feature of signed measures becomes evident: The difference p in Lemma 17.9 is more than an illustrative example of a signed measure - it is the typical signed measure:
18.2 Corollary. Every finite signed measure p on a a-algebra sat in ] is the difference of two finite measures on sat.
Proof. Let fl = S2+ U S2- be a Hahn decomposition in the sense of 18.1. Then evidently p+(A)
p(A n St+)
and p(A) :_ - p(A n St-),
A E sat
define measures on d, which satisfy p = p+ - p-, since each A E sat is the disjoint
union (AnS2+)u(Ancl-). 0 With this result the circle closes: finite signed measures are nothing more than the differences of finite measures. It is however possible to dispense with the finite-
ness hypothesis if a-additivity is handled with sufficient care, but we will not go into this further. In the final analysis it is because of the preceding corollary that we only consider measures with non-negative values in this book. Often to emphasize the distinction with signed measures, what we call simply measures are called positive measures.
Exercises. 1. Show that every finite signed measure on a a-algebra is bounded and assumes a largest and a smallest value.
2. Let p be a finite signed measure on a-algebra d in Sl, and St = Sli U f1i , fl = fl2 Uci be two Hahn decompositions for it. Show that ii LSl2 and Sti OS22 are totally p-nulsets, meaning that p(N) = 0 for every N E 0 which is subset of either of them. Conclude that to within such totally p-nullsets there is only one Hahn decomposition for p. 3. Let p be a finite signed measure on a a-algebra sat in Q. Show that the specific representation p = p+ - p- of p as the difference of the two measures on sat which was produced in the proof of 18.2 is characterized by the following minimality property: In every representation p = pl - p2 as the difference of measures pl, p2
on 0, pl = p+ + 8 and p2 = p + b for an appropriate finite measure 8 on sa7, and indeed if 11 = Sl+ U S2- is any Hahn decomposition of S2 corresponding to p,
8 = (ln+)p2 + (1n-)pl. (Conversely, of course, every finite non-zero measure b on sat generates in this way a different representation of p.) Infer that the only measure v on sat which satisfies v(A) < min{p+(A), p-(A)} for every A E sat is the identically 0 measure. [Remark: The representation p = p+ - p uniquely determined by this minimality condition is called the Jordan decomposition of the finite signed measure p. As with functions, p+ and p- are called the positive part and the negative part of p.]
110
1 1. Integration Theory
§19. Integration with respect to an image measure Along with the measure space (it, .0', i) a measurable space (W,01) and an jW-d'-measurable mapping
T : (fl, a) -a (ft', d') are given. Then the image measure
p` := T(p) is defined in (7.5). The connection between p-integrals and µ'-integrals is elucidated by:
19.1 Theorem. For every s/'-measurable numerical function f' > 0 on 0' (19.1)
Proof. The non-negative function f' o T is d-measurable, by 7.3. The integral on the right-band side of (19.1) is therefore defined. To prove the equality there we first consider only d'-elementary f': n
f
ailA s
i=1
(with coefficients ai E R+ and sets A; E d'). For such f
f'oTa;lAi e=1
with A; := T-r (A;), so this composite is an d-elementary function. Since
T(p)(Ai) = p(Ai)
(i = 1,...,n)
holds by definition of image measures, (19.1) follows in this case. For an arbitrary s9'-measurable f > 0 there is an isotone sequence (un) of d'-elementary functions for which u;, T f'. Then (un o T) is a sequence of s(-elementary functions for which u;, o T T f o T. From the validity of (19.1) for the u;, and Definition 11.3 of the integral in general, we get (19.1) for f'.
19.2 Corollary 1. Let f' be an sf'-measurable numerical function on W. Then the T(µ)-integrability of f' entails the p-integrubility of f' oT, and conversely. In case of integrability (19.2)
1
§19. Integration with respect to an image measure
111
Proof. From 19.1
f (f')+dT(p)=J(f')+
o Tdp and
J(f')_dT(P) = f
(f')- oT d1 z,
and of course
(f'oT)+=(f')+oT
and
(f'oT)-=(f')-oT.
Both claims therefore follow from the definition of the integral 12.1.
19.3 Corollary 2. The mapping T : S2 -+ S2' is bijective and d -d'-measurable,
with W'-d-measurable inverse T'. Further f' is a numerical function on W. Then the T(p)-integrability of f' is equivalent to the p-integrability of f' o T, and in its presence equality (19.2) prevails.
One has only to note that the integrability of f' o T entails the measurability of f' o T and therewith that off'= f' o T o T -1. The content of 19.1-19.3 constitutes what is called the "general transformation theorem for integrals".
As the behavior of the L-B measure with respect to Cl-diffeomorphisms is known from (8.16'), the transformation theorem for Lebesgue integrals follows at once:
19.4 Theorem. Let G. G' be open subsets of W', cp : G -> G' a C1-diffeomorphisrn
of G onto G'. A numerical function f' on G' is Ad-integrable if and only if the function f' o cp I det DWI is Ad-integrable over G, and in this case (19.3)
IG, f' dAd =
fcf' o' I det D,,, I dAd .
Proof. The Ad-integrability of f' over G' and that of f' o W I (let DWI over G means the AG,-integrability and the AC-integrability of those functions, respectively. According to (8.16') ' (Ac) = I det DWI Ad ;
furthermore, the Borel measurability of f' is equivalent to that of f'o
f f'dAc,_f f
f
f'o,pIdctDWIdAd,.
Because of Theorem 19.1, equality (19.3) holds as well for all non-negative, Borel measurable, numerical functions on G'.
112
1 1. Integration Theory
Exercises. 1. Let (0, dal, p) be a measure space, T : fZ -+ f 1 a mapping which together with its inverse is an d-d-measurable bijection. Show that for every f E E (St, .ad) the image measure T(f p) has a density with respect to T(p), namely f o T-1.
2. Let (0,.', p) be a a-finite measure space, T : ) -4 i2 an alf-d-measurable mapping such that T-1(A) is a p-nullset whenever A is. Prove the existence of a measurable function q > 0 such that
r
fA-'(A) f oTdp fqdu
-TJ for all dat-measurable numerical functions f > 0 on fl, and all A E d.
§20. Stochastic convergence Let us return to the study of p-fold integrable functions begun in §14. Our goal will be to replace the almost-everywhere convergence concept that underlies the theorems proved there with a weaker convergence concept. It is suggested by a simple but very useful inequality.
The setting is once again an arbitrary measure space (el, 0,u). 20.1 Lemma. For every measurable numerical function f on 0 and every pair of real numbers p > 0 and a > 0 the Chebyshev-Markov inequality p({IfI >- a}) <-
(20.1)
af
Iflp dp
holds.
For p = 2 this is also known simply as Chebyshev's inequality.
Proof The set A6 := {IfI > a} lies in d and
p>j Iflpdp2j apdp=app(Aa)
fd
a
a
which is what (20.1) claims.
Therefore if f If Ip dp is finite, which when p > 1 means just that f is p-fold integrable, it follows from (20.1) that (20.2)
lim p({IfI > a}) = 0.
a-r+co
One can also study the dependence on it E N of the measures of the sets { I fn - f I > a} when f, fl, f2.... are measurable real functions. That leads to the aforementioned new convergence concept.
§20. Stochastic convergence
113
20.2 Definition. A sequence (fn)nEN of measurable real functions on 1 is said to be (µ-)stochastically convergent (or to be convergent in p-measure) to a measurable
real function f on S2, if for each real number a > 0 and each A E d of finite measure
nlim tt({I fn - f I > a} n A) = 0.
(20.3)
+oo
In this case we also write
µ- lim fn = f
(20.4)
and call f a (µ-)stochastic limit of the sequence (fn). Remarks. 1. For a finite measure p we may take A = 52 in (20.3) and in this case stochastic convergence of (fn) to f is equivalent to the requirement
lim µ({lfn- fI>a})=0
(20.5)
for every a>0.
The more complicated condition (20.3) is dictated by the desire to treat infinite, and especially a-finite, measures as well as finite ones. 2. For a-finite measures p the stochastic convergence of a sequence (fn) to f is generally not equivalent to (20.5), as the next example illustrates.
Example. 1. Let St := N, 0 := .9(N), It the measure (obviously a-finite) defined on sad by the equations
µ({n}) = n
for every n E N
and the requirement of o-additivity. With An := {n, n + 1,.. .} and In := 1A., for each n E N, the sequence (fn) converges stochastically to 0: For every a E 10, 1[, { jn > a} = An, and since An ,. 0, it follows from 3.2 that lim µ(An n A) = 0 for every A E Af having finite measure. On the other hand, u(A.) = +oo for
every nEN.
Remark. 3. Let f be a stochastic limit of a sequence (fn) and consider any measurable real function f' on 11. If f' = f p-almost everywhere in every A E d which has finite measure, then f' is also a stochastic limit of the sequence (fn). This is because the sets
{Ifn-f*I >a}nA and {Ifn-fl>a}nA differ from each other only in an (n-independent) nullset. The converse of this is important:
20.3 Theorem. For every o-finite measure p, any two stochastic limits of a sequence of measurable real functions are µ-almost everywhere equal to each other.
114
1 1. Integration Theory
Proof. If f and f* are stochastic limits of the sequence (fn), then from the triangle inequality in R
{If -f*I2al C{If.-fI? a/2}U{Ifn-f*I2! a/2}, whence
p({If-f*I >a}nA)a/2}nA)+p({Ifn-f*I2:a/2}n A) for every n E N and every A E d. Letting n -3 oo shows that
p({ If -f*1 >- a} nA) = 0 for every a > 0 and every A E ii of finite measure. Then however, f = f* "-almost everywhere in every such set A, since
If 54 f*} n A= U{If - f*1 > Ilk} nA kEN
is a p-nullset. Upon taking for A the sets in a sequence (An) in 41 which satisfies p(An) < +oo for all n and An t 0, the p-almost everywhere equality of f and f follows. D To supplement this fact we mention:
Remark. 4. Stochastic limits f and f* of the same sequence (fn) are almost everywhere equal without any hypotheses on the measure itself if both functions are p-fold integrable for some p E [1, +oo[. This is because for every real a > 0 the
set (if - f* I > a} has finite measure, by (20.1), and so f = f * p-almost everywhere in this set, whence { If - f * I > 0} = U {If - f* I > 1/n} is a countable nEN
union of p-nullsets. This just says that f = f* p-almost everywhere in Sl. But the next example shows that it may fail if one of the functions is not in any 2P-space. Example. 2. Consider the measure space (fl, Y(fl), p), where 11 consists of exactly two elements wo,wl and p({wo}) = 0, p({wl}) = +oo, fn = f = 0 for every n E N. These functions lie in every .2'P(p) and the sequence (fn) converges stochastically
to f , as well as to every real-valued function f * on 0. Every such f* which is non-zero at wl, however, lies in no 2"(p) with 1 < p < +00 and fails to coincide p-almost everywhere in 11 with f. The considerations with which we began this section lead to an important class of stochastically convergent sequences:
20.4 Theorem. If the sequence (fn) in 2P(p) converges in e" mean to a function f E 2P(p) for some 1 < p < +oo, then it also converges to f p-stochastically. Proof. The Chebyshev-Markov inequality tells us that
p({Ifn - fl ?a}nA)
§20. Stochastic convergence
115
holds for every n E N, every a > 0 and every A E s+d. The claimed stochastic convergence, that is, the convergence to 0 of the left end of this chain as n -+ oo, follows because f I fn - f I' dµ -+ 0 as n -+ oo is the definition of convergence
in pth mean. 0 The proof shows that convergence in eh mean actually entails the stronger form of stochastic convergence in (20.5). The situation is different when the given sequence is almost everywhere convergent. (On this point cf. also Remark 5.) 20.5 Theorem. If a sequence (fn)nEN of measurable real functions on fl converges µ-almost everywhere in Sl - or even just p-almost everywhere in each set A E st of finite measure - to a measurable malfunction f on 1l, then this sequence also converges p-stochastically to f.
Proof. For every a > 0,
{Ifn - .fI 1a} C {m>p Ifm - .fI
1a}
n
and so
A({Ifn - fl2! a}nA):5 µ({supI.fm-f1 >a}nA) m>n
for every A E d. The present claim therefore follows from our next lemma, applied
to the restriction of p to A n sl for each A of finite measure. 0 20.6 Lemma. If the measure p is finite, then each of the following three conditions on a sequence (fn)nEN of measurable real functions is equivalent to (fn) converging p-almost everywhere to 0: (20.6)
(20.6')
Ifml > a}) =0
for every a > 0,
lim µ({sip Ifml > a}) = 0
for every a > 0,
p(limsap{Ifnl>a})=0
for every a>0.
lim A n-rao
(20.7)
m>n
m>n
Proof. To prove the equivalence of (20.6) with the almost everywhere convergence of (fn) to 0, we set, for each a > 0 and each n E N
An :_ { sup IN > a} . m>n
Obviously both n H An and a H An are antitone mappings; then k H An/k is isotone on N. If we also set
A:= {w E fl :limo fn(w) = 0} = {w E Sl : limas
op
Ifnl (w) = 0),
1 1. Integration Theory
116
then these lie in W. either by appeal to 9.5 or by noticing that each A; E W and
A= n U kEN nEN
Passing to complements,
CA= U nAnk kEN nEN
and so
n A ;/k r CA as k -+ oo,
and Al/k n 1
fI' dl "m
as n -00.
mEN
nEH
Consequently,
u(CA) = sup p ( n A,imk) = sup inf
(20.8)
kEN
kEN 'nEN
nEN
because the finite measure µ is both continuous from above and continuous from below, by 3.2. Thus (fn) converges almost everywhere to 0 just when the number defined by (20.8) is 0. In turn, the latter occur