Documente Academic
Documente Profesional
Documente Cultură
Denitions: Terminologies
Coin being tossed till a head appears: ={H, TH, TTH, TTTH,....},
cardinality is innite; since we can count the sample space, it is countably innite
sample spaces with uncountably nite and uncountably innite will be given later
Denitions: Terminologies
Elements of
Example: Tossing of two coins: The sample points are HH, HT, TH, TT
A subset consists of some or all of these sample points Thus, a subset could be {HH}, {HT}, {TH}, {TT}
{HH, HT}, {HH, TH}, {HH,TT}, {HT,TH}, {HT,TT},{TH,TT} {HH,HT,TH}, {HH,HT,TT},{HH,TH,TT},{HT,TH,TT}, {HH,HT,TH,TT},
Denitions: Terminologies
( if is nite)
Measure theory
The concept of -algebra can be explained more elegantly using measure theory. The mathematical concept of measure is a generalization of the concepts such as length, area, volume etc to more abstract notions. Thus, for a set E dened in d space, one can dene a measure on E which takes positive values only. For a class of subsets A belonging to E , one can state that the measure of A is given by (A) [0, ]. A are referred to as measurable sets.
It is obvious that the measure of the null set , is zero, i.e., () = 0. If the sets A and B are disjoint and measurable, then
This is known as the additive property. Now, if this property is extended to an innite sequence of disjoint measurable subsets An , then ( An ) = ( An ) . n1
n 1
( A B ) = ( A) + ( B ) .
Measure theory
Let us assume that (E ) < . For a measurable set A, it is obvious that A Ac = E . It follows from the additive property that ( Ac ) = ( E ) ( A) < and is measurable. Thus, a collection of subsets E which contains the null set E , is stable under unions, i.e., is dened as algebra.
n 1 An
6
Wednesday 29 January 2014
Measure theory
Thus, formally one can dene measure as follows: Let E be a algebra of subsets of . (, E ) is called a measurable space. A positive measure on (, E ) is dened as a function : E [0, ] such that, () = 0, and for any sequence of disjoint sets An E ( )= ( An ) n1
n 1
, then an element A E is called a measurable set and (A) is its measure. Examples of measure are Lebesgue measure, Radon measure etc. Probability is also a measure.
7
Wednesday 29 January 2014
Measure theory
Let us consider a set with E being the set of events. E forms a -algebra. A probability measure on (, E ) is a positive nite measure denoted by P having a total mass of unity. (, E , P ) is then called the probability space. Mathematically, the probability measure is represented as a function P : E [0, 1] with the probability measure of a set A denoted as P (A).
The question on the importance of dening the probability space triplet (, E , P ) will be addressed later in this course.
8
Wednesday 29 January 2014
Axioms of Probability Assign to each event A , a number P (A) , is called the probability of event A such that,
P ( A) 0 P () = 1 ,
and if A B = , where A and B are mutually exclusive events, then
P ( A + B ) = P ( A) + P ( B ) .
9
Wednesday 29 January 2014
P ( ) = P ( c ) = 0 P ( A) = 1 P ( Ac ) 1
As A Ac = , A Ac = and as P () = 1 , it follows that
P ( A A c ) = P ( A) + P ( Ac )
10
Wednesday 29 January 2014