Probability
Probability
Probability
Department of Statistics
Universidad Carlos III de Madrid
Probability
Statistics — 2014–2015
A random experiment is an experiment that can result in different out-
comes, even though it is repeated in the same manner every time and a
probability is used to quantify the likelihood, or chance, that an outcome of
a random experiment will occur.
The sample space is the set of all possible outcomes of a random exper-
iment. We will denoted the sample space by E. The sample space is said to
be discrete if it is finite or denumerable (countably infinite) and continuous
if it is uncountable.
An event is a subset of the sample space of a random experiment. We
will represent the events by capital letters, A, B, C, . . ..
Events are subsets (of a sample space), and thus the basic set operations
(union, intersection, and complement) are used to describe new events from
combinations of existing events.
Union. The union of two events A and B, denoted A ∪ B is the event
that consists of all outcomes that are contained in either of the two
events. It occurs whenever at least one from A and B occurs.
Intersection. The intersection of two events A and B, denoted A ∩ B
is the event that consists of all outcomes that are contained in both of
the two events. It occurs when both A and B occur simultaneously.
Complement. The complement of an event A in a sample space E,
denoted A or Ac is the set of outcomes in the sample space that are
not in the event. It occurs when A does not occur.
Set difference. The (Set) difference. The difference of two events A and
B expressed as A minus B, denoted A \ B is the event that consists of
all outcomes that are contained in A, but not contained in B. It occurs
when A occurs, but B does not.
1
An elementary event is any element (singleton) from the sample space .
A compound event is any event that can be obtained as a union of several
elementary events.
The null or impossible event is the one that never occurs, therefore it is
represented as ∅. Its complement is the certain event, which consists of the
whole sample space, E.
Two events A and B are said to be mutually exclusive if they cannot
occur simultaneously, that is, their intersection is the empty set, A ∩ B = ∅.
A collection of events A1 , A2 , . . . , An is said to be mutually exclusive if for all
pairs, Ai ∩ Aj = ∅ for i 6= j.
A collection of events A1 , A2 , . . . , An is exhaustive if their union is the
whole sample space ∩ni=1 Ai = E.
Definition 1. A probability P associated with a random experiment whose
sample space is E assigns to each member of a collection of events from
the random experiment, A, a real number P (A), that is interpreted as the
probability of A. A probability satisfies the following properties::
1. P (A) ≥ 0 for every event A;
2. P (E) = 1;
3. given a family of events {Ai }ni=1 y Ai ∩ Aj = ∅ if i 6= j, then
[ n X n
P Ai = P (Ai ).
i=1 i=1
2
Property. If A and B are independent, then A and B are also independent,
and the same happens with A and B.
Definition 3. Given two events A and B with P (B) > 0, the conditional
probability of A given B is the probability that A occurs given that B has
occurred, it is denoted by P (A|B),
P (A ∩ B)
P (A|B) = .
P (B)
Property. Two sets A and B with P (A), P (B) > 0 are independent if and
only if P (A|B) = P (A) (or alternatively P (B|A) = P (B)).
3
Assessment of probabilities in practice: Laplace rule. When a ran-
dom experiment has a finite number of equally likely possible outcomes, then
the probability of any event A is
no of outcomes favorable to A
P (A) = .
total no of possible outcomes
n1 × n2 × . . . × nk
Biomedical jargon