1.3.6 Solved Problems:
Random Experiments and Probabilities

Problem
Consider a sample space $S$ and three events $A$, $B$, and $C$. For each of the following events draw a Venn diagram representation as well as a set expression.
  1. Among $A$, $B$, and $C$, only $A$ occurs.
  2. At least one of the events $A$, $B$, or $C$ occurs.
  3. $A$ or $C$ occurs, but not $B$.
  4. At most two of the events $A$, $B$, or $C$ occur.
  • Solution
      1. Among $A$, $B$, and $C$, only $A$ occurs: $A-B-C=A-(B \cup C)$.
      2. At least one of the events $A$, $B$, or $C$ occurs: $A \cup B \cup C$.
      3. $A$ or $C$ occurs, but not $B$: $(A \cup C)-B$.
      4. At most two of the events $A$, $B$, or $C$ occur: $(A \cap B \cap C)^c=A^c \cup B^c \cup C^c$.

      The Venn diagrams are shown in Figure 1.19.
      Probability events
      Fig.1.19 - Venn diagrams for solved problem 1.


Problem

Write the sample space $S$ for the following random experiments.

  1. We toss a coin until we see two consecutive tails. We record the total number of coin tosses.
  2. A bag contains $4$ balls: one is red, one is blue, one is white, and one is green. We choose two distinct balls and record their color in order.
  3. A customer arrives at a bank and waits in the line. We observe $T$, which is the total time (in hours) that the customer waits in the line. The bank has a strict policy that no customer waits more than $20$ minutes under any circumstances.

  • Solution
    • Remember that the sample space is the set of all possible outcomes. Usually, when you have a random experiment, there are different ways to define the sample space $S$ depending on what you observe as the outcome. In this problem, for each experiment it is stated what outcomes we observe in order to help you write down the sample space $S$.

      1. We toss a coin until we see two consecutive tails. We record the total number of coin tosses: Here, the total number of coin tosses is a natural number larger than or equal to $2$. The sample space is $$S=\{2,3,4,\cdots\}.$$
      2. A bag contains $4$ balls: one is red, one is blue, one is white, and one is green. We choose two distinct balls and record their color in order: The sample space can be written as $$S=\{(R,B),(B,R),(R,W),(W,R),(R,G),(G,R),$$ $$(B,W),(W,B),(B,G),(G,B),(W,G),(G,W)\}.$$
      3. A customer arrives at a bank and waits in the line. We observe $T$...: In theory $T$ can be any real number between $0$ and $\frac{1}{3}=20$ minutes. Thus, $$S=\big[0,\frac{1}{3}\big]=\big\{x \in \mathbb{R} | 0 \leq x \leq \frac{1}{3} \big\}.$$


Problem

Let $A$, $B$, and $C$ be three events in the sample space $S$. Suppose we know

Answer the following questions:
  1. Find $P(A \cap B)$.
  2. Do $A$, $B$, and $C$ form a partition of $S$?
  3. Find $P\big(C-(A \cup B)\big)$.
  4. If $P(C \cap (A \cup B))=\frac{5}{12}$, find $P(C)$.

  • Solution
    • As before, it is always useful to draw a Venn diagram; however, here we provide the solution without using a Venn diagram.

      1. Using the inclusion-exclusion principle, we have $$P(A \cup B)=P(A)+P(B)-P(A \cap B).$$ Thus,

        $P(A \cap B)$ $=P(A)+P(B)-P(A \cup B)$
        $=\frac{1}{2}+\frac{2}{3}-\frac{5}{6}$
        $=\frac{1}{3}$.

      2. No, since $A \cap B \neq \emptyset$.
      3. We can write

        $C-(A \cup B)$ $=\bigg(C \cup (A\cup B)\bigg)-(A\cup B)\hspace{30pt}$
        $=S-(A \cup B)$ $\textrm{(since $A \cup B \cup C=S$)}$
        $=(A \cup B)^c$.

        Thus

        $P\big(C-(A \cup B)\big)$ $=P\big((A \cup B)^c\big)$
        $=1-P(A \cup B)$
        $=\frac{1}{6}$.

      4. We have $$P(C)=P(C \cap (A \cup B))+P(C-(A \cup B))=\frac{5}{12}+\frac{1}{6}=\frac{7}{12}.$$


Problem
I roll a fair die twice and obtain two numbers $X_1=$ result of the first roll, and $X_2=$ result of the second roll. Find the probability of the following events:
  1. $A$ defined as "$X_1 < X_2$";
  2. $B$ defined as "You observe a $6$ at least once".
  • Solution
    • As we saw before, the sample space $S$ has $36$ elements.

      1. We have $$A= \{(1,2),(1,3),(1,4),(1,5),(1,6),(2,3),(2,4),(2,5),$$ $$(2,6),(3,4),(3,5),(3,6),(4,5),(4,6), (5,6) \}.$$ Then, we obtain $$P(A)=\frac{|A|}{|S|}=\frac{15}{36}=\frac{5}{12}.$$
      2. We have $$B = \{(6,1),(6,2),(6,3),(6,4),(6,5),(6,6),(1,6),(2,6),(3,6),(4,6),(5,6)\}.$$ We obtain $$P(B)=\frac{|B|}{|S|}=\frac{11}{36}.$$


Problem

You purchase a certain product. The manual states that the lifetime $T$ of the product, defined as the amount of time (in years) the product works properly until it breaks down, satisfies $$P(T \geq t)=e^{-\frac{t}{5}} \textrm{ for all } t \geq 0.$$ For example, the probability that the product lasts more than (or equal to) $2$ years is $P(T \geq 2)=e^{-\frac{2}{5}}=0.6703$.

  1. This is an example of a continuous probability model. Write down the sample space $S$.
  2. Check that the statement in the manual makes sense by finding $P(T \geq 0)$ and $\lim_{t\rightarrow \infty} P(T \geq t)$.
  3. Also check that if $t_1 < t_2$, then $P(T \geq t_1)\geq P(T \geq t_2)$. Why does this need to be true?
  4. Find the probability that the product breaks down within three years of the purchase time.
  5. Find the probability that the product breaks down in the second year, i.e., find $P(1 \leq T < 2)$.

  • Solution
      1. The sample space $S$ is the set of all possible outcomes. Here, the possible outcomes are the possible values for $T$ which can be any real number larger than or equal to zero. Thus $$S=[0, \infty).$$
      2. We have $$P(T \geq 0)=e^{-\frac{0}{5}}=1,$$ $$\lim_{t\rightarrow \infty} P(T \geq t)=e^{-\infty}=0,$$ which is what we expect. In particular, $T$ is always larger than or equal to zero, thus we expect $P(T \geq 0)=1$. Also, since the product will eventually fail at some point, we expect that $P(T \geq t)$ approaches zero as $t$ goes to infinity.

      3. First note that if $t_1 < t_2$, then $P(T \geq t_1)= e^{-\frac{t_1}{5}}>e^{-\frac{t_2}{5}}$$=P(T \geq t_2)$ (since $f(x)=e^{(x)}$ is an increasing function). Here we have two events, $A$ is the event that $T \geq t_1$ and $B$ is the event that $T \geq t_2$. That is, $$A =[t_1,\infty), B=[t_2, \infty).$$ Since $B$ is a subset of $A$, $B \subset A$, we must have $P(B)\leq P(A)$, thus $$P(A)=P(T \geq t_1)\geq P(T \geq t_2)=P(B).$$
      4. The probability that the product breaks down within three years of the purchase time is $$P(T < 3)=1-P(T \geq 3)=1-e^{-\frac{3}{5}} \approx 0.4512$$
      5. Note that if $A \subset B$, then

        $P(B-A)$ $ =P(B)-P(B \cap A)$
        $=P(B)-P(A) \hspace{25pt}$ $ (\textrm{since } A \subset B$).

        Choosing $A=[2, \infty)$ and $B=[1,\infty)$, we can write

        $P(1 \leq T < 2)$ $=P(T \geq 1)-P(T \geq 2)$
        $=e^{-\frac{1}{5}}-e^{-\frac{2}{5}}$
        $=0.1484$



Problem

I first saw this question in a math contest many years ago: You get a stick and break it randomly into three pieces. What is the probability that you can make a triangle using the three pieces? You can assume the break points are chosen completely at random, i.e. if the length of the original stick is $1$ unit, and $x, y, z$ are the lengths of the three pieces, then $(x,y,z)$ are uniformly chosen from the set $$\{(x,y,z) \in \mathbb{R}^3 | x+y+z=1, x,y,z \geq 0\}.$$

  • Solution
    • This is again a problem on a continuous probability space. The basic idea is pretty simple. First, we need to identify the sample space $S$. In this case the sample space is going to be a two-dimensional set. Second, we need to identify the set $A$ that contains the favorable outcomes (the set of $(x,y,z)$ in $S$ that form a triangle). And finally, since the space is uniform, we will divide area of set $A$ by the area of $S$ to obtain $P(A)$.

      First, we need to find the sets $S$ and $A$. This is basically a geometry problem. The two sets, $S$ and $A$, are shown in Figure 1.20.

      Two sets
      Fig.1.20 - The sample space and set $A$ for Problem 6.

      Note that in $\mathbb{R}^3$, $x+y+z=1$ represents a plane that goes through the points $(1,0,0), (0,1,0), (0,0,1)$. To find the sample space $S$, note that $S=\{(x,y,z) \in \mathbb{R}^3 | x+y+z=1, x,y,z \geq 0\}$, thus $S$ is the part of the plane that is shown in Figure 1.20.

      To find the set $A$, note that we need $(x,y,z)$ to satisfy the triangle inequality $$x+y > z,$$ $$y+z > x,$$ $$x+z > y.$$ Note that since $x+y+z=1$, we can equivalently write the three equations as $$x < \frac{1}{2},$$ $$y < \frac{1}{2},$$ $$z < \frac{1}{2}.$$ Thus, we conclude that the set $A$ is the area shown in Figure 20. In particular, we note that the set $S$ consists of four triangles with equal areas. Therefore, its area is four times the area of $A$, and we have $$P(A)=\frac{\textrm{Area of } A}{\textrm{Area of } S}=\frac{1}{4}.$$




The print version of the book is available on Amazon.

Book Cover


Practical uncertainty: Useful Ideas in Decision-Making, Risk, Randomness, & AI

ractical Uncertaintly Cover