1.3.5 Continuous Probability Models

Consider a scenario where your sample space $S$ is, for example, $[0,1]$. This is an uncountable set; we cannot list the elements in the set. At this time, we have not yet developed the tools needed to deal with continuous probability models, but we can provide some intuition by looking at a simple example.



Example
Your friend tells you that she will stop by your house sometime after or equal to $1$ p.m. and before $2$ p.m., but she cannot give you any more information as her schedule is quite hectic. Your friend is very dependable, so you are sure that she will stop by your house, but other than that we have no information about the arrival time. Thus, we assume that the arrival time is completely random in the $1$ p.m. and $2$ p.m. interval. (As we will see, in the language of probability theory, we say that the arrival time is "uniformly" distributed on the $[1,2)$ interval). Let $T$ be the arrival time.
  1. What is the sample space $S$?
  2. What is the probability of $P(1.5)$? Why?
  3. What is the probability of $T \in [1,1.5)$?
  4. For $1 \leq a \leq b \leq 2$, what is $P(a \leq T \leq b)=P([a,b])$?
  • Solution
      1. Since any real number in $[1,2)$ is a possible outcome, the sample space is indeed $S=[1,2)$.

      2. Now, let's look at $P(1.5)$. A reasonable guess would be $P(1.5)=0$. But can we provide a reason for that? Let us divide the $[1,2)$ interval to $2N+1$ equal-length and disjoint intervals, $[1,1+\frac{1}{2N+1}), [1+\frac{1}{2N+1}, 1+\frac{2}{2N+1}), \cdots, [1+\frac{N}{2N+1}, 1+\frac{N+1}{2N+1}),\cdots,[1+\frac{2N}{2N+1}, 2)$. See Figure 1.18. Here, $N$ could be any positive integer.
        Equal-length Intervals
        Fig.1.18 - Dividing the interval $[1,2)$ to $2N+1$ equal-length intervals.
        The only information that we have is that the arrival time is "uniform" on the $[1,2)$ interval. Therefore, all of the above intervals should have the same probability, and since their union is $S$ we conclude that

        $$P\left(\Big[1,1+\frac{1}{2N+1}\Big)\right)=P\left(\Big[1+\frac{1}{2N+1}, 1+\frac{2}{2N+1}\Big)\right)=\cdots\\$$ $$\cdots=P\left(\Big[1+\frac{N}{2N+1}, 1+\frac{N+1}{2N+1}\Big)\right)=\cdots\\$$ $$\cdots=P\left(\Big[1+\frac{2N}{2N+1},2\Big)\right)=\frac{1}{2N+1}.$$
        In particular, by defining $A_N=\left[1+\frac{N}{2N+1}, 1+\frac{N+1}{2N+1}\right)$, we conclude that $$P(A_N)=P\left(\Big[1+\frac{N}{2N+1}, 1+\frac{N+1}{2N+1}\Big)\right)=\frac{1}{2N+1}.$$ Now note that for any positive integer $N$, $1.5 \in A_N$. Thus, $\{1.5\} \subset A_N$, so $$P(1.5) \leq P(A_N)=\frac{1}{2N+1}, \hspace{20pt} \textrm{for all }N \in \mathbb{N}.$$ Note that as $N$ becomes large, $P(A_N)$ approaches $0$. Since $P(1.5)$ cannot be negative, we conclude that $P(1.5)=0$. Similarly, we can argue that $P(x)=0$ for all $x \in [1,2)$.

      3. Next, we find $P([1,1.5))$. This is the first half of the entire sample space $S=[1,2)$ and because of uniformity, its probability must be $0.5$. In other words, $$P([1,1.5))=P([1.5,2)) \hspace{20pt} \textrm{(by uniformity),}$$ $$P([1,1.5))+P([1.5,2))=P(S)=1.$$ Thus $$P([1,1.5))=P([1.5,2))=\frac{1}{2}.$$

      4. The same uniformity argument suggests that all intervals in $[1,2)$ with the same length must have the same probability. In particular, the probability of an interval is proportional to its length. For example, since $$[1,1.5)=[1,1.25) \cup [1.25, 1.5).$$ Thus, we conclude

        $$P\big([1,1.5)\big)=P\big([1,1.25)\big)+ P\big([1.25, 1.5)\big)\\$$ $$=2P\big([1,1.25)\big).$$
        And finally, since $P\big([1,2)\big)=1$, we conclude $$P([a,b])=b-a, \hspace{20pt} \textrm{for } 1\leq a \leq b \lt 2.$$


The above example was a somewhat simple situation in which we have a continuous sample space. In reality, the probability might not be uniform, so we need to develop tools that help us deal with general distributions of probabilities. These tools will be introduced in the coming chapters.

Discussion: You might ask why $P(x)=0$ for all $x \in [1,2)$, but at the same time, the outcome of the experiment is always a number in $[1,2)$? We can answer this question from different points of view. From a mathematical point of view, we can explain this issue by using the following analogy: consider a line segment of length one. This line segment consists of points of length zero. Nevertheless, these zero-length points as a whole constitute a line segment of length one. From a practical point of view, we can provide the following explanation: our observed outcome is not all real values in $[1,2)$. That is, if we are observing time, our measurement might be accurate up to minutes, or seconds, or milliseconds, etc. Our continuous probability model is a limit of a discrete probability model, when the precision becomes infinitely accurate. Thus, in reality we are always interested in the probability of some intervals rather than a specific point $x$. For example, when we say, "What is the probability that your friend shows up at $1:32$ p.m.?", what we may mean is, "What is the probability that your friend shows up between $1:32:00$ p.m. and $1:32:59$ p.m.?" This probability is nonzero as it refers to an interval with a one-minute length. Thus, in some sense, a continuous probability model can be looked at as the "limit" of a discrete space. Remembering from calculus, we note that integrals are defined as the limits of sums. That is why we use integrals to find probabilities for continuous probability models, as we will see later.




The print version of the book is available on Amazon.

Book Cover


Practical uncertainty: Useful Ideas in Decision-Making, Risk, Randomness, & AI

ractical Uncertaintly Cover