In S6, you learned about discrete random variables, variables that are typically the result of counting. Continuous random variables are those that result from measuring. For example, we can measure heights, weights, time elapsed.

Motivation

Consider the following situation: You are playing darts and you have the following board:

Rendered by QuickLaTeX.com

What is the likelihood that if you throw a dart, it lands on the 2nd quadrant? The correct and even intuitive answer would be \frac{1}{4}. Why is that? Simply put, the 2nd quadrant occupies a quarter of the circle (of the entire board) and so the likelihood of a dart landing there is \frac{1}{4}. This logic is perfectly correct. What we are comparing is areas. This is how we calculate probabilities with continuous random variables.

The next example is a bit trickier. What is the likelihood that the dart lands exactly on the X? The answer is 0. Think of it in terms of how many points there are on the board. You want 1 precise point out of infinite points. Therefore, it makes sense that this probability is 0.

Even with our area comparison, the area of a point is 0, so the probability should also be zero. A small side-discussion could be: if you can say this about any point, then it would make sense that a dart can never land on the board. This is not true because there are infinite points, and our logic breaks down when we try to expand a finite situation into infinity.

This is the same logical problem as when we compare 1 with 0.9999... (periodic).

Definitions

In this section, we define how to find probabilities of a continuous random variable and also extend the concepts we saw for discrete random variables (i.e.: expectation, variance, and standard deviation) to continuous random variables.

Definition (Probability Density Function – PDF): A Probability Density Function f(x) is a function that describes the probability for a continuous random variable X to take on certain values. f(x) is defined on some interval [a,b]. The probability that X falls within a specific interval [c, d] is given by the integral of the PDF over that interval:

    \[P(c \le X \le d) = \int_{c}^{d} f(x) \, dx\]

Conditions for a Valid PDF: For f(x) to be a valid probability distribution function, it must satisfy the following two properties:

  • 1. Non-negativity: The function cannot have negative values:

        \[f(x) \ge 0 \quad \text{for all } x \in [a,b]\]

  • 2. Total Probability: The total area under the entire curve must equal exactly 1:

        \[\int_{a}^{b} f(x) \, dx = 1\]

In other words, we have an image like this to calculate \mathbb{P}(c\leq X\leq d).

Rendered by QuickLaTeX.com

This also explains why the probability of being an exact value is always 0.

Example: Consider a continuous random variable X with the probability density function given by f(x) = \frac{3}{32}(4x - x^2) for 0 \le x \le 4. Verify that f(x) is a valid probability density function, and then calculate the probability \mathbb{P}(1 \le X \le 3).

Definition (Expectation / Expected Value): The expected value (or mean) \mathbb{E}(X) of a continuous random variable X with a probability density function f(x), defined on [a,b], is given by:

    \[\mathbb{E}(X) = \int_{a}^{b} x \cdot f(x) \, dx\]

Example: Let X be a continuous random variable with the probability density function given by f(x) = \frac{x^2}{9} defined on the interval [0, 3], and f(x) = 0 everywhere else. Show that f(x) is a valid probability density function, find the probability \mathbb{P}(1 \le X \le 2), and find the expected value \mathbb{E}(X).

Definition (Variance): The variance Var(X) (also denoted \sigma^2) of a continuous random variable X defined on a bounded interval with a probability density function f(x) defined on [a, b] is given by:

    \[Var(X) = \int_{a}^{b} (x - \mu)^2 \cdot f(x) \, dx = \int_{a}^{b} x^2 \cdot f(x) \, dx - \mu^2\]

The symbol \mu is just another way to write \mathbb{E}(X). This definition should be relatively intuitive. It is the same definition as you saw in the discrete case, but since we have infinite values we have an infinite sum, which is equivalent to an integral.

Definition (Standard Deviation): The standard deviation \sigma of a continuous random variable X defined on a bounded interval [a, b] is the positive square root of its variance, quantifying the average spread of the probability distribution in the same units as the random variable itself.

    \[\sigma = \sqrt{Var(X)}\]

Example: Let X be a continuous random variable with a probability density function given by f(x) = 0.5x defined on the interval [0, 2]. Show that f(x) is a valid probability density function, and find the expected value \mathbb{E}(X), the variance Var(X), and the standard deviation \sigma.

Exercises

For each function below defined on a bounded interval [a, b], determine whether it represents a valid PDF.

  • 1. f(x) = \frac{3}{26}(x^2 + 1) defined on [1, 3], and f(x) = 0 otherwise.
  • 2. f(x) = \frac{1}{2}(2x - 3) defined on [1, 3], and f(x) = 0 otherwise.
  • 3. f(x) = \frac{4}{15}x^3 defined on [1, 2], and f(x) = 0 otherwise.

Let X be a continuous random variable with the probability density function given by f(x) = \frac{3}{8}x^2 defined on the bounded interval [0, 2], and f(x) = 0 otherwise. Evaluate the distribution by solving the following sub-problems:

  • 1. Calculate the interval probability P(1 \le X \le 2).
  • 2. Compute the expected value \mathbb{E}(X).
  • 3. Find the variance \text{Var}(X).
  • 4. Determine the standard deviation \sigma.

For each probability density function f(x) below defined on its respective bounded interval [a, b], calculate the expectation \mathbb{E}(X), the variance \text{Var}(X), and the standard deviation \sigma. Assume f(x) = 0 everywhere else.

  • 1. f(x) = \frac{3}{125}x^2 defined on the interval [0, 5].
  • 2. f(x) = \frac{3}{26}(x^2 + 1) defined on the interval [1, 3].
  • 3. f(x) = \frac{1}{9}(6x - x^2) defined on the interval [0, 3].
  • 4. f(x) = \frac{1}{2} defined on the interval [1, 3].
  • 5. f(x) = \frac{4}{15}x^3 defined on the interval [1, 2].
error: Content is protected!