10.2.1 Power Spectral Density

So far, we have studied random processes in the time domain. It is often very useful to study random processes in the frequency domain as well. To do this, we need to use the Fourier transform. Here, we will assume that you are familiar with the Fourier transform. A brief review of the Fourier transform and its properties is given in the appendix.

Consider a WSS random process $X(t)$ with autocorrelation function $R_X(\tau)$. We define the Power Spectral Density (PSD) of $X(t)$ as the Fourier transform of $R_X(\tau)$. We show the PSD of $X(t)$, by $S_X(f)$. More specifically, we can write \begin{align*} S_X(f)=\mathcal{F} \{R_X(\tau) \}= \int_{-\infty}^{\infty} R_X(\tau) e^{-2 j \pi f \tau} \; d\tau, \end{align*} where $j=\sqrt{-1}$.

Power Spectral Density (PSD)

\begin{align*} S_X(f)=\mathcal{F} \{R_X(\tau) \}= \int_{-\infty}^{\infty} R_X(\tau) e^{-2 j \pi f \tau} \; d\tau, \quad \textrm{where $j=\sqrt{-1}$.} \end{align*}
From this definition, we can conclude that $R_X(\tau)$ can be obtained by the inverse Fourier transform of $S_X(f)$. That is
\begin{align*} R_X(\tau)=\mathcal{F}^{-1} \{S_X(f)\}= \int_{-\infty}^{\infty} S_X(f) e^{2 j \pi f \tau} \; df. \end{align*}
As we have seen before, if $X(t)$ is a real-valued random process, then $R_X(\tau)$ is an even, real-valued function of $\tau$. From the properties of the Fourier transform, we conclude that $S_X(f)$ is also real-valued and an even function of $f$. Also, from what we will discuss later on, we can conclude that $S_X(f)$ is non-negative for all $f$.
  1. $S_X(-f)=S_X(f)$, for all $f$;
  2. $S_X(f) \geq 0$, for all $f$.
Before going any further, let's try to understand the idea behind the PSD. To do so, let's choose $\tau=0$. We know that expected power in $X(t)$ is given by \begin{align*} E\big[X(t)^2\big]=R_X(0)&= \int_{-\infty}^{\infty} S_X(f) e^{2 j \pi f \cdot 0} \; df\\ &=\int_{-\infty}^{\infty} S_X(f) \; df. \end{align*} We conclude that the expected power in $X(t)$ can be obtained by integrating the PSD of $X(t)$. This fact helps us to understand why $S_X(f)$ is called the power spectral density. In fact, as we will see shortly, we can find the expected power of $X(t)$ in a specific frequency range by integrating the PSD over that specific range.
The expected power in $X(t)$ can be obtained as \begin{align*} E\big[X(t)^2\big]=R_X(0)=\int_{-\infty}^{\infty} S_X(f) \; df. \end{align*}


Example
Consider a WSS random process $X(t)$ with \begin{align} \nonumber R_X(\tau) = e^{-a|\tau|}, \end{align} where $a$ is a positive real number. Find the PSD of $X(t)$.
  • Solution
    • We need to find the Fourier transform of $R_X(\tau)$. We can do this by looking at a Fourier transform table or by finding the Fourier transform directly as follows. \begin{align*} S_X(f)&=\mathcal{F} \{R_X(\tau) \}\\ &= \int_{-\infty}^{\infty} e^{-a|\tau|} e^{-2 j \pi f \tau} \; d\tau\\ &=\int_{-\infty}^{0} e^{a\tau} e^{-2 j \pi f \tau} \; d\tau+ \int_{0}^{\infty} e^{-a\tau} e^{-2 j \pi f \tau} \; d\tau\\ &=\frac{1}{a-j 2 \pi f}+\frac{1}{a+j 2 \pi f}\\ &=\frac{2a}{a^2+4 \pi^2 f^2}. \end{align*}


Cross Spectral Density:

For two jointly WSS random processes $X(t)$ and $Y(t)$, we define the cross spectral density $S_{XY}(f)$ as the Fourier transform of the cross-correlation function $R_{XY}(\tau)$, \begin{align*} S_{XY}(f)=\mathcal{F} \{R_{XY}(\tau) \}= \int_{-\infty}^{\infty} R_{XY}(\tau) e^{-2 j \pi f \tau} \; d\tau. \end{align*}


The print version of the book is available on Amazon.

Book Cover


Practical uncertainty: Useful Ideas in Decision-Making, Risk, Randomness, & AI

ractical Uncertaintly Cover