1

I have a pretty basic question: If a Gaussian random process is uncorrelated with itself, does it imply that it is stationary? I think not, but I wanted to confirm my assertion.

Edit: Uncorrelated with itself means that any two samples of the random process (taken at different times) have zero covariance. In other words:

$$\text{Cov}_X(t_1, t_2)=\text{Cov}(X(t_1), X(t_2))=0~\text{for all}~t_1 \neq t_2$$

Iconoclast
  • 1,058

2 Answers2

2

No, it does not. Uncorrelatedness simply means that the covariance matrix of the process is diagonal for any selection of base points. The variance, however, can still depend on the selection of base points. Only if it wouldn't, and the mean is constant (thanks Dilip), the process would be stationary.

Edit: I have to agree with Dilip that it would only be stationary if the mean is also the same for each location.

fabee
  • 919
  • 1
    This answer worries me a bit. Suppose that $\text{var}(X(t)) = \sigma^2$ for all $t$ where $\sigma^2$ is a finite positive real number. Is it possible to have a Gaussian process for which $$\text{cov}(X(t_1), X(t_2)) = \begin{cases}0, & t_1\neq t_2,\ \sigma^2, & t_1 = t_2,\end{cases}??$$ or is white Gaussian noise (for which we cannot say that $\text{var}(X(t))$ is finite) the only possibility? – Dilip Sarwate Nov 14 '11 at 12:58
  • @Dilip Yes, this is Gaussian white noise, and the variance is finite for every $t$. What makes you think otherwise? –  Nov 14 '11 at 13:27
  • @user15376: I agree. – Iconoclast Nov 14 '11 at 13:27
  • @Dillip: I think you are confusing variance with power. The power in white Gaussian noise is infinite, becuase its PSD is a non-zero constant over $(-\infty, \infty)$. – Iconoclast Nov 14 '11 at 13:29
  • 2
    @ByronSchmuland I am used to thinking of a (continuous-time) white Gaussian noise process as a zero-mean process having autocorrelation function $\frac{N_0}{2}\delta(t)$ where $\delta(t)$ is the Dirac delta or impulse and power spectral density $\frac{N_0}{2}, -\infty<f<\infty$ (as per Iconoclast's comment). For this process, the variance $E[(X(t))^2]$ cannot be said to be finite. For a discrete-time process, there is no issue. – Dilip Sarwate Nov 14 '11 at 13:59
  • 4
    @Dilip: I agree. There are even more pernicious (lack of) measurability issues at play here. See, e.g., the first few pages of Kallianpur's Stochastic Filtering Theory text. – cardinal Nov 14 '11 at 14:13
  • @Dilip I think of Gaussian white noise with index set $T$ as the Gaussian process whose law on $\mathbb{R}^T$ is the product measure $N(0,1)^T$. For each fixed $t\in T$ we have $\mbox{Var}(X(t))=1$ and there are no measurability issues until you start looking at sample paths. –  Nov 14 '11 at 16:18
  • @ByronSchmuland As I said before, when the index set $T$ is a discrete set, I have no concerns, but when $T$ is an interval of $\mathbb R$ (or all of $\mathbb R$), I feel queasy about a continuous-time random process whose autocorrelation function has a discontinuity at the origin (see my answer to this question). cardinal (who knows far more measure theory than I do) also seems to have some concerns on this point. – Dilip Sarwate Nov 14 '11 at 16:48
  • @Dilip As I say, there is no difficulty at all. The collection $(X_t)_{t\in T}$ is simply a set of i.i.d. standard normals. –  Nov 14 '11 at 16:50
  • @Dilip The size, shape, or cardinality of $T$ is irrelevant. But I think that I can't convince you, so I'll stop commenting now. :) –  Nov 14 '11 at 16:52
  • @Dilip: this link might help understand Byron's point. Note that $T$ may be ANY set. – Did Nov 15 '11 at 08:23
  • @Byron: I guess this is what you had in mind... – Did Nov 15 '11 at 08:24
  • 1
    @DidierPiau Yes, this is what I call a white noise process. What I hadn't realized is that some, in particular Kallianpur, explicitly reject this as an appropriate model of white noise when $T$ is uncountable. –  Nov 15 '11 at 13:22
  • @Iconoclast, Could you explain: "The power in white Gaussian noise is infinite, becuase its PSD is a non-zero constant over (−∞,∞)."? Namely, could you build Gaussian White Noise with $ \mathbb{E} \left[ x \left( t \right) x \left( t + \tau \right) \right] = {\sigma}^{2} $ (Namely finite)? – Royi Jun 16 '18 at 19:55
1

I wish to disagree with the accepted answer to a slight extent.

  • A discrete-time Gaussian process $\{X[n] \colon n \in \mathbb{Z}\}$ with the property that $$\text{cov}(X[m],X[n]) = \begin{cases}0, & n \neq m,\\\sigma^2, & n = m \end{cases} $$ has the property that the covariance matrix of $X[n_1], X[n_2], \ldots X[n_m]$ (where $n_1, n_2, \ldots n_m$ are distinct integers) is $\sigma^2I_m$. But the process is not necessarily stationary unless we also require that $E[X[n]]$ is the same for all $n$.

  • Suppose that there is a zero-mean continuous-time Gaussian process $\{X(t) \colon t \in \mathcal{R}\}$ with the property that $$\text{cov}(X(t_1),X(t_2)) = \begin{cases}0, & t_1 \neq t_2,\\\sigma^2, & t_1 = t_2.\end{cases}$$
    Then the distribution of $X(t_1), X(t_2), \ldots X(t_m)$ (where $t_1, t_2, \ldots t_m$ are distinct real numbers) is the same as the distribution of $X(t_1+\tau), X(t_2+\tau), \ldots X(t_m+\tau)$ as is needed for stationarity. However, the autocorrelation function of this process is $$R_X(\tau) = E[X(t)X(t+\tau)] =\begin{cases} \sigma^2, & \tau=0,\\0, & \tau \neq 0,\end{cases}$$ which is discontinuous at $\tau=0$ and has Fourier transform $0$, that is, the power spectral density is $0$.

Dilip Sarwate
  • 26,411