<p>Consider the AR process.
<span class="math-container">$$
y_t = \phi_0 + \phi_1 y_{t-1} + \varepsilon_t \tag{1}.
$$</span></p>
<p>The infinite MA represenation is given by:</p>
<p><span class="math-container">$$
y_t = \frac{\phi_0}{1 - \phi_1} + \sum_{j = 0}^\infty \phi_1^{j} \varepsilon_{t-j} \tag{2}
$$</span>
One reason why <span class="math-container">$(2)$</span> is useful is to compute, for example, the mean, variance or covariance for the <span class="math-container">$y_t$</span> terms. Assume that <span class="math-container">$\varepsilon_t$</span> terms are i.i.d. with variance <span class="math-container">$\sigma^2$</span>.</p>
<p>Using <span class="math-container">$(1)$</span> to compute the mean gives:
<span class="math-container">$$
\mathbb{E}(y_t) = \phi_0 + \phi_1 \mathbb{E}(y_{t-1}).
$$</span>
This is not a closed form solution, so it would have to be solved recursively. However, if we use <span class="math-container">$(2)$</span> we get immediately:
<span class="math-container">$$
\mathbb{E}(y_t) = \frac{\phi_0}{1 - \phi_1}.
$$</span>
Also, if we want the compute the variance using <span class="math-container">$(1)$</span> it would look something like this:
<span class="math-container">$$
\mathbb{E}((y_t - \mathbb{E}(y_t))^2) = \left[\phi_0 + \phi_1\mathbb{E}(y_{t-1}) + \varepsilon_t - \frac{\phi_0}{1 - \phi_1}  \right]^2,
$$</span>
Which does not seem very useful. However, using <span class="math-container">$(2)$</span> we get:
<span class="math-container">$$
\begin{align*}
\mathbb{E}((y_t - \mathbb{E}(y_t))^2) &amp;= \mathbb{E}\left[\sum_{j = 0}^\infty\sum_{k = 0}^\infty \phi_1^j \phi_1^k\varepsilon_{t-j}\varepsilon_{k-j}\right],\\
&amp;= \mathbb{E}\left[\sum_{j = 0}^\infty \phi_1^{2k}(\varepsilon_{j})^2\right],\\
&amp;= \frac{\sigma^2}{1 - \phi_1^2}
\end{align*}
$$</span>
Again, computing the covariance starting from <span class="math-container">$(1)$</span> will be quite cumbersome, but using <span class="math-container">$(2)$</span> we easily obtain <span class="math-container">$(\ell &gt; t)$</span>:
<span class="math-container">$$
\begin{align*}
\mathbb{E}((y_t - \mathbb{E}(y_t))(y_{\ell}- \mathbb{E}(y_\ell))) &amp;= \mathbb{E}\left[\sum_{j = 0}^\infty \sum_{k = 0}^\infty \phi_1^j \phi_1^k \varepsilon_{t-j} \varepsilon_{\ell - k}\right]\\
&amp;= \mathbb{E}\left[\sum_{j = 0}^\infty \phi_1^j \phi_1^{\ell - t + j} \sigma^2\right],\\
&amp;= \sigma^2 \phi^{\ell - t} \sum_{j = 0}^\infty \phi_1^{2j},\\
&amp;= \sigma^2 \frac{\phi^{\ell - t}}{1 - \phi^2}
\end{align*}
$$</span></p>

CC BY-SA 4.0
2021-05-31T07:31:59.037Z
Thank you @tdm. I appreciate your rigour there!
EB3112
CC BY-SA 4.0
2021-05-31T13:25:47.777Z
very nice tdm. just a heads up that you have a typo in 2) in that the bottom subscript in summation should be zero. It's  not a bug deal but it might confuse someone trying to see how to go from 2) to the equation with the double sum.
mark leeds
CC BY-SA 4.0
2021-05-31T13:27:48.720Z
@mark leeds Thanks, I'll correct it.
tdm
CC BY-SA 4.0
2021-05-31T23:53:52.420Z
With respect to calculating expectation and variance I would still find it easier to use (1) and simply impose stationarity $\mathbb E[y_t] = \mathbb E[y_{t-1}]$ and $\mathbb V[y_t] = \mathbb V[y_{t-1}]$. I mean I guess the infinite MA-sums only converge if we have stationarity anyway so no generality is lost or am I wrong?
Jesper Hybel
CC BY-SA 4.0
2021-06-01T05:25:13.127Z
@Jesper Hybel That's indeed another option. Please edit the answer (or add one) if you think it's useful.
tdm
CC BY-SA 4.0
2021-07-20T11:14:47.853Z
@tdm: as the question is also about **why** an AR(1) has an MA representation, maybe add a comment how you get there by recursion, and the conditions under which it exists?
BrsG
CC BY-SA 4.0
2021-05-31T06:39:52.497Z
2021-05-31T13:28:10.550Z
2021-05-31T13:28:10.550Z
tdm
<p>Take the simple example of a univariate AR(1) process, without a constant, and <span class="math-container">$0 &lt; \phi &lt;1 $</span>.
<span class="math-container">$$
y_t =  \phi y_{t-1} + \varepsilon_t
$$</span></p>
<p>It is true that the impact of any shock <span class="math-container">$\varepsilon_t$</span> diminishes over time. However, lagged values of <span class="math-container">$y$</span> also still carry the impact of earlier shocks. To see this, do a recursion.
<span class="math-container">$$
y_t =  \phi y_{t-1} + \varepsilon_t = \phi(\phi y_{t-2}+\varepsilon_{t-1}) + \varepsilon_t = \cdots = \phi^h y_{t-h-1} +\sum_{j=0}^h \phi^j \varepsilon_{t-j}
$$</span></p>
<p>As <span class="math-container">$0&lt;\phi&lt;1$</span>, this recursion can be extended to infinity.
<span class="math-container">$$
y_t =  \sum_{j=0}^{\infty} \phi^j \varepsilon_{t-j}
$$</span></p>
<p><strong>In plain English:</strong> the current value of <span class="math-container">$y$</span> is determined by the the history of all historical shocks. This is simply and implication applying recursion of the AR(1) process to infity.</p>
<p>Note that the cumulative impact of the shocks doesn't die out, on the contrary it's always present.</p>
<p>Consider
<span class="math-container">$$
\frac{\delta}{\delta \varepsilon_{t-i}} y_t = \frac{\delta}{\delta \varepsilon_{t-i}} \sum_{j=0}^{\infty} \phi^j \varepsilon_{t-j} = \sum_{j=i}^{\infty} \phi^j =\sum_{j=0}^{\infty} \phi^{j+i} =: \Phi_i
$$</span></p>
<p><span class="math-container">$\Phi_i$</span> is the total cumulative marginal impact of a shock occurring at <span class="math-container">$t-i$</span>. In other words it captures the impact not just up to time <span class="math-container">$t$</span>, but beyond.</p>
<p>Generally, we can get the maximum cumulative marginal impact (I am sure there are better ways to phrase this) as</p>
<p><span class="math-container">$$
\Phi := \sum_{j=0}^{\infty} \phi^j 
$$</span></p>
<p>So, one of the key information we get from the MA representation of a AR process (among other things) is this kind of impact metric.</p>

CC BY-SA 4.0
2021-07-20T18:27:51.717Z
Thanks @BrsG - this is of course a richer/better explanation than my own
EB3112
CC BY-SA 4.0
2021-07-20T17:28:36.263Z
2021-07-20T17:28:36.263Z
BrsG
<p>I thought I'd add an answer here to my original question on 'why an MA representation is required' having recently discovered it.</p>
<p>The short answer is: that an MA representation allows us to see how shocks decay.</p>
<p>Hope this is somewhat useful to anyone who was struggling with the conceptual point (rather than the algebraic point), as I was.</p>

CC BY-SA 4.0
2021-07-20T10:14:17.137Z
2021-07-20T10:14:17.137Z
EB3112
<p>Just wanted to ask a qualitative question in terms of the AR(1) having an infinite MA representation.</p>
<p>Firstly, here, in reverse order: I can understand why it is important to ensure that an MA process has an infinite AR representation (i.e. the MA/white noise process is unobservable).</p>
<p>However, I struggle intuitively to see why an AR (1) can be specified as an infinite MA process.
In my own mind, a stationary AR(1) process has an autoregressive parameter which dies out and a zero-mean white noise error term.</p>
<p>However, I struggle to see why it is useful to convey the AR (1) in purely MA terms, if these MA terms need explained by an infinite AR in the first instance.</p>
<p>Would appreciate some clarity on the matter - or I hope at least it sparks some interesting conversation.</p>

CC BY-SA 4.0
2021-05-30T22:55:59.510Z
I do not quite understand what the question is. Do you want to know what the Wold decomposition is useful for?
Michael Greinecker
CC BY-SA 4.0
2021-05-31T07:28:25.323Z
Hi Michael, thanks for your response. Firstly, yes: I think a very clear explanation of Wold's decomposition would also be helpful. And secondly, regarding my lack of clarity in the question, apologies. I was trying to say: (1) an AR representation of an MA is clearly important for estimating the MA part. (2) However, I am not quite sure why it is sound to interpret an AR as an infinite MA.
EB3112
<econometrics>
MA Representation of an AR Process - Plain English
EB3112
# MA Representation of an AR Process - Plain English

(Asked by: username_0 on 2021-05-30)

Just wanted to ask a qualitative question in terms of the AR(1) having an infinite MA representation.

Firstly, here, in reverse order: I can understand why it is important to ensure that an MA process has an infinite AR representation (i.e. the MA/white noise process is unobservable).

However, I struggle intuitively to see why an AR (1) can be specified as an infinite MA process.
In my own mind, a stationary AR(1) process has an autoregressive parameter which dies out and a zero-mean white noise error term.

However, I struggle to see why it is useful to convey the AR (1) in purely MA terms, if these MA terms need explained by an infinite AR in the first instance.

Would appreciate some clarity on the matter - or I hope at least it sparks some interesting conversation.

**Tags:** econometrics
> **Comments:**
> **username_1**: I do not quite understand what the question is. Do you want to know what the Wold decomposition is useful for?  
> **username_0**: Hi Michael, thanks for your response. Firstly, yes: I think a very clear explanation of Wold's decomposition would also be helpful. And secondly, regarding my lack of clarity in the question, apologies. I was trying to say: (1) an AR representation of an MA is clearly important for estimating the MA part. (2) However, I am not quite sure why it is sound to interpret an AR as an infinite MA.  

---

## 3 answers

### Answer by username_2 on 2021-05-31. Score: 9

Consider the AR process.
$$
y\_t = \phi\_0 + \phi\_1 y\_{t-1} + \varepsilon\_t \tag{1}.
$$

The infinite MA represenation is given by:

$$
y\_t = \frac{\phi\_0}{1 - \phi\_1} + \sum\_{j = 0}^\infty \phi\_1^{j} \varepsilon\_{t-j} \tag{2}
$$
One reason why $(2)$ is useful is to compute, for example, the mean, variance or covariance for the $y\_t$ terms. Assume that $\varepsilon\_t$ terms are i.i.d. with variance $\sigma^2$.

Using $(1)$ to compute the mean gives:
$$
\mathbb{E}(y\_t) = \phi\_0 + \phi\_1 \mathbb{E}(y\_{t-1}).
$$
This is not a closed form solution, so it would have to be solved recursively. However, if we use $(2)$ we get immediately:
$$
\mathbb{E}(y\_t) = \frac{\phi\_0}{1 - \phi\_1}.
$$
Also, if we want the compute the variance using $(1)$ it would look something like this:
$$
\mathbb{E}((y\_t - \mathbb{E}(y\_t))^2) = \left[\phi\_0 + \phi\_1\mathbb{E}(y\_{t-1}) + \varepsilon\_t - \frac{\phi\_0}{1 - \phi\_1} \right]^2,
$$
Which does not seem very useful. However, using $(2)$ we get:
$$
\begin{align\*}
\mathbb{E}((y\_t - \mathbb{E}(y\_t))^2) &= \mathbb{E}\left[\sum\_{j = 0}^\infty\sum\_{k = 0}^\infty \phi\_1^j \phi\_1^k\varepsilon\_{t-j}\varepsilon\_{k-j}\right],\\
&= \mathbb{E}\left[\sum\_{j = 0}^\infty \phi\_1^{2k}(\varepsilon\_{j})^2\right],\\
&= \frac{\sigma^2}{1 - \phi\_1^2}
\end{align\*}
$$
Again, computing the covariance starting from $(1)$ will be quite cumbersome, but using $(2)$ we easily obtain $(\ell > t)$:
$$
\begin{align\*}
\mathbb{E}((y\_t - \mathbb{E}(y\_t))(y\_{\ell}- \mathbb{E}(y\_\ell))) &= \mathbb{E}\left[\sum\_{j = 0}^\infty \sum\_{k = 0}^\infty \phi\_1^j \phi\_1^k \varepsilon\_{t-j} \varepsilon\_{\ell - k}\right]\\
&= \mathbb{E}\left[\sum\_{j = 0}^\infty \phi\_1^j \phi\_1^{\ell - t + j} \sigma^2\right],\\
&= \sigma^2 \phi^{\ell - t} \sum\_{j = 0}^\infty \phi\_1^{2j},\\
&= \sigma^2 \frac{\phi^{\ell - t}}{1 - \phi^2}
\end{align\*}
$$

> **Comments:**
> **username_0**: Thank you @tdm. I appreciate your rigour there!  
> **username_3**: very nice tdm. just a heads up that you have a typo in 2) in that the bottom subscript in summation should be zero. It's  not a bug deal but it might confuse someone trying to see how to go from 2) to the equation with the double sum.  
> **username_2**: @mark leeds Thanks, I'll correct it.  
> **username_4**: With respect to calculating expectation and variance I would still find it easier to use (1) and simply impose stationarity $\mathbb E[y_t] = \mathbb E[y_{t-1}]$ and $\mathbb V[y_t] = \mathbb V[y_{t-1}]$. I mean I guess the infinite MA-sums only converge if we have stationarity anyway so no generality is lost or am I wrong?  
> **username_2**: @Jesper Hybel That's indeed another option. Please edit the answer (or add one) if you think it's useful.  
> **username_5**: @tdm: as the question is also about **why** an AR(1) has an MA representation, maybe add a comment how you get there by recursion, and the conditions under which it exists?  

---

### Answer by username_5 on 2021-07-20. Score: 1

Take the simple example of a univariate AR(1) process, without a constant, and $0 < \phi <1 $.
$$
y\_t = \phi y\_{t-1} + \varepsilon\_t
$$

It is true that the impact of any shock $\varepsilon\_t$ diminishes over time. However, lagged values of $y$ also still carry the impact of earlier shocks. To see this, do a recursion.
$$
y\_t = \phi y\_{t-1} + \varepsilon\_t = \phi(\phi y\_{t-2}+\varepsilon\_{t-1}) + \varepsilon\_t = \cdots = \phi^h y\_{t-h-1} +\sum\_{j=0}^h \phi^j \varepsilon\_{t-j}
$$

As $0<\phi<1$, this recursion can be extended to infinity.
$$
y\_t = \sum\_{j=0}^{\infty} \phi^j \varepsilon\_{t-j}
$$

**In plain English:** the current value of $y$ is determined by the the history of all historical shocks. This is simply and implication applying recursion of the AR(1) process to infity.

Note that the cumulative impact of the shocks doesn't die out, on the contrary it's always present.

Consider
$$
\frac{\delta}{\delta \varepsilon\_{t-i}} y\_t = \frac{\delta}{\delta \varepsilon\_{t-i}} \sum\_{j=0}^{\infty} \phi^j \varepsilon\_{t-j} = \sum\_{j=i}^{\infty} \phi^j =\sum\_{j=0}^{\infty} \phi^{j+i} =: \Phi\_i
$$

$\Phi\_i$ is the total cumulative marginal impact of a shock occurring at $t-i$. In other words it captures the impact not just up to time $t$, but beyond.

Generally, we can get the maximum cumulative marginal impact (I am sure there are better ways to phrase this) as

$$
\Phi := \sum\_{j=0}^{\infty} \phi^j
$$

So, one of the key information we get from the MA representation of a AR process (among other things) is this kind of impact metric.

> **Comments:**
> **username_0**: Thanks @BrsG - this is of course a richer/better explanation than my own  

---

### Answer by username_0 on 2021-07-20. Score: 0

I thought I'd add an answer here to my original question on 'why an MA representation is required' having recently discovered it.

The short answer is: that an MA representation allows us to see how shocks decay.

Hope this is somewhat useful to anyone who was struggling with the conceptual point (rather than the algebraic point), as I was.


---

