<p><strong>The meaning of the words first</strong></p>

<p>Some people use the word "IV estimator" to refer to any estimator that uses instrumental variables. To them, IV estimators contain 2SLS, LIML, k-class estimators, and others, so 2SLS is a special case of IV. For example, the title of Bekker's (1994, Econometrica) paper is "Alternative approximations to the distribution of instrumental variable estimators".</p>

<p>More traditional people mean by IV the particular instrumental variable estimator $(Z'X)^{-1}Z'y$ for the exactly identified case ($Z$ = instrument matrix, $X$ = regressor matrix, $y$ = regressand vector), and 2SLS is a generalization of IV to the overidentified case. But, as Paul says, 2SLS can be expressed as an IV estimator of this second sense because it is $(\hat{X}'X)^{-1} \hat{X}'y$, where $\hat{X} = Z(Z'Z)^{-1}Z'X$ is the instrument matrix.</p>

<p>I personally think it is very fine to leave the meaning of IV estimators ambiguous because the meaning is usually clear in the context and we need not rigorously distinguish them.</p>

<p><strong>As for your question ...</strong></p>

<p>It seems to me that the sentence "2sls is predicting the endogenous variable" means the first stage regression of the endogenous regressor on the instrumental variables (to get $\hat{X}$). The expression "instrumental variables are similar to proxy variables" looks more casual. Proxy variables (e.g., IQ for ability) can be used to solve the endogeneity problem. Instrumental variables are another way of solving the endogeneity problem. In that sense they are "similar".</p>

CC BY-SA 4.0
2019-09-19T12:03:22.247Z
In the exactly identified case, we assume each instrument has a correlation of 1 with a regressor: $Z(Z'Z)^{-1}Z'X = Z\ \impliedby\ (Z'Z)^{-1}Z'X = I$. This shows that 2SLS is equivalent to IV, up to the order of the instruments. If the instruments are not in the correct order, the projection $Z(Z'Z)^{-1}Z'X$ will re-order the variables so that $\hat X $ has a different ordering to $Z$ but the same as $X$.
ahorn
CC BY-SA 4.0
2020-08-02T02:56:59.617Z
In case $dim(Z) = dim(X)$, $Z'X$ is invertible, and $Z'Z$ is nonsingular, we have $(Z'X)^{-1} Z'y = [X'Z(Z'Z)^{-1} Z'X]^{-1} X'Z(Z'Z)^{-1} Z'y$ by cancellation. But it's not true that $(Z'Z)^{-1}Z'X = I$ unless $Z=X$; it's not true even when $Z=-X$.
chan1142
CC BY-SA 4.0
2020-08-02T07:21:38.070Z
Exactly my point. I was saying that if $Z=X$ (i.e. if the ordering is the same), then they are equivalent. Note that I did not claim that $(Z'Z)^{-1}Z'X = I$; I merely claimed that the implication is true.
ahorn
CC BY-SA 4.0
2020-08-02T07:27:10.000Z
I think it's common for mathematicians to say "$A\implies B$", when they really mean "$A$ is true. Therefore $B$ is true." However, I'm the type of mathematician who prefers to evaluate the fundamental truth of the _implication_, regardless of whether the antecedent is true or not.
ahorn
CC BY-SA 3.0
2016-10-26T13:27:31.307Z
2016-10-26T13:27:31.307Z
chan1142
<p>Generally 2SLS is referred to as IV estimation for models with more than one instrument and with only one endogenous explanatory variable.
You can also use two stage least squares estimation for a model with one instrumental variable. 
It can be shown that IV estimation equals 2SLS estimation when there is one endogenous and one instrumental variable.
Finally 2SLS can be used for models with multiple endogenous explanatory variables as long as we have the same amount of instruments as endogenous variables.</p>

CC BY-SA 4.0
2018-07-12T22:20:10.027Z
2018-07-12T22:32:39.730Z
2018-07-12T22:32:39.730Z
Kenzie
<p>IV estimators <em>are</em> 2SLS estimators.</p>
<p>An IV estimator is the sample analog of the form: <span class="math-container">$\beta = \frac{Cov(Y, Z)}{Cov(X, Z)}$</span>, where <span class="math-container">$Y$</span> is the outcome variable, <span class="math-container">$X$</span> is the endogenous variable, and <span class="math-container">$Z$</span> is the instrumental variable.</p>
<p>It can be shown that the 2SLS is of the above form. The advantage of 2SLS estimators over other IV estimators is that 2SLS can easily combine multiple instrumental variables, and it also makes including control variables easier.</p>

CC BY-SA 4.0
2016-10-26T03:23:39.913Z
2020-08-01T14:22:55.520Z
2020-08-01T14:22:55.520Z
Paul
<p>I'm doing independent study and I am having trouble understanding the difference between these two estimators.</p>

<p>I get that 2SLS is predicting the endogenous variable, and that instrumental variables are similar to proxy variables, but I don't get how one differs from the other.</p>

<econometrics><instrumental-variable>
What is the difference between two stage least squares and instrumental variable regression?
Forgot the Jacobian
# What is the difference between two stage least squares and instrumental variable regression?

(Asked by: username_0 on 2016-10-26)

I'm doing independent study and I am having trouble understanding the difference between these two estimators.

I get that 2SLS is predicting the endogenous variable, and that instrumental variables are similar to proxy variables, but I don't get how one differs from the other.

**Tags:** econometrics, instrumental-variable

---

## 3 answers

### Answer by username_4 on 2016-10-26. Score: 7 | Accepted answer

IV estimators *are* 2SLS estimators.

An IV estimator is the sample analog of the form: $\beta = \frac{Cov(Y, Z)}{Cov(X, Z)}$, where $Y$ is the outcome variable, $X$ is the endogenous variable, and $Z$ is the instrumental variable.

It can be shown that the 2SLS is of the above form. The advantage of 2SLS estimators over other IV estimators is that 2SLS can easily combine multiple instrumental variables, and it also makes including control variables easier.


---

### Answer by username_1 on 2016-10-26. Score: 18

**The meaning of the words first**

Some people use the word "IV estimator" to refer to any estimator that uses instrumental variables. To them, IV estimators contain 2SLS, LIML, k-class estimators, and others, so 2SLS is a special case of IV. For example, the title of Bekker's (1994, Econometrica) paper is "Alternative approximations to the distribution of instrumental variable estimators".

More traditional people mean by IV the particular instrumental variable estimator $(Z'X)^{-1}Z'y$ for the exactly identified case ($Z$ = instrument matrix, $X$ = regressor matrix, $y$ = regressand vector), and 2SLS is a generalization of IV to the overidentified case. But, as Paul says, 2SLS can be expressed as an IV estimator of this second sense because it is $(\hat{X}'X)^{-1} \hat{X}'y$, where $\hat{X} = Z(Z'Z)^{-1}Z'X$ is the instrument matrix.

I personally think it is very fine to leave the meaning of IV estimators ambiguous because the meaning is usually clear in the context and we need not rigorously distinguish them.

**As for your question ...**

It seems to me that the sentence "2sls is predicting the endogenous variable" means the first stage regression of the endogenous regressor on the instrumental variables (to get $\hat{X}$). The expression "instrumental variables are similar to proxy variables" looks more casual. Proxy variables (e.g., IQ for ability) can be used to solve the endogeneity problem. Instrumental variables are another way of solving the endogeneity problem. In that sense they are "similar".

> **Comments:**
> **username_2**: In the exactly identified case, we assume each instrument has a correlation of 1 with a regressor: $Z(Z'Z)^{-1}Z'X = Z\ \impliedby\ (Z'Z)^{-1}Z'X = I$. This shows that 2SLS is equivalent to IV, up to the order of the instruments. If the instruments are not in the correct order, the projection $Z(Z'Z)^{-1}Z'X$ will re-order the variables so that $\hat X $ has a different ordering to $Z$ but the same as $X$.  
> **username_1**: In case $dim(Z) = dim(X)$, $Z'X$ is invertible, and $Z'Z$ is nonsingular, we have $(Z'X)^{-1} Z'y = [X'Z(Z'Z)^{-1} Z'X]^{-1} X'Z(Z'Z)^{-1} Z'y$ by cancellation. But it's not true that $(Z'Z)^{-1}Z'X = I$ unless $Z=X$; it's not true even when $Z=-X$.  
> **username_2**: Exactly my point. I was saying that if $Z=X$ (i.e. if the ordering is the same), then they are equivalent. Note that I did not claim that $(Z'Z)^{-1}Z'X = I$; I merely claimed that the implication is true.  
> **username_2**: I think it's common for mathematicians to say "$A\implies B$", when they really mean "$A$ is true. Therefore $B$ is true." However, I'm the type of mathematician who prefers to evaluate the fundamental truth of the _implication_, regardless of whether the antecedent is true or not.  

---

### Answer by username_3 on 2018-07-12. Score: 3

Generally 2SLS is referred to as IV estimation for models with more than one instrument and with only one endogenous explanatory variable.
You can also use two stage least squares estimation for a model with one instrumental variable.
It can be shown that IV estimation equals 2SLS estimation when there is one endogenous and one instrumental variable.
Finally 2SLS can be used for models with multiple endogenous explanatory variables as long as we have the same amount of instruments as endogenous variables.


---

