Two-Stage Least Squares (2SLS) Regression Analysis

Two-Stage least squares (2SLS) regression analysis is a statistical technique that is used in the analysis of structural equations.  This technique is the extension of the OLS method.  It is used when the dependent variable’s error terms are correlated with the independent variables. Additionally, it is useful when there are feedback loops in the model.  In structural equations modeling, we use the maximum likelihood method to estimate the path coefficient.  This technique is an alternative in SEM modeling to estimate the path coefficient.  This technique can also be applied in quasi-experimental studies.

Questions Answered:

How much can be budgeted in order to accurately estimate how much wheat is needed to produce bread?

What is the price of wheat? Is it on an upward trend?

Determine the final price for its bread.

Assumptions:

  1. Models (equations) should be correctly identified.
  2. The error variance of all the variables should be equal.
  3. Error terms should be normally distributed.
  4. It is assumed that the outlier(s) is removed from the data.
  5. Observations should be independents of each other.

 2stagesqregression

 

Key concepts and terms:

Problematic causal variable: The dependent or endogenous variable whose error term is correlated with the other dependent variable error term.  A problematic causal variable is replaced with the substitute variable in the first stage of the analysis.

Instruments: An instrument variable is used to create a new variable by replacing the problematic variable.

Stages: In ordinary least square method, there is a basic assumption that the value of the error terms is independent of predictor variables. When this assumption is broken, this technique helps us to solve this problem.  This analysis assumes that there is a secondary predictor that is correlated to the problematic predictor but not with the error term.  Given the existence of the instrument variable, the following two methods are used:

  1. In the first stage, a new variable is created using the instrument variable.
  2. In the second stage, the model-estimated values from stage one are then used in place of the actual values of the problematic predictors to compute an OLS model for the response of interest.

SPSS:

All statistical software does not perform this regression method.  In SPSS, to perform this analysis, the following steps are involved:

  1. Click on the “SPSS” icon from the start menu.
  2. Click on the “Open data” icon and select the data.
  3. Click on the “analysis” menu and select the “regression” option.
  4. Select two-stage least squares (2SLS) regression analysis from the regression option.  From the 2SLS regression window, select the dependent, independent and instrumental variable.  Click on the “ok” button. The result window will appear in front of us.  The result explanation of the analysis is same as the OLS, MLE or WLS method.

Data Analysis Plan

  • Edit your research questions and null/alternative hypotheses
  • Write your data analysis plan; specify specific statistics to address the research questions, the assumptions of the statistics, and justify why they are the appropriate statistics; provide references
  • Justify your sample size/power analysis, provide references
  • Explain your data analysis plan to you so you are comfortable and confident
  • Two hours of additional support with your statistician

Quantitative Results Section (Descriptive Statistics, Bivariate and Multivariate Analyses, Structural Equation Modeling, Path analysis, HLM, Cluster Analysis)

  • Clean and code dataset
  • Conduct descriptive statistics (i.e., mean, standard deviation, frequency and percent, as appropriate)
  • Conduct analyses to examine each of your research questions
  • Write-up results
  • Provide APA 6th edition tables and figures
  • Explain chapter 4 findings
  • Ongoing support for entire results chapter statistics

*Please call 877-437-8622 to request a quote based on the specifics of your research, or email Info@StatisticsSolutions.com.

Resources

Angrist, J. D., & Imbens, G. W. (1995). Two-stage least squares estimation of average causal effects in models with variable treatment intensity. Journal of the American Statistical Association, 90(430), 431-442.

Benda, B. B., & Corwyn, R. F. (1997). A test of a model with reciprocal effects between religiosity and various forms of delinquency using 2-stage least squares regression. Journal of Social Service Research, 22(3), 27-52.

Bollen, K. A. (1996). An alternative two stage least squares (2SLS) estimator for latent variable equations. Psychometrika, 61(1), 109-121.

Freedman, D. (1984). On bootstrapping two-stage least-squares estimates in stationary linear models. The Annals of Statistics, 12(3), 827-842.

Hsiao, C. (1997). Statistical properties of the two-stage least squares estimator under cointegration. Review of Economic Studies, 64, 385-398.

James, L. R., & Singh, B. K. (1978). An introduction to the logic, assumptions, and basic analytic procedures of two-stage least squares. Psychological Bulletin, 85(5), 1104-1122.

Kelejian, H. H., & Prucha, I. R. (1997). Estimation of spatial regression models with autoregressive errors by two-stage least squares procedures: A serious problem. International Regional Science Review, 20(1), 103-111.

Kelejian, H. H., & Prucha, I. R. (1998). A generalized spatial two-stage least squares procedure for estimating a spatial autoregressive model with autoregressive disturbances. The Journal of Real Estate Finance and Economics, 17(1), 99-121.

Land, K. C., & Deane, G. (1992). On the large-sample estimation of regression models with spatial- or network-effects terms: A two-stage least squares approach. Sociological Methodology, 22, 221-248.

Ramsey, J. B. (1969). Tests for specification errors in classical linear least-squares regression analysis. Journal of the Royal Statistical Society, 31(2), 350-371.

Scott, A. J., & Holt, D. (1982). The effect of two-stage sampling on ordinary least squares methods. Journal of the American Statistical Association, 77(380), 848-854.

Related Pages:

Structural Equation Modeling