u05d2 Types of Logistic Regression

John plans to do a logistic regression using the default (enter) method. His friend Barbara
suggests that he should do a sequential logistic regression instead, and his other friend, Linda,
tells John that a stepwise logistic regression is the way to go.
Discuss the advantages and disadvantages of these three options. What criteria should John use
in order to decide which method is best for him?
Response Guidelines
Respond to at least one other posting by making a counter argument to the position taken. In
other words, if the poster supports Barbaras suggestion of a sequential logistic regression,
respond to the post by making a counter argument for either the default (enter) method or a
stepwise logistic regression. Be sure to respond to the specific points raised in the posting.
According to Warner (2008), there are basically three approaches to the method of entry in
logistic and multivariate regression analysis involving multiple predictors: 1) Standard or
Simultaneous (default), 2) Sequential or Hierarchical and 3) Statistical. Its important to note
that the term stepwise regression analysis has been subject to some confusion regarding which
approach best supports the use of the term. Some researchers describe stepwise as sequential
or hierarchical and some a statistical method of entry. Warner (2008) specifically defines
stepwise as a statistical method of entry for predictor variables in logistic regression.
1) Standard or simultaneous (default) regression analysis involves entering all the Xi predictor
variables at the same time in one regression equation procedure to determine the proportion of
variance on Y that is predictable from each Xi predictor while controlling for all others. The
major advantage is this method of entry is it typically yields the most conservative predictive
capacity of any of the three methods based upon the effect size of each Xi predictor variable
(Warner, 2008). A disadvantage would be that this method excludes consideration of how a
specific data collection strategy may potentially demonstrate a relationship to theory
development through a more regimented method of data entry and coefficient calculation in the
regression equation.
2) Sequential or hierarchical regression analysis involves computing a series of regression
equations as each predictor variable is entered in a step by step procedure based upon a
researchers discretion of the order of data entry for each regression procedure. The criterion to
determine the predictive capacity of each Xi predictor variable is based upon the increase of R2
as each predictor is added to the equation (Warner, 2008). Each Xi variables contribution of
variance is assessed while controlling for only those variables entered in previous steps of the
regression procedure. The advantage is it affords the researcher opportunity to examine the
significant role each Xi predictor may play in the analysis. The disadvantage is researcher bias
may hinder statistical outcomes by arbitrarily entering preferred variables based upon a
researchers a priori approach to theory development.

3) Statistical or stepwise regression analysis is similar to method #2 above, and also involves
computing a series of regression equations as each predictor variable is entered in a step by step
procedure based upon a researchers discretion of the order of data entry in each regression
procedure. However, although the criterion to determine the predictive capacity of each Xi
predictor variable is based upon the increase of R2 as each predictor is added to the equation, a
predictor may also be dropped if a decrease in R2 occurs. In other words, the variables are
entered according to their predictive usefulness hence this method is sometimes referred to as
data driven (Warner, 2008). The disadvantage is SPSS does not make adjustments for inflated
Type I errors which overestimate sample correlations as true population correlations resulting
from the use of this regression method. For this reason this entry method is normally is not a
recommended logistic regression procedure.
The selection criteria for choosing the type of entry method explained above may be determined
by the researchers examination of the theory of the research study suggesting a particular order
of data entry (i.e. time series) (Warner, 2008). It may be possible for a researcher to justify a
particular order of entry based upon the times at which the data was collected or the
predetermined correlation strength of each Xi variable. If research does not indicate whether
there a significant correlation between certain Xi variables and the Y outcome variable exists
after logarithmic data adjustments, then the standard or default method of entry should be used.
Anthony Rhodes
General Psychology PhD

References
Warner, R.M. (2008). Applied statistics: From Bivariate Through Multivariate Techniques.
Thousand Oaks, CA: Sage Publications. ISBN: 9780761927723.