Logistic-Regression-Webinar.pdf

Logistic Regression Using SPSS
Presented by Nasser Hasan - Statistical Supporting Unit
7/8/2020
nasser.hasan@miami.edu

Overview
• Brief introduction of Logistic Regression.
• Logistic Regression Analysis Using SPSS.

Overview
Logistic Regression
- Logistic regression is used to predict a categorical (usually
dichotomous) variable from a set of predictor variables.
- For a logistic regression, the predicted dependent variable is a function
of the probability that a particular subject will be in one of the
categories.

Overview
Logistic Regression - Examples
- A researcher wants to understand whether exam performance (passed
or failed) can be predicted based on revision time, test anxiety and
lecture attendance.
- A researcher wants to understand whether drug use (yes or no) can be
predicted based on prior criminal convictions, drug use amongst friends,
income, age and gender.

Overview
Logistic Regression - Assumption
1. Your dependent variable should be measured on a dichotomous scale.
2. You have one or more independent variables, which can be either
continuous or categorical.
3. You should have independence of observations and the dependent
variable should have mutually exclusive and exhaustive categories.

Overview
Logistic Regression - Assumption
4. There needs to be a linear relationship between any continuous
independent variables and the logit transformation of the dependent
variable. à Box-Tidwell Test

Overview
Box-Tidwell Test
- We include in the model the interactions between the continuous
predictors and their logs.
- If the interaction term is statistically significant, the original continuous
independent variable is not linearly related to the logit of the dependent
variable.
- Don’t worry about the significant interaction if the sample sizes are
large.

Performing the Analysis Using SPSS
Dataset
Please download the dataset using this link:
https://miami.box.com/s/cb1tytyzogqe1vs7eu4fdqj7m9ewtwzo
And open it in SPSS

Dataset
1) The dependent variable, heart_disease , which is whether the
participant has heart disease;
2) The independent variable, age , which is the participant's age in years;
3) The independent variable, weight , which is the participant's weight
(technically, it is their 'mass’);
4) The independent variable, gender , which has two categories: "Male"
and "Female";
5) The independent variable, VO2max , which is the maximal aerobic
capacity.
6) The case identifier, caseno , which is used for easy elimination of cases
(e.g., participants) that might occur when checking outliers.

Click Transform > Compute Variable:
- We want to compute the logs of any continuous independent variable,
in our case: age, weight, and VO2 max.
- For Age variable:
Type LN_age in target variable and LN(age) in Numeric Expression
- Repeat the same procedure for the other two variables.

Click Analyze > Regression > Binary Logistic

In the Logistic Regression Window
- Move your DV into the DV box, and all of your IVs in the covariates box.

For Box-Tidwell test
- Add the interaction term between each continues IV and its log.

In the Logistic Regression Window: Click on Categorical
- Transfer the categorical independent variable, gender, from
the Covariates: box to the Categorical Covariates: box, as shown below,
and then change the reference category to be the first, then click on
change:

In the Logistic Regression Window: Click on Options
- Check the appropriate statistics and plots needed for the analysis as
shown below:

SPSS output for Box-Tedwell Test
- If all of them are not significant, redo the analysis with the interaction
terms:

Redo the analysis: Click Analyze > Regression > Binary Logistic

Remove interaction terms from covariates:

SPSS output
This part of the output tells you about the cases that were included and excluded from the
analysis, the coding of the dependent variable, and coding of any categorical variables listed on
the categorical subcommand.

SPSS output – Block 0
This part of the output describes a “null model”, which is model with no predictors and just the
intercept. This is why you will see all of the variables that you put into the model in the table
titled “Variables not in the Equation”.

The section contains what is frequently the most interesting part of the output: the overall test of
the model (in the “Omnibus Tests of Model Coefficients” table) and the coefficients and odds
ratios (in the “Variables in the Equation” table).
The overall model is statistically significant, χ2(4) = 27.40, p < .05.

This table contains the Cox & Snell R Square and Nagelkerke R Square values, which are both
methods of calculating the explained variation. These values are sometimes referred to
as pseudo R2 values (and will have lower values than in multiple regression). However, they are
interpreted in the same manner, but with more caution. Therefore, the explained variation in the
dependent variable based on our model ranges from 24.0% to 33.0%, depending on whether you
reference the Cox & Snell R2 or Nagelkerke R2 methods, respectively.

The Hosmer-Lemeshow tests the null hypothesis that predictions made by the model fit perfectly
with observed group memberships. A chi-square statistic is computed comparing the observed
frequencies with those expected under the linear model. A nonsignificant chi-square indicates
that the data fit the model well.

Logistic regression estimates the probability of an event (in this case, having heart disease)
occurring. If the estimated probability of the event occurring is greater than or equal to 0.5 (better
than even chance), SPSS Statistics classifies the event as occurring (e.g., heart disease being
present). If the probability is less than 0.5, SPSS Statistics classifies the event as not occurring
(e.g., no heart disease). It is very common to use binomial logistic regression to predict whether
cases can be correctly classified (i.e., predicted) from the independent variables. Therefore, it
becomes necessary to have a method to assess the effectiveness of the predicted classification
against the actual classification.

- With the independent variables added, the model now correctly classifies 71.0% of cases
overall (see "Overall Percentage" row) à Percentage accuracy in classification.
- 45.7% of participants who had heart disease were also predicted by the model to have heart
disease (see the "Percentage Correct" column in the "Yes" row of the observed categories). à
Sensitivity
- 84.6% of participants who did not have heart disease were correctly predicted by the model not
to have heart disease (see the "Percentage Correct" column in the "No" row of the observed
categories). à Specificity

- The positive predictive value is the percentage of correctly predicted cases with the
observed characteristic compared to the total number of cases predicted as having the
characteristic. In our case, this is 100 x (16 ÷ (10 + 16)) which is 61.5%. That is, of all cases
predicted as having heart disease, 61.5% were correctly predicted.
- The negative predictive value is the percentage of correctly predicted cases without the
observed characteristic compared to the total number of cases predicted as not having the
characteristic. In our case, this is 100 x (55 ÷ (55 + 19)) which is 74.3%. That is, of all cases
predicted as not having heart disease, 74.3% were correctly predicted.

- The Wald test ("Wald" column) is used to determine statistical significance for each of the
independent variables. The statistical significance of the test is found in the "Sig." column.
From these results you can see that age (p = .003), gender (p = .021) and VO2max (p = .039)
added significantly to the model/prediction, but weight (p = .799) did not add significantly to
the model.

- You can use the information in the "Variables in the Equation" table to predict the probability of
an event occurring based on a one-unit change in an independent variable when all other
independent variables are kept constant. For example, the table shows that the odds of
having heart disease ("yes" category) is 7.026 times greater for males as opposed to females.

APA style write-up
- A logistic regression was performed to ascertain the effects of age, weight, gender and
VO2max on the likelihood that participants have heart disease. The logistic regression model
was statistically significant, χ2(4) = 27.402, p < .0005. The model explained 33.0%
(Nagelkerke R2) of the variance in heart disease and correctly classified 71.0% of cases.
Males were 7.02 times more likely to exhibit heart disease than females. Increasing age was
associated with an increased likelihood of exhibiting heart disease, However, increasing
VO2max was associated with a reduction in the likelihood of exhibiting heart disease.

Multiple Regression Using SPSS
Presented by Nasser Hasan - Statistical Supporting Unit
6/3/2020
Thanks for Listening and Attending!
Any Questions?
Can you please give us a minute to fill this survey as it will help
us to evaluate our performance and take your feedback into
consideration for future webinars:
https://umiami.qualtrics.com/jfe/form/SV_a9N5Xta6OlybEeV

Logistic-Regression-Webinar.pdf

More Related Content

Similar to Logistic-Regression-Webinar.pdf (20)

Recently uploaded (20)

Logistic-Regression-Webinar.pdf