Table of Contents
Logistic regression coefficients indicate the strength of the relationship between the independent variable and the logit of the dependent variable. The coefficient value indicates the amount by which the logit of the dependent variable changes for a one unit change in the independent variable, while controlling for all other independent variables in the model. A positive coefficient value indicates that a one unit increase in the independent variable is associated with an increase in the logit of the dependent variable, while a negative coefficient value indicates that a one unit increase in the independent variable is associated with a decrease in the logit of the dependent variable.
Logistic regression is a method we can use to fit a regression model when the is binary.
When we fit a logistic regression model, the coefficients in the model output represent the average change in the log odds of the response variable associated with a one unit increase in the predictor variable.
β = Average Change in Log Odds of Response Variable
Often we’re more interested in understanding the average change in the odds of the response variable associated with a one unit increase in the predictor variable, which we can find by using the formula eβ.
eβ = Average Change in Odds of Response Variable
The following example shows how to interpret logistic regression coefficients in practice.
Example: How to Interpret Logistic Regression Coefficients
Suppose we would like to fit a logistic regression model using gender and number of practice exams taken to predict whether or not a student will pass a final exam in some class.
Suppose we fit the model using statistical software (such as , , , or ) and receive the following output:
| Coefficient Estimate | Standard Error | Z-Value | P-value | |
|---|---|---|---|---|
| Intercept | -1.34 | 0.23 | 5.83 | <0.001 |
| Gender (Male) | -0.56 | 0.25 | 2.24 | 0.03 |
| Practice Exams | 1.13 | 0.43 | 2.63 | 0.01 |
How to Interpret Gender (Binary Predictor Variable)
We can see that the coefficient estimate for gender is negative, which indicates that being male decreases the chances of passing the exam.
We can also see that the p-value for gender is less than .05, which means it has a statistically significant effect on whether or not an individual passes the exam.
To understand exactly how being male affects whether or not an individual passes the exam, we can use the formula eβ.
e-0.56 = 0.57
We interpret this to mean that males have just 0.57 times the odds of females of passing the exam, assuming the number of practice exams is held constant.
We could also say that males have (1 – 0.57) 43% lower odds of passing the exam than females, again assuming the number of practice exams is held constant.
How to Interpret Practice Exams (Continuous Predictor Variable)
We can see that the coefficient estimate for practice exams is positive, which indicates that each additional practice exam taken increases the chances of passing the final exam.
We can also see that the p-value for number of practice exams taken is less than .05, which means it has a statistically significant effect on whether or not an individual passes the final exam.
To quantify how each additional practice exam affects whether or not an individual passes the final exam, we can use the formula eβ.
e1.13 = 3.09
We interpret this to mean that each additional practice exam taken multiplies the odds of passing the final exam by 3.09, assuming that gender is held constant.
We could also say that each additional practice exam taken is associated with a (3.09 – 1) 209% increase in the odds of passing the final exam, again assuming that gender is held constant.
Note: Refer to to learn how to interpret the intercept term in a logistic regression model.
The following tutorials provide additional information about logistic regression: