How do I interpret the parameter estimates for dummy variables in regression or glm?

How do I interpret the parameter estimates for dummy variables in regression or glm?

The interpretation of parameter estimates for dummy variables in regression or glm refers to the process of understanding the relationship between a categorical variable and the outcome variable in a statistical model. Dummy variables are used to represent categories in a regression or glm model, and the parameter estimates associated with these variables indicate the effect of each category on the outcome variable. By interpreting these estimates, one can determine the strength and direction of the relationship between the categorical variable and the outcome variable. This process is important in understanding the significance of different categories and their impact on the overall model.

How do I interpret the
parameter estimates for dummy variables in regression or glm? | SPSS FAQ

Consider this simple data file that has nine subjects
(sub)
in three groups (iv) with a score on the outcome or dependent variable (dv).

data list list / sub iv dv.
begin data
1 1 48
2 1 49
3 1 50
4 2 17
5 2 20
6 2 23
7 3 28
8 3 30
9 3 32
end data.

Below we use the means command to find the
overall mean and the means for the three groups.

means tables = dv by iv.

As we see below, the overall mean is 33, and the means
for groups 1, 2 and 3 are 49, 20 and 30 respectively.

Case Processing Summary
Cases
Included Excluded Total
N Percent N Percent N Percent
DV * IV 9 100.0% 0 .0% 9 100.0%
Report
DV
IV Mean N Std. Deviation
1.00 49.0000 3 1.00000
2.00 20.0000 3 3.00000
3.00 30.0000 3 2.00000
Total 33.0000 9 12.89380

Let’s run a standard ANOVA on these data using glm.

glm dv by iv.

The results of the ANOVA are shown below.

Between-Subjects Factors
N
IV 1.00 3
2.00 3
3.00 3
Tests of Between-Subjects Effects
Dependent Variable: DV
Source Type III Sum of Squares df Mean Square F Sig.
Corrected Model 1302.000(a) 2 651.000 139.500 .000
Intercept 9801.000 1 9801.000 2100.214 .000
IV 1302.000 2 651.000 139.500 .000
Error 28.000 6 4.667
Total 11131.000 9
Corrected Total 1330.000 8
a R Squared = .979 (Adjusted R Squared = .972)

Now, let’s take this information we have found and
relate it to the results that we get when we run a similar analysis using dummy coding.  Let’s make a data file called dummy2 that has dummy variables called
iv1
(1 if iv=1), iv2 (1 if iv=2) and iv3 (1 if iv=3). 
Note that iv3 is not really necessary, but it could be useful for further
exploring the meaning of dummy variables.  We will then use the
regression
command to
predict dv from iv1 and iv2.

compute iv1 = 0.
if iv = 1 iv1 = 1.
compute iv2 = 0.
if iv = 2 iv2 = 1.
compute iv3 = 0.
if iv = 3 iv3 = 1.
execute.

regression
 /dependent = dv
 /method = enter iv1 iv2.

The output is shown below.

Variables Entered/Removed(b)
ModelVariables EnteredVariables RemovedMethod
1IV2, IV1(a).Enter
a All requested variables entered.
b Dependent Variable: DV
Model Summary
ModelRR SquareAdjusted R SquareStd. Error of the Estimate
1.989(a).979.9722.16025
a Predictors: (Constant), IV2, IV1
ANOVA(b)
ModelSum of SquaresdfMean SquareFSig.
1Regression1302.0002651.000139.500.000(a)
Residual28.00064.667
Total1330.0008
a Predictors: (Constant), IV2, IV1
b Dependent Variable: DV
Coefficients(a)
Unstandardized CoefficientsStandardized CoefficientstSig.
ModelBStd. ErrorBeta
1(Constant)30.0001.24724.054.000
IV119.0001.764.73710.772.000
IV2-10.0001.764-.388-5.669.001
a Dependent Variable: DV

First, note that from the ANOVA using the glm
command
that the F-value was 139.5 and for the regression using the regression
command the F-value (for the model) is also 139.5.  This illustrates that the overall test of the model
using regression is really the same as doing an ANOVA.

After the
ANOVA table, there is a table entitled Coefficients. What is the interpretation of the values listed there, the 30, 19 and
-10?  Notice how we have iv1 and iv2 that refer to group
1 and group 2, but we did not include any dummy variable referring to group 3. 
Group 3 is
often called the omitted group or reference group
Recall that the means of the 3 groups were 49, 20 and 30 respectively.  The
intercept
term is the mean of the dependent variable, which we called dv, for the
omitted group, and indeed the parameter estimate
(in the column B) from the output is the mean of group 3, 30.  The parameter estimate for
iv1
is the mean of the dependent variable, dv, for group 1 minus the mean of
the dependent variable for group 3, 49 – 30 = 19, and indeed that is the
parameter estimate for iv1.  Likewise, the parameter estimate for
iv2
is the mean of the dependent variable for group 2 minus the mean of the
dependent variable for group 3, 20 – 30 = -10, the parameter estimate for
iv2.

So, in summary:

Intercept mean of group 3 (mean of omitted group)
iv1 mean of group 1 – group 3 (omitted group)
iv2mean of group 2 – group 3 (omitted group)

Try running this example, but use iv2 and iv3
using regression (making group 1 the omitted group) and see what happens.

Finally, consider how the parameter estimates can be
used in the regression model to obtain the means for the groups (the predicted values).

The regression model is

Ypredicted = 30 + iv1*19 + iv2*-10 
For group 1: Ypredicted = 30 + 1 * 19 + 0 * -10 = 49
For group 2: Ypredicted = 30 + 0 * 19 + 1 * -10 = 20
For group 3: Ypredicted = 30 + 0 * 19 + 0 * -10 = 30 

As you see, the regression formula predicts that each
group will have the mean value of its group.

You can also perform the same analysis using
glm.  The print = parameter
subcommand tells SPSS
to print the regression coefficients.

glm dv with iv1 iv2
  /print = parameter.
Tests of Between-Subjects Effects
Dependent Variable: DV
SourceType III Sum of SquaresdfMean SquareFSig.
Corrected Model1302.000(a)2651.000139.500.000
Intercept2700.00012700.000578.571.000
IV1541.5001541.500116.036.000
IV2150.0001150.00032.143.001
Error28.00064.667
Total11131.0009
Corrected Total1330.0008
a R Squared = .979 (Adjusted R Squared = .972)
Parameter Estimates
Dependent Variable: DV
BStd. ErrortSig.95% Confidence Interval
ParameterLower BoundUpper Bound
Intercept30.0001.24724.054.00026.94833.052
IV119.0001.76410.772.00014.68423.316
IV2-10.0001.764-5.669.001-14.316-5.684

Cite this article

stats writer (2024). How do I interpret the parameter estimates for dummy variables in regression or glm?. PSYCHOLOGICAL SCALES. Retrieved from https://scales.arabpsychology.com/stats/how-do-i-interpret-the-parameter-estimates-for-dummy-variables-in-regression-or-glm/

stats writer. "How do I interpret the parameter estimates for dummy variables in regression or glm?." PSYCHOLOGICAL SCALES, 30 Jun. 2024, https://scales.arabpsychology.com/stats/how-do-i-interpret-the-parameter-estimates-for-dummy-variables-in-regression-or-glm/.

stats writer. "How do I interpret the parameter estimates for dummy variables in regression or glm?." PSYCHOLOGICAL SCALES, 2024. https://scales.arabpsychology.com/stats/how-do-i-interpret-the-parameter-estimates-for-dummy-variables-in-regression-or-glm/.

stats writer (2024) 'How do I interpret the parameter estimates for dummy variables in regression or glm?', PSYCHOLOGICAL SCALES. Available at: https://scales.arabpsychology.com/stats/how-do-i-interpret-the-parameter-estimates-for-dummy-variables-in-regression-or-glm/.

[1] stats writer, "How do I interpret the parameter estimates for dummy variables in regression or glm?," PSYCHOLOGICAL SCALES, vol. X, no. Y, ص Z-Z, June, 2024.

stats writer. How do I interpret the parameter estimates for dummy variables in regression or glm?. PSYCHOLOGICAL SCALES. 2024;vol(issue):pages.

Download Post (.PDF)
Slide Up
x
PDF
Scroll to Top