What is Ordinal Logistic Regression and how can it be used in Mplus for data analysis?

What is Ordinal Logistic Regression and how can it be used in Mplus for data analysis?

Ordinal Logistic Regression is a statistical method used to analyze data with a categorical dependent variable that has more than two levels, also known as an ordinal variable. It is a type of regression analysis that is suitable for predicting the probability of an outcome falling into a particular category based on a set of independent variables.

In Mplus, Ordinal Logistic Regression can be used to model the relationship between an ordinal dependent variable and one or more independent variables, while taking into account the hierarchical nature of the categories. This allows for the estimation of the odds of an outcome occurring within a specific category, as well as the effect of the independent variables on the odds.

This method is particularly useful in data analysis as it allows for the examination of relationships between variables, while also accounting for the ordered nature of the dependent variable. It can be utilized in various fields such as psychology, social sciences, and education to better understand the factors that influence categorical outcomes. By using Mplus, researchers can easily implement this technique and obtain accurate and reliable results for their data analysis.

Ordinal Logistic Regression | Mplus Data Analysis Examples

VersionInfo:  Code for this page was tested in Mplus
version 6.12.

Please note: The purpose of this page is to show how to use various data analysis commands.
It does not cover all aspects of the research process which researchers are expected to do. In
particular, it does not cover data cleaning and checking, verification of assumptions, model
diagnostics and potential follow-up analyses.

Examples of ordered logistic regression

Example 1:  A marketing research firm wants to
investigate what factors influence the size of soda (small, medium, large or
extra large) that people order at a fast-food chain.  These factors may
include what type of sandwich is ordered (burger or chicken), whether or not
fries are also ordered, and age of the consumer.  While the outcome
variable, size of soda, is obviously ordered, the difference between the various
sizes is not consistent.  The differece between small and medium is 10
ounces, between medium and large 8, and between large and extra large 12.

Example 2:  A researcher is interested in what factors influence medaling
in Olympic swimming.  Relevant predictors include at training hours, diet,
age, and popularity of swimming in the athlete’s home country.  The
researcher believes that the distance between gold and silver is larger than the
distance between silver and bronze.

Example 3:  A study looks at factors that influence the decision of
whether to apply to graduate school.  College juniors are asked if they are
unlikely, somewhat likely, or very likely to apply to graduate school.
Hence, our outcome variable has three categories.  Data on parental educational status, whether the undergraduate institution is
public or private, and current GPA is also collected.   The
researchers have reason to believe that the “distances” between these three
points are not equal.  For example, the “distance” between “unlikely” and
“somewhat likely” may be shorter than the distance between “somewhat likely” and
“very likely”.

Description of the Data

For our data analysis below, we are going to expand on Example 3 about
applying to graduate school.  We have generated hypothetical data,
which can be obtained here.

This hypothetical data set has a thee level variable called apply
(coded 0, 1, 2), that we will use as our response (i.e., outcome, dependent)
variable. We also have three variables that we will use as predictors: pared,
which is a 0/1 variable indicating whether at least one parent has a graduate degree;
public, which is a 0/1 variable where 1 indicates that the undergraduate
institution is a public university and 0 indicates that it is a private university,
and gpa, which is the student’s grade point average. Let’s start with some
descriptive statistics for the variables of interest.

  Title: Ordinal logistic regression in Mplus;
  Data:
    File is D:documentsologit in Mplus DAEologit.dat ;
  Variable:
    Names are apply pared public gpa;
      categorical are apply;
  Analysis:
    type = basic;
  Plot:
    type = plot1;

For this output only, we will display all of the information in the output.
You will want to look at this carefully to be sure that the data were read into
Mplus correctly. You will want to make sure that you have the correct number
of observations, and that the categorical and continuous variables have been
correctly specified. We have not used a missing statement because we have no
missing data in this data set. If any of our variables had missing data we would
have specified “missing = #” in the variable statement,
where # is the numeric value given to missing values (e.g. -9999). Below the
output are histograms for each of our four variables, these were produced using
the plotting function in Mplus. In order to be able to do this, we included the
plot statement and specified “type = plot1” which tells Mplus to create
the auxiliary files necessary for the plotting function.

INPUT READING TERMINATED NORMALLY

Ordinal logistic regression in Mplus;

SUMMARY OF ANALYSIS

Number of groups                                                 1
Number of observations                                         400

Number of dependent variables                                    4
Number of independent variables                                  0
Number of continuous latent variables                            0

Observed dependent variables

  Continuous
   PARED       PUBLIC      GPA

  Binary and ordered categorical (ordinal)
   APPLY


Estimator                                                    WLSMV
Maximum number of iterations                                  1000
Convergence criterion                                    0.500D-04
Maximum number of steepest descent iterations                   20
Parameterization                                             DELTA

Input data file(s)
  D:documentsologit in Mplus DAEologit.dat

Input data format  FREE


SUMMARY OF CATEGORICAL DATA PROPORTIONS

    APPLY
      Category 1    0.550
      Category 2    0.350
      Category 3    0.100


RESULTS FOR BASIC ANALYSIS


     ESTIMATED SAMPLE STATISTICS


           MEANS/INTERCEPTS/THRESHOLDS
              APPLY$1       APPLY$2       PARED         PUBLIC        GPA
              ________      ________      ________      ________      ________
      1         0.126         1.282         0.157         0.143         2.999


           CORRELATION MATRIX (WITH VARIANCES ON THE DIAGONAL)
              APPLY         PARED         PUBLIC        GPA
              ________      ________      ________      ________
 APPLY
 PARED          0.234         0.133
 PUBLIC         0.052         0.079         0.122
 GPA            0.179         0.186         0.227         0.158


     STANDARD ERRORS FOR ESTIMATED SAMPLE STATISTICS


           S.E. FOR MEANS/INTERCEPTS/THRESHOLDS
              APPLY$1       APPLY$2       PARED         PUBLIC        GPA
              ________      ________      ________      ________      ________
      1         0.063         0.085     16970.182     17629.901         0.020


           S.E. FOR CORRELATION MATRIX (WITH VARIANCES ON THE DIAGONAL)
              APPLY         PARED         PUBLIC        GPA
              ________      ________      ________      ________
 APPLY
 PARED          0.053      6574.693
 PUBLIC         0.054         0.044      6025.901
 GPA            0.060         0.047         0.046         0.013

Image ologit1Image ologit2Image ologit3Image ologit4

Analysis methods you might consider

Below is a list of some analysis methods you may have encountered.
Some of the methods listed are quite reasonable while others have either
fallen out of favor or have limitations.

Ordinal logistic regression

Before we run our ordinal logistic model, we will see if any cells (created by the
crosstab of our categorical and response variables) are empty or extremely
small.  If any are, we may have difficulty running our model. We cannot do this
in Mplus, so the tables below come from Stata. You can use whatever statistics package
you prefer to do this.

           |         pared
     apply |         0          1 |     Total
-----------+----------------------+----------
         0 |       200         20 |       220 
         1 |       110         30 |       140 
         2 |        27         13 |        40 
-----------+----------------------+----------
     Total |       337         63 |       400 


           |        public
     apply |         0          1 |     Total
-----------+----------------------+----------
         0 |       189         31 |       220 
         1 |       124         16 |       140 
         2 |        30         10 |        40 
-----------+----------------------+----------
     Total |       343         57 |       400

None of the cells is too small or empty (has no cases), so we will run our
model in Mplus. The syntax in bold below contains our model. Under analysis we
have specified “estimator = ml“. Had we not specified that the estimator
should be ml, Mplus would have performed a probit regression model using
weighted least squares, specifying “estimator = ml” instructs Mplus to
estimate an ordinal logit model and to estimate it using maximum likelihood.
Notice that we specify that the dependent variable, apply, is
categorical.

  Title: Ordinal logistic regression in Mplus,
   Descriptive statistics;
  Data:
    File is D:documentsologit in Mplus DAEologit.dat ;
  Variable:
    Names are
      apply pared public gpa;
      categorical are apply;
  Analysis:
    Type = general ;
    estimator = ml;
  Model:
      apply on pared public gpa;

MODEL FIT INFORMATION

Number of Free Parameters                        5

Loglikelihood

          H0 Value                        -358.512

Information Criteria

          Akaike (AIC)                     727.025
          Bayesian (BIC)                   746.982
          Sample-Size Adjusted BIC         731.117
            (n* = (n + 2) / 24)



MODEL RESULTS

                                                    Two-Tailed
                    Estimate       S.E.  Est./S.E.    P-Value

 APPLY      ON
    PARED              1.048      0.266      3.942      0.000
    PUBLIC            -0.059      0.298     -0.197      0.844
    GPA                0.616      0.261      2.363      0.018

 Thresholds
    APPLY$1            2.203      0.780      2.826      0.005
    APPLY$2            4.299      0.804      5.345      0.000


LOGISTIC REGRESSION ODDS RATIO RESULTS

 APPLY      ON
    PARED              2.851
    PUBLIC             0.943
    GPA                1.851

One of the assumptions underlying ordinal logistic (and ordinal probit)
regression is that the relationship between each pair of outcome groups is the
same.  In other words, ordinal logistic regression assumes that the
coefficients that describe the relationship between, say, the lowest versus all
higher categories of the response variable are the same as those that describe
the relationship between the next lowest category and all higher categories,
etc.  This is called the proportional odds assumption or the parallel
regression assumption.  Because the
relationship between all pairs of groups is the same, there is only one set of
coefficients (only one model).  If this was not the case, we would
need different models to describe the relationship between each pair of outcome
groups. Mplus does not have a formal test for the proportional odds assumption.
One way to asses whether the proportional odds assumption is reasonable is to
turn your ordered dependent variable into a series of binary variables that are
equal to one if y is greater than or equal to a given value, and zero otherwise.
You will need k-1 of these binary variables, where k is the number of values
your dependent variable takes on. You will then want to perform a series of
binary logistic regression analyses, using each of these new variables as
the outcome. If the proportional odds assumption is reasonable, the coefficients
should be similar across each of these binary logistic regression models.

Things to consider

See also

References

 

Cite this article

stats writer (2024). What is Ordinal Logistic Regression and how can it be used in Mplus for data analysis?. PSYCHOLOGICAL SCALES. Retrieved from https://scales.arabpsychology.com/stats/what-is-ordinal-logistic-regression-and-how-can-it-be-used-in-mplus-for-data-analysis/

stats writer. "What is Ordinal Logistic Regression and how can it be used in Mplus for data analysis?." PSYCHOLOGICAL SCALES, 29 Jun. 2024, https://scales.arabpsychology.com/stats/what-is-ordinal-logistic-regression-and-how-can-it-be-used-in-mplus-for-data-analysis/.

stats writer. "What is Ordinal Logistic Regression and how can it be used in Mplus for data analysis?." PSYCHOLOGICAL SCALES, 2024. https://scales.arabpsychology.com/stats/what-is-ordinal-logistic-regression-and-how-can-it-be-used-in-mplus-for-data-analysis/.

stats writer (2024) 'What is Ordinal Logistic Regression and how can it be used in Mplus for data analysis?', PSYCHOLOGICAL SCALES. Available at: https://scales.arabpsychology.com/stats/what-is-ordinal-logistic-regression-and-how-can-it-be-used-in-mplus-for-data-analysis/.

[1] stats writer, "What is Ordinal Logistic Regression and how can it be used in Mplus for data analysis?," PSYCHOLOGICAL SCALES, vol. X, no. Y, ص Z-Z, June, 2024.

stats writer. What is Ordinal Logistic Regression and how can it be used in Mplus for data analysis?. PSYCHOLOGICAL SCALES. 2024;vol(issue):pages.

Download Post (.PDF)
Slide Up
x
PDF
Scroll to Top