Engagement with Criticism Scale (ECS)

Abstract

The Engagement with Criticism Scale (ECS; Orosz et al., 2023) was developed to evaluate various dimensions of how individuals engage with criticism, specifically focusing on over-engagement, disengagement, and constructive engagement. The instrument was created for a study investigating the distinct roles of growth mindset and trait mindfulness in fostering the motivation to learn from criticism. The study was conducted with an online sample of Hungarian adolescents and adults. The ECS was assessed within this sample using nine items, which were formulated based on the scale construction principles from previous research (Bőthe et al., 2018; Orosz et al., 2016; Tóth-Király et al., 2017). The reported findings include results from factor analysis, reliability tests, and validity assessments for these items.

Keywords

Criticism Over-Engagement; Criticism Disengagement; Criticism Constructive Engagement; Criticism; Psychological Engagement; State Trait Level Measures

Authors

Orosz, Gábor; Evans, Kristopher M.; Török, Lilla; Bőthe, Beáta; Tóth-Király, István; Sik, Kata; Gál, Éva

---

Purpose

The purpose of this scale is to measure multiple aspects of criticism engagement.

Construct

The primary construct measured by this scale is Criticism Engagement.

Validity

Evidence of validity was established through several analyses. For convergent validity, the results demonstrated that the scale had reasonable correlations with other self-reported constructs, such as rumination, positive reappraisal, and depression. For discriminant validity, which was assessed in relation to social desirability, the authors performed a linear logistic regression. The findings indicated that no correlations reached a significant level.

Reliability

The internal consistency of the scale was assessed, with Cronbach’s alpha coefficients ranging from .69 to .85 across its subscales.

Factor Analysis

A confirmatory factor analysis was conducted. The first-order, three-factor, nine-item model of the Engagement with Criticism Scale demonstrated good goodness-of-fit indices (χ2 = 127.078, df=24, CFI=0.969, TLI=0.954, RMSEA=0.054, 90% CI 0.045-0.064). Standardized factor loadings were strong, ranging from 0.670 to 0.848. The scale is composed of three subscales: Criticism constructive engagement; Criticism disengagement; and Criticism over-engagement.

Instrument

• Test Type: This is an original inventory/questionnaire.

• Format: The instrument consists of 9 items. Responses are captured using a six-point Likert scale, with options ranging from “Almost never” to “Almost always”. The test is administered electronically.

• Language Available: The scale is available in English and Hungarian.

• Population Group: The instrument is designed for human populations, including males and females.

• Age Group: The scale is suitable for a wide range of ages, including Adolescence (13-17 years), Adulthood (18 years & older), Young Adulthood (18-29 years), Thirties (30-39 years), Middle Age (40-64 years), and Aged (65 years & older).

• Population Details: The development study included adolescent and adult participants from Hungary, with ages ranging from 13 to 71.

• Test Methodology: The development and validation process involved assessments of Test Validity, Convergent Validity, Discriminant Validity, Test Reliability, Internal Consistency, Factor Analysis, and Confirmatory Factor Analysis.

Keywords

Criticism Over-Engagement; Criticism Disengagement; Criticism Constructive Engagement; Criticism; Psychological Engagement; State Trait Level Measures

Authors including Author ocrid Identifier and Affiliation Email addresses Correspondence Address

• Orosz, Gábor

  • ORCID Identifier: http://orcid.org/0000-0001-5883-6861

  • Affiliation: Université du Littoral Côte d’Opale, Université d’Artois, Université de Lille ULR 7369-URePSSS-Unité de Recherche Pluridisciplinaire Sport Santé Société

  • Email: [email protected]

• Evans, Kristopher M.

  • ORCID Identifier: No data is Available

  • Affiliation: Stanford University, Department of Psychology

  • Email: No data is Available

• Török, Lilla

  • ORCID Identifier: No data is Available

  • Affiliation: Université du Littoral Côte d’Opale, Université d’Artois, Université de Lille ULR 7369-URePSSS-Unité de Recherche Pluridisciplinaire Sport Santé Société

  • Email: No data is Available

• Bőthe, Beáta

  • ORCID Identifier: http://orcid.org/0000-0003-2718-4703

  • Affiliation: Université de Montréal, Département de Psychologie

  • Email: No data is Available

• Tóth-Király, István

  • ORCID Identifier: No data is Available

  • Affiliation: Concordia University, Department of Psychology

  • Email: No data is Available

• Sik, Kata

  • ORCID Identifier: http://orcid.org/0000-0002-0897-258X

  • Affiliation: University of Vienna Department of Occupational, Economic and Social Psychology, Motivation Psychology Lab

  • Email: No data is Available

• Gál, Éva

  • ORCID Identifier: http://orcid.org/0000-0002-7515-7024

  • Affiliation: Babes Bolyai University Doctoral School of Evidence-Based Assessment and Psychological Interventions

  • Email: No data is Available

• Correspondence Address

  • Orosz, Gábor: Université du Littoral Côte d’Opale, Université d’Artois, Université de Lille, ULR 7369-URePSSS-Unité de Recherche Pluridisciplinaire Sport Santé Société, Liévin, France, [email protected]

Permissions & Fee and Test Year

• Permissions: To use the scale, interested parties should contact the corresponding author.

• Fee: There is no fee to use this instrument.

• Test Year: 2023

Reference’s

Orosz, G., Evans, K. M., Török, L., Bőthe, B., Tóth-Király, I., Sik, K., & Gál, É. (2023). The differential role of growth mindset and trait mindfulness in the motivation of learning from criticism. Mindfulness, 14(4), 868–879. https://doi.org/10.1007/s12671-023-02117-4

Items of the Engagement with Criticism Scale (ECS)

The provided text indicates that the specific test items are not available within the document itself. However, it is noted that the items can be found in the supplemental material of the source reference article.