PSYC 421 Week 6 Test Evaluation Paper Example

Test Evaluation Paper: The Short Grit Scale, Its Reliability and Predictive Evidence and the Question of What It Measures

Introduction and Justification

Few psychological constructs have moved from journals into classrooms and corporate training as quickly as grit. Schools post it on bulletin boards, and some organizations discuss it in hiring. I chose the Short Grit Scale (Grit-S) for three reasons. It is not covered in the course textbook or lectures, its development and validation are published in peer-reviewed journals and its popularity has prompted independent research testing its claims. Cohen and Swerdlik (2018) stress that test users are responsible for evaluating whether evidence supports a test's intended use, and a measure this widely used deserves that scrutiny.

Description of the Test

In the founding article, Duckworth et al. (2007) described grit as sustained effort and enduring interest directed at long-range aims, measured with a 12-item Grit Scale. Duckworth and Quinn (2009) shortened it to eight items, four for consistency of interest, such as being distracted by new ideas and projects, and four for perseverance of effort, such as finishing whatever one begins. Respondents rate each statement on a five-point scale from "very much like me" to "not like me at all." Items are averaged to produce a score from 1 to 5, with higher scores indicating more grit. The scale takes two or three minutes, and an informant-report version allows a parent, teacher or friend to rate the respondent.

Reliability

Duckworth and Quinn (2009) reported internal consistency for the Grit-S across several samples of adults, adolescents, military cadets and spelling bee competitors, with alphas generally in the acceptable range for a short scale. They also reported retest stability over a year in a sample of middle and high school students and agreement between self-reports and informant reports. Cohen and Swerdlik (2018) note that shorter scales usually show lower internal consistency, so these values are reasonable for eight items. Agreement with informants is especially useful because it shows that scores reflect something other people can observe, not only self-perception. Retest stability matters for a construct described as a trait, since a measure of an enduring disposition should not swing widely from one season to the next. A year-long interval is a demanding test, and moderate stability over that span is consistent with a trait that can still change during adolescence.

Validity

Predictive Evidence

The developers' strongest evidence is predictive. In the original studies, grit accounted for an average of about 4% of the variance in success outcomes, including educational attainment in two adult samples, grade point average among 138 Ivy League undergraduates, retention among two classes of West Point cadets and ranking among 175 National Spelling Bee competitors (Duckworth et al., 2007). Grit scores showed no positive link with IQ yet overlapped heavily with conscientiousness, and the authors reported that grit still added prediction beyond both. With the short form, Duckworth and Quinn (2009) found that grit predicted retention at West Point, final round reached in the Spelling Bee, educational attainment and fewer career changes among adults, and grade point average among adolescents.

Construct Evidence and Its Challenge

The central construct question is whether grit is distinct from conscientiousness, a trait psychologists already measure well. Credé et al. (2017) addressed it with a meta-analysis of 584 effect sizes from 88 independent samples representing 66,807 people. They found that the proposed higher-order structure of grit was not confirmed, that its links with performance and with staying in a program were only moderate and that it tracked conscientiousness very closely. The perseverance of effort facet had stronger criterion validities than the consistency of interest facet and explained variance in academic performance even after conscientiousness was controlled. Their conclusion was that the construct validity of grit is in question and that its main usefulness may lie in the perseverance facet.

Norms and Fairness

The Grit-S does not have a nationally representative normative sample comparable to those of major clinical or ability tests. Published means come from research samples, many of them students, cadets or competitors, so a single score cannot be interpreted against a population reference group with much confidence. Because the items are transparent, respondents who know that grit is valued can easily present themselves favorably, which raises fairness concerns if the scale were used for selection.

Limitations

The evidence supports several cautions. The scale's two facets do not function equally, so the total score may blur a useful facet with a weaker one. Its overlap with conscientiousness suggests that some of its predictive power comes from a familiar trait under a new name. Its predictive correlations are modest, as is typical for personality measures, which makes it unsuitable for decisions about individuals. Self-report makes it vulnerable to impression management in high-stakes settings.

Conclusion

The Short Grit Scale is a brief, reasonably reliable measure with published evidence of modest predictive validity for persistence and achievement. It is appropriate for research, for program evaluation in groups and for self-reflection. The meta-analytic evidence argues against treating it as a distinct higher-order trait or using it for admissions, hiring or other high-stakes decisions about individuals. Users interested in its predictive value should attend to the perseverance of effort items in particular and, where possible, measure conscientiousness alongside it. For a school counselor, a sensible use might be to open a conversation with a student about long-term goals, with the score treated as one perspective rather than a verdict.

References

Cohen, R. J., & Swerdlik, M. E. (2018). Psychological testing and assessment: An introduction to tests and measurement (9th ed.). McGraw-Hill Education.

Credé, M., Tynan, M. C., & Harms, P. D. (2017). Much ado about grit: A meta-analytic synthesis of the grit literature. Journal of Personality and Social Psychology, 113(3), 492-511. https://doi.org/10.1037/pspp0000102

Duckworth, A. L., Peterson, C., Matthews, M. D., & Kelly, D. R. (2007). Grit: Perseverance and passion for long-term goals. Journal of Personality and Social Psychology, 92(6), 1087-1101. https://doi.org/10.1037/0022-3514.92.6.1087

Duckworth, A. L., & Quinn, P. D. (2009). Development and validation of the Short Grit Scale (Grit-S). Journal of Personality Assessment, 91(2), 166-174. https://doi.org/10.1080/00223890802634290