COUC 521 Week 3 Exploring Reliability and Validity Example

Exploring Reliability and Validity: How Well Does the PHQ-9 Measure Depression in Counseling Practice?

Introduction

Counselors who screen for depression need a brief measure that clients can complete quickly and that tracks change over time. The Patient Health Questionnaire-9 (PHQ-9) is among the most widely used instruments for that purpose. This paper examines the psychometric evidence reported in its original validation study, which serves as its technical documentation, and in later research, in order to judge how useful it is for clinical practice.

Overview of the Instrument

The PHQ-9 is the depression module of the Patient Health Questionnaire, a self-administered version of the PRIME-MD instrument. Each of its nine items corresponds to one diagnostic criterion for major depression and asks the respondent to rate, from 0 to 3, how often it occurred during the previous fortnight, so totals range up to 27. Kroenke et al. (2001) suggested reading totals of 5, 10, 15 and 20 as the lower edges of four rising severity bands, from mild to severe.

Norm Population

The original sample included 6,000 patients from eight primary care clinics and seven obstetrics-gynecology clinics, with a subsample of 580 patients who also received an independent structured interview by a mental health professional (Kroenke et al., 2001). The sample was large and drawn from real clinical settings, which is a strength. It was not, however, a counseling or mental health population, and obstetrics-gynecology patients were mostly women, so counselors should be cautious about assuming the same score distributions in community mental health clients.

Reliability

The items hung together well: Cronbach's alpha reached .89 in the primary care sample and .86 in the obstetrics-gynecology sample (Kroenke et al., 2001). Coefficients in the .80s are generally regarded as strong enough to support decisions about individual clients, and Drummond et al. (2016) stress that the decision a score supports should guide how much reliability is required. Test-retest reliability, assessed when a mental health professional readministered the items by telephone within 48 hours, was .84, indicating that scores were stable over a short interval. Because that second administration was given in a different format, by an interviewer over the phone rather than on paper, the coefficient also suggests that the items mean much the same thing whether read or heard, which matters for clients with limited literacy.

Validity

Criterion-related validity was assessed against the mental health professional interview. Using 10 as the threshold, the scale flagged 88% of the people whom interviewers found to have major depression, and 88% of people without it scored below the line (Kroenke et al., 2001). Construct validity was supported by strong associations between higher PHQ-9 scores and poorer functioning on all six subscales of a short health survey, along with more sick days, clinic visits and symptom-related difficulty. Later work strengthened the case. Pooling the raw data of 17,357 participants from 58 studies, Levis et al. (2019) found that a cut-off of 10 maximized combined sensitivity and specificity among studies using semistructured interviews, with sensitivity of .88 and specificity of .85. A review of the PHQ scales also reported that the PHQ-9 is sensitive to change over treatment (Kroenke et al., 2010).

Quality of the Information

The quality of the information is high. The original study reported its sample, methods and statistics clearly, and independent researchers have since replicated the main findings across many settings. Huang et al. (2006) tested the PHQ-9 with 5,053 primary care patients who were non-Hispanic White, African American, Chinese American and Latino, and found a single depression factor in each group, with alphas from .79 to .89, though some individual items functioned differently across groups. The PHQ-9's evidence is unusually strong for a free, nine-item measure, but that evidence was gathered mostly in medical settings, not counseling offices.

Problems and Limitations

Several problems deserve attention. First, the instrument screens and grades severity; it does not replace a diagnostic interview, and a positive screen requires clinical follow-up. Second, the 48-hour test-retest interval shows short-term stability but says little about longer periods. Third, accuracy depends on the reference standard; Levis et al. (2019) found that results differed depending on which type of diagnostic interview was used. Fourth, the differential item functioning reported by Huang et al. (2006) suggests that some items, such as those about sleep or appetite, may carry different meanings across cultures. Finally, as a self-report measure, it depends on the client's willingness and ability to report symptoms honestly.

Usefulness for Clinical Practice

The PHQ-9 is a highly useful tool for counselors when used for what it was designed to do: screening for depression and monitoring severity over time. Its reliability and validity support routine use at intake and at regular intervals, and its brevity makes repeated administration practical. It should not be used alone to diagnose, and counselors should interpret scores alongside the clinical interview, cultural context and other measures. Its free availability is a practical advantage for agencies and private practices alike, since no license fee limits how often it can be given. For the fictional client in this course's projects, a teacher referred for fatigue and poor concentration, the PHQ-9 would be an appropriate first measure in the battery.

References

Drummond, R. J., Sheperis, C. J., & Jones, K. D. (2016). Assessment procedures for counselors and helping professionals (8th ed.). Pearson.

Huang, F. Y., Chung, H., Kroenke, K., Delucchi, K. L., & Spitzer, R. L. (2006). Using the Patient Health Questionnaire-9 to measure depression among racially and ethnically diverse primary care patients. Journal of General Internal Medicine, 21(6), 547-552. https://doi.org/10.1111/j.1525-1497.2006.00409.x

Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606-613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x

Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010). The Patient Health Questionnaire somatic, anxiety, and depressive symptom scales: A systematic review. General Hospital Psychiatry, 32(4), 345-359. https://doi.org/10.1016/j.genhosppsych.2010.03.006

Levis, B., Benedetti, A., & Thombs, B. D. (2019). Accuracy of Patient Health Questionnaire-9 (PHQ-9) for screening to detect major depression: Individual participant data meta-analysis. BMJ, 365, Article l1476. https://doi.org/10.1136/bmj.l1476