BUSI 443 Week 4 Discussion Board Forum 2 Example

Discussion Board Forum 2: Measurement and External Selection

BUSI 443 Workforce Planning and Employment, Discussion Board Forum 2 Thread and Reply

Thread by [Student Name]

The forum prompt and the classmate are composites; the textbook and the research cited are real.

Thread

Heneman et al. (2015) teach that a selection tool is only as useful as its measurement properties. Reliability concerns whether a tool gives consistent results, and validity concerns whether its scores relate to later job performance. A tool can be reliable but invalid, measuring something consistently that has nothing to do with the job. I want to argue that, for most organizations, the most important selection decision is not which type of tool to use but whether to use it in a structured way.

For about twenty years, practitioners leaned on Schmidt and Hunter (1998), whose review pulled together eight and a half decades of studies on how well hiring methods predict performance. They found general mental ability tests to be among the strongest predictors of job performance, with structured interviews, work samples and integrity tests also performing well and adding to the prediction when combined with ability tests. Unstructured interviews predicted less well than structured ones. For many years, that ranking shaped how textbooks and consultants advised employers.

More recent work has revised these estimates. Sackett et al. (2022) contended that older pooled estimates had been adjusted too aggressively for range restriction, a statistical adjustment for the fact that only hired applicants have performance data. Applying corrections more conservatively, they found that validity estimates for many tools dropped, and that structured interviews emerged as among the strongest predictors, while the estimate for general mental ability tests fell substantially. Structure, it turns out, carries a great deal of the predictive power.

Consider a growing software company whose managers hire by informal conversation, asking whatever comes to mind and deciding by impression. Giving those conversations a fixed set of job-based questions and a shared rating guide would likely do more for its hiring than buying a new test.

Structure also supports fairness and legal defensibility, since every candidate is assessed on the same criteria. For a company with limited budgets, it is the most cost-effective improvement available.

A sensible plan for the software company would begin with a job analysis of its most common roles, write eight to ten questions for each that ask about past behavior or likely responses to realistic situations, and give interviewers rating scales with examples of strong and weak answers. It could then add a short work sample, such as reviewing a piece of code, which the research also rates as a strong predictor. Tracking new hires' performance reviews against their interview scores for a year would show whether the new process predicts better than the old one, which is the test of validity the chapter describes.

Reply to Jordan

Jordan, your plan to replace the call center's casual hiring chats with structured interviews fits the evidence well, and your example of a supervisor who hired candidates because they "seemed friendly" shows exactly the problem structure solves. I would add some detail about which parts of structure matter.

Levashina et al. (2014) reviewed the research on structured employment interviews and described structure as a set of components, such as job-analysis-based questions, the same question set for all candidates, favoring behavioral and situational items, rating each answer with anchored scales and using trained interviewers. They found that structure improved the reliability and validity of interviews and reduced the influence of irrelevant factors, and that some components, especially standardized questions and anchored rating scales, did much of the work.

For the call center, I would start with a job analysis of the agent role to identify the moments that matter, such as calming an angry caller or explaining a billing error, then write questions around them and give interviewers a rating guide with examples of strong, acceptable and weak answers. Heneman et al. (2015) emphasize that interviewers need training to use such guides consistently. Pairing interviewers also guards against the halo effect, in which one strong impression colors every rating, and it gives the center a simple check on reliability: if two trained raters often disagree, the guide or the training needs work. Over time, the center could compare interview scores with agents' quality scores after six months to confirm that the structured interview predicts performance in its own setting. Would the center be willing to have two interviewers rate each candidate separately and then compare scores?

References

Heneman, H. G., III, Judge, T. A., & Kammeyer-Mueller, J. D. (2015). Staffing organizations (8th ed.). McGraw-Hill Education.

Levashina, J., Hartwell, C. J., Morgeson, F. P., & Campion, M. A. (2014). The structured employment interview: Narrative and quantitative review of the research literature. Personnel Psychology, 67(1), 241-293. https://doi.org/10.1111/peps.12052

Sackett, P. R., Zhang, C., Berry, C. M., & Lievens, F. (2022). Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. Journal of Applied Psychology, 107(11), 2040-2068. https://doi.org/10.1037/apl0000994

Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124(2), 262-274. https://doi.org/10.1037/0033-2909.124.2.262