We contribute to society by helping organizations hire and develop the right people, helping workers and students find their best career path, ensuring assessment tools are validated and implemented fairly, and evaluating programs for accountability.

TALENT MANAGEMENT

The Department of Homeland Security (DHS) turned to us to help overhaul its human capital management program for cybersecurity professionals across components. Designed to rethink all aspects of the traditional civil service system, the Cybersecurity Talent Management System ranged from recruitment to compensation to performance management.

ASSESSMENT SOLUTIONS

We developed, validated, and implemented five pre-employment physical ability assessments for the Electrician’s Assistant job at San Diego Gas & Electric (SDG&E) in compliance with federal statutes. This project included job analysis, test development, content and criterion validation, documentation, and implementation steps and materials.

PERSON-JOB FIT

For more than three decades, HumRRO has supported the Defense Testing Assessment Center’s mission-critical work on the Armed Services Vocational Aptitude Battery (ASVAB) and, more recently, its Career Exploration Program (CEP). The ASVAB and CEP are critical programs for acquiring and engaging new talent for the U.S. military—enabling the services to recruit and access hundreds of thousands of applicants each year. In 2021, we signed a five-year contract to advance these programs using new or emerging techniques in machine learning and natural language processing, among others.

PROGRAM & POLICY EVALUATION

Colorado’s Office of the State Auditor engaged HumRRO to assess whether the requirements of the state accountability system described in the statute are being implemented as intended. We presented the results of the year-long study to the Colorado State Board of Education and the Colorado Legislative Audit Committee.

EXPERT CONSULTING

We comprehensively reviewed the Wisconsin Center for Education Research and WIDA ACCESS assessment system’s psychometric processes and activities. Our evaluative work identified strategies to improve the efficiency of psychometric processes without sacrificing the validity and reliability of the assessment scores, and we provided a clear set of recommendations to improve operational processes.

We contributed to science and shared our work and expertise by publishing more than 80 articles and studies in academic journals and delivering presentations at numerous conferences, including these examples:

Journal of Educational Measurement,
Fall 2022 Special Issue

EDITORS: David Dorsey, Ph.D., Vice President, and Hillary Michaels, Ph.D.

IMPACT: Features original research articles from practitioners and researchers tackling the challenges of AI validity arguments in educational assessment domains.

Military Psychology, 2022

EDITORS: Deborah Gebhardt,
Ph.D., Principal Scientist
(with Todd Baker, Ph.D.)

IMPACT: Features original research articles from practitioners and researchers tackling the challenges of AI validity arguments in educational assessment domains.

2022 International Personnel Assessment Council Annual Conference

KEYNOTE SPEAKER: Suzanne Tsacoumis, Ph.D., President & CEO

IMPACT: Shared her expertise on
technological advances, such as rich media (i.e., animation, video), automated scoring, and artificial intelligence, in high-stakes assessments.

62nd International Military Testing Association Conference

KEYNOTE SPEAKER: Deirdre Knapp, Ph.D., Principal Scientist

IMPACT: Shared insights on impactful military selection and classification research.

Our staff shared their time, talent, and expertise with many different professional organizations over the past two years, including in the following roles, and several were recognized for their service.

American Psychological Association Beth Bynum, Ph.D., Manager

Member: APA Committee on Psychological Tests and Assessment (CPTA)

Dan Putka, Ph.D., Principal Scientist

Member: SIOP’s Task Force on Artificial
Intelligence (AI) Based Personnel
Assessment and Prediction

2022 Society for Industrial and Organizational Psychology (SIOP) Fellow

RECIPIENT: Gavan O’Shea, Ph.D., Manager

GIVEN BY: Society for Industrial and Organizational Psychology

2021 Distinguished Service Contributions Award

RECIPIENT: Deirdre Knapp, Ph.D., Principal Scientist

GIVEN BY: Society for Industrial and Organizational Psychology

Named in honor of HumRRO’s founding director, the Meredith P. Crawford Fellowship is one of the most prestigious awards, granting a non-renewable $12,000 stipend, in the fields of human resources and organizational behavior.

2022 Recipient:
Chen Tang
University of Illinois
Urbana-Champaign’s School of Labor and Employment Relations

2021 Recipient:
Ji Woon (June) Ryu
Kelley School of Business
Indiana University in Bloomington