Assessing Inter-rater Reliability and Intra-rater Reliability During the 2-Minute Hand-Release Push-Up Event in the Army Fitness Test.

Authors

Drew Van Dam, Rachel Gidaro, Sarah Ferreira, Jenna Morogiello, Dan Jaffe, Austin Semmel

Published in

Journal of strength and conditioning research. Sep 18, 2026. Epub Sep 18, 2026.

Abstract

Van Dam, D, Gidaro, R, Ferreira, S, Morogiello, J, Jaffe, D, and Semmel, A. Assessing inter-rater reliability and intra-rater reliability during the 2-minute hand-release push-up event in the army fitness test. J Strength Cond Res XX(X): 000-000, 2026-The Army Fitness Test, implemented in 2025, assesses soldier readiness via 5 physically challenging events (3 repetition maximum deadlift, hand-release push-up, sprint-drag-carry, plank, and 2-mile run). Each event is graded by individuals with varying levels of experience, thus posing a threat to the reliability of the physical performance scores. The purpose of this study was to examine the inter-rater and intra-rater reliability of the two-minute hand-release push-up test to facilitate learning and improvement of assessing physical performance. Seventeen raters (5 female, 12 male) graded 10 hand-release push-up (HRPU) videos over 3 separate weeks (30 total videos, 60 total minutes). Each video contained a recording of a Cadet performing the two-minute HRPU test. Raters were required to provide a response after each repetition by stating "yes" for a proper repetition and "no" for an improper repetition. Researchers recorded all responses from raters in each of the 3 settings. Videos were randomized for each week of viewing with no rater viewing the videos in the same order. Using a logistic model, we were able to measure inter-rater and intra-rater reliability. Researchers calculated the intraclass correlation coefficient to evaluate overall reliability and agreement and Prevalence-Adjusted, Bias-Adjusted Kappa to further understand inter-rater and intra-rater reliability. Ultimately, we found that raters were not consistent as a group, with some showing significant fluctuations in their responses between tests. This finding is crucial because even small differences in scoring can negatively impact assessment on the HRPU event influencing a subjects's total score.

PMID:
42758003
Bibliographic data and abstract were imported from PubMed on 18 Sep 2026.

Read full publication at:
Please sign in to see all details.

Stats

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.