AF Tier Two Physical
Fitness Tests and
Standards Study
Neal Baumgartner, Ph.D.
USAF Fitness Testing and Standards Unit
Randolph AFB, TX
The views expressed here are those of the authors, and do not necessarily reflect official US Government, Department of Defense, or US Air Force positions or policies
AF Fitness Unit
Mission ‐ Maximize Human Performance
1. Provide exercise physiology science consultation on AF‐wide fitness assessment, program and policy to the AF Deputy Chief of Staff for Manpower and Personnel
2. Develop optimal physical fitness tests and standards
3. Provide environmental physiology (thermal stress) consultation
Team
• Unit Chief ‐ civilian exercise physiologist
• Deputy chief (Res O‐5), exercise physiologists (AD O‐4, ANG E‐6), part time aerospace physiologists (two Res O‐4s)
• Research assistants (Res/ANG, SSgt‐MSgt)
• Collaborate with AF Studies and Analysis Squadron analysts
Study Specific
– RAND PAF FY15 study ‐ parallel with AF Study
– BA Operational SMEs
Fitness Standards
• “Traditional/Historical” approach ‐ use normative data
– Quite subjective: “very poor” to “superior”
– Limited: rating against peers only
– Not anchored in health or mission requirements • Prior to 2010, AF fitness standards were arbitrary
– Not based on recognized science, health, or performance criteria
• We moved beyond traditional/historical model to criterion, science‐based standards
Components of Fitness
• Health components of physical fitness
1 Cardiorespiratory Endurance (aerobic)
2 Body Composition
3 Muscular Strength
4 Muscular Endurance
Tier 1
5 Flexibility / (Mobility ‐ Stability)
• Skill components
Tier 2
1 Agility
2 Balance
3 Coordination
4 Power
5 Reaction time
6 Speed
Magnitude
Total Physical Fitness = Health + Skill
Notional Depiction:
Health‐Based PF Standard
Notional Depiction:
Performance‐Based PF Standard
Health vs. Performance Standards
Health‐based fitness for total force (Tier 1)




Evidence‐based* *Unique to USAF
Health and general fitness standard across fitness components*
Occupationally (AFSC) independent
Gender dependent
 Completed Tier 1 science basis 2004, full implementation Jul 2010
 Only service with body composition in FA, abdominal circumference method
 Over two million fitness assessments Jul 2010 to present
 Tier 1 scores do not necessarily reflect military task achievement
 Performance‐based fitness by career field (Tier 2)





Evidence‐based
Performance standard across fitness components
Occupationally (AFSC) dependent
Gender independent
Next generation effort for AF Fitness ‐ Tier 1 for all + Tier 2 for some
Purpose: Tier 2 Study
• Develop occupationally‐specific, operationally‐relevant, science‐
based, criterion Tier 2 physical fitness tests and standards
• As early as 1998 we recommended two tier approach*
• Concerted, ongoing effort 2011‐present on Tier 2
– Battlefield Airmen (BA) ‐ four enlisted and three officer AFSCs
• Address additional physically‐demanding AFSCs 2016‐
forward
• Air Liaison Officer
• Explosive Ordnance Disposal
• Firefighter
• Survival Evasion Resistance Escape
– Next generation AF PF Assessment ‐ Tier 1 + Tier 2 (+ Tier 1B)
*Baumgartner, N. White Paper. US Air Force Physical Fitness Standards: Health and Performance Based. Force Enhancement and Fitness Division, Department of Aerospace Physiology and Human Performance, USAF School of Aerospace Medicine. Brooks AFB, TX. 28 Jul 1998.
Battlefield Airmen
1C4XX: Enlisted Tactical Air Command and Control Party (TACP)
1C2XX: Enlisted Combat Controller (CCT)
13CX: Special Tactics Officer (STO)
1T2XX: Enlisted Pararescue (PJ)
13DX: Combat Rescue Officer (CRO)
15WXC: Special Operations Weather Officer (SOWO)
1W0X2: Enlisted Special Operations Weather (SOWT)
RAND PAF FY12 Study
• AETC co‐sponsored study with AFSOC and HAF/A1P
• FY12 RAND PAF Study
– Initial Physical Demands Analysis
– Demonstrated BFOR Approach
– Recommend follow‐
on AF development and validation effort
Robson S., et al. Fit for Duty: an Assessment of Battlefield Airmen Physical Ability Requirements. RAND Corporation Project Air Force Interim Report. Arlington, VA., 2012.
Purpose: Tier 2‐WISR Study
• 2013 ‐ SecDef‐driven Women in the Services Review
• AF High Level Implementation Plan (May 13), three main tasks
1. Eliminate gender‐specific policies and assignment restrictions for positions in units with the seven previously closed AFSCs
2. Develop and validate occupationally‐specific, operationally‐relevant, gender‐
neutral physical performance tests and standards

3. Integrate women into previously closed AFSCs considering each aspect of the personnel lifecycle (Recruit, Assess, Select, Train, Develop)
AF Fitness Unit Action

Continue Tier 2 effort for BA

Meet DoD Women in the Services Review requirements
Timeline: Tier 2 Studies
Introduced Tiered
Standards Concept
Recommended
Tiered Standards
Concept to AFSOC
SOAR:
Process of PF
Standards
Development.
OSD Key WISR
Reference
‘98 ‘99
‘00
Authored
Tier 1
Sciencebased,
Criterion
Standards
AF Tier 1 Mod –
Matched
Scoring to
Science-based
Standards
Re-energize
Tier 2
Approach
AF restarts
1.5 mi run,
implements
AC
Continue
Tier 2 additional
AFSCs
(e.g., ALO,
EOD,…)
FY12 RAND
PAF Study
(faulty scoring)
‘03 ‘04
Ongoing Tier 2
Study;
encompasses
WISR Directive
‘10
‘11
‘13
’16 - fwd
US Public Law
Public Law 103‐160, Sec. 543 Gender‐neutral occupational performance standards
“In the case of any military occupational career field that is open to both male and female members of the Armed Forces, the Sec of Def shall ensure that qualification….for, and continuance of members….in, that occupational career field is evaluated on the basis of common, relevant performance standards…”
United States Government. United States Public Law 103‐160, Section 543. Gender‐Neutral Occupational Performance Standards. 30 Nov 1993.
High‐Level Focus
• Air Staff and Congressional Interactions
– Apr 13 ‐ Interviews with SASC and HASC PSMs
– Apr 13 / May 14 ‐ Met with AF senior leadership
– Jul 13 ‐ Attended House Caucus on Women in the Military
• HASC July 13 Letter of Concerns to Sec Def and CJCS
“Based on Services implementation plans presented to HASC, only one service, the Air Force, appears to be moving toward the development and implementation/testing of gender‐
neutral performance standards that would meet the requirement of the law.”
“The Air Force objective is to develop and validate occupationally‐specific, operationally‐relevant, and gender‐
neutral physical performance tests and standards for all seven previously closed AFSCs. This approach is entirely consistent with the law.”
Tier 2 / WISR Study ‐ Major Steps
• Three major steps in developing occupationally‐
specific, operationally‐relevant, science‐based, criterion PF performance tests and standards
– Step 1 ‐ conduct job analysis, an AFSC‐specific physical demand analysis to identify, describe and quantify physically demanding tasks/job requirements; Critical Physical Tasks
– Step 2 ‐ develop appropriate tests to evaluate ability to perform physically demanding work; Physical Test Battery and Physical Task Simulations
– Step 3 ‐ define physical capacity to perform work; establish minimum test scores associated with successful job performance; validate and set Physical Tests and Standards
Constable S.H. and Palmer B., editors. The Process of Physical Fitness Standards Development. Human Systems Information Analysis Center State of the Art Report. Wright‐Patterson Air Force Base, OH., 2000
1. Conduct PDA
Bona Fide Operational Requirements
2. Link: tasks - physical abilities - tests
Metabolic Demands
Literature Review; Focus Groups
FMPs
Scoring Assess‐
ments
Example
3. Develop and validate tests
Loaded Ruck
Agility, Balance, Coord
Muscular Strength, Endurance, Power
Cardiorespiratory
Endurance
3000m Run
Muscular Endurance
Squat Test
Ruck Test
Spivock
2010
Task 2A Timeline
Plan Development / Literature Review
Proposal / Institutional Review Board Approval
Staff Hiring / Training
Research / Procure – Equipment / Supplies
Agency Coordination
Step 1 – Job Analysis / PDA
Step 2 - Develop Physical
Task Simulations, Tests, and
Evaluate Physical Attributes
Step 3 - Validate
Tests and Standards
Q3
Q4
FY 2013
Q1
Q2
FY 2014
Q3
Q4
Q1
FY 2015
Q2
Q3
Q4
Q1
Q2
FY 2016
Step 1 Physical Demand Analysis
– PURPOSE: Conduct physical demand analysis, develop AFSC‐specific Critical Physical Tasks (CPTs)
– Specifically, define and delineate BA duty tasks that are both physically demanding and critical to mission success
• Step 0 ‐ developed preliminary physical task lists (PPTs)
• Step 1A ‐ Focus Groups refined PPT lists to draft CPTs; objectively scored PT list
• Step 1B ‐ BA Assessment/Survey objectively scored PT list, and provided data on non‐physical performance dimensions
• Step 1C Full Mission Profiles (6) ‐ observations; needs analyses
• Step 1D ‐ BA Leadership Interviews
Steps 0 and 1A ‐ Methods
• Step 0 ‐ Compiled duty task listings from:
– BA Occupational Analysis Reports
– Career Field Education and Training Plans
– BA subject matter experts (SMEs) assisted in elimination of non‐physical tasks, task description and initial ranking
• Step 1A ‐ BA focus groups (FGs); three FGs per AFSC, operationally experienced SMEs
– FGs described and delineated tasks with operational verbs
– Per operational missions conducted over the past ten years, FGs scored each task for frequency, duration, intensity, and importance (critical to mission success)
– FGs achieved consensus on task scores, via a priori criteria
• Composite score ≥ 3.5 points on a 5.0 point Likert scale
• Composite = 0.10 freq + 0.25 dur + 0.25 int + 0.40 importance
Step 1A Focus Groups ‐ Results
• Composite scores for draft CPTs were consistent across AFSCs
– Mean ± SD: CCT/STO 3.8 ± 0.3, SOW/SOWO 3.8 ± 0.2,
PJ/CRO 3.7 ± 0.3, TACP 3.7 ± 0.3
• FGs provided per task: combat loads, distances, team vs individual, mechanical advantages, environmental conditions, and assisted EPs in assigning physical descriptors; examples:
– PJ/CRO combat loads:
» Alpha = ‘slick’ ‐ helmet, goggles, load bearing vest; 20 lbs ‐ 25 lbs
» Bravo = alpha + helmet, plates, fluid, ammo, weapon; 65 lbs ‐ 85 lbs
» Charlie = bravo + 55 lb ‐ 75 lb ruck = 120 lbs ‐ 160 lbs
» Delta = specialty gear, e.g., scuba gear
– Distances for ‘maneuver/traverse terrain’ = 3k to 20k
– Physical Descriptors = pull, press/push, bend, core, squat, lift, velocity (walk, jog, run, sprint), power, agility, balance, quickness, isometric, crawl, climb
Steps 0 and 1A ‐ Results
• Steps 0 and 1A delineated duty tasks, respectively
• 0: Duty tasks PPTs and then 1A: PPTs draft CPTs
– CCT/STO
556
71
40
– PJ/CRO
981
161
50
– SOW
586
91
50
– TACP
415
79
44
Step 1A ‐ Results
Operational Groups and number of AFSCs per  Mountaineering operations 2
grouping

Casualty collection 4

Close quarters battle 4

Personnel extraction 2

Fast rope insertion/extraction system 4

Prepare deployed locations 2

Rope ladder actions 4

Artic operations 1

Small unit tactics 4

Landing zone operations 1

Water operations 4

Perform climbing procedures 1

Parachute operations 4

Radio assembly 1

Rig / De‐rig equipment 1

Vehicle operations 1
Step 1A ‐ Results, Draft CPTs
CCT‐STO Physical Performance Criteria
LANDING ZONE OPERATIONS
1A
TRAVERSE LENGTH OF RUNWAY TWICE (Context: establish assault/landing zone)
4.1
SECURE AND CHECK LANDING ZONE (Context: establish assault/landing zone operations)
3.9
ESTABLISH/BREAKDOWN/TRANSPORT LANDING ZONE NAVIGATION AIDS (Context: drop/landing zone operations)
3.8
PERFORM CONTINGENCY AMMO RESUPPLY (Context: engine‐running loadings/unloadings) 3.7
LOADING/UNLOADING EQUIPMENT ON/OFF AIRCRAFT (Context: engine‐running loadings/unloadings of aircraft or infil/exfil)
3.6
CLEAR OBJECTS/OBSTACLES FROM LANDING ZONE (Context: drop/landing zone operations)
3.6
Step 1A ‐ Results, Draft CPTs
SOW Physical Performance Criteria
PREPARE DEPLOYED LOCATION
1A
HAUL/CARRY LUGGAGE, RUCK, EQUIPMENT (Context: pack/palletize
deployment/contingency equipment on/off aircraft)
3.8
MANEUVER/MOVE/LIFT ITEMS (Context: pack/palletize deployment/contingency
equipment)
3.8
FILL/LIFT/TRANSPORT/PLACE SANDBAGS (Context: construct hasty or defensive
fighting positions)
3.8
LOAD AND UNLOAD EQUIPMENT (Context: pack/palletize deployment/contingency
equipment)
3.7
PUSH PALLETS FROM LOADER TO AIRCRAFT (Context: pack/palletize
deployment/contingency equipment)
3.6
CLEAR/REMOVE DEBRIS OR OBSTRUCTIONS (Context: drop/landing zone
activities)
3.6
DIG HOLES/DEFENSIVE FIGHTING POSITIONS (Context: construct hasty or
defensive fighting positions)
3.6
ASSEMBLE ANTENNA (TACMET/MOD III) (Context: set-up/tear down electronic
equipment)
3.5
Step 1A ‐ Results, Draft CPTs
PJ-CRO Physical Performance Criteria
PERSONNEL EXTRACTION
REMOVE SURVIVORS FROM AVALANCHES, AIRCRAFT OR VEHICLE WRECKAGE,
COLLAPSED STRUCTURES, OR CONFINED SPACES (Context: remove survivors from
avalanches, aircraft or vehicle wreckage, structures, and confined spaces)
EMPLOY AND OPERATE EXTRICATION DEVICES AND EQUIPMENT (Context: remove
survivors from aircraft or vehicle wreckage, structures, and confined spaces)
RECOVER / REMOVE SURVIVORS / REMAINS AND SENSITIVE MATERIALS FROM WATER,
WRECKAGE, OR VEHICLE (Context: remove personnel from aircraft or vehicle wreckage,
structures, and confined spaces)
DIG AND DISPLACE SNOW OR DIRT TO EVACUATE VICTIM (Context: perform avalanche
search and recovery procedures)
TRANSPORT EQUIPMENT AND GEAR TO OBJECTIVE, e.g., WRECKAGE SITE, DIVE SITE
OR VESSEL (Context: remove survivors from aircraft or vehicle wreckage, structures, and
confined spaces)
CONSTRUCT AND INSERT SHORING SYSTEMS TO STABILIZE WRECKAGE (Context:
perform lift-bag recovery and confined space collapsed structure procedures)
REMOVE DEBRIS, OBJECTS, OR OBSTACLES TO GAIN PATIENT ACCESS OR ESTABLISH
LANDING AREA (Context: clear building entry and landing areas for recovery forces at incident
sites)
1A
4.1
3.9
3.9
3.8
3.7
3.6
3.4
Step 1A ‐ Results, Draft CPTs
TACP Physical Performance Criteria
VEHICLE OPERATIONS
1A
REACT TO IEDs AND PERFORM ACTIONS ON CONTACT
DURING VEHICLE OPS (context: conduct vehicle ops)
3.6
RECOVER OR REPAIR DAMAGED OR DISABLED VEHICLES
(context: perform field expedient maintenance or recovery ops on
vehicle; e.g. change tire, hook-up tow bar)
3.5
MANEUVER OUT OF ROLLOVER OR SUBMERGED VEHICLE
(context: perform vehicle egress)
3.5
UNLOAD / CROSS LOAD PERSONNEL AND EQUIPMENT FROM
DISABLED VEHICLE TO EVACUATION VEHICLE OR AIRCRAFT
(context: perform field expedient maintenance or recovery ops on
vehicle; e.g. change tire, hook-up tow bar)
3.5
Step 1B Assessment/Survey
• Purpose: refine PT list; compile characteristics of a successful operator; continue and increase BA engagement in process
• Methods: sent to all operational AF BA; three sections
– BA demographics
– Physical Task Scoring Assessment: BA scored draft CPTs
– RAND Corp PAF Survey: defined operator characteristics
• Completed Apr 14; data compiled (n = 798, 27% AD, 25% overall)
• Composite scores for draft CPTs across AFSCs (mean ± SD) for 1A (FG specificity) and 1B (assessment ↑ n) were consistent:
– CCT/STO: 3.8 ± 0.3 / 3.8 ± 0.3
– SOW/SOWO: 3.8 ± 0.2 / 3.6 ± 0.4
– PJ/CRO: 3.7 ± 0.3 / 3.5 ± 0.3
– TACP: 3.7 ± 0.3 / 3.5 ± 0.3
Steps 1A and 1B ‐ Results, Draft CPTs
CCT‐STO Physical Performance Criteria
LANDING ZONE OPERATIONS
TRAVERSE LENGTH OF RUNWAY TWICE (Context: establish assault/landing zone)
1A
1B
4.1
4.0
SECURE AND CHECK LANDING ZONE (Context: establish assault/landing zone operations)
3.9
3.9
ESTABLISH/BREAKDOWN/TRANSPORT LANDING ZONE NAVIGATION AIDS (Context: drop/landing zone operations)
3.8
3.6
PERFORM CONTINGENCY AMMO RESUPPLY (Context: engine‐running loadings/unloadings) 3.7
3.5
LOADING/UNLOADING EQUIPMENT ON/OFF AIRCRAFT (Context: engine‐
running loadings/unloadings of aircraft or infil/exfil)
3.6
3.4
CLEAR OBJECTS/OBSTACLES FROM LANDING ZONE (Context: drop/landing zone operations)
3.6
3.7
Steps 1A and 1B ‐ Results, Draft CPTs
SOW Physical Performance Criteria
PREPARE DEPLOYED LOCATION
1A
1B
HAUL/CARRY LUGGAGE, RUCK, EQUIPMENT (Context: pack/palletize
deployment/contingency equipment on/off aircraft)
3.8
3.4
MANEUVER/MOVE/LIFT ITEMS (Context: pack/palletize
deployment/contingency equipment)
3.8
3.5
FILL/LIFT/TRANSPORT/PLACE SANDBAGS (Context: construct hasty or
defensive fighting positions)
3.8
3.7
LOAD AND UNLOAD EQUIPMENT (Context: pack/palletize
deployment/contingency equipment)
3.7
3.3
PUSH PALLETS FROM LOADER TO AIRCRAFT (Context: pack/palletize
deployment/contingency equipment)
3.6
3.1
CLEAR/REMOVE DEBRIS OR OBSTRUCTIONS (Context: drop/landing zone
activities)
3.6
3.4
DIG HOLES/DEFENSIVE FIGHTING POSITIONS (Context: construct hasty or
defensive fighting positions)
3.6
3.6
ASSEMBLE ANTENNA (TACMET/MOD III) (Context: set-up/tear down
electronic equipment)
3.5
3.1
Steps 1A and 1B ‐ Results Draft CPTs
PJ-CRO Physical Performance Criteria
PERSONNEL EXTRACTION
1A
1B
4.1
4.0
3.9
3.8
3.9
3.9
3.8
3.7
TRANSPORT EQUIPMENT AND GEAR TO OBJECTIVE, e.g., WRECKAGE SITE, DIVE
SITE OR VESSEL (Context: remove survivors from aircraft or vehicle wreckage, structures,
3.7
and confined spaces)
3.8
REMOVE SURVIVORS FROM AVALANCHES, AIRCRAFT OR VEHICLE WRECKAGE,
COLLAPSED STRUCTURES, OR CONFINED SPACES (Context: remove survivors from
avalanches, aircraft or vehicle wreckage, structures, and confined spaces)
EMPLOY AND OPERATE EXTRICATION DEVICES AND EQUIPMENT (Context: remove
survivors from aircraft or vehicle wreckage, structures, and confined spaces)
RECOVER / REMOVE SURVIVORS / REMAINS AND SENSITIVE MATERIALS FROM
WATER, WRECKAGE, OR VEHICLE (Context: remove personnel from aircraft or vehicle
wreckage, structures, and confined spaces)
DIG AND DISPLACE SNOW OR DIRT TO EVACUATE VICTIM (Context: perform
avalanche search and recovery procedures)
CONSTRUCT AND INSERT SHORING SYSTEMS TO STABILIZE WRECKAGE (Context:
perform lift-bag recovery and confined space collapsed structure procedures)
REMOVE DEBRIS, OBJECTS, OR OBSTACLES TO GAIN PATIENT ACCESS OR
ESTABLISH LANDING AREA (Context: clear building entry and landing areas for recovery
forces at incident sites)
3.6
3.3
3.4
3.5
Steps 1A and 1B ‐ Results, Draft CPTs
TACP Physical Performance Criteria
VEHICLE OPERATIONS
REACT TO IEDs AND PERFORM ACTIONS ON CONTACT
DURING VEHICLE OPS (context: conduct vehicle ops)
RECOVER OR REPAIR DAMAGED OR DISABLED
VEHICLES (context: perform field expedient maintenance or
recovery ops on vehicle; e.g. change tire, hook-up tow bar)
MANEUVER OUT OF ROLLOVER OR SUBMERGED
VEHICLE (context: perform vehicle egress)
UNLOAD / CROSS LOAD PERSONNEL AND EQUIPMENT
FROM DISABLED VEHICLE TO EVACUATION VEHICLE OR
AIRCRAFT (context: perform field expedient maintenance or
recovery ops on vehicle; e.g. change tire, hook-up tow bar)
1A
1B
3.6 3.6
3.5 3.5
3.5 3.5
3.5 3.5
Steps 1A and 1B ‐ Results
Operational Task Groupings
SOW‐
CCT‐STO SOWO PJ‐CRO
TACP
X
SD
3.7
3.7
3.8
0.2
3.8
3.7
3.8
0.1
3.8
3.5
3.6
3.6
0.1
3.6
3.6
3.6
3.5
3.6
0.1
Parachute Operations
3.5
3.5
3.6
3.6
3.5
0.2
Rope Ladder Activities
Fast Rope Insertion Extraction System
3.9
3.6
3.3
3.2
3.5
0.3
3.4
3.3
3.1
3.5
3.3
0.2
(all four AFSCs)
Small Unit Tactics
4.0
4.0
Casualty Collection
3.9
3.8
Close Quarters Battle
3.7
Water Operations
Conclusion: multi-phased SME FGs and BA-wide Assessments with objective scoring
proved efficacious for performing a salient portion of a physical demand analysis on
military occupations, specifically AF BA
Survey ‐ Top 11 Performance Dimensions
1.
Job‐specific technical competence, non‐physical 2.
Job‐specific physical readiness
3.
Handling emergency or crisis situations 4.
Situational Flexibility 5.
Spatial orientation and visualization
6. Handling work stress
7. Teamwork
8. Attention to detail
9. Oral communication
10. Critical thinking
11. Persistence
Collaboration with RAND Corp
Steps 1C and 1D
• Step 1C ‐ Full Mission Profile Observations
– Purpose: observe BA perform CPTs in operational setting
– Methods: documented physical actions in the field via video tape and written needs analysis
Step 1D Interviews
• Step 1D ‐ Interviews
– Purpose: review and confirm final CPT lists and Physical Task Simulations with emphasis on present and future capability
– Methods: interviewed special operations senior officer and NCO leaders, sampled x AFSC, major commands, units
MAJCOM
TACP
PJ
CRO
CCT
STO
SOW‐E
SOW
AFSOC
2
1
1
3
3
2
1
AETC
1
1
2
1
ACC
5
1
1
USAFE
1
PACAF
1
1
AFRS
1
ANG
1
Totals
8
7
3
5
3
3
1
 What proportion of BA should retain capability (by task)?

What other CPTs are missing?

What other CPTs should be added for future missions?

What other environments should be considered?
Totals
13
5
7
1
2
1
1
30
Step 2 ‐ Develop PF Tests and PTSs; Testing; Linkage
– PURPOSE: Develop Physical Test Battery and Physical Task Simulations; Conduct Testing; Establish Test‐
Performance Link
• Step 2A ‐ Identify and Review Physical Test Battery ‐
physical fitness (PF) tests
• Step 2B ‐ Develop and Review Physical Task Simulations (PTSs)
• Step 2C ‐ Conduct Testing ‐ Pilot Work and Data Collection
• Step 2D ‐ Establish Test‐Performance Link
CPT Basis for PTSs and Test Battery
Physical Task Simulations
Critical Physical Tasks
Tests and Standards
Physical Fitness Test Battery
Step 2A ‐ Identify PF Tests
• Step 2A ‐ Identified valid and reliable PF tests per recognized:
•
PF components (11): Cardiorespiratory Endurance, Body Composition, Muscular Strength, Muscular Endurance, Flexibility, Agility, Balance, Coordination, Power, Speed, and Reaction Time
•
Physical descriptors (14): Velocity, Bend, Twist/Core Rotation, Squat, Pull, Press/Push, Power, Lift, Climb, Crawl, Agility, Dynamic Balance, Quickness/Reaction Time, Isometric Contraction
Basic planes of motion:
1. Frontal Plane (left to right movements)
2. Sagittal Plane (front to back movements)
3. Transverse Plane (cross section movements)
• PF Tests ‐ objectively narrow and rank order 80 tests per exercise science literature and following criteria:
•
Content and face validity, reliability, field or laboratory application, practicality‐ease of administration, cost/resource‐equipment requirements, directions‐test protocol, skill requirements, literature references, standards, PFC‐PD breadth (Exer Prof Review ‐ 18 Dec)
Step 2A ‐ Fitness Test Battery
Test Battery
1
2
Paper/
Matrix
Scoring
(GAR)
3
Pilot
Testing
4
Data
Driven
Reduction
Final
Operator
Test
•
Identified PF tests from scientific literature, consultation, SME input
•
Objectively score per Content‐Specificity, Physical Descriptor Breadth, Ease of Admin, Resources, Subject Skill Requirements
•
Discriminators: SME input, injury risk, PFC breadth, literature, reliability, validity, norms/standards, directions/protocol, cost, adverse impact
Test Battery Site ‐ Lackland Main
TEST BATTERY OBJECTIVE SCORING GAR
TEST
Buddy Drag
Fireman’s Carry
Ammunition Resupply
Farmer’s Walk
5‐10‐5 Pro Agility Sandbag Lift
Ruck March
300‐Yard Shuttle Run
Three‐Cone Drill Test
Skedco Drag 100M
Slalom Test
T‐Test
Zigzag Run Test
Hurdle Test
YMCA Step Test
Illinois Agility Test
SUM
2.72
2.65
2.59
2.50
2.48
2.43
2.42
2.41
2.41
2.39
2.38
2.38
2.38
2.37
2.37
2.36
TEST
Hexagon Test 300 Meter Sprint
Triple Jump for Distance Test
20‐Meter Shuttle Run Test
Standing Long Jump
800M High Intensity Run Test
Low Crawl
Low Crawl; under load
Sled Pull
Lunges; Danish
Pull‐Up Test
500 M Ergo Row Test
Rope Climb; 20 feet in Body Armor
3 RM Trap bar Deadlift
Overhead Press: Ammunition Lift
Turkish Get Up
SUM
2.33
2.31
2.30
2.30
2.29
2.26
2.26
2.24
2.23
2.23
2.22
2.21
2.20
2.20
2.19
2.19
TEST BATTERY OBJECTIVE SCORING GAR
TEST
Bosco Test
1.5 Mile Run
SUM
TEST
SUM
2.16
2.16
In‐Water Vertical Jump
Weighted (25lbs.) Pull‐Up Test
2.09
2.09
Progressive Isoinertial Lifting Eval
2.14
Lat‐Pull Down
2.08
12 Minute Run Test
2.14
Push‐Up Test
2.08
3 Mile Run
2.14
Alternate Pull‐Up Test
2.07
Dips; Danish 2.13
500 M Surface Swim 2.06
Loaded Step Up Test
3 RM Olympic Push Press
2.13
2.13
1 RM Leg Press
Split Stance Med Ball Chest Pass
2.05
2.05
Vertical Jump Test
Backward Medicine Ball Toss
1 RM Olympic Push Press
2.11
2.11
2.10
90° Static Sit‐up; Danish Grip strength
Edgren Side Step Test
2.05
2.04
2.03
50 M Surface Swim Sprint
Overhead Medicine Ball Toss
VersaClimber VO2max test
Squat Jump Test
2.10
2.10
2.10
2.09
3 RM Leg Press
Sit‐Up
Flexed Arm Hang
2.03
2.03
2.03
TEST BATTERY OBJECTIVE SCORING GAR
TEST
1500 M Fin Swim
Supine Bridge
Prone Bridge
Sidearm Medicine Ball Throw
Alternate Single‐Leg Squat Test
Peg Board Climb
1 RM Bench Press
Firefighter Sledge; Forcible Entry
505 Agility Test
Side Bridge
25‐Meter Underwater Swim
Seated Chest Pass 1500 M Fin Swim
Supine Bridge
Prone Bridge
SUM
1.99
1.99
1.99
1.98
1.98
1.97
1.97
1.96
1.96
1.95
1.95
1.95
1.99
1.99
1.99
TEST
Seated Shot‐Put Throw Deadlift; Danish Weighted (25lbs.) Push‐Up Test Rockport Walk Test
Back Suspension
Water Repeat Sprint Test
Single Leg Deadlift
1 RM Olympic Lift Clean
Tread Water; Pararescue Test
Mid‐thigh Pull
Y Balance Test
VO2 max (treadmill)
Seated Shot‐Put Throw Deadlift; Danish Weighted (25lbs.) Push‐Up Test SUM
1.95
1.94
1.92
1.90
1.89
1.89
1.88
1.82
1.79
1.74
1.68
1.35
1.95
1.94
1.92
Summary Score = (Content Validity*) x (0.30) + (Physical Descriptor Breadth) x (0.225) + (Ease of
Administration) x (0.225) + (Specific Resources) x (0.15) + (Test Subject Skill Requirement) x (0.10)
* Content Validity= Physical Fitness Components, Metabolic Demands, Planes of Motion and
Displacement
Step 2B ‐ Develop and Review PTSs
• 2B PTSs link operationally‐relevant CPTs to physical tests
• 2B1 ‐ developed PTSs via AFSC‐specific workshops with Fit Unit, RAND PAF, and BA SMEs; guiding principles:
– Right simulations link performance and physical ability
– Important physical actions are represented and mission relevant
– Standardization
– Feasibly realistic to simulate
– Reliable and accurate measurement
– 2B2 ‐ Review
• Conducted 31 independent BA SME interviews to review CPTs and PTSs; revised PTSs
• 1D/2B2 ‐ BA Senior Leader Review ‐ clarify variations and confirm “What do you expect your BA should be capable of doing?”
Physical Task Simulations ‐ Draft Order
Land
Land
Land
Tower
Land
Land
Tower
Land
Land
Land
Land
Land
Land
Tower
Water
Water
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
T-Duck Carry to Aircraft
Airfield Operations
Rope Bridge
Wall Climb
Move Equipment
Remove Debris and Survivor from Confined Space
Single-leg Vertical Rope Ascent
Cross Load Personnel and Equipment
Casualty Movement
SUT Part A - Ruck March with Situational Awareness
SUT Part B ‐ Reaction Course
SUT Part C ‐ Maneuver Course
SUT Part D ‐ Casualty Movement
Rope Ladder
Swim to Inflatable Craft
Surface Fin Swim
PTS ‐ T‐Duck Carry to Aircraft
PTS ‐ Airfield Operations
Rope Bridge
PTS ‐ Rope Bridge
Climbing / Hauling
PTS ‐ Wall Climb
Move Equipment
PTS ‐ Move Equipment
PTS ‐ Remove Debris and Survivor from Confined Space
Single‐leg Vertical Rope Ascent
PTS ‐ Single‐leg Vertical Rope Ascent
PTS Tower Site ‐ Lackland Annex
PTS ‐ Cross Load Personnel and Equipment
Casualty Movement
PTS ‐ Casualty Movement
PTS ‐ SUT Part A ‐ Ruck March with Situational Awareness
PTS Land Site ‐ Lackland Annex
SUT Posture Transition
PTS ‐ SUT Part B ‐ Reaction Course
PTS ‐ SUT Part C ‐ Maneuver Course
PTS Land Site / SUT‐C
PTS Land Site / SUT‐C
Litter Carry
PTS ‐ SUT Part D ‐ Casualty Movement
Caving / Rope Ladder
PTS ‐ Rope Ladder
Surface and UW Swims
PTS ‐ Swim to Inflatable Craft
PTS ‐ Surface Fin Swim
Steps 2C1 ‐ Pilot Work
• Human subjects test protocol officially approved 9 Jan 15
• Preparation for Pilot Work and Data Collection
• Procure equipment and supplies for PF Test Battery and PTSs
• Test Site Approval
• Worked with CE at all test sites (Lackland/LTA, Hurlburt)
• Towers ‐ vertical PTSs
• Aquatic Facilities ‐ water PTSs
• Land Area ‐ ground PTSs
• Combat Equipment ‐ PTSs
• Indoor Facility ‐ PF Test Battery execution and equipment storage
• Transportation ‐ subject and team travel
• Construct PTS venues; set‐up PF test equipment and materials
Steps 2C2 and 2D ‐ Testing, Linkage
• Step 2C2 ‐ Conduct Testing / Data Collection
• Recruit subjects ‐ AF males and females, age 18 ‐ 45 yrs, current medical, fitness test, screening questionnaire
– Recruit approx 300 – 400 subjects to reach goal of 200 completing
– BA operators (50)
– BA tech trainees + Non‐BA tech trainees + AD Airmen (150)
– Female subjects ‐ 75 of 150
– Participation must be completely voluntary
– Score all subjects on all PF tests, and on all PTSs
– Step 2D ‐ Establish test‐performance link
• Use statistical tests to evaluate strength of relationship
Step 3 ‐ Validate and Set Physical Tests and Standards
– 3A ‐ Validate Tests and Standards
– Score separate set of test subjects on final test battery and PTSs; evaluate predicative ability of test battery weighted regression equation
– 3B ‐ Validate Physical Standards post‐FMP
Score separate set of BA operators on final physical test battery before and after an FMP, measure delta between pre‐ and post‐test data
•
• 3C ‐ Set Physical Standards • Identify minimally acceptable job/task performance
• Establish test scores that indicate acceptable physical readiness
• PF tests intended for use in BA operational, training, and selection tests for evaluation of ability to perform physically demanding work
– 3D ‐ CPTs vs Physically Demanding Training Requirements
Step 3 ‐ Methods
1. Collect data to determine how well tests predict PTS performance
Courtesy of RAND Corp
Step 3 ‐ Methods
2. Establish minimum level of acceptable PTS performance
•
•
•
•
•
Small group of experienced operators complete a PTS
Test administrators provide individual feedback on time to complete the PTS
Operators estimate time to complete PTS for a minimally acceptable performer
Courtesy of RAND Corp
Small group deliberation to discuss time estimates
Minimum PTS level set by average of estimates, consensus, or both
•
AF senior leadership review and approval Step 3 ‐ Methods
3. Establish test standard to maximize probability of successful physical performance
Courtesy of RAND Corp
Tier 2 / WISR Physical Study
2D Establish Linkage
1A Focus Groups
1B Assessment
Step 1
PDA
Develop
1C FMP CPTs
Observations
2A Test Battery
2B PTSs
3B Validate FMP
3A Validate
Step 2
Test Battery, PTSs, Testing, Linkage
Step 3
Validate and Set Tests and Standards
2C Pilot Work, Collect Data
3C Set Standards
1D Interviews
3D CPTs ‐
Trng Reqs
Timeline
• 6 Feb ‐ 28 Feb ‐ AF Fit Unit study pilot work (preliminary testing)
• 3 Mar ‐ 28 Mar ‐ pilot work with 24 Battlefield Airmen and 20 non‐BA subjects
• 14 Apr ‐ 13 Jun ‐ official data collection with ≈ 350 subjects starting to reach 200 completions (150 at Lackland, 50 Hurlburt)
• 22 Jun ‐ 18 Jul ‐ validation phase with additional 45 subjects
• 20 Jul ‐ 24 Jul ‐ Full Mission Profile (ACC, AFSOC supported) with ≈ 30 subjects, final TB pre‐ and post‐FMP
• Hurlburt Field Timeline ‐ offset parallel with Lackland
• Aug ‐ forward ‐ Implementation and Prototype Verification Work
(Dates subject to change due to subject availability and other unforeseen factors; however, 31 Jul 15 end date is firm per OSD)
Optimal Performance, Duty Cycles
Additional training increases performance for mission‐specific environments
Peak
Performance
Strength &
Conditioning Coaching
Injury Prevention Training
Baseline
Fitness
Tier II Standard
Task and Mission
Failure
Courtesy of RAND Corp
FOUO
Projected BA Operator Test
Current
Operator
Test
Tier 2
Operator
Test
Future BA fitness assessment will likely* overlap with current
operator test; study data will determine extent
*Projection only at this time
BA Fitness Testing
BA Trainee
AFSC
Specific
Final Test
BA Trainee
AFSC
Specific
Intermediate
Test
BA Candidate
AFSC
Specific
New PAST
Selection
FOUO
BA Operator
AFSC
Specific
Tier 2 Test
AF Fitness
Assessment
Tier 1 Test
BA Trainee
AFSC
Specific
Initial Test
Training Pipeline
Operational
Implementation and Prototype Verification
Study Dev
and Validation
SecAF/SOCOM
Review
Congressional Review*
30 Day Continuous (90 day)
Operators
Adjusted
Operator
FA**
Tier 2
Pipeline
Prototype
FA
Provide Training
Units Procure Equipment
Adjusted
Pipeline
FA**
Tier 2
PAST
Prototype
FA
Provide Training
Adjusted
Candidate
FA**
Accession/Recruitment
Provide Training
Units Procure Equipment
Training Pipeline
Implementation and Verification
Tier 2
Operator
Prototype
FA
*Title 10 U.S.C. § 113
& § 652
31 Jul 15
1 Apr 16
1 Jan 16
**Adjusted
per
Operational
Feedback
~ Oct 16
Verification Period
• Review standards against operator performance in mission settings
• Operators achieving minimum test scores should perform at a satisfactory level or higher on the job
– Evaluations of physical performance in actual missions
– Evaluations of physical performance in full mission profiles
• If observe pattern of poor performance, can adjust standards to ensure physical readiness • Documentation is critical
– Methods used to review standards
– Data used in making any adjustments to standards
Courtesy of RAND Corp
Goals
• Develop occupationally‐specific, operationally‐relevant, science‐based criterion Tier 2 PF performance standards with validated tests to measure adherence for:
– Battlefield Airmen
– Meeting 2013‐2016 DoD WISR requirements
– Additional physically‐demanding AFSCs (2016 ‐ forward)
– Next generation AF PF Assessment ‐ Tier 1 + Tier 2
• Provide optimal selection, training, and operational physical tests and standards
– Best qualified airmen for the tasks
– Match human weapon system to mission requirements
– Increase probability of successful mission execution
Back-up Slides
Step 2B ‐ Physical Task Simulations ‐
PJ/CRO
Tower
Tower
Tower
Tower
1
2
3
4
PTS
Rope Ladder
Rope Bridge
Rock Climbing
Single-leg vertical rope ascent
CPT
28, 29
4, 32
13, 14, 31, 47
31
Land
Land
Land
Land
Land
Land
Land
Land
Land
Land
5
6
7
8
9
10
11
12
13
14
Crossload Personnel
Jump Preparation
Casualty Movement
T-Duck Carry to Aircraft
Remove Debris and Survivor from Confined Space
Litter Carry over Adverse Terrain
SUT w Casualty Movement A
SUT w Casualty Movement B
SUT w Casualty Movement C
SUT w Casualty Movement D
9, 10, 44, 47, 48
34, 35
9
38, 39, 42, 43
9, 47, 48, 50
11, 12, 13
3
1, 2, 9
4
10, 11, 12, 13
Water
Water
15 Swim to Inflatable Craft
16 Surface Fin Swim
17, 19, 22, 29
17, 23, 24
Validate Physically Demanding Training Requirements Physical
Fitness
Operator Performance
L2
L1
Physically
Demanding Training
Requirement
Linkages represent progression of
capabilities to perform job requirements
Courtesy of RAND Corp
L3
L4
Critical
Physical Tasks
Performance
Attributes