ADA616378
ADA616378
ADA616378
Peter S. Schaefer
U.S. Army Research Institute
Leonard Bruce
Auburn University
John Lipinski
U.S. Army Research Institute
December 2014
Technical Review by
NOTICES
DISTRIBUTION: This Research Report has been submitted to the Defense Information
Technical Center (DTIC). Address correspondence concerning ARI reports to: U.S.
Army Research Institute for the Behavioral and Social Sciences, Attn: DAPE-ARI-ZXM,
6000 6th Street (Building 1464 / Mail Stop: 5610), Fort Belvoir, VA 22060-5610.
NOTE: The findings in this Research Report are not to be construed as an official
Department of the Army position, unless so designated by other authorized documents.
REPORT DOCUMENTATION PAGE
1. REPORT DATE (dd-mm-yy) 2. REPORT TYPE 3. DATES COVERED (from. . . to)
December 2014 Final December 2012 - April 2014
SECURITY CLASSIFICATION OF
19. LIMITATION OF 20. NUMBER 21. RESPONSIBLE PERSON
ABSTRACT OF PAGES
16. REPORT 17. ABSTRACT 18. THIS PAGE
Unlimited 19 Dorothy Young
Unclassified Unclassified Unclassified 703-545-2316
Unclassified
i
Research Report 1982
Peter S. Schaefer
U.S. Army Research Institute
Leonard Bruce
Auburn University
John Lipinski
U.S. Army Research Institute
December 2014
ii
ACKNOWLEDGEMENT
The authors would like to express their gratitude to the leadership and staff of the U.S.
Army Military Police School at Fort Leonard Wood, MO, for their support.
iii
EVALUATION OF COURSES OF FIRE FOR LAW ENFORCEMENT
FIREARMS TRAINING
EXECUTIVE SUMMARY
Research Requirement:
In response to active shooter threats, the U.S. Army Military Police School (USAMPS)
identified current best practices for weapons skills training as employed by various civilian and
military law enforcement authorities. That information was then used to construct a new set of
military police (MP) pistol exercises which focus on dynamic shooting engagement and the
development of skills in successful target transitioning and rapid weapon reloading—the types of
skills required for success in active shooter situations. To identify an effective, efficient
approach for training these skills, the Army Research Institute was asked by USAMPS to aid in
the experimental design and analysis of data resulting from the Law Enforcement Firearms
Training Validation Research effort.
Procedure:
Active (N = 134) and Reserve (N=230) MPs were trained on a new set of pistol exercises
in a Dry, Engagement Skills Trainer 2000 (EST 2000), Live, or Live Plus (a live fire conditions
with more live practice rounds) condition. Baseline and post-training shooting performance was
measured via scores on a newly developed course of fire.
Findings:
For Active MPs, only the Dry and Live Plus conditions significantly improved
qualification scores. For Reserve MPs, all four training conditions were equally effective at
improving qualification scores. Therefore, the results indicated that the Dry and Live Plus
conditions were the most consistently effective at improving MP qualification scores.
The findings provide decision makers with relevant information regarding resource
allocation and training strategy implementation. For example, to the extent that the MP samples
are representative of their respective populations, then different training recommendations are
appropriate for Reserve versus Active MPs. These findings were disseminated and briefed to
USAMPS personnel at Fort Leonard Wood, MO.
iv
EVALUATION OF COURSES OF FIRE FOR LAW ENFORCEMENT
FIREARMS TRAINING
CONTENTS
Page
INTRODUCTION ...........................................................................................................................1
METHOD ........................................................................................................................................3
RESULTS ........................................................................................................................................3
REFERENCES ................................................................................................................................9
APPENDICES
v
EVALUATION OF COURSES OF FIRE FOR
LAW ENFORCEMENT FIREARMS TRAINING
Introduction
For this transition in training focus to succeed, it was necessary to identify an effective,
efficient training approach for military law enforcement personnel. Perhaps the most basic
decision was whether to use live rounds for marksmanship training. At the broadest level, there
are three available options: live fire training, dry fire training, and simulation training (e.g.,
Engagement Skills Trainer 2000 [EST2000]).
There are numerous advantages to live fire training. Fundamentally, training with live
rounds most closely approximates the task demands of marksmanship qualification performance
and active shooter responses. These demands include anxiety management, which may impact
psychomotor skills (Chung, Delacruz, de Vries, Bewly, & Baker, 2006), as well as recoil
management, natural lighting conditions, and the full range of target distances. Previous
research suggests that incorporating live ammunition throughout training produces better training
outcomes (McGuigan, 1953). However, live fire is also associated with important limits, such as
range availability, ammunition costs, and safety considerations especially for initial entry MPs
and novice firers.
Dry fire training is training in which individuals train without live or simulated rounds.
Anecdotal evidence suggests that dry fire can compose up to 70% of training time for
competitive marksmen and is a critical component of maintaining and enhancing fundamental
marksmanship training skills, especially sight alignment, trigger control, and weapons handling
(e.g., drawing the weapon from the holster). Neurocognitive research on skill learning and habit
formation indicates that practice in psychomotor tasks leads to a representational shift from
deliberate processing to more automatic response execution (Poldrack, et al., 2005; Yarrow,
Brown, & Krakauer, 2009). To the extent that the actions practiced reflect appropriate
movements and facilitate shooting performance, they would be expected to transfer to live round
contexts and improve shooting performance. There are several advantages of dry fire practice.
First, because it requires no additional equipment beyond the weapon and (for pistol shooting) a
holster, dry fire training can be extremely cost effective. Second, dry fire training can be
executed virtually anywhere, i.e., indoors or outdoors. This ease of execution means that dry fire
training can be undertaken at the shooters convenience. It is also comparatively safe, provided
1
standard safety procedures are followed. Third, dry fire training also supports the training of
weapons draw and magazine loading, which are crucial for the execution of time-limited
shooting tasks and fundamental weapon control. Improvement in such tasks can reduce task
execution time and increase shooter confidence. Despite these advantages, however, there are
limitations to dry fire training. First, dry fire does not provide feedback on round location.
Second, dry fire training is of limited use for teaching recoil management.
Computer-based simulators offer a viable alternative to both live fire and dry fire
marksmanship training. Previous research suggests that performance with laser based training
systems can be highly predictive of live fire qualification performance for both rifle and pistol
(Smith & Hagman, 2000). In addition, previous work suggests that laser-based simulation
systems may in some ways be more effective than training emphasizing dry fire practice
(Hagman, 2000). One major benefit of simulated training is that, like live fire training, it offers
feedback about round location. In addition, like dry fire training, simulation training does not
require the use of live rounds. Further, computer simulations, such as the EST2000, offer a wide
variety of shooting options (e.g., variety of targets and target locations and scenarios (e.g., active
shooter, robbery, hostage) that are simply not feasible for a live fire range. As with any training
system, there are drawbacks to computer-based simulations for law-enforcement marksmanship.
First, the simulated recoil is not identical to the recoil experienced with live rounds, impeding the
acquisition of recoil management skills. Second, unlike dry fire training, simulation training
requires specialized equipment, buildings, and personnel that are not always available. Third,
while simulated training systems are remarkably flexible, some systems such as the EST2000
cannot incorporate extremely close range shooting (less than 3 meters from target). Fourth,
simulation-based training is typically carried out in dark, indoor facilities with light-emitting
screens, and, thus, simulation-based training cannot replicate natural shooting environments.
The goal of this research was to empirically assess the relative effectiveness of the three
broad approaches in training MPs active-shooter scenario skills. To that end, Active and Reserve
Component MPs were trained in one of four conditions (dry, simulation, and two versions of live
training).
Method
Participants
The sample consisted of 134 Active Component MPs and 230 Reserve Component MPs.
The reported ranks of the participants ranged from E1 to O4. Participating units were selected
on the basis of projected MP numbers and MP type (i.e., Reserve vs. Active). Units were
assigned to the different training conditions according to the availability of the required facilities.
Each individual provided informed consent prior to participation.
The training pilot lasted a total of three days. On Day 1, participants completed standard
unit Preliminary Marksmanship Instruction (PMI), including weapons safety training. This
instruction was consistent with established unit-specific practices and was not altered to
2
accommodate the training pilot assessment. After completing PMI, all individuals completed the
baseline training pilot qualification course of fire for pistol (see Appendix A) using a standard
Omaha Q target. This score served as the measure of baseline (i.e., pre-training) pistol
performance.
On Day 2, participants completed group exercises in either Dry, Simulation, Live, or Live
Plus firing conditions depending on which training condition they were assigned. With a few
minor exceptions, the training conditions differed only in terms of method—the exercises were
largely the same (see Appendix B). However, the ‘Live Plus’ condition merits a fuller
description. In essence, the Live Plus condition was identical to the Live condition but for the
use of additional live rounds which were used to complete a practice round of the pilot pistol
qualification course of fire (again, see Appendix A).
On Day 3, individuals completed the baseline training pilot qualification course of fire for
pistol once again. Thus, the course of fire shown in Appendix A served as the measure of both
baseline and post-training pistol performance.
Results
Separate analyses for the Active Component MPs and Reserve Component MPs were
conducted to determine the training conditions that best matched the unique characteristics of the
MPs. This was done because there were differences in the baseline marksmanship scores of the
Active and Reserve Component MPs.
All analyses were conducted on SPSS 21.0 for Windows, and the alpha level for statistical
significance set at .05 for all tests. As this was an exploratory analysis, all p values should be
treated with caution. Each analysis used a 2 (scores on baseline and post-training qualification) x
4 (training condition) mixed-factor analysis of variance. If the interaction term was statistically
significant, then post-hoc analyses were used to clarify the nature of the interaction.
The interaction term was significant (F (3, 130) = 7.65, p < .05, MSE = 24.20). The
nature of the interaction can be gleaned by examining Figure 1, which contains error bars
indicating 5% confidence intervals. The Dry and Live Plus conditions significantly increased
qualification scores from baseline to post-training, while qualification scores were statistically
equivalent in the EST2000 and Live conditions.
3
Figure 1. Mean Marksmanship Qualification Scores for Active Component MPs. Error bars
indicate 95% confidence intervals.
The interaction term was not significant (F (3, 226) = .43, p < .05, MSE = 22.84) nor was
the main effect for training condition (F (3, 226) = .34, p > .05, MSE = 31.22). However, the
within-subjects effect was significant (F (1, 226) = 189.00, p <.05, MSE = 22.84). As presented
in Figure 2, all four training conditions resulted in a statistically significant and statistically
equivalent increase in
performance.
4
Figure 2. Mean Marksmanship Qualification Scores for Reserve Component MPs. Error bars
indicate 95% confidence intervals.
Considered all together, the results indicated that the most effective conditions for
training the new USAMPS course of fire were Dry and Live Plus. The Reserve MPs, benefited
almost equally from all four training conditions. However, Active MPs only benefitted from the
Dry and Live Plus training conditions. If a choice is to be made between Dry and Live Plus
training conditions, the decision may depend on available resources. The Reserve Component
MPs equally benefitted from both Dry and Live Plus. A cost savings could be realized for
Reserve MPs by utilizing dry fire training. However, Live Plus resulted in a larger increase in
qualification scores for Active Component MPs as compared to Dry. Thus, a decision would
have to be made as to whether the greater effectiveness of Live Plus over Dry is large enough to
justify the expenditure of extra resources.
5
Explaining why the Live Plus training condition led to increased performance for both the
Reserve and Active Component MPs is a relatively straightforward affair. Namely, as noted in
the Introduction, use of live most closely approximates the task demands of marksmanship
qualification performance and active shooter responses. In addition, the Live Plus condition not
only allowed for the use of additional live rounds (compared to the Live condition), but also
afforded an additional practice trial on the course of fire. Less expected, perhaps, was the
finding that Dry was so effective in increasing marksmanship performance. Given the different
pre-training performance scores of the Reserve and Active Component MPs, the role that Dry
training played may be quite different. For the Reserve Component MPs, the increase in
performance may have resulted because Dry training focuses on fundamental behaviors
associated with the shooter and the weapon (e.g., sight alignment, trigger control) rather than a
strict focus on bullet placement. Such fundamental skills may be necessary conditions of
accurate bullet placement. For the more experienced Active Component MPs, Dry may have
resulted in successful reinforcement training of the fundamental behaviors.
Making a fully informed choice between Dry and Live Plus for Active MPs will require a
consideration of a broader range of factors than this data alone-namely, the availability of range
time, allocation of rounds, etc. Nor should the other methods of training be ruled unworthy of
further consideration. As the data show, for the Reserve MPs all four training conditions were
significantly and equally effective.
These findings were disseminated and briefed to USAMPS personnel at Fort Leonard
Wood, Missouri.
6
References
Chung, G. K., Delacruz, G. C., de Vries, L. F., Bewley, W. L., & Baker, E. L. (2006). New
directions in rifle marksmanship research. Military Psychology, 18, 161-179.
Hagman, J. D. (2000). Basic rifle marksmanship training with the laser marksmanship training
system (Research Report 1761). Alexandria, VA: U.S. Army Research Institute for the
Behavioral and Social Sciences. (DTIC No. ADA380109).
Poldrack, R. A., Sabb, F. W., Foerde, K., Tom, S. M., Asarnow, R. F., Bookheimer, S. Y., &
Knowlton, B. J. (2005). The neural correlates of motor skill automaticity. The Journal
of Neuroscience, 25, 5356-5364.
Smith, M. D., & Hagman, J. D. (2000). Predicting rifle and pistol marksmanship performance
with the Laser Marksmanship Training System (No. TR-1106). Alexandria, VA: U.S.
Army Research Institute for the Behavioral and Social Sciences. (DTIC No.
ADA384045).
Yarrow, K., Brown, P., & Krakauer, J. W. (2009). Inside the brain of an elite athlete: The
neural processes that support high achievement in sports. Nature Reviews Neuroscience,
10, 585-596.
7
APPENDIX A
A-1
DEPARTMENT OF THE ARMY
LAW ENFORCEMENT PISTOL QUALIFICATION SCORECARD
For use of this form, see ST 19-LEWQ; the proponent agency is USAMPS
ID: Date: Range Surface:
UNIT (Organization and location): Weather: Temperature: Uniform:
Ran k: G roup: 1 2 3 4 p·tsto ll'tglh t: y es No T1YJ>i! Ho Ister:
Station Tilsl. Position Oistenc~ II Event T1me H1t H1t M ISS PTM Hud Notes
(met~~) Rnds (seconds) Bdyl 9o)(l 0
A-2
APPENDIX B
B-1
Training Condition
Dry EST2000 Live Live Plus
Time
Training Event Rounds Standard Repetitions
Trigger Reset, firing position, 5 1 NA 10 10 10 10
meters, 2” bull target
Single Shot, holster, 5 meters, 2” 1 NA 5 5 5 5
bull target
Single Shot, holster, 10 meters, 4” 1 NA 5 5 5 5
bull target
Single Shot, holster, 25 meters, 8” 1 NA 5 5 5 5
chest
Controlled Pairs, holster, 5 2 2 sec. 6 6 **5/1 **5/1
meters, 2” bull target
Controlled Pairs, holster, 10 2 3 sec. 2 2 2 2
meters, 4” bull target
Controlled Pairs, holster, 25 2 3 sec. 3 3 3 3
meters, 8” chest
IA/Reload (2x2x2), holster, 5 6 10 sec. 3 3 3 3
meters, 4” bull target
Controlled Pairs, low ready, 7 2 3 sec. 5 5 5 5
meters, 8” chest
Close in Ready, controlled pair, 2 3 sec. 4 *4 4 4
Close in Ready, 2 meters, 8” chest
Close in Ready, controlled pair, 2 3 sec. 5 *5 5 5
holster, 2 meters, 8” chest
Bill Drill (6 round), holster, 5 6 NA 3 3 3 3
meters, 4” bull
Failure Drill, holster, 7 meters, 8” 3 5 sec. 5 5 5 5
chest, 4” head
(continued)
B-2
(continued)
Training Condition
Dry EST2000 Live Live Plus
Time
Training Event Rounds Standard Repetitions
Pivots Rear, holster, 7 meters, 8” 2 4 sec. 8 8 *8 *8
chest
Move and Shoot, controlled pairs, 2 2 sec. 5 *5 5 5
low ready, 10-3 meters, 8” chest
One Hand (strong), controlled 2 3 sec. 3 3 3 3
pairs, holster, 7 meters, 8” chest
One Hand (support), controlled 2 6 sec. 3 3 3 3
pairs, holster, 7 meters, 8” chest
Barricade Standing, left, controlled 2 4 sec. 3 3 3 3
pairs, holster, 15 meters, 8” chest
Barricade Kneel, left, controlled 2 4 sec. 3 3 3 3
pairs, holster, 15 meters, 8” chest
Barricade Standing, Right, 2 4 sec. 3 3 3 3
controlled pairs, holster, 15
t 8”Kneel,
Barricade h t Right, controlled 2 4 sec. 3 3 3 3
pairs, holster, 15 meters, 8” chest
B-3