The
Myth of "One Shot Stop" Percentages
| Many firearms enthusiasts, particularly
those who are students of tactical handgun technique, are familiar with Evan Marshall and
Ed Sanow's (M&S) "One Shot Stop" (OSS) statistics. However, for
reasons I hope to explain here, I believe that the M&S OSS percentages are of very
little use to anyone trying to choose a defensive handgun caliber or load. |
| What OSS Is |
Before I explain why OSS is inaccurate, it will be useful to
understand what OSS is, or is supposed to be. M&S study actual police shooting
reports and autopsy reports and cull from these reports all cases where the person shot
received only a single gunshot wound, that wound being to the upper torso (center of mass,
or "COM"). All other shootings are discarded and are not part of the
analysis. This is an important fact, and one that Ill address at length later.
M&S then take all of these single-COM-hit cases and determine how many of them
resulted in a "stop," which they define as a cessation of hostility within a
certain time period. That number, represented as a percentage of all the single COM hit
cases, is the official "one shot stop percentage" for that round. In cases where
less than five shootings have occurred with a particular load, M&S have a statistical
prediction model they use instead.
|
| Why OSS Doesn't Mean Much |
The biggest problem with the OSS approach, as mentioned
above, is that it automatically discounts every single instance in which it took more than
one shot to stop an attacker. The effect of this should be obvious to anyone who has
even a passing familiarity with defensive handgun skills. When you shoot someone who is
attacking you, you keep shooting until the person stops attacking you. So the odds are
very high that if you only shoot someone once, it is because he stopped attacking you
after one shot. In those cases where only one shot is fired and the attacker did not stop,
that is likely due to some event which kept you from shooting more than one round (e.g.,
the Bad Guy took your gun away, or shot you).
Other variables involved like specific shot placement, firearm used, angle of shot,
etc., are also ignored by M&S. However, it is these variables which are determining
whether the round fired actually stops an attacker. Some folks have argued that,
over a large enough data set, all of these variables will be self-correcting. The
problem is that very few of the loads which M&S discuss have been in a significant
number of "acceptable" shootings under the M&S criteria.
|
| Unbalanced Numbers |
Because of the M&S methodology, it is very easy to get
ridiculously high OSS numbers. Many different loads are rated as 93 to 96% "one shot
stoppers." But everyone knows that handguns simply arent that powerful. If a
96% OSS meant that a round had a 96% chance of stopping an attacker, then shooting someone
twice with that round should yield a 99.8% chance of stopping the attacker. Thats as
close to 100% as you can get, and no one is suggesting that a double tap with any
handgun ammo can guarantee a stop.
|
| Speaking of Double Taps |
In their second book, M&S discuss the double tap and
offer some shooting data for cases where two COM hits were scored rather than one. Many
people were startled to learn that the "two shot stop" percentages and the OSS
numbers were almost identical. Of course, this shouldnt surprise anyone. In fact,
it demonstrates just how biased the numbers are. Once again, you see that people shoot
until an attacker is stopped. The numbers are not significantly different because they
dont represent anything about the ammunition.
|
| An Example of the Problem |
The M&S methodology vastly underreports instances of
ammunition failure to stop. Imagine the following ten scenarios, all using the
Zenwolf .40S&W Black Super Death Gold Shok-Talon Safety[tm] ammo:
- One round fired, COM hit, target dies.
- One round fired, COM hit, target incapacitated.
- One round fired, COM hit, target doesn't stop and in fact kills his shooter, but then 2
seconds later hears his ex-wife yelling at him and so surrenders just to get away from
her.
- One round fired, head hit, target stops.
- Two rounds fired in quick succession, target stops.
- One round fired, left pinky shot off, target starts crying and surrenders.
- One round fired, COM hit, target doesn't stop, two more rounds fired, COM hits, target
stops.
- Subject takes 14 rounds in the COM, head, and pelvis, doesn't stop, kills everyone
within four square miles.
- Six rounds fired, 3 COM hits, target doesn't stop.
- Four rounds fired, 2 COM hits, 1 head hit, 1 pelvis hit, target doesn't stop.
According to the M&S criteria, only the first three (one round fired only, COM hit)
meet their criteria and are part of the study. In this case, the Zenwolf round has a 100%
OSS (the target surrendered within the M&S time limit in #3, and that's all that
matters unless youre the deceased person who wasnt saved by your One
Shot Stop). In actuality, only five out of the ten (50%) were stopped AT ALL by the ammo,
and only three out of ten (30%) were stopped by the ammo in one shot.
Case #5 is a big question mark: there's no way to know whether the first round alone
would have been enough.
Cases #3 and #6 obviously have nothing to do with ammo selection. Nevertheless, one
counts towards the study and one doesn't.
Cases #7-10 are all cases where one shot DID NOT STOP the attacker, but these don't
count toward the M&S study because more than one hit was taken by the subject.
In particular, cases #8-10 show that even after multiple good hits, this ammo did not
stop this particular attacker.
Nevertheless, this round gets a 100% OSS rating.
|
| Skill Level |
One suggestion that some critics of M&S have put forward
is that the glaring differences in OSS numbers might reflect shooter skill more than
ammunition effectiveness. For example, the .357Magnum is frequently touted as the
"top round" in OSS. However, it was not uncommon (back when many police
departments issued revolvers) to find only the more skilled shooters using .357Magnum
ammunition, while the less skilled shooters used the softer-kicking .38Special loads. The
same is true today for agencies which issue 9mm but allow officers to buy and carry their
own .45s. So it is possible (though by no means certain) that the .357 owes
some part of its OSS success to the fact that .357 shooters tend to be more skilled than,
say, .32ACP shooters. This could also account for the unusually high OSS rates of many
.22lr munitions, since many people who use twenty-twos are accomplished pistol shots.
It has also been suggested that revolver shooters (and therefore revolver calibers and
loads) are by necessity more careful with their shot placement, which results in greater
likelihood of good stopping hits. Compared to the spray-and-pray so common with high
capacity 9mm semiautos, this may be one reason there is a disparity between these
calibers.
|
| For those interested in the other side of
the debate, see Dale Towert's
Stopping Power Page, the official web depository of M&S OSS data. |
| Conclusion |
The fact is, you cannot draw any conclusions from the
M&S reports. They refuse to make their data available (and at least some of their
cited sources deny any involvement with the study), so it is impossible to do more than
point out the problems with their statistical model whether their hard-earned data
actually does point to some stopping power truisms will remain unknown. I would like to
state that Im not suggesting M&S are charlatans, nor do I think they are fools.
They explain their methodology, and are then made victims by gun writers, editors, and gun
shop commandos who misunderstand what M&S are trying to present.
The M&S OSS system makes perfect sense until you take a long critical look at it.
However, I hope that my short discussion, above, has helped to dispel the myth that these
numbers represent anything statistically significant about handgun ammunition. The average
defensive handgun student desperately wants an objective way to measure his gun and
ammunition, so he can know he has The Best. But, as M&S themselves frequently say,
its all about shot placement
train to hit your target in the vital COM, and
the difference between one caliber or another and one load or another are going to mean
much less in real life than in any on-line debate. |
|