We know that the M&S conclusions are statistically invalid. We know that the data collected has not been subject to peer review and, at the very least, contains inconsistencies. For this reason, I give the M&S data and conclusions very little credence.
This is unfortunate because their concept of quantifying qualitative data is attractive and could be useful. Any similar study would essentially consist of case studies, but case studies can be useful if enough are done and they are done properly. A lot of medical advances have been made through case studies.
Over the years, we have used a lot of anecdotal data to come to conclusions most of us accept. The Army depended upon anecdotal data in determining the .38 Long Colt to be deficient and reverted back to a .45 caliber pistol firing a heavier bullet at moderate speeds, a combination which it had previously used with good results (anecdotal). The .45 acp and the 1911 pistol were born and were proven many times over by anecdotal evidence. Most of us accept the military's long experience with the .45 acp as evidence it is a solid defensive round.
The .38 special 158 gr. LRN (standard pressure) bullet became known as "the widow maker" due to anecdotal evidence of poor terminal ballistics. This led to the development of hollow points and +P ammo. Most of us would consider the 158 gr. LRN in .38 special to be a relatively poor choice for a defensive round, even if ultimately deadly.
But, it would be a mistake to simply rely upon anecdotal evidence in choosing a handgun cartridge for defense. The variables are too complex and results may not be repeatable. Enter testing in ballistic gelatin. While not a perfect test medium, it approximates muscle tissue and is useful because it is repeatable and results can be easily compared. Subsequent anecdotal data often supports the gel test results, lending them additional credibility.
In summary, the M&S data and results are simply too flawed to accept as authoritative. Instead, any decision on caliber/cartridge should be based upon both ballistic gelatin results AND anecdotal evidence obtained over a long period of time.
This is unfortunate because their concept of quantifying qualitative data is attractive and could be useful. Any similar study would essentially consist of case studies, but case studies can be useful if enough are done and they are done properly. A lot of medical advances have been made through case studies.
Over the years, we have used a lot of anecdotal data to come to conclusions most of us accept. The Army depended upon anecdotal data in determining the .38 Long Colt to be deficient and reverted back to a .45 caliber pistol firing a heavier bullet at moderate speeds, a combination which it had previously used with good results (anecdotal). The .45 acp and the 1911 pistol were born and were proven many times over by anecdotal evidence. Most of us accept the military's long experience with the .45 acp as evidence it is a solid defensive round.
The .38 special 158 gr. LRN (standard pressure) bullet became known as "the widow maker" due to anecdotal evidence of poor terminal ballistics. This led to the development of hollow points and +P ammo. Most of us would consider the 158 gr. LRN in .38 special to be a relatively poor choice for a defensive round, even if ultimately deadly.
But, it would be a mistake to simply rely upon anecdotal evidence in choosing a handgun cartridge for defense. The variables are too complex and results may not be repeatable. Enter testing in ballistic gelatin. While not a perfect test medium, it approximates muscle tissue and is useful because it is repeatable and results can be easily compared. Subsequent anecdotal data often supports the gel test results, lending them additional credibility.
In summary, the M&S data and results are simply too flawed to accept as authoritative. Instead, any decision on caliber/cartridge should be based upon both ballistic gelatin results AND anecdotal evidence obtained over a long period of time.