I wrapped up the testing portion of the scope field test last night!!! Although I significantly underestimated how much time this would require, I committed to do it … and now the hard part is over. I did get some great data that may offer new insight, and help fellow shooters see what they’re paying for.
I’ve already started crunching the data, and plan to start publishing results within the next 2 weeks. Instead of analyzing all of the data and writing all the content up front, I plan to break it down into sections and publish each one as I go. So this will essentially be a series of posts, and one might cover the results of the double-blind optics tests, while another one talks about the findings related to how precise the click values were. There may be 3-4 posts total to cover the results, and the final post will wrap it all up with some overall scores and a summary.
Now, I need some input from you. I’ve been debating on how to weight the overall scores. Essentially, I tested optical performance, mechanical performance, and I’m also trying to quantify things like ergonomics and other specialized features. How should each of those be weighted in the overall score? Is optical clarity or mechanical precision more important? Please take a minute to let me know what you think by answering the one question poll below. The poll will only be open for 1 week (closes 6/19).
Update 6/24/14: Thanks to everyone for providing input on this. 709 people completed the poll, and it really helped me understand how the overall scores should be weighted. Here are the results:
You can see mechanical and optical performance were both obviously rated as very important, but mechanical was rated as slightly higher priority on average. Most shooters view precise mechanical adjustments as a cost to even be a serious candidate at this price point. Then on the less important end of the scale was ergonomics and what I grouped as “advanced features” (I didn’t know what else to call it). It looks like they are also very similar in ranking, although a few more people thought things like reticle options, locking turrets, zero stop, etc. were slightly important, and some even said that stuff as VERY important. Thanks again for the feedback. And, as I’ve mentioned to a few people … don’t worry, I won’t dumb all the results down to top-level scores. I plan to publish exhaustive details of each and every test. So if you don’t agree with the overall scoring weight, you can look at the results for each test and come up with your own conclusions. I just want to provide some type of summary score for people who prefer the “cliff notes” version, and I wanted the weights I used to lineup with what the shooting community in general thought was important … not just based on what I thought was important. Thanks!
Here are a few more photos from the field tests: