| |
Four Barriers to Accuracy
There are four major barriers to accuracy when you use any method that relies on the verbal responses of people who have volunteered to participate in a survey, poll, interview or focus group.
The Barriers
1. The most obvious barrier is inability to recall. The
Faulty Memory
of some of your survey respondents may limit the accuracy of your survey results.
2. The mental process of
Repression
is the tendency of people to accept a new message into their minds and then unconsciously erase the conscious memory of how the message got in. Like Faulty Memory, Repression may limit the accuracy of any research that relies on recall.
3. If enough people refuse to participate in a survey, the group of people who do participate may not be a representative sample. Psychologists and statisticians call this type of inaccuracy
Nonresponse Bias.
It is a serious and growing problem. 4. A substantial percentage (up to 50 percent) of people in any sample will give
Dishonest Answers
during a survey. There are various reasons for lying, including a desire to avoid seeming "politically incorrect," a desire to seem dignified or "classy," and a desire to sabotage the survey.
Why You Should Care About This
I raise the topic of inaccuracy for three reasons: - To caution you that some methods are non-intuitive: they have pitfalls and you should use outside experts.
- To help you recognize that some methods are less accurate than they appear to be – even when executed by experts.
- To explain why non-verbal methods – especially
Classical Tracking
– are more accurate than surveys.
Which Methods Are Affected?
Any time you invite people to give you information verbally, you risk some inaccuracy due to Faulty Memory, Repression, Nonresponse Bias, or Dishonest Answers, in some combination. This risk exists, in varying degrees, in the following methods:
Burke Test
Starch Tests
Message Testing
Editorial Survey
Readership Survey
Public Survey
Reverse Tracking
I want to re-emphasize that the effects vary from method to method. And with proper expertise applied, the effects can be mitigated.
Return from Barriers to Accuracy to Home
|