i take time out for others strongly agree or disagree

It takes a bit more time to write direct questions than agree/disagree ones, but you will get more accurate results. “Likert-like scales are ubiquitous on smile sheets – but they are very problematic and should be avoided in most circumstances”įor more information on why these questions can be improved on, read Will’s’ book, see this survey research article by eminent researchers Krosnick and Presser or read my article on good survey practice on the Questionmark blog. To quote learning researcher Will Thalheimer in his excellent book on smile sheets (course evaluation surveys) “ Performance-focused smile sheets”: Furthermore, the distinction between “Strongly Agree” and “Agree” is imprecise and different people will select one or the other with different criteria. The respondent has to think “what do I feel about the statement?” and then “how should I answer?”, and this complexity reduces how accurate the results are. On average, studies have shown that with two questions asking the same thing in different ways, around 14% more people agree with an assertion compared to those who express the same point of view via a direct question.Īnother reason that agree/disagree questions should be replaced is that they require the respondent to evaluate the statement and then answer. This factor has been shown repeatedly in research. This is a particularly strong tendency for some of those with less formal education, who are more likely to agree, as they may think the survey author knows more than they do. Whether due to people wanting to be polite or just because they don’t want to put in the effort, people tend to agree with survey statements much more than they disagree. People are much more likely to agree with a statement than disagree with it. One reason why agree/disagree questions are weak is due to something called “acquiescence bias”. It’s much better to replace it with something direct. Is this a good question or a poor one? The answer: it is usually a poor question. It’s very common in surveys to ask whether a respondent agrees or disagrees with a statement (sometimes called a Likert Scale question).

One of the most common kinds of survey questions, used widely in course evaluation surveys, employee attitude surveys and other surveys of opinion or attitude in education and training, is actually a source of survey error and should be avoided.

I take time out for others strongly agree or disagree