Survey Design

How Survey Question Wording Can Skew Responses [Video]

How much can a single word in a survey question shift the answer? Substantially more than most survey designers think. This short video walks through a real example, "easy" vs "difficult" in the same question, and shows why word choice quietly biases your data before the respondent even gets to the scale.

By Adam Ramshaw 2 min read
How your words can influence survey results, illustration for How Survey Question Wording Can Skew Responses [Video]
How Survey Question Wording Can Skew Responses

A simple change in words can influence the response. Choose your words wisely as it may skew your results!

Transcription of this Video

Hi, my name’s Adam Ramshaw. I’m from Genroe.

Today’s customer feedback question is

“How much can one word in the question influence the answer?”

When we write a customer survey, we’re really trying to get a good understanding of what our customers think. So we really want to influence them as little as possible in changing what the score would be, or changing how they would respond.

Let me give you an example of how you might do this.

You might write a question that says,

“Please write how easy it was to contact our service desk, from very easy to very difficult?”

Now you see we have the word “easy” twice in that question, once in the question and once in the answer.

Just by human nature people are more likely to answer closer to the very easy end of the scale than the very difficult.

Skewing the results like this is something that you really don’t want to do. You want to get a clear understanding of what the customer is thinking. You really don’t want to influence them.

A much better way to ask the same question would be to simply say:

“How did you find contacting our service desk, from very easy to very difficult?”

Same idea, but now you’re not influencing people and influencing the response they’re going to give you. So you get much more accurate information.

One final thought to think about when you write questions is to try to be as neutral in the wording and in the lead-in to the question as you possibly can.

Try not to do things like saying:

“We try to provide excellent service. How was our service today?”

By adding that first sentence in you’re going to change the way the customers respond.

You really don’t want to predispose them to answer one way or the other. You want to get that neutral response from the customer.

Back to Blog

Related Posts

View All Posts »
Surveys for Customer Satisfaction Feedback: Do you make these mistakes?

Surveys for Customer Satisfaction Feedback: Do you make these mistakes?

I take pretty much every customer satisfaction survey I'm sent, it's a useful way to see what works and what to avoid. This is the first in a deconstruction series: a real survey from a web-hosting company, what they got right, and where it quietly fell over. Names removed; the lessons aren't.

Are These the Worst (Real) Customer Survey Questions You’ve Seen?

Are These the Worst (Real) Customer Survey Questions You’ve Seen?

Bad survey questions don't just annoy the respondent, they hand you data that's quietly wrong, and you only find out months later when you try to act on it. Here are the worst real-world survey question patterns I've collected, from biased phrasing to mandatory questions with no "N/A", and how to spot them in your own survey before they ship.

The Customer Survey Questions Experts use, with 149 samples

The Customer Survey Questions Experts use, with 149 samples

There are thousands of possible survey questions, but only three types that actually do work for the business, outcome, attribute, and how-to-improve. Get one wrong or skip one and the data doesn't drive action. Here's each type explained, with 149 real-world question samples to draw from.

The Only 6 Training Survey Questions You Will Ever Need

The Only 6 Training Survey Questions You Will Ever Need

Most training feedback forms ask 15 questions and tell you nothing actionable about the course. After analysing tens of thousands of responses across hundreds of training surveys, six questions consistently emerge as the only ones that matter. Here's the list, why each one earns its place, and the popular questions you can confidently drop.