Recognizing and Avoiding Common Pitfalls

Loading...

From the course by University of California, Davis

Quantitative Research

25 ratings

University of California, Davis

Quantitative Research

25 ratings

Course 3 of 4 in the Specialization Market Research

In this course, you will obtain some insights about marketing to help determine whether there is an opportunity that actually exists in the marketplace and whether it is valuable and actionable for your organization or client. Week 1: Assess methods available for creating quantitative surveys, along with their advantages and disadvantages. Identify the type of questions that should be asked and avoid unambiguous survey questions. Week 2: Design, test, and implement a survey by identifying the target audience and maximizing response rates. You will have an opportunity to use Qualtrics, a survey software tool, to launch your own survey. Week 3: Analyze statistical models that can be applied to your marketing data, so that you can make data-driven decisions about your marketing mix. Week 4: Predict most likely outcomes from the marketing decisions and match the type of analysis needed for your business problem. Take Quantitative Research as a standalone course or as part of the Market Research Specialization. You should have equivalent experience to completing the second course in this specialization, Qualitative Research, before taking this course. By completing the third class in the Specialization, you will gain the skills needed to succeed in the full program.

From the lesson

Getting Started and Preparing to Design a Quantitative Survey for Market Research

In this module, you will be able to identify the business objectives and assess the suitability for quantitative research. You will be able to build on qualitative findings to help inform a survey. You will be able to discuss the various types of surveys and take steps to design and implement a survey. You will also be able to recognize and avoid common survey pitfalls.

Introduction to Preparing to Design a Quantitative Survey for Market Research1:46

Identifying Business Objectives4:43

Assessing Suitability of Quantitative Research5:52

Building On Qualitative Findings to Inform a Quantitative Survey4:59

Introduction to Various Types of Quantitative Surveys1:49

Online Surveys4:41

Telephone Surveys4:43

In-Person Surveys4:12

Direct Mail Surveys3:33

Steps to Design and Implement a Survey - Part 17:36

Steps to Design and Implement a Survey - Part 24:54

Recognizing and Avoiding Common Pitfalls6:30

Meet the Instructors

Susan Berman
President, Impact Research
UC Davis Division of Continuing and Professional Education
Olivier Rubel, PhD
Associate Professor, Graduate School of Management
UC Davis

Hi there.

If you don't know by now,

designing a survey isn't the easiest thing in the world to do.

There are a lot of factors to consider.

And there are an infinite number of ways to phrase questions.

But you want to make sure you phrase a question just right to get

that information you want.

It isn't always a simple task.

And there are a lot of ways you can make mistakes that affect the data you capture.

In this lesson, we're going to discuss some of these pitfalls and

talk about ways to avoid them.

After this lesson, you will be able to identify tasks you can outsource,

identify common pitfalls in designing and implementing quantitative research, and

also be able to explain techniques to avoid and mitigate them.

All right then, let's get started.

In the next module of this course,

you will begin designing your quantitative survey.

But before you begin this task,

let me point out some of the most common pitfalls so that you can avoid them.

Since I've covered the ground many times, trust me, I know where the pitfalls lie.

Of course, there may be others.

But if you anticipate and avoid these ones,

you'll definitely save yourself a lot of trouble and produce a much better survey.

One common pitfall is surveying the wrong target market.

This can happen when your client wants you to bite off more than you can chew.

They may identify too broad of a target market.

An example would be simply identifying students age 18 to 24.

To avoid surveying this incorrect target market that is too broad,

I would suggest to the client narrowing it to students age

18 to 24 who have purchased a new smartphone in the last year.

Another common pitfall in surveying is not getting enough responses.

This can happen when you choose the incorrect research approach for

the designated target market.

For example, instead of doing a mail survey with the students age 18 to 24,

you would probably want to do on online survey instead, right?

That particular target market is plugged in and online, so

you want to meet them where they are.

Most of them aren't going to bother filling out a mailed survey,

let alone putting it in the mailbox and returning it.

Another common pitfall is not including N/A or other as an option in a response.

This is when you design a question on a survey that will be avoided if

the respondent can't fit the response in the correct slot.

They will probably just skip it and you will risk losing valuable data.

The N/A response means not applicable.

An example would be asking an 18 to 24 year old, who has an iPhone,

how satisfied are you with your Android phone?

Not at all, somewhat, satisfied or very satisfied.

To avoid this, I would recommend putting in N/A response

because the question is not applicable to their situation.

They may have an iPhone and don't have an Android phone.

Another common pitfall is poorly worded questions.

You've probably experienced this when you've been taking a survey and

said yourself, what?

What are they asking?

Or that makes no sense.

Here's an example.

What do you think about your new cell phone?

Is it too big, too fast, too cheap, or not fancy enough?

The provided answers from which a respondent is supposed to choose are all

over the place and don't quantify well.

They also mix language modes, meaning some of these can

be seen as a positive attribute and some can be seen as a negative attribute.

To avoid poorly worded questions, pay attention to the lesson in the next

module where I discuss how to write good questions.

Another common pitfall is bias from the survey administrator.

This is when the interviewer tells the respondent too much information about

the question that will likely lead their response.

These are known as leading questions.

An example would be, the next question I have is a really hard one.

To avoid this type of bias from the survey administrator,

I would advise you merely asking the question as it was written exactly

without trying to qualify the question in any way.

Another common pitfall is unprofessional interaction.

This can happen for a variety of reasons.

One main reason is that your interviewer was not properly trained about

what to do and what not to do when interacting with a respondent.

An example could be a phone interviewer who makes up data to get a response,

as I've mentioned before.

To avoid interacting unprofessionally,

I recommend screening the people you hire very carefully.

Get their references and call them and be very clear with them.

For a phone interviewer in particular, it may even make sense to

draft a script in a conversational tone for the interviewer to use.

One common pitfall is bias from intentionally surveying some people and

not others.

This is when you don't follow the randomly chosen procedure designated in your

research.

This is also referred to as sampling error.

And my colleague Olivier will go over this in more detail later in the course.

An example of this sampling bias would be picking only people from

the phonebook who have a last name starting with a A.

Clearly people who have last names starting

with the letter A don't represent views adequately of your entire sample.

It isn't random enough.

To avoid bias from intentionally surveying some and not others,

I advise that you give your interviewers an exact list of who they should be

interviewing, in the order in which you would like them to be interviewed.

There is also a software you can use, including in Excel,

that can help you further randomize a list of names to survey in order

to get a good random sample.

Okay, with that,

that's a wrap of the most common pitfalls I'd like you to be aware of.

As I suggested earlier, there are definitely others.

But these are pretty common ones that are seen often when surveying people.

And I'd like you to follow the suggestions I've outlined to avoid them.

Explore our Catalog

Join for free and get personalized recommendations, updates and offers.

Coursera provides universal access to the world’s best education, partnering with top universities and organizations to offer courses online.

© 2018 Coursera Inc. All rights reserved.

Download on the App Store

Get it on Google Play