fbpx

Tag: response rates

CATI IN 2019: Battling Declining Response Rates

The transition away from telephone interviewing is well underway. Online polls now make up the principal source of data on consumer opinion surveys, with CATI projects largely being relegated to B2B audiences, historic tracking studies and geographic areas that lack online representation.

online polling Although online has now become the preferred methodology for most due to its attractive price point, it still poses a lot of questions in the subjects of quality and representation. The absence of a clear set of standards for online research, in particular online polling, has led to many questions about the reliability of the results that are shared.

Whilst journalists are now more likely to cite online polls as a reliable source of data, it is still unclear in many cases how these polls are fielded, and if the sample composition is entirely dependable.

Of course, traditional live-interviewing telephone polls have been facing their own challenges as of late. As the cost of labor has increased, so too has the average cost per telephone survey, and as consumers turn away from landline phones in favour of cell phones, response rates continue to decline. To further complicate matters, phone response can vary greatly within different demographic groups.

phone survey There is substantial evidence that phone interviewing is inherently less biased than opt-in panels. For one, randomly dialling both landline and cell phones puts you in touch with a consumer that may or may not know about market research and hasn’t voluntarily opted into a research-based panel. Secondly, a phone approach provides access to segments of the population that are traditionally under-represented on online panels including younger males, visible minorities and senior citizens.

As consumers continue the trend of ditching their landline in favour of a cell phone only household, sample and interviewing techniques must keep pace in order to ensure that a CATI methodology remains representative and that response rates remain high.

Here are three things to consider when conducting your CATI project.

 

Cell Phone vs Landline

An RDD (Random digit dialling) approach is effective in some cases, but as households move away from having a landline in their home it’s now more important than ever to ensure cell phone sample is included in your sample mix. Based on the latest data, a 60% land line, 40% cell phone sample split is ideal. This blend will ensure that you’re reaching cell phone only households which tend to skew younger in age.

 

Maximizing Your Success with Targeted Audiences

Does your project contain visible minorities, or perhaps those who are considered to be affluent? You can dial blindly amongst the general population in the hopes that these individuals will fall out naturally. However, chances are that these audiences are more likely to have unlisted numbers which would not be included in general landline dialling. For these groups a targeted sample list approach might be best. Targeted sample lists contain appended demographic data which is sourced from 3rd party consumer lists and databases. This increases your chances of connecting with your desired audience and you can boost your overall target numbers.

 

Making Your Survey Relatable and User Friendly

In addition to targeted sample, it’s also important to consider the overall framework of your project to ensure that you are making it as easy as possible for participants to take part. If you’re dialling visible minorities are you using interviewers that speak the language? Are you dialling from a local number as opposed to a toll free number. Is the survey itself accessible?  The more relatable you make your survey to participants the higher participation and cooperation rates will be.

 

Some people say phone is dying. I prefer to look at is as a metamorphosis.  As consumers habits change, so too must our research practices and approach. At the end of the day, the goal is to ensure high quality response rates and by following the 3 steps above you’ll ensure that your phone projects continue to be well rounded and balanced.

 


About Chris Connolly

2018 Color headshot Chris Connolly, Vice President of Research Services at The Logit Group is persistently focused on providing superior value and experience for each client relationship. With over 20 years of industry experience serving in leadership roles for both technical groups and project management teams, he has a proven track record of success.

Top Four Tips for Boosting Sampling Response Rates

It might sound obvious, but your sample is the most important part of your market research project.

Too often, it seems like the survey participants’ experiences and opinions of market research are somewhat overlooked. However, our industry relies heavily on individuals giving up their own time and effort to respond to long questionnaires. If they don’t enjoy the experience or gain any benefit, then why should they bother participating?

Businesses rely on customer data to guide their decision making and provide a sense of direction when making a change in terms of a product enhancement, service overview, or even a new product range. Therefore, reduced response rates ultimately mean less insight or fewer data-driven outcomes.

How can you help your participants enjoy the experience of giving you feedback?

 

1. Treat people the way you would want to be treated

It is important to ensure your research invitations and reminders clearly outline what you are asking. This may include information on why you are conducting the research, incentives on offer (e.g. gift cards), and an explanation why their feedback will be so valuable.

You should try to personalize communication to an individual as far as possible with the resources you have available. For example, most email marketing tools allow you to directly customize how you address emails to individuals rather than impersonal form letters.

Far too often, researchers leave participant communication to the bottom of their list of priorities. I think this is totally wrong. Ask yourself whether you would complete a particular survey if you yourself received the email you’re about to send.

jakeblog2.image2

2. Go mobile

So many people in the industry mention the use of mobile surveys that it must get boring to always read about it! Still, the reason we all say it so much is because we still continually find surveys that have not been mobile-optimized and are not responsive to being answered on a phone or tablet. It can be challenging to get participants to complete a survey while they are watching TV, and an even bigger task to convince them to answer your questions when they are hard to read on a cellphone screen.

We know a high proportion of individuals are “second-screen watchers,” which means they may be watching TV while also texting on their phone. By making a survey mobile-optimized, you increase the likelihood of someone completing it as a second-screen experience instead of never bothering to take part.

jakeblog2.image9

3. Never be boring

Can you remember the last time you wanted to complete a survey that consisted of 40 questions? I can’t… and I am sure your participants feel the same way.

Neither researcher nor participant benefits from excessively lengthy and tedious questioning in either qual or quant research. When survey participants are bored, they are more likely to flip through the survey questions, rush and give false answers just to complete it. Having a seemingly endless list of questions also increases the likelihood of dropouts throughout the survey, negatively affecting your representative sample.

You should be developing short and lean surveys that take participants less than five minutes to complete. This can give you the essential information you require while also increasing the likelihood of a large sample size because of the short length.

jakeblog2.image10

4. Don’t sit on your feedback

After completing a quantitative survey that has a sample size of 1,000+, the worst thing you could do is just ignore all that feedback and not act on any of the new intelligence.

Participants want to feel valued—not just from a gift or reward point of view, but also emotionally. They want to know whether or not their feedback has truly helped, and they really want to see what you, as a brand, will do with the insight and opinions they shared. Offering participants feedback allows them to see the true value of completing a survey or a piece of research for you. It means they will be far more likely to take five or 10 minutes of their own time to complete something for you again.

jakeblog2.image7

Conclusion

By making surveys short, sharp and to the point, you give participants less work to do and your business still gains valuable data and information. The four tips outlined in this article are only a handful of ways to boost response rates. However, implementing even one of these suggestions will help improve the research experience for your participants. Happy and rewarded participants mean quality data outcomes for you that can lead to data-driven decision making.


About Jake

Jake-Pryszlak_avatar_1546770824-400x400 Jake Pryszlak, commonly known as the Research Geek, is a 3-time award-winning market researcher, blogger and speaker. He’s a current Forbes columnist who is active across a plethora of social media channels. His aim is to share his market research knowledge with others in the industry. You can find his blog and social media channels here.