Focus groups are a waste of time and money
While focus groups are the ‘sacred cow’ of market research, do they really achieve what they set out to? Agents of Spring’s Evette Cordy argues that relying on verbal conversations in an artificial environment, often observed behind a two-way mirror, is like “trying to solve a jigsaw puzzle with only 25% of the pieces”.
Focus groups are the sacred cow of qualitative market research. They’re fast, cheap and easy to organise. But are they good value? And do they deliver what’s required? I’ve moderated hundreds of focus groups in Australia and overseas over the past two decades, and I believe they come with several, fundamental limitations. So while companies spent approximately $70m on focus groups in Australia in 2017, it might be time to kill this sacred cow.
Artificial environments
Most traditional focus groups treat people like the latest zoo attraction – observed around a table in front of a discretely located camera, or through a two-way mirror. On the other side of the mirror are comfier chairs, and no doubt tastier snacks and drinks, where observers convey a sense of control.
Pretty much. The comment about social conformity is an interesting one, particularly in a time when expressing certain opinions and attitudes comes with a social cost. For example, if a participant genuinely holds racist views they not likely to express them in a focus group….but meet them at the Reclaim Australia rally and…
That’s obviously an extreme example but there a moderate but “unpopular” views that people aren’t going to express.
Add to that, I suspect that the same general problem exists here as in many surveys. Anyone with the time to participate….may not be very reflective of the general population.
Well, lookie here pardners, looks like someone with something to sell wants a slice a that sweet sweet sacred cow $70m. There’s room in this town for all us snake-oil salesfolk, just ask the ones spruiking neuro.
@ Doc Holliday it does rather look like someone trying to look like they have discovered something that’s been around for a very long time. Of course focus groups aren’t the solution to every problem. Different problems , different solutions. Good researchers know which technique to use. Good moderators know how to deal with the points she raises, and good strategists know that research can only ever be an aid to judgement not a substitute. And, good commentators don’t infer they have the only answer and their peers, and clients, are all idiots.
Not always a waste, but definitely so if used for the wrong reasons. My simple rule of thumb: if you want to understand behaviour and its drivers, don’t do groups (for the reasons outlined in the article), immerse yourself in consumers’ lives in context instead. If you want a reaction to an idea (note: reaction, never opinion), or a ‘snapshot’ of how people feel, then groups (or one-on-one interviews) are fine.
This critique of focus groups has been doing the rounds since at least 1997, when I started work as a junior researcher/planner type. Key points are: they are flawed if you want them to be able to do everything; they are okay if you acknowledge their limitations; they are best used in combination with other research tools – ideally a blend of qual and quant.
A meaningful critique beyond these basic points above would be best levelled less at focus groups as a method and more at the people (clients and agencies) who continue to use them badly.
While I’m not a fan of focus groups, its when they’re incorrectly used as the holy grail for judging a campaign or creative territory as opposed to insight generation or a toe in the water for a wider audience where it becomes more damaging than good.
However I’ll take focus groups over data based on clicks any day of the week.
Any good moderator + controller would immediately be able to counter all the above points, flag them in their report or better yet, identify people in the sample who are steering the group, and kick them out (in a polite, ‘sorry we actually overbooked, but here’s your cash anyway’ kind of way).
Hmm. Some groups are a waste of time. But sometimes there’s gold, an insight that changes everything. This should justify the rest.
No single person, from any walk of life is likely to ever be ‘reflective of the general population’.
Give 20 strangers $20 to go in a strange room, for 20 minutes and they’ll say 20 strange things. Just ask all the Election Polls.
The “focus” in the name describes what they were originally intended for and would still be valuable if used for: to focus the thoughts that would be studied in thorough quantitative research.
Yeah, but there’s not reflective and there’s “I would voulntarily spend my time in a focus group” not reflective
Very narrow-minded view. They are not a solution for every problem but when used well by a competent researcher they can add real value. Author has moderated ‘hundreds of groups’…wondering why if they think they serve no real purpose? Not the type of researcher I’d want working on my brand.
This is exactly what someone who has no idea what a well-run focus group looks like would say.
“Focus groups rely on participants relaying exactly what they think and how they would behave, but we know people don’t always walk their talk.” – what absolute nonsense. Focus groups are designed to accommodate this, in fact the entire design of a group is based on the need to get past the fact that people can’t always express, or even know, what they mean.
That’s not to say there aren’t often better ways to run qualitative research. Online in particular, if done well, can be excellent. But this blanket statement that focus groups are bad just highlights your ignorance.
A good researcher will pick the right tool for the job, and sometimes that tool is a group.
All feedback is useful if kept in context Years of researching tv ad concepts taught me that if anything flies through research, don’t make it— it will be wallpaper at best. And forget black humour —
Wow! Waste of time? The reason they still work, because the results have been successful more times than not. You can’t make such a blanket statement without proof. Perhaps run a series of focus groups to see if they work!
Seriously sounds like an amateur’s simplistic viewpoint.
We put up two campaigns. Client wanted A. Thanks to well selected and well run group, B came out. But it was a nervous launch. It followed exactly as predicted and it took off like a rocket. And same on repeat for many others. One day someone will call out data and same old same old arguments.
What is this, bash the market research industry month?
Focus groups and tracking are dead apparently ! What’s left?
Why does mumbrella give a voice to these fact-deprived opinion writers?
There are two ways to build your business in a competitive market : be better, or try to make your competition look worse. One requires talent.
Thousands of businesses threw away their money last year because they used focus groups for some very bad reasons.
Most wanted to validate decisions they’d already made. Focus groups are great for this, as participants can be easily steered to provide the answers you’re looking for. All you have to do is have a cooperative moderator, stack the deck with leading questions, and make it absolutely clear that you are not only looking for agreement, but for group consensus.
Too many treated focus groups as quantitative data. Nothing is more absurd than counting qualitative responses as if they were part of a statistically valid sample of randomly selected participants.
Some did groups because they liked the voyeuristic feel of sitting in the dark behind a mirror eavesdropping on the conversations of others. Erika Hall of Mule Design calls focus groups “useless research theatre.” In her article, Focus Groups Are Worthless, she says “No one buys shoes or cooks dinner sitting at a table under fluorescent lights while engaged in a moderated group discussion.”
They all believed focus groups provided answers, when the real purpose of focus groups has always been to generate more questions.