Focus groups have long been a go-to methodology for market research. For almost a hundred years, focus groups have been the standard for understanding your target consumer more deeply.
But a lot has changed in a hundred years, and market research is no exception. Nearly every market research methodology has benefited from technological advances.
From the beginning, focus groups were limited by certain disadvantages. Nowadays, if brands want to hear from their consumers, they have much better options to avoid these focus group shortcomings.
If you’ve ever been afraid to speak up in a group setting at work or back in your schooldays, you can already intuitively understand one of the many issues of getting a group of people together and asking them to speak openly and honestly.
This manifests in a bunch of different ways, including:
If you’ve ever been afraid to speak up in a group setting at work or back in your schooldays, you can already intuitively understand one of the many issues of getting a group of people together and asking them to speak openly and honestly.
This manifests in many ways, including:
Groupthink occurs when the desire for harmony or conformity within a group leads to irrational or dysfunctional decision-making. It can stifle creativity and individual responsibility, as members prioritize consensus over their own opinions. In focus groups, this can be particularly problematic as it may result in skewed data that doesn't accurately reflect the diverse perspectives of all participants.
"When all think alike, no one is thinking." -Walter Lippmann
Let's say a focus group is testing a new smartphone. The group is asked to provide feedback on the phone's design.
One particularly vocal participant, Alex, immediately praises the sleek design and modern features. As the discussion progresses, others who might have had reservations about the phone’s usability or battery life start to agree with Alex, despite their initial doubts.
They nod along, perhaps to avoid conflict or because they assume Alex’s enthusiasm reflects the majority opinion. This is groupthink in action, where the loudest voice overshadows the quieter, potentially critical perspectives, leading the group to a consensus that might not truly represent everyone’s views.
Focus groups often face challenges with limited diversity due to convenience sampling, which typically results in a homogenous group. This lack of diversity means the group may not accurately represent the broader demographic, leading to skewed insights and conclusions. The consequences of underrepresentation in focus groups are significant, as they can result in biased outcomes that fail to account for the perspectives and needs of minority groups.
This can ultimately affect the validity and applicability of the research findings.
People hold many opinions they’d rather not share out loud for fear of how they will be perceived. It’s very common for people to express opinions they don’t genuinely hold if they think it will make a good impression on others (or withhold opinions they think may be less popular with a said group). They may also feel compelled (whether consciously or subconsciously) to give the answer they sense the moderator is looking for.
For example, a focus group participant might refrain from expressing their concern about the product's environmental impact if they perceive that the group values cost-effectiveness over sustainability.
It’s not easy to avoid introducing bias in focus groups.
Those who lead focus groups should be specially trained with years of experience to ask questions using non-leading language or reveal any preference for one answer over the other. But even subtle actions like body language can influence responses, so focus group moderation is truly a difficult skill to get right every time. Here's a few common examples of moderator bias:
If focus group responses are biased (which they almost inevitably will be given all the reasons above), then you can’t fully trust the quality of data you can extract from a focus group. And if you can’t trust the quality of your consumer data, then it’s difficult to justify undertaking the research in the first place.
Additionally, data transcription and coding in focus groups pose significant challenges. Transcribing discussions can be time-consuming and prone to errors, while coding qualitative data requires careful interpretation to ensure accuracy and consistency.
Focus groups are a form of qualitative feedback. In contrast to quantitative research methodologies like surveys, qualitative research is often conducted with smaller sample sizes–but focus groups are limited to very small sample sizes–often no more than four to eight people.
From a data quality perspective, this simply isn’t going to cut it.
As we get more used to meeting online, it's become harder to find a time and place to bring together the necessary people for a focus group in person. Scheduling challenges can lead to significant time delays, as aligning the availability of all participants often requires considerable coordination. This not only affects the timing of the focus group but can also delay subsequent phases of the project.
The time-intensive nature of asking people to give up their days to drive to a physical location to give feedback on a product, for example, means you’ll inadvertently filter for those who can afford to give up time in their day, take off work, and/or pay for childcare. Recruitment processes need to be carefully managed to avoid further delays, as finding suitable participants who meet the criteria can be time-consuming.
It also increases costs for your brand. Renting a physical space is a costly addition on top of the moderator and other researchers you may work with who must be paid, too. Additionally, the time-lag in reporting results from these focus groups can impact decision-making. Delays in data analysis and report generation can hinder timely business decisions, potentially affecting product launch timelines and market competitiveness.
Finally, the environment in which you conduct your focus group can muddy your responses and data. If you want reactions to your facial serum prototype, asking a focus group in an office room you rented for the day does not reflect the organic environment of their own home where they’d be using the product. Their responses may be totally different in a different setting.
Back before the normalization of virtual meetings–or before they were even an option–brands didn’t blink twice about the cost of a focus group. That’s all changed, though, thanks to online meeting software like Zoom. Smaller businesses and startups, in particular, face significant financial challenges as these costs can strain their limited budgets, making it difficult for them to compete with larger companies that can afford such expenses.
In addition to recruiting and incentivizing product testing participants, other in-person focus group testing costs include:
The numbers don't lie. When it comes to focus groups, the costs often outweigh the benefits.
Focus groups often exhibit rigidity and inflexibility, particularly when it comes to adapting to new insights or shifting objectives. This inflexibility can be attributed to their structured format, which may not easily accommodate emerging ideas or unexpected findings during the session. Moreover, the reliance on a predetermined set of questions can limit the depth of exploration into participants' thoughts and feelings. As a result, supplementary research is often necessary to validate and expand upon the results obtained from focus groups, ensuring that the insights are both comprehensive and accurate.
For instance, consider a focus group conducted to test a new snack product. During the session, participants might express a preference for a flavor not initially considered by the company. However, due to the rigid nature of the focus group, the discussion might not pivot to explore this new insight further, potentially missing out on valuable consumer preferences. This anecdote highlights how the lack of flexibility can be a significant flaw, necessitating additional research methods to capture a fuller picture of consumer sentiment.
CPG brands are often up against some of the biggest shortcomings presented by the focus group methodology. They’re challenged for all the aforementioned reasons, and they often need to get a physical product in the hands of consumer testers in order to measure their responses and feedback.
Whether the focus group is taking place in an office or over Zoom, there are big challenges to overcome. If respondents are meeting for a focus group in a central location, they’re not using the product in the organic environment of their home. And if they’re using the product in their home and providing feedback via Zoom, the brand still has to figure out the logistics of shipping the products to the homes of every respondent.
For CPG brands, in-home usage testing (IHUT) presents one of the best alternatives to focus groups, because IHUT enables consumer feedback on physical products used within the consumer’s regular routines and organic environment. There’s no better or more honest predictor of product pros and cons than consumers who can use the product exactly how they would at home.
The challenge for many CPG brands is choosing the right IHUT provider to help with needs like sourcing high-quality product testers and managing logistics and shipping. For more info, read How to Choose the Right Product Testing Company For Your Needs.
Technologies like Zoom enable in-depth interviews like never before. Respondents can share their open and honest opinions in one-on-one conversations from the comfort of their own homes. This is an excellent way to gather qualitative data–even across time zones and regions–and it’s also an excellent component to longitudinal studies (those studies conducted over time).
Video diaries provide another excellent source of qualitative data, and unlike IDI conducted over Zoom, no scheduling or calendar tetris is necessary. When everyone has a smartphone, everyone can be their own videographer, filming themselves using the product or providing their feedback to the experience. Like IDI, video diaries can be a great component of longitudinal research.
To see examples of IDI and video diary methodology in practice, read this case study on Agile Sensory Testing for Cat Litter.
Concept testing is done almost entirely digitally now thanks to the convenience of online surveying. This is common across CPG and retail industries, but one standout example in fashion. Apparel brands will often plan their upcoming season’s or line’s prints based on testing different images with online respondents.
You can learn more about how apparel brands capture consumer feedback in this article: 11 Ways to Improve Apparel & Wear Testing for Clothing Brands.
CPG brands can use concept testing, too. See this case study about how canned drink brand Country Luau tested packaging designs and potential flavors.
Online communities of product testers are crucial to power all of the aforementioned methodologies. They are the fuel that feeds consumer insights, but they must be curated and cultivated carefully to make sure they reflect the demographics of the consumer population, provide thoughtful and in-depth answers, and conduct any tests as instructed.
You can learn more about how Highlight supports their online, nationwide panel in this blog: How Highlight Cultivates an Engaged Community of Product Testers.
While focus groups have played an important role in market research over the years, new technologies and social norms have had a huge impact on the methodologies we use to collect qualitative consumer feedback. The next time you’re considering which method is right for your brand, be sure to weigh all these factors and their alternatives.