Concept testing means showing people an early idea, such as a new product, ad, or package, and finding out how they react. Two common formats are the monadic survey and the multi-day bulletin board. They answer different questions, and mixing them up is how teams end up with confident numbers about the wrong thing.
Monadic surveys scale preference. Boards surface lived reaction, reconsideration, and in-home proof. Pick based on the decision you need to make, not on habit.
What ‘monadic’ means
In a monadic survey, each respondent sees only one concept and rates it. Because different groups see different concepts, you can compare scores fairly with a large sample. It is good at answering ‘which one scores higher?’ It is not good at answering ‘why?’ or ‘what happens when they actually try it?’
A related format is sequential monadic, where each person sees several concepts one after another. It gives more data per person but adds order effects: the first concept seen shapes how the next is judged. Rotating the order helps, but it does not remove the effect.
What a board adds
A board runs over several days. Participants see the concept, react, then come back later after thinking about it, using it, or showing it to family. First reactions can change. The kitchen counter, the store shelf, and the family argument are all things a survey cannot reach.
Swipe to see all columns
| Need | Better format |
|---|---|
| Clean A/B preference at n=800 | Monadic survey |
| Why it fails in the kitchen | Multi-day board |
| First reaction + Day 3 reconsideration | Board |
| Language and claims that resonate | Board, then survey to size it |
| Dashboard for CX leadership | Survey / XM |
The ‘n=800’ row means a large number of respondents; large samples are what surveys are for. The ‘XM’ row refers to experience management tools that track customer scores over time on dashboards.
A decision framework
Ask three questions before choosing a format.
- 1What decision does this inform? If it is ‘launch, kill, or choose between A and B,’ you need measurement. If it is ‘what do we fix before launch?’ you need understanding.
- 2Does the answer depend on context? Products used at home, at shelf, or in a family setting need real-world time that surveys cannot give.
- 3How confident must the numbers be? If someone will put a forecast on the result, you need a proper sample; if the team needs direction and language, a board can be enough.
Designing a concept board
- Day 1: show the concept, capture the unprompted reaction before you explain anything, then ask what is appealing and what is unclear.
- Middle day: ask about use and context, such as where it would live, who else would see it, and what it would replace.
- Late day: bring the concept back and ask what has changed in their view. This is the reconsideration step surveys cannot offer.
- Throughout: keep stimulus under an NDA when the creative is confidential.
Using both without fighting
Many teams run both in sequence. A survey narrows ten concepts to three based on scores. A board then explores the three finalists to find out what language works, what confuses people, and what needs to change before launch. Another order also works: run a board first to find the right questions and phrasing, then use a survey to measure them at scale.
A scenario
A household cleaning brand has three new product ideas. A survey says Concept B scores slightly higher. A five-day board shows that people like B on Day 1, but by Day 3 they report they would not store the bottle under the sink because of its shape. That detail changes the packaging brief. The survey could not have found it.
FAQ