Research Wiki

Research mistakes and myths

Explanations of common research failure modes, from oversized confidence in NPS and sample size to synthetic respondents and statistical significance.

Myth / failure mode

Common mistakes in brand tracking

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why NPS can be misleading

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why high CSAT does not guarantee loyalty

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why purchase intent overstates actual demand

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why consumers cannot always explain their behaviour

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why larger samples do not automatically mean better research

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why online samples are not automatically representative

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why statistical significance may be commercially irrelevant

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why correlation does not establish causality

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why cluster solutions can be unstable

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why segmentation often fails after delivery

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why conjoint results can be unrealistic

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why pricing research produces contradictory answers

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why social sentiment is not public opinion

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why AI-generated insights can sound right and still be wrong

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why synthetic respondents cannot fully replace primary research

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why poor recruitment ruins good methodology

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why city-level conclusions from small samples are dangerous

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why questionnaire length damages data quality

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why respondent incentives can introduce bias

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why weighted data may have a smaller effective sample

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer
Myth / failure mode

Why “pan-India coverage” does not guarantee field quality

A diagnostic explainer separating the observed result from the inference teams are tempted to make.

Open explainer

Need the method applied to a live decision?

Share the market, customer, product or investment question that needs a defensible evidence design.

Brief Ninth Atlas