Research Wiki · Methods Lab

Causal inference and experimentation

Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it.

Methods family

Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it.

Use methods only after defining the estimand, data structure, assumptions, validation plan and decision consequence.

Randomised controlled trials

Randomised controlled trials is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Read the full entry →
A/B testing

A/B testing is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Read the full entry →
Multivariate testing

Multivariate testing is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Read the full entry →
Split-cell experiments

Split-cell experiments is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Read the full entry →
Factorial experiments

Factorial experiments is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Read the full entry →
Fractional-factorial experiments

Fractional-factorial experiments is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Read the full entry →
Quasi-experimental design

Quasi-experimental design is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Read the full entry →
Difference-in-differences

Difference-in-differences estimates an intervention effect by comparing changes over time between treated and comparison groups. Its credibility relies heavily on the parallel-trends assumption and the absence of differential shocks.

Read the full entry →
Regression discontinuity

Regression discontinuity is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Instrumental variables

Instrumental variables is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Propensity-score matching

Propensity-score matching pairs treated and untreated observations with similar estimated treatment probabilities. It can balance observed covariates but cannot remove bias from unobserved confounding.

Propensity-score weighting

Propensity-score weighting is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Coarsened exact matching

Coarsened exact matching is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Synthetic control

Synthetic control constructs a weighted combination of comparison units that approximates the treated unit before an intervention. Post-intervention divergence is interpreted against placebo and robustness checks.

Interrupted time series

Interrupted time series is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Uplift modelling

Uplift modelling is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Treatment-effect modelling

Treatment-effect modelling is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Heterogeneous treatment effects

Heterogeneous treatment effects is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Causal forests

Causal forests is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Double machine learning

Double machine learning is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Mediation analysis

Mediation analysis is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Incrementality testing

Incrementality testing is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Geo experiments

Geo experiments is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Matched-market testing

Matched-market testing is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Marketing-mix experiments

Marketing-mix experiments is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Holdout-market tests

Holdout-market tests is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Causal impact analysis

Causal impact analysis is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Bayesian experiments

Bayesian experiments is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Sequential testing

Sequential testing is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Multi-armed bandits

Multi-armed bandits is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Browse linked method entries

Deep entry

Randomised controlled trials

Randomised controlled trials is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method
Deep entry

A/B testing

A/B testing is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Open method
Deep entry

Multivariate testing

Multivariate testing is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Open method
Deep entry

Split-cell experiments

Split-cell experiments is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method
Deep entry

Factorial experiments

Factorial experiments is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method
Deep entry

Fractional-factorial experiments

Fractional-factorial experiments is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method
Deep entry

Quasi-experimental design

Quasi-experimental design is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method
Deep entry

Difference-in-differences

Difference-in-differences estimates an intervention effect by comparing changes over time between treated and comparison groups. Its credibility relies heavily on the parallel-trends assumption and the absence of differential shocks.

Open method
Method definition

Regression discontinuity

Regression discontinuity is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Open method
Method definition

Instrumental variables

Instrumental variables is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method
Method definition

Propensity-score matching

Propensity-score matching pairs treated and untreated observations with similar estimated treatment probabilities. It can balance observed covariates but cannot remove bias from unobserved confounding.

Open method
Method definition

Propensity-score weighting

Propensity-score weighting is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method
Method definition

Coarsened exact matching

Coarsened exact matching is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method
Method definition

Synthetic control

Synthetic control constructs a weighted combination of comparison units that approximates the treated unit before an intervention. Post-intervention divergence is interpreted against placebo and robustness checks.

Open method
Method definition

Interrupted time series

Interrupted time series is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method
Method definition

Uplift modelling

Uplift modelling is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Open method
Method definition

Treatment-effect modelling

Treatment-effect modelling is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Open method
Method definition

Heterogeneous treatment effects

Heterogeneous treatment effects is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method
Method definition

Causal forests

Causal forests is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method
Method definition

Double machine learning

Double machine learning is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method
Method definition

Mediation analysis

Mediation analysis is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Open method
Method definition

Incrementality testing

Incrementality testing is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Open method
Method definition

Geo experiments

Geo experiments is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method
Method definition

Matched-market testing

Matched-market testing is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Open method
Method definition

Marketing-mix experiments

Marketing-mix experiments is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method
Method definition

Holdout-market tests

Holdout-market tests is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Open method
Method definition

Causal impact analysis

Causal impact analysis is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Open method
Method definition

Bayesian experiments

Bayesian experiments is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method
Method definition

Sequential testing

Sequential testing is a method within causal inference and experimentation. Experimental and quasi-experimental methods designed to estimate what changed because of an intervention rather than alongside it. Its usefulness depends on data structure, assumptions, validation and whether the output answers the intended decision.

Open method
Method definition

Multi-armed bandits

Multi-armed bandits is a statistical or analytical concept within causal inference and experimentation. It should be selected for the data-generating process and decision question rather than because software makes it available.

Open method

Need the method applied to a live decision?

Share the market, customer, product or investment question that needs a defensible evidence design.

Brief Ninth Atlas