Validate
Experiment Design
Planning a fair comparison to find out whether a change caused a result.
What is Experiment Design?
Planning a fair comparison to find out whether a change caused a result.
What you learn
To know a change worked, compare with people who didn’t get it.
When it helps
you have a proposed change and need a fair comparison to find out whether it causes a result.
Use it at work
- Write what you’ll change and what you expect to happen.
- Keep a comparison group that doesn’t get the change.
- Run both at the same time, assigned at random if you can.
- Compare the results, then decide.
Your output
Before your next launch, decide what you’ll compare against: a group without the change, at the same time.
Watch for
Comparing before and after, which mixes your change with everything else.
Related practices
- Outcome Definition
- Measurement
- Assumption Mapping
- Evidence Confidence
- Survey Design
- Workload Assessment
- Business Model Experiments
- Minimum Viable Product
Sources
Enable JavaScript to try the interactive activity.