In this chapter, you’ll learn everything needed to prepare for the pre-test phase.
Phases in Experimentation
Defining the Problem Statement
Hypothesis Generation
Experimentation Details
Defining Test Metrics
Test Metrics Decision Flow
Decide on number of variations
Choosing test unit and assignment method
Qualified Target Base
Control Group Size & Structure
Exposure duration
Measurement horizon (Power Analysis)
Power Analysis Formula & Parameter Choices
Measurement horizon
Risk Tolerance and Ramp plan
