“- Optimizely experimentation methodology - Optimizely Stats Engine technical paper”
+ Sequential testing
“- Sequential testing.”
+ False Discovery Rate control
“- False Discovery Rate control.”
+ Adjustments for multiple metrics and variations
“- Adjustments for multiple metrics and variations.”
+ Separation of primary and secondary metric evaluation
“- Separation of primary and secondary metric evaluation.”
“- Statsig sequential testing documentation - Statsig power analysis documentation - Statsig multiple testing controls”
+ Sequential testing (mSPRT)
“- Mixture Sequential Probability Ratio Testing (mSPRT).”
+ Sequential confidence interval adjustments
“- Sequential confidence interval adjustments.”
+ SPRT and Bayesian analysis options
“- SPRT and Bayesian analysis options.”
+ Multiple testing corrections
“- Bonferroni and Benjamini-Hochberg corrections.”
+ Power analysis
“- Power analysis using historical traffic and metric statistics.”