Experimentation Notebook

Experimentation Notebook

This section contains the complete markdown library from the local Experimentation Notebook folder.

Core Lectures

• 01. Experimentation in Regulated Finance
• 02c. When Is an Experiment Done - Decision Thresholds Beyond Statistical Significance
• 02g. When Is an Experiment Done - Decision Thresholds Beyond Statistical Significance
• 02m. When Is an Experiment Done - Decision Thresholds Beyond Statistical Significance
• 03c. The Role of Null Results in Mature Experimentation Programs
• 03g. The Role of Null Results in Mature Experimentation Programs
• 03m. The Role of Null Results in Mature Experimentation Programs
• 04. Power, MDE, and Practical Feasibility in Low-Velocity Channels
• 05. Sequential Testing Methods in Business Experiments
• 06. Variance Reduction Techniques_ CUPED, CUPAC, and Beyond
• 07. Ratio Metrics and Correlated User Behavior in Experiments
• 08. Email Experimentation in the Post-Apple Mail Privacy Era
• 09. Measuring Incrementality in Email Marketing
• 10. Email Fatigue, Frequency, and Long-Term Effects
• 11. From ATE to CATE_ Extracting Value from Flat Experiments
• 12. When (and When Not) to Personalize Based on Experimental Results
• 13. Multi-Armed Bandits vs Controlled Experiments
• 14. Building an Experimentation Operating Model
• 15. Experimentation Metrics That Align with Business Strategy
• 16. Communicating Experiment Results to Senior Stakeholders
• 17. Experimentation, Trust, and Consumer Perception
• 18. Legal and Compliance Considerations in Marketing Experiments
• 19. Unified Measurement_ How Experiments Fit with MMM and Attribution
• 20. The Future of Experimentation in Marketing (2025–2030)
• 21c. From Holdouts to Experimentation - The First-Year Maturity Curve
• 21g. From Holdouts to Experimentation_ The First-Year Maturity Curve
• 21m. From Holdouts to Experimentation - The First-Year Maturity Curve
• 22. Designing “Safe First Experiments” in High-Trust Organizations
• 23c. What Can Be Learned in the First 48 Hours of an Experiment
• 23g. What Can Be Learned in the First 48 Hours of an Experiment
• 23m. Identifying Reliable Signals in Early Marketing Experiments
• 24. Temporal Dynamics of Experiment Data_ Early, Middle, and Late Signals
• 25c. Debunking the 30-Day-Experiment Myth
• 25g. Debunking the 30-Day-Experiment Myth
• 25m. Debunking the 30-Day-Experiment Myth
• Slide Deck 1 - Email Experimentation at Vanguard - The Canon
• Slide Deck 2 - When Is an Experiment Done
• Slide Deck 6 - Where Experiments Fit in Marketing Measurement

02m. When Is an Experiment Done - Decision Thresholds Beyond Statistical Significance

• 02m. When Is an Experiment Done - Decision Thresholds Beyond Statistical Significance - Bayesian A B Testing Beyond Frequentist Methods
• 02m. When Is an Experiment Done - Decision Thresholds Beyond Statistical Significance - Bayesian Decision Rules and Expected Loss Research Notes
• 02m. When Is an Experiment Done - Decision Thresholds Beyond Statistical Significance - Company Case Studies on Experiment Stopping Criteria
• 02m. When Is an Experiment Done - Decision Thresholds Beyond Statistical Significance - Experiments at Airbnb
• 02m. When Is an Experiment Done - Decision Thresholds Beyond Statistical Significance - GrowthBook Experiment Decision Framework
• 02m. When Is an Experiment Done - Decision Thresholds Beyond Statistical Significance - Improving Experimentation Efficiency at Netflix with Meta Analysis and Optimal Stopping
• 02m. When Is an Experiment Done - Decision Thresholds Beyond Statistical Significance - Minimum Detectable Effect and Power Analysis
• 02m. When Is an Experiment Done - Decision Thresholds Beyond Statistical Significance - Organizational Decision Frameworks Research Notes
• 02m. When Is an Experiment Done - Decision Thresholds Beyond Statistical Significance - Spotify Sequential Testing Framework Comparisons and Discussions
• 02m. When Is an Experiment Done - Decision Thresholds Beyond Statistical Significance - Spotify Sequential Testing Framework Research Notes
• 2m. When Is an Experiment Done - Decision Thresholds Beyond Statistical Significance

03m. The Role of Null Results in Mature Experimentation Programs

• 03m. The Role of Null Results in Mature Experimentation Programs - Centralized A B Testing Repository
• 03m. The Role of Null Results in Mature Experimentation Programs - Jeff Bezos 2016 Letter to Amazon Shareholders
• 03m. The Role of Null Results in Mature Experimentation Programs - Netflix A Culture of Learning
• 03m. The Role of Null Results in Mature Experimentation Programs - Research Notes Null and Negative Results in Experimentation
• 3m. The Role of Null Results in Mature Experimentation Programs

21m. From Holdouts to Experimentation - The First-Year Maturity Curve

• 21m. From Holdouts to Experimentation - The First-Year Maturity Curve - Experimentation Program Mistakes
• 21m. From Holdouts to Experimentation - The First-Year Maturity Curve - Getting Everyone on Board Gaining Buy-In for Experimentation
• 21m. From Holdouts to Experimentation - The First-Year Maturity Curve - Holdouts Measuring Experiment Impact Accurately
• 21m. From Holdouts to Experimentation - The First-Year Maturity Curve - Research Notes Organizational Evolution from Holdout to Formal Experimentation
• 21m. From Holdouts to Experimentation - The First-Year Maturity Curve - The Conversion Maturity Model Benchmark Your Experimentation Program
• 21m. From Holdouts to Experimentation - The First-Year Maturity Curve - Why Most Experiment Programs Are Failing
• 21m. From Holdouts to Experimentation - The First-Year Maturity Curve

23m. Identifying Reliable Signals in Early Marketing Experiments

• 23m. Identifying Reliable Signals in Early Marketing Experiments - Research Notes: Early Marketing Experiment Signals (24-48 Hours)
• 23m. Identifying Reliable Signals in Early Marketing Experiments

25m. Debunking the 30-Day-Experiment Myth

• 25m. Debunking the 30-Day-Experiment Myth - 30 Day Dogma Critical Analysis of Experiment Duration Expanded
• 25m. Debunking the 30-Day-Experiment Myth - 30 Day Dogma Critical Analysis of Experiment Duration
• 25m. Debunking the 30-Day-Experiment Myth - Research Notes on 30 Day Experiment Duration Analysis
• 25m. Why Organizations Default to 30-Day Experiment Durations

---

Generated from local markdown conversion artifacts.