A/B Testing & Evaluation

- Offline metrics: NDCG@K, Recall@K, HitRate, AUC - Online metrics: CTR, CVR, watch time, revenue per session, retention - Experiment framework: Bayesian A/B test, sequential testing, CUPED variance reduction - Holdout group for long-term impact measurement