Experiment Evaluation

DaTaobao Tech

Dec 22, 2023 · Big Data

AB Incremental Evaluation and Contamination Mitigation in Social Viral Experiments

The paper defines AB increment, shows how to calculate DAU gains from per‑user visit rates, explains how social viral experiments introduce unidirectional or bidirectional contamination that biases increment estimates, and proposes four probability‑estimation schemes—exponential smoothing, expansion coefficients, and homogeneous‑group sampling—to correct the bias based on experiment design and business context.

AB testingExperiment Evaluationcontamination

0 likes · 10 min read

AB Incremental Evaluation and Contamination Mitigation in Social Viral Experiments

Alimama Tech

Oct 20, 2021 · Big Data

Designing Evaluation Metrics and Building an Overall Evaluation Index (OEC) for AB Testing

The article explains how to design experiment evaluation metrics—from top‑down objectives to core, quality, and observation types—and construct an Overall Evaluation Criterion by processing, weighting, and aggregating metrics, providing a robust, scalable framework for credible AB‑test assessment and product optimization.

AB testingData ScienceExperiment Evaluation

0 likes · 11 min read

Designing Evaluation Metrics and Building an Overall Evaluation Index (OEC) for AB Testing