Robust Sequential Experimental Design for A/B Testing
Wen, Qianglin, Wu, Xiangkun, Shi, Chengchun, Li, Ting, Tang, Niansheng, Zhang, Yingying, Zhu, Hongtu
Experimental design has emerged as a powerful approach for improving the sample efficiency of A/B testing, yet existing designs rely critically on correctly specified models. We study robust sequential experimental design under model misspecification and develop a unified framework that covers both contextual bandit and dynamic settings. Theoretically, we prove that our design bounds the worst-case mean squared error of the estimated treatment effect. Empirically, we demonstrate the effectiveness of the proposed approach using synthetic and real-world datasets from a leading technology company.
May-14-2026
- Country:
- Asia > China (0.46)
- North America > United States (0.45)
- Genre:
- Research Report > Experimental Study (1.00)
- Industry:
- Information Technology (0.68)
- Transportation (0.46)
- Technology: