讲座:Estimating Treatment Effects under Recommender Interference: A Structured Neural Networks Approach 发布时间:2024-10-22

  • 活动时间:
  • 活动地址:
  • 主讲人:

题 目:Estimating Treatment Effects under Recommender Interference: A Structured Neural Networks Approach

嘉 宾:詹若涵,助理教授,香港科技大学

主持人:江浦平 助理教授 BAT365唯一官网

时 间:2024年10月28日(周一)10:00-11:30am

地 点:安泰楼B207室

内容简介:

Recommender systems are essential for content-sharing platforms by curating personalized content. To evaluate updates to recommender systems targeting content creators, platforms frequently rely on creator-side randomized experiments. The treatment effect measures the change in outcomes when a new algorithm is implemented compared to the status quo. We show that the standard difference-in-means estimator can lead to biased estimates due to recommender interference that arises when treated and control creators compete for exposure. We propose a “recommender choice model” that describes which item gets exposed from a pool containing both treated and control items. By combining a structural choice model with neural networks, this framework directly models the interference pathway while accounting for rich viewer-content heterogeneity. We construct a debiased estimator of the treatment effect and prove it is asymptotically normal with potentially correlated samples. We validate our estimator's empirical performance with a field experiment on Weixin short-video platform. In addition to the standard creator-side experiment, we conduct a costly double-sided randomization design to obtain a benchmark estimate free from interference bias. We show that the proposed estimator yields results comparable to the benchmark, whereas the standard difference-in-means estimator can exhibit significant bias and even produce reversed signs.

演讲人简介:

Ruohan Zhan is an assistant professor in the Department of Industrial Engineering and Decision Analytics at the Hong Kong University of Science and Technology. Her primary research interest lies in the understanding and optimization of online marketplaces. Ruohan studies the causal evaluation of marketplace interventions, economic analysis of the dynamics and interactions among multiple stakeholders, and optimization of platform operations, including recommendation algorithms and online experimentation. Methodologically, She is interested in causal inference, econometrics, statistical learning and machine learning. Her research has been published in Management Science and Proceedings of National Academy of Sciences, as well as machine learning conferences including NeurIPS, ICML, ICLR, WWW, and KDD. Ruohan earned her PhD from Stanford University and her BS from Peking University.

 

欢迎广大师生参加!