A Simple Model to Estimate Sharing Effects in Social Networks
–arXiv.org Artificial Intelligence
Randomised Controlled Trials (RCTs) are the gold standard for estimating treatment effects across many fields of science. Technology companies have adopted A/B-testing methods as a modern RCT counterpart, where end-users are randomly assigned various system variants and user behaviour is tracked continuously. The objective is then to estimate the causal effect that the treatment variant would have on certain metrics of interest to the business. When the outcomes for randomisation units -- end-users in this case -- are not statistically independent, this obfuscates identifiability of treatment effects, and harms decision-makers' observability of the system. Social networks exemplify this, as they are designed to promote inter-user interactions. This interference by design notoriously complicates measurement of, e.g., the effects of sharing. In this work, we propose a simple Markov Decision Process (MDP)-based model describing user sharing behaviour in social networks. We derive an unbiased estimator for treatment effects under this model, and demonstrate through reproducible synthetic experiments that it outperforms existing methods by a significant margin.
arXiv.org Artificial Intelligence
Sep-16-2024
- Country:
- Asia > Singapore (0.04)
- North America > Canada
- Nova Scotia > Halifax Regional Municipality > Halifax (0.04)
- Europe > United Kingdom
- Scotland > City of Edinburgh
- Edinburgh (0.04)
- England > Cambridgeshire
- Cambridge (0.04)
- Scotland > City of Edinburgh
- Genre:
- Research Report
- Strength High (1.00)
- Experimental Study (1.00)
- Research Report
- Industry:
- Information Technology > Services (0.83)
- Technology: