Burnett, Margaret
Intersectionality Goes Analytical: Taming Combinatorial Explosion Through Type Abstraction
Burnett, Margaret, Erwig, Martin, Fallatah, Abrar, Bogart, Christopher, Sarma, Anita
HCI researchers' and practitioners' awareness of intersectionality has been expanding, producing knowledge, recommendations, and prototypes for supporting intersectional populations. However, doing intersectional HCI work is uniquely expensive: it leads to a combinatorial explosion of empirical work (expense 1), and little of the work on one intersectional population can be leveraged to serve another (expense 2). In this paper, we explain how representations employed by certain analytical design methods correspond to type abstractions, and use that correspondence to identify a (de)compositional model in which a population's diverse identity properties can be joined and split. We formally prove the model's correctness, and show how it enables HCI designers to harness existing analytical HCI methods for use on new intersectional populations of interest. We illustrate through four design use-cases, how the model can reduce the amount of expense 1 and enable designers to leverage prior work to new intersectional populations, addressing expense 2.
Explaining Reinforcement Learning to Mere Mortals: An Empirical Study
Anderson, Andrew, Dodge, Jonathan, Sadarangani, Amrita, Juozapaitis, Zoe, Newman, Evan, Irvine, Jed, Chattopadhyay, Souti, Fern, Alan, Burnett, Margaret
We present a user study to investigate the impact of explanations on non-experts' understanding of reinforcement learning (RL) agents. We investigate both a common RL visualization, saliency maps (the focus of attention), and a more recent explanation type, reward-decomposition bars (predictions of future types of rewards). We designed a 124 participant, four-treatment experiment to compare participants' mental models of an RL agent in a simple Real-Time Strategy (RTS) game. Our results show that the combination of both saliency and reward bars were needed to achieve a statistically significant improvement in mental model score over the control. In addition, our qualitative analysis of the data reveals a number of effects for further study.
End-User Feature Labeling via Locally Weighted Logistic Regression
Wong, Weng-Keen (Oregon State University) | Oberst, Ian (Oregon State University) | Das, Shubhomoy (Oregon State University) | Moore, Travis (Oregon State University) | Stumpf, Simone (City University London) | McIntosh, Kevin (Oregon State University) | Burnett, Margaret (Oregon State University)
Applications that adapt to a particular end user often make inaccurate predictions during the early stages when training data is limited. Although an end user can improve the learning algorithm by labeling more training data, this process is time consuming and too ad hoc to target a particular area of inaccuracy. To solve this problem, we propose a new learning algorithm based on Locally Weighted Logistic Regression for feature labeling by end users, enabling them to point out which features are important for a class, rather than provide new training instances. In our user study, the first allowing ordinary end users to freely choose features to label directly from text documents, our algorithm was more effective than others at leveraging end users’ feature labels to improve the learning algorithm. Our results strongly suggest that allowing users to freely choose features to label is a promising method for allowing end users to improve learning algorithms effectively.