Local Justice and Machine Learning: Modeling and Inferring Dynamic Ethical Preferences around High-stakes Allocations

Violet (Xinying) Chen, Joshua Williams, Hoda Heidari, Derek Leben Poster (Non-archival) at second ACM conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO 2022) October 2022

Preprint available upon request

Keywords: moral preference, elicit ethical judgement from people, preference learning

We consider a setting in which a social planner has to make a sequence of decisions to allocate scarce resources in a high-stakes domain. Our goal is to understand stakeholders’ dynamic moral preferences toward such allocational policies. In particular, we evaluate the sensitivity of moral preferences to the history of allocations and their perceived future impact on various socially salient groups. We propose a mathematical model to capture and infer such dynamic moral preferences. We illustrate our model through small-scale human-subject experiments focused on the allocation of scarce medical resource distributions during a hypothetical viral epidemic. We observe that participants’ preferences are indeed history- and impact-dependent. Additionally, our preliminary experimental results reveal intriguing patterns specific to medical resources—a topic that is particularly salient against the backdrop of the global covid-19 pandemic.