SNACK | Fair Fund? Automated Evaluations of Deservingness in Recommendation Systems and Large Language Models

How do automated systems evaluate who should get what and why? Research on welfare deservingness and charitable giving shows that humans exhibit biases in what they deem to be a worthy cause based on who is asking, the kind of help they’re asking for, and how they ask it, generating demographic disparities in aid. Across various welfare allocation contexts, from social service providers to charitable fundraising platforms like GoFundMe, such decisions about deservingness are being rapidly delegated to automated systems, raising important questions about who and what these tools deem to be deserving. The fact that AI systems used in these contexts are trained on text reflecting dominant cultural schemas about deservingness specifically raises concerns about whether human preferences for certain kinds of askers and appeals are reproduced when AI makes judgments. This project studies how two types of automated processes, algorithmic recommendation systems and large language models (LLMs), evaluate welfare deservingness. The first study is an algorithmic audit of GoFundMe, the world's largest crowdfunding platform, which uses automated accounts to systematically compare the campaigns that users are algorithmically served to the larger population of campaigns on the platform, to understand whether recommendation systems are biased toward particular types of causes. The second study tests how frontier LLMs allocate funding when forced to choose among a set of fictitious fundraising appeals systematically varied on gender, race, cause, and responsibility attribution. The appeals are grounded in a computational analysis of 1.3M actual crowdfunding requests, providing ecological validity while enabling precise experimental variation in key dimensions of deservingness.

Martin Lukk is a Postdoctoral Research Fellow at the Data Sciences Institute at the University of Toronto. He is a social scientist whose work focuses on politics, inequality, and digital platforms. His research explores how artificial intelligence evaluates deservingness and how cultural divisions can evolve into sources of political conflict. He is the author of GoFailMe: The Unfulfilled Promise of Digital Crowdfunding (Stanford University Press). His recent work includes the article “Disrupting Philanthropy? A Reality Check for Digital Crowdfunding,” published in the Journal of Philanthropy and co-authored with Nora Kenworthy, Erik Schneiderhan, and Jeremy Snyder.

-------------------------------------------

HOW TO JOIN THE SOCCULTURE LISTSERV:

VIA EMAIL:

1. From your University of Toronto email address, start a new email
2. Address it to LISTSERV@LISTSERV.UTORONTO.CA
3. LEAVE THE SUBJECT LINE BLANK
4. In the body of the e-mail type: Subscribe SOCCULTURE-L YourFirstName YourLastName
5. If you have an email signature, remove it
6. Send and wait for confirmation email
7. If you do not receive an email in one hour, contact Maddalena at maddalena.simeon@mail.utoronto.ca