-
The Empty Chair: Using LLMs to Raise Missing Perspectives in Policy Deliberations
Authors:
Suyash Fulay,
Deb Roy
Abstract:
Deliberation is essential to well-functioning democracies, yet physical, economic, and social barriers often exclude certain groups, reducing representativeness and contributing to issues like group polarization. In this work, we explore the use of large language model (LLM) personas to introduce missing perspectives in policy deliberations. We develop and evaluate a tool that transcribes conversa…
▽ More
Deliberation is essential to well-functioning democracies, yet physical, economic, and social barriers often exclude certain groups, reducing representativeness and contributing to issues like group polarization. In this work, we explore the use of large language model (LLM) personas to introduce missing perspectives in policy deliberations. We develop and evaluate a tool that transcribes conversations in real-time and simulates input from relevant but absent stakeholders. We deploy this tool in a 19-person student citizens' assembly on campus sustainability. Participants and facilitators found that the tool sparked new discussions and surfaced valuable perspectives they had not previously considered. However, they also noted that AI-generated responses were sometimes overly general. They raised concerns about overreliance on AI for perspective-taking. Our findings highlight both the promise and potential risks of using LLMs to raise missing points of view in group deliberation settings.
△ Less
Submitted 17 March, 2025;
originally announced March 2025.
-
On the Relationship between Truth and Political Bias in Language Models
Authors:
Suyash Fulay,
William Brannon,
Shrestha Mohanty,
Cassandra Overney,
Elinor Poole-Dayan,
Deb Roy,
Jad Kabbara
Abstract:
Language model alignment research often attempts to ensure that models are not only helpful and harmless, but also truthful and unbiased. However, optimizing these objectives simultaneously can obscure how improving one aspect might impact the others. In this work, we focus on analyzing the relationship between two concepts essential in both language model alignment and political science: truthful…
▽ More
Language model alignment research often attempts to ensure that models are not only helpful and harmless, but also truthful and unbiased. However, optimizing these objectives simultaneously can obscure how improving one aspect might impact the others. In this work, we focus on analyzing the relationship between two concepts essential in both language model alignment and political science: truthfulness and political bias. We train reward models on various popular truthfulness datasets and subsequently evaluate their political bias. Our findings reveal that optimizing reward models for truthfulness on these datasets tends to result in a left-leaning political bias. We also find that existing open-source reward models (i.e., those trained on standard human preference datasets) already show a similar bias and that the bias is larger for larger models. These results raise important questions about the datasets used to represent truthfulness, potential limitations of aligning models to be both truthful and politically unbiased, and what language models capture about the relationship between truth and politics.
△ Less
Submitted 11 October, 2024; v1 submitted 8 September, 2024;
originally announced September 2024.
-
Outgroup Animosity Has Risen for Politicians, Journalists, and a Sample of Partisan Users on Twitter and Reddit
Authors:
Suyash Fulay,
Deb Roy
Abstract:
Using language models, we analyze a sample of 67 million tweets and 30 million Reddit comments referencing a set of 215 political entities from 2010-2023 from partisan users, journalists, and politicians. Our analysis indicates outgroup animosity has increased consistently in our sample, with newer cohorts of users expressing higher levels of animosity than previous ones. Moreover, a small fractio…
▽ More
Using language models, we analyze a sample of 67 million tweets and 30 million Reddit comments referencing a set of 215 political entities from 2010-2023 from partisan users, journalists, and politicians. Our analysis indicates outgroup animosity has increased consistently in our sample, with newer cohorts of users expressing higher levels of animosity than previous ones. Moreover, a small fraction of users are responsible for a disproportionate share of this negative content. We observe systematic differences in topic-level outgroup affect across political orientations: right-leaning users are twice as likely to exhibit outgroup animosity when discussing immigration, while left-leaning users show heightened outgroup animosity when discussing healthcare. On Twitter, U.S. politicians on the left exhibit more outgroup animosity than partisan users in our sample, but in the past four years, politicians on the right have experienced the sharpest rise in outgroup animosity, surpassing journalists, media, and partisan users. On Reddit, a small number of communities account for a large share of polarizing rhetoric, with the rise and eventual ban of r/TheDonald significantly shaping polarizing discourse on the right.
△ Less
Submitted 29 May, 2025; v1 submitted 29 August, 2023;
originally announced August 2023.
-
ConGraT: Self-Supervised Contrastive Pretraining for Joint Graph and Text Embeddings
Authors:
William Brannon,
Wonjune Kang,
Suyash Fulay,
Hang Jiang,
Brandon Roy,
Deb Roy,
Jad Kabbara
Abstract:
Learning on text-attributed graphs (TAGs), in which nodes are associated with one or more texts, has been the subject of much recent work. However, most approaches tend to make strong assumptions about the downstream task of interest, are reliant on hand-labeled data, or fail to equally balance the importance of both text and graph representations. In this work, we propose Contrastive Graph-Text p…
▽ More
Learning on text-attributed graphs (TAGs), in which nodes are associated with one or more texts, has been the subject of much recent work. However, most approaches tend to make strong assumptions about the downstream task of interest, are reliant on hand-labeled data, or fail to equally balance the importance of both text and graph representations. In this work, we propose Contrastive Graph-Text pretraining (ConGraT), a general, self-supervised approach for jointly learning separate representations of texts and nodes in a TAG. Our method trains a language model (LM) and a graph neural network (GNN) to align their representations in a common latent space using a batch-wise contrastive learning objective inspired by CLIP. We further propose an extension to the CLIP objective that leverages graph structure to incorporate information about inter-node similarity. Extensive experiments demonstrate that ConGraT outperforms baselines on various downstream tasks, including node and text category classification, link prediction, and language modeling. Finally, we present an application of our method to community detection in social graphs, which enables finding more textually grounded communities, rather than purely graph-based ones. Code and certain datasets are available at https://github.com/wwbrannon/congrat.
△ Less
Submitted 9 July, 2024; v1 submitted 23 May, 2023;
originally announced May 2023.
-
Divergences in Following Patterns between Influential Twitter Users and Their Audiences across Dimensions of Identity
Authors:
Suyash Fulay,
Nabeel Gillani,
Deb Roy
Abstract:
Identity spans multiple dimensions; however, the relative salience of a dimension of identity can vary markedly from person to person. Furthermore, there is often a difference between one's internal identity (how salient different aspects of one's identity are to oneself) and external identity (how salient different aspects are to the external world). We attempt to capture the internal and externa…
▽ More
Identity spans multiple dimensions; however, the relative salience of a dimension of identity can vary markedly from person to person. Furthermore, there is often a difference between one's internal identity (how salient different aspects of one's identity are to oneself) and external identity (how salient different aspects are to the external world). We attempt to capture the internal and external saliences of different dimensions of identity for influential users ("influencers") on Twitter using the follow graph. We consider an influencer's "ego-centric" profile, which is determined by their personal following patterns and is largely in their direct control, and their "audience-centric" profile, which is determined by the following patterns of their audience and is outside of their direct control. Using these following patterns we calculate a corresponding salience metric that quantifies how important a certain dimension of identity is to an individual. We find that relative to their audiences, influencers exhibit more salience in race in their ego-centric profiles and less in religion and politics. One practical application of these findings is to identify "bridging" influencers that can connect their sizeable audiences to people from traditionally underheard communities. This could potentially increase the diversity of views audiences are exposed to through a trusted conduit (i.e. an influencer they already follow) and may lead to a greater voice for influencers from communities of color or women.
△ Less
Submitted 14 April, 2023;
originally announced April 2023.
