-
Donald Trumps in the Virtual Polls: Simulating and Predicting Public Opinions in Surveys Using Large Language Models
Authors:
Shapeng Jiang,
Lijia Wei,
Chen Zhang
Abstract:
In recent years, large language models (LLMs) have attracted attention due to their ability to generate human-like text. As surveys and opinion polls remain key tools for gauging public attitudes, there is increasing interest in assessing whether LLMs can accurately replicate human responses. This study examines the potential of LLMs, specifically ChatGPT-4o, to replicate human responses in large-…
▽ More
In recent years, large language models (LLMs) have attracted attention due to their ability to generate human-like text. As surveys and opinion polls remain key tools for gauging public attitudes, there is increasing interest in assessing whether LLMs can accurately replicate human responses. This study examines the potential of LLMs, specifically ChatGPT-4o, to replicate human responses in large-scale surveys and to predict election outcomes based on demographic data. Employing data from the World Values Survey (WVS) and the American National Election Studies (ANES), we assess the LLM's performance in two key tasks: simulating human responses and forecasting U.S. election results. In simulations, the LLM was tasked with generating synthetic responses for various socio-cultural and trust-related questions, demonstrating notable alignment with human response patterns across U.S.-China samples, though with some limitations on value-sensitive topics. In prediction tasks, the LLM was used to simulate voting behavior in past U.S. elections and predict the 2024 election outcome. Our findings show that the LLM replicates cultural differences effectively, exhibits in-sample predictive validity, and provides plausible out-of-sample forecasts, suggesting potential as a cost-effective supplement for survey-based research.
△ Less
Submitted 11 February, 2025; v1 submitted 3 November, 2024;
originally announced November 2024.
-
Costly Persuasion by a Partially Informed Sender
Authors:
Shaofei Jiang
Abstract:
I study a model of costly Bayesian persuasion by a privately and partially informed sender who conducts a public experiment. The cost of running an experiment is the expected reduction of a weighted log-likelihood ratio function of the sender's belief. This is microfounded by a Wald sequential sampling problem where good news and bad news cost differently. I focus on equilibria satisfying the D1 c…
▽ More
I study a model of costly Bayesian persuasion by a privately and partially informed sender who conducts a public experiment. The cost of running an experiment is the expected reduction of a weighted log-likelihood ratio function of the sender's belief. This is microfounded by a Wald sequential sampling problem where good news and bad news cost differently. I focus on equilibria satisfying the D1 criterion. The equilibrium outcome depends crucially on the relative costs of drawing good and bad news in the experiment. If good news is not too costly compared to bad news, there exists a unique separating equilibrium, and the receiver learns more information thanks to sender private information. If good news is sufficiently costlier than bad news, the single-crossing property fails. There may exist pooling and partial pooling equilibria, and in some equilibria, the receiver learns less information compared to a benchmark with an uninformed sender.
△ Less
Submitted 18 November, 2024; v1 submitted 25 January, 2024;
originally announced January 2024.
-
A Primer on Deep Learning for Causal Inference
Authors:
Bernard Koch,
Tim Sainburg,
Pablo Geraldo,
Song Jiang,
Yizhou Sun,
Jacob Gates Foster
Abstract:
This review systematizes the emerging literature for causal inference using deep neural networks under the potential outcomes framework. It provides an intuitive introduction on how deep learning can be used to estimate/predict heterogeneous treatment effects and extend causal inference to settings where confounding is non-linear, time varying, or encoded in text, networks, and images. To maximize…
▽ More
This review systematizes the emerging literature for causal inference using deep neural networks under the potential outcomes framework. It provides an intuitive introduction on how deep learning can be used to estimate/predict heterogeneous treatment effects and extend causal inference to settings where confounding is non-linear, time varying, or encoded in text, networks, and images. To maximize accessibility, we also introduce prerequisite concepts from causal inference and deep learning. The survey differs from other treatments of deep learning and causal inference in its sharp focus on observational causal estimation, its extended exposition of key algorithms, and its detailed tutorials for implementing, training, and selecting among deep estimators in Tensorflow 2 available at github.com/kochbj/Deep-Learning-for-Causal-Inference.
△ Less
Submitted 28 November, 2023; v1 submitted 8 October, 2021;
originally announced October 2021.
-
Equilibrium Refinement in Finite Action Evidence Games
Authors:
Shaofei Jiang
Abstract:
Evidence games study situations where a sender persuades a receiver by selectively disclosing hard evidence about an unknown state of the world. Evidence games often have multiple equilibria. Hart et al. (2017) propose to focus on truth-leaning equilibria, i.e., perfect Bayesian equilibria where the sender discloses truthfully when indifferent, and the receiver takes off-path disclosure at face va…
▽ More
Evidence games study situations where a sender persuades a receiver by selectively disclosing hard evidence about an unknown state of the world. Evidence games often have multiple equilibria. Hart et al. (2017) propose to focus on truth-leaning equilibria, i.e., perfect Bayesian equilibria where the sender discloses truthfully when indifferent, and the receiver takes off-path disclosure at face value. They show that a truth-leaning equilibrium is an equilibrium of a perturbed game where the sender has an infinitesimal reward for truth-telling. We show that, when the receiver's action space is finite, truth-leaning equilibrium may fail to exist, and it is not equivalent to equilibrium of the perturbed game. To restore existence, we introduce a disturbed game with a small uncertainty about the receiver's payoff. A purifiable truthful equilibrium is the limit of a sequence of truth-leaning equilibria in the disturbed games as the disturbances converge to zero. It exists and features a simple characterization. A truth-leaning equilibrium that is also purifiable truthful is an equilibrium of the perturbed game. Moreover, purifiable truthful equilibria are receiver optimal and give the receiver the same payoff as the optimal deterministic mechanism.
△ Less
Submitted 19 September, 2022; v1 submitted 13 July, 2020;
originally announced July 2020.
-
Disclosure Games with Large Evidence Spaces
Authors:
Shaofei Jiang
Abstract:
We study a disclosure game with a large evidence space. There is an unknown binary state. A sender observes a sequence of binary signals about the state and discloses a left truncation of the sequence to a receiver in order to convince him that the state is good. We focus on truth-leaning equilibria (cf. Hart et al. (2017)), where the sender discloses truthfully when doing so is optimal, and the r…
▽ More
We study a disclosure game with a large evidence space. There is an unknown binary state. A sender observes a sequence of binary signals about the state and discloses a left truncation of the sequence to a receiver in order to convince him that the state is good. We focus on truth-leaning equilibria (cf. Hart et al. (2017)), where the sender discloses truthfully when doing so is optimal, and the receiver takes off-path disclosure at face value. In equilibrium, seemingly sub-optimal truncations are disclosed, and the disclosure contains the longest truncation that yields the maximal difference between the number of good and bad signals. We also study a general framework of disclosure games which is compatible with large evidence spaces, a wide range of disclosure technologies, and finitely many states. We characterize the unique equilibrium value function of the sender and propose a method to construct equilibria for a broad class of games.
△ Less
Submitted 23 December, 2020; v1 submitted 29 October, 2019;
originally announced October 2019.