-
Experimental Evidence That Conversational Artificial Intelligence Can Steer Consumer Behavior Without Detection
Authors:
Tobias Werner,
Ivan Soraperra,
Emilio Calvano,
David C. Parkes,
Iyad Rahwan
Abstract:
Conversational AI models are becoming increasingly popular and are about to replace traditional search engines for information retrieval and product discovery. This raises concerns about monetization strategies and the potential for subtle consumer manipulation. Companies may have financial incentives to steer users toward search results or products in a conversation in ways that are unnoticeable…
▽ More
Conversational AI models are becoming increasingly popular and are about to replace traditional search engines for information retrieval and product discovery. This raises concerns about monetization strategies and the potential for subtle consumer manipulation. Companies may have financial incentives to steer users toward search results or products in a conversation in ways that are unnoticeable to consumers. Using a behavioral experiment, we show that conversational AI models can indeed significantly shift consumer preferences. We discuss implications and ask whether regulators are sufficiently prepared to combat potential consumer deception.
△ Less
Submitted 18 September, 2024;
originally announced September 2024.
-
Optimal Engagement-Diversity Tradeoffs in Social Media
Authors:
Fabian Baumann,
Daniel Halpern,
Ariel D. Procaccia,
Iyad Rahwan,
Itai Shapira,
Manuel Wuthrich
Abstract:
Social media platforms are known to optimize user engagement with the help of algorithms. It is widely understood that this practice gives rise to echo chambers\emdash users are mainly exposed to opinions that are similar to their own. In this paper, we ask whether echo chambers are an inevitable result of high engagement; we address this question in a novel model. Our main theoretical results est…
▽ More
Social media platforms are known to optimize user engagement with the help of algorithms. It is widely understood that this practice gives rise to echo chambers\emdash users are mainly exposed to opinions that are similar to their own. In this paper, we ask whether echo chambers are an inevitable result of high engagement; we address this question in a novel model. Our main theoretical results establish bounds on the maximum engagement achievable under a diversity constraint, for suitable measures of engagement and diversity; we can therefore quantify the worst-case tradeoff between these two objectives. Our empirical results, based on real data from Twitter, chart the Pareto frontier of the engagement-diversity tradeoff.
△ Less
Submitted 6 March, 2023;
originally announced March 2023.
-
Lie detection algorithms attract few users but vastly increase accusation rates
Authors:
Alicia von Schenk,
Victor Klockmann,
Jean-François Bonnefon,
Iyad Rahwan,
Nils Köbis
Abstract:
People are not very good at detecting lies, which may explain why they refrain from accusing others of lying, given the social costs attached to false accusations - both for the accuser and the accused. Here we consider how this social balance might be disrupted by the availability of lie-detection algorithms powered by Artificial Intelligence. Will people elect to use lie detection algorithms tha…
▽ More
People are not very good at detecting lies, which may explain why they refrain from accusing others of lying, given the social costs attached to false accusations - both for the accuser and the accused. Here we consider how this social balance might be disrupted by the availability of lie-detection algorithms powered by Artificial Intelligence. Will people elect to use lie detection algorithms that perform better than humans, and if so, will they show less restraint in their accusations? We built a machine learning classifier whose accuracy (67\%) was significantly better than human accuracy (50\%) in a lie-detection task and conducted an incentivized lie-detection experiment in which we measured participants' propensity to use the algorithm, as well as the impact of that use on accusation rates. We find that the few people (33\%) who elect to use the algorithm drastically increase their accusation rates (from 25\% in the baseline condition up to 86% when the algorithm flags a statement as a lie). They make more false accusations (18pp increase), but at the same time, the probability of a lie remaining undetected is much lower in this group (36pp decrease). We consider individual motivations for using lie detection algorithms and the social implications of these algorithms.
△ Less
Submitted 8 December, 2022;
originally announced December 2022.
-
Classes of Aggregation Rules for Ethical Decision Making in Automated Systems
Authors:
Federico Fioravanti,
Iyad Rahwan,
Fernando Abel Tohmé
Abstract:
We study a class of {\em aggregation rules} that could be applied to ethical AI decision-making. These rules yield the decisions to be made by automated systems based on the information of profiles of preferences over possible choices. We consider two different but very intuitive notions of preferences of an alternative over another one, namely {\it pairwise majority} and {\it position} dominance.…
▽ More
We study a class of {\em aggregation rules} that could be applied to ethical AI decision-making. These rules yield the decisions to be made by automated systems based on the information of profiles of preferences over possible choices. We consider two different but very intuitive notions of preferences of an alternative over another one, namely {\it pairwise majority} and {\it position} dominance. Preferences are represented by permutation processes over alternatives and aggregation rules are applied to obtain results that are socially considered to be ethically correct. In this setting, we find many aggregation rules that satisfy desirable properties for an autonomous system. We also address the problem of the stability of the aggregation process, which is important when the information is variable. These results are a contribution for an AI designer that wants to justify the decisions made by an autonomous system.\\ \textit{Keywords:} Aggregation Operators; Permutation Process; Decision Analysis.
△ Less
Submitted 28 June, 2023; v1 submitted 10 June, 2022;
originally announced June 2022.
-
China's First Workforce Skill Taxonomy
Authors:
Weipan Xu,
Xiaozhen Qin,
Xun Li,
Haohui"Caron" Chen,
Morgan Frank,
Alex Rutherford,
Andrew Reeson,
Iyad Rahwan
Abstract:
China is the world's second largest economy. After four decades of economic miracles, China's economy is transitioning into an advanced, knowledge-based economy. Yet, we still lack a detailed understanding of the skills that underly the Chinese labor force, and the development and spatial distribution of these skills. For example, the US standardized skill taxonomy O*NET played an important role i…
▽ More
China is the world's second largest economy. After four decades of economic miracles, China's economy is transitioning into an advanced, knowledge-based economy. Yet, we still lack a detailed understanding of the skills that underly the Chinese labor force, and the development and spatial distribution of these skills. For example, the US standardized skill taxonomy O*NET played an important role in understanding the dynamics of manufacturing and knowledge-based work, as well as potential risks from automation and outsourcing. Here, we use Machine Learning techniques to bridge this gap, creating China's first workforce skill taxonomy, and map it to O*NET. This enables us to reveal workforce skill polarization into social-cognitive skills and sensory-physical skills, and to explore the China's regional inequality in light of workforce skills, and compare it to traditional metrics such as education. We build an online tool for the public and policy makers to explore the skill taxonomy: skills.sysu.edu.cn. We will also make the taxonomy dataset publicly available for other researchers upon publication.
△ Less
Submitted 9 January, 2020;
originally announced January 2020.
-
Automation Impacts on China's Polarized Job Market
Authors:
Haohui 'Caron' Chen,
Xun Li,
Morgan Frank,
Xiaozhen Qin,
Weipan Xu,
Manuel Cebrian,
Iyad Rahwan
Abstract:
When facing threats from automation, a worker residing in a large Chinese city might not be as lucky as a worker in a large U.S. city, depending on the type of large city in which one resides. Empirical studies found that large U.S. cities exhibit resilience to automation impacts because of the increased occupational and skill specialization. However, in this study, we observe polarized responses…
▽ More
When facing threats from automation, a worker residing in a large Chinese city might not be as lucky as a worker in a large U.S. city, depending on the type of large city in which one resides. Empirical studies found that large U.S. cities exhibit resilience to automation impacts because of the increased occupational and skill specialization. However, in this study, we observe polarized responses in large Chinese cities to automation impacts. The polarization might be attributed to the elaborate master planning of the central government, through which cities are assigned with different industrial goals to achieve globally optimal economic success and, thus, a fast-growing economy. By dividing Chinese cities into two groups based on their administrative levels and premium resources allocated by the central government, we find that Chinese cities follow two distinct industrial development trajectories, one trajectory owning government support leads to a diversified industrial structure and, thus, a diversified job market, and the other leads to specialty cities and, thus, a specialized job market. By revisiting the automation impacts on a polarized job market, we observe a Simpson's paradox through which a larger city of a diversified job market results in greater resilience, whereas larger cities of specialized job markets are more susceptible. These findings inform policy makers to deploy appropriate policies to mitigate the polarized automation impacts.
△ Less
Submitted 15 August, 2019;
originally announced August 2019.
