Showing 1–16 of 16 results for author: Taeihagh, A

The Risks of Machine Learning Systems

Authors: Samson Tan, Araz Taeihagh, Kathy Baxter

Abstract: The speed and scale at which machine learning (ML) systems are deployed are accelerating even as an increasing number of studies highlight their potential for negative impact. There is a clear need for companies and regulators to manage the risk from proposed ML systems before they harm people. To achieve this, private and public sector actors first need to identify the risks posed by a proposed M… ▽ More The speed and scale at which machine learning (ML) systems are deployed are accelerating even as an increasing number of studies highlight their potential for negative impact. There is a clear need for companies and regulators to manage the risk from proposed ML systems before they harm people. To achieve this, private and public sector actors first need to identify the risks posed by a proposed ML system. A system's overall risk is influenced by its direct and indirect effects. However, existing frameworks for ML risk/impact assessment often address an abstract notion of risk or do not concretize this dependence. We propose to address this gap with a context-sensitive framework for identifying ML system risks comprising two components: a taxonomy of the first- and second-order risks posed by ML systems, and their contributing factors. First-order risks stem from aspects of the ML system, while second-order risks stem from the consequences of first-order risks. These consequences are system failures that result from design and development choices. We explore how different risks may manifest in various types of ML systems, the factors that affect each risk, and how first-order risks may lead to second-order effects when the system interacts with the real world. Throughout the paper, we show how real events and prior research fit into our Machine Learning System Risk framework (MLSR). MLSR operates on ML systems rather than technologies or domains, recognizing that a system's design, implementation, and use case all contribute to its risk. In doing so, it unifies the risks that are commonly discussed in the ethical AI community (e.g., ethical/human rights risks) with system-level risks (e.g., application, design, control risks), paving the way for holistic risk assessments of ML systems. △ Less

Submitted 20 April, 2022; originally announced April 2022.

How does fake news spread? Understanding pathways of disinformation spread through APIs

Authors: Lynnette H. X. Ng, Araz Taeihagh

Abstract: What are the pathways for spreading disinformation on social media platforms? This article addresses this question by collecting, categorising, and situating an extensive body of research on how application programming interfaces (APIs) provided by social media platforms facilitate the spread of disinformation. We first examine the landscape of official social media APIs, then perform quantitative… ▽ More What are the pathways for spreading disinformation on social media platforms? This article addresses this question by collecting, categorising, and situating an extensive body of research on how application programming interfaces (APIs) provided by social media platforms facilitate the spread of disinformation. We first examine the landscape of official social media APIs, then perform quantitative research on the open-source code repositories GitHub and GitLab to understand the usage patterns of these APIs. By inspecting the code repositories, we classify developers' usage of the APIs as official and unofficial, and further develop a four-stage framework characterising pathways for spreading disinformation on social media platforms. We further highlight how the stages in the framework were activated during the 2016 US Presidential Elections, before providing policy recommendations for issues relating to access to APIs, algorithmic content, advertisements, and suggest rapid response to coordinate campaigns, development of collaborative, and participatory approaches as well as government stewardship in the regulation of social media platforms. △ Less

Submitted 27 September, 2021; originally announced September 2021.

Journal ref: Policy and Internet, 2021

Reliability Testing for Natural Language Processing Systems

Authors: Samson Tan, Shafiq Joty, Kathy Baxter, Araz Taeihagh, Gregory A. Bennett, Min-Yen Kan

Abstract: Questions of fairness, robustness, and transparency are paramount to address before deploying NLP systems. Central to these concerns is the question of reliability: Can NLP systems reliably treat different demographics fairly and function correctly in diverse and noisy environments? To address this, we argue for the need for reliability testing and contextualize it among existing work on improving… ▽ More Questions of fairness, robustness, and transparency are paramount to address before deploying NLP systems. Central to these concerns is the question of reliability: Can NLP systems reliably treat different demographics fairly and function correctly in diverse and noisy environments? To address this, we argue for the need for reliability testing and contextualize it among existing work on improving accountability. We show how adversarial attacks can be reframed for this goal, via a framework for developing reliability tests. We argue that reliability testing -- with an emphasis on interdisciplinary collaboration -- will enable rigorous and targeted testing, and aid in the enactment and enforcement of industry standards. △ Less

Submitted 31 May, 2021; v1 submitted 6 May, 2021; originally announced May 2021.

Comments: Accepted to ACL-IJCNLP 2021 (main conference). Camera-ready version

Regulating human control over autonomous systems

Authors: Mikolaj firlej, Araz Taeihagh

Abstract: In recent years, many sectors have experienced significant progress in automation, associated with the growing advances in artificial intelligence and machine learning. There are already automated robotic weapons, which are able to evaluate and engage with targets on their own, and there are already autonomous vehicles that do not need a human driver. It is argued that the use of increasingly auto… ▽ More In recent years, many sectors have experienced significant progress in automation, associated with the growing advances in artificial intelligence and machine learning. There are already automated robotic weapons, which are able to evaluate and engage with targets on their own, and there are already autonomous vehicles that do not need a human driver. It is argued that the use of increasingly autonomous systems (AS) should be guided by the policy of human control, according to which humans should execute a certain significant level of judgment over AS. While in the military sector there is a fear that AS could mean that humans lose control over life and death decisions, in the transportation domain, on the contrary, there is a strongly held view that autonomy could bring significant operational benefits by removing the need for a human driver. This article explores the notion of human control in the United States in the two domains of defense and transportation. The operationalization of emerging policies of human control results in the typology of direct and indirect human controls exercised over the use of AS. The typology helps to steer the debate away from the linguistic complexities of the term autonomy. It identifies instead where human factors are undergoing important changes and ultimately informs about more detailed rules and standards formulation, which differ across domains, applications, and sectors. △ Less

Submitted 22 July, 2020; originally announced July 2020.

Journal ref: Regulation and Governance (2020)

Smart City Governance in Developing Countries: A Systematic Literature Review

Authors: Si Ying Tan, Araz Taeihagh

Abstract: Smart cities that make broad use of digital technologies have been touted as possible solutions for the population pressures faced by many cities in developing countries and may help meet the rising demand for services and infrastructure. Nevertheless, the high financial cost involved in infrastructure maintenance, the substantial size of the informal economies, and various governance challenges a… ▽ More Smart cities that make broad use of digital technologies have been touted as possible solutions for the population pressures faced by many cities in developing countries and may help meet the rising demand for services and infrastructure. Nevertheless, the high financial cost involved in infrastructure maintenance, the substantial size of the informal economies, and various governance challenges are curtailing government idealism regarding smart cities. This review examines the state of smart city development in developing countries, which includes understanding the conceptualisations, motivations, and unique drivers behind (and barriers to) smarty city development. A total of 56 studies were identified from a systematic literature review from an initial pool of 3928 social sciences literature identified from two academic databases. Data were analysed using thematic synthesis and thematic analysis. The review found that technology-enabled smart cities in developing countries can only be realised when concurrent socioeconomic, human, legal, and regulatory reforms are instituted. Governments need to step up their efforts to fulfil the basic infrastructure needs of citizens, raise more revenue, construct clear regulatory frameworks to mitigate the technological risks involved, develop human capital, ensure digital inclusivity, and promote environmental sustainability. A supportive ecosystem that encourages citizen participation, nurtures start-ups, and promotes public-private partnerships needs to be created to realise their smart city vision. △ Less

Submitted 28 January, 2020; originally announced January 2020.

Journal ref: Sustainability 2020, 12(3), 899

Algorithmic decision-making in AVs: Understanding ethical and technical concerns for smart cities

Authors: Hazel Si Min Lim, Araz Taeihagh

Abstract: Autonomous Vehicles (AVs) are increasingly embraced around the world to advance smart mobility and more broadly, smart, and sustainable cities. Algorithms form the basis of decision-making in AVs, allowing them to perform driving tasks autonomously, efficiently, and more safely than human drivers and offering various economic, social, and environmental benefits. However, algorithmic decision-makin… ▽ More Autonomous Vehicles (AVs) are increasingly embraced around the world to advance smart mobility and more broadly, smart, and sustainable cities. Algorithms form the basis of decision-making in AVs, allowing them to perform driving tasks autonomously, efficiently, and more safely than human drivers and offering various economic, social, and environmental benefits. However, algorithmic decision-making in AVs can also introduce new issues that create new safety risks and perpetuate discrimination. We identify bias, ethics, and perverse incentives as key ethical issues in the AV algorithms' decision-making that can create new safety risks and discriminatory outcomes. Technical issues in the AVs' perception, decision-making and control algorithms, limitations of existing AV testing and verification methods, and cybersecurity vulnerabilities can also undermine the performance of the AV system. This article investigates the ethical and technical concerns surrounding algorithmic decision-making in AVs by exploring how driving decisions can perpetuate discrimination and create new safety risks for the public. We discuss steps taken to address these issues, highlight the existing research gaps and the need to mitigate these issues through the design of AV's algorithms and of policies and regulations to fully realise AVs' benefits for smart and sustainable cities. △ Less

Submitted 29 October, 2019; originally announced October 2019.

Journal ref: Sustainability, 2019, 11(20), 5791

Governing autonomous vehicles: emerging responses for safety, liability, privacy, cybersecurity, and industry risks

Authors: Araz Taeihagh, Hazel Si Min Lim

Abstract: The benefits of autonomous vehicles (AVs) are widely acknowledged, but there are concerns about the extent of these benefits and AV risks and unintended consequences. In this article, we first examine AVs and different categories of the technological risks associated with them. We then explore strategies that can be adopted to address these risks, and explore emerging responses by governments for… ▽ More The benefits of autonomous vehicles (AVs) are widely acknowledged, but there are concerns about the extent of these benefits and AV risks and unintended consequences. In this article, we first examine AVs and different categories of the technological risks associated with them. We then explore strategies that can be adopted to address these risks, and explore emerging responses by governments for addressing AV risks. Our analyses reveal that, thus far, governments have in most instances avoided stringent measures in order to promote AV developments and the majority of responses are non-binding and focus on creating councils or working groups to better explore AV implications. The US has been active in introducing legislations to address issues related to privacy and cybersecurity. The UK and Germany, in particular, have enacted laws to address liability issues, other countries mostly acknowledge these issues, but have yet to implement specific strategies. To address privacy and cybersecurity risks strategies ranging from introduction or amendment of non-AV specific legislation to creating working groups have been adopted. Much less attention has been paid to issues such as environmental and employment risks, although a few governments have begun programmes to retrain workers who might be negatively affected. △ Less

Submitted 16 July, 2018; originally announced July 2018.

Comments: Transport Reviews, 2018

The Governance of Risks in Ridesharing: A Revelatory Case from Singapore

Authors: Yanwei Li, Araz Taeihagh, Martin de Jong

Abstract: Recently we have witnessed the worldwide adoption of many different types of innovative technologies, such as crowdsourcing, ridesharing, open and big data, aiming at delivering public services more efficiently and effectively. Among them, ridesharing has received substantial attention from decision-makers around the world. Because of the multitude of currently understood or potentially unknown ri… ▽ More Recently we have witnessed the worldwide adoption of many different types of innovative technologies, such as crowdsourcing, ridesharing, open and big data, aiming at delivering public services more efficiently and effectively. Among them, ridesharing has received substantial attention from decision-makers around the world. Because of the multitude of currently understood or potentially unknown risks associated with ridesharing (unemployment, insurance, information privacy, and environmental risk), governments in different countries apply different strategies to address such risks. Some governments prohibit the adoption of ridesharing altogether, while other governments promote it. In this article, we address the question of how risks involved in ridesharing are governed over time. We present an in-depth single case study on Singapore and examine how the Singaporean government has addressed risks in ridesharing over time. The Singaporean government has a strong ambition to become an innovation hub, and many innovative technologies have been adopted and promoted to that end. At the same time, decision-makers in Singapore are reputed for their proactive style of social governance. The example of Singapore can be regarded as a revelatory case study, helping us further to explore governance practices in other countries. Keywords: risk; ridesharing; transport; governance; innovative technologies; case study; Singapore △ Less

Submitted 21 May, 2018; originally announced May 2018.

Journal ref: Energies 11, no. 5: 1277 (2018)

Autonomous Vehicles for Smart and Sustainable Cities: An In-Depth Exploration of Privacy and Cybersecurity Implications

Authors: Hazel Si Min Lim, Araz Taeihagh

Abstract: Amidst rapid urban development, sustainable transportation solutions are required to meet the increasing demands for mobility whilst mitigating the potentially negative social, economic, and environmental impacts. This study analyses autonomous vehicles (AVs) as a potential transportation solution for smart and sustainable development. We identified privacy and cybersecurity risks of AVs as crucia… ▽ More Amidst rapid urban development, sustainable transportation solutions are required to meet the increasing demands for mobility whilst mitigating the potentially negative social, economic, and environmental impacts. This study analyses autonomous vehicles (AVs) as a potential transportation solution for smart and sustainable development. We identified privacy and cybersecurity risks of AVs as crucial to the development of smart and sustainable cities and examined the steps taken by governments around the world to address these risks. We highlight the literature that supports why AVs are essential for smart and sustainable development. We then identify the aspects of privacy and cybersecurity in AVs that are important for smart and sustainable development. Lastly, we review the efforts taken by federal governments in the US, the UK, China, Australia, Japan, Singapore, South Korea, Germany, France, and the EU, and by US state governments to address AV-related privacy and cybersecurity risks in-depth. Overall, the actions taken by governments to address privacy risks are mainly in the form of regulations or voluntary guidelines. To address cybersecurity risks, governments have mostly resorted to regulations that are not specific to AVs and are conducting research and fostering research collaborations with the private sector. △ Less

Submitted 27 April, 2018; originally announced April 2018.

Journal ref: Energies 11, no. 5: 1062 (2018)

The Fundamentals of Policy Crowdsourcing

Authors: John Prpic, Araz Taeihagh, James Melton

Abstract: What is the state of the research on crowdsourcing for policy making? This article begins to answer this question by collecting, categorizing, and situating an extensive body of the extant research investigating policy crowdsourcing, within a new framework built on fundamental typologies from each field. We first define seven universal characteristics of the three general crowdsourcing techniques… ▽ More What is the state of the research on crowdsourcing for policy making? This article begins to answer this question by collecting, categorizing, and situating an extensive body of the extant research investigating policy crowdsourcing, within a new framework built on fundamental typologies from each field. We first define seven universal characteristics of the three general crowdsourcing techniques (virtual labor markets, tournament crowdsourcing, open collaboration), to examine the relative trade-offs of each modality. We then compare these three types of crowdsourcing to the different stages of the policy cycle, in order to situate the literature spanning both domains. We finally discuss research trends in crowdsourcing for public policy, and highlight the research gaps and overlaps in the literature. KEYWORDS: crowdsourcing, policy cycle, crowdsourcing trade-offs, policy processes, policy stages, virtual labor markets, tournament crowdsourcing, open collaboration △ Less

Submitted 8 February, 2018; originally announced February 2018.

Comments: arXiv admin note: substantial text overlap with arXiv:1702.04213

Journal ref: Policy & Internet, 7: 340-361 (2015)

Crowdsourcing: a new tool for policy-making?

Authors: Araz Taeihagh

Abstract: Crowdsourcing is rapidly evolving and applied in situations where ideas, labour, opinion or expertise of large groups of people are used. Crowdsourcing is now used in various policy-making initiatives; however, this use has usually focused on open collaboration platforms and specific stages of the policy process, such as agenda-setting and policy evaluations. Other forms of crowdsourcing have been… ▽ More Crowdsourcing is rapidly evolving and applied in situations where ideas, labour, opinion or expertise of large groups of people are used. Crowdsourcing is now used in various policy-making initiatives; however, this use has usually focused on open collaboration platforms and specific stages of the policy process, such as agenda-setting and policy evaluations. Other forms of crowdsourcing have been neglected in policy-making, with a few exceptions. This article examines crowdsourcing as a tool for policy-making, and explores the nuances of the technology and its use and implications for different stages of the policy process. The article addresses questions surrounding the role of crowdsourcing and whether it can be considered as a policy tool or as a technological enabler and investigates the current trends and future directions of crowdsourcing. Keywords: Crowdsourcing, Public Policy, Policy Instrument, Policy Tool, Policy Process, Policy Cycle, Open Collaboration, Virtual Labour Markets, Tournaments, Competition. △ Less

Submitted 8 February, 2018; originally announced February 2018.

Journal ref: Policy Sciences Journal, 50(4):629-647 (2017)

Crowdsourcing, Sharing Economies and Development

Authors: Araz Taeihagh

Abstract: What are the similarities and differences between crowdsourcing and sharing economy? What factors influence their use in developing countries? In light of recent developments in the use of IT-mediated technologies, such as crowdsourcing and the sharing economy, this manuscript examines their similarities and differences, and the challenges regarding their effective use in developing countries. We… ▽ More What are the similarities and differences between crowdsourcing and sharing economy? What factors influence their use in developing countries? In light of recent developments in the use of IT-mediated technologies, such as crowdsourcing and the sharing economy, this manuscript examines their similarities and differences, and the challenges regarding their effective use in developing countries. We first examine each individually and highlight different forms of each IT-mediated technology. Given that crowdsourcing and sharing economy share aspects such as the use of IT, a reliance on crowds, monetary exchange, and the use of reputation systems, we systematically compare the similarities and differences of different types of crowdsourcing with the sharing economy, thus addressing a gap in the current literature. Using this knowledge, we examine the different challenges faced by developing countries when using crowdsourcing and the sharing economy, and highlight the differences in the applicability of these IT-mediated technologies when faced with specific development issues. △ Less

Submitted 20 July, 2017; originally announced July 2017.

Journal ref: Journal of Developing Societies, Vol 33, Issue 2, Pages 191 to 222 (2017)

MOOCs and Crowdsourcing: Massive Courses and Massive Resources

Authors: John Prpic, James Melton, Araz Taeihagh, Terry Anderson

Abstract: Premised upon the observation that MOOC and crowdsourcing phenomena share several important characteristics, including IT mediation, large-scale human participation, and varying levels of openness to participants, this work systematizes a comparison of MOOC and crowdsourcing phenomena along these salient dimensions. In doing so, we learn that both domains share further common traits, including sim… ▽ More Premised upon the observation that MOOC and crowdsourcing phenomena share several important characteristics, including IT mediation, large-scale human participation, and varying levels of openness to participants, this work systematizes a comparison of MOOC and crowdsourcing phenomena along these salient dimensions. In doing so, we learn that both domains share further common traits, including similarities in IT structures, knowledge generating capabilities, presence of intermediary service providers, and techniques designed to attract and maintain participant activity. Stemming directly from this analysis, we discuss new directions for future research in both fields and draw out actionable implications for practitioners and researchers in both domains. △ Less

Submitted 10 February, 2017; originally announced February 2017.

Comments: First Monday, Volume 20, Issue 12, December 2015

Journal ref: First Monday, Volume 20, Issue 12, December 2015

Experiments on Crowdsourcing Policy Assessment

Authors: J. Prpic, A. Taeihagh, J. Melton

Abstract: Can Crowds serve as useful allies in policy design? How do non-expert Crowds perform relative to experts in the assessment of policy measures? Does the geographic location of non-expert Crowds, with relevance to the policy context, alter the performance of non-experts Crowds in the assessment of policy measures? In this work, we investigate these questions by undertaking experiments designed to re… ▽ More Can Crowds serve as useful allies in policy design? How do non-expert Crowds perform relative to experts in the assessment of policy measures? Does the geographic location of non-expert Crowds, with relevance to the policy context, alter the performance of non-experts Crowds in the assessment of policy measures? In this work, we investigate these questions by undertaking experiments designed to replicate expert policy assessments with non-expert Crowds recruited from Virtual Labor Markets. We use a set of ninety-six climate change adaptation policy measures previously evaluated by experts in the Netherlands as our control condition to conduct experiments using two discrete sets of non-expert Crowds recruited from Virtual Labor Markets. We vary the composition of our non-expert Crowds along two conditions: participants recruited from a geographical location directly relevant to the policy context and participants recruited at-large. We discuss our research methods in detail and provide the findings of our experiments. △ Less

Submitted 10 February, 2017; originally announced February 2017.

Comments: Oxford Internet Institute, University of Oxford - IPP 2014 - Crowdsourcing for Politics and Policy

Crowdsourcing the Policy Cycle

Authors: J. Prpic, A. Taeihagh, J. Melton

Abstract: Crowdsourcing is beginning to be used for policymaking. The wisdom of crowds [Surowiecki 2005], and crowdsourcing [Brabham 2008], are seen as new avenues that can shape all kinds of policy, from transportation policy [Nash 2009] to urban planning [Seltzer and Mahmoudi 2013], to climate policy. In general, many have high expectations for positive outcomes with crowdsourcing, and based on both anecd… ▽ More Crowdsourcing is beginning to be used for policymaking. The wisdom of crowds [Surowiecki 2005], and crowdsourcing [Brabham 2008], are seen as new avenues that can shape all kinds of policy, from transportation policy [Nash 2009] to urban planning [Seltzer and Mahmoudi 2013], to climate policy. In general, many have high expectations for positive outcomes with crowdsourcing, and based on both anecdotal and empirical evidence, some of these expectations seem justified [Majchrzak and Malhotra 2013]. Yet, to our knowledge, research has yet to emerge that unpacks the different forms of crowdsourcing in light of each stage of the well-established policy cycle. This work addresses this research gap, and in doing so brings increased nuance to the application of crowdsourcing techniques for policymaking. △ Less

Submitted 10 February, 2017; originally announced February 2017.

Comments: Collective Intelligence 2014, MIT Center for Collective Intelligence

A Framework for Policy Crowdsourcing

Authors: J. Prpic, A. Taeihagh, J. Melton

Abstract: What is the state of the literature in respect to Crowdsourcing for policy making? This work attempts to answer this question by collecting, categorizing, and situating the extant research investigating Crowdsourcing for policy, within the broader Crowdsourcing literature. To do so, the work first extends the Crowdsourcing literature by introducing, defining, explaining, and using seven universal… ▽ More What is the state of the literature in respect to Crowdsourcing for policy making? This work attempts to answer this question by collecting, categorizing, and situating the extant research investigating Crowdsourcing for policy, within the broader Crowdsourcing literature. To do so, the work first extends the Crowdsourcing literature by introducing, defining, explaining, and using seven universal characteristics of all general Crowdsourcing techniques, to vividly draw-out the relative trade-offs of each mode of Crowdsourcing. From this beginning, the work systematically and explicitly weds the three types of Crowdsourcing to the stages of the Policy cycle as a method of situating the extant literature spanning both domains. Thereafter, we discuss the trends, highlighting the research gaps, and outline the overlaps in the research on Crowdsourcing for policy, stemming from our analysis. △ Less

Submitted 10 February, 2017; originally announced February 2017.

Comments: Oxford Internet Institute, University of Oxford - IPP 2014 - Crowdsourcing for Politics and Policy