Bound by the Bounty: Collaboratively Shaping Evaluation Processes for Queer AI Harms
Authors:
Organizers of QueerInAI,
Nathan Dennler,
Anaelia Ovalle,
Ashwin Singh,
Luca Soldaini,
Arjun Subramonian,
Huy Tu,
William Agnew,
Avijit Ghosh,
Kyra Yee,
Irene Font Peradejordi,
Zeerak Talat,
Mayra Russo,
Jess de Jesus de Pinho Pinhal
Abstract:
Bias evaluation benchmarks and dataset and model documentation have emerged as central processes for assessing the biases and harms of artificial intelligence (AI) systems. However, these auditing processes have been criticized for their failure to integrate the knowledge of marginalized communities and consider the power dynamics between auditors and the communities. Consequently, modes of bias e…
▽ More
Bias evaluation benchmarks and dataset and model documentation have emerged as central processes for assessing the biases and harms of artificial intelligence (AI) systems. However, these auditing processes have been criticized for their failure to integrate the knowledge of marginalized communities and consider the power dynamics between auditors and the communities. Consequently, modes of bias evaluation have been proposed that engage impacted communities in identifying and assessing the harms of AI systems (e.g., bias bounties). Even so, asking what marginalized communities want from such auditing processes has been neglected. In this paper, we ask queer communities for their positions on, and desires from, auditing processes. To this end, we organized a participatory workshop to critique and redesign bias bounties from queer perspectives. We found that when given space, the scope of feedback from workshop participants goes far beyond what bias bounties afford, with participants questioning the ownership, incentives, and efficacy of bounties. We conclude by advocating for community ownership of bounties and complementing bounties with participatory processes (e.g., co-creation).
△ Less
Submitted 25 July, 2023; v1 submitted 14 July, 2023;
originally announced July 2023.
3D human pose estimation with adaptive receptive fields and dilated temporal convolutions
Authors:
Michael Shin,
Eduardo Castillo,
Irene Font Peradejordi,
Shobhna Jayaraman
Abstract:
In this work, we demonstrate that receptive fields in 3D pose estimation can be effectively specified using optical flow. We introduce adaptive receptive fields, a simple and effective method to aid receptive field selection in pose estimation models based on optical flow inference. We contrast the performance of a benchmark state-of-the-art model running on fixed receptive fields with their adapt…
▽ More
In this work, we demonstrate that receptive fields in 3D pose estimation can be effectively specified using optical flow. We introduce adaptive receptive fields, a simple and effective method to aid receptive field selection in pose estimation models based on optical flow inference. We contrast the performance of a benchmark state-of-the-art model running on fixed receptive fields with their adaptive field counterparts. By using a reduced receptive field, our model can process slow-motion sequences (10x longer) 23% faster than the benchmark model running at regular speed. The reduction in computational cost is achieved while producing a pose prediction accuracy to within 0.36% of the benchmark model.
△ Less
Submitted 28 May, 2020;
originally announced May 2020.
