-
Why Accuracy Is Not Enough: The Need for Consistency in Object Detection
Authors:
Caleb Tung,
Abhinav Goel,
Fischer Bordwell,
Nick Eliopoulos,
Xiao Hu,
George K. Thiruvathukal,
Yung-Hsiang Lu
Abstract:
Object detectors are vital to many modern computer vision applications. However, even state-of-the-art object detectors are not perfect. On two images that look similar to human eyes, the same detector can make different predictions because of small image distortions like camera sensor noise and lighting changes. This problem is called inconsistency. Existing accuracy metrics do not properly accou…
▽ More
Object detectors are vital to many modern computer vision applications. However, even state-of-the-art object detectors are not perfect. On two images that look similar to human eyes, the same detector can make different predictions because of small image distortions like camera sensor noise and lighting changes. This problem is called inconsistency. Existing accuracy metrics do not properly account for inconsistency, and similar work in this area only targets improvements on artificial image distortions. Therefore, we propose a method to use non-artificial video frames to measure object detection consistency over time, across frames. Using this method, we show that the consistency of modern object detectors ranges from 83.2% to 97.1% on different video datasets from the Multiple Object Tracking Challenge. We conclude by showing that applying image distortion corrections like .WEBP Image Compression and Unsharp Masking can improve consistency by as much as 5.1%, with no loss in accuracy.
△ Less
Submitted 28 July, 2022;
originally announced July 2022.
-
Analyzing Worldwide Social Distancing through Large-Scale Computer Vision
Authors:
Isha Ghodgaonkar,
Subhankar Chakraborty,
Vishnu Banna,
Shane Allcroft,
Mohammed Metwaly,
Fischer Bordwell,
Kohsuke Kimura,
Xinxin Zhao,
Abhinav Goel,
Caleb Tung,
Akhil Chinnakotla,
Minghao Xue,
Yung-Hsiang Lu,
Mark Daniel Ward,
Wei Zakharov,
David S. Ebert,
David M. Barbarash,
George K. Thiruvathukal
Abstract:
In order to contain the COVID-19 pandemic, countries around the world have introduced social distancing guidelines as public health interventions to reduce the spread of the disease. However, monitoring the efficacy of these guidelines at a large scale (nationwide or worldwide) is difficult. To make matters worse, traditional observational methods such as in-person reporting is dangerous because o…
▽ More
In order to contain the COVID-19 pandemic, countries around the world have introduced social distancing guidelines as public health interventions to reduce the spread of the disease. However, monitoring the efficacy of these guidelines at a large scale (nationwide or worldwide) is difficult. To make matters worse, traditional observational methods such as in-person reporting is dangerous because observers may risk infection. A better solution is to observe activities through network cameras; this approach is scalable and observers can stay in safe locations. This research team has created methods that can discover thousands of network cameras worldwide, retrieve data from the cameras, analyze the data, and report the sizes of crowds as different countries issued and lifted restrictions (also called ''lockdown''). We discover 11,140 network cameras that provide real-time data and we present the results across 15 countries. We collect data from these cameras beginning April 2020 at approximately 0.5TB per week. After analyzing 10,424,459 images from still image cameras and frames extracted periodically from video, the data reveals that the residents in some countries exhibited more activity (judged by numbers of people and vehicles) after the restrictions were lifted. In other countries, the amounts of activities showed no obvious changes during the restrictions and after the restrictions were lifted. The data further reveals whether people stay ''social distancing'', at least 6 feet apart. This study discerns whether social distancing is being followed in several types of locations and geographical locations worldwide and serve as an early indicator whether another wave of infections is likely to occur soon.
△ Less
Submitted 27 August, 2020;
originally announced August 2020.
-
Observing Responses to the COVID-19 Pandemic using Worldwide Network Cameras
Authors:
Isha Ghodgaonkar,
Abhinav Goel,
Fischer Bordwell,
Caleb Tung,
Sara Aghajanzadeh,
Noah Curran,
Ryan Chen,
Kaiwen Yu,
Sneha Mahapatra,
Vishnu Banna,
Gore Kao,
Kate Lee,
Xiao Hu,
Nick Eliopolous,
Akhil Chinnakotla,
Damini Rijhwani,
Ashley Kim,
Aditya Chakraborty,
Mark Daniel Ward,
Yung-Hsiang Lu,
George K. Thiruvathukal
Abstract:
COVID-19 has resulted in a worldwide pandemic, leading to "lockdown" policies and social distancing. The pandemic has profoundly changed the world. Traditional methods for observing these historical events are difficult because sending reporters to areas with many infected people can put the reporters' lives in danger. New technologies are needed for safely observing responses to these policies. T…
▽ More
COVID-19 has resulted in a worldwide pandemic, leading to "lockdown" policies and social distancing. The pandemic has profoundly changed the world. Traditional methods for observing these historical events are difficult because sending reporters to areas with many infected people can put the reporters' lives in danger. New technologies are needed for safely observing responses to these policies. This paper reports using thousands of network cameras deployed worldwide for the purpose of witnessing activities in response to the policies. The network cameras can continuously provide real-time visual data (image and video) without human efforts. Thus, network cameras can be utilized to observe activities without risking the lives of reporters. This paper describes a project that uses network cameras to observe responses to governments' policies during the COVID-19 pandemic (March to April in 2020). The project discovers over 30,000 network cameras deployed in 110 countries. A set of computer tools are created to collect visual data from network cameras continuously during the pandemic. This paper describes the methods to discover network cameras on the Internet, the methods to collect and manage data, and preliminary results of data analysis. This project can be the foundation for observing the possible "second wave" in fall 2020. The data may be used for post-pandemic analysis by sociologists, public health experts, and meteorologists.
△ Less
Submitted 18 May, 2020;
originally announced May 2020.
