Textured Mesh Quality Assessment: Large-Scale Dataset and Deep Learning-based Quality Metric
Authors:
Yana Nehmé,
Johanna Delanoy,
Florent Dupont,
Jean-Philippe Farrugia,
Patrick Le Callet,
Guillaume Lavoué
Abstract:
Over the past decade, 3D graphics have become highly detailed to mimic the real world, exploding their size and complexity. Certain applications and device constraints necessitate their simplification and/or lossy compression, which can degrade their visual quality. Thus, to ensure the best Quality of Experience (QoE), it is important to evaluate the visual quality to accurately drive the compress…
▽ More
Over the past decade, 3D graphics have become highly detailed to mimic the real world, exploding their size and complexity. Certain applications and device constraints necessitate their simplification and/or lossy compression, which can degrade their visual quality. Thus, to ensure the best Quality of Experience (QoE), it is important to evaluate the visual quality to accurately drive the compression and find the right compromise between visual quality and data size. In this work, we focus on subjective and objective quality assessment of textured 3D meshes. We first establish a large-scale dataset, which includes 55 source models quantitatively characterized in terms of geometric, color, and semantic complexity, and corrupted by combinations of 5 types of compression-based distortions applied on the geometry, texture mapping and texture image of the meshes. This dataset contains over 343k distorted stimuli. We propose an approach to select a challenging subset of 3000 stimuli for which we collected 148929 quality judgments from over 4500 participants in a large-scale crowdsourced subjective experiment. Leveraging our subject-rated dataset, a learning-based quality metric for 3D graphics was proposed. Our metric demonstrates state-of-the-art results on our dataset of textured meshes and on a dataset of distorted meshes with vertex colors. Finally, we present an application of our metric and dataset to explore the influence of distortion interactions and content characteristics on the perceived quality of compressed textured meshes.
△ Less
Submitted 8 May, 2023; v1 submitted 4 February, 2022;
originally announced February 2022.
The Cyborg Astrobiologist: Porting from a wearable computer to the Astrobiology Phone-cam
Authors:
Alexandra Bartolo,
Patrick C. McGuire,
Kenneth P. Camilleri,
Christopher Spiteri,
Jonathan C. Borg,
Philip J. Farrugia,
Jens Ormo,
Javier Gomez-Elvira,
Jose Antonio Rodriguez-Manfredi,
Enrique Diaz-Martinez,
Helge Ritter,
Robert Haschke,
Markus Oesker,
Joerg Ontrup
Abstract:
We have used a simple camera phone to significantly improve an `exploration system' for astrobiology and geology. This camera phone will make it much easier to develop and test computer-vision algorithms for future planetary exploration. We envision that the `Astrobiology Phone-cam' exploration system can be fruitfully used in other problem domains as well.
We have used a simple camera phone to significantly improve an `exploration system' for astrobiology and geology. This camera phone will make it much easier to develop and test computer-vision algorithms for future planetary exploration. We envision that the `Astrobiology Phone-cam' exploration system can be fruitfully used in other problem domains as well.
△ Less
Submitted 5 July, 2007;
originally announced July 2007.
