-
Generative Adversarial Networks in Human Emotion Synthesis:A Review
Authors:
Noushin Hajarolasvadi,
Miguel Arjona RamÃrez,
Hasan Demirel
Abstract:
Synthesizing realistic data samples is of great value for both academic and industrial communities. Deep generative models have become an emerging topic in various research areas like computer vision and signal processing. Affective computing, a topic of a broad interest in computer vision society, has been no exception and has benefited from generative models. In fact, affective computing observe…
▽ More
Synthesizing realistic data samples is of great value for both academic and industrial communities. Deep generative models have become an emerging topic in various research areas like computer vision and signal processing. Affective computing, a topic of a broad interest in computer vision society, has been no exception and has benefited from generative models. In fact, affective computing observed a rapid derivation of generative models during the last two decades. Applications of such models include but are not limited to emotion recognition and classification, unimodal emotion synthesis, and cross-modal emotion synthesis. As a result, we conducted a review of recent advances in human emotion synthesis by studying available databases, advantages, and disadvantages of the generative models along with the related training strategies considering two principal human communication modalities, namely audio and video. In this context, facial expression synthesis, speech emotion synthesis, and the audio-visual (cross-modal) emotion synthesis is reviewed extensively under different application scenarios. Gradually, we discuss open research problems to push the boundaries of this research area for future works.
△ Less
Submitted 7 November, 2020; v1 submitted 28 October, 2020;
originally announced October 2020.
-
Transparency's Influence on Human-Collective Interactions
Authors:
Karina A. Roundtree,
Jason R. Cody,
Jennifer Leaf,
H. Onan Demirel,
Julie A. Adams
Abstract:
Collective robotic systems are biologically inspired and advantageous due to their apparent global intelligence and emergent behaviors. Many applications can benefit from the incorporation of collectives, including environmental monitoring, disaster response missions, and infrastructure support. Transparency research has primarily focused on how the design of the models, visualizations, and contro…
▽ More
Collective robotic systems are biologically inspired and advantageous due to their apparent global intelligence and emergent behaviors. Many applications can benefit from the incorporation of collectives, including environmental monitoring, disaster response missions, and infrastructure support. Transparency research has primarily focused on how the design of the models, visualizations, and control mechanisms influence human-collective interactions. Traditionally most evaluations have focused only on one particular system design element, evaluating its respective transparency. This manuscript analyzed two models and visualizations to understand how the system design elements impacted human-collective interactions, to quantify which model and visualization combination provided the best transparency, and provide design guidance, based on remote supervision of collectives. The consensus decision-making and baseline models, as well as an individual agent and abstract visualizations, were analyzed for sequential best-of-n decision-making tasks involving four collectives, composed of 200 entities each. Both models and visualizations provided transparency and influenced human-collective interactions differently. No single combination provided the best transparency.
△ Less
Submitted 17 September, 2020;
originally announced September 2020.
-
Human collective visualization transparency
Authors:
Karina A. Roundtree,
Jason R. Cody,
Jennifer Leaf,
H. Onan Demirel,
Julie A. Adams
Abstract:
Interest in collective robotic systems has increased rapidly due to the potential benefits that can be offered to operators, such as increased safety and support, who perform challenging tasks in high-risk environments. Human-collective transparency research has focused on how the design of the algorithms, visualizations, and control mechanisms influence human-collective behavior. Traditional coll…
▽ More
Interest in collective robotic systems has increased rapidly due to the potential benefits that can be offered to operators, such as increased safety and support, who perform challenging tasks in high-risk environments. Human-collective transparency research has focused on how the design of the algorithms, visualizations, and control mechanisms influence human-collective behavior. Traditional collective visualizations have shown all of the individual entities composing a collective, which may become problematic as collectives scale in size and heterogeneity, and tasks become more demanding. Human operators can become overloaded with information, which will negatively affect their understanding of the collective's current state and overall behaviors, which can cause poor teaming performance. An analysis of visualization transparency and the derived visualization design guidance, based on remote supervision of collectives, are the primary contributions of this manuscript. The individual agent and abstract visualizations were analyzed for sequential best-of-n decision-making tasks involving four collectives, composed of 200 entities each. The abstract visualization provided better transparency by enabling operators with different individual differences and capabilities to perform relatively the same and promoted higher human-collective performance.
△ Less
Submitted 24 March, 2020;
originally announced March 2020.
-
Image Resolution Enhancement by Using Interpolation Followed by Iterative Back Projection
Authors:
Pejman Rasti,
Hasan Demirel,
Gholamreza Anbarjafari
Abstract:
In this paper, we propose a new super resolution technique based on the interpolation followed by registering them using iterative back projection (IBP). Low resolution images are being interpolated and then the interpolated images are being registered in order to generate a sharper high resolution image. The proposed technique has been tested on Lena, Elaine, Pepper, and Baboon. The quantitative…
▽ More
In this paper, we propose a new super resolution technique based on the interpolation followed by registering them using iterative back projection (IBP). Low resolution images are being interpolated and then the interpolated images are being registered in order to generate a sharper high resolution image. The proposed technique has been tested on Lena, Elaine, Pepper, and Baboon. The quantitative peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) results as well as the visual results show the superiority of the proposed technique over the conventional and state-of-art image super resolution techniques. For Lena's image, the PSNR is 6.52 dB higher than the bicubic interpolation.
△ Less
Submitted 3 January, 2016;
originally announced January 2016.
