-
Action Units Recognition by Pairwise Deep Architecture
Authors:
Junya Saito,
Ryosuke Kawamura,
Akiyoshi Uchida,
Sachihiro Youoku,
Yuushi Toyoda,
Takahisa Yamamoto,
Xiaoyu Mi,
Kentaro Murase
Abstract:
In this paper, we propose a new automatic Action Units (AUs) recognition method used in a competition, Affective Behavior Analysis in-the-wild (ABAW). Our method tackles a problem of AUs label inconsistency among subjects by using pairwise deep architecture. While the baseline score is 0.31, our method achieved 0.67 in validation dataset of the competition.
In this paper, we propose a new automatic Action Units (AUs) recognition method used in a competition, Affective Behavior Analysis in-the-wild (ABAW). Our method tackles a problem of AUs label inconsistency among subjects by using pairwise deep architecture. While the baseline score is 0.31, our method achieved 0.67 in validation dataset of the competition.
△ Less
Submitted 2 October, 2020; v1 submitted 1 October, 2020;
originally announced October 2020.
-
A Multi-term and Multi-task Analyzing Framework for Affective Analysis in-the-wild
Authors:
Sachihiro Youoku,
Yuushi Toyoda,
Takahisa Yamamoto,
Junya Saito,
Ryosuke Kawamura,
Xiaoyu Mi,
Kentaro Murase
Abstract:
Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition method focusing on valence-arousal (VA) and expression (EXP) that was submitted to the Affective Behavior Analysis in-the-wild (ABAW) 2020 Contest. Since we consi…
▽ More
Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition method focusing on valence-arousal (VA) and expression (EXP) that was submitted to the Affective Behavior Analysis in-the-wild (ABAW) 2020 Contest. Since we considered that affective behaviors have many observable features that have their own time frames, we introduced multiple optimized time windows (short-term, middle-term, and long-term) into our analyzing framework for extracting feature parameters from video data. Moreover, multiple modality data are used, including action units, head poses, gaze, posture, and ResNet 50 or Efficient NET features, and are optimized during the extraction of these features. Then, we generated affective recognition models for each time window and ensembled these models together. Also, we fussed the valence, arousal, and expression models together to enable the multi-task learning, considering the fact that the basic psychological states behind facial expressions are closely related to each another. In the validation set, our model achieved a valence-arousal score of 0.498 and a facial expression score of 0.471. These verification results reveal that our proposed framework can improve estimation accuracy and robustness effectively.
△ Less
Submitted 2 October, 2020; v1 submitted 29 September, 2020;
originally announced September 2020.
-
Relaxing Constraints on Inflation Models with Curvaton
Authors:
Takeo Moroi,
Tomo Takahashi,
Yoshikazu Toyoda
Abstract:
We consider the effects of the curvaton, late-decaying scalar condensation, to observational constraints on inflation models. From current observations of cosmic density fluctuations, severe constraints on some class of inflation models are obtained, in particular, on the chaotic inflation with higher-power monomials, the natural inflation, and the new inflation. We study how the curvaton scenar…
▽ More
We consider the effects of the curvaton, late-decaying scalar condensation, to observational constraints on inflation models. From current observations of cosmic density fluctuations, severe constraints on some class of inflation models are obtained, in particular, on the chaotic inflation with higher-power monomials, the natural inflation, and the new inflation. We study how the curvaton scenario changes (and relaxes) the constraints on these models.
△ Less
Submitted 3 January, 2005;
originally announced January 2005.
