-
Investigating Role of Big Five Personality Traits in Audio-Visual Rapport Estimation
Authors:
Takato Hayashi,
Ryusei Kimura,
Ryo Ishii,
Shogo Okada
Abstract:
Automatic rapport estimation in social interactions is a central component of affective computing. Recent reports have shown that the estimation performance of rapport in initial interactions can be improved by using the participant's personality traits as the model's input. In this study, we investigate whether this findings applies to interactions between friends by developing rapport estimation…
▽ More
Automatic rapport estimation in social interactions is a central component of affective computing. Recent reports have shown that the estimation performance of rapport in initial interactions can be improved by using the participant's personality traits as the model's input. In this study, we investigate whether this findings applies to interactions between friends by developing rapport estimation models that utilize nonverbal cues (audio and facial expressions) as inputs. Our experimental results show that adding Big Five features (BFFs) to nonverbal features can improve the estimation performance of self-reported rapport in dyadic interactions between friends. Next, we demystify how BFFs improve the estimation performance of rapport through a comparative analysis between models with and without BFFs. We decompose rapport ratings into perceiver effects (people's tendency to rate other people), target effects (people's tendency to be rated by other people), and relationship effects (people's unique ratings for a specific person) using the social relations model. We then analyze the extent to which BFFs contribute to capturing each effect. Our analysis demonstrates that the perceiver's and the target's BFFs lead estimation models to capture the perceiver and the target effects, respectively. Furthermore, our experimental results indicate that the combinations of facial expression features and BFFs achieve best estimation performances not only in estimating rapport ratings, but also in estimating three effects. Our study is the first step toward understanding why personality-aware estimation models of interpersonal perception accomplish high estimation performance.
△ Less
Submitted 7 October, 2024;
originally announced October 2024.
-
Estimating Driver Personality Traits from On-Road Driving Data
Authors:
Ryusei Kimura,
Takahiro Tanaka,
Yuki Yoshihara,
Kazuhiro Fujikake,
Hitoshi Kanamori,
Shogo Okada
Abstract:
This paper focuses on the estimation of a driver's psychological characteristics using driving data for driving assistance systems. Driving assistance systems that support drivers by adapting individual psychological characteristics can provide appropriate feedback and prevent traffic accidents. As a first step toward implementing such adaptive assistance systems, this research aims to develop a m…
▽ More
This paper focuses on the estimation of a driver's psychological characteristics using driving data for driving assistance systems. Driving assistance systems that support drivers by adapting individual psychological characteristics can provide appropriate feedback and prevent traffic accidents. As a first step toward implementing such adaptive assistance systems, this research aims to develop a model to estimate drivers' psychological characteristics, such as cognitive function, psychological driving style, and workload sensitivity, from on-road driving behavioral data using machine learning and deep learning techniques. We also investigated the relationship between driving behavior and various cognitive functions, including the Trail Making Test (TMT) and Useful Field of View (UFOV) test, through regression modeling. The proposed method focuses on road type information and captures various durations of time-series data observed from driving behaviors. First, we segment the driving time-series data into two road types, namely, arterial roads and intersections, to consider driving situations. Second, we further segment data into many sequences of various durations. Third, statistics are calculated from each sequence. Finally, these statistics are used as input features of machine learning models to estimate psychological characteristics. The experimental results show that our model can estimate a driver's cognitive function, namely, the TMT~(B) and UFOV test scores, with Pearson correlation coefficients $r$ of 0.579 and 0.708, respectively. Some characteristics, such as psychological driving style and workload sensitivity, are estimated with high accuracy, but whether various duration segmentation improves accuracy depends on the characteristics, and it is not effective for all characteristics.
△ Less
Submitted 23 August, 2023; v1 submitted 9 February, 2023;
originally announced February 2023.
-
A Study on the relationship between the geometrical shapes and the biometrical acoustic characteristics of human ear canal
Authors:
Riki Kimura,
Shunsuke Tanaka,
Naoki Wakui,
Naoki Kodama,
Shohei Yano
Abstract:
Ear acoustic authentication is a new biometrics method and it utilizes the differences in acoustic characteristics of the ear canal between users. However, there have been few reports on the factors that cause differences in the acoustic characteristics. We investigate the relationship between ear canal shapes and acoustic characteristics in terms of user-to-user similarity. We used magnetic reson…
▽ More
Ear acoustic authentication is a new biometrics method and it utilizes the differences in acoustic characteristics of the ear canal between users. However, there have been few reports on the factors that cause differences in the acoustic characteristics. We investigate the relationship between ear canal shapes and acoustic characteristics in terms of user-to-user similarity. We used magnetic resonance imaging (MRI) to measure ear canal geometry. As a result, the correlation coefficient between shape similarity and acoustic characteristic similarity is higher than 0.7 and the coefficient of determination is higher than 0.5. This suggests that the difference in the shape of the ear canal is one of the important factors.
△ Less
Submitted 1 September, 2022; v1 submitted 30 August, 2022;
originally announced August 2022.
-
Representing a Partially Observed Non-Rigid 3D Human Using Eigen-Texture and Eigen-Deformation
Authors:
Ryosuke Kimura,
Akihiko Sayo,
Fabian Lorenzo Dayrit,
Yuta Nakashima,
Hiroshi Kawasaki,
Ambrosio Blanco,
Katsushi Ikeuchi
Abstract:
Reconstruction of the shape and motion of humans from RGB-D is a challenging problem, receiving much attention in recent years. Recent approaches for full-body reconstruction use a statistic shape model, which is built upon accurate full-body scans of people in skin-tight clothes, to complete invisible parts due to occlusion. Such a statistic model may still be fit to an RGB-D measurement with loo…
▽ More
Reconstruction of the shape and motion of humans from RGB-D is a challenging problem, receiving much attention in recent years. Recent approaches for full-body reconstruction use a statistic shape model, which is built upon accurate full-body scans of people in skin-tight clothes, to complete invisible parts due to occlusion. Such a statistic model may still be fit to an RGB-D measurement with loose clothes but cannot describe its deformations, such as clothing wrinkles. Observed surfaces may be reconstructed precisely from actual measurements, while we have no cues for unobserved surfaces. For full-body reconstruction with loose clothes, we propose to use lower dimensional embeddings of texture and deformation referred to as eigen-texturing and eigen-deformation, to reproduce views of even unobserved surfaces. Provided a full-body reconstruction from a sequence of partial measurements as 3D meshes, the texture and deformation of each triangle are then embedded using eigen-decomposition. Combined with neural-network-based coefficient regression, our method synthesizes the texture and deformation from arbitrary viewpoints. We evaluate our method using simulated data and visually demonstrate how our method works on real data.
△ Less
Submitted 7 July, 2018;
originally announced July 2018.
-
Neural Machine Translation Model with a Large Vocabulary Selected by Branching Entropy
Authors:
Zi Long,
Ryuichiro Kimura,
Takehito Utsuro,
Tomoharu Mitsuhashi,
Mikio Yamamoto
Abstract:
Neural machine translation (NMT), a new approach to machine translation, has achieved promising results comparable to those of traditional approaches such as statistical machine translation (SMT). Despite its recent success, NMT cannot handle a larger vocabulary because the training complexity and decoding complexity proportionally increase with the number of target words. This problem becomes eve…
▽ More
Neural machine translation (NMT), a new approach to machine translation, has achieved promising results comparable to those of traditional approaches such as statistical machine translation (SMT). Despite its recent success, NMT cannot handle a larger vocabulary because the training complexity and decoding complexity proportionally increase with the number of target words. This problem becomes even more serious when translating patent documents, which contain many technical terms that are observed infrequently. In this paper, we propose to select phrases that contain out-of-vocabulary words using the statistical approach of branching entropy. This allows the proposed NMT system to be applied to a translation task of any language pair without any language-specific knowledge about technical term identification. The selected phrases are then replaced with tokens during training and post-translated by the phrase translation table of SMT. Evaluation on Japanese-to-Chinese, Chinese-to-Japanese, Japanese-to-English and English-to-Japanese patent sentence translation proved the effectiveness of phrases selected with branching entropy, where the proposed NMT model achieves a substantial improvement over a baseline NMT model without our proposed technique. Moreover, the number of translation errors of under-translation by the baseline NMT model without our proposed technique reduces to around half by the proposed NMT model.
△ Less
Submitted 6 September, 2017; v1 submitted 14 April, 2017;
originally announced April 2017.
