Enhancing Impression Change Prediction in Speed Dating Simulations Based on Speakers' Personalities
Authors:
Kazuya Matsuo,
Yoko Ishii,
Atsushi Otsuka,
Ryo Ishii,
Hiroaki Sugiyama,
Masahiro Mizukami,
Tsunehiro Arimoto,
Narichika Nomoto,
Yoshihide Sato,
Tetsuya Yamaguchi
Abstract:
This paper focuses on simulating text dialogues in which impressions between speakers improve during speed dating. This simulation involves selecting an utterance from multiple candidates generated by a text generation model that replicates a specific speaker's utterances, aiming to improve the impression of the speaker. Accurately selecting an utterance that improves the impression is crucial for…
▽ More
This paper focuses on simulating text dialogues in which impressions between speakers improve during speed dating. This simulation involves selecting an utterance from multiple candidates generated by a text generation model that replicates a specific speaker's utterances, aiming to improve the impression of the speaker. Accurately selecting an utterance that improves the impression is crucial for the simulation. We believe that whether an utterance improves a dialogue partner's impression of the speaker may depend on the personalities of both parties. However, recent methods for utterance selection do not consider the impression per utterance or the personalities. To address this, we propose a method that predicts whether an utterance improves a partner's impression of the speaker, considering the personalities. The evaluation results showed that personalities are useful in predicting impression changes per utterance. Furthermore, we conducted a human evaluation of simulated dialogues using our method. The results showed that it could simulate dialogues more favorably received than those selected without considering personalities.
△ Less
Submitted 7 February, 2025;
originally announced February 2025.
Empirical Analysis of Training Strategies of Transformer-based Japanese Chit-chat Systems
Authors:
Hiroaki Sugiyama,
Masahiro Mizukami,
Tsunehiro Arimoto,
Hiromi Narimatsu,
Yuya Chiba,
Hideharu Nakajima,
Toyomi Meguro
Abstract:
In recent years, several high-performance conversational systems have been proposed based on the Transformer encoder-decoder model. Although previous studies analyzed the effects of the model parameters and the decoding method on subjective dialogue evaluations with overall metrics, they did not analyze how the differences of fine-tuning datasets affect on user's detailed impression. In addition,…
▽ More
In recent years, several high-performance conversational systems have been proposed based on the Transformer encoder-decoder model. Although previous studies analyzed the effects of the model parameters and the decoding method on subjective dialogue evaluations with overall metrics, they did not analyze how the differences of fine-tuning datasets affect on user's detailed impression. In addition, the Transformer-based approach has only been verified for English, not for such languages with large inter-language distances as Japanese. In this study, we develop large-scale Transformer-based Japanese dialogue models and Japanese chit-chat datasets to examine the effectiveness of the Transformer-based approach for building chit-chat dialogue systems. We evaluated and analyzed the impressions of human dialogues in different fine-tuning datasets, model parameters, and the use of additional information.
△ Less
Submitted 11 September, 2021;
originally announced September 2021.
