Showing 1–2 of 2 results for author: Kuroki, S
-
Domain Discrepancy Measure for Complex Models in Unsupervised Domain Adaptation
Authors:
Jongyeong Lee,
Nontawat Charoenphakdee,
Seiichi Kuroki,
Masashi Sugiyama
Abstract:
Appropriately evaluating the discrepancy between domains is essential for the success of unsupervised domain adaptation. In this paper, we first point out that existing discrepancy measures are less informative when complex models such as deep neural networks are used, in addition to the facts that they can be computationally highly demanding and their range of applications is limited only to bina…
▽ More
Appropriately evaluating the discrepancy between domains is essential for the success of unsupervised domain adaptation. In this paper, we first point out that existing discrepancy measures are less informative when complex models such as deep neural networks are used, in addition to the facts that they can be computationally highly demanding and their range of applications is limited only to binary classification. We then propose a novel domain discrepancy measure, called the paired hypotheses discrepancy (PHD), to overcome these shortcomings. PHD is computationally efficient and applicable to multi-class classification. Through generalization error bound analysis, we theoretically show that PHD is effective even for complex models. Finally, we demonstrate the practical usefulness of PHD through experiments.
△ Less
Submitted 21 October, 2019; v1 submitted 29 January, 2019;
originally announced January 2019.
-
Unsupervised Domain Adaptation Based on Source-guided Discrepancy
Authors:
Seiichi Kuroki,
Nontawat Charoenphakdee,
Han Bao,
Junya Honda,
Issei Sato,
Masashi Sugiyama
Abstract:
Unsupervised domain adaptation is the problem setting where data generating distributions in the source and target domains are different, and labels in the target domain are unavailable. One important question in unsupervised domain adaptation is how to measure the difference between the source and target domains. A previously proposed discrepancy that does not use the source domain labels require…
▽ More
Unsupervised domain adaptation is the problem setting where data generating distributions in the source and target domains are different, and labels in the target domain are unavailable. One important question in unsupervised domain adaptation is how to measure the difference between the source and target domains. A previously proposed discrepancy that does not use the source domain labels requires high computational cost to estimate and may lead to a loose generalization error bound in the target domain. To mitigate these problems, we propose a novel discrepancy called source-guided discrepancy (S-disc), which exploits labels in the source domain. As a consequence, S-disc can be computed efficiently with a finite sample convergence guarantee. In addition, we show that S-disc can provide a tighter generalization error bound than the one based on an existing discrepancy. Finally, we report experimental results that demonstrate the advantages of S-disc over the existing discrepancies.
△ Less
Submitted 19 November, 2018; v1 submitted 11 September, 2018;
originally announced September 2018.
