-
Color Recommendation for Vector Graphic Documents based on Multi-Palette Representation
Authors:
Qianru Qiu,
Xueting Wang,
Mayu Otani,
Yuki Iwazaki
Abstract:
Vector graphic documents present multiple visual elements, such as images, shapes, and texts. Choosing appropriate colors for multiple visual elements is a difficult but crucial task for both amateurs and professional designers. Instead of creating a single color palette for all elements, we extract multiple color palettes from each visual element in a graphic document, and then combine them into…
▽ More
Vector graphic documents present multiple visual elements, such as images, shapes, and texts. Choosing appropriate colors for multiple visual elements is a difficult but crucial task for both amateurs and professional designers. Instead of creating a single color palette for all elements, we extract multiple color palettes from each visual element in a graphic document, and then combine them into a color sequence. We propose a masked color model for color sequence completion and recommend the specified colors based on color context in multi-palette with high probability. We train the model and build a color recommendation system on a large-scale dataset of vector graphic documents. The proposed color recommendation method outperformed other state-of-the-art methods by both quantitative and qualitative evaluations on color prediction and our color recommendation system received positive feedback from professional designers in an interview study.
△ Less
Submitted 22 September, 2022;
originally announced September 2022.
-
DM$^2$S$^2$: Deep Multi-Modal Sequence Sets with Hierarchical Modality Attention
Authors:
Shunsuke Kitada,
Yuki Iwazaki,
Riku Togashi,
Hitoshi Iyatomi
Abstract:
There is increasing interest in the use of multimodal data in various web applications, such as digital advertising and e-commerce. Typical methods for extracting important information from multimodal data rely on a mid-fusion architecture that combines the feature representations from multiple encoders. However, as the number of modalities increases, several potential problems with the mid-fusion…
▽ More
There is increasing interest in the use of multimodal data in various web applications, such as digital advertising and e-commerce. Typical methods for extracting important information from multimodal data rely on a mid-fusion architecture that combines the feature representations from multiple encoders. However, as the number of modalities increases, several potential problems with the mid-fusion model structure arise, such as an increase in the dimensionality of the concatenated multimodal features and missing modalities. To address these problems, we propose a new concept that considers multimodal inputs as a set of sequences, namely, deep multimodal sequence sets (DM$^2$S$^2$). Our set-aware concept consists of three components that capture the relationships among multiple modalities: (a) a BERT-based encoder to handle the inter- and intra-order of elements in the sequences, (b) intra-modality residual attention (IntraMRA) to capture the importance of the elements in a modality, and (c) inter-modality residual attention (InterMRA) to enhance the importance of elements with modality-level granularity further. Our concept exhibits performance that is comparable to or better than the previous set-aware models. Furthermore, we demonstrate that the visualization of the learned InterMRA and IntraMRA weights can provide an interpretation of the prediction results.
△ Less
Submitted 22 November, 2022; v1 submitted 7 September, 2022;
originally announced September 2022.
-
Benefits and Drawbacks of a Graduate Course: An Experience Teaching Systematic Literature Review
Authors:
Anderson Yoshiaki Iwazaki,
Vinicius dos Santos,
Katia Romero Felizardo,
/'Erica Ferreira de Souza,
Natasha M. C. Valentim,
Elisa Yumi Nakagawa
Abstract:
Graduate courses can provide specialized knowledge for Ph.D. and Master's students and contribute to develop their hard and soft skills. At the same time, Systematic Literature Review (SLR) has been increasingly adopted in the computing area as a valuable technique to synthesize the state of the art of a given research topic. However, there is still a poor understanding of the real benefits and dr…
▽ More
Graduate courses can provide specialized knowledge for Ph.D. and Master's students and contribute to develop their hard and soft skills. At the same time, Systematic Literature Review (SLR) has been increasingly adopted in the computing area as a valuable technique to synthesize the state of the art of a given research topic. However, there is still a poor understanding of the real benefits and drawbacks of offering the SLR course for graduate students. This paper reports an experience that examines such benefits and drawbacks, the difficulties for professors (i.e., educators), and the essential SLR topics to be taught as well as a way to better teach them. We also surveyed computer science graduate students who attended the SLR course, which we have offered for almost ten years for Ph.D. and Master's students in our institution. We found the attendance to the SLR course is a valuable opportunity for graduate students to conduct the required deep literature review of their research topic, improve their research skills, and increase their formation. Hence, we recommend that Ph.D. and Masters' programs offer the SLR course to contribute to their academic achievement.
△ Less
Submitted 16 May, 2022;
originally announced May 2022.
-
Towards Sustainability of Systematic Literature Reviews
Authors:
Vinicius dos Santos,
Anderson Yoshiaki Iwazaki,
Katia Romero Felizardo,
Érica Ferreira de Souza,
Elisa Yumi Nakagawa
Abstract:
Background: The software engineering community has increasingly conducted systematic literature reviews (SLR) as a means to summarize evidence from different studies and bring to light the state of the art of a given research topic. While SLR provide many benefits, they also present several problems with punctual solutions for some of them. However, two main problems still remain: the high time-/e…
▽ More
Background: The software engineering community has increasingly conducted systematic literature reviews (SLR) as a means to summarize evidence from different studies and bring to light the state of the art of a given research topic. While SLR provide many benefits, they also present several problems with punctual solutions for some of them. However, two main problems still remain: the high time-/effort-consumption nature of SLR and the lack of an effective impact of SLR results in the industry, as initially expected for SLR. Aims: The main goal of this paper is to introduce a new view - which we name Sustainability of SLR - on how to deal with SLR aiming at reducing those problems. Method: We analyzed six reference studies published in the last decade to identify, group, and analyze the SLR problems and their interconnections. Based on such analysis, we proposed the view of Sustainability of SLR that intends to address these problems. Results: The proposed view encompasses three dimensions (social, economic, and technical) that could become SLR more sustainable in the sense that the four major problems and 31 barriers (i.e., possible causes for those problems) that we identified could be mitigated. Conclusions: The view of Sustainability of SLR intends to change the researchers' mindset to mitigate the inherent SLR problems and, as a consequence, achieve sustainable SLR, i.e., those that consume less time/effort to be conducted and updated with useful results for the industry.
△ Less
Submitted 31 August, 2021;
originally announced September 2021.
