Multimedia

Authors and titles for December 2021

[1] arXiv:2112.00331 [pdf, other]

Title: Mutltimodal AI Companion for Interactive Fairytale Co-creation

Ruiyang Liu, Predrag K. Nikolic

Subjects: Multimedia (cs.MM)

[2] arXiv:2112.01131 [pdf, other]

Title: FNR: A Similarity and Transformer-Based Approach to Detect Multi-Modal Fake News in Social Media

Faeze Ghorbanpour, Maryam Ramezani, Mohammad A. Fazli, Hamid R. Rabiee

Comments: 10 pages, 11 figures, 4 tables and 20 references

Subjects: Multimedia (cs.MM); Computers and Society (cs.CY); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

[3] arXiv:2112.01832 [pdf, other]

Title: Lightweight Attentional Feature Fusion: A New Baseline for Text-to-Video Retrieval

Fan Hu, Aozhu Chen, Ziyue Wang, Fangming Zhou, Jianfeng Dong, Xirong Li

Comments: Accepted by ECCV2022

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[4] arXiv:2112.01849 [pdf, other]

Title: Cross-modal Knowledge Distillation for Vision-to-Sensor Action Recognition

Jianyuan Ni, Raunak Sarbajna, Yang Liu, Anne H.H. Ngu, Yan Yan

Comments: 5 pages, 2 figures, submitted to ICASSP2022

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[5] arXiv:2112.02070 [pdf, other]

Title: Malakai: Music That Adapts to the Shape of Emotions

Zack Harris, Liam Atticus Clarke, Pietro Gagliano, Dante Camarena, Manal Siddiqui, Pablo S. Castro

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI)

[6] arXiv:2112.02839 [pdf, other]

Title: MoCA: Incorporating Multi-stage Domain Pretraining and Cross-guided Multimodal Attention for Textbook Question Answering

Fangzhi Xu, Qika Lin, Jun Liu, Lingling Zhang, Tianzhe Zhao, Qi Chai, Yudai Pan

Comments: 9 pages, 6 figures

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI)

[7] arXiv:2112.03727 [pdf, other]

Title: RFGAN: RF-Based Human Synthesis

Cong Yu, Zhi Wu, Dongheng Zhang, Zhi Lu, Yang Hu, Yan Chen

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI)

[8] arXiv:2112.05428 [pdf, other]

Title: Protecting Your NLG Models with Semantic and Robust Watermarks

Tao Xiang, Chunlong Xie, Shangwei Guo, Jiwei Li, Tianwei Zhang

Subjects: Multimedia (cs.MM)

[9] arXiv:2112.08432 [pdf, other]

Title: Expert and Crowd-Guided Affect Annotation and Prediction

Ramanathan Subramanian, Yan Yan, Nicu Sebe

Comments: Manuscript submitted for review to IEEE Transactions on Affective Computing

Subjects: Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[10] arXiv:2112.09401 [pdf, other]

Title: AI-Empowered Persuasive Video Generation: A Survey

Chang Liu, Han Yu

Comments: under review

Subjects: Multimedia (cs.MM)

[11] arXiv:2112.10381 [pdf, other]

Title: Automated Vision-Based Wellness Analysis for Elderly Care Centers

Xijie Huang, Jeffry Wicaksana, Shichao Li, Kwang-Ting Cheng

Comments: To be appeared at AAAI22 health intelligence workshop

Subjects: Multimedia (cs.MM)

[12] arXiv:2112.10603 [pdf, other]

Title: A Multi-user Oriented Live Free-viewpoint Video Streaming System Based On View Interpolation

Jingchuan Hu, Shuai Guo, Kai Zhou, Yu Dong, Jun Xu, Li Song

Comments: 10 pages, 7 figures

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[13] arXiv:2112.12273 [pdf, other]

Title: Perceptual Evaluation of 360 Audiovisual Quality and Machine Learning Predictions

Randy Frans Fela, Nick Zacharov, Søren Forchhammer

Subjects: Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[14] arXiv:2112.12284 [pdf, other]

Title: A Survey on Perceptually Optimized Video Coding

Yun Zhang, Linwei Zhu, Gangyi Jiang, Sam Kwong, C.-C.Jay Kuo

Comments: 36 pages, 12 figures, 6 tables, accepted by ACM Computing Surveys

Subjects: Multimedia (cs.MM); Image and Video Processing (eess.IV)

[15] arXiv:2112.12907 [pdf, other]

Title: 3D Point Cloud Reconstruction and SLAM as an Input

Ziyu Li, Fangyang Ye, Xinran Guan

Comments: 7 pages

Subjects: Multimedia (cs.MM)

[16] arXiv:2112.00317 (cross-list from cs.CV) [pdf, other]

Title: Unleashing the Potential of Unsupervised Pre-Training with Intra-Identity Regularization for Person Re-Identification

Zizheng Yang, Xin Jin, Kecheng Zheng, Feng Zhao

Comments: Technical report, code: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[17] arXiv:2112.00355 (cross-list from cs.SD) [pdf, other]

Title: Score Transformer: Generating Musical Score from Note-level Representation

Masahiro Suzuki

Comments: Accepted at ACM Multimedia Asia 2021 (MMAsia '21); Project page: this https URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[18] arXiv:2112.01085 (cross-list from cs.CV) [pdf, other]

Title: PTCT: Patches with 3D-Temporal Convolutional Transformer Network for Precipitation Nowcasting

Ziao Yang, Xiangrui Yang, Qifeng Lin

Comments: 9 pages, 3 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[19] arXiv:2112.01194 (cross-list from cs.CV) [pdf, other]

Title: Video-Text Pre-training with Learned Regions

Rui Yan, Mike Zheng Shou, Yixiao Ge, Alex Jinpeng Wang, Xudong Lin, Guanyu Cai, Jinhui Tang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[20] arXiv:2112.01839 (cross-list from cs.CV) [pdf, other]

Title: Mind Your Clever Neighbours: Unsupervised Person Re-identification via Adaptive Clustering Relationship Modeling

Lianjie Jia, Chenyang Yu, Xiehao Ye, Tianyu Yan, Yinjie Lei, Pingping Zhang

Comments: The experimental results are not sufficient

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG); Multimedia (cs.MM)

[21] arXiv:2112.02644 (cross-list from cs.CV) [pdf, other]

Title: Boosting Mobile CNN Inference through Semantic Memory

Yun Li, Chen Zhang, Shihao Han, Li Lyna Zhang, Baoqun Yin, Yunxin Liu, Mengwei Xu

Comments: 13 pages, 13 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[22] arXiv:2112.02858 (cross-list from eess.IV) [pdf, other]

Title: A comparison study of CNN denoisers on PRNU extraction

Hui Zeng, Morteza Darvish Morshedi Hosseini, Kang Deng, Anjie Peng, Miroslav Goljan

Comments: 12 pages, 6 figures, 4 tables

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[23] arXiv:2112.03420 (cross-list from cs.HC) [pdf, other]

Title: ORCLSim: A System Architecture for Studying Bicyclist and Pedestrian Physiological Behavior Through Immersive Virtual Environments

Xiang Guo, Austin Angulo, Erin Robartes, T. Donna Chen, Arsalan Heydarian

Comments: 36 pages, 7 figures

Journal-ref: Journal of Advanced Transportation 2022, 2750369

Subjects: Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[24] arXiv:2112.03857 (cross-list from cs.CV) [pdf, other]

Title: Grounded Language-Image Pre-training

Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao

Comments: CVPR 2022; updated visualizations; fixed hyper-parameters in Appendix C.1

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[25] arXiv:2112.04222 (cross-list from cs.CV) [pdf, other]

Title: Classification-Then-Grounding: Reformulating Video Scene Graphs as Temporal Bipartite Graphs

Kaifeng Gao, Long Chen, Yulei Niu, Jian Shao, Jun Xiao

Comments: Accepted by CVPR 2022. Code is available at this https URL. We also won the 1st place of Video Relation Understanding (VRU) Grand Challenge in ACM Multimedia 2021, with a simplified version of our model.(The code for object tracklets generation is available at this https URL)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)