New Paper


Journal Articles


tpami_2021

Affective Image Content Analysis: Two Decades Review and New Perspectives

Sicheng Zhao, Xingxu Yao, Jufeng Yang, Guoli Jia, Guiguang Ding, Tat-Seng Chua, Bjorn W. Schuller, Kurt Keutzer IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021[accepted].

Wang_2021_MM

Multimodal Event-Aware Network for Sentiment Analysis in Tourism

Lijuan Wang, Wenya Guo, Xingxu Yao, Yuxiang Zhang, Jufeng Yang
IEEE MultiMedia( (MM), 2021 [accepted].

TMM_2021

LD-MAN: Layout-Driven Multimodal Attention Network for Online News Sentiment Recognition

Wenya Guo, Ying Zhang, Xiangrui Cai, Lei Meng, Jufeng Yang, Xiaojie Yuan IEEE Transactions on Multimedia (TMM), 2021[accepted].

SPM_2021

Emotion Recognition From Multiple Modalities: Fundamentals and methodologies

Sicheng Zhao, Guoli Jia, Jufeng Yang, Guiguang Ding, Kurt Keutzer
IEEE Signal Processing Magazine (SPM), 2021[accepted].

Yao_2021_TMM

APSE: Attention-aware polarity-sensitive embedding for emotion-based image retrieval

Xingxu Yao, Sicheng Zhao, Yu-Kun Lai, Dongyu She, Jie Liang, Jufeng Yang
IEEE Transcation on Multimedia (TMM), 2020[accepted].

Yao_2021_TMM

Adaptive Deep Metric Learning for Affective Image Retrieval and Classification

Xingxu Yao, Dongyu She, Haiwei Zhang, Jufeng Yang, Ming-Ming Cheng and Liang Wang
IEEE Transcation on Multimedia (TMM), 2020[accepted].

She_2019_TMM

WSCNet: Weakly Supervised Coupled Networks for Visual Sentiment Classification and Detection

Dongyu She, Jufeng Yang, Ming-Ming Cheng, Yu-Kun Lai, Paul L. Rosin and Liang Wang
IEEE Transcation on Multimedia (TMM), 2019[accepted].

She_2019_TMM

Learning Discriminative Sentiment Representation from Strongly- and Weakly-Supervised CNNs

Dongyu She, Ming Sun, Jufeng Yang
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) (TOMM), 2019[accepted].

She_2018_TMM

Visual Sentiment Prediction Based on Automatic Discovery of Affective Regions

Jufeng Yang, Dongyu She, Ming Sun, Ming-Ming Cheng, Paul L. Rosin, and Liang Wang
IEEE Transcation on Multimedia (TMM), 2018[accepted].


Conference Proceedings


Yao_2020_MM

Emotion-Based End-to-End Matching Between Image and Music in Valence-Arousal Space

Sicheng Zhao, Yaxian Li, Xingxu Yao, Weizhi Nie, Pengfei Xu, Jufeng Yang, Kurt Keutzer
ACM International Conference on Multimedia( (ACM MM), 2020[accepted].

Zhao_2020_AAAI

An End-to-End Visual-Audio Attention Networt=k for Emotion Recognition in User-Generated Videos

Sicheng Zhao, Yunsheng Ma, Yang Gu, Jufeng Yang, Tengfei Xing, Pengfei Xu, Runbo Hu, Hua Chai, Kurt Keutzer
AAAI Conference on Artificial Intelligence( (AAAI), 2020[accepted].

Yao_2019_ICCV

Attention-Aware Polarity Sensitive Embedding for Affective Image Retrieval

Xingxu Yao, Dongyu She, Sicheng Zhao, Jie Liang, Yu-Kun Lai, Jufeng Yang
IEEE International Conference on Computer Vision( (ICCV), 2019[accepted].

Zhan_2019_ICCV

Zero-Shot Emotion Recognition via Affective Structural Embedding

Chi Zhan, Dongyu She, Sicheng Zhao, Ming-Ming Cheng, Jufeng Yang
IEEE International Conference on Computer Vision( (ICCV), 2019[accepted].

Yang_2018_AAAI

Weakly Supervised Coupled Networks for Visual Sentiment Analysis

Jufeng Yang, Dongyu She, Yu-Kun Lai, Paul L. Rosin, Ming-Hsuan Yang
Internaltional Conference on Computer Vision and Pattern Recogintion (CVPR), Salt Lake City, Utah, USA, June. 2018.

Yang_2018_AAAI

Retrieving and Classifying Affective Images via Deep Metric Learning

Jufeng Yang, Dongyu She, Yu-Kun Lai, Ming-Hsuan Yang
AAAI Conference on Artificial Intelligence (AAAI), New Orleans, Louisiana, USA, Feb. 2018.

Sun_2018_AAAI

Understanding Image Impressiveness Inspired by Instantaneous Human Perceptual Cues

Jufeng Yang, Yan Sun, Jie Liang, Yong-Liang Yang, Ming-Ming Cheng
AAAI Conference on Artificial Intelligence (AAAI), New Orleans, Louisiana, USA, Feb. 2018.

Yao_2018_IJCAI

Text Emotion Distribution Learning via Multi-Task Convolutional Neural Network

Yuxiang Zhang, Jiamei Fu, Dongyu She, Ying Zhang, Senzhang Wang, and Jufeng Yang
International Joint Conference on Artificial Intelligence (IJCAI), 2018[accepted].

Fu_2018_PRICAI

Deep Coordinated Textual and Visual Network for Sentiment-Oriented Cross-Modal Retrieval

Jiamei Fu, Dongyu She, Xingxu Yao, Yuxiang Zhang, and Jufeng Yang
Pacific Rim International Conferences on Artificial Intelligence (PRICAI), 2018[accepted].

She_2017_IJCAI

Joint Image Emotion Classification and Distribution Learning via Deep Convolutional Neural Network

Jufeng Yang, Dongyu She, Ming Sun
International Joint Conference on Artificial Intelligence (IJCAI), 2017[accepted].

Sun_2017_AAAI

Learning Visual Sentiment Distributions via Augmented Conditional Probability Neural Network

Jufeng Yang, Ming Sun, Xiaoxiao Sun
Internaltional Conference on Computer Vision and Pattern Recogintion (AAAI), San Francisco, California, USA, Feb. 2017.

Sun_2016_ICME

Discovering Affctive Regions In Deep Convolutional Neural Networks For Visual Sentiment Prediction

Ming Sun, Jufeng Yang, Kai Wang, Hui Shen
International Conference on Multimedia and Expositions (ICME), 2016[accepted].

Datasets

All Demos

Card image cap
Image Sentiment

Demo for Image Sentiment Recognization.

Try it out
Card image cap
Facial Expression

Demo for Facial Emotion Recognization.

Try it out