6-1 面向社交媒体的多模态属性级情感分析.pdf

1、Multimodal Aspect-Based Sentiment Analysis for Social Media Posts虞剑飞 南京理工大学|01Background02Multimodal ABSA 03Our Recent Works04Conclusion目录CONTENT|01Background|Backgroundtext-driven|text-drivenmultimodal-drivenBackground|BackgroundImage credit(https:/ of Twitter in 2015TNW(https:/ contain more than o

2、ne image|BackgroundText Social Media Analytics-Multimodal Social Media AnalyticsSentiment AnalysisTextual InputOutputW/O ImageSentiment:Neutral|BackgroundText Social Media Analytics-Multimodal Social Media AnalyticsSentiment AnalysisTextual InputImageOutputWith ImageSentiment:PositiveYou,Q.,Luo,J.,J

3、in,H.,&Yang,J.Joint Visual-Textual Sentiment Analysis with Deep Neural Networks.In ACM MM,2015|BackgroundText Social Media Analytics-Multimodal Social Media AnalyticsFake News DetectionTextual InputOutputW/O ImageFake News VS Real NewsPhoto:Lenticular clouds over Mount Fuji,Japan.#amazing#earth#clou

4、ds#mountainsWang,Y.,Ma,F.,Jin,Z.,Yuan,Y.,Xun,G.,Jha,K.,&Gao,J.EANN:Event adversarial neural networks for multi-modal fake news detection.In KDD 2018.|BackgroundText Social Media Analytics-Multimodal Social Media AnalyticsFake News DetectionImageTextual InputOutputPhoto:Lenticular clouds over Mount F

5、uji,Japan.#amazing#earth#clouds#mountainsWith ImageFake NewsFake|BackgroundText Social Media Analytics-Multimodal Social Media AnalyticsSarcasm DetectionTextual InputOutputW/O ImageSarcasm?What a wonderful weather!|BackgroundText Social Media Analytics-Multimodal Social Media AnalyticsSarcasm Detect

6、ionWhat a wonderful weather!With ImageSarcasmRainingImageTextual InputOutput|02Multimodal ABSA(MABSA)Subtask 1:Multimodal Aspect Term Extraction/Named Entity RecognitionSubtask 2:Multimodal Aspect-Based Sentiment ClassificationSubtask 3:Joint Multimodal Aspect-Sentiment Analysis|MABSAMultimodal Aspe