| Detection of potential anxiety in social media based on multimodal fusion with deep learning methods | |
Lai, Shuzhong; Li, ZP(李泽鹏) | |
| 2023 | |
| Source Publication | Proceedings - 2023 2023 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2023 Impact Factor & Quartile Of Published Year The Latest Impact Factor & Quartile |
| Conference Name | 2023 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2023 |
| Conference Date | December 5, 2023 - December 8, 2023 |
| Pages | 560-566 |
| Abstract | The global prevalence of anxiety disorders is the highest among mental disorders in 2020. However, most people still ignore the danger of anxiety disorders and most of the research on mental disorders only focuses on depression patients. Therefore, this paper makes a Multi-Modal-Anxiety(MMA) dataset for anxiety disorder detection based on data from Weibo social media, and proposes a Multimodal-Anxiety-Detection Network(MADNet) which fused three dimensions: textual information, image information and behavior information. The model maps textual features and non-textual features into the same semantic space for fusion via Multimodal-Anxiety-Information fusion method(MAI) to predict the anxiety tendency for a single post. The experimental results show that the model has achieved F1-score 70.96% and AUC-ROC 70.91% on the MMA dataset, which is state-of-the-art among the existing models. This paper also explores and analyses the prediction of the model through interpretable methods to prove the validity of the model. Overall, this paper provides a usable dataset, model baseline, and multimodal fusion methods for further research on anxiety disorder based on social media. The code associated with this paper is available at https://github.com/Shuzhong-Lai/MADNet. © 2023 IEEE. |
| Publisher | Institute of Electrical and Electronics Engineers Inc. |
| DOI | 10.1109/BIBM58861.2023.10385475 |
| Indexed By | EI |
| Language | 英语 |
| Funding Organization | NSF |
| EI Accession Number | 20240715560117 |
| Original Document Type | Conference article (CA) |
| Conference Place | Istanbul, Turkey |
| Citation statistics | |
| Document Type | 会议论文 |
| Identifier | https://ir.lzu.edu.cn/handle/262010/583798 |
| Collection | 信息科学与工程学院 |
| Affiliation | Lanzhou University, School of Information Science and Engineering, Lanzhou, China |
| First Author Affilication | School of Information Science and Engineering |
| First Signature Affilication | School of Information Science and Engineering |
| Recommended Citation GB/T 7714 | Lai, Shuzhong,Li, Zepeng. Detection of potential anxiety in social media based on multimodal fusion with deep learning methods[C],2023:560-566. |
| Files in This Item: | There are no files associated with this item. | ||||
