兰州大学机构库
A self-supervised anomaly detection algorithm with interpretability
Wu, Zhichao1; Yang, Xin1; Wei, Xiaopeng1; Yuan, Peijun2; Zhang, Yuanping3; Bai, Jianming4,5
2024-03-01
Online publication date2023-09
Source PublicationEXPERT SYSTEMS WITH APPLICATIONS   Impact Factor & Quartile
ISSN0957-4174
EISSN1873-6793
Volume237
page numbers12
Abstract

Identifying the abnormal samples from a data set and determining their type are two key tasks of anomaly detection. However, the existing anomaly detection algorithms are generally faced with the defects of weak generalization ability and insufficient interpretation, the core reason of which is that they cannot mine specific features for different abnormal types. In this paper, a new anomaly detection algorithm aiming at feature selection for different abnormal types is developed. Inspired by self-supervised learning, we take the stationarity of variance changes of abnormal score similarity as a pretext task and combine it with wrapped search method. Then, the features and the corresponding parameters for different abnormal types can be screened to apply to the downstream task of anomaly integration detection. To verify the efficiency of the new algorithm, we conduct two sets of experiments to compare the new algorithm with 11 classical anomaly detection and 3 clustering anomaly detection algorithms on the data sets WDBC, WPBC and Wilt from DAMI database with the evaluation measures P@n, Adj-P@n, AP, Adj-AP and AUC. The experiment results show that, both in the identification and classification on abnormal samples, all performance measures of the new algorithm are explicitly better than that of the contrastive algorithms. Also, we apply the new algorithm to the Chinese auto insurance market, and find that the results can help managers to identify the main patterns of fraudulent claims and to summarize the feature combinations of fraud behaviors. In general, the new algorithm developed in this paper has the following advantages compared with traditional algorithms: 1) It can directly capture abnormal features and realize effective recognition of abnormal types, which effectively bridge the gap between abnormal judgement and feature screening. 2) Automatic screening of abnormal features can be completed under the condition of self-updating learning optimal strategy. 3) Only a few features are extracted from all features to reveal the abnormal characteristics, which significantly improves the interpretability and generalization ability of the algorithm and its results. In a word, through the novel self-supervised design method, feature screening is skillfully integrated into the anomaly detection task, which may provide a new way for anomaly detection research.

KeywordAnomaly Detection Self-supervised Learning Wrapped Feature Selection Lof Interpretability
PublisherPERGAMON-ELSEVIER SCIENCE LTD
DOI10.1016/j.eswa.2023.121539
Indexed BySCIE
Language英语
WOS Research AreaComputer Science ; Engineering ; Operations Research & Management Science
WOS SubjectComputer Science, Artificial Intelligence ; Engineering, Electrical & Electronic ; Operations Research & Management Science
WOS IDWOS:001079441900001
Original Document TypeArticle
Citation statistics
Document Type期刊论文
Identifierhttps://ir.lzu.edu.cn/handle/262010/568817
Collection兰州大学
Corresponding AuthorBai, Jianming
Affiliation
1.Dalian Univ Technol, Sch Comp Sci & Technol, Dalian, Peoples R China;
2.Dalian New Oriental Sch, Dalian, Peoples R China;
3.Shanghai Dophy Informat & Technol Co Ltd, Shanghai, Peoples R China;
4.Lanzhou Univ, Sch Management, Lanzhou, Peoples R China;
5.Lanzhou Univ, Ctr Data Sci, Lanzhou, Peoples R China
Recommended Citation
GB/T 7714
Wu, Zhichao,Yang, Xin,Wei, Xiaopeng,et al. A self-supervised anomaly detection algorithm with interpretability[J]. EXPERT SYSTEMS WITH APPLICATIONS,2024,237.
APA Wu, Zhichao,Yang, Xin,Wei, Xiaopeng,Yuan, Peijun,Zhang, Yuanping,&Bai, Jianming.(2024).A self-supervised anomaly detection algorithm with interpretability.EXPERT SYSTEMS WITH APPLICATIONS,237.
MLA Wu, Zhichao,et al."A self-supervised anomaly detection algorithm with interpretability".EXPERT SYSTEMS WITH APPLICATIONS 237(2024).
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Altmetrics Score
Google Scholar
Similar articles in Google Scholar
[Wu, Zhichao]'s Articles
[Yang, Xin]'s Articles
[Wei, Xiaopeng]'s Articles
Baidu academic
Similar articles in Baidu academic
[Wu, Zhichao]'s Articles
[Yang, Xin]'s Articles
[Wei, Xiaopeng]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Wu, Zhichao]'s Articles
[Yang, Xin]'s Articles
[Wei, Xiaopeng]'s Articles
Terms of Use
No data!
Social Bookmark/Share
No comment.
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.