Vol.69, No.2, 2021, pp.1765-1781, doi:10.32604/cmc.2021.017516
OPEN ACCESS
ARTICLE
Outlier Detection of Mixed Data Based on Neighborhood Combinatorial Entropy
  • Lina Wang1,2,*, Qixiang Zhang1, Xiling Niu1, Yongjun Ren3, Jinyue Xia4
1 School of Artificial Intelligence, Nanjing University of Information Science and Technology, Nanjing, 210044, China
2 Southern Marine Science and Engineering Guangdong Laboratory (Zhuhai), Zhuhai, 519080, China
3 School of Computer and Software, Nanjing University of Information Science and Technology, Nanjing, 210044, China
4 International Business Machines Corporation (IBM), New York, 10504, USA
* Corresponding Author: Lina Wang. Email:
Received 02 February 2021; Accepted 10 April 2021; Issue published 21 July 2021
Abstract
Outlier detection is a key research area in data mining technologies, as outlier detection can identify data inconsistent within a data set. Outlier detection aims to find an abnormal data size from a large data size and has been applied in many fields including fraud detection, network intrusion detection, disaster prediction, medical diagnosis, public security, and image processing. While outlier detection has been widely applied in real systems, its effectiveness is challenged by higher dimensions and redundant data attributes, leading to detection errors and complicated calculations. The prevalence of mixed data is a current issue for outlier detection algorithms. An outlier detection method of mixed data based on neighborhood combinatorial entropy is studied to improve outlier detection performance by reducing data dimension using an attribute reduction algorithm. The significance of attributes is determined, and fewer influencing attributes are removed based on neighborhood combinatorial entropy. Outlier detection is conducted using the algorithm of local outlier factor. The proposed outlier detection method can be applied effectively in numerical and mixed multidimensional data using neighborhood combinatorial entropy. In the experimental part of this paper, we give a comparison on outlier detection before and after attribute reduction. In a comparative analysis, we give results of the enhanced outlier detection accuracy by removing the fewer influencing attributes in numerical and mixed multidimensional data.
Keywords
Neighborhood combinatorial entropy; attribute reduction; mixed data; outlier detection
Cite This Article
Wang, L., Zhang, Q., Niu, X., Ren, Y., Xia, J. (2021). Outlier Detection of Mixed Data Based on Neighborhood Combinatorial Entropy. CMC-Computers, Materials & Continua, 69(2), 1765–1781.
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.