Open Access

ARTICLE

Improved Logistic Regression Algorithm Based on Kernel Density Estimation for Multi-Classification with Non-Equilibrium Samples

by Yang Yu¹, Zeyu Xiong¹, Yueshan Xiong¹, Weizi Li²

1 HPCL, School of Computer Science, National University of Defense Technology, Changsha,410073, China.
2 Department of Computer Science, University of North Carolina at Chapel Hill, North Carolina27599, USA.

* Corresponding Author: Zeyu Xiong. Email: .

Computers, Materials & Continua 2019, 61(1), 103-118. https://doi.org/10.32604/cmc.2019.05154

Abstract

Logistic regression is often used to solve linear binary classification problems such as machine vision, speech recognition, and handwriting recognition. However, it usually fails to solve certain nonlinear multi-classification problem, such as problem with non-equilibrium samples. Many scholars have proposed some methods, such as neural network, least square support vector machine, AdaBoost meta-algorithm, etc. These methods essentially belong to machine learning categories. In this work, based on the probability theory and statistical principle, we propose an improved logistic regression algorithm based on kernel density estimation for solving nonlinear multi-classification. We have compared our approach with other methods using non-equilibrium samples, the results show that our approach guarantees sample integrity and achieves superior classification.

---

Keywords

---

Citations