Open Access

ARTICLE

A Discovery Method for New Words From Mobile Product Comments

by Hai Yang Zhu, Xiaobo Yin, Shunxiang Zhang, Zhongliang Wei, Guangli Zhu, Meng-Yen Hsieh

1 School of Computer Science and Engineering, Anhui University of Science & Technology, Huainan, China
2 Department of Computer Science and Information Engineering, Providence University, Taichung 43301, Taiwan
† 838412840@qq.com(H.Z.)
‡ xbyin@aust.edu.cn(XY.)
§ sxzhang@aust.edu.cn(S.Z.)
¶ zhlwei@aust.edu.cn(Z.W.)
II glzhu@aust.edu.cn(G.Z.)
∗∗ mengyen@pu.edu.tw(M.H.)

* Corresponding Authors: ; ; ; Tel.: +88-642-6328-001(M.H.).

Computer Systems Science and Engineering 2020, 35(6), 399-410. https://doi.org/10.32604/csse.2020.35.399

Abstract

A large number of new words in product reviews generated by mobile terminals are valuable indicators of the privacy preferences of customers. By clustering these privacy preferences, sufficient information can be collected to characterize users and provide a data basis for the research issues of privacy protection. The widespread use of mobile clients shortens the string length of the comment corpus generated by product reviews, resulting in a high repetition rate. Therefore, the effective and accurate recognition of new words is a problem that requires an urgent solution. Hence, in this paper, we propose a method for discovering new words from product comments based on Mutual Information and improved Branch Entropy. Firstly, by calculating the Co-occurrence Frequency and Mutual Information between words and adjacent words, the character strings of words after pre-processing and word segmentation are expanded left and right respectively to discover the potential word set. The candidate set of new words is obtained by means of an improved support filtering algorithm. Finally, a new word set is built by applying an improved Branch Entropy filtering algorithm and removing old words. The experimental results show that this method can accurately and effectively identify new words in product comments.

---

Keywords

---

Citations