KMS Of Academy of mathematics and systems sciences, CAS
| Text classification based on multi-word with support vector machine | |
| Zhang, Wen1; Yoshida, Taketoshi1; Tang, Xijin2 | |
| 2008-12-01 | |
| Source Publication | KNOWLEDGE-BASED SYSTEMS
 |
| ISSN | 0950-7051 |
| Volume | 21Issue:8Pages:879-886 |
| Abstract | One of the main themes which support text mining is text representation: that is, its task is to look for appropriate terms to transfer documents into numerical vectors. Recently, many efforts have been invested on this topic to enrich text representation using vector space model (VSM) to improve the performances of text mining techniques such as text classification and text clustering. The main concern in this paper is to investigate the effectiveness of using multi-words for text representation on the performances of text classification. Firstly, a practical method is proposed to implement the multi-word extraction from documents based on the syntactical structure. Secondly, two strategies as general concept representation and subtopic representation are presented to represent the documents using the extracted multi-words. In particular, the dynamic k-mismatch is proposed to determine the presence of a long multi-word which is a subtopic of the content of a document. Finally, we carried out a series of experiments on classifying the Reuters-21578 documents using the representations with multi-words. We used the performance of representation in individual words as the baseline, which has the largest dimension of feature set for representation without linguistic preprocessing. Moreover, linear kernel and non-linear polynomial kernel in support vector machines (SVM) are examined comparatively for classification to investigate the effect of kernel type on their performances. Index terms with low information gain (IG) are removed from the feature set at different percentages to observe the robustness of each classification method. Our experiments demonstrate that in multi-word representation, subtopic representation outperforms the general concept representation and the linear kernel outperforms the non-linear kernel of SVM in classifying the Reuters data. The effect of applying different representation strategies is greater than the effect of applying the different SVM kernels on classification performance. Furthermore, the representation using individual words outperforms any representation using multi-words. This is consistent with the major opinions concerning the role of linguistic preprocessing on documents' features when using SVM for text classification. (C) 2008 Elsevier B.V. All rights reserved. |
| Keyword | Text classification Multi-word Feature selection Information gain Support vector machine |
| DOI | 10.1016/j.knosys.2008.03.044 |
| Language | 英语 |
| Funding Project | Ministry of Education, Culture. Sports, Science and Technology of Japan ; National Natural Science Foundation of China[70571078] ; National Natural Science Foundation of China[70221001] |
| WOS Research Area | Computer Science |
| WOS Subject | Computer Science, Artificial Intelligence |
| WOS ID | WOS:000261736300017 |
| Publisher | ELSEVIER SCIENCE BV |
| Citation statistics | |
| Document Type | 期刊论文 |
| Identifier | http://ir.amss.ac.cn/handle/2S8OKBNM/6219 |
| Collection | 中国科学院数学与系统科学研究院 |
| Corresponding Author | Zhang, Wen |
| Affiliation | 1.Japan Adv Inst Sci & Technol, Sch Knowledge Sci, Tatsunokuchi, Ishikawa 9231292, Japan 2.Chinese Acad Sci, Inst Syst Sci, Acad Math & Syst Sci, Beijing 100190, Peoples R China |
| Recommended Citation GB/T 7714 | Zhang, Wen,Yoshida, Taketoshi,Tang, Xijin. Text classification based on multi-word with support vector machine[J]. KNOWLEDGE-BASED SYSTEMS,2008,21(8):879-886. |
| APA | Zhang, Wen,Yoshida, Taketoshi,&Tang, Xijin.(2008).Text classification based on multi-word with support vector machine.KNOWLEDGE-BASED SYSTEMS,21(8),879-886. |
| MLA | Zhang, Wen,et al."Text classification based on multi-word with support vector machine".KNOWLEDGE-BASED SYSTEMS 21.8(2008):879-886. |
| Files in This Item: | There are no files associated with this item. | |||||
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment