Text classification based on multi-word with support vector machine
Zhang, Wen1; Yoshida, Taketoshi1; Tang, Xijin2
AbstractOne of the main themes which support text mining is text representation: that is, its task is to look for appropriate terms to transfer documents into numerical vectors. Recently, many efforts have been invested on this topic to enrich text representation using vector space model (VSM) to improve the performances of text mining techniques such as text classification and text clustering. The main concern in this paper is to investigate the effectiveness of using multi-words for text representation on the performances of text classification. Firstly, a practical method is proposed to implement the multi-word extraction from documents based on the syntactical structure. Secondly, two strategies as general concept representation and subtopic representation are presented to represent the documents using the extracted multi-words. In particular, the dynamic k-mismatch is proposed to determine the presence of a long multi-word which is a subtopic of the content of a document. Finally, we carried out a series of experiments on classifying the Reuters-21578 documents using the representations with multi-words. We used the performance of representation in individual words as the baseline, which has the largest dimension of feature set for representation without linguistic preprocessing. Moreover, linear kernel and non-linear polynomial kernel in support vector machines (SVM) are examined comparatively for classification to investigate the effect of kernel type on their performances. Index terms with low information gain (IG) are removed from the feature set at different percentages to observe the robustness of each classification method. Our experiments demonstrate that in multi-word representation, subtopic representation outperforms the general concept representation and the linear kernel outperforms the non-linear kernel of SVM in classifying the Reuters data. The effect of applying different representation strategies is greater than the effect of applying the different SVM kernels on classification performance. Furthermore, the representation using individual words outperforms any representation using multi-words. This is consistent with the major opinions concerning the role of linguistic preprocessing on documents' features when using SVM for text classification. (C) 2008 Elsevier B.V. All rights reserved.
KeywordText classification Multi-word Feature selection Information gain Support vector machine
Funding ProjectMinistry of Education, Culture. Sports, Science and Technology of Japan ; National Natural Science Foundation of China[70571078] ; National Natural Science Foundation of China[70221001]
WOS Research AreaComputer Science
WOS SubjectComputer Science, Artificial Intelligence
WOS IDWOS:000261736300017
Citation statistics
Document Type期刊论文
Corresponding AuthorZhang, Wen
Affiliation1.Japan Adv Inst Sci & Technol, Sch Knowledge Sci, Tatsunokuchi, Ishikawa 9231292, Japan
2.Chinese Acad Sci, Inst Syst Sci, Acad Math & Syst Sci, Beijing 100190, Peoples R China
Recommended Citation
GB/T 7714
Zhang, Wen,Yoshida, Taketoshi,Tang, Xijin. Text classification based on multi-word with support vector machine[J]. KNOWLEDGE-BASED SYSTEMS,2008,21(8):879-886.
APA Zhang, Wen,Yoshida, Taketoshi,&Tang, Xijin.(2008).Text classification based on multi-word with support vector machine.KNOWLEDGE-BASED SYSTEMS,21(8),879-886.
MLA Zhang, Wen,et al."Text classification based on multi-word with support vector machine".KNOWLEDGE-BASED SYSTEMS 21.8(2008):879-886.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zhang, Wen]'s Articles
[Yoshida, Taketoshi]'s Articles
[Tang, Xijin]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zhang, Wen]'s Articles
[Yoshida, Taketoshi]'s Articles
[Tang, Xijin]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zhang, Wen]'s Articles
[Yoshida, Taketoshi]'s Articles
[Tang, Xijin]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.