Text classification based on multi-word with support vector machine

doi:10.1016/j.knosys.2008.03.044

CSpace

	Text classification based on multi-word with support vector machine
	Zhang, Wen 1; Yoshida, Taketoshi 1; Tang, Xijin 2
	2008-12-01
发表期刊	KNOWLEDGE-BASED SYSTEMS
ISSN	0950-7051
卷号	21 期号:8 页码:879-886
摘要	One of the main themes which support text mining is text representation: that is, its task is to look for appropriate terms to transfer documents into numerical vectors. Recently, many efforts have been invested on this topic to enrich text representation using vector space model (VSM) to improve the performances of text mining techniques such as text classification and text clustering. The main concern in this paper is to investigate the effectiveness of using multi-words for text representation on the performances of text classification. Firstly, a practical method is proposed to implement the multi-word extraction from documents based on the syntactical structure. Secondly, two strategies as general concept representation and subtopic representation are presented to represent the documents using the extracted multi-words. In particular, the dynamic k-mismatch is proposed to determine the presence of a long multi-word which is a subtopic of the content of a document. Finally, we carried out a series of experiments on classifying the Reuters-21578 documents using the representations with multi-words. We used the performance of representation in individual words as the baseline, which has the largest dimension of feature set for representation without linguistic preprocessing. Moreover, linear kernel and non-linear polynomial kernel in support vector machines (SVM) are examined comparatively for classification to investigate the effect of kernel type on their performances. Index terms with low information gain (IG) are removed from the feature set at different percentages to observe the robustness of each classification method. Our experiments demonstrate that in multi-word representation, subtopic representation outperforms the general concept representation and the linear kernel outperforms the non-linear kernel of SVM in classifying the Reuters data. The effect of applying different representation strategies is greater than the effect of applying the different SVM kernels on classification performance. Furthermore, the representation using individual words outperforms any representation using multi-words. This is consistent with the major opinions concerning the role of linguistic preprocessing on documents' features when using SVM for text classification. (C) 2008 Elsevier B.V. All rights reserved.
关键词	Text classification Multi-word Feature selection Information gain Support vector machine
DOI	10.1016/j.knosys.2008.03.044
语种	英语
资助项目	Ministry of Education, Culture. Sports, Science and Technology of Japan ; National Natural Science Foundation of China[70571078] ; National Natural Science Foundation of China[70221001]
WOS研究方向	Computer Science
WOS类目	Computer Science, Artificial Intelligence
WOS记录号	WOS:000261736300017
出版者	ELSEVIER SCIENCE BV
引用统计
文献类型	期刊论文
条目标识符	http://ir.amss.ac.cn/handle/2S8OKBNM/6219
专题	中国科学院数学与系统科学研究院
通讯作者	Zhang, Wen
作者单位	1.Japan Adv Inst Sci & Technol, Sch Knowledge Sci, Tatsunokuchi, Ishikawa 9231292, Japan 2.Chinese Acad Sci, Inst Syst Sci, Acad Math & Syst Sci, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Zhang, Wen,Yoshida, Taketoshi,Tang, Xijin. Text classification based on multi-word with support vector machine[J]. KNOWLEDGE-BASED SYSTEMS,2008,21(8):879-886.
APA	Zhang, Wen,Yoshida, Taketoshi,&Tang, Xijin.(2008).Text classification based on multi-word with support vector machine.KNOWLEDGE-BASED SYSTEMS,21(8),879-886.
MLA	Zhang, Wen,et al."Text classification based on multi-word with support vector machine".KNOWLEDGE-BASED SYSTEMS 21.8(2008):879-886.