基于特征多视图提升Naive Bayesian的Boosting改进算法 |
| |
引用本文: | 林正奎,;唐焕玲,;鲁明羽,;王敬东. 基于特征多视图提升Naive Bayesian的Boosting改进算法[J]. 北方交通大学学报, 2009, 0(6): 70-75 |
| |
作者姓名: | 林正奎, 唐焕玲, 鲁明羽, 王敬东 |
| |
作者单位: | [1]大连海事大学信息科学技术学院,辽宁大连116026; [2]中国工商银行股份有限公司烟台分行,山东烟台 264000 |
| |
基金项目: | 国家自然科学基金资助项目(60773084,J0724003,60603023);高等学校博士学科点专项科研基金项目资助(20070151009) |
| |
摘 要: | AdaBoost作为一种有效的集成学习方法,能够明显提高不稳定学习算法的分类正确率,但对稳定的Naive Bayesian分类算法的提升效果却不明显.为此,利用多种特征评估函数建立不同的特征视图,生成多个有差畀的加权朴素贝叶斯(WNB)基分类器;尝试使用几种不同的方式将样本权重嵌入WNB基分类器的参数中,对WNB产生扰动,进一步增加基分类器的不稳定性.实验结果表明.对比AdaBoost所提算法.BoostMV-WNB能够明显提升WNB文本分类器的性能.
|
关 键 词: | AdaBoost 加权朴素贝叶斯 文本分类 特征多视图 样本权重 |
An Improved Boosting Algorithm with Naive Bayesian Classification Based on Multi-Views |
| |
Affiliation: | LIN Zhengkui, TANG Huanling, LU Mingyu, WANG Jingtong (1. School of Information Science & Technology, Dalian Maritime University, Dalian Liaoning 116026, China; 2. Industrial & Commercial Bank of China Ltd. Yantai Branch, Yantai Shandong 264000, China) |
| |
Abstract: | AdaBoost, as an effective ensemble learning method, can improve the performance of unstable learning algorithms, yet works poorly with Naive Bayesian classifier due to its relative stability. So, a revised AdaBoost algorithm with weighted Naive Bayesian (WNB) classifier named Boost MV- WNB was proposed. Firstly, at boosting iterations, multi-views are constructed on the same training set in terms of different terms evaluation functions. Then diverse WNB classifiers are generated by using multiple views. Moreover, the weights of training examples are introduced to the parameters of WNB classifier utilizing a certain function. In this way, the base WNB classifiers become more unstable due to the perturbation. Experimental comparison shows that the BoostMV-WNB algorithm performs better than AdaBoost with WNB text categorization. |
| |
Keywords: | AdaBoost weighted Naive Bayesian classifier text categorization multiple views exampies' weight |
本文献已被 维普 等数据库收录! |
|