自然科学版
陕西师范大学学报(自然科学版)
数据挖掘专题
一种基于Newton-Armijo优化的多项式光滑孪生支持向量机
PDF下载 ()
韦修喜1,黄华娟1,2*
(1 广西民族大学 人工智能学院,广西 南宁 530006;2 广西民族大学 网络通信工程重点实验室,广西 南宁 530006)
黄华娟,女,副教授,博士,主要从事机器学习和数据挖掘的研究工作。E-mail:hhj@gxun.edu.cn
摘要:
针对光滑孪生支持向量机 (smooth twin support vector machines, STWSVM) 采用的Sigmoid光滑函数逼近精度低的问题,提出一种基于Newton-Armijo优化的多项式光滑孪生支持向量机(polynomial smooth twin support vector machines based on Newton-Armijo optimization, PSTWSVM-NA)。在PSTWSVM-NA中,引入正号函数,将孪生支持向量机的两个二次规划问题转化为两个不可微的无约束优化问题。随后,引入一族多项式光滑函数对不可微的无约束优化问题进行光滑逼近,并用收敛速度快的Newton-Armijo方法求解新模型。从理论上证明了PSTWSVM-NA模型具有任意阶光滑性,在人工数据和UCI数据集上的实验结果表明该算法具有较高的分类精度和较快的训练效率。
关键词:
孪生支持向量机;多项式;光滑;Newton-Armijo法
收稿日期:
2020-09-10
中图分类号:
TP18
文献标识码:
A
文章编号:
1672-4291(2021)01-0044-08
基金项目:
国家自然科学基金(61662005); 广西自然科学基金(2018GXNSFAA294068); 广西高校中青年教师科研基础能力提升项目(2019KY0195)
Doi:
A polynomial smooth twin support vector machines based on Newton-Armijo optimization
WEI Xiuxi1 , HUANG Huajuan1,2*
(1 College of Artificial Intelligence, Guangxi University for Nationalities, Nanning 530006, Guangxi, China;2 Key Laboratory of Network Communication Engineering, Guangxi University for Nationalities, Nanning 530006, Guangxi, China)
Abstract:
In order to solve the problem of low approximation accuracy of sigmoid smooth function adopted by smooth twin support vector machines (STWSVM), a polynomial smooth twin support vector machines based on Newton-Armijo optimization (PSTWSVM-NA) is proposed. In PSTWSVM-NA, the positive sign function is introduced to transform two quadratic programming problems of TWSVM into two non-differentiable unconstrained optimization problems. Then, a family of polynomial smooth functions are introduced to smooth the non-differentiable unconstrained optimization problem, and Newton Armijo method with fast convergence speed is used to solve the new model. It is proved theoretically that the PSTWSVM-NA model has any order smoothness. Experimental results on artificial data and UCI data sets show that the algorithm has higher classification accuracy and faster training efficiency.
KeyWords:
twin support vector machines; polynomial; smooth; Newton-Armijo method