Actas de congresos
Ga-based Selection Of Components For Heterogeneous Ensembles Of Support Vector Machines
Registro en:
2003 Congress On Evolutionary Computation, Cec 2003 - Proceedings. Ieee Computer Society, v. 3, n. , p. 2238 - 2245, 2003.
10.1109/CEC.2003.1299950
2-s2.0-84856720362
Autor
Coelho A.L.V.
Lima C.A.M.
Von Zuben F.J.
Institución
Resumen
Several support vector machine (SVM) instances with distinct kernel functions may be separately created and properly combined into the same learning machine structure. This is the idea underlying heterogeneous ensembles of SVMs (HE-SVMs), an approach conceived to alleviate the performance bottlenecks incurred with the kernel function choice problem inherent in SVM design. In this paper, we assess the effectiveness of applying an evolutionary based mechanism (GASe1) in the search of the optimal subset of SVM models for automatic HE-SVM construction. GASe1 has the advantage of merging both the selection and combination of component SVMs into the same optimization process, and has shown sound performance when compared with two other component selection methods in complicated classification problems. © 2003 IEEE. 3
2238 2245 Alon, U., Barkai, N., Notterman, D.A., Gish, K., Ybarra, S., Mack, D., Levine, A.J., Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon cancer tissues probed by oligonucleotide arrays (1999) Proc. Natl. Acad. Sci. USA, 96 (12), pp. 6745-6750 Back, T., Fogel, D.B., Michalewicz, Z., (1997) Handbook of Evolutionary Computation, , editors. Institute of Physics Publishing and Oxford University Press Blake, C.L., Merz, C.J., (1998) The UC1 Repository of Machine Learning, , http://ics.uci.edu/mlearn/MLRepository.html Cover, T., Geometrical and statistical properties of systems of linear inequalities with applications in pattern recognition (1965) IEEE Transactions on Electronic Computers, 14, pp. 326-334 Cristianini, N., Shawe-Taylor, J., (2000) An Introduction to Support Vector Machines, , Cambridge Press Fogel, D., Wasson III, E., Boughton, E., Evolving neural networks for detecting breast cancer (1995) Cancer Letters, 96, pp. 49-53 Guyon, I., Weston, J., Barnhill, S., Vapnik, V., Gene selection for cancer classification using support vector machines (2002) Machine Learning, 46 (1-3), pp. 389-422 Hansen, L.K., Salamon, P., Neural network ensembles (1990) IEEE Transactions on Pattern Analysis and Machine Intelligence, 12 (10), pp. 993-1001 Kearns, M., Mansour, Y., Ng, A., Ron, D., An experimental and theoretical comparison of model selection methods (1997) Machine Learning, 27 (1), pp. 7-50 Kim, H.-C., Pang, S., Je, H.-M., Kim, D., Bang, S.-Y., Support vector machine ensemble with bagging (2002) Procs. of SVM 2002, pp. 397-408. , volume 2388 of LNCS, Springer Lee, S.-I., Ahn, J.-H., Cho, S.-B., Exploiting diversity of neural ensembles with speciated evolution (2001) Procs. of UCNN'01, pp. 808-813. , Washington, D.C., IEEE Press Lima, C.A.M., Coelho, A.L.V., Von Zuben, F.J., Ensembles of support vector machines for regression problems (2002) Procs. of IJCNN'02, pp. 2381-2386. , Hawaii, IEEE Press Lima, C.A.M., Coelho, A.L.V., Von Zuben, F.J., Model selection based on VC-dimension for heterogeneous ensembles of support vector machines (2002) Procs. of RASC'02, pp. 459-464. , A. Lotfi, J. Garibaldi, and R. John, editors, Nottingham, December, The Nottingham Trent University Perrone, M.P., Cooper, L.N., When networks disagree: Ensemble method for neural networks (1993) Neural Networks for Speech and Image Processing, pp. 126-142. , R. J. Mammone, editor, Chapman- Hall Ruta, D., Gabrys, B., Application of the evolutionary algorithms for classifier selection in multiple classifier systems with majority voting (2001) Procs. of MCS 2001, pp. 399-408. , volume 2096 of LNCS, Springer Valentini, G., Dietterich, T., Bias-variance analysis and ensembles of svm (2002) Procs. of MCS 2002, pp. 222-231. , volume 2364, Springer Vapnik, V.N., (1998) Statistical Learning Theory, , John Wiley Zhou, Z.-H., Wu, J.-X., Jiang, Y., Chen, S.-F., Genetic algorithm based selective neural network ensemble (2001) Procs. of JCAI 2001, 2, pp. 797-802. , Seattle, AAAI Press Zhou, Z.-H., Wu, J.-X., Tang, W., Chen, Z.-Q., Selectively ensembling neural classifiers (2002) Procs. of IJCNN 2002, 2, pp. 1411-1415. , Hawaii, IEEE Press