Actas de congresos
Data Partition And Variable Selection For Time Series Prediction Using Wrappers
Registro en:
0780394909; 9780780394902
Ieee International Conference On Neural Networks - Conference Proceedings. , v. , n. , p. 4740 - 4747, 2006.
10987576
2-s2.0-40649114243
Autor
Puma-Villanueva W.J.
Dos Santos E.P.
Von Zuben F.J.
Institución
Resumen
The purpose of this paper is a comparative study of a non-exhaustive, though representative, set of methodologies already available for the partition of the training dataset in time series prediction, and also for variable selection under the wrapper paradigm. The partition policy of the training dataset and the choice of a proper set of variables for the regression vector are known to have a significant influence in the accuracy of the predictor, no matter the choice of the prediction model. However, there has been no extensive search for a figure of merit supporting a comparative analysis. Here, two partition policies, denoted sequential and random, are compared, and among the variable selection approaches using wrappers, forward selection is contrasted with sensitivity based pruning. Five real financial time series with trends and seasonality have been considered and multilayer perceptrons are adopted as the predictor. The obtained results indicate with high confidence that the rarely adopted random partition and the computationally intensive forward selection overcomes the contestants in the whole set of experiments. © 2006 IEEE.
4740 4747 Box, G.E.P., Jenkins, G.M.. Time Series Analysis: Forecasting, and Control. Holden Day. San Francisco. CA. 1976Cherkassky, V., Mulier, F., (1998) Learning from data, concepts, theory and methods, , John Wiley & Sons, New York Conway, A.J., Macpherson, K.P., Brown, J.C., Delayed time series predictions with neural networks (1998) Neurocomputing, 18 (1-3), pp. 81-89 Cover, T.M., Thomas, J.A., (1991) Elements of Information Theory, , Wiley, New York Cybenko, G., Approximation by superpositions of sigmoid function (1989) Mathematics of Control Signals and Systems, 2, pp. 303-314 Bonnlander, B.V., (1996) Nonparametric selection of input variables for connectionist learning, , PhD thesis, University of Colorado Fast, F.F., Binary Feature Selection with Conditional Mutual Information (2004) Journal of Machine Learning Research, 5, pp. 1531-1555 Foster, W.R., Collopy, F., Ungar, L.H., Neural network forecasting of short, noisly time series (1992) Comput. Chem. Engng, 16, pp. 293-297 Franses, P.H., Draisma, G., Recognizing changing seasonal patterns using artificial neural networks (1997) Journal of Econometrics, 81, pp. 273-280 Goutte, C., Extraction of the Relevant Delays for Temporal Modelling, Neural Networks for Signal Processing [1997] VII (1997) Proceedings of the 1997 IEEE Workshop. 24-26, pp. 92-101 Guyon, I., Elisseeff, A., An introduction to variable and feature selection (2003) Journal of Machine Learning Research, 3, pp. 1157-1182 Hornik, K., Stinchcombe, M., White, H., Multilayer feedforward networks are universal approximators (1989) Neural Networks, 2, pp. 359-366 Jacobs, R.A., Jordan, M.I., Nowlan, S.J., Hinton, E.G., Adaptive mixture of local experts (1991) Neural Compulation, 3 (1), pp. 79-87 Kohavi, R., John, G., Wrappers for Feature Subset Selection (1997) Artificial Intelligence, 97 (1-2), pp. 273-324 Leray, P., Gallinari, P., Feature selection with neural networks (1999) Behaviormetrika (special issue on Analysis of Knowledge Representation in Neural Network Models), 26 (1), pp. 145-166 Lima, C.A.M., Coelho, A.L.V., Von Zuben, F.J., Mixture of Experts Applied to Nonlinear Dynamic Systems Identification: A Comparative Study (2002) Proceedings of the VII Brazilian Symposium on Neural Networks, pp. 162-167. , Porto de Galinhas, Recife, November 11-14, pp Lima, C.A.M., Puma-Villanueva, W.J.P., dos Santos, E., Von Zuben, F.J., Mixture of experts applied to financial time series prediction (2004) Proceedings of the XIII Brazilian Symposium on Neural Nenvorks, , in Portuguese, paper no. 3708 Moody, J., Utans, J., Architecture Selection Strategies for Neural Networks: Application to Corporate Bond Rating Prediction (1994) Neural Networks in the Capital Markets, , Refenes A. N, ed, John Wiley & Sons, New York Nelson, M., Hill, T., Remus, T., O'Connor, M., Time series forecasting using NNs: Should the data be deseasonalized · rst (1999) Journal of Forecasting, 18, pp. 359-367 Puma-Villanueva, W.J., Lima, C.A.M., dos Santos, E.P., Von Zuben, F.J., Mixture of Heterogeneous Experts Applied to Time Series: A Comparative Study (2005) Proceedings of the International Joint Conference on Neural Networks (IJCNN'2005), , Montreal. Canada Refenes, A.N., Azema-Barac, M., Karousssos, S.A., Currency exchange rate forecasting by error backpropagation (1992) Proceedings of the Twenty-Fifth Annual Hawaii International Conference on System Sciences, 4, pp. 504-515 Ripley, B., (1993) Statistical aspects of neural networks. In Chaos and Networks - Statistical and Probabilistic Aspects, pp. 40-123. , eds O. Barnorff-Nielsen, J. Jensen and W. Kendall, London: Chapman and Hall Sharda, R., Patil, R.B., Conectionist approach to time series prediction: An empirical test (1992) Journal of Intelligent Manufacturiong, 3, pp. 317-323 Tang, Z., de Almeida, C., Fishwick, P.A., Time series forecasting using neural networks vs. Box-Jenkins methodology (1991) Simulation, 57 (5), pp. 303-310 Wang, G., Lochovsky, F.H., Feature selection with conditional mutual information maximin in text categorization (2004) Conference on Information and Knowledge Management, pp. 342-349 Zhang, G.P., Qi, M., Neural network forecasting for seasonal and trend time series (2005) European Journal of Operation Research, 160, pp. 501-514