Bitte verwenden Sie diesen Link, um diese Publikation zu zitieren, oder auf sie als Internetquelle zu verweisen: https://hdl.handle.net/10419/209136 
Autor:innen: 
Erscheinungsjahr: 
2019
Schriftenreihe/Nr.: 
FAU Discussion Papers in Economics No. 11/2019
Verlag: 
Friedrich-Alexander-Universität Erlangen-Nürnberg, Institute for Economics, Nürnberg
Zusammenfassung: 
Machine learning is increasingly applied to time series data, as it constitutes an attractive alternative to forecasts based on traditional time series models. For independent and identically distributed observations, cross-validation is the prevalent scheme for estimating out-of-sample performance in both model selection and assessment. For time series data, however, it is unclear whether forwardvalidation schemes, i.e., schemes that keep the temporal order of observations, should be preferred. In this paper, we perform a comprehensive empirical study of eight common validation schemes. We introduce a study design that perturbs global stationarity by introducing a slow evolution of the underlying data-generating process. Our results demonstrate that, even for relatively small perturbations, commonly used cross-validation schemes often yield estimates with the largest bias and variance, and forward-validation schemes yield better estimates of the out-of-sample error. We provide an interpretation of these results in terms of an additional evolution-induced bias and the sample-size dependent estimation error. Using a large-scale financial data set, we demonstrate the practical significance in a replication study of a statistical arbitrage problem. We conclude with some general guidelines on the selection of suitable validation schemes for time series data.
Schlagwörter: 
machine learning
model selection
model validation
time series
cross-validation
Dokumentart: 
Working Paper

Datei(en):
Datei
Größe
905.5 kB





Publikationen in EconStor sind urheberrechtlich geschützt.