EconStor >
Ludwig-Maximilians-Universität München (LMU) >
Sonderforschungsbereich 386: Statistische Analyse diskreter Strukturen, Universität München (LMU) >
Discussion papers, SFB 386, LMU München >

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10419/31101
  
Title:Penalized regression with correlation based penalty PDF Logo
Authors:Tutz, Gerhard
Ulbricht, Jan
Issue Date:2006
Series/Report no.:Discussion paper // Sonderforschungsbereich 386 der Ludwig-Maximilians-Universität München 486
Abstract:A new regularization method for regression models is proposed. The criterion to be minimized contains a penalty term which explicitly links strength of penalization to the correlation between predictors. As the elastic net, the method encourages a grouping effect where strongly correlated predictors tend to be in or out of the model together. A boosted version of the penalized estimator, which is based on a new boosting method, allows to select variables. Real world data and simulations show that the method compares well to competing regularization techniques. In settings where the number of predictors is smaller than the number of observations it frequently performs better than competitors, in high dimensional settings prediction measures favor the elastic net while accuracy of estimation and stability of variable selection favors the newly proposed method.
Subjects:Correlation based estimator
Boosting
Variable selection
Elastic net
Lasso
Penalization
Persistent Identifier of the first edition:urn:nbn:de:bvb:19-epub-1854-7
Document Type:Working Paper
Appears in Collections:Discussion papers, SFB 386, LMU München

Files in This Item:
File Description SizeFormat
518770192.PDF366.99 kBAdobe PDF
No. of Downloads: Counter Stats
Download bibliographical data as: BibTeX
Share on:http://hdl.handle.net/10419/31101

Items in EconStor are protected by copyright, with all rights reserved, unless otherwise indicated.