Please use this identifier to cite or link to this item: https://hdl.handle.net/10419/223901 
Year of Publication: 
2020
Series/Report no.: 
IZA Discussion Papers No. 13459
Publisher: 
Institute of Labor Economics (IZA), Bonn
Abstract: 
New challenges arise in data visualization when a sizable database is used in the analysis. With many data points, classical scatterplots are non-informative due to the cluttering of points. On the contrary, simple plots such as the boxplot that are of limited use in small samples, offer great potential to facilitate group comparison in the case of an extensive sample. This paper presents Exploratory Data Analysis (EDA) methods that are useful when a large dataset is involved. The EDA methods, (introduced by Tukey in his seminal book of 1977) encompass a set of statistical tools aimed to extract information from data using simple graphical tools. In this paper, some of the EDA methods like the Boxplot and Scatterplot are revisited and enhanced using modern graphical computational devices (as, e.g., the heat-map) and their use illustrated with Spanish Social Security data. We explore how earnings vary across several factors like age, gender, type of occupation and contract and in particular, the gender gap in salaries is visualized in various dimensions relating to the type of occupation. The EDA methods are also applied to assessing competing regressions with earnings as the dependent variable. The methods discussed should be useful to researchers to assess heterogeneity in data, across group-variation, and classical diagnostic plots of residuals from alternative models fits.
Subjects: 
EDA Analysis
large dataset
ggplot
heat-maps
R
JEL: 
C55
J01
J08
Y10
C80
Document Type: 
Working Paper

Files in This Item:
File
Size
3.89 MB





Items in EconStor are protected by copyright, with all rights reserved, unless otherwise indicated.