Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Models’
In many supervised learning applications, understanding and visualizing the effects of the predictor variables on the predicted response is of paramount importance. A shortcoming of black box supervised learning models (e.g. complex trees, neural networks, boosted trees, random forests, nearest neighbours, local kernel-weighted methods and support vector regression) in this regard is their lack of interpretability or transparency. Partial dependence plots, which are the most popular approach for visualizing the effects of the predictors with black box supervised learning models, can produce erroneous results if the predictors are strongly correlated, because they require extrapolation of the response at predictor values that are far outside the multivariate envelope of the training data. As an alternative to partial dependence plots, we present a new visualization approach that we term accumulated local effects plots, which do not require this unreliable extrapolation with correlated predictors. Moreover, accumulated local effects plots are far less computationally expensive than partial dependence plots. We also provide an R package ALEPlot as supplementary material to implement our proposed method.
The webinars aim to make a diverse and engaging programme of high-quality papers accessible to all, with a particular focus on the impact of the research since its first publication. The webinars are free, open to RSS members and non-members alike, and chaired by a leading statistician with research interests in the field, in similarity to our Discussion Paper meetings.
Members, non-Members, all welcome.
Authors: Daniel Apley (Northwestern)
Discussants: Giles Hooker (University of Pennsylvania), Qingyuan Zhao (Cambridge)
Chair: Angela Montanari (University of Bologna)
Book now