TY - GEN
T1 - Evaluating Model Performance Through a User-Centric Explainable Framework for Probabilistic Load Forecasting Models
AU - Robin, Rebecca
AU - Heistrene, Leena
AU - Belikov, Juri
AU - Baimel, Dmitry
AU - Levron, Yoash
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Load forecasting models ensure efficient, secure, and stable operation of the modern power system. Probabilistic forecasting accounts for uncertainties associated with missing features that are often overlooked by deterministic approaches. However, machine learning-based probabilistic models are complicated. This paper proposes a user-centric explainable AI framework that presents global and local interpretations aligned with the expertise and explanation needs of the targeted user. The overall influence of temporal and spatial exogenous features at the model development stage is evaluated using the Permutation Feature Importance technique. Such an explanation provides a holistic picture of the knowledge gained by the Gradient Boosting Regressor-based probabilistic load forecasting model. Further-more, the proposed framework suggests the implementation of SHapely Additive exPlanations (SHAP) at the post-deployment stage for individual forecast instances. Local explanations provided by SHAP are used to distinguish between interval forecasts with higher and lower forecast accuracy. Such distinction is applied for both the lower and upper bounds of the forecast interval. This is specifically useful for the non-AI expert end-users that need load forecasts for their strategizing their daily operations. This work is validated on the Kaggle data set on the national load demand of Panama supported with several other exogenous features such as weather-related quantities, holidays, and date-time details. Results show the efficacy of the proposed framework and its ability to provide user-friendly interpretations aligned with users' explanation goals.
AB - Load forecasting models ensure efficient, secure, and stable operation of the modern power system. Probabilistic forecasting accounts for uncertainties associated with missing features that are often overlooked by deterministic approaches. However, machine learning-based probabilistic models are complicated. This paper proposes a user-centric explainable AI framework that presents global and local interpretations aligned with the expertise and explanation needs of the targeted user. The overall influence of temporal and spatial exogenous features at the model development stage is evaluated using the Permutation Feature Importance technique. Such an explanation provides a holistic picture of the knowledge gained by the Gradient Boosting Regressor-based probabilistic load forecasting model. Further-more, the proposed framework suggests the implementation of SHapely Additive exPlanations (SHAP) at the post-deployment stage for individual forecast instances. Local explanations provided by SHAP are used to distinguish between interval forecasts with higher and lower forecast accuracy. Such distinction is applied for both the lower and upper bounds of the forecast interval. This is specifically useful for the non-AI expert end-users that need load forecasts for their strategizing their daily operations. This work is validated on the Kaggle data set on the national load demand of Panama supported with several other exogenous features such as weather-related quantities, holidays, and date-time details. Results show the efficacy of the proposed framework and its ability to provide user-friendly interpretations aligned with users' explanation goals.
KW - Explainable AI
KW - Gradient Boost Regressor
KW - load forecasting
KW - PFI
KW - power system
KW - SHAP
KW - XAI
UR - http://www.scopus.com/inward/record.url?scp=85190374807&partnerID=8YFLogxK
U2 - 10.1109/ICPC2T60072.2024.10474692
DO - 10.1109/ICPC2T60072.2024.10474692
M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???
AN - SCOPUS:85190374807
T3 - 2024 3rd International Conference on Power, Control and Computing Technologies, ICPC2T 2024
SP - 427
EP - 432
BT - 2024 3rd International Conference on Power, Control and Computing Technologies, ICPC2T 2024
T2 - 3rd International Conference on Power, Control and Computing Technologies, ICPC2T 2024
Y2 - 18 January 2024 through 20 January 2024
ER -