An Improved and Explainable Electricity Price Forecasting Model via SHAP-based Error Compensation Approach

Leena Heistrene, Juri Belikov, Dmitry Baimel, Liran Katzir, Ram Machlev, Kfir Levy, Shie Mannor, Yoash Levron

Research output: Contribution to journalArticlepeer-review

Abstract

Forecasting errors in power markets, even as small as 1%, can have significant financial implications. However, even high-performance artificial intelligence (AI) based electricity price forecasting (EPF) models have instances when their prediction error is much higher than those shown by mean performance metrics. To date, explainable AI has been used to enhance the model transparency and trustworthiness of AI-based EPF models. However, this paper demonstrates that insights from explainable AI (XAI) techniques can be expanded beyond its primary task of explanatory visualizations. This work presents a XAI-based error compensation approach to improve model performance and identify irregular predictions. The first phase of the proposed approach involves error quantification through a Shapley additive explanations (SHAP) based corrector model that fine-Tunes the base predictor's forecasts. Using this corrector model's SHAP explanations, the proposed approach distinguishes high-Accuracy predictions from lower ones in the second stage. Additionally, these explanations are more simplified than the base model, making them easier for non-expert users like bidding agents. Performance enhancement and insightful user-centric explanations are crucial for real-world scenarios like price spikes during network congestion, high renewable penetration, and fluctuating fuel costs. Case studies discussed here show the efficacy of the proposed approach independent of model architecture, feature combination, or behavioral patterns of electricity prices in different markets.

Original languageEnglish
JournalIEEE Transactions on Artificial Intelligence
DOIs
StateAccepted/In press - 2024

Keywords

  • CNN
  • Electricity price forecasting
  • Explainable artificial intelligence
  • LSTM
  • Price spike
  • SHAP
  • XAI
  • XGBoost

ASJC Scopus subject areas

  • Computer Science Applications
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'An Improved and Explainable Electricity Price Forecasting Model via SHAP-based Error Compensation Approach'. Together they form a unique fingerprint.

Cite this