DuMES: deep reinforcement learning based EV charging scheduling with dual-layer safety modules

Zhang, A., Liu, C., Makantasis, K., Chen, X. ORCID: https://orcid.org/0000-0001-9267-355X, Ward, T. and Cheng, L. (2025) DuMES: deep reinforcement learning based EV charging scheduling with dual-layer safety modules. IET Smart Energy Systems. ISSN 3065-9655 doi: 10.1049/ses2.70017

Abstract/Summary

Deep reinforcement learning (DRL) has become a promising approach for electric vehicle (EV) charging scheduling. However, its practical deployment poses potential risks to power infrastructure. DRL relies on trial‐and‐error interactions during training to approximate optimal policies, which may lead to unsafe decisions. To address this, a novel framework called dual‐layer safety modules for EV charging scheduling (DuMES) is proposed. This framework introduces a decision‐level safety layer into the conventional DRL architecture that adaptively detects and replaces unsafe actions. Furthermore, by integrating dual safety layers with reward shaping, the framework promotes convergence between raw and safe actions. This enhances training efficiency while ensuring power system stability during both training and deployment phases. The method was evaluated through simulation experiments on a charging station equipped with renewable energy and energy storage system (ESS). Comparative analyses with baseline methods demonstrate that DuMES effectively satisfies user charging demands, reduces operational costs and ensures compliance with safety constraints.

Item Type	Article
URI	https://centaur.reading.ac.uk/id/eprint/127268
Identification Number/DOI	10.1049/ses2.70017
Refereed	Yes
Divisions	Science > School of Mathematical, Physical and Computational Sciences > Department of Computer Science
Publisher	Wiley
Download/View statistics	View download statistics for this item