Integrating model predictive control with federated reinforcement learning for decentralized energy management of fuel cell vehicles

Khalatbarisoltani, A., Boulon, L. et Hu, X. (2023). Integrating model predictive control with federated reinforcement learning for decentralized energy management of fuel cell vehicles. IEEE Transactions on Intelligent Transportation Systems . ISSN 1558-0016 DOI 10.1109/TITS.2023.3303991

Prévisualisation

PDF Télécharger (4MB) | Prévisualisation

Résumé

Abtract

The optimization-based energy management strategy (EMS) enables expertise to improve the performance of fuel cell vehicles (FCVs). Ongoing efforts are mostly focused on optimizing a centralized EMS using a variety of high-computing technologies without offering appropriate scalability and modularity for the onboard powertrain components. In real-time applications, the time-accomplishment capability of EMSs is crucial; hence, decentralized EMSs with low-cost components and limited processing capability are necessary. Local units handle the computation load on a modular platform. In addition, the decentralized system’s plug-and-play functionality minimizes the total cost. This paper presents a decentralized model predictive control (D-MPC) based on the consensus-based alternating direction method of multipliers (C-ADMM) that explicitly considers the coordination of the dynamic reactions of powertrain components and future driving profiles. In addition, a decentralized learning method is proposed to seek the optimal policy for the moving horizon dimensions in the D-MPC using the federated reinforcement learning (FRL) algorithm in order to improve processing time. Due to the deployment of a fully modular system in the proposed learning technique, agents are restricted from sharing their trajectories. Using a highly dynamic module-to-module communication layer in a fully decentralized arrangement, the powertrain components utilize the multi-step method to attain the global optimum. The performance of the proposed framework is evaluated with regards to its precision, convergence speed, and scalability. The results of numerical simulation and implementation demonstrated that the proposed method is superior to the centralized and fixed-horizon MPC approaches.

Type de document:	Article
Mots-clés libres:	Optimization Costs Mechanical power transmission Medical services Energy management Fuel cells Batteries Alternating direction method of multipliers (ADMM) Federated reinforcement learning (FRL) Proton exchange membrane fuel cell (PEMFC) Distributed optimization algorithms Energy management strategy (EMS) Fuel cell vehicle (FCV) Model predictive control (MPC)
Date de dépôt:	25 sept. 2023 15:02
Dernière modification:	25 sept. 2023 15:02
Version du document déposé:	Post-print (version corrigée et acceptée)
URI:	https://depot-e.uqtr.ca/id/eprint/10869

Actions (administrateurs uniquement)

Éditer la notice