* Upcoming papers  
Subject Keyword Abstract Author
Balance Control for the First-order Inverted Pendulum Based on the Advantage Actor-critic Algorithm

Yan Zheng, Xutong Li*, and Long Xu
International Journal of Control, Automation, and Systems, vol. 18, no. 12, pp.3093-3100, 2020

Abstract : In this paper, a control algorithm based on Advantage Actor-Critic for the classical inverted pendulum system has been proposed. To enrich the observed states which are used to control, a CNN feature-based state is proposed. The direct control and the indirect control algorithms are introduced to address different control situations, such as the situation which only physical states like angle, velocity, etc. provided or the situation which only the indirect states provided like images, etc. A comparison experiment between the direct control and the indirect control algorithms based on the Advantage Actor-Critic has been evaluated. Besides, the comparison experiment with the Deep Q-Network algorithm has been performed. The experiment results show that the proposed method achieves comparable performance with the PID control algorithm and better than the Deep Q-Network based algorithm.

Download: http://link.springer.com/article/10.1007/s12555-019-0278-z

Keyword : Actor critic, deep Q network(DQN), inverted pendulum, PID, reinforcement learning.

Business License No.: 220-82-01782