Neural Network-Based Model-Free Learning Approach for Approximate Optimal Control of Nonlinear Systems

doi:10.1587/transfun.2020EAP1022

CSpace

	Neural Network-Based Model-Free Learning Approach for Approximate Optimal Control of Nonlinear Systems
	Xu, Zhenhui 1; Shen, Tielong 1; Cheng, Daizhan 2
	2021-02-01
发表期刊	IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES
ISSN	0916-8508
卷号	E104A 期号:2 页码:532-541
摘要	This paper studies the infinite time horizon optimal control problem for continuous-time nonlinear systems. A completely model-free approximate optimal control design method is proposed, which only makes use of the real-time measured data from trajectories instead of a dynamical model of the system. This approach is based on the actor-critic structure, where the weights of the critic neural network and the actor neural network are updated sequentially by the method of weighted residuals. It should be noted that an external input is introduced to replace the input-to-state dynamics to improve the control policy. Moreover, strict proof of convergence to the optimal solution along with the stability of the closed-loop system is given. Finally, a numerical example is given to show the efficiency of the method.
关键词	infinite-time horizon approximate optimal control design completely model-free neural network
DOI	10.1587/transfun.2020EAP1022
收录类别	SCI
语种	英语
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Hardware & Architecture ; Computer Science, Information Systems ; Engineering, Electrical & Electronic
WOS记录号	WOS:000649543500030
出版者	IEICE-INST ELECTRONICS INFORMATION COMMUNICATIONS ENG
引用统计
文献类型	期刊论文
条目标识符	http://ir.amss.ac.cn/handle/2S8OKBNM/58678
专题	中国科学院数学与系统科学研究院
通讯作者	Xu, Zhenhui
作者单位	1.Sophia Univ, Dept Engn & Appl Sci, Tokyo 1028554, Japan 2.Chinese Acad Sci, Acad Math & Syst Sci, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Xu, Zhenhui,Shen, Tielong,Cheng, Daizhan. Neural Network-Based Model-Free Learning Approach for Approximate Optimal Control of Nonlinear Systems[J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES,2021,E104A(2):532-541.
APA	Xu, Zhenhui,Shen, Tielong,&Cheng, Daizhan.(2021).Neural Network-Based Model-Free Learning Approach for Approximate Optimal Control of Nonlinear Systems.IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES,E104A(2),532-541.
MLA	Xu, Zhenhui,et al."Neural Network-Based Model-Free Learning Approach for Approximate Optimal Control of Nonlinear Systems".IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES E104A.2(2021):532-541.