Model adjointization and its cost

doi:10.1360/02yf0440

	Model adjointization and its cost
	Cheng, Q ; Zhang, LB; Wang, B
	2004-10-01
发表期刊	SCIENCE IN CHINA SERIES F-INFORMATION SCIENCES
ISSN	1009-2757
卷号	47 期号:5 页码:587-611
摘要	In this article, the least program behavior decomposition method (LPBD) is put forward from a program structure point of view. This method can be extensively used both in algorithms of automatic differentiation (AD) and in tools design, and does not require programs to be evenly separable but the cost in terms of operations count and memory is similar to methods using checkpointing. This article starts by summarizing the rules of adjointization and then presents the implementation of LPBD. Next, the definition of the separable program space, based on the fundamental assumptions (FA) of automatic differentiation, is given and the differentiation cost functions are derived. Also, two constants of fundamental importance in AD, sigma and mu, are derived under FA. Under the assumption of even separability, the adjoint cost of simple and deep decomposition is subsequently discussed quantitatively using checkpointing. Finally, the adjoint costs in terms of operations count and memory through the LPBD method are shown to be uniformly dependent on the depth of structure or decomposition.
关键词	automatic differentiation model adjointization least program behavior floating-point operations
DOI	10.1360/02yf0440
语种	英语
WOS研究方向	Computer Science
WOS类目	Computer Science, Information Systems
WOS记录号	WOS:000225243100004
出版者	SCIENCE CHINA PRESS
引用统计
文献类型	期刊论文
条目标识符	http://ir.amss.ac.cn/handle/2S8OKBNM/573
专题	计算数学与科学工程计算研究所
通讯作者	Wang, B
作者单位	1.Chinese Acad Sci, ICMSEC, LSEC, Beijing 100080, Peoples R China 2.Chinese Acad Sci, IAP, LASG, Beijing 100029, Peoples R China
推荐引用方式 GB/T 7714	Cheng, Q,Zhang, LB,Wang, B. Model adjointization and its cost[J]. SCIENCE IN CHINA SERIES F-INFORMATION SCIENCES,2004,47(5):587-611.
APA	Cheng, Q,Zhang, LB,&Wang, B.(2004).Model adjointization and its cost.SCIENCE IN CHINA SERIES F-INFORMATION SCIENCES,47(5),587-611.
MLA	Cheng, Q,et al."Model adjointization and its cost".SCIENCE IN CHINA SERIES F-INFORMATION SCIENCES 47.5(2004):587-611.