Training GANs with centripetal acceleration
Peng, Wei1; Dai, Yu-Hong2,3; Zhang, Hui4; Cheng, Lizhi4
AbstractTraining generative adversarial networks (GANs) often suffers from cyclic behaviours of iterates. Based on a simple intuition that the direction of centripetal acceleration of an object moving in uniform circular motion is toward the centre of the circle, we present the Simultaneous Centripetal Acceleration (SCA) method and the Alternating Centripetal Acceleration (ACA) method to alleviate the cyclic behaviours. Under suitable conditions, gradient descent methods with either SCA or ACA are shown to be linearly convergent for bilinear games. Numerical experiments are conducted by applying ACA to existing gradient-based algorithms in a GAN setup scenario, which demonstrate the superiority of ACA.
KeywordPrimary: 97N60 90C25 Secondary: 90C06 90C30
Indexed BySCI
Funding ProjectChinese NSF[11501569] ; Chinese NSF[61571008] ; Chinese NSF[11631013] ; Chinese NSF[11991021] ; Chinese NSF[11971372] ; Chinese NSF[11991020] ; Beijing Academy of Artificial Intelligence (BAAI)
WOS Research AreaComputer Science ; Operations Research & Management Science ; Mathematics
WOS SubjectComputer Science, Software Engineering ; Operations Research & Management Science ; Mathematics, Applied
WOS IDWOS:000527185500001
Citation statistics
Document Type期刊论文
Corresponding AuthorDai, Yu-Hong
Affiliation1.Chinese Acad Mil Sci, Natl Innovat Inst Def Technol, Beijing, Peoples R China
2.Chinese Acad Sci, LSEC, ICMSEC, Acad Math & Syst Sci, Beijing 100190, Peoples R China
3.Univ Chinese Acad Sci, Sch Math Sci, Beijing 100049, Peoples R China
4.Natl Univ Def Technol, Dept Math, Changsha, Hunan, Peoples R China
Recommended Citation
GB/T 7714
Peng, Wei,Dai, Yu-Hong,Zhang, Hui,et al. Training GANs with centripetal acceleration[J]. OPTIMIZATION METHODS & SOFTWARE,2020:19.
APA Peng, Wei,Dai, Yu-Hong,Zhang, Hui,&Cheng, Lizhi.(2020).Training GANs with centripetal acceleration.OPTIMIZATION METHODS & SOFTWARE,19.
MLA Peng, Wei,et al."Training GANs with centripetal acceleration".OPTIMIZATION METHODS & SOFTWARE (2020):19.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Peng, Wei]'s Articles
[Dai, Yu-Hong]'s Articles
[Zhang, Hui]'s Articles
Baidu academic
Similar articles in Baidu academic
[Peng, Wei]'s Articles
[Dai, Yu-Hong]'s Articles
[Zhang, Hui]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Peng, Wei]'s Articles
[Dai, Yu-Hong]'s Articles
[Zhang, Hui]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.