Real-Time Facial Pose Estimation and Tracking by Coarse-to-Fine Iterative Optimization

doi:10.26599/TST.2020.9010001

CSpace

	Real-Time Facial Pose Estimation and Tracking by Coarse-to-Fine Iterative Optimization
	Yang, Xiaolong 1,2; Jia, Xiaohong 1,2; Yuan, Mengke 3; Yan, Dong-Ming 3
	2020-10-01
发表期刊	TSINGHUA SCIENCE AND TECHNOLOGY
ISSN	1007-0214
卷号	25 期号:5 页码:690-700
摘要	We present a novel and efficient method for real-time multiple facial poses estimation and tracking in a single frame or video. First, we combine two standard convolutional neural network models for face detection and mean shape learning to generate initial estimations of alignment and pose. Then, we design a bi-objective optimization strategy to iteratively refine the obtained estimations. This strategy achieves faster speed and more accurate outputs. Finally, we further apply algebraic filtering processing, including Gaussian filter for background removal and extended Kalman filter for target prediction, to maintain real-time tracking superiority. Only general RGB photos or videos are required, which are captured by a commodity monocular camera without any priori or label. We demonstrate the advantages of our approach by comparing it with the most recent work in terms of performance and accuracy.
关键词	facial pose recognition facial pose estimation real-time tracking
DOI	10.26599/TST.2020.9010001
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[61872354] ; National Natural Science Foundation of China[61772523] ; National Natural Science Foundation of China[61620106003] ; National Natural Science Foundation of China[61802406] ; National Key R&D Program of China[2019YFB2204104] ; Beijing Natural Science Foundation[L182059] ; Beijing Natural Science Foundation[Z190004] ; Intelligent Science and Technology Advanced Subject Project of University of Chinese Academy of Sciences[115200S001] ; Alibaba Group through Alibaba Innovative Research Program
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Information Systems ; Computer Science, Software Engineering ; Engineering, Electrical & Electronic
WOS记录号	WOS:000543490100013
出版者	TSINGHUA UNIV PRESS
引用统计
文献类型	期刊论文
条目标识符	http://ir.amss.ac.cn/handle/2S8OKBNM/51781
专题	中国科学院数学与系统科学研究院
通讯作者	Jia, Xiaohong
作者单位	1.Chinese Acad Sci, Acad Math & Syst Sci, Key Lab Math Mechanizat, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 3.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Yang, Xiaolong,Jia, Xiaohong,Yuan, Mengke,et al. Real-Time Facial Pose Estimation and Tracking by Coarse-to-Fine Iterative Optimization[J]. TSINGHUA SCIENCE AND TECHNOLOGY,2020,25(5):690-700.
APA	Yang, Xiaolong,Jia, Xiaohong,Yuan, Mengke,&Yan, Dong-Ming.(2020).Real-Time Facial Pose Estimation and Tracking by Coarse-to-Fine Iterative Optimization.TSINGHUA SCIENCE AND TECHNOLOGY,25(5),690-700.
MLA	Yang, Xiaolong,et al."Real-Time Facial Pose Estimation and Tracking by Coarse-to-Fine Iterative Optimization".TSINGHUA SCIENCE AND TECHNOLOGY 25.5(2020):690-700.