Automatic Cinemagraph Portraits
Article first published online: 18 JUL 2013
© 2013 The Author(s) Computer Graphics Forum © 2013 The Eurographics Association and John Wiley & Sons Ltd.
Computer Graphics Forum
Volume 32, Issue 4, pages 17–25, July 2013
How to Cite
Bai, J., Agarwala, A., Agrawala, M. and Ramamoorthi, R. (2013), Automatic Cinemagraph Portraits. Computer Graphics Forum, 32: 17–25. doi: 10.1111/cgf.12147
- Issue published online: 18 JUL 2013
- Article first published online: 18 JUL 2013
- I.3.8 [Computer Graphics]: Applications—Video
Cinemagraphs are a popular new type of visual media that lie in-between photos and video; some parts of the frame are animated and loop seamlessly, while other parts of the frame remain completely still. Cinemagraphs are especially effective for portraits because they capture the nuances of our dynamic facial expressions. We present a completely automatic algorithm for generating portrait cinemagraphs from a short video captured with a hand-held camera. Our algorithm uses a combination of face tracking and point tracking to segment face motions into two classes: gross, large-scale motions that should be removed from the video, and dynamic facial expressions that should be preserved. This segmentation informs a spatially-varying warp that removes the large-scale motion, and a graph-cut segmentation of the frame into dynamic and still regions that preserves the finer-scale facial expression motions. We demonstrate the success of our method with a variety of results and a comparison to previous work.