Paper in CVPR (2010): “Discontinuous Seam-Carving for Video Retargeting”

Discontinuous Seam-Carving for Video Retargeting

  • M. Grundmann, V. Kwatra, M. Han, and I. Essa (2010), “Discontinuous Seam-Carving for Video Retargeting,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010. [PDF] [WEBSITE] [DOI] [BIBTEX]
    @InProceedings{    2010-Grundmann-DSVR,
      author  = {M. Grundmann and V. Kwatra and M. Han and I. Essa},
      booktitle  = {Proceedings of IEEE Conference on Computer Vision
          and Pattern Recognition (CVPR)},
      doi    = {10.1109/CVPR.2010.5540165},
      month    = {June},
      pdf    = {http://www.cc.gatech.edu/cpl/projects/videoretargeting/cvpr2010_videoretargeting.pdf},
      publisher  = {IEEE Computer Society},
      title    = {Discontinuous Seam-Carving for Video Retargeting},
      url    = {http://www.cc.gatech.edu/cpl/projects/videoretargeting/},
      year    = {2010}
    }

Abstract

We introduce a new algorithm for video retargeting that uses discontinuous seam-carving in both space and time for resizing videos. Our algorithm relies on a novel appearance-based temporal coherence formulation that allows for frame-by-frame processing and results in temporally discontinuous seams, as opposed to geometrically smooth and continuous seams. This formulation optimizes the difference in appearance of the resultant retargeted frame to the optimal temporally coherent one, and allows for carving around fast moving salient regions.

Additionally, we generalize the idea of appearance-based coherence to the spatial domain by introducing piece-wise spatial seams. Our spatial coherence measure minimizes the change in gradients during retargeting, which preserves spatial detail better than minimization of color difference alone. We also show that per-frame saliency (gradient- based or feature-based) does not always produce desirable retargeting results and propose a novel automatically computed measure of spatio-temporal saliency. As needed, a user may also augment the saliency by interactive region-brushing. Our retargeting algorithm processes the video sequentially, making it conducive for streaming applications.

Examples from our CVPR 2010 Paper

Tags: , , , , | Categories: Computational Photography and Video, Matthias Grundmann, PAMI/ICCV/CVPR/ECCV, Papers, Vivek Kwatra | Date: June 13th, 2010 | By: Irfan Essa |

No Comments »

You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

Leave a Reply