Fulltext

Information-theoretic temporal segmentation of video and applications: multiscale keyframes selection and shot boundaries detection

Janvier, Bruno ; Bruno, Eric ; Pun, Thierry ; Marchand-Maillet, Stéphane

In: Multimedia Tools and Applications, 2006, vol. 30, no. 3, p. 273-288

Ajouter à la liste personnelle
    Titre
    • Information-theoretic temporal segmentation of video and applications: multiscale keyframes selection and shot boundaries detection
    Auteur
    • Janvier, Bruno. Viper Group, Computer Vision and Multimedia Laboratory, Université de Genéve, Geneva, Switzerland
    • Bruno, Eric. Viper Group, Computer Vision and Multimedia Laboratory, Université de Genéve, Geneva, Switzerland
    • Pun, Thierry. Viper Group, Computer Vision and Multimedia Laboratory, Université de Genéve, Geneva, Switzerland
    • Marchand-Maillet, Stéphane. Viper Group, Computer Vision and Multimedia Laboratory, Université de Genéve, Geneva, Switzerland
    Type de document
    • Postprint
    Langue
    • Anglais
    Publié dans
    • Multimedia Tools and Applications, 2006, vol. 30, no. 3, p. 273-288. Kluwer Academic Publishers-Plenum Publishers; http://www.springer-ny.com
    Autre version électronique
    Identifiant OAI-PMH
    • oai:doc.rero.ch:311216
    Summary
    The first step in the analysis of video content is the partitioning of a long video sequence into short homogeneous temporal segments. The homogeneity property ensures that the segments are taken by a single camera and represent a continuous action in time and space. These segments can then be used as atomic temporal components for higher level analysis like browsing, classification, indexing and retrieval. The novelty of our approach is to use color information to partition the video into segments dynamically homogeneous using a criterion inspired by compact coding theory. We perform an information-based segmentation using a Minimum Message Length (MML) criterion and minimization by a Dynamic Programming Algorithm (DPA). We show that our method is efficient and robust to detect all types of transitions in a generic manner. A specific detector for each type of transition of interest therefore becomes unnecessary. We illustrate our technique by two applications: a multiscale keyframe selection and a generic shot boundaries detection