logo Idiap Research Institute        
 [BibTeX] [Marc21]
Finding Structure in Consumer Videos by Probabilistic Hierarchical Clustering
Type of publication: Idiap-RR
Citation: gatica02c
Number: Idiap-RR-22-2002
Year: 2002
Institution: IDIAP
Note: IEEE Transactions on Circuits and Systems for Video Technology, accepted for publication
Abstract: Accessing, organizing, and manipulating home videos present technical challenges due to their unrestricted content and lack of storyline. In this paper, we present a methodology to discover cluster structure in home videos, which uses video shots as the unit of organization, and is based on two concepts: (i) the development of statistical models of visual similarity and temporal duration and adjacency of consumer video segments, and (ii) the reformulation of hierarchical clustering as a sequential binary Bayesian classification process. A Bayesian formulation allows for the incorporation of prior knowledge of the structure of home video, and offers the advantages of a principled methodology. Gaussian mixture models are used to represent the class-conditional distributions of inter-segment visual similarity, and temporal adjacency and duration. The models are then used in the probabilistic clustering algorithm, where the merging order is a variation of Highest Confidence First, and the merging criterion is Maximum a Posteriori. The algorithm does not need any ad-hoc parameter determination. We present extensive results on a ten-hour home video database with ground-truth which thoroughly validate the performance of our methodology with respect to cluster detection, individual shot-cluster labeling, and the effect of prior selection.
Userfields: ipdmembership={vision},
Keywords:
Projects Idiap
Authors Gatica-Perez, Daniel
Loui, Alexander
Sun, Ming-Ting
Crossref by gatica02c-art
Added by: [UNK]
Total mark: 0
Attachments
  • rr02-22.pdf
  • rr02-22.ps.gz
Notes