CONF quelhas:civr:2006/IDIAP Natural Scene Image Modeling using Color and Texture Visterms. Quelhas, Pedro Odobez, Jean-Marc EXTERNAL http://publications.idiap.ch/attachments/papers/2006/quelhas-civr-2006.pdf PUBLIC http://publications.idiap.ch/index.php/publications/showcite/quelhas:rr06-17 Related documents Conference on Image and Video Retrieval CIVR 2006 IDIAP-RR 06-17 This paper presents a novel approach for visual scene representation, combining the use of quantized color and texture local invariant features (referred to here as {\em visterms}) computed over interest point regions. In particular we investigate the different ways to fuse together local information from texture and color in order to provide a better {\em visterm} representation. We develop and test our methods on the task of image classification using a 6-class natural scene database. We perform classification based on the {\em bag-of-visterms} (BOV) representation (histogram of quantized local descriptors,',','), extracted from both texture and color features. We investigate two different fusion approaches at the feature level: fusing local descriptors together and creating one representation of joint texture-color visterms, or concatenating the histogram representation of both color and texture, obtained independently from each local feature. On our classification task we show that the appropriate use of color improves the results w.r.t. a texture only representation. REPORT quelhas:rr06-17/IDIAP Natural Scene Image Modeling using Color and Texture Visterms. Quelhas, Pedro Odobez, Jean-Marc EXTERNAL http://publications.idiap.ch/attachments/reports/2006/quelhas-idiap-rr-06-17.pdf PUBLIC Idiap-RR-17-2006 2006 IDIAP Submitted for publication This paper presents a novel approach for visual scene representation, combining the use of quantized color and texture local invariant features (referred to here as {\em visterms}) computed over interest point regions. In particular we investigate the different ways to fuse together local information from texture and color in order to provide a better {\em visterm} representation. We develop and test our methods on the task of image classification using a 6-class natural scene database. We perform classification based on the {\em bag-of-visterms} (BOV) representation (histogram of quantized local descriptors,',','), extracted from both texture and color features. We investigate two different fusion approaches at the feature level: fusing local descriptors together and creating one representation of joint texture-color visterms, or concatenating the histogram representation of both color and texture, obtained independently from each local feature. On our classification task we show that the appropriate use of color improves the results w.r.t. a texture only representation.