Academic Journal

Multi-Scale Label-Maps Extraction for Texture Synthesis

Bibliographic Details
Title: Multi-Scale Label-Maps Extraction for Texture Synthesis
Authors: Lockerman, Yitzchak David, Sauvage, Basile, Allègre, Rémi, Dischler, Jean-Michel, Dorsey, Julie, Rushmeier, Holly
Contributors: Yale University New Haven, Laboratoire des sciences de l'ingénieur, de l'informatique et de l'imagerie (ICube), École Nationale du Génie de l'Eau et de l'Environnement de Strasbourg (ENGEES)-Université de Strasbourg (UNISTRA)-Les Hôpitaux Universitaires de Strasbourg (HUS)-Institut National des Sciences Appliquées - Strasbourg (INSA Strasbourg), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Centre National de la Recherche Scientifique (CNRS)-Matériaux et Nanosciences Grand-Est (MNGE), Université de Strasbourg (UNISTRA)-Université de Haute-Alsace (UHA) Mulhouse - Colmar (Université de Haute-Alsace (UHA))-Institut National de la Santé et de la Recherche Médicale (INSERM)-Institut de Chimie - CNRS Chimie (INC-CNRS)-Centre National de la Recherche Scientifique (CNRS)-Université de Strasbourg (UNISTRA)-Université de Haute-Alsace (UHA) Mulhouse - Colmar (Université de Haute-Alsace (UHA))-Institut National de la Santé et de la Recherche Médicale (INSERM)-Institut de Chimie - CNRS Chimie (INC-CNRS)-Centre National de la Recherche Scientifique (CNRS)-Réseau nanophotonique et optique, Université de Strasbourg (UNISTRA)-Université de Haute-Alsace (UHA) Mulhouse - Colmar (Université de Haute-Alsace (UHA))-Centre National de la Recherche Scientifique (CNRS)-Université de Strasbourg (UNISTRA)-Centre National de la Recherche Scientifique (CNRS)
Superior Title: ISSN: 0730-0301.
Publisher Information: HAL CCSD
Association for Computing Machinery
Publication Year: 2016
Collection: Inserm: HAL (Institut national de la santé et de la recherche médicale)
Subject Terms: [INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR]
Description: Texture synthesis is a well-established area, with many important applications in computer graphics and vision. However, despite their success, synthesis techniques are not used widely in practice because the creation of good exemplars remains challenging and extremely tedious. In this paper, we introduce an unsupervised method for analyzing texture content across multiple scales that automatically extracts good exemplars from natural images. Unlike existing methods, which require extensive manual tuning, our method is fully automatic. This allows the user to focus on using texture palettes derived from their own images, rather than on manual interactions dictated by the needs of an underlying algorithm. Most natural textures exhibit patterns at multiple scales that may vary according to the location (non-stationarity). To handle such textures many synthesis algorithms rely on an analysis of the input and a guidance of the synthesis. Our new analysis is based on a labeling of texture patterns that is both (i) multi-scale and (ii) unsupervised -- that is, patterns are labeled at multiple scales, and the scales and the number of labeled clusters are selected automatically. Our method works in two stages. The first builds a hierarchical extension of superpixels and the second labels the superpixels based on random walk in a graph of similarity between superpixels and a nonnegative matrix factorization. Our label-maps provide descriptors for pixels and regions that benefit state-of-the-art texture synthesis algorithms. We show several applications including guidance of non-stationary synthesis, content selection and texture painting. Our method is designed to treat large inputs and can scale to many megapixels. In addition to traditional exemplar inputs, our method can also handle natural images containing different textured regions.
Document Type: article in journal/newspaper
Language: English
Relation: hal-03703432; https://hal.science/hal-03703432; https://hal.science/hal-03703432/document; https://hal.science/hal-03703432/file/islandora_145213.pdf
DOI: 10.1145/2897824.2925964
Availability: https://doi.org/10.1145/2897824.2925964
https://hal.science/hal-03703432
https://hal.science/hal-03703432/document
https://hal.science/hal-03703432/file/islandora_145213.pdf
Rights: info:eu-repo/semantics/OpenAccess
Accession Number: edsbas.7C2BCA54
Database: BASE
Description
Description not available.