Soft Color Segmentation and its Applications

Cited 0 time in webofscience Cited 0 time in scopus
  • Hit : 314
  • Download : 1944
We propose an automatic approach to soft color segmentation, which produces soft color segments with appropriate amount of overlapping and transparency essential to synthesizing natural images for a wide range of image-based applications. While many state-of-the-art and complex techniques are excellent at partitioning an input image to facilitate deriving a semantic description of the scene, to achieve seamless image synthesis, we advocate to a segmentation approach designed to maintain spatial and color coherence among soft segments while preserving discontinuities, by assigning to each pixel a set of soft labels corresponding to their respective color distributions. We optimize a global objective function which simultaneously exploits the reliability given by global color statistics and flexibility of local image compositing, leading to an image model where the global color statistics of an image is represented by a Gaussian Mixture Model (GMM), while the color of a pixel is explained by a local color mixture model where the weights are defined by the soft labels to the elements of the converged GMM. Transparency is naturally introduced in our probabilistic framework which infers an optimal mixture of colors at an image pixel.To adequately consider global and local information in the same framework, an alternating optimization scheme is proposed to iteratively solve for the global and local model parameters. Our method is fully automatic, and is shown to converge to a good optimal solution. We perform extensive evaluation and comparison, and demonstrate that our method achieves good image synthesis results for image-based applications such as image matting, color transfer, image deblurring, and image colorization.
Issue Date

Color image segmentation; Image synthesis


IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.29, No.9, pp.1520-1537

Appears in Collection
CS-Journal Papers(저널논문)
Files in This Item
Soft Color segmentation_200709_IEEE TPAMI.pdf(5.11 MB)Download


  • mendeley


rss_1.0 rss_2.0 atom_1.0