Exploring Patch-wise Semantic Relation for Contrastive Learning in Image-to-Image Translation Tasks

Cited 6 time in webofscience Cited 0 time in scopus
  • Hit : 68
  • Download : 0
Recently, contrastive learning-based image translation methods have been proposed, which contrasts different spatial locations to enhance the spatial correspondence. However, the methods often ignore the diverse semantic relation within the images. To address this, here we propose a novel semantic relation consistency (SRC) regularization along with the decoupled contrastive learning, which utilize the diverse semantics by focusing on the heterogeneous semantics between the image patches of a single image. To further improve the performance, we present a hard negative mining by exploiting the semantic relation. We verified our method for three tasks: single-modal and multi-modal image translations, and GAN compression task for image translation. Experimental results confirmed the state-of-art performance of our method in all the three tasks.
Publisher
IEEE COMPUTER SOC
Issue Date
2022-06
Language
English
Citation

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp.18239 - 18248

ISSN
1063-6919
DOI
10.1109/CVPR52688.2022.01772
URI
http://hdl.handle.net/10203/306008
Appears in Collection
AI-Conference Papers(학술대회논문)
Files in This Item
There are no files associated with this item.
This item is cited by other documents in WoS
⊙ Detail Information in WoSⓡ Click to see webofscience_button
⊙ Cited 6 items in WoS Click to see citing articles in records_button

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0