logo Idiap Research Institute        
 [BibTeX] [Marc21]
Synthetic to Authentic: Transferring Realism to 3D Face Renderings for Boosting Face Recognition
Type of publication: Conference paper
Citation: Rahimi_ECCV_2024
Publication status: Accepted
Booktitle: European Conference on Computer Vision Workshops
Year: 2024
Abstract: In this paper, we investigate the potential of image-to-image translation (I2I) techniques for transferring realism to 3D-rendered facial images in the context of Face Recognition (FR) systems. The primary motivation for using 3D-rendered facial images lies in their ability to circumvent the challenges associated with collecting large real face datasets for training FR systems. These images are generated entirely by 3D rendering engines, facilitating the generation of synthetic identities. However, it has been observed that FR systems trained on such synthetic datasets underperform when compared to those trained on real datasets, on various FR benchmarks. In this work, we demonstrate that by transferring the realism to 3D-rendered images (i.e., making the 3D-rendered images look more real), we can boost the performance of FR systems trained on these more photorealistic images. This improvement is evident when these systems are evaluated against FR benchmarks like IJB-C, LFW which utilize real-world data by 2% to %5, thereby paving new pathways for employing synthetic data in real-world applications. The project page is available at: \url{https://idiap.ch/paper/syn2auth}.
Keywords: 3D-Rendered Datasets, face recognition systems, Image-to-Image Translation, Photorealism in Synthetic Data, Realism Transfer
Projects SAFER
Authors Rahimi, Parsa
Razeghi, Behrooz
Marcel, Sébastien
Added by: [UNK]
Total mark: 0
Attachments
  • Rahimi_ECCV_2024.pdf
       (Camera Ready)
Notes