Communication Dans Un Congrès Année : 2026

Retinex-guided Relighting and Latent-Space Refinement for Realistic Diffusion-based Face Swapping

Résumé

Face swapping, or deepfake generation, remains a challenging task that requires balancing identity preservation, attribute consistency, and photorealistic realism. We propose a novel training-free, three-stage face swapping framework that improves realism by explicitly aligning illumination and skin appearance prior to diffusion-based synthesis. Our approach refines photometric consistency and skin tone while preserving facial structure and integrates seamlessly with an off-the-shelf diffusion face swapping model. Experiments on the CelebAMask-HQ dataset demonstrate significant improvements in both visual realism and attribute preservation, achieving an FID score of 7.16 compared to the baseline. The proposed method provides an efficient and robust solution for realistic face swapping under varying illumination and appearance conditions without additional model training.

Fichier principal
Vignette du fichier
EI2026.pdf (1.64 Mo) Télécharger le fichier

Dates et versions

hal-05547390 , version 1 (11-03-2026)

Licence

Identifiants

  • HAL Id : hal-05547390 , version 1

Citer

Thu Hien Le, Christophe Charrier, Emmanuel Giguet, Maxime Bérubé. Retinex-guided Relighting and Latent-Space Refinement for Realistic Diffusion-based Face Swapping. Electonic Imaging, Media Watermarking, Security, and Forensics 2026, Mar 2026, Burlingame (CA), United States. ⟨hal-05547390⟩
329 Consultations
120 Téléchargements

Partager

  • More