A Differentiable Entropy Model for Learned Image Compression - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

A Differentiable Entropy Model for Learned Image Compression

Résumé

In an end-to-end learned image compression framework, an encoder projects the image on a low-dimensional, quantized, latent space while a decoder recovers the original image. The encoder and decoder are jointly trained with standard gradient backpropagation to minimize a rate-distortion (RD) cost function accounting for both distortions between the original and reconstructed image and the quantized latent space rate. State-of-the-art methods rely on an auxiliary neural network to estimate the rate R of the latent space. We propose a non-parametric entropy model that estimates the statistical frequencies of the quantized latent space during training. The proposed model is differentiable, so it can be plugged into the cost function to be minimized as a rate proxy and can be adapted to a given context without retraining. Our experiments show comparable performance with a learned rate estimator and better performance when is adapted over a temporal context
Fichier non déposé

Dates et versions

hal-04253744 , version 1 (23-10-2023)

Identifiants

Citer

Alberto Presta, Attilio Fiandrotti, Enzo Tartaglione, Marco Grangetto. A Differentiable Entropy Model for Learned Image Compression. International Conference on Image Analysis and Processing – ICIAP 2023, Sep 2023, Udine, Italy. pp.328-339, ⟨10.1007/978-3-031-43148-7_28⟩. ⟨hal-04253744⟩
12 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More