Learning-Based Fast Splitting and Directional Mode Decision for VVC Intra Prediction - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Broadcasting Année : 2024

Learning-Based Fast Splitting and Directional Mode Decision for VVC Intra Prediction

Résumé

As the latest video coding standard, Versatile Video Coding (VVC) is highly efficient at the cost of very high coding complexity, which seriously hinders its practical application. Therefore, it is very crucial to improve its coding speed. In this paper, we propose a learning-based fast split mode (SM) and directional mode (DM) decision algorithm for VVC intra prediction using a deep learning approach. Specifically, given the observation that the SM distributions of coding units (CUs) of different sizes are significantly distinct, we first design the neural networks separately and train the SM models for all CUs of different sizes to obtain the probability of SMs and skip the unlikely ones. Second, given a similar observation that the DM distributions of CUs of different sizes are distinct, we design neural networks to train the DM models for all CUs of different sizes separately to obtain the probabilities of DMs, and then adaptively select candidate DMs based on probabilities of their located SMs. Third, after an SM is checked, we select its probability, residual coefficients, rate-distortion (RD) cost, etc. as features, and design a lightweight neural network (LNN) model to early terminate SM selection. Experimental results demonstrate that the proposed algorithm can reduce the encoding time of VVC by 70.73% with 2.44% increase in Bjøntegaard delta bitrate (BDBR) on average.
Fichier principal
Vignette du fichier
2024_TBC_WANG_et_al.pdf (2.32 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04467050 , version 1 (20-03-2024)

Identifiants

Citer

Yuanyuan Huang, Junyi Yu, Dayong Wang, Xin Lu, Frédéric Dufaux, et al.. Learning-Based Fast Splitting and Directional Mode Decision for VVC Intra Prediction. IEEE Transactions on Broadcasting, inPress, ⟨10.1109/TBC.2024.3360729⟩. ⟨hal-04467050⟩
46 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More