The Other Side of Compression: Measuring Bias in Pruned Transformers - Archive ouverte HAL Access content directly
Conference Papers Year : 2023

The Other Side of Compression: Measuring Bias in Pruned Transformers

Abstract

Social media platforms have become popular worldwide. Online discussion forums attract users because of their easy access, speech freedom, and ease of communication. Yet there are also possible negative aspects of such communication, including hostile and hate language. While fast and effective solutions for detecting inappropriate language online are constantly being developed, there is little research focusing on the bias of compressed language models that are commonly used nowadays. In this work, we evaluate bias in compressed models trained on Gab and Twitter speech data and estimate to which extent these pruned models capture the relevant context when classifying the input text as hateful, offensive or neutral. Results of our experiments show that transformer-based encoders with 70% or fewer preserved weights are prone to gender, racial, and religious identity-based bias, even if the performance loss is insignificant. We suggest a supervised attention mechanism to counter bias amplification using ground truth per-token hate speech annotation. The proposed method allows pruning BERT, RoBERTa and their distilled versions up to 50% while preserving 90% of their initial performance according to bias and plausibility scores.
Fichier principal
Vignette du fichier
I_Proskurina_Bias_in_Pruned_Transformers.pdf (435.6 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Licence : CC BY - Attribution

Dates and versions

hal-04104840 , version 1 (24-05-2023)

Identifiers

Cite

Irina Proskurina, Guillaume Metzler, Julien Velcin. The Other Side of Compression: Measuring Bias in Pruned Transformers. IDA 2023 - 21th International Symposium on Intelligent Data Analysis, Apr 2023, Louvain-la-Neuve - Belgique, Belgium. pp.366-378, ⟨10.1007/978-3-031-30047-9_29⟩. ⟨hal-04104840⟩
81 View
80 Download

Altmetric

Share

Gmail Facebook X LinkedIn More