Article Dans Une Revue IEEE Transactions on Visualization and Computer Graphics Année : 2026

An Autoethnography on Visualization Literacy: A Wicked Measurement Problem

Résumé

We contribute an autoethnographic reflection on the complexity of defining and measuring visualization literacy (i.e., the ability to interpret and construct visualizations) to expose our tacit thoughts that often exist in-between polished works and remain unreported in individual research papers. Our work is inspired by the growing number of empirical studies in visualization research that rely on visualization literacy as a basis for developing effective data representations or educational interventions. Researchers have already made various efforts to assess this construct, yet it is often hard to pinpoint either what we want to measure or what we are effectively measuring. In this autoethnography, we gather insights from 14 internal interviews with researchers who are users or designers of visualization literacy tests. We aim to identify what makes visualization literacy assessment a “wicked” problem. We further reflect on the fluidity of visualization literacy and discuss how this property may lead to misalignment between what the construct is and how measurements of it are used or designed. We also examine potential threats to measurement validity from conceptual, operational, and methodological perspectives. Based on our experiences and reflections, we propose several calls to action aimed at tackling the wicked problem of visualization literacy measurement, such as by broadening test scopes and modalities, improving test ecological validity, making it easier to use tests, seeking interdisciplinary collaboration, and drawing from continued dialogue on visualization literacy to expect and be more comfortable with its fluidity.

Fichier principal
Vignette du fichier
VIS25_Vis_literacy_autoethnography_paper.pdf (463.09 Ko) Télécharger le fichier
Vignette du fichier
VL preview.png (92.87 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence
Format Figure, Image
Licence

Dates et versions

hal-05245265 , version 1 (08-09-2025)

Licence

Identifiants

Citer

Lily W Ge, Anne-Flore Cabouat, Karen Bonilla, Yuan Cui, Yiren Ding, et al.. An Autoethnography on Visualization Literacy: A Wicked Measurement Problem. IEEE Transactions on Visualization and Computer Graphics, inPress, 32 (1), pp.1394-1404. ⟨10.1109/TVCG.2025.3634792⟩. ⟨hal-05245265⟩
8838 Consultations
528 Téléchargements

Altmetric

Partager

  • More