How to (Auto) Collate Big Manuscript Data with Minimal HTR Training - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2022

How to (Auto) Collate Big Manuscript Data with Minimal HTR Training

Elpida Perdiki
  • Fonction : Auteur
  • PersonId : 1196991

Résumé

HTR (Handwritten Text Recognition) technologies have progressed enough to offer high-accuracy results in recognising handwritten documents, even on a synchronous level. Despite the state-of-the-art algorithms and software, historical documents (especially those written in Greek) remain a real-world challenge for researchers. A large number of unedited or under-edited works of Greek Literature (ancient or byzantine, especially the latter) exist to this day due to the complexity of producing critical editions. To critically edit a literary text, scholars need to pinpoint text variations on several manuscripts, which requires fully (or at least partially) transcribed manuscripts. For a large manuscript tradition (i.e., a large number of manuscripts transmitting the same work), such a process can be a painstaking and time-consuming project. To that end, HTR algorithms that train AI models can significantly assist, even when not resulting in entirely accurate transcriptions. Deep learning models, though, require a quantum of data to be effective. This, in turn, intensifies the same problem: big (transcribed) data require heavy loads of manual transcriptions as training sets. In the absence of such transcriptions, this study experiments with training sets of various sizes to determine the minimum amount of manual transcription needed to produce usable results. HTR models are trained through the Transkribus platform (transkribus.eu) on manuscripts from multiple works of a single Byzantine author, John Chrysostom. By gradually reducing the number of manually transcribed texts and by training mixed models from multiple manuscripts, economic transcriptions of large bodies of manuscripts (in the hundreds) can be achieved. Results of these experiments show that if the right combination of manuscripts is selected, and with the transferlearning tools provided by Transkribus, the required training sets can be reduced by up to 80%. Certain peculiarities of Greek manuscripts, which lead to easy automated cleaning of resulting transcriptions, could further improve these results. This study also tests the usability of these transcriptions, which are automatically produced by the HTR models, through several text collation tools. The aim is to distinguish each manuscript's position in the textual tradition of Chrysostom's works, i.e., the grouping of manuscripts according to the text variations they transmit. For large manuscript traditions, manually processed table alignment of text variations is unattainable. Automated collation is achieved through various methods, e.g., a) heat map histograms of text variants or b) multiple sequence analysis in a tree visualisation, forming a series of branching points that connect ancestors (manuscripts serving as prototypes for copies). Less could be more if we can correctly evaluate HTR learning and results. This case study proposes a solution for researching/editing authors and works that were popular enough to survive in hundreds (if not thousands) of manuscripts and is, therefore, unfeasible to be evaluated by humans.
Fichier principal
Vignette du fichier
Perdiki_How to Auto-collate Big Manuscript Data with Minimal HTR Training.pdf (759.65 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03880102 , version 1 (30-11-2022)
hal-03880102 , version 2 (27-02-2023)
hal-03880102 , version 3 (28-10-2023)
hal-03880102 , version 4 (06-12-2023)

Identifiants

  • HAL Id : hal-03880102 , version 1

Citer

Elpida Perdiki. How to (Auto) Collate Big Manuscript Data with Minimal HTR Training. 2022. ⟨hal-03880102v1⟩
269 Consultations
546 Téléchargements

Partager

More