Alignment of Noisy Unstructured Text Data - Archive ouverte HAL
Communication Dans Un Congrès Année : 2007

Alignment of Noisy Unstructured Text Data

Résumé

This paper describes a textual aligner named MEDITE whose specificity is the detection of moves. It was developed to solve a problem from textual genetic criticism, a humanities discipline that compares different versions of authors’ texts in order to highlight invariants and differences between them. Our aligner handles this task and it is general enough to handle others. The algorithm, based on the edit distance with moves, aligns duplicated character blocks with an A∗ heuristic algorithm. We present an experimental evaluation of our algorithm by comparing it with similar ones in four experiments. The first one deals with the alignment of texts with a large amount of repetitions; we show it is a very difficult problem. Two other experiments are duplicate linkage and text reuse detection. Finally, the algorithm is tested with synthetic data.
Fichier non déposé

Dates et versions

hal-01306265 , version 1 (22-04-2016)

Identifiants

  • HAL Id : hal-01306265 , version 1

Citer

Julien Bourdaillet, Jean-Gabriel Ganascia. Alignment of Noisy Unstructured Text Data. 20th International Joint Conference on Artificial Intelligence (IJCAI). Workshop on Analytics for Noisy Unstructured Text Data (AND 2007), Jan 2007, Hyderabad, India. pp.139-146. ⟨hal-01306265⟩
136 Consultations
0 Téléchargements

Partager

More