Sparse Logistic Regression with High-order Features for Automatic Grammar Rule Extraction from Treebanks - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Sparse Logistic Regression with High-order Features for Automatic Grammar Rule Extraction from Treebanks

Résumé

Descriptive grammars are highly valuable, but writing them is time-consuming and difficult. Furthermore, while linguists typically use corpora to create them, grammar descriptions often lack quantitative data. As for formal grammars, they can be challenging to interpret. In this paper, we propose a new method to extract and explore significant fine-grained grammar patterns and potential syntactic grammar rules from treebanks, in order to create an easy-to-understand corpus-based grammar. More specifically, we extract descriptions and rules across different languages for two linguistic phenomena, agreement and word order, using a large search space and paying special attention to the ranking order of the extracted rules. For that, we use a linear classifier to extract the most salient features that predict the linguistic phenomena under study. We associate statistical information to each rule, and we compare the ranking of the model's results to those of other quantitative and statistical measures. Our method captures both well-known and less well-known significant grammar rules in Spanish, French, and Wolof.
Fichier principal
Vignette du fichier
2024.lrec-main.1314.pdf (238.09 Ko) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
Licence

Dates et versions

hal-04701105 , version 1 (18-09-2024)

Licence

Identifiants

Citer

Santiago Herrera, Caio Corro, Sylvain Kahane. Sparse Logistic Regression with High-order Features for Automatic Grammar Rule Extraction from Treebanks. Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), May 2024, Turin, Italy. ⟨10.48550/arXiv.2403.17534⟩. ⟨hal-04701105⟩
39 Consultations
12 Téléchargements

Altmetric

Partager

More