Machine readable grammar for optimizing automatic retrieval in text corpus - Archive ouverte HAL
Communication Dans Un Congrès Année : 2014

Machine readable grammar for optimizing automatic retrieval in text corpus

Prihantoro Prihantoro
  • Fonction : Auteur
  • PersonId : 1160676

Résumé

Machine Readable Grammar (MRG) is aimed at supporting the computer to perform Natural Language Processing (NLP) tasks. As for this paper, it discusses the one of the essences of MRG, which is to perform automatic retrieval in a text corpus. In automatic retrieval, the MRG serves a crucial importance in performing queries of the target expressions. In this research, I use Unitex, a Java based corpus processing software. It can manage texts from languages with their own alphabets such as Chinese, Greek, Japanese, Korean and etc. This software allows two different methods of queries. The first one is by using regular expression. This method resembles queries used in search engines like Google, Yahoo, Naver and some other well known search engines. The second one is by using Local Grammar Graphs (LGGs), which are the representation of finite state transducers (FSTs). When queries are performed by using LGGs, users can set various constraints and perform more complex retrievals. In terms of speed, regular expression works faster. But the advantage of LGGs is that it allows users to perform multiple retrievals and generate outputs at the same time. However, it depends completely on you to decide which MRG suits your goals.
Fichier principal
Vignette du fichier
prihantoro2014.pdf (402.86 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03767690 , version 1 (13-09-2022)

Identifiants

  • HAL Id : hal-03767690 , version 1

Citer

Prihantoro Prihantoro. Machine readable grammar for optimizing automatic retrieval in text corpus. Kongres Internasional Masyarakat Linguistik Indonesia (International Congress of the Indonesian Linguistic Society), Feb 2014, Bandar Lampung, Indonesia. ⟨hal-03767690⟩

Collections

LIGM_LINGU_INVITE
27 Consultations
32 Téléchargements

Partager

More