Automatic word segmentation for spoken Cantonese - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2015

Automatic word segmentation for spoken Cantonese

Roxana Fung
  • Fonction : Auteur
Brigitte Bigi

Résumé

Though Cantonese is the most influential variety of Chinese other than Mandarin, there are only a limited number of Cantonese corpora available for linguistic studies. Among the essential steps of building a corpus, word segmentation is a necessary but highly challenging task due to the lack of clear word boundary in Cantonese. This paper reports the construction and evaluation of an open-source automatic Cantonese word segmenter developed for Cantonese. The tool is a component of the multilingual SPPAS program designed to be used directly by linguists. It is a free software distributed under a GPL license. The effectiveness of the tool was evaluated by comparing the result of segmenting some samples of a spoken Cantonese corpus manually and automatically using the tool developed. High precision and recall were found in our study. Upon completion, the tool would definitely promote the development of more Cantonese corpora for language related studies.

Mots clés

Fichier non déposé

Dates et versions

hal-01455312 , version 1 (03-02-2017)

Identifiants

Citer

Roxana Fung, Brigitte Bigi. Automatic word segmentation for spoken Cantonese. Oriental COCOSDA and Conference on Asian Spoken Language Research and Evaluation (O-COCOSDA/CASLRE), 2015, Shanghai, Switzerland. pp.196--201, ⟨10.1109/ICSDA.2015.7357891⟩. ⟨hal-01455312⟩
111 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More