Discovering Unexpected Documents in Corpora - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Knowledge-Based Systems Année : 2009

Discovering Unexpected Documents in Corpora

François Jacquenet
Christine Largeron

Résumé

Text mining is widely used to discover frequent patterns in large corpora of documents. Hence, many classical data mining techniques, that have been proven fruitful in the context of data stored in relational databases, are now successfully used in the context of textual data. Nevertheless, there are many situations where it is more valuable to discover unexpected information rather than frequent ones. In the context of technology watch for example, we may want to discover new trends in specific markets, or discover what competitors are planning in the near future, etc. This paper is related to that context of research. We have proposed several unexpectedness measures and implemented them in a prototype, called UnexpectedMiner, that can be used by watchers, in order to discover unexpected documents in large corpora of documents (patents, datasheets, advertisements, scientific papers, etc.). UnexpectedMiner is able to take into account the structure of documents during the discovery of unexpected information. Many experiments have been performed in order to validate our measures and show the interest of our system.
Fichier non déposé

Dates et versions

hal-00387505 , version 1 (25-05-2009)

Identifiants

  • HAL Id : hal-00387505 , version 1

Citer

François Jacquenet, Christine Largeron. Discovering Unexpected Documents in Corpora. Knowledge-Based Systems, 2009, 22 (6), pp.421-429. ⟨hal-00387505⟩
71 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More