Poster De Conférence Année : 2025

ATILF at NTCIR-18 RadNLP 2024 Shared Task: With less radiology reports, comes less performance (Poster)

Résumé

We present our results on the main task and subtask of the NTCIR-18 RadNLP 2024 shared task on the English language. We tested to what extent Large Language Models (LLMs) and Pretrained Language Models (PLMs) can identify and classify tumor types and subtypes. Our results for the main task showed that LLMs have difficulties in understanding different subtypes of tumors. For the tumor sentence segment classification subtask, we obtained competitive overall score with pretrained language models with an overall score of 0.83 for micro F2.0 metric. Our results showed that in low amount of data setting, we have a better chance with clinical PLMs in comparison to general and domain specific LLMs. Providing additional information such definitions in case clinical staging classification can help LLMs achieve better scores on fine-grained classification.

Fichier principal
Vignette du fichier
RADNLPoSTER.pdf (1.36 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-05153470 , version 1 (09-07-2025)

Licence

Identifiants

  • HAL Id : hal-05153470 , version 1

Citer

Aman Sinha, Ioana Buhnila. ATILF at NTCIR-18 RadNLP 2024 Shared Task: With less radiology reports, comes less performance (Poster). NTCIR-18: Proceedings of the 18th NTCIR Conference on Evaluation of Information Access Technologies, Jun 2025, Tokyo, Japan. ⟨hal-05153470⟩
76 Consultations
29 Téléchargements

Partager

  • More