Effect of Document Representation on the Performance of Medical Document Classification

F. H. Saad, B. de la Iglesia, G. D. Bell

Research output: Contribution to conferencePaper

Abstract

Text classification in the medical domain is a real world problem with wide applicability. This paper investigates extensively the effect of text representation approaches on the performance of medical document classification. To accomplish this objective, we evaluated seven different approaches to represent real word medical documents. The text representation approaches investigated in this paper are basic word representation (bag-of-words), key-phrases, collocation extracted from preprocessed text, collocation extracted from postprocessed text, single-word-nouns, combination of singleword-noun and adjectives and combination of single-wordnoun, adjective and verbs. A set of experiments was conducted to make comprehensive evaluation of the effects of these representation approaches using real world medical documents by measuring the classification performance. We measured classification performance with information retrieval metrics; precision, recall, F-measure and accuracy. Our experimental results show that bag-ofwords representation outperforms all other representation approaches. In addition, careful use of selected features improve the classification performance.
Original languageEnglish
Pages83-89
Number of pages7
Publication statusPublished - 2006
EventProceedings of the 2006 International Conference on Data Mining (DMIN-06) - Las Vegas, NV
Duration: 26 Jun 200629 Jun 2006

Conference

ConferenceProceedings of the 2006 International Conference on Data Mining (DMIN-06)
CityLas Vegas, NV
Period26/06/0629/06/06

Cite this