ARTICLE
vincia04a-art/IDIAP
Noisy Text Categorization
Vinciarelli, Alessandro
EXTERNAL
https://publications.idiap.ch/attachments/reports/2004/rr04-03.pdf
PUBLIC
https://publications.idiap.ch/index.php/publications/showcite/vincia04a
Related documents
IEEE Transactions on Pattern Analysis and Machine Intelligence
27
12
1882-1295
2005
IDIAP-RR 04-03
This work presents categorization experiments performed over noisy texts. By noisy it is meant any text obtained through an extraction process (affected by errors) from media other than digital texts (e.g. transcriptions of speech recordings extracted with a recognition system). The performance of a categorization system over the clean and noisy (Word Error Rate between 10 and 50 percent) versions of the same documents is compared. The noisy texts are obtained through Handwriting Recognition and simulation of Optical Character Recognition. The results show that the performance loss is acceptable and it is especially low for Recall values lower than 60 percent. New measures of the extraction process performance, allowing a better explanation of the categorization results, are proposed.
REPORT
vincia04a/IDIAP
Noisy Text Categorization
Vinciarelli, Alessandro
EXTERNAL
https://publications.idiap.ch/attachments/reports/2004/rr04-03.pdf
PUBLIC
Idiap-RR-03-2004
2004
IDIAP
accepted for publication by IEEE Transactions on Pattern Analysis and Machine Intelligence
This work presents categorization experiments performed over noisy texts. By noisy it is meant any text obtained through an extraction process (affected by errors) from media other than digital texts (e.g. transcriptions of speech recordings extracted with a recognition system). The performance of a categorization system over the clean and noisy (Word Error Rate between 10 and 50 percent) versions of the same documents is compared. The noisy texts are obtained through Handwriting Recognition and simulation of Optical Character Recognition. The results show that the performance loss is acceptable and it is especially low for Recall values lower than 60 percent. New measures of the extraction process performance, allowing a better explanation of the categorization results, are proposed.