Periods, Capitalized Words, etc
Bibliographic Data
| ID | 12155659 |
|---|---|
| Authors | Andrei Mikheev (University of Edinburgh, corresponding author) |
| Year | 2002 |
| Volume | 28 |
| Issue | 3 |
| Pages | 289-318 |
| Publication date | 2002-09-01 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Computational Linguistics (JOURNAL) |
| Journal identifiers | ISSN: 0891-2017 • E-ISSN: 1530-9312 |
| Publisher | Association for Computational Linguistics (PUBLISHER • US) |
| DOI | 10.1162/089120102760275992 |
| OpenAlex | W2127973959 |
| Language | EN |
| Citations received | 2 |
| References cited | 5 |
In this article we present an approach for tackling three important aspects of text normalization: sentence boundary disambiguation, disambiguation of capitalized words in positions where capitalization is expected, and identification of abbreviations. As opposed to the two dominant techniques of computing statistics or writing specialized grammars, our document-centered approach works by considering suggestive local contexts and repetitions of individual words within a document. This approach proved to be robust to domain shifts and new lexica and produced performance on the level with the highest reported results. When incorporated into a part-of-speech tagger, it helped reduce the error rate significantly on capitalized words and sentence boundaries. We also investigated the portability to other languages and obtained encouraging results
Capitalization · Domain (mathematical analysis · Identification (biology · Linguistics · Natural language processing · Normalization (sociology · Programming language · Rule-based machine translation · Sentence · Software portability · Algorithms and Data Compression · Computer Science · Data Mining Algorithms and Applications · Mathematics · Natural Language Processing Techniques · Artificial Intelligence
| Citations per year | 0.1 |
|---|---|
| Citation span | 2006 - 2016 (11) |
| Highly cited | No |