Ella Reiter
Biographic Data
| ID | 219540 |
|---|---|
| NAME | Ella Reiter |
| GIVEN NAMES | Ella |
| FAMILY NAME | Reiter |
| SIGNATURE | REITER E |
| AFFILIATIONS | University of Aberdeen |
| ORCID | 0000-0002-7548-9504 |
| VERIFIED | Yes |
| TOTAL WORKS | 9 |
| TOTAL CITATIONS | 5 |
| WORKS AS AUTHOR | 9 |
| WORKS AS EDITOR | 0 |
| FIRST PUBLICATION YEAR | 2000 |
| LATEST PUBLICATION YEAR | 2026 |
| H-INDEX | 1 |
Reconstructing human–animal interactions via multiproxy analysis of dog paleofeces from the medieval Central Balkans
An integrated archaeological and anthropological approach to investigating human sacrifice among Etruscans
Common Flaws in Running Human Evaluation Experiments in NLP
While conducting a coordinated set of repeat runs of human evaluation experiments in NLP, we discovered flaws in every single experiment we selected for inclusion via a systematic process. In this squib, we describe the types of flaws we discovered, which include coding errors (e.g., loading the wrong system outputs to evaluate), failure to follow standard scientific practice (e.g., ad hoc exclusion of participants and responses), and mistakes in…
A Structured Review of the Validity of BLEU
The BLEU metric has been widely used in NLP for over 15 years to evaluate NLP systems, especially in machine translation and natural language generation. I present a structured review of the evidence on whether BLEU is a valid evaluation technique—in other words, whether BLEU scores correlate with real-world utility and user-satisfaction of NLP systems; this review covers 284 correlations reported in 34 papers. Overall, the evidence supports usin…
Providing Adaptive Health Updates Across the Personal Social Network
This article presents research conducted to establish how information is shared across the personal social network in the sensitive context of a health crisis. We worked with parents of very sick babies who were cared for in a hospital's Neonatal Unit (NNU). Through a combination of interviews, a focus group, and surveys, we developed a user model of the information that parents wanted to share, and how they adapted this information to individual…
An Investigation into the Validity of Some Metrics for Automatically Evaluating Natural Language Generation Systems
There is growing interest in using automatically computed corpus-based evaluation metrics to evaluate Natural Language Generation (NLG) systems, because these are often considerably cheaper than the human-based evaluations which have traditionally been used in NLG. We review previous work on NLG evaluation and on validation of automatic metrics in NLP, and then present the results of two studies of how well some metrics which are popular in other…
The Shrinking Horizons of Computational Linguistics
The Problem
Human Variation and Lexical Choice
Much natural language processing research implicitly assumes that word meanings are fixed in a language community, but in fact there is good evidence that different people probably associate slightly different meanings with words. We summarize some evidence for this claim from the literature and from an ongoing research project, and discuss its implications for natural language generation, especially for lexical choice, that is, choosing appropri…
Pipelines and Size Constraints
Some types of documents need to meet size constraints, such as fitting into a limited number of pages. This can be a difficult constraint to enforce in a pipelined natural language generation (NLG) system, because size is mostly determined by content decisions, which usually are made at the beginning of the pipeline, but size cannot be accurately measured until the document has been completely processed by the NLG system. I present experimental d…
An Investigation into the Validity of Some Metrics for Automatically Evaluating Natural Language Generation Systems
There is growing interest in using automatically computed corpus-based evaluation metrics to evaluate Natural Language Generation (NLG) systems, because these are often considerably cheaper than the human-based evaluations which have traditionally been used in NLG. We review previous work on NLG evaluation and on validation of automatic metrics in NLP, and then present the results of two studies of how well some metrics which are popular in other…
The Shrinking Horizons of Computational Linguistics
The Problem
Pipelines and Size Constraints
Some types of documents need to meet size constraints, such as fitting into a limited number of pages. This can be a difficult constraint to enforce in a pipelined natural language generation (NLG) system, because size is mostly determined by content decisions, which usually are made at the beginning of the pipeline, but size cannot be accurately measured until the document has been completely processed by the NLG system. I present experimental d…
Pipelines and Size Constraints
Some types of documents need to meet size constraints, such as fitting into a limited number of pages. This can be a difficult constraint to enforce in a pipelined natural language generation (NLG) system, because size is mostly determined by content decisions, which usually are made at the beginning of the pipeline, but size cannot be accurately measured until the document has been completely processed by the NLG system. I present experimental d…
Human Variation and Lexical Choice
Much natural language processing research implicitly assumes that word meanings are fixed in a language community, but in fact there is good evidence that different people probably associate slightly different meanings with words. We summarize some evidence for this claim from the literature and from an ongoing research project, and discuss its implications for natural language generation, especially for lexical choice, that is, choosing appropri…
The Shrinking Horizons of Computational Linguistics
The Problem
An Investigation into the Validity of Some Metrics for Automatically Evaluating Natural Language Generation Systems
There is growing interest in using automatically computed corpus-based evaluation metrics to evaluate Natural Language Generation (NLG) systems, because these are often considerably cheaper than the human-based evaluations which have traditionally been used in NLG. We review previous work on NLG evaluation and on validation of automatic metrics in NLP, and then present the results of two studies of how well some metrics which are popular in other…
Providing Adaptive Health Updates Across the Personal Social Network
This article presents research conducted to establish how information is shared across the personal social network in the sensitive context of a health crisis. We worked with parents of very sick babies who were cared for in a hospital's Neonatal Unit (NNU). Through a combination of interviews, a focus group, and surveys, we developed a user model of the information that parents wanted to share, and how they adapted this information to individual…
A Structured Review of the Validity of BLEU
The BLEU metric has been widely used in NLP for over 15 years to evaluate NLP systems, especially in machine translation and natural language generation. I present a structured review of the evidence on whether BLEU is a valid evaluation technique—in other words, whether BLEU scores correlate with real-world utility and user-satisfaction of NLP systems; this review covers 284 correlations reported in 34 papers. Overall, the evidence supports usin…
Common Flaws in Running Human Evaluation Experiments in NLP
While conducting a coordinated set of repeat runs of human evaluation experiments in NLP, we discovered flaws in every single experiment we selected for inclusion via a systematic process. In this squib, we describe the types of flaws we discovered, which include coding errors (e.g., loading the wrong system outputs to evaluate), failure to follow standard scientific practice (e.g., ad hoc exclusion of participants and responses), and mistakes in…
An integrated archaeological and anthropological approach to investigating human sacrifice among Etruscans
Reconstructing human–animal interactions via multiproxy analysis of dog paleofeces from the medieval Central Balkans
Computer Science (7 works) · Natural Language Processing Techniques (6 works) · Artificial Intelligence (5 works) · Natural language processing (5 works) · Topic Modeling (5 works) · Natural language (3 works) · Speech and dialogue systems (3 works) · Archaeology and ancient environmental studies (2 works) · Linguistics (2 works) · Machine learning (2 works)