Anna Rumshisky
Biographic Data
| ID | 4985210 |
|---|---|
| NAME | Anna Rumshisky |
| GIVEN NAMES | Anna |
| FAMILY NAME | Rumshisky |
| SIGNATURE | RUMSHISKY A |
| AFFILIATIONS | Brandeis University |
| VERIFIED | No |
| TOTAL WORKS | 2 |
| TOTAL CITATIONS | 1 |
| AUTHOR COUNT | 2 |
| EDITOR COUNT | 0 |
| FIRST PUBLICATION YEAR | 2008 |
| LATEST PUBLICATION YEAR | 2020 |
| H-INDEX | 1 |
A Primer in Bertology: What We Know About How Bert Works
Transformer-based models have pushed state of the art in many areas of NLP, but our understanding of what is behind their success is still limited. This paper is the first survey of over 150 studies of the popular BERT model. We review the current state of knowledge about how BERT works, what kind of information it learns and how it is represented, common modifications to its training objectives and architecture, the overparameterization issue, a…
Between Chaos and Structure: Interpreting Lexical Data Through a Theoretical Lens
In this paper, we explore the inherent tension between corpus data and linguistic theory that aims to model it, with particular reference to the dynamic and variable nature of the lexicon. We explore the process through which modeling of the data is accomplished, presenting itself as a sequence of conflicting stages of discovery. First-stage data analysis informs the model, whereas the seeming chaos of organic data inevitably violates our theoret…
Between Chaos and Structure: Interpreting Lexical Data Through a Theoretical Lens
In this paper, we explore the inherent tension between corpus data and linguistic theory that aims to model it, with particular reference to the dynamic and variable nature of the lexicon. We explore the process through which modeling of the data is accomplished, presenting itself as a sequence of conflicting stages of discovery. First-stage data analysis informs the model, whereas the seeming chaos of organic data inevitably violates our theoret…
Between Chaos and Structure: Interpreting Lexical Data Through a Theoretical Lens
In this paper, we explore the inherent tension between corpus data and linguistic theory that aims to model it, with particular reference to the dynamic and variable nature of the lexicon. We explore the process through which modeling of the data is accomplished, presenting itself as a sequence of conflicting stages of discovery. First-stage data analysis informs the model, whereas the seeming chaos of organic data inevitably violates our theoret…
A Primer in Bertology: What We Know About How Bert Works
Transformer-based models have pushed state of the art in many areas of NLP, but our understanding of what is behind their success is still limited. This paper is the first survey of over 150 studies of the popular BERT model. We review the current state of knowledge about how BERT works, what kind of information it learns and how it is represented, common modifications to its training objectives and architecture, the overparameterization issue, a…
Computer Science (2 works) · Natural Language Processing Techniques (2 works) · Topic Modeling (2 works) · Architecture (1 works) · Art (1 works) · Artificial Intelligence (1 works) · Artificial Intelligence (1 works) · Authorship Attribution and Profiling (1 works) · CHAOS (operating system (1 works) · Computer security (1 works)