Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

The Impact of Edge Displacement Vaserstein Distance on UD Parsing Performance

Bibliographic Data

ID12156010
AuthorsMark Anderson (0000-0002-6400-8760, Universidade da Coruña, CITIC. [email protected], corresponding author), Carlos Gómez‐Rodríguez (0000-0003-0752-8812, CITIC Group (China), corresponding author), Carlos Gómez-Rodríguez (Universidade da Coruña, CITIC. [email protected])
Year2022
Volume48
Issue3
Pages517-554
Publication date2022-01-01
Open AccessYes
TypeARTICLE
VenueComputational Linguistics (JOURNAL)
Journal identifiersISSN: 0891-2017 • E-ISSN: 1530-9312
PublisherAssociation for Computational Linguistics (PUBLISHER • US)
DOI10.1162/coli_a_00440
OpenAlexW4225729798
LanguageEN
References cited46

We contribute to the discussion on parsing performance in NLP by introducing a measurement that evaluates the differences between the distributions of edge displacement (the directed distance of edges) seen in training and test data. We hypothesize that this measurement will be related to differences observed in parsing performance across treebanks. We motivate this by building upon previous work and then attempt to falsify this hypothesis by using a number of statistical methods. We establish that there is a statistical correlation between this measurement and parsing performance even when controlling for potential covariants. We then use this to establish a sampling technique that gives us an adversarial and complementary split. This gives an idea of the lower and upper bounds of parsing systems for a given treebank in lieu of freshly sampled data. In a broader sense, the methodology presented here can act as a reference for future correlation-based exploratory work in NLP

Adversarial system · Bottom-up parsing · Displacement (psychology · Enhanced Data Rates for GSM Evolution · Natural language processing · Parsing · Top-down parsing · Treebank · Computer Science · Natural Language Processing Techniques · Psychology · Software Engineering Research · Topic Modeling · Artificial Intelligence

  • An Analysis of Variance Test for Normality (Complete Samples)

    Samuel S Shapiro, M B WILK•Biometrika•1965

  • Relative Importance for Linear Regression in R

    Open Access•Ulrike Grömping•Journal of Statistical Software•2006

  • Pingouin

    Open Access•Raphael Vallat•Journal of Open Source Software•2018

  • Dependency Distance as a Metric of Language Comprehension Difficulty

    Open Access•Haitao Liu, Haitao Liu Haitao Liu•Journal of Cognitive Science•2008

  • Large-scale evidence of dependency length minimization in 37 languages

    Open Access•Richard Futrell, Kyle Mahowald et al.•Proceedings of the National…•2015

  • Dependency distance

    Open Access•Haitao Liu, Chunshan Xu et al.•Physics of Life Reviews•2017

  • A Mathematical Theory of Communication

    Claude E Shannon•Bell System Technical Journal•1948

  • The risks of mixing dependency lengths from sequences of different length

    Ramon Ferrer-I-Cancho, Haitao Liu•Glottotheory•2014

  • Multicollinearity in Regression Analysis

    Donald E Farrar, Robert R Glauber•The Review of Economics and…•1967

  • Minimizing Syntactic Dependency Lengths

    Open Access•David Temperley, Daniel Gildea•Annual Review of Linguistics•2017

  • Analyzing and Integrating Dependency Parsers

    Open Access•Ryan McDonald, Joakim Nivre•Computational Linguistics•2011

  • The effects of sentence length on dependency distance, dependency direction and the implications-Based on a parallel English-Chinese dependency treebank

    Open Access•Jingyang Jiang, Haitao Liu•Language Sciences•2015

Highly citedNo

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae