Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

An Open Capt System for Prosody Practice

Practical Steps towards Multilingual Setup

Bibliographic Data

ID5901027
AuthorsJohn Blake (0000-0002-3150-4995, University of Aizu, corresponding author), Natalia Bogach (0000-0001-6563-6040, Peter the Great St. Petersburg Polytechnic University, corresponding author), Akemi Kusakari (Hachinohe National College of Technology), Iurii Lezhenin (0000-0002-4737-7249, Peter the Great St. Petersburg Polytechnic University), Veronica Khaustova (0000-0003-0965-1515, University of Aizu), Son Luu Xuan (Suntory (Japan)), Van Nhi Nguyen (Oji Holdings (Japan)), Nam Ba Pham (Peter the Great St. Petersburg Polytechnic University), Roman Svechnikov (Peter the Great St. Petersburg Polytechnic University), Andrey Ostapchuk (Peter the Great St. Petersburg Polytechnic University), Dmitrei Efimov (Peter the Great St. Petersburg Polytechnic University), Evgeny Pyshkin (0000-0002-7923-7988, University of Aizu, corresponding author)
Year2024
Volume9
Issue1
Pages27
Publication date2024-01-12
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueLanguages (JOURNAL)
Journal identifiersISSN: 2226-471X • E-ISSN: 2226-471X
PublisherMDPI AG (PUBLISHER • IT)
DOI10.3390/languages9010027
OpenAlexW4390812903
LanguageEN
Citations received1
References cited38

This paper discusses the challenges posed in creating a Computer-Assisted Pronunciation Training (CAPT) environment for multiple languages. By selecting one language from each of three different language families, we show that a single environment may be tailored to cater for different target languages. We detail the challenges faced during the development of a multimodal CAPT environment comprising a toolkit that manages mobile applications using speech signal processing, visualization, and estimation algorithms. Since the applied underlying mathematical and phonological models, as well as the feedback production algorithms, are based on sound signal processing and modeling rather than on particular languages, the system is language-agnostic and serves as an open toolkit for developing phrasal intonation training exercises for an open selection of languages. However, it was necessary to tailor the CAPT environment to the language-specific particularities in the multilingual setups, especially the additional requirements for adequate and consistent speech evaluation and feedback production. In our work, we describe our response to the challenges in visualizing and segmenting recorded pitch signals and modeling the language melody and rhythm necessary for such a multilingual adaptation, particularly for tonal syllable-timed and mora-timed languages

Adaptation (eye · Intonation (linguistics · Linguistics · Natural language processing · Pronunciation · Prosody · Selection (genetic algorithm · Speech recognition · Syllable · Computer Science · Music and Audio Processing · Phonetics and Phonology Research · Speech Recognition and Synthesis · Artificial Intelligence

  • A scientometric study of computer-assisted pronunciation training in second language acquisition

    Open Access•Mohammed Ali Mohsen, Hassan Saleh Mahdi et al.•Humanities and Social Sciences…•2025

  • Intonational Phonology

    Open Access•D Robert Ladd•Intonational Phonology•2008

  • Rhythm, Timing and the Timing of Rhythm

    Open Access•Amalia Arvaniti•Phonetica•2009

  • The persistence of matching teaching and learning styles

    Open Access•Stephen B R E Brown•Frontiers in Education•2023

  • Vietnamese Tone

    Andrea Hòa Phạm, Laurence Horn•Vietnamese Tone•2004

  • Globalization, glocalization and the ICT revolution

    Open Access•Roudometof•Global Media and Communication•2023

  • Are Asian Language Speakers Similar or Different? The Perception of Mandarin Lexical Tones by Naïve Listeners from Tonal Language Backgrounds

    Kimiko Tsukada•Australian Journal of Linguistics•2019

  • Pronunciation learner autonomy

    Open Access•Shannon McCrocklin, Shannon M McCrocklin•System•2016

  • The effectiveness of embodied prosodic training in L2 accentedness and vowel accuracy

    Open Access•Peng Li, Florence Baills et al.•Second language Research•2022

  • Multimodal input in second-language speech processing

    Open Access•Debra M Hardison•Language Teaching•2021

  • The Mora and Syllable Structure in Japanese

    Open Access•Haruo Kubozono•Language and Speech•1989

  • Learning Styles

    Open Access•Harold Pashler, Mark A Mcdaniel et al.•Psychological Science in the…•2008

Unique citing works1
Citations per year1
Citation span2025 - 2025 (1)
Citation velocityrecent
Highly citedNo
Citation typesNeutral: 1

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae