Marc Leman
Biographic Data
| ID | 1379319 |
|---|---|
| NAME | Marc Leman |
| GIVEN NAMES | Marc |
| FAMILY NAME | Leman |
| SIGNATURE | LEMAN M |
| AFFILIATIONS | Ghent University |
| ORCID | 0000-0002-9780-2194 |
| VERIFIED | Yes |
| TOTAL WORKS | 47 |
| TOTAL CITATIONS | 29 |
| AUTHOR COUNT | 44 |
| EDITOR COUNT | 3 |
| FIRST PUBLICATION YEAR | 1989 |
| LATEST PUBLICATION YEAR | 2023 |
| H-INDEX | 3 |
The assessment of presence and performance in an AR environment for motor imitation learning: A case-study on violinists
The acquisition of advanced gestures is a challenge in various domains of proficient sensorimotor performance. For example, orchestral violinists must move in sync with the lead violinist's gestures. To help train these gestures, an educational music play-back system was developed using a HoloLens 2 simulated AR environment and an avatar representation of the lead violinist. This study aimed to investigate the impact of using a 2D or 3D represent…
The virtual drum circle: Polyrhythmic Music Interactions in Mixed Reality
Emerging technologies in the domain of mixed reality offer rich, new possibilities for the study and practice of joint music performance. Apart from the technological challenges, bringing music players together in mixed reality raises important questions on their performance and embodied coordination. In this study, we designed a mixed reality platform to assess a remote, bidirectional polyrhythmic interaction between two players, mediated in rea…
Toward a meaningful technology for instrumental music education: Teachers’ voice
In musical instrument training, researchers have gradually started exploring the potential of interactive technologies supporting learning processes and teaching methods. Although numerous technological tools have been proposed to enhance instrument learning and teaching, these methods rarely find their way into daily practice and teaching routines. In this study, we report data from an online survey study administered to violin and drum kit teac…
Does musical interaction in a jazz duet modulate peripersonal space
Co-regulated timing in music ensembles: A Bayesian listener perspective
Co-regulated timing in a music ensemble rests on the human capacity to coordinate actions in time. Here we explore the hypothesis that humans predict timing constancy in coordinated actions, in view of timing their own actions in line with the others. An algorithm (BListener) is presented that predicts timing constancy, using Bayesian inference about incoming timing data from the music ensemble. The algorithm is then applied to a timing analysis …
The influence of performing gesture type on interpersonal musical timing, and the role of visual contact and tempo
Integrative Research in Art and Science: A Framework for Proactive Humanities
We argue that current cultural developments, driven by innovative technology, call for a reconsideration of the role of humanities as a field of study in which art and science is tightly integrated. This integration would allow the humanities to develop a proactive power such that it can (co-)steer the innovative developments of the techno-culture. Integrated art-science research may be realized in contexts where human expressive interaction with…
The effect of (a)synchronous music on runners’ lower leg impact loading
Running with musical accompaniment is becoming increasingly popular and several pieces of software have been developed that match the music tempo to the exerciser’s running cadence, that is, foot strikes per minute. Synchronizing music with running cadence has been shown to affect several aspects of performance output and perception. The purpose of this study was to investigate the effect of synchronous music on runners’ foot impact loading. This…
Expressive interaction with music
Exploring the effect of tempo changes on violinists’ body movements
In expressive music performance, tempo is known to be a fundamental parameter. In this article, we explored effects of changes in musical tempo on performers’ movement articulations. Eight duos (piano – violin) played two pieces at a predefined tempo, after which this start tempo was gradually increased and decreased. Throughout the different performances, we measured acceleration of the violinists’ head and right wrist, together with the downwar…
Beyond documentation – The digital philology of interaction heritage
A philologist's approach to heritage is traditionally based on the curation of documents, such as text, audio and video. However, with the advent of interactive multimedia, heritage becomes floating and volatile, and not easily captured in documents. We propose an approach to heritage that goes beyond documents. We consider the crucial role of institutes for interactive multimedia (as motor of a living culture of interaction) and propose that the…
Embodied, Participatory Sense-Making in Digitally-Augmented Music Practices: Theoretical Principles and the Artistic Case “SoundBikes”
Electronic and digital technologies open immense opportunities for music composition, listening, interaction, and participation. However, at the same time, they critically challenge some of the most basic principles that drive human engagement and interaction with music. This article first presents a theoretical discussion of two of these principles, namely sensorimotor control and participatory sense-making. Thereafter, it presents SoundBikes, a…
The Routledge Companion to Embodied Music Interaction
This chapter presents a cross-disciplinary summary review of literature that addresses the source of those physical and imagined intentions which motivate interacting bodies, focusing on the notion of ‘agency’. The concept of agency is seen to be of great significance to those who wish to characterize and understand musical engagement – and yet its meaning and usage appear to vary, both across and within disciplines. The chapter concludes by pres…
Routledge Companion to Embodied Music Interaction
Adopting a music-to-heart rate alignment strategy to measure the impact of music and its tempo on human heart rate
Music is frequently used as a means of relaxation. Conversely, it is used as a means of arousal in sports and exercise contexts. Previous research suggests that tempo is one of the most significant determinants of music-related arousal and relaxation effects. Here we investigate the specific effect of music tempo, but also more generally, the influence of music on human heart rate. We took the pulses of 32 participants in silence, and then we pla…
PLXTRM: Prediction-Led eXtended-guitar Tool for Real-time Music applications and live performance
This article presents PLXTRM, a system tracking picking-hand micro-gestures for real-time music applications and live performance. PLXTRM taps into the existing gesture vocabulary of the guitar player. On the first level, PLXTRM provides a continuous controller that doesn’t require the musician to learn and integrate extrinsic gestures, avoiding additional cognitive load. Beyond the possible musical applications using this continuous control, the…
Gestures in Contemporary Music Performance: A Method to Assist the Performer's Artistic Process
0
Evaluation and Recommendation of Pulse and Tempo Annotation in Ethnic Music
Large digital archives of ethnic music require automatic tools to provide musical content descriptions. While various automatic approaches are available, they are to a wide extent developed for Western popular music. This paper aims to analyse how automated tempo estimation approaches perform in the context of Central-African music. To this end we collect human beat annotations for a set of musical fragments, and compare them with automatic beat …
Musical Meter Classification with Beat Synchronous Acoustic Features, DFT-based Metrical Features and Support Vector Machines
This paper proposes a novel algorithm for the automatic classification of song excerpts according to their meter. The proposed algorithm performs two types of analyses: a local analysis of the acoustic properties (e.g. spectrum) in the vicinity of the beat and a larger time span analysis of the acoustic properties (e.g. pitch) measured during intervals between two successive beats. Compared to existing algorithms, it pays more attention to the te…
Tarsos, a Modular Platform for Precise Pitch Analysis of Western and Non-Western Music
This paper presents Tarsos, a modular software platform used to extract and analyse pitch organization in music. With Tarsos pitch estimations are generated from an audio signal and those estimations are processed in order to form musicologically meaningful representations. Tarsos aims to offer a flexible system for pitch analysis through the combination of an interactive user interface, several pitch estimation algorithms, filtering options, imm…
Using Narrative Analysis to Map the Control Parameters of Enhanced Operatic Singing
The concepts of mediality and embodied music cognition are relevant theories to improve the efficiency of the design of technologically enhanced performance environments. This paper discusses (i) relevant theories that may be applicable for the analysis of gestures in professional operatic singing performances, and (ii) the resulting gestural mappings that might then be used for building a vocal augmentation tool. A methodology is presented integ…
Synchronizing Music and Movement with BeatLED: An Interactive Musical Social Game
To study the rhythmical and social synchronization, also known as entrainment, that occurs when people move to music in a social context, novel applications that motivate and measure this behaviour are needed. In this paper, we describe the development of such an application, BeatLED, a social game that uses music, movement and luminescent textile. We analyse the requirements of such a musical social game, as well as the possible application fiel…
Assessing a Clarinet Player's Performer Gestures in Relation to Locally Intended Musical Targets
Musicianship is known to display high-level skills, which involve different aspects of mental processing and corporeal control. Of particular interest is the match between the musician's mental focus on musical targets (the so-called musical intentions) and the expressive (or so-called auxiliary) body movements. To what extent are these related to each other? And what does this relationship reveal about mind–body connections? To approach these qu…
The Influence of an Audience on Performers: A Comparison Between Rehearsal and Concert Using Audio, Video and Movement Data
For many people, live concerts occupy an important position in their experience of music. The interaction between audience and performers creates a special tension, which also influences the performing musicians. This paper presents a method to study how the presence of an audience influences performers. To study this influence, a concert with a singer and a viola da gamba player was recorded using audio, video and acceleration sensors (invisibly…
The Music Paint Machine: Stimulating Self-monitoring Through the Generation of Creative Visual Output Using a Technology-enhanced Learning Tool
In this paper, we discuss the pedagogically grounded and research-based design of a technology-enhanced learning tool, the Music Paint Machine. This interactive music system introduces a musical experience in which the musician creates a digital painting by playing an acoustic musical instrument and by moving the body on a coloured pressure mat. As a learning tool it aims at the development of musical creativity, at the stimulation of embodied un…
A Gesture-based Typology of Sliding-tones in Guqin Music
A good part of the expressive character of traditional Chinese guqin music can be accounted for in terms of sliding-tones, of which vibrato and portamento form major constituents. In this paper, a representative performance of a guqin piece formed the starting point for identifying an alphabet of basic movements on top of which it was possible to define different vibrato and portamento gesture types. The methodology is based on a pitch analysis o…
Prediction of Musical Affect Using a Combination of Acoustic Structural Cues
This study explores whether musical affect attribution can be predicted by a linear combination of acoustical structural cues. To that aim, a database of sixty musical audio excerpts was compiled and analyzed at three levels: judgments of affective content by subjects; judgments of structural content by musicological experts (i.e., "manual structural cues"), and extraction of structural content by an auditory-based computer algorithm (called: aco…
Schema-based tone center recognition of musical signals
This paper presents a model of schema‐based tone center recognition of musical signals. A distinction is made between passive and active schema‐based recognition. Passive recognition assumes the use of a schema as a template, that is, a pattern with which the new information is correlated. Active recognition assumes an active role of the schema itself. The model is part of a theory of musical morphology whose aim is to provide an operational acco…
Assessing a Clarinet Player's Performer Gestures in Relation to Locally Intended Musical Targets
Musicianship is known to display high-level skills, which involve different aspects of mental processing and corporeal control. Of particular interest is the match between the musician's mental focus on musical targets (the so-called musical intentions) and the expressive (or so-called auxiliary) body movements. To what extent are these related to each other? And what does this relationship reveal about mind–body connections? To approach these qu…
A Cross-modal Heuristic for Periodic Pattern Analysis of Samba Music and Dance
Samba delimits a privileged cultural territory, which is populated by a diverse set of dance and musical expressions. Although several authors have stressed the fact that music and dance are intrinsically coupled in samba culture, there is a lack of proper methods that allow the description of this relationship in terms of musical patterns and body movement. In this study, we develop a method to unravel this relationship, using a computational he…
The Societal Contexts for Sound and Music Computing: Research, Education, Industry, and Socio-Culture
The paper addresses the various contexts that determine the societal framework for research in the field of sound and music computing. Four of these contexts are identified, namely, the research context, the educational context, the industrial context and the socio-cultural context. For each context, the major trends are analysed and summarized as short statements, thus providing a background in which the state-of-the-art and the challenges of so…
The virtual drum circle: Polyrhythmic Music Interactions in Mixed Reality
Emerging technologies in the domain of mixed reality offer rich, new possibilities for the study and practice of joint music performance. Apart from the technological challenges, bringing music players together in mixed reality raises important questions on their performance and embodied coordination. In this study, we designed a mixed reality platform to assess a remote, bidirectional polyrhythmic interaction between two players, mediated in rea…
Co-regulated timing in music ensembles: A Bayesian listener perspective
Co-regulated timing in a music ensemble rests on the human capacity to coordinate actions in time. Here we explore the hypothesis that humans predict timing constancy in coordinated actions, in view of timing their own actions in line with the others. An algorithm (BListener) is presented that predicts timing constancy, using Bayesian inference about incoming timing data from the music ensemble. The algorithm is then applied to a timing analysis …
Embodied, Participatory Sense-Making in Digitally-Augmented Music Practices: Theoretical Principles and the Artistic Case “SoundBikes”
Electronic and digital technologies open immense opportunities for music composition, listening, interaction, and participation. However, at the same time, they critically challenge some of the most basic principles that drive human engagement and interaction with music. This article first presents a theoretical discussion of two of these principles, namely sensorimotor control and participatory sense-making. Thereafter, it presents SoundBikes, a…
Gestures in Contemporary Music Performance: A Method to Assist the Performer's Artistic Process
0
Tarsos, a Modular Platform for Precise Pitch Analysis of Western and Non-Western Music
This paper presents Tarsos, a modular software platform used to extract and analyse pitch organization in music. With Tarsos pitch estimations are generated from an audio signal and those estimations are processed in order to form musicologically meaningful representations. Tarsos aims to offer a flexible system for pitch analysis through the combination of an interactive user interface, several pitch estimation algorithms, filtering options, imm…
The Influence of an Audience on Performers: A Comparison Between Rehearsal and Concert Using Audio, Video and Movement Data
For many people, live concerts occupy an important position in their experience of music. The interaction between audience and performers creates a special tension, which also influences the performing musicians. This paper presents a method to study how the presence of an audience influences performers. To study this influence, a concert with a singer and a viola da gamba player was recorded using audio, video and acceleration sensors (invisibly…
The Music Paint Machine: Stimulating Self-monitoring Through the Generation of Creative Visual Output Using a Technology-enhanced Learning Tool
In this paper, we discuss the pedagogically grounded and research-based design of a technology-enhanced learning tool, the Music Paint Machine. This interactive music system introduces a musical experience in which the musician creates a digital painting by playing an acoustic musical instrument and by moving the body on a coloured pressure mat. As a learning tool it aims at the development of musical creativity, at the stimulation of embodied un…
Microtiming Patterns and Interactions with Musical Properties in Samba Music
In this study, we focus on the interaction between microtiming patterns and several musical properties: intensity, meter and spectral characteristics. The data-set of 106 musical audio excerpts is processed by means of an auditory model and then divided into several spectral regions and metric levels. The resulting segments are described in terms of their musical properties, over which patterns of peak positions and their intensities are sought. …
Adaptive dynamics of musical listening
The paper addressess issues related to the self-organization of the musical mind during perceptual learning: in particular, adaptation and changes of mental musical representations. The change of representation in response to perceptual information is called adaptive dynamics: a key concept in our understanding of all musical information processing mechanisms. An analysis of adaptive dynamics in the musical listening context is given in terms of …
Introduction to auditory models in music research
Schema-based tone center recognition of musical signals
This paper presents a model of schema‐based tone center recognition of musical signals. A distinction is made between passive and active schema‐based recognition. Passive recognition assumes the use of a schema as a template, that is, a pattern with which the new information is correlated. Active recognition assumes an active role of the schema itself. The model is part of a theory of musical morphology whose aim is to provide an operational acco…
The convergence paradigm, ecological modelling, and context-dependent pitch perception
The convergence paradigm assumes that the correlative study of behavioral data, physiological data and data from computer simulation may contribute to a better understanding of the processes that underlay music cognition. Computer simulation may provide a working hypothesis for the development, interpretation and explanation of psychological and physiological observations. The proposed paradigm for computer modelling is called ecological modellin…
Relevance of Neuromusicology for Music Research
The roles of sensory and cognitive neuromusicology with respect to music research are analyzed. After giving a characterization of the fields in terms of research traditions and the historical contexts, their musical relevance is discussed in view of the epistemological methodological, and ontological foundations
Automatic Harmonic Description of Musical Signals Using Schema-based Chord Decomposition
This paper presents a model for the harmonic description of musical signals using schema-based chord decomposition. The model is based (i) on a bottom-up processing of musical signals into auditory images of different kinds and (ii) on a schema-based top-down processing of the images which produces chord decomposition. The schema is carried by a neural network and its content is derived from the self-organization of a pre-selected set of chords i…
Introduction: Music and Time
The Ipem-archive Conservation and Digitalization Project
The IPEM-archive conservation and digitalization project aims at digitalizing the IPEM tape archive which consists of music produced, mainly, between 1963 and 1987. This period covers the area of the international institutional avant-garde in Flanders, Belgium. The archive contains a collection of electro-acoustic music on tapes, as well as related documents such as photographs, written texts, videos, etc....Associated with the digitalization of …
The Mega Project: Analysis and Synthesis of Multisensory Expressive Gesture in Performing Art Applications
This article presents a survey of the research work carried out within the framework of the European Union-IST project MEGA (Multisensory Expressive Gesture Applications, November 2000 – October 2003; www.megaproject.org). First, the article introduces a layered conceptual framework for analysis and synthesis of expressive gesture. Such a framework represents the main methodological foundation upon which the MEGA project built its own research. A…
Prediction of Musical Affect Using a Combination of Acoustic Structural Cues
This study explores whether musical affect attribution can be predicted by a linear combination of acoustical structural cues. To that aim, a database of sixty musical audio excerpts was compiled and analyzed at three levels: judgments of affective content by subjects; judgments of structural content by musicological experts (i.e., "manual structural cues"), and extraction of structural content by an auditory-based computer algorithm (called: aco…
Understanding musical expressiveness using interactive multimedia platforms
Background in musicology Understanding the gesture-based foundations of musical involvement opens a number of new perspectives for musicology, with the likely effect of a change in approach. Giving justice to the role of gesture in music calls for an integrated view of perception and action, which implies a shift from auditory-based cognition towards embodied cognition, an approach that includes the whole human body as mediator between mental pro…
Embodied Music Cognition and Mediation Technology
A proposal that an embodied cognition approach to music research—drawing on work in computer science, psychology, brain science, and musicology—offers a promising framework for thinking about music mediation technology. Digital media handles music as encoded physical energy, but humans consider music in terms of beliefs, intentions, interpretations, experiences, evaluations, and significations. In this book, drawing on work in computer science, p…
The Societal Contexts for Sound and Music Computing: Research, Education, Industry, and Socio-Culture
The paper addresses the various contexts that determine the societal framework for research in the field of sound and music computing. Four of these contexts are identified, namely, the research context, the educational context, the industrial context and the socio-cultural context. For each context, the major trends are analysed and summarized as short statements, thus providing a background in which the state-of-the-art and the challenges of so…
A Gesture-based Typology of Sliding-tones in Guqin Music
A good part of the expressive character of traditional Chinese guqin music can be accounted for in terms of sliding-tones, of which vibrato and portamento form major constituents. In this paper, a representative performance of a guqin piece formed the starting point for identifying an alphabet of basic movements on top of which it was possible to define different vibrato and portamento gesture types. The methodology is based on a pitch analysis o…
A Cross-modal Heuristic for Periodic Pattern Analysis of Samba Music and Dance
Samba delimits a privileged cultural territory, which is populated by a diverse set of dance and musical expressions. Although several authors have stressed the fact that music and dance are intrinsically coupled in samba culture, there is a lack of proper methods that allow the description of this relationship in terms of musical patterns and body movement. In this study, we develop a method to unravel this relationship, using a computational he…
Musical Gestures
We experience and understand the world, including music, through body movement–when we hear something, we are able to make sense of it by relating it to our body movements, or form an image in our minds of body movements. Musical Gestures is a collection of essays that explore the relationship between sound and movement. It takes an interdisciplinary approach to the fundamental issues of this subject, drawing on ideas, theories and methods from d…
Musical gestures: Sound, Movement, and Meaning
'Musical Gestures' is a collection of essays that explore the relationship between sound and movement. The book takes an interdisciplinary approach to the fundamental issues of this subject, drawing on ideas, theories and methods from disciplines such as musicology, music perception, and human movement science
An embodied approach to music semantics
This paper looks at a framework for music semantics, based on the concept of embodied music cognition (Leman, 2007). The first part presents the representational viewpoint on semantics and why one should aim at transcending this. The second part deals with different types of semantics, ranging from more mental to more corporeal ones. The third part discusses issues of semantics related to embodiment. It is argued that the embodiment approach, by …
User-oriented studies in embodied music cognition research
Music research aims at developing a research space that, in a proactive sense, can support the development of creative and cultural industries. In that context, we argue that a focus on users and their experiences in using tools may become more important in music research. It implies an expansion of the traditional methods of music psychology with methods that can address relevant features of musical action and musical tool use. This paper discus…
Gesture in Samba: A cross-modal analysis of dance and music from the Afro-Brazilian culture
Gesture in Samba: A cross-modal analysis of dance and music from the Afro-Brazilian culture
Microtiming Patterns and Interactions with Musical Properties in Samba Music
In this study, we focus on the interaction between microtiming patterns and several musical properties: intensity, meter and spectral characteristics. The data-set of 106 musical audio excerpts is processed by means of an auditory model and then divided into several spectral regions and metric levels. The resulting segments are described in terms of their musical properties, over which patterns of peak positions and their intensities are sought. …
Using Narrative Analysis to Map the Control Parameters of Enhanced Operatic Singing
The concepts of mediality and embodied music cognition are relevant theories to improve the efficiency of the design of technologically enhanced performance environments. This paper discusses (i) relevant theories that may be applicable for the analysis of gestures in professional operatic singing performances, and (ii) the resulting gestural mappings that might then be used for building a vocal augmentation tool. A methodology is presented integ…
Synchronizing Music and Movement with BeatLED: An Interactive Musical Social Game
To study the rhythmical and social synchronization, also known as entrainment, that occurs when people move to music in a social context, novel applications that motivate and measure this behaviour are needed. In this paper, we describe the development of such an application, BeatLED, a social game that uses music, movement and luminescent textile. We analyse the requirements of such a musical social game, as well as the possible application fiel…
Assessing a Clarinet Player's Performer Gestures in Relation to Locally Intended Musical Targets
Musicianship is known to display high-level skills, which involve different aspects of mental processing and corporeal control. Of particular interest is the match between the musician's mental focus on musical targets (the so-called musical intentions) and the expressive (or so-called auxiliary) body movements. To what extent are these related to each other? And what does this relationship reveal about mind–body connections? To approach these qu…
Computer Science (40 works) · Music Technology and Sound Studies (32 works) · Neuroscience and Music Perception (29 works) · Psychology (28 works) · Artificial Intelligence (25 works) · Music and Audio Processing (23 works) · Art (22 works) · Musical (20 works) · Visual arts (16 works) · Gesture (14 works)