
SoundNet: Investigating a language composed of environmental sounds. Cognitive and biomechanical influences in pianists finger tapping. Human brain regions involved in recognizing environmental sounds. Sharing musical expression through embodied listening: A case study based on Chinese Guqin music. Massachusetts Institute of Technology Press. Embodied Music Cognition and Mediation Technology. Journal of Experimental Psychology: Applied 16, 1 (2010), 16-32. Listener expertise and sound identification influence the categorization of environmental sounds. The Journal of the Acoustical Society of America 131 (2012), 1337. Auditory perception of material is fragile while action is strikingly robust. Hearing sounds, understanding actions: action representation in mirror neurons.

Journal of Experimental Psychology: Applied 18, 1 (2012), 52-80. A lexical analysis of environmental sound categories. Similarity and categorization of environmental sounds. The Journal of the Acoustical Society of America 115 (2004), 1252. Spectral-temporal factors in the identification of environmental sounds. Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale 61, 1 (2007), 54. Playing “air instruments”: Mimicry of sound-producing gestures by novices and experts. In Proceedings of the COST287-ConGAS 2nd International Symposium on Gesture Interfaces for Multimedia Systems (GIMS’06). Exploring music-related gestures by sound-tracing: A preliminary study. Gestural-sonorous objects: embodied extensions of Schaeffer’s conceptual apparatus. Hearing living symbols and nonliving icons: Category specificities in the cognitive processing of environmental sounds. Mémoire sémantique et sons de l’environnement. What in the world do we hear?: An ecological approach to auditory event perception. How do we hear in the world? Explorations in ecological acoustics. In Embodied Communication and Human-Computer Interaction, volume 5934 of Lecture Notes in Computer Science. Towards a gesture-sound cross-modal analysis. Mimicking Sound with Gesture as Interaction Paradigm. Université Pierre et Marie Curie (Paris 6). Studies on the Relationship between Gesture and Sound in Musical Performance. Journal of Experimental Psychology: Human Perception and Performance 19, 2 (1993), 250-267. Common factors in the identification of an assortment of brief everyday sounds.

Variability demonstrates that, in the first case, participants have several ways of producing the same action, whereas in the second case, the sound features tend to make the gesture responses consistent. We also found that the interparticipants’ gesture variability is higher for causal sounds compared to noncausal sounds. In the other case, when no action can be associated with the sound, participants trace contours related to sound acoustic features. We showed that for the sounds where causal action can be identified, participants mainly mimic the action that has produced the sound. They were questioned on their perception of the listened sounds and on their gestural strategies. Afterward, we conducted interviews asking participants to verbalize their experience while watching their own video recordings. In the second experiment, participants performed arm and hand gestures synchronously while listening to sounds taken from these corpora. These corpora properties were validated through a listening test. The second contains sounds for which no causal actions could be identified. The first corpus contains sounds with identifiable causal actions. In the first experiment, we built two corpora of sounds.

To validate our hypothesis, we conducted two experiments. Our hypothesis is that the strategies in gestural responses depend on the level of identification of the sound source and specifically on the identification of the action causing the sound. We investigated gesture description of sound stimuli performed during a listening task.
