We initially characterized the relation of sound waveform of piano tone to the finger-key contacting force in detail. Then, we determined the role of muscular and non-muscular forces generated at all joints in the upper-limb in production of various key-force waveforms in terms of a series of forward and inverse dynamics computations. This provided quantitative evidences demonstrating that touch-dependent control of the inter-segmental dynamics plays a key role in manipulating the touch. Finally, a psychoacoustic experiment revealed that the timbre of a tone produced by different touches were perceived differently. My further scope is to determine (1) a "sound-motion" map based on these methods and evidences, and (2) its underlying neural mechanism.Selected publication
Furuya S, Altenmüller E, Katayose H, Kinoshita H (2010) Control of multi-joint arm movements for the manipulation of touch in keystroke by expert pianists. BMC Neuroscience
Kinoshita H, Furuya S, Aoki T, Altenmüller E (2007) Loudness control in pianists as exemplified in keystroke force measurements at different touches. J Acoust Soc Am
4. Role of auditory feedback in piano playing
Musical performance requires highly accurate spatiotemporal control of sequential movements. This involves monitoring and updating motor actions over time based on visual, auditory, and somatosensory information. How do pianists integrate these information into planning and executing keystrokes?
I recently developed a custom-made script to manipulate characteristic of piano tone (timing, pitch, loudness) during piano playing in a real-time manner (time resolution = 2 ms). Using this system, we investigated the effect of transient perturbation of auditory feedback on the control of successive keystroke motions while pianists were playing musical pieces. A similar approach has been extensively used in speech research for examining the role of auditory feedback in vocal production and/or mechanism of stuttering, whereas its extension to piano playing was limited to studies that investigated the effect of persistently perturbing auditory feedback on piano playing.
Our results showed a rapid compensatory action in response to a transient perturbation, illustrating that pianists accounted for auditory feedback from one single tone for accurate control of timing and intensity of successive keystrokes. We also found effects of perturbing auditory feedback from a keystroke with right hand on keystrokes with left hand. This emphasizes importance of auditory feedback for bimanual coordination of hand movements during piano playing.