TOP>Sessions> Sound>This Session

Invited SNDHighlight  AC

Sound Makes the Value of Visual Media Production: Interaction between Sound and Moving Picture

September 1 (Wed) 13:30 - 14:30
Session (60min.)
Expected Skill

Everybody is welcome to my talk. In particular, if you are interested in the role of sound in visual media productions and you want to improve quality of
visual productions by the effective use of auditory elements, I would like to recommend participate in this session.

Ideas Take Away

You can acquire scientific knowledge on the effective use of sounds in visual media productions. You will realize sound plays an integral part in visual productions and gives them life.

Visual media productions are rarely composed of purely motion pictures. They are generally a combination of motion pictures and sounds. Sound plays an integral part in visual productions and gives them life. To create an impressive visual media production, there must be subjective congruence between motion picture and sound. We have performed a series of empirical studies of audio-visual interaction in visual media. Our rating experiments showed that musical impressions directly affected the impressions of actual visual materials. Music influences the affective meaning of visual media productions. We have also examined subjective congruence between moving picture and sound. The synchronization of auditory and visual accents of audio-visual stimuli created subjective congruence between moving picture and sound. The similarity between auditory and visual impressions evoked from audio-visual stimuli also created subjective congruence. Furthermore, the relationship between the transformation of visual images and the pitch pattern of sound contributed to rising subjective congruence. Subjective congruence of motion picture and sound contributed to integrating auditory and visual information and to improving visual media productions.

* The session contents are based on the information provided by the speakers.

  • Shin-ichiro Iwamiya

    Shin-ichiro Iwamiya


    Faculty of Design

    Kyushu University