Krystian Mikolajczyk

Audio Visual Perception

LE2 module

Aims/Learning Outcomes

• The proposed module is intended for those interested in analysis of human audio visual perception from
  the neurophysiological point of view. It will provide essential background for future study in the domain of artificial
  intelligence, robotics and computational modelling of neurophysiological phenomena.

  Visual perception will cover basic neurophysiology of the visual system, psychophysical experiments, results
  and implications, perception of light and colour as well as image formation and recognition. Auditory perception will cover
  more advanced topics of human audition, binaural hearing and localisation, and acoustic cues.

• The aim of this module is to offer an insight on the basic principles and mechanisms involved in human audio visual perception.
  Upon completion of this module you should be able to:

  • understand a wide range of  theoretical developments and experimental approaches in human perception

  • explain the processes involved in human visual and auditory perception of complex sources

  • discuss approaches to computer modelling of human seeing and hearing

  • design basic algorithms that model the audio-visual processes.

Content

• Visual Perception (10h)

  • Basic neurophysiology ( eye, retina, receptors, neurons, brain and computational models)

  • Color Vision and physics of the visual stimulus (light, colour proessing theory, colour models, colour mixing,
    trichromatic/opponent processes, image formation, reflection models )

  • Perceptual principles of the visual system (image perception theories, measures of perceptual
    quantities, acuity, sensitivity, perception of distance, size, shape and texture, perceptual constancies,
    organization principles, computational models)

  • Perception of shadow and motion (shape from shadow, motion sensors, motion field, optic flow)

  • Image enhancement techniques (histogram based operations)

• Auditory Perception (10h)

  • Pitch of complex tones

  • Temporal factors

  • Binaural phenomena

  • Spatial attributes

  • Streaming

  • Modelling

• Problem class (4h)