Knowledge-based scene analysis with saccadic eye movements
by , , , ,
Abstract:
The perception of an image by a human observer is usually modeled as a parallel process in which all parts of the image are treated more or less equivalently, but in reality the analysis of scenes is a highly selective procedure, in which only a small subset of image locations is processed by the precise and efficient neural machinery of foveal vision. To understand the principles behind this selection of the 'informative' regions of images we have developed a hybrid system, which consists of a combination of a knowledge-based reasoning system wit a low-level preprocessing by linear and nonlinear neural operators. This hybrid system is intended as a first step towards a compete model of the sensorimotor system of saccadic scene analysis. In the analysis of a scene, the system calculates in each step which eye movement has to be made to reach a maximum of information about the scene. The possible information gain is calculated by means of a parallel strategy which is suitable for adaptive reasoning. The output of the system is a fixation sequence, and finally, a hypothesis about the scene.
Download PDF
PDF URL: http://dx.doi.org/10.1117/12.348483
Reference:
Knowledge-based scene analysis with saccadic eye movements (Kerstin Schill, Elisabeth Umkehrer, Stephan Beinlich, Gerhard Krieger, Christoph Zetzsche), In Human Vision and Electronic Imaging IV (Bernice E. Rogowitz, Thrasyvoulos N. Pappas, eds.), SPIE-Intl Soc Optical Eng, 1999.
Bibtex Entry:
@InProceedings{Schill1999,
  author    = {Kerstin Schill and Elisabeth Umkehrer and Stephan Beinlich and Gerhard Krieger and Christoph Zetzsche},
  title     = {Knowledge-based scene analysis with saccadic eye movements},
  booktitle = {Human Vision and Electronic Imaging {IV}},
  year      = {1999},
  editor    = {Bernice E. Rogowitz and Thrasyvoulos N. Pappas},
  month     = {may},
  publisher = {{SPIE}-Intl Soc Optical Eng},
  abstract  = {The perception of an image by a human observer is usually modeled as a parallel process in which all parts of the image are treated more or less equivalently, but in reality the analysis of scenes is a highly selective procedure, in which only a small subset of image locations is processed by the precise and efficient neural machinery of foveal vision. To understand the principles behind this selection of the 'informative' regions of images we have developed a hybrid system, which consists of a combination of a knowledge-based reasoning system wit a low-level preprocessing by linear and nonlinear neural operators. This hybrid system is intended as a first step towards a compete model of the sensorimotor system of saccadic scene analysis. In the analysis of a scene, the system calculates in each step which eye movement has to be made to reach a maximum of information about the scene. The possible information gain is calculated by means of a parallel strategy which is suitable for adaptive reasoning. The output of the system is a fixation sequence, and finally, a hypothesis about the scene.},
  doi       = {10.1117/12.348483},
  url       = {10.1117/12.348483">http://dx.doi.org/10.1117/12.348483},
}