ECOVISION - Early Cognitive
Vision
• The Theoretical Basis of ECOVISION
– Recursive Mid-Level Vision
– Application of Gestalt Laws in Computer Vision
• Optic Flow Gestalts
• Stereo Gestalts
• Results
– Fast Pre-Processing
– Gestalts in Flow and Stereo
02/12/2002
ECOVISION Review Meeting, Leuven 2002
Hierarchical-Recursive Image
Processing
Pixels
Low-Level Vision
Data and Noise reduction
Extraction of Meaningful
Information (first steps)
Mid-Level Vision
Spatio-temporal Context
Grouping, Segmentation,
Task-dependent Attention
Self-Emergence of Entities
Features
Primitives
Gestalts
Objects
02/12/2002
High-Level Vision
(Cognition)
Higher Cognitive Aspects
“Reasoning”
ECOVISION Review Meeting, Leuven 2002
Examples
Features:
Orientation and
Flow
dense but noisy
Primitives: Sparse,
focused at high-energy
locations
multi-modal.
02/12/2002
ECOVISION Review Meeting, Leuven 2002
Examples
Gestalt:
“Meaningful” entity
that emerges from
cooperative, recursive
processing.
02/12/2002
ECOVISION Review Meeting, Leuven 2002
Properties of the Primitive
Image Representation
•
•
•
•
•
Local
Condensed
Sparse
Rich
Adaptive
02/12/2002
ECOVISION Review Meeting, Leuven 2002
Some more use of Primitives: Symbolic Pointillism
Glasgow, Lighthouse Tower Exhibition in the context of the ECVP
A cortical hypercolumn
representation
Examples of a Motion Gestalt
02/12/2002
ECOVISION Review Meeting, Leuven 2002
FPGA-based Motion Analysis
Front-End
Overtaking Sequence
02/12/2002
ECOVISION Review Meeting, Leuven 2002
Prototyping platform
02/12/2002
ECOVISION Review Meeting, Leuven 2002
Emergence of 3D
Gestalts
3-D Gestalts
emerge at
“high-energy”
locations from
local matches
together with
global RBM
properties
02/12/2002
ECOVISION Review Meeting, Leuven 2002
Summary
• Advanced Early Cognitive Image Processing for MidLevel Vision
• Fast Front-End Processing
• Recursive, self-emergence of visual Gestalts
• Consortium
–
–
–
–
–
–
–
F. Woergoetter Stirling
Marc vanHuelle, Leuven
Eduardo Ros, Granada
Alan Johnston, London
Markus Lappe, Muenster
Silvio Sabatini, Genova
Martin Muehlenberg, HELLA Hueck KG, Lippstadt
02/12/2002
ECOVISION Review Meeting, Leuven 2002