Models and Frameworks for Cognitive - People

National Science Foundation Industry/University Cooperative Research Center for e-Design
IAB Meeting June 7, 2007
Project Title: Cognitive Integration in Design Review Environments
PI
Nicholas F. Polys, Ph.D.
Virginia Tech
Thrust Area:
Visualization & Virtual Prototyping
IRVE-Serve viewpoint sequence
Deliverables & Accomplishments
Visualization Testbed and Interface Adaptation Engine
• A software framework for adaptive information-rich renderings based on soft constraints and explicit user feedback
Introduction & Background
Across engineering domains, designers are faced with large volumes of data that are heterogeneous in nature. It is imperative that next-generation interfaces leverage the strengths
Predictive
of the human
Model
operator&to Design
create useful Guidelines
and economical tools for analysis and decision-making.
In Human-Computer Interaction (HCI) and Cognitive Ergonomics in general, we are seeking to reduce the cognitive distance between
Paraview
• Empirical evidence regarding the interaction of layout and display on information throughput and user performance
the user and the system and increase the information throughput between the user and the system.
1. A cognitive
model
of feature
integration
in design
applications
Visual Analytics refers to this science of facilitating analytical reasoning through interactive visual interfaces [1]. This research program leverages methods from Virtual Environments
(VEs),
Information
Visualization
(InfoVis),
and review
the Psychology
of Perception to develop ‘Information-Rich Virtual Environments’ (IRVEs) as a solution to th
and mental models of the system they are examining.
2. Interface guidelines for engineering productivity across display venues
Recent research in Information-Rich Virtual Environments (IRVEs) has shown that human operators rely on different perceptual
cues depending on the nature of their task (e.g. search or comparison) and depending on their task target (e.g. spatial or abstract
properties) [2]. These profiles of perceptual salience also change depending on the display venue such as desktop, wall-projection, and immersive systems such as the CAVE [3]. In addition, large-format and high-re
Visual Nastran
Demonstrated ROI for Visualization Interfaces and Venues
Effect of Association Information Value (AIV)
on Accuracy
100
90
80
Models and Frameworks for Cognitive Integration in
% Correct
70
60
Overall
50
Search
40
Comparison
The display techniques and empirical evaluations undertaken in this research provide the basis for software and interface d
Design Review Environments
A->S
30
S->A
20
10
In many systems, dynamic properties are best modeled with their spatial and structural aspects - spatial relationships are important when structure, location, and function are related. Indeed, this is the case in many domains where physical systems are designed, simulated, or analyzed. IRVEs aim to render clear views of such complex systems and t
By casting this research in an applied domain, we can better understand how e-Design and engineering applications can benefit
from basic research in visualization technology and perceptual psychology. The advantages of advanced and commodity display venues
for the analysis of complex systems have been demonstrated but a coherent model of these effects is still missing. Through a software framework and empirical data collection, we intend to construct a cognitive model that can optimize the human operator’s interface for
both accuracy and productivity.
0
1
2
3
5
5.58
6
6.58
AIV score (in bits)
Effect of Association Information Value (AIV)
on Completion Time
140
120
100
Seconds
Overall
Search
80
Comparison
A->S
60
S->A (null)
40
20
Applied Testing of Perceptual Integration and Cognitive Load
0
1
2
3
5
5.58
6
6.58
AIV score (in bits)
There is a significant literature on graphic design and human perception. However, historically this research has focused on either abstract information (e.g. InfoVis) or spatial inf
However perception of visual information is not just a bottom-up process. Top-down processes such as attention and user expectation also play a significant role. For this reason,
HEC ATR ANU PTH ETR EET
This is the same informational content as:
Display Techniques
THE CAT RAN UP THE TREE
but theacross
lattermany
representation
withThis
our research
expectations
as further studies it suggests will advance
The role of perceptual feature binding and Visual Working Memory in comprehension is a fertile area of research that directly impacts information analysis and communication
fields andagrees
domains.
and the
native English speakers and thus is considerably easier to process.
our understanding of how rich perceptual media may help alleviate huma
Snap2Diverse (VT CAVE)
Display Venues
IRVE-Serve mappings for energy flux in a tube
Commodity hardware pricing has made immersive visualization ‘not just for national labs only’. Indeed, the demonstrated power of large-format and high-resolution displays is now feasible for many organizations. The question then becomes: “how do I modify my application interface for the desktop and for other display venues?’ We will test our
Labeling testbed on projection wall
Stereo projection wall
VT Gigapixel version 1