Joint Action Science and Technology
JAST - FP6-003747
6th Framework Programme - Priority 2
“Information Society Technologies”
FP6/2003/IST/2
Joint-Action
JAST
Science and Technology
Joint-Action
Science and Technology
Overview
1.
2.
3.
4.
5.
6.
7.
Goals
Means
Co-ordinator
Organization
Activities
Website
Delegation
1. Goals
• Cognitive Systems
– JAST will extend cognitive science beyond the domain of studying
individual cognitive systems
• Ultimate goal of JAST
– To build jointly-acting autonomous systems that communicate and work
intelligently on non-trivial mutual tasks
• Primary goal
– Understanding the cognitive architecture of collaborating cognitive
systems
2a. Means: Consortium
Partners
1.
2.
3.
4.
5.
6.
7.
Radboud Universiteit Nijmegen
- Nijmegen Institute for Cognition and Information
- FC Donders Centre for Cognitive Neuroimaging
The Netherlands – NICI + FCDC
Max Planck Institute for Biological Cybernetics, Tübingen
Germany – MPIT
Institute of Communication and Computer Systems, Athens
Greece – ICCS
The University of Edinburgh
United Kingdom – UEDIN
Max Planck Institute for Psycholinguistics Nijmegen
The Netherlands – MPIN
Technische Universität München
Germany – TUM
Universidade do Minho
Portugal – UMP
2b. Multidisciplinary team
Partners
1.
2.
3.
4.
5.
6.
7.
8.
NICI
FCDC
MPIT
ICCS
UEDIN
MPIN
TUM
UMP
Disciplines
Neurocognitive scientists
id.
Cognitive scientists
Neuroscientists
Psycholinguists
id.
Robotocists
id.
2c. Means: Common Scenario
Joint-Action
Science and Technology
Arbitrary initial object layout
Resulting objects after completion of
multimodal dialogue sequence
2d. JAST Construction Task
(video)
Joint-Action
Science and Technology
2e: State-of-the-art starting conditions:
Demonstrator-Hardware
– Two directly cooperating arms.
A third arm may be used for holding
aggregates
– Assembly without any fixtures or
specialised tools
– A rich set of action primitives
(motor, sensor, sensorimotor) has
been implemented for positioning,
grasping, assembling, disassembling,
goal-directed motion under collision
avoidance, etc.
– Robust recognition and manipulation
of parts in all positions
– 3 Robots, 10 colour cameras (partly
articulated)
2f. Beyond state-of-the-art goals
System to be developed:
• multiple degrees-of-freedom
in perception-action
• real-time, adaptive planning
• dialogue-supported perception,
reasoning, action
• cross-modal associations
• model of action-dynamics
• rule- and self-organization
based learning
• monitoring and repairing
errors by self/other
3a. Co-ordinator
http://www.nici.kun.nl/People/BekkeringH/index.html
3b. Manager
http://www.nici.kun.nl/People/MeulenbroekRGJ/index.html
4. Work-Packages
5. Activities
• Two-day Opening Conference
– Athens, Greece
– February, 2005
– Dates: to be announced
• R&D activities in WP 2-3-4-5
– See excerpt JAST
(http://bscw.socsci.kun.nl/pub/bscw.cgi/0/1706107)
6. JAST Website
http://212.205.85.69/jast/index.htm
7. Delegation
Members of JAST attending the CogSys Kick-Off Meeting