Intelligent Software Agents for
Autonomous Logistic Processes
Dr.-Ing. Ingo J. Timm (Senior Researcher)
Collaborative Research Center on
“Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations”
Center for Computing Technologies (TZI)
University of Bremen
Colloquium of the SPP 1183 Organic Computing
Munich, February 24th, 2006
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Outline
1. Motivation and Introduction
2. Autonomy in Logistics
(Windt, Hülsmann)
3. Intelligent Agents for
Autonomous Logistic Processes
(Müller-Christ, Herzog, Schumacher)
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
1
Outline
1. Motivation and Introduction
2. Autonomy in Logistics
(Windt, Hülsmann)
3. Intelligent Agents for
Autonomous Logistic Processes
(Timm, Müller-Christ, Herzog, Schumacher)
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
The CRC 637 at the University of Bremen
Autonomous Cooperating Logistic Processes –
A Paradigm Shift and its Limitations
ƒ Funded by Deutsche Forschungsgemeinschaft since 2004
ƒ Interdisciplinary research in the fields Electrical Engineering,
Mathematics, Computer Science, Production Engineering,
Business Studies
ƒ Budget: 2 mio € / year
ƒ 12 sub projects + 1 demonstration project
ƒ Team: 50+ scientific researchers
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
2
Sub Projects of the CRC 637
Project Domain A –
Foundations of Modeling
Project Domain B –
Methods and Tools
A1: Fundamental Studies
B1: Reactive Planning and Control
Windt (Production Engineering)
A2: Sustainable Management
Müller-Christ (Business Studies)
A3: Monitoring of Autonomous Systems
Hülsmann (Business Studies)
A4: Rule-based Graph Transformation
Kreowski (Computer Science)
A5: Dynamics of Autonomous Systems
Scholz-Reiter (Production Engineering) /
Wirth (Mathematics)
Project Domain Z - Infrastructure
Z1: Coordination and Management
Herzog (Computer Science)
Z2: Demonstrator
Scholz-Reiter (Production Engineering)
Scholz-Reiter (Production Engineering) /
Görg (Electrical Engineering)
B2: Adaptive Business Processes
Scholz-Reiter (Production Engineering)
B3: Mobile Communication
Networks and Models
Görg (Electrical Engineering)
B4: Knowledge Management
Herzog (Computer Science)
B5: Risk Management
Herzog (Computer Science) /
Schumacher (Production Engineering)
B6: Sensorsystems
Lang / Laur (Electrical Engineering)
B7: Autonomous Adaption of Vehicle
Schedules
Kopfer (Business Studies)
Production Engineering / Logistics
Computer Science
Business Studies / Management
IC-Tecchnologies / RFID
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Involved Faculties and Institutes
Faculty 1 – Physics / Electrical Engineering
com nets
Kommunikationsnetze
I MS A S
INSTITUT FÜR MIKROSENSOREN,
AKTUATOREN UND -SYSTEME
I TE M
INSTITUT FÜR THEORETISCHE
ELEKTROTECHNIK UND M IKROELEKTRONIK
Faculty 3 – Mathematics / Computer Science
Faculty 4 – Production Engineering and Technology
und Steuerung
produktionstechnischer Systeme
PSPS Planung
Applications of Computer &
Information Technologies in
Production Engineering
Faculty 7 – Business Studies and Economics
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
3
Technological Developments
Positioning Systems
Telematics
Interoperability
Networking
Technology
Transportation
Technology
Network
Security
Transponder
Technology
Loading and
Transit Equipment
Handling
Technology
Mobile
Phone
Standards
Mobile
Data Transfer
Machine
Learning
Terminal
Technology
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Holistic Perspective on Logistics
Logistics System
Task Layers within the CRC 637
Decision System
Organisation and
Management
Information System
Informatics methods
and I&C Technologies
Execution System
Human
Technical System
Material flow and
Logistics
Mass
Energy
Information
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
4
Paradigm Shift: Strong Regulation vs. Autonomy
Strong Regulation:
ƒ Hierarchical IT-structure
ƒ Global Information processing
ƒ Central Planning and control
Paradigm
Shift
Autonomy:
ƒ Distributed IT-structure with
global communication
ƒ Local information processing
ƒ Autonomous, decentralized
control
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Outline
1. Motivation and Introduction
2. Autonomy in Logistics
(Windt, Hülsmann)
3. Intelligent Agents for
Autonomous Logistic Processes
(Müller-Christ, Herzog, Schumacher)
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
5
Autonomy
Autonomy
... as a phenomena in
organization theory
... as a phenomena
for logistic control
Organizational and
Managerial Perspective
Logistics Perspective
ƒ
ƒ
ƒ
ƒ
ƒ
ƒ
Definition
Measurement
Evaluation
Definition
Measurement
Evaluation
Integration of the
Perspectives
[Hülsmann et al., 2006]
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Concept of Autonomy
Autonomy ...
... describes processes of decentralized decision making in heterarchical structures.
... is based on the ability of interacting elements in non-deterministic systems
to make autonomous decisions.
... aims at ensuring a higher degree of reliability and positive emergence of the system
by a distributed, flexible management of dynamics and complexity.
Strong Regulation
100 %
Strong Regulation
X
Central Planning Instance
Today
+ RFID
Autonomy
100 %
Autonomy
[Hülsmann et al., 2006]
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
6
Economical Evaluation of Autonomy
Evaluation-Tool
1.
2.
Description Model
Assessment Model
Measurement of
the Degree of Autonomy
and its Modification
Measurement of the
Economical Effects of
Autonomy and its
Modification
3.
Assignment
[Hülsmann et al., 2006]
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Description Model
M 2: Autonomy
100%
Polarization Graph
M 1: Decentralized
Decision Making
- 100%
100%
0%
100%
M 5: Heterarchy
M 3: Non-Determinism
100%
Selbststeuerungsgrad
einer logistischen Ebene
M 4: Interaction
Merkmal
M1
Dezentrale
Entscheidungsfindung
Logistische
Ebene
MerkmalsSpezifizierung
E3
Ausführungsebene
M1E3
Lokale
Disposition
I1M1E3
Entscheidungen
auf Stückgutebene
Σ (GM x M)
Σ (GI x I)
Σ (GMG x MG)
100 %
IndikatorenBildung
100 %
MessgrößenDefinition
MG1I1M1E3
E-Anzahl
MG2I1M1E3
E-Frequenz
MG3I1M1E3
E-Wert
100 %
Gewichtete Messgrößen-Aggregation
Scoring Model
Spatial-Temporal
Consistency Measurement
[Hülsmann et al., 2006]
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
7
Polarization Graph
M2: Autonomy
100%
Decision-layer
Information-layer
Execution-layer
M1: Decentralized
Decision Making 100%
100%
0%
100%
M3: Non-Determinism
100%
M5: Heterarchy
M4: Interaction
Strong Regulation
100%
Autonomy
100%
[Hülsmann et al., 2006]
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Autonomy
Autonomy
... as a phenomena in
organization theory
... as a phenomena
for logistic control
Organizational and
Managerial Perspective
Logistics Perspective
ƒ
ƒ
ƒ
ƒ
ƒ
ƒ
Definition
Measurement
Evaluation
Definition
Measurement
Evaluation
Integration of the
Perspectives
[Hülsmann et al., 2006]
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
8
[Windt et al., 2006]
Degree of Logistical
Goal Satisfication
Approach of Evaluating
Autonomous Logistics
Processes
Globales
Zielsystem
Maschine
z
Auftragsklasse
Lokale
Zielvorgabe
e
-
Logistisches
Auftragscontrolling
Regler
bei Auftragsende
Stellglied
Produktionsprozess
x
Dynamics Æ
ComplexityÆ
Logistical Evaluation of Autonomy
Key
Performance
Indicators
Messung der
logistischen IstKennzahlen
Assessment Level I
Evaluation of the
System
Degree of Autonomy
Criteria-Catalogue
Merkmalsklassen
Entscheidungsfindung
Beschreibung
Merkmale
Ausprägungen
Zeitliches Verhalten
des Zielsystems
Statisch
Überwiegend
statisch
Überwiegend
dynamisch
dynamisch
Organisationsstruktur
hierarchisch
Überwiegend
hierarchisch
Überwiegend
heterarchisch
heterarchisch
keine
einige
viele
unbegrenzt
Anzahl Entscheidungsalternativen
Art der Entscheidungsfindung
Assessment Level II
Evaluation of
Logistical Objects
Globales
Zielsystem
statisch
e
Lokale
Zielvorgabe
Regler
-
Logistisches
Auftragscontrolling
bei Auftragsende
Stellglied
Produktionsprozess
x
Informationsverarbeitung
Entscheidungsausführung
Element determ.
System determ.
Element determ.
System nicht-determ.
E nicht-determ.
S determ.
Beides nichtdeterm.
Datenhaltung
zentral
Überwiegend
zentral
Überwiegend
dezentral
dezentral
Datenverarbeitung
Überwiegend
zentral
Überwiegend
dezentral
dezentral
keine
Datenbereitstellung
Kommunikation
Koordination
unflexibel
Wenig flexibel
flexibel
Sehr flexibel
Keine Elemente
identifizierbar
Wenige Elemente
identifizierbar
Viele Elemente
identifizierbar
Alle Elemente
identifizierbar
keine
andere
selbst
Selbst und andere
zentral
Flexibilität
Identifizierbarkeit
Fähigkeit zur Messung
Assessment Level III
Evaluation of
Decision
Alternatives
lernen
Systemelementebene
Systemebene
Systemverhalten
Interaktionsfähigkeit
Messung der
logistischen IstKennzahlen
regelbasiert
Subsystemebene
Ort der Entscheidungsfindung
Maschine
z
Auftragsklasse
Zunehmender Selbststeuerungsgrad
e
-
Regler
Stellglied
Experiments
on Autonomy
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Evaluation of Autonomous Logistic Processes
Global
Objectives
Deriving Alternatives
• Generation of Alternatives
• Assessment of
Alternatives
• Decision
Making
Execution of Decisions
Lokale
Zielvorgabe
Logistisches
Auftragscontrolling
e
-
Regler
bei Auftragsende
Stellglied
Messung der
logistischen IstKennzahlen
Ressource
z
Order
Type
Goal
Satisfaction
of Global
System
Local
Goal
Logistical
Order
Controlling
e
-
Controller
Order Completion
Actuator
Production
Process
x
Measurement of
Logistical Key
Performance Indicators
Goal Satisfaction of Logistical Object
Logistical Object
e Deviation z Failure
x Regulation
[Windt et al., 2006]
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
9
Outline
1. Motivation and Introduction
2. Autonomy in Logistics
(Windt, Hülsmann)
3. Intelligent Agents for
Autonomous Logistic Processes
(Müller-Christ, Herzog, Schumacher)
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Agents as Enabling Technology
[Eurogate, 2005]
As enabler (or “simulator”) of autonomous processes implement
imitation
real world system
model
ƒ knowledge
about internal structures and agent
organizations,
preserving structure
ƒ may represent a physical
entity (truck, ship, package),
and behavior
ƒ Iare aware of actors
situated in the environment,
I
O
agent
O
ƒ are able of perceiving changes in their environment,
ƒ have the ability to communicate, and
solutions
ƒ have a defined economic scope of representing their enterprise.
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
10
Challenges for Intelligent Software Agents
ƒ Large number of distributed processes: centralized
decision-making is not feasible
ƒ Competitive environment: Knowledge as tradable good
and resource
ƒ Multi-dimensional risks
ƒ Situation-aware decision-making
ƒ Identification of chances resp. synergies
ƒ Gap between strategic objectives and
operational decision-making resp.
ƒ Compensation of loss of control by comprehensive
behaviour
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
11
Scenario: Paper Roll Logistics
6:00 A shipment of 4.000 rolls of paper arrives in Bremerhaven. 1.000 rolls have to be
delivered to a small publisher in Emsland, 3.000 rolls have to be sent to a large
publisher in Hamburg by 18:00.
7:00 Suddenly, hail damages 500 rolls (for the huge publisher in Hamburg)
Transportation Requirements
ƒ Paper rolls for high-speed presses
ƒ High weight, specific unloading equipment
ƒ Rolls are sensitive to humidity, etc.
ƒ Paper rolls are expensive
improve
w c a n we
o
H
Today’s Approach
this situa
tion?
7:30 Stop of unloading procedure, information of central logistic unit
9:30 Experts arrive at port and estimate damage (500 rolls useless for the publisher in
Hamburg). Undamaged rolls are sent with time delay to the publisher; damaged rolls
are disposed.
¾Additional costs: ~1 mio € (damaged rolls, replacement, conventional penalties)
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Autonomous Logistic Processes
Software System
Real World
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
12
Model of Autonomous Decision Processes
Social Decision
Sustainable Management
Contradiction
Management
Boundary
Management
System
Participation
Management
Risk Management
by and for Technical Systems
Autonomous
Identification
Generation of 4
Alternatives
Optimization
Technical
Decision System
Knowledge Management
by and for Technical Systems
Representation
& Inferences
Acquisition &
Maintenance
Strategic Decisions
on the Level of the
Social System
Delegation of
Decision
Competences
Goal Satisfaction on
Technical-operational
Level
Processing &
Learning
Implication of Delegation to Sustainable Management
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Representation and Inference
Knowledge Model
ƒ Representation of logistical domain knowledge within an
extensive ontology for transportation and production (OWL-DL)
Cargo
Food
Vehicle
Motor Vehicles
Truck
Frozen Food
Chiller
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
13
Representation and Inference
Knowledge Model
ƒ Representation of logistical domain knowledge within an
extensive ontology for transportation and production (OWL-DL)
ƒ Representation of complex domain knowledge and
spatio-temporal knowledge by rules
(SWRL resp. Prolog- and HiLog-rules in F-Logic/FLORA)
temp_sens(CARGOTYPE,CARGOSIZE,FROM,TO) :Fracht
Fahrzeug
get_environment_temperature(ENVTEMP),
ENVTEMP < 20,
get_chiller_type(CHILLER),
Kraftfahrzeug
get_distance(FROM,TO,DIST),
Lebensmittel
check_chiller(CHILLER,CARGOTYPE,CARGOSIZE,20,DST).
Lkw :check_chiller(normal_unit,frozen_food,_,X,_)
X > 35, !, fail.
Tiefkühlkost
check_chiller(_,_,_,_,_).
Kühl-Lkw
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Representation and Inference
Knowledge Model
ƒ Representation of logistical domain knowledge within an
extensive ontology for transportation and production (OWLDL)
ƒ Representation of complex domain knowledge and
spatio-temporal knowledge by rules
(SWRL resp. Prolog- and HiLog-rules in F-Logic/FLORA)
Reasoning
ƒ Racer: Inference system for ontologies
(transfer to Pellet is analyzed)
ƒ XSB: Inference system for complex Prolog-/HiLog-rules
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
14
Framework for Distributed Knowledge Management
ƒ Infrastructure for KM functionalities, e.g.,
•Acquisition
(data, information, knowledge)
•Logical inferences
•Providing knowledge for agents
ƒ Agent-based role model for
External Interaction in Roles
decomposition of KM functionalities
ƒ Competitive interaction mechanisms
based for negotiation on knowledge as
tradable good
ƒ Implication from sustainable
management
•Formation of knowledge coalitions
•Retrieval of partners for cooperation
(reputation, trust)
¾ Knowledge management emerges from
Internal Interaction in Roles
the interaction of agents
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Agents Based on Knowledge and Risk Management
Deliberation Cycle of Agents
Perception
Situation
Situation
Analysis
Analysis
Identification
Identification of
of
Risks
Risks (Chances)
(Chances)
Option
Option
Selection
Selection
Action
Knowledge
Knowledge
Acquisition
Acquisition
Evaluation
Evaluation
Risk Management
Knowledge
Management
Decision Support
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
15
Risk Management
ƒKnowledge-based identification of risks
• Representation of situation-dependent risk patterns
• Identification is based on pattern matching
(Inferences on the basis of HiLog queries)
ƒRecognition of uncertainty
• Evaluation of uncertainty intervals
(based on the Dempster/Shafer evidence theory)
ƒAcquisition of additional knowledge
• Importance is determined by the size of the
uncertainty interval as well as height of the risk
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Solution of the Paper Role Scenario
6:00 Shipment paper roles reaches Bremerhaven
7:00 Hail damages paper roles
Solution with Knowledge Management
7:00 Humidity sensors register damage
7:01 Sensor system informs the risk management
the risk management system (RMS). RMS
requests additional information on cargo…
7:03 Additional information are received
7:05 The system computes an optimal solution: 371 damaged roles, which
cannot be used by the publisher in Hamburg, are sent to the small publisher in
Emsland. 129 paper roles are lost and exchanged by material in another stock
in Passau
¾Benefit: almost no time loss through flexible solution in real-time such that there
are no additional costs for priority transportation or conventional penalty:
~100 T€ (replacement of roles, disposal)
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
16
Simulation of Autonomous Logistic Processes
Configuration of
Simulation
Visualization
Documentation, Supervision,
Filtering
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Conclusion
The DFG Collaborative Research Center
„Autonomous Cooperating Logistics Processes:
A Paradigm Shift and its Limitations“ ...
CRC 637
ƒ
focuses on a long-term, interdisciplinary field of research,
ƒ
combines the investigation of highly dynamic logistic processes
with the development and application of recent I&C technologies,
ƒ
is based on a well proven interdisciplinary combination of the
necessary research groups at the University of Bremen,
ƒ
has significant relevance for practical applications and high
potential for future technology transfer,
ƒ
integrates industrial partners from the very beginning.
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
17
Contact
Autonomous Cooperating Logistic Processes
A Paradigm Shift and its Limitations
Internet:
www.sfb637.uni-bremen.de
Dipl.-Ing. Michael Freitag
(Managing Director)
Dr.-Ing. Ingo J. Timm
University of Bremen
Center for Computing Technologies (TZI)
Am Fallturm 1
28359 Bremen
Phone:
Fax:
Email:
0421 / 218 81 70
0421 / 218 71 96
[email protected]
University of Bremen
BIBA
Hochschulring 20
28359 Bremen
Phone:
Fax:
Email:
0421 / 218 97 90
0421 / 218 81 63
[email protected]
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
Upcoming Event:
Fourth German Conference
on Multiagent Systems
Technologies (MATES‘06)
http://www.dfki.de/MATES/
[Eurogate, 2005]
Klaus Fischer, Ingo J. Timm (Program Co-Chairs)
Elisabeth Andre, Ning Zhong (General Co-Chairs)
Thank you for your attention !
CRC 637 Autonomous Cooperating Logistic Processes – A Paradigm Shift and its Limitations
18