LAMP
Spiral 2 Year-end Project Review
LAMP
University of Delaware
PI: Martin Swany
Staff: Eric Boyd, Jason Zurawski, Internet2
Students: Guilherme Fernandes, Ezra Kissel
29-August-2010
Sponsored by the National Science Foundation
Project Summary
• LAMP (Leveraging and Abstracting Measurements with perfSONAR)
is an effort to use and extend the perfSONAR system for
Instrumentation and Measurement (I&M) in ProtoGENI
– perfSONAR (www.perfsonar.net) has wide adoption in research and education
networks
– One key to the success of perfSONAR system is its extensibility
– Ability to wrap many data sources, while fully capturing relevant metadata
• Key Goals of LAMP
– Inclusion of various modes of operation
• Slice creation with embedded I&M
• Dynamic dedicated monitoring slice
• Access to persistent I&M services
– Generic metadata, including slice topology and data description to provide
“lingua franca” for various I&M projects
– Easy access to commonly-desired data
– Easy support for experiment-specific metrics
– Exploratory work toward GENI I&M Architecture
Sponsored by the National Science Foundation
29-August-2010
2
Milestone & QSR Status
ID
Milestone
Status
On
Time?
On Wiki?
GPO
signoff
?
S2.a
Requirements and design doc
Document draft complete
>2 mo
late &
comp
N (today)
N
S2.c
Updated Prospectus
Prospectus on integration with GENI
monitoring efforts has largely been combined
with the I&M Architecture Doc
<2 mo
late &
incomp
N
N
S2.d
Demonstration of perfSONAR on
ProtoGENI
Presentation/demo at GEC7
on time
Y
Y
S2.e
V1.0 of perfSONAR on ProtoGENI
Software is functional, no formal
announcement due to lack of documentation
on time
N
N
S2.j
GENI measurement and data schema
demonstration
No demonstration, but schema efforts are
ongoing with ProtoGENI RSpec, others
<2mo
late &
incomp
N
N
S2.f
V1.1 of perfSONAR on ProtoGENI
Planned release on September 15th
<2wks
late &
incomp
N
N
S2.g
Demonstration of perfSONAR on
ProtoGENI
Demo occurred at GEC8
on time
Y
N
S2.h
Evaluation Report
in progress
QSR: 1Q2010
complete
on time
Y
Y
QSR: 2Q2010
in progress
<2mo
late &
incomp
N (this
wk)
N
Sponsored by the National Science Foundation
29-August-2010
3
Accomplishments 1:
Advancing GENI Spiral 2 Goals
•
One of the main Spiral 2 goals was to establish various Instrumentation and
Measurement (I&M) Systems and to work toward a strawman proposal for a
GENI-wide framework
–
•
The LAMP team has actively participated in the I&M WG to advance the I&M
Architecture
–
•
•
This effort has been substantial and wasn’t reflected in our original milestones!
Development of an I&M System Prototype that integrates perfSONAR in
ProtoGENI, while serving as a continuous experimenter
–
•
LAMP has the twin goals of a working system and exploratory investigation toward the larger
framework
This helped improve the Control Framework by identifying needs of I&M systems, providing
feedback on general CF use/design, and generating bug reports
We have paid substantial attention to Interoperability by understanding the
various RSpecs used by CFs and looking toward a common representation
Similarly, we have faced Identity Management questions from the outset, and
have worked toward support for this in LAMP
Sponsored by the National Science Foundation
29-August-2010
4
Accomplishments 2:
Other Project Accomplishments
• Deployed perfSONAR measurement infrastructure for ProtoGENI
backbone nodes
• Substantial integration with ProtoGENI
– I&M infrastructure deployment and bootstrapping integrated with the CF
– ProtoGENI AA support added to perfSONAR services and global infrastructure
– ProtoGENI RSpec translated into UNIS topology schema
• Developed a different approach for bootstrapping and configuring the
perfSONAR I&M infrastructure that
– Nodes configure themselves by retrieving annotations on the topology description
of the slice
– Continuous configuration changes possible
– Nodes can push changes back into the topology description so that information is
up-to-date (e.g. IP addresses)
• The measurement and (UNIS) topology schema integration in the
LAMP I&M system demonstrates a possible solution for storing and
sharing measurement data from virtual topologies (i.e. non-public IP
addresses, etc)
Sponsored by the National Science Foundation
29-August-2010
5
Issues
• We (LAMP) need to improve in our completion (and revision if
necessary) of project milestones
– When we became substantially involved in the I&M WG, we let our own milestone
languish as the analysis and description was largely the same
• Lack of instrumentation/measurement resources (e.g. measurement
boxes) at various aggregates
– Creates difficulties in integrating substrate and slice measurement planes
• Topology of the substrates should be described in more detail
• Lack of dedicated measurement plane network
• CFs and RSpecs are very different underneath
– This will be a major barrier to fully integrating I&M systems to all CFs (i.e.
bootstrapping, determining virtual topology vs physical topology mappings
(including hostnames/IPs), etc).
Sponsored by the National Science Foundation
29-August-2010
6
Plans
•
•
•
•
•
•
•
Integrating the rest of the perfSONAR-PS services
Adapting the pS-PS-Toolkit web configuration tool for managing distributed
services through changes to UNIS
Making the topology based (node) configuration service a full blown pS
service
Improve GUIs available to GENI experimenters for visualizing perfSONAR
data of slices (Periscope, perfAdmin, others)
Public release of software available to all experiments with documentation and
user manual
Continued emphasis on GENI I&M Architecture document and discussion
The GPO is starting to formulate goals for Spiral 3. What are your thoughts
regarding potential Spiral 3 work?
–
An increased emphasis on common language and more correspondence in RPecs. Diversity is
good, but not for its own sake.
Sponsored by the National Science Foundation
29-August-2010
7