EGEE-II-EDGeS-MoU-v1-NA4com

13 July 2017 Version: Draft
Memorandum of Understanding
between
EGEE and EDGeS
1. Purpose of this MoU1
The purpose of this Memorandum of Understanding (MoU) is to facilitate and strengthen the
collaboration between EGEE and EDGeS projects. This can be achieved by identifying areas of
collaboration, clarifying roles and commitments from both parties and agreeing on a joint programme
of work.
2. Background
The EGEE (Enabling Grids for E-sciencE) project2 provides a production quality Grid infrastructure
for a myriad of applications from various scientific domains, including earth sciences, high energy
physics, bioinformatics and astrophysics. The project brings together scientists and engineers from
more than 240 institutions in over 45 countries providing around 50K CPUs and 5 PB disk storage.
The EDGeS (Enabling Desktop Grids for e-Science) project3 aims to interconnect the EGEE
infrastructure with existing Desktop Grid (DG) systems to enable mutual enhancement of capacity
and target user communities that require large computing power not available or accessible in current
scientific e-Infrastructures. Presently EDGeS offers 125K CPUs and X disk storage from BOINC and
XtremWeb-based DG systems it federates.
Institutions common to both projects are MTA SZTAKI, CIEMAT and CNRS/IN2P3.
The executive summaries of EGEE and EDGeS are in Annexes 1 and 2, respectively.
3. Joint Workplan
The specific goals of this collaboration are:
1. To enhance the capacities of both infrastructures;
2. To allow EGEE users access to EDGeS resources;
3. To establish an EDGeS VO within the EGEE infrastructure and allow EDGeS users access to
EGEE resources via this VO.
The specific activities detailed in this MoU are:
1
An MoU is a written agreement that clarifies relationships and responsibilities between two or more parties that share services, clients, and
resources.
2
http://www.eu-egee.org
3
http://www.edges-grid.eu
1/9
A.1
Parties Involved4: EDGeS (name); EGEE NA4 (Name, TBC)
Description of work: Identify EGEE applications that will run in the EDGeS infrastructure.
EDGeS will lead this activity which involves setting up a validation procedure, support the
porting of EGEE applications in EDGeS, and maintain a repository of ported EGEE applications
within the EDGeS system. EDGeS will provide a clear guide as to what types of applications are
appropriate to run on the EDGeS infrastructure and enumerating constraints that could affect
application selection (for example, EGEE client software is not available on EDGeS worker
nodes, inability to connect to outside services, and the like). EGEE NA4 will support this activity
via the Steering Committee, proposing applications appropriate for porting. The EGEE
applications groups involved will liaise with the EDGeS porting group.
Expected outcome: A repository of ported EGEE applications maintained within the EDGeS
system.
To be discussed:
* Clarify meaning of ‘repository’
A.2
Parties Involved: EGEE NA4 (Name, TBC); EGEE NA1 (E.Laure); EDGeS (name)
Description of work: Provide EGEE users access to EDGeS resources. The supported EGEE
applications are identified in A.1. EDGeS will guarantee these applications will be accepted by
the DG systems it federates. EGEE NA4 will lead this activity which involves setting up a usage
plan (identify users, applications, metrics) and monitoring the progress of the
activity. EGEE
NA1 will actively encourage its users to run their applications in the EDGeS infrastructure.
Expected outcome: EGEE users access to EDGeS resources.
Milestone M1: EGEE users access to EDGeS resources. This milestone is met upon completion
of A.2 and submission of report on the usage plan and statistics.
A.3
Parties Involved: EDGeS (name); EGEE NA4, SA1 (RAG5 M.Barroso Lopez); EGEE NA1
(E.Laure)
Description of work: Setup EDGeS External VO6 in the EGEE infrastructure. EDGeS will lead
this activity which involves VO registration, configuration and integration, and will assume full
operational responsibilities during the lifetime of this VO. EGEE will provide access to a limited
set of seed resources for a limited period of time. After that the EDGeG VO will bring its own
resources. EGEE will actively mediate via the RAG the sharing of resources with other resource
providers.
Expected outcome: An EDGeS External VO is created in the EGEE infrastructure .
To be discussed:
* Which EGEE infrastructure will host the EDGeS VO – PPS, Prod, Gilda?
4
Party leading the activity is underlined.
5
EGEE NA4 with SA1 will ensure that initial resources are deployed for new VOs via the Resource Access Group (RAG)
run jointly by SA1, which will facilitate negotiations on resource usage with resource providers.
External VO – A registered VO which is supported by a separate funding. These VOs are expected to participate directly in the evolution
and management aspects of the infrastructure.
6
2/9
A.4
Parties Involved: EDGeS (name); EGEE NA4, SA1 (RAG M.Barroso Lopez); EGEE NA1
(E.Laure)
Description of work: Provide EDGeS users access to EGEE resources via the EDGeS VO.
EDGeS will lead this activity and assume full responsibility in the integration of EGEE sites with
the EDGeS resources with no modification to the gLite stack. EDGeS will also setup a usage plan
(identify users, applications, metrics) similar to A.2 and monitor the progress of the activity.
EGEE will support this activity by…
Expected outcome: EDGeS users access to EGEE resources via the EDGeS VO.
Milestone M2: EDGeS users access to EGEE resources via the EDGeS VO. This milestone is
met upon completion of A.4 and submission of report on the usage plan and statistics.
4. Timeline and Reporting
The EGEE Collaborating Projects Liaison Office (CPLO) will coordinate the periodic review of the
progress of the activities defined in this MoU, follow-up the milestones and distribute reports to both
projects.
Date
Task/Milestone Additional Information
A.1
A.2
Milestone1
Requires report.
A.3
A.4
Requires report.
Event1
EGEE Conference – Joint Workshop?
Event2
EGEE User Forum - Joint Workshop?
Event3
EDGeS event
Publication
Joint publication
5. Administrative Procedures/ Considerations
5.a Communication
The coordinators of both projects will maintain regular contact to discuss any high-level issues related
to the cooperation described in this MoU.
The principal point of contact who will act as primary technical channel of behalf of each project is:
EGEE: CPLO [email protected]
EDGeS: <Name> <email>
5.b Rights and Responsibilities
* Draft pending checks with LS; inclusion of EGEE Acceptable Use Policy
3/9
Each project will maintain full responsibility for its own activities, including the fulfilment of its
obligations under its Grant Agreement with the European Commission and provides no warranty,
express or implied, with respect to its contribution to any activity agreed by the projects under this
MoU, including but not limited to those of fitness for a particular purpose and the infringement of
third-party proprietary rights.
Any proprietary rights relating to the results of activities undertaken by the projects under this MoU
shall be jointly held by the projects, and each project herewith grants the other project a free,
irrevocable and perpetual license to use such rights, including the granting of sub-licenses to such
rights, for its own purposes, including the right for each project to place the results of such activities
in the public domain, in its own name and under its own responsibility.
(Taken from other MoUs – existing IP, licensing, which license to use for joint developments, access
rights, liability, settlement of dispute)
5.c Effective date, Duration and Modification
This MoU will become effective when signed by the coordinators of EGEE and EDGeS. It may be
modified in writing by mutual consent of both projects and amendments shall be valid only if signed
by the coordinators of both projects. It will remain in effect until completion of activities identified in
Sections 3 and 4, or when either of the projects is complete, or when either project gives notice of
termination to the other, in which case a minimum notice of three months will be given.
4/9
Memorandum of Understanding between EGEE and EDGeS
The following agree to the terms and conditions of this MoU:
________________________________
Bob Jones
EGEE Project Director
________________________________
Peter Kacsuk
EDGeS Project Coordinator
________________
Date
________________
Date
5/9
Annex 1 – EGEE
EGEE-III has two complementary objectives that are essential for European research infrastructures:

To expand and optimise Europe’s largest production Grid infrastructure, namely EGEE, by
continuous operation of the infrastructure, support for more user communities, and addition of
further computational and data resources; and

To prepare the migration of the existing production European Grid from a project-based
model to a sustainable federated infrastructure based on National Grid Initiatives for multidisciplinary use.
Background to EGEE-III
The Grid concept involves establishing an infrastructure that allows existing IT installations to connect
and share their computing power and storage capacities. For a wide range of applications, this
enables dispersed groups of users to collaborate on common challenges. This concept has been
implemented in a variety of ways, including 'Capability' Grids combining supercomputers (e.g.
DEISA), ‘Capacity' Grids, comprising clusters of commodity computers (e.g. EGEE), 'Enterprise' Grids
linking together resources of a single company, and 'Volunteer' Grids, linking individual home
computers (e.g. BOINC). Of these, ‘Capacity’ Grids offer a general purpose, dependable, costeffective and pervasive infrastructure, suitable for the needs of collaborative European science.
The concept of a European Grid Infrastructure emerged in 2000. In Framework 5, the EUDataGrid
project and related initiatives proved a European Grid system was capable of supporting different user
communities. In Framework 6, the EGEE project built on these results to establish a continuously
available production quality Grid infrastructure. Since 2006, EGEE-II focuses on consolidating the
operating procedures, expanding the resources, enlarging the Grid to more countries and attracting
more user communities. EGEE-II has improved the scalability of the Grid, and its reliability in
supporting a wide range of applications.
EGEE has become a critical infrastructure for a range of top European scientific undertakings. Most
European countries have Grid infrastructures, at varying levels of maturity. A limitation of national
Grids is their lack of access provision to international science communities. Beyond the national level
standards become important to allow ease of connectivity and sharing of applications. EGEE ensures
that the European Grid infrastructure does not fragment into national and thematic Grid
infrastructures, with less coherence at a European level. EGEE-III will provide a world class, coherent
and reliable European Grid, ensuring Europe remains at the forefront of scientific excellence.
Details of EGEE-III
The focus of EGEE-III is:

To migrate the existing European Grid Infrastructure from a European co-funded project to a
self-sustainable infrastructure that is under the governance of national initiatives;

To ensure the continuous provision of a production quality Grid infrastructure to European
eScience;

To expand the usage of the infrastructure in terms of new user communities;

To simplify the usability of the system for the end user;

To provide active contributions to standardisation efforts for adoption at European and
International levels;

To work closely with businesses to ensure commercial uptake of the Grid, key to
sustainability.
6/9
Consortium:
The EGEE consortium consists of 43 beneficiaries, both academic and business. All EC co-funded
countries have grouped their academic partners on a national level via Joint Research Units or
National Grid Initiatives so that the 43 beneficiaries represent a total of more than 120 partners. This
has a structuring effect on the Grid communities across the European Research Area and is an
important milestone for the planning of a sustainable Grid Infrastructure model. Beneficiaries are
organized in regional federations, covering:

Asia Pacific (Australia, Japan, Korea, Taiwan)

Benelux (Belgium, the Netherlands)

Central Europe (Austria, Croatia, Czech Republic, Hungary, Poland, Slovakia, Slovenia)

France

Germany/Switzerland

Italy

Nordic countries (Finland, Sweden, Norway)

South East Europe (Bulgaria, Cyprus, Greece, Israel, Romania, Serbia, Turkey)

South West Europe (Portugal, Spain)

Russia

United Kingdom/Ireland

USA
Collaboration with additional countries in the Asia Pacific region (China, Brunei, Indonesia, Malaysia,
Philippines, Singapore, Thailand, Vietnam) and in the Commonwealth of Independent States
(Armenia, Ukraine, Uzbekistan) is also foreseen.
Duration: 24 months
EC Contribution: 32,000,000 €
Total Budget: cca. 47,150,000 €, with a further estimated 50,000,000 € worth of computing
resources contributed by the partners.
Total Manpower: 9,010 Person Months, of which over 4,500 Person Months contributed by the
partners from their own funding sources.
7/9
Annex 2 – EDGeS (Text taken from http://www.edges-grid.eu/)
Summary
The targets of the project are user communities that require large computing power not available or
accessible in current scientific e-Infrastructures. In order to support the specific needs of these
scientific and other communities The consortium will interconnect the largest European Service Grid
infrastructure (EGEE) with existing Desktop Grid (DG) systems in a strong partnership with the
EGEE consortium. Service Grids (SG) are more flexible and can accommodate a broader variety of
applications than Desktop Grids, however, their setup and maintenance require more efforts, highly
skilled IT specialist, and dedicated resources. On the other hand, Desktop Grids are currently
restricted solely to a subclass of compute-intensive applications but these easy-to-scale systems are
able to collect 1-2 orders of magnitude more compute power by utilizing the involved spare and
volunteer IT resources at a fraction of the cost. Making a bridge between these two types of Grid
systems will enable the users to transparently execute applications on any arbitrary platform involved
in the new infrastructure. Taking the advantages of both approaches the EDGeS infrastructure will
represent a major step towards a European wide scientific grid where extremely large number of
resources could be integrated to support grand-challenge scientific and other applications. The
involvement of low-cost volunteer Desktop Grids into the European scientific grid infrastructure will
contribute to the establishment of a sustainable European Grid infrastructure. The consortium is to
extend the potential user communities for both beyond traditional scientists and current volunteer
computing participants to further involve citizens, school students, and company employees, giving
them an opportunity to become involved in science and to apply Grid technology in their every day
life. In order to meet these objectives the project will connect Desktop Grid based city Grids, school
grids and enterprise grids with EGEE.
Project Objectives

Identify and involve new scientific communities that need large number of computing
resources beyond the size of existing service grids, and also involve new type of user and
resource provider communities beyond the scientific communities including citizens, school
students, and company employees.

Provide Grid application development interfaces and tools for the new scientific user
communities in order to adapt their applications for the EDGeS e-infrastructure.

Provide new trust mechanisms for the integrated e-infrastructure.

Establish international collaborations, procedures and standards for the integration of Service
Grids and Desktop Grids.

Contribute to the establishment of a sustainable Grid infrastructure in Europe by integrating
existing national and international service grids and desktop grids.
Action Plan
The consortium will create the integrated infrastructure in two phases. Phase 1 will establish a bridge
enabling Desktop Grid projects to send task to any Virtual Organisations of EGEE that are ready to
support such external projects. Phase 2 will create the reverse direction of the bridge extending EGEE
with the capacity of connected Desktop Grids, and enabling their user communities to transparently
utilize these new resources. During these phases the consortium will train both user communities how
to use the integrated infrastructure and will support them in gridifying and making their applications
desktop grid enabled for the new infrastructure.
8/9
9/9