MERIS Monthly Report – September 2016
Title:
Document Author:
Document Approver:
Issue date:
Revision number:
Reference Document:
MERIS Monthly Report – September 2016
A. Paciucci/G. Davies
Paolo Boezi
11 Oct 2016
1.1
XPReSS-SER-REP-0376
Page 1 of 17
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016
Contents
1 Introduction.......................................................................................................................................................... 4
2 Project Overview – Summary ............................................................................................................................... 5
3 Technical Overview .............................................................................................................................................. 7
3.1
Data Collection ............................................................................................................................................ 7
3.2
Data Consolidation ...................................................................................................................................... 7
3.3
Integration ................................................................................................................................................ 11
3.4
Processing ................................................................................................................................................. 11
3.5
Repatriation .............................................................................................................................................. 11
3.6
Configuration and Change Management .................................................................................................. 12
3.7
Anomaly Handling ..................................................................................................................................... 12
3.8
Web Page .................................................................................................................................................. 12
3.9
Risk Status ................................................................................................................................................. 12
4 Planning and Schedule ....................................................................................................................................... 13
4.1
Milestone and Schedule Status ................................................................................................................. 13
4.2
CFI Status................................................................................................................................................... 15
5 Plans for Next Period .......................................................................................................................................... 16
6 Other highlights .................................................................................................................................................. 17
Page 2 of 17
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016
Table of Figures
Figure 1. MERIS RR Status Summary ......................................................................................................................... 5
Figure 2. MERIS FR Status Summary.......................................................................................................................... 5
Figure 3: MERIS FR project Gantt ............................................................................................................................ 13
Figure 4: MERIS RR Project Gantt ............................................................................................................................ 14
Table of Tables
Table 1. Risks ........................................................................................................................................................... 12
Page 3 of 17
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016
Introduction
1
The X-PReSS MERIS Monthly Report provides details on the progress on the MERIS improvement loop - 4th RR
and FR reprocessing. The scope of the project activated so far is:
•
•
Collection of:
•
MERIS RR L0 Consolidated Dataset at the Low Rate Archive Centre (LRAC)
•
MERIS RR L0 (Kiruna unconsolidated products)
•
MERIS RR L0 (delivered by ACRI)
Consolidation of:
•
MERIS RR L0 products
•
MERIS FR L0 data products
•
ECONS Processor integration
•
MERIS ECONS delta processing of RR products
S[&]T , Magellium and CEMS are working on ECONS integration activities, processing project is expected to be
activated later.
INTA is working on MERIS FR consolidation activity.
This report covers progress during the reporting period against the baseline plan, issues and plans for the next
reporting period.
Page 4 of 17
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016
2
Project Overview – Summary
This section reports the main points related to service performance over the reporting period.
The overall status of the project is summarized in the figures below (which are also available on the MERIS Web
pages (http://xpress.sp.serco.eu/MERIS_RR/ and http://xpress.sp.serco.eu/MERIS_FR/); additional and detailed
information can be found below.
Figure 1. MERIS RR Status Summary
Figure 2. MERIS FR Status Summary
Page 5 of 17
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016
The RR L0 data (consolidated and unconsolidated) received by CEMS has been copied into the infrastructure.
Magellium developed the consolidation (ECONS) approach and a the final TN has been released to ESA, comments
received have been implemented and the final consolidation results have been presented to ESA EO Asset
Certification Board meeting held on last 14th June 2016.
The FR L0 data is at INTA after being returned by ESA from the previous collection project, and the three NASes
are connected to the infrastructure. The consolidation activity has been undertaken by INTA due to the request to
anticipate the Certification meeting coming from ESA. The consolidation activity is now completed and the results
shown during the Certification meeting held on the 14th of June.
Several teleconferences held with Magellium to finalize the consolidation activities and prepare the final presentation.
Magellium prepared a Consolidation TN including the methodologies proposed to handle the consolidation and the
recommendations suggested by the team to handle ECONS inconsistencies/ gaps / overlap includes also any
additional ECONS processing to be proposed; and as second release of the same TN includes also the results
achieved.
INTA prepared the Consolidation TN including the methodologies and results for MERIS FR.
The gap analyses for MERIS RR and MERIS FR products have been provided to ESA and results have been shown
during the certification meeting.
In preparation for the integration of MEGS (not activated yet), further iterations with IDEAS+ and GMQ were done
in order to understand the status of the processor development and the possible date for deliver to X-PReSS. The
MEGS processor has been delivered to X-PReSS on 23.09.2016, discussion around validation of the processor is ongoing.
X-PReSS is collaborating closely with IDEAS+ on the definition and monitoring of the overall reprocessing plan and
schedule, the reprocessing plan has not been delivered yet.
The activity during this month was concentrated in progressing housekeeping documentation. The main plans for
next month are to finalise the remaining documentation and to work on integration activity if the processing part of
the project will be activated, otherwise the project will be closed and the final report including the activities already
undertaken will be delivered and a new project will be opened when the processing part will be activated.
Page 6 of 17
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016
Technical Overview
3
This section summarises the main issues regarding the technical work carried out by the service over the
reporting period. The activities are reported according to the following core areas: Data Collection, Integration,
Processing, Configuration and Change Management, Anomaly Handling, Web Page and Risk Status.
This Chapter is subdivided into the same main tasks and provides a summary of the most important events for
each one of the tasks.
3.1
Data Collection
The progress for the reporting period on collection is summarised below:



MERIS RR L0:
•
Consolidated Dataset at the LRAC, 25 TB (DL106): received at CEMS, copied into
Infrastructure.
•
Kiruna unconsolidated products, 26.2 TB (compared to 15 TB in the project proposal) (DL106):
received at CEMS and copied into Infrastructure
•
Data delivered by ACRI, 4 TB (DL028): received at CEMS on 11/11/2015, copied into the
infrastructure
•
To facilitate the development of the consolidation approach, the data from each DL has been
copied into the infrastructure and made available to Magellium. A VM and VPN access to
CEMS Infrastructure have been made available to Magellium to give them direct access to the
data and proceed to analysis.
MERIS FR L0:
•
The three L0 NASes from the previous MERIS improvement loop have been returned to
INTA, inspected and connected.
•
The FR L0 data for 2012 which were retrieved by EOSense are still available by ftp.
It has been agreed with ESA that MER_CA__0P products will not be collected/consolidated. The
definitive listing of the dataset has been received and was passed on to IDEAS+ and EOSense to check
as their dataset had 2 fewer files. The missing files have been received from the Data Librarian and
passed on to IDEAS+ and ALTS.
The activity is completed only the documentation part is under finalization and it will be closed by end of next
reporting period.
3.2
Data Consolidation
The progress for the reporting period on data consolidation is summarised below:

General:
Page 7 of 17
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016
•
All available input material from IDEAS+, ESA and the 3rd reprocessing has been passed to
Magellium and INTA as input to the consolidation approach, as well as the L0 product
specifications.
•
DMOP and Mission unavailability files have been collected from ESA PM and provided to
Magellium and INTA to speed up the gap analysis phase.
•
14 Corrupted Files found by Magellium have been submitted for inspection to ESA for further
analysis. According to the ESA findings, these files are corrupted from the origin.
•
Magellium and INTA finalized the TNs including the methodologies proposed to handle the
consolidation and the recommendations suggested by the team to handle ECONS
inconsistencies/ gaps / overlaps and the results achieved as part of the consolidation activities
and the same has been submitted to IDEAS+, comments received have been discussed, agreed
with IDEAS+ and have been implemented. Final version delivered and published on X-PReSS
Web page.
•
The gap analysis for MERIS RR and FR have been provided to ESA for legacy tapes check and
identification of potential gaps to be recovered by tape transcription.
The activity is completed including the documentation part.

MERIS RR L0:
•
ECONS processing approach defined and implemented.
Figure 1: MERIS RR NRT Consolidated Dataset
Page 8 of 17
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016
Figura 2: MERIS RR ECONS Consolidated dataset
Page 9 of 17
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016

MERIS FR L0:
•
Consolidation completed, gap analysis provided and TN finalized and reviewed by IDEAS+
•
MERIS FR reprocessing results used to better characterize the dataset have been certified during
the EO Asset Board meeting.
Figura 3 : MERIS FR consolidation results
Figura 4: MERIS FR Consolidated dataset
Page 10 of 17
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016
3.3
Integration
The progress for the reporting period on processing is summarised below:

Discussions with S[&]T about the integration of ECONS completed:
•
The number of products to be processed has been clarified between Serco and S[&]T;
•
Integration finalized;
•
Infrastructure setup completed.
The activity is completed; the documentation part has been delivered to ESA PM for review.


MERCI (integration not activated yet):
•
The MERCI installation and administration manual was provided by Brockmann on 16
November 2015;
•
MERCI has been released to XPReSS by BC on the mid of April. The formal delivery as CFI by
ESA is arrived to IDEAS+.
MEGS (integration not activated yet):
•
A teleconf was held between Philippe Goryl, Véronique Bruniquel (ACRI) and X-PReSS on 12
February 2016 to discuss the status of MEGS and the support from ACRI during the
reprocessing;
•
Draft documentation on how to run MEGS for the reprocessing was provided by ACRI on 19
February 2016 and is being used by INTA and CEMS to assess the integration complexity and
the ERA-Interim data to be collected from ECMWF.
•
Delivery received from Acri on 23.09.2016 via ftp including:

The MERIS L1 and L2 processors package for the 4th data reprocessing

4 TDSs covering the possible instrument settings and resolutions

Documentation to install and operate the processors MER4RP-OPE-001-ACR_v1.0.pdf.
It has been clarified from IDEAS+ that the processor is not under their responsibility in term of validation;
discussion are on-going to verify who is responsible for validation.
Acri provided also the following additional information “some ESLs may still change some ADF values. We have a
teleconference with the QWG members on 3rd October to discuss the situation and potential values tuning. I will keep you informed if
some adjustments are required.” This needs to be monitored and clarified before starting the reprocessing
3.4
Processing
Processing activities have not started yet.
3.5
Repatriation
At ESA’s request for EOSense’s work on the ALTS and IDEAS+ projects, FR data on DL149a (3018 files - full year
2012) were transferred to INTA’s DMZ FTP and downloaded by EOSense. A request for additional data from April
Page 11 of 17
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016
to December 2011 has been requested by ESA. Data are made available on ftp-server to allow the user to download
it.
3.6
Configuration and Change Management
The L0 XML extraction for the FR and RR data is on-going as part of the collection and consolidation activities.
3.7
Anomaly Handling
No anomalies have been opened yet.
3.8
Web Page
The web pages have been set up and are being actively maintained:
http://xpress.sp.serco.eu/MERIS_RR/
http://xpress.sp.serco.eu/MERIS_FR/
3.9
Risk Status
The risk status is summarised in the table below.
Table 1. Risks
Risk
Delay in RR collection
activities, due to multiple
parallel activities at facility
Tight Schedule for
completion of consolidation
before processing
Tight Schedule for
Certification Meeting
Probability
Impact
Risk
Index
Low
Medium
Medium
Medium
Medium
Medium
High
High
Medium
Page 12 of 17
Mitigation
Plan facility utilisation for
all related projects
including taking into
account GMQ’s planning
of MERIS and AATSR
Ensure close collaboration
with IDEAS+ in
consolidation activities
Split Data Expert role
between Magellium (RR)
and INTA (FR)
Status
Closed
Closed
Closed
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016
4
Planning and Schedule
The schedule status is presented with reference to the agreed milestones and CFIs in the subsections below.
4.1
Milestone and Schedule Status
The key milestones are included in CFI and milestones table in the next section. The plan has been updated now that
the request of consolidation to bring forward compared with the original schedule has been resolved and the
certification meeting held on schedule. Considering the uncertainty around the processor deliver schedule the plan for
reprocessing part could be subject to further review when the processor will be available and the reprocessing part of
the project will be formally activated by the Agency. The plan is also available on MERIS Web pages
(http://xpress.sp.serco.eu/MERIS_RR/ and http://xpress.sp.serco.eu/MERIS_FR/ ). Project Gantt is reported
below:
Figure 3: MERIS FR project Gantt
Page 13 of 17
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016
Figure 4: MERIS RR Project Gantt
Page 14 of 17
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016
4.2
CFI Status
The status of the CFI needed for this reprocessing campaign is summarised in the table embedded below:
CFI, milestones and
DELIVERABLES.xlsx
Page 15 of 17
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016
5
Plans for Next Period
This section summarises the main plans for the next reporting period:

Collection:
o

Finalization of Collection documentation
Integration:
o
Start to work on MEGS processor integration (if this will be activated)

Discuss with ESA the processing part activation

Work closely with IDEAS+/GMQ for future reprocessing campaign including MERCI delivery and
usage

Housekeeping documentation
Page 16 of 17
MERIS Monthly Report September 2016
Ref. XPReSS-SER-REP-0376
MERIS Monthly Report – September 2016
6
Other highlights
None.
Page 17 of 17