Big Data from Space:
the Copernicus contribution
P. Bargellini, H. Laur – EO Ground Segment and Mission Operations Department,
European Space Agency
BIDS’16 – Big data from Space: the Copernicus contribution
Sentinel-1A: Radar Vision
Acquired on 28 February 2016
Tenerife
BIDS’16 – Big data from Space: the Copernicus contribution
Gran Canaria
Sentinel-1A: Radar Vision
Tenerife
Tenerife
ESA UNCLASSIFIED –
For Official Use
ESA UNCLASSIFIED – For Official Use
BIDS’16 – Big data from Space: the Copernicus contribution
Acquired on 28 February 2016
Sentinel-3A: Sea and Land Surface Temperature
Radiometer (SLSTR)
Acquired on 3 March 2016
ESA UNCLASSIFIED –
For Official Use
BIDS’16 – Big data from Space: the Copernicus contribution
Sentinel-2A: Colour Vision
Acquired on 7 March 2016
BIDS’16 – Big data from Space: the Copernicus contribution
Sentinel-2A: Colour Vision
Acquired on 7 March 2016
BIDS’16 – Big data from Space: the Copernicus contribution
The Copernicus Programme
Copernicus (formerly known
as GMES) is a European space
flagship programme led by
the European Union
Space
Component
Provides the necessary data
for operational monitoring of
the environment and for civil
security
ESA coordinates the space
component
In-Situ
Component
Services
Component
7
BIDS’16 – Big data from Space: the Copernicus contribution
Copernicus Contributing Missions
Providing since 2008 high quality data to Copernicus users
BIDS’16 – Big data from Space: the Copernicus contribution
Copernicus Space Component: Dedicated Missions
S1: Radar Mission
S2: High Resolution Optical Mission
S3: Medium Resolution Imaging and Altimetry Mission
S4: Geostationary Atmospheric Chemistry Mission
S5P: Low Earth Orbit Atmospheric Chemistry Precursor Mission
S5: Low Earth Orbit Atmospheric Chemistry Mission
S6 (Jason-CS): Altimetry Mission
BIDS’16 – Big data from Space: the Copernicus contribution
9
Sentinels Operations: latest status
 Sentinel-1A nominal routine operations continue
•
•
Start of data download via the European Data Relay System: May 2016
Sentinel-1B launch: scheduled on 22 April 2016
 Sentinel-2A ramp-up phase in progress
•
Very good performance of space and ground segments
•
Opening of access to core products access for all users on 3rd December 2015
 Sentinel-3A commissioning phase in progress
•
All instruments switched ON and confirmed healthy
•
First data processed and images released on-line
 Sentinel-5 Precursor space and ground segment
validation completed
•
Launch: autumn 2016
BIDS’16 – Big data from Space: the Copernicus contribution
Sentinel data – Systematic Production
In 2015 an average of 3 TB of core products
was generated daily
By end 2016 it is projected that this figure will increase to more than
6 TB a day
Full Sentinel-1A production available
online: > 450,000 products
BIDS’16 – Big data from Space: the Copernicus contribution
Full Sentinel-2A production available
online: > 14,000 products
Sentinel Data Dissemination - Overview
•
Online access to Sentinel products via dedicated data hubs
• Users can register at sentinels.copernicus.eu
• ESA CSC Ground Segment data distribution is ensuring that at any point in
time any user can retrieve all Sentinels products
• Includes most recent products as well as full Long Term Archive
Data Hub software (DHuS) provides and OPEN
SOURCE Web interface
Users can set own scripts to automatically
download the data
BIDS’16 – Big data from Space: the Copernicus contribution
Sentinel data - Users Registration
Number of
registered users
A sharp increase of users
as a consequence of Data Policy and Mission Operations Concept
systematic observation, acquisition, processing and dissemination
26,680 self-registered users on
open access data hub
(status 10 March 2016)
Copernicus missions
data users
(through open hub)
ESA missions
data users
Many Sentinel-1 data users were Envisat /ERS SAR data users. They appear in both groups of stats (ESA missions & Copernicus missions)
BIDS’16 – Big data from Space: the Copernicus contribution
Sentinel Products Access Heatmap
Some 3.7 million Sentinel-1 products downloaded to date
corresponding to 4.5 Petabytes of data
In 2015: on average each product
was downloaded 10 times
In 2015: 30 TB of products have been
disseminated on average a day
BIDS’16 – Big data from Space: the Copernicus contribution
It is projected that by end 2016
100 TB of products will be
disseminated daily
EO Innovation Europe
Need to introduce complementary data access solutions
based on Big Data Paradigm
A Future Scenario of interconnected
Exploitation Platforms
BIDS’16 – Big data from Space: the Copernicus contribution
What is an Exploitation Platform ?
“Move User activities to the Data”
Exploitation platforms
EO
software
ICT
resources
Innovative operations concept
Users access a work environment containing data and
resources, as opposed to downloading the data ‘at
home’
EO data
In-situ data
Exploitation platform =
Virtual open and collaborative environment
bringing together:
•data centre (EO and non-EO data)
•computing resources and hosted processing
•collaborative tools (processing tools, data mining tools, user
tools, …)
•concurrent design and test bench functions
•application shops and market place functionalities
•communication tools (social network) and documentation
•accounting tools to manage resource utilisation
Exploitation platform = Community platform = EO platform = Applications platform
BIDS’16 – Big data from Space: the Copernicus contribution
EO Innovation Europe
an “ecosystem“ of exploitation platforms
The best worldwide
EO data asset
Europe EO
Operational public
EO data
Increasing data
volume &
diversity
Evolving
user expectations
“traditional” data delivery
Vivid global user communities
5 interconnected user groups
Users public
services
(Sentinel, Meteo)
Heritage EO data
(e.g. Spot-1, Envisat)
R&D EO data
(e.g. Earth Explorers)
Commercial
EO data
e.g. RapidEye, Deimos
Network of
exploitation
platforms
Users R&D
remote sensing
“EO-Innovation
Europe”
“Big Data”
Users profit-making
services
Users
geosciences
General public,
education, media
Airborne &
in-situ data
Objectives:
How:
Enabling large scale exploitation of EO data
Stimulating the innovation with EO data
Interoperable/interconnected platforms
around a core enabling element
Maximising impact of European EO assets
and preserving European independence
Common governance rules
BIDS’16 – Big data from Space: the Copernicus contribution
Open to multi-source funding initiatives
EO Innovation Europe
Funding and enabling governance rules
Open to multi-source funding initiatives
EO-Innovation Europe is a key concept of the ESA EO Envelop Programme and
provides a robust framework for “innovation and science”
 an open concept, inviting initiatives of partners at EU, National and industrial level
 a common set of enabling governance rules
• Open, non-discriminative access to platforms and resources
• Offer a combination of free, sponsored and pay-per-use services
• Stable delineation of scope for institutional + commercial activities
Outreach element
Stimulating element
Enabling
element
• Protection of IPR and data
• System and data security
• A clear level of commitment on business continuity
• A participative model for any evolution of the governance rules involving all stakeholders
The EO-Innovation Europe values:
Collaboration, sharing, networked governance, affiliation, “open for business”
BIDS’16 – Big data from Space: the Copernicus contribution
EO Innovation Europe
Partnerships, Synchronised Programming, Cooperative funding
“Potential programmatic lines”
EOEP-5 (EO Application Platforms)
LTDP+, Earthnet
EO-Innovation
Europe
Common concept,
Partnership,
Synchronised
programming,
Cooperative funding
“Big Data”
Sentinel Collaborative Ground Segment
National missions data access
Copernicus Data and Information Access Service
Open Science Cloud
EU
GEOSS Common Infrastructure
….
“EO market place”
Open to additional actors
BIDS’16 – Big data from Space: the Copernicus contribution
Thank You
Copernicus Programme: copernicus.eu
Sentinel Online: sentinels.copernicus.eu
Sentinel app: available in iTunes
BIDS’16 – Big data from Space: the Copernicus contribution
Copernicus data (2015): elaborated by VisioTerr