Fiducial Reference Measurements for validation of Surface Temperature from
Satellites (FRM4STS)
D140- Appendix A: linked evidence to support the summary in the database
Summary
ESA Contract No. 4000113848_15I-LG
Evangelos Theocharous & Nigel Fox
PROTECT - COMMERCIAL
NOVEMBER 2015
Reference
OFE-D-140A-V1-Iss-1-Ver-1-DRAFT
Issue
1
Revision
1
Date of Issue
09 November 2015
Status
DRAFT
Document Type
D140- Database
NPL - Commercial
OFE-D-140-V1-Iss-1-Ver-1-DRAFT
INTENTIONALLY BLANK
Page 2 of 16
NPL - Commercial
OFE-D-140-V1-Iss-1-Ver-1-DRAFT
Fiducial Reference Measurements for validation of Surface Temperature
from Satellites (FRM4STS): Laboratory Calibration of Participants
Radiometers and Blackbodies
Appendix A: Linked Evidence to Support the Database Summary
Evangelos Theocharous & Nigel Fox
Environment Division
NPL - Commercial
OFE-D-90-V1-Iss-1-Ver-1-DRAFT
 Queen’s Printer and Controller of HMSO, 2015
National Physical Laboratory
Hampton Road, Teddington, Middlesex, TW11 0LW
This report is Protect - Commercial and must not be exposed to casual examination. It is not for
general distribution and should not be cited as a reference other than in accordance with the contract .
Page 4 of 16
NPL - Commercial
OFE-D-140-V1-Iss-1-Ver-1-DRAFT
19
CONTENTS
DOCUMENT VERSION HISTORY
DOCUMENT APPROVAL
APPLICABLE DOCUMENTS .............................................................................................................7
INTRODUCTION:.................................................................................................................................8
THE LABORATORY COMPARISON OF RADIOMETERS AND BLACKBODIES OF
PARTICIPANTS. ...........................................................................................................................9
1.1 THE LABORATORY COMPARISON OF RADIOMETERS OF THE PARTICIPANTS .........9
1.2 THE LABORATORY COMPARISON OF BLACKBODIES OF PARTICIPANTS ................11
2. WATER SURFACE TEMPERATURE (WST) COMPARISON ...............................................12
3. LAND SURFACE TEMPERATURE (LST) COMPARISON AT NPL .....................................14
4. LAND SURFACE TEMPERATURE (LST) COMPARISON IN NAMIBIA ............................16
5. ICE SURFACE TEMPERATURE (LST) COMPARISON IN THE ARCTIC ...........................16
4. REFERENCES .............................................................................................................................16
NPL - Commercial
OFE-D-140-V1-Iss-1-Ver-1-DRAFT
DOCUMENT MANAGEMENT
Issue Revision Date of
Issue/revision
1
1
09-Nov-15
Description of Changes
Creation of document
DOCUMENT APPROVAL
Contractor Approval
Name
Role in Project
Dr Nigel Fox
Technical Leader
Mr David Gibbs
Project Manager
Signature & Date (dd/mm/yyyy)
CUSTOMER APPROVAL
Name
Role in Project
C Donlon
ESA Technical Officer
Signature
Date (dd/mm/yyyy)
Page 6 of 16
NPL - Commercial
OFE-D-140-V1-Iss-1-Ver-1-DRAFT
19
APPLICABLE DOCUMENTS
AD Ref.
EOPSM/2642
Ver.
/Iss.
1
Title
Fiducial Reference Measurements for Thermal Infrared Satellite
Validation (FRM4STS) Statement of Work
NPL - Commercial
OFE-D-140-V1-Iss-1-Ver-1-DRAFT
INTRODUCTION:
The websites database will be divided into (at least) five main Sections tabs of a page which will
initially be populated from the results of the current round of comparisons see below:
i.
Laboratory comparison of radiometers and blackbodies of participants.
ii.
Water Surface Temperature (WST) comparison near NPL.
iii.
Land Surface Temperature (LST) comparison at NPL.
iv.
Land Surface Temperature (LST) comparison in Namibia.
v.
Ice Surface Temperature (IST) comparison in the Arctic.
However, since the database is intended to be a long term updatable store of information for future
comparisons and bi-lateral events the detail of these activities will sit behind the database in an
archive, linked as part of D150. The content of the archive will be as shown in Appendix A
The front end of the database will consist of searchable fields identifying the participant organisation,
Date of any comparison (overall set of comparisons for a given exercise), Type and location e.g. water
(atlantic ocean) Queen Mary or Laboratory (NPL), Type of instrument and unique ID, Brightness temp
range (could be several values if appropriate e.g for a laboratory exercise), %Difference to any
comparison defined reference (could be a different participant and for an exercise with many
participants a separate entry indicating any bias for each participant will be included), Uncertainty of
participant, Uncertainty of comparison, comments, Link to Evidence (Appendix A).
Each field will be searchable. It is intended that going forward the database will be added to and times
series of bi-lateral comparisons identified.
Page 8 of 16
NPL - Commercial
OFE-D-140-V1-Iss-1-Ver-1-DRAFT
19
APPENDIX A-THE LABORATORY COMPARISON OF RADIOMETERS AND
BLACKBODIES OF PARTICIPANTS.
This Section of the website contains all the detail and for the comparisons being carried out in
FRM4STS which will be the initial population data set it will be subdivided into two sub-Sections, one
dealing with the comparison of the participants’ radiometers while the other will be dealing with the
participants’ blackbodies.
1.1 THE LABORATORY COMPARISON OF RADIOMETERS OF THE PARTICIPANTS
This Section of the website will include a short introduction and a summary of the conditions under
which this particular comparison was carried out during the week beginning 20th June 2016. There will,
of course, be a reference to the protocol of the laboratory comparison of the radiometers of the
participants [1]. This will be followed by another part which will include the results/measurements of
this particular part of the comparison. This Section of the website will consists of number of directories,
each devoted to the measurements provided by a particular participant. The directory of a particular
participant will include sub-directories corresponding to measurements made on different days and
with the reference blackbody being measured operating at different temperatures. The sub-directories
will include:
a. Excel files which will contain the measurements of the brightness temperature of the
reference blackbody reported by the participant to whom the directory is assigned. Each excel
file will tabulate the brightness temperature of the reference blackbody at different times over
the monitoring period. The excel file will start with information on the conditions which
prevailed during the period when those measurements were taken, including information on
the laboratory ambient temperature and laboratory ambient humidity. It will also include a
table with the following columns of data:
i.
ii.
iii.
The first column will indicate the date of the measurement.
The second column will show the UTC time at which the measurements were done.
The third column will show the brightness temperature of the reference blackbody at
each particular time, as measured by the participant’s radiometer.
iv.
The fourth column will show the combined uncertainty of that particular brightness
temperature measurement, as measured by that participant.
Each excel file will also include graphical plots of the measurements of the reference blackbody
temperature reported by that particular participant, as a function of time.
b. Excel files which will contain the measurements of the temperature of the reference blackbody
reported by the pilot. Each excel file will tabulate the temperature of the reference blackbody
at different times over the time over which the test radiometer was monitoring the reference
blackbody. The excel file will start with information on the conditions which prevailed during
the period of those measurements, including information on the lab ambient temperature and
lab ambient humidity. It will also include columns of data:
i.
The first column will indicate the date of the measurement.
NPL - Commercial
OFE-D-140-V1-Iss-1-Ver-1-DRAFT
ii.
iii.
The second column will show the UTC time at which that measurement was done.
The third column will show the temperature of the reference blackbody at that
particular time, as reported by the pilot.
iv.
The fourth column will show the combined uncertainty of that particular blackbody
temperature measurement, as estimated by the pilot.
Each excel file will also include graphical plots of the measurements of the blackbody
temperature reported by the pilot, as a function of time.
c. Excel summary files which will combine the measurements of the brightness temperature of
the reference blackbody reported by the participant to whom the directory is assigned, with
the measurements of the temperature of the reference blackbody reported by the pilot. Each
excel file will tabulate the two temperature values at different times over the monitoring
period. The excel file will start with information on the conditions which prevailed during the
period of those measurements, including information on the lab ambient temperature and lab
ambient humidity. It will also include columns of data:
i.
ii.
The first column will indicate the date of the measurement.
The second column will show the UTC time at which that particular measurement was
done.
iii.
The third column will show the brightness temperature of the reference blackbody at that
particular time, as measured by the participant’s radiometer1.
iv.
The fourth column will show the combined uncertainty of that particular brightness
temperature measurement, as estimated by the participant.
v.
The fifth column will show the temperature of the reference blackbody at that particular
time, as measured by the pilot.
vi.
The sixth column will show the combined uncertainty of the temperature of the reference
blackbody for that particular temperature measurement, as estimated by the pilot.
vii.
The seventh column will show the difference in the value of the temperature measured by
the test radiometer from the value of temperature of the reference blackbody reported
by the pilot. This column represents the “error” with which the test radiometer measures
the brightness temperature of the reference blackbody under that particular setting.
viii.
The eighth column will show the uncertainty resulting from combining the total
uncertainty of the brightness temperature measured by the participant (shown in the
fourth column) and the total uncertainty of the reference blackbody reported by the pilot
(shown in the sixth column).
Each excel summary file will also include graphical plots of the measurements of the reference
blackbody temperature reported by the participant (measured by the test radiometer) and the
corresponding measurement completed by the pilot, as a function of time. It will also include
plots of the difference in the value of the temperature measured by the test radiometer from
the value of temperature of the reference blackbody reported by the pilot. This plot represents
the “error” with which the test radiometer measures the brightness temperature of the
reference blackbody, as a function of time.
1 Since the times of the two measurements are unlikely to coincide, Matlab will be used to interpolate the values
of temperature at regular (but common) times during the period over which the test radiometer was monitoring
the reference blackbody.
Page 10 of 16
NPL - Commercial
OFE-D-140-V1-Iss-1-Ver-1-DRAFT
19
1.2 THE LABORATORY COMPARISON OF BLACKBODIES OF PARTICIPANTS
This Section will start with a short introduction which will be followed by a summary of the conditions
under which that particular comparison was carried out. There will, of course, be a reference to the
protocol of the laboratory comparison of the blackbodies of the participants [1]. This will be followed
by another Section which will include the results/measurements of this particular part of the
comparison. This Section will consists of number of directories, each devoted to the measurements
provided by a particular participant. The directory of a particular participant will include sub-directories
corresponding to measurements made on different days and with the test blackbodies being measured
being at different temperatures. The sub-directories will include:
a. Excel files which will contain the measurements of the brightness temperature of the test
blackbody reported by the participant to whom the directory is assigned. Each excel file will
tabulate the brightness temperature of the test blackbody at different times over the
monitoring period. The excel file will start with information on the conditions which prevailed
during the period when those measurements were taken, including information on the lab
ambient temperature and lab ambient humidity. It will also include a table with the following
columns of data:
i.
The first column will indicate the date of the measurement.
ii.
The second column will show the UTC time of the measurement.
iii.
The third column will show the brightness temperature of the test blackbody at that
particular time, as reported by the participant.
iv.
The fourth column will show the combined uncertainty of the measurement of the
brightness temperature of the test blackbody, as estimated by the participant.
Each excel file will also include graphical plots of the measurements of the blackbody temperature
reported by that particular participant as a function of time.
b. Excel files which will contain the measurements of the temperature of the test blackbody as
measured by AMBER or the PTB IR broadband radiometer. Each excel file will tabulate the
temperature of the test blackbody at different times over the time over which the reference
radiometer was monitoring the test blackbody. The excel file will start with information on the
conditions which prevailed during the period of those measurements, including information
on the lab ambient temperature and lab ambient humidity. It will also include columns of data:
i.
ii.
iii.
The first column will indicate the date of the measurement.
The second column will show the UTC time at which that measurement was done.
The third column will show the temperature of the test blackbody at that particular
time, as measured by the reference radiometer.
iv.
The fourth column will show the combined uncertainty of that particular temperature
measurement, as estimated by the operator of the reference radiometer.
Each excel file will also include graphical plots of the measurements of the blackbody
temperature reported by the operator of the reference radiometer, as a function of time.
c. Excel summary files which will combine the measurements of the brightness temperature of
the test blackbody reported by the participant to whom the directory is assigned with the
measurements of the temperature made by the reference radiometer and reported by its
operator. Each excel file will tabulate the two temperature values at different times over the
NPL - Commercial
OFE-D-140-V1-Iss-1-Ver-1-DRAFT
monitoring period. The excel file will start with information on the conditions which prevailed
during the period of those measurements, including information on the lab ambient
temperature and lab ambient humidity. It will also include columns of data:
i.
ii.
iii.
The first column will indicate the date of the measurement.
The second column will show the UTC time of the measurement.
The third column will show the brightness temperature of the test blackbody at that
particular time, as reported by the participant2.
iv.
The fourth column will show the combined uncertainty of the test blackbody at that
particular brightness temperature, as estimated by the participant.
v.
The fifth column will show the temperature of the test blackbody at that particular
time, as measured by the operator of the reference radiometer.
vi.
The sixth column will show the combined uncertainty of the temperature of the test
blackbody measured by the reference radiometer, as estimated by the operator of the
reference radiometer.
vii.
The seventh column will show the difference in the value of the temperature of the
test blackbody (reported by the participant) from the value of temperature of the test
blackbody measured by the reference radiometer. This column represents the “error”
with which the participant estimates the brightness temperature of the test
blackbody, under that particular setting and operating conditions.
viii.
The eighth column will show the uncertainty resulting from combining the total
uncertainty of the brightness temperature measured by the participant (shown in the
fourth column) and the total uncertainty of the test blackbody reported by the pilot
(shown in the sixth column).
Each excel summary file will also include graphical plots of the measurements of the test
blackbody temperature reported by the participant and the corresponding measurement
completed by the reference radiometer, as a function of time. It will also include plots of the
difference in the value of the temperature measured by the reference radiometer from the
value of temperature of the test blackbody reported by the participant. This plot represents
the “error” with which the test radiometer measures the brightness temperature of the
reference blackbody as a function of time.
2.
WATER SURFACE TEMPERATURE (WST) COMPARISON
This Section of the website will include a short introduction and a summary of the conditions under
which this particular comparison was carried out during the week beginning 27th June 2016. There will,
of course, be a reference to the protocol of the WST comparison of the radiometers of the participants
[2]. This will be followed by another Section which will include the results/measurements of this
particular part of the comparison. This Section will consists of number of directories, each devoted to
the measurements provided by a particular participant. The directory of a particular participant will
include sub-directories corresponding to measurements made on different days and different angles
of view to the nadir. The sub-directories will include:
2 Since the times of the two measurements are unlikely to coincide, Matlab will be used to interpolate the values
of temperature at regular (but common) times during the period over which the reference radiometer was
monitoring the test blackbody.
Page 12 of 16
NPL - Commercial
OFE-D-140-V1-Iss-1-Ver-1-DRAFT
19
a. Excel files which will contain the measurements of the WST of the water target reported by
the participant to whom the directory is assigned. Each excel file will tabulate the WST of the
target at different times over the monitoring period. The excel file will start with information
on the conditions which prevailed during the period when those measurements were taken,
including information on the ambient temperature and ambient humidity. It will also include
a table with the following columns of data:
i.
ii.
The first column will indicate the date of the measurement.
The second column will show the UTC time at which that particular measurement was
done.
iii.
The third column will show the WST of the water target at that particular time, as
measured by the participant’s radiometer.
iv.
The fourth column will show the combined uncertainty of that particular WST
measurement, as estimated by the participant.
v.
The fifth column will indicate the angle of view of the test radiometer to the nadir,
corresponding to that particular WST measurement.
Each excel file will also include graphical plots of the measurements of the blackbody temperature
reported by that particular participant as a function of time.
b. Excel summary files which will combine the measurements of the WST of the target reported
all the participants which took part in the comparison. An excel summary file will tabulate the
WST values measured by the participants at different times over the monitoring period. The
excel file will start with information on the conditions which prevailed during the period when
those measurements were made, including information on the ambient temperature and
ambient humidity. It will also include columns of data:
i.
ii.
iii.
iv.
v.
vi.
vii.
viii.
ix.
The first column will indicate the date of the measurement.
The second column will show the UTC time at which that particular measurement was
done.
The third column will show the WST of the target at that particular time, as measured
by the first participant3.
The fourth column will show the combined uncertainty of that particular WST
measurement, as estimated by the first participant.
The fifth column will show the WST of the target at that particular time, as measured
by the second participant.
The sixth column will show the combined uncertainty of that particular WST
measurement, as estimated by the second participant.
The measurements and uncertainties of the next participant will be tabulated in the
next two columns and so on until the measurements and associated uncertainties of
all particulars are shown in the spreadsheet.
The next column will show the average of the measurements of the WST of all
participants
The next column will show the difference in the value of the WST measured by the
first participant from the average value of temperature shown in the previous column.
3 Since the times of the two measurements are unlikely to coincide, Matlab will be used to interpolate the values
of temperature at regular (but common) times during the period over which the test radiometer was monitoring
the reference blackbody.
NPL - Commercial
OFE-D-140-V1-Iss-1-Ver-1-DRAFT
This column represents the “error” with which the first participant measured WST
under those particular conditions.
x.
The next column will show the difference in the value of the WST measured by the
second participant from the average value of temperature shown in a previous
column. This column represents the “error” with which the second participant
measured WST under those particular conditions
xi.
The difference in the measured WST from the mean will tabulated in the next columns
for all participants.
Each excel summary file will also include graphical plots of the measurements of the WST
reported by each participant and the average value of the measurements of all participants
made at that time, as a function of time. It will also include graphical plots of the difference in
the value of the WST measured by a participant from the average value of WST made by all
participants. This plot represents the “error” with which that particular participant measures
the WST as a function of time. In cases where there is a large variation in the magnitude of the
uncertainties reported by different radiometers/participants then uncertainty weighted
average values will be calculated and used in the table and plots discussed above.
3.
LAND SURFACE TEMPERATURE (LST) COMPARISON AT NPL
This Section of the website will include a short introduction and a summary of the conditions under
which this particular comparison was carried out during the week beginning 4th July 2016. There will,
of course, be a reference to the protocol of the LST comparison of the radiometers of the participants
[3]. This will be followed by another Section which will include the results/measurements of this
particular part of the comparison. This Section will consists of number of directories, each devoted to
the measurements provided by a particular participant. The directory of a particular participant will
include sub-directories corresponding to measurements made on different days and different angles
of view to the nadir. The sub-directories will include:
a. Excel files which will contain the measurements of the LST of the land target reported by the
participant to whom the directory is assigned. Each excel file will tabulate the LST of the target
at different times over the monitoring period. The excel file will start with information on the
conditions which prevailed during the period when those measurements were taken, including
information on the ambient temperature and ambient humidity. It will also include a table
with the following columns of data:
i.
ii.
iii.
iv.
v.
The first column will indicate the date of the measurement.
The second column will show the UTC time at which that particular measurement was
done.
The third column will show the LST of the land target at that particular time, as measured
by the participant’s radiometer.
The fourth column will show the combined uncertainty of that particular LST
measurement, as estimated by the participant.
The fifth column will indicate the angle of view of the test radiometer to the nadir,
corresponding to that particular LST measurement.
Page 14 of 16
NPL - Commercial
OFE-D-140-V1-Iss-1-Ver-1-DRAFT
19
Each excel file will also include graphical plots of the measurements of the blackbody temperature
reported by that particular participant as a function of time.
b. Excel summary files which will combine the measurements of the LST of the target reported
all the participants which took part in the comparison. An excel summary file will tabulate the
LST values measured by the participants at different times over the monitoring period. The
excel file will start with information on the conditions which prevailed during the period when
those measurements were made, including information on the ambient temperature and
ambient humidity. It will also include columns of data:
i.
ii.
The first column will indicate the date of the measurement.
The second column will show the UTC time at which that particular measurement was
done.
iii.
The third column will show the LST of the target at that particular time, as measured by
the first participant4.
iv.
The fourth column will show the combined uncertainty of that particular LST
measurement, as estimated by the first participant.
v.
The fifth column will show the LST of the target at that particular time, as measured by the
second participant.
vi.
The sixth column will show the combined uncertainty of that particular LST measurement,
as estimated by the second participant.
vii.
The measurements and uncertainties of the next participant will be tabulated in the next
two columns and so on until the measurements and associated uncertainties of all
particulars are shown in the table.
viii.
The next column will show the average of the measurements of the LST of all participants.
ix.
The next column will show the difference in the value of the LST measured by the first
participant from the average value of temperature shown in the previous column. This
column represents the “error” with which the first participant measured LST under those
particular conditions.
x.
The next column will show the difference in the value of the LST measured by the second
participant from the average value of temperature shown in a previous column. This
column represents the “error” with which the second participant measured LST under
those particular conditions.
xi.
The difference in the measured LST values from the mean will tabulated in the next
columns, for all participants.
Each excel summary file will also include graphical plots of the measurements of the LST
reported by each participant and the average value of the measurements of all participants
made at that time, as a function of time. It will also include graphical plots of the difference in
the value of the LST measured by a participant from the average value of LST made by all
participants. This represents the “error” with which each participant measures the LST under
those particular conditions. This plot represents the “error” with which that particular
participant measures the LST as a function of time. In cases where there is a large variation in
the magnitude of the uncertainties reported by different radiometers/participants, then
4 Since the times of the two measurements are unlikely to coincide, Matlab will be used to interpolate the values
of temperature at regular (but common) times during the period over which the test radiometer was monitoring
the reference blackbody.
NPL - Commercial
OFE-D-140-V1-Iss-1-Ver-1-DRAFT
uncertainty weighted average values will be calculated and used in the table and plots
discussed above.
4.
LAND SURFACE TEMPERATURE (LST) COMPARISON IN NAMIBIA
The website for this part of the comparison will be very similar to that for the LST comparison at NPL
(see Section 3 of this report).
5.
ICE SURFACE TEMPERATURE (LST) COMPARISON IN THE ARCTIC
The website for this part of the comparison will be very similar to that for the LST comparison at NPL
(see Section 3 of this report)
4. REFERENCES
1. Theocharous, E. and Fox, N. P., 2016, “Fiducial Reference Measurements for validation of
Surface Temperature from Satellites (FRM4STS) - Laboratory Calibration of Participants
Radiometers and Blackbodies”, Protocol for the FRM4STS LCE (LCE-IP), ESA Contract No.
4000113848_15I-LG, NPL report OFE-D-90A-V1-Iss-1-Ver-1
2. Theocharous, E. and Fox, N. P., 2016, “Fiducial Reference Measurements for validation of
Surface Temperature from Satellites (FRM4STS) - Water Surface Temperature Comparison of
Participants Radiometers”, Protocol for the FRM4STS LCE (LCE-IP), ESA Contract No.
4000113848_15I-LG, NPL report OFE-D-80A-V1-Iss-1-Ver-1
3. Theocharous, E. and Fox, N. P., 2016, “Fiducial Reference Measurements for validation of
Surface Temperature from Satellites (FRM4STS) - Land Surface Temperature Comparison of
Participants Radiometers”, Protocol for the FRM4STS LCE (LCE-IP), ESA Contract No.
4000113848_15I-LG, NPL report OFE-D-80A-V1-Iss-1-Ver-1
Page 16 of 16
NPL - Commercial