Joint OSSE data set at NASA Portal
DBL91 profile data for T511
Simulated prepbufr data
Simulated ozone data
Observation template data
Jack Woollen and Michiko Masutani
December 2009
Joint OSSE Nature Run data
http://portal.nccs.nasa.gov/osse
Password protected
The complete data for T511NR and T799NR. Model level data and surface data are saved as a reduced
gaussian grid. Regular lat-lon grid data for pressure levels, isentropic levels and surface data are also
provided for verification purposes.
For more detail visit:
http://www.emc.ncep.noaa.gov/research/JointOSSEs
Access to the complete data is available from the NASA/GSFC portal system:
http://portal.nccs.nasa.gov/osse
Requires a user name and password.
Contact person Harper Pryor ([email protected])
Gradsdods access:
T511NR model resolution data are also available from the OPeNDAP server
http://opendap.nccs.nasa.gov:9090/dods/OSSE/T511/
Gradsdods access is available for T511 NR. The data can be down loaded in grib1, NetCDF, binary. The
data can be retrieved globally or selected region.
Provide IP number to :Arlindo da Silva ([email protected])
Product from Joint OSSE team
http://portal.nccs.nasa.gov/josse
This site is not password protected
Joint OSSE Data Usage and Credit
This data must not be used for commercial purposes and redistribution
rights are not given. Originating institutes must be given credit in any
publications in which this data is used.
If you are interested in using the data or need assistance please contact
the originating institute.
For more information about Joint OSSE and the data sets, please visit
the Joint OSSE website
(http://www.emc.ncep.noaa.gov/research/JointOSSEs)
NCEP-NESDIS data posted in December 2009
Dataset
Originating Institute
Contact
NCEP Obs
NOAA/NCEP
Michiko Masutani ([email protected])
NCEP-NESDIS
NOAA/NCEP
NOAA/NESDIS
Michiko Masutani ([email protected])
Subdirectories under each data set
NCEP_Obs
thinsats_rad.gdas.mask.v0909
thinsats_rad.gdas.v0905
NCEP-NESDIS
osbuvb.n_t511.v0906
prepbufr.n_t511.v0903
thinsats.n_t511.dbl91.v0909
NCEP-NESDIS
Simulated data from T511 Nature Run May2,2005-August31, 2005
osbuvb.n_t511.v0906 (BUFR)
Ozone data. More detail?
prepbufr.n_t511.v0903 (BUFR)
Conventional data which is included in prepbufr data at NCEP
thinsats.n_t511.dbl91.v0909
DBL91 data explained after slide 6
NCEP_Obs
thinsats_rad.gdas.mask.v0909 (BUFR)
Template file for DBL91. Foot print used by NCEPGDAS. QC info for each
channel. Values 0 for unused channel
thinsats_rad.gdas.v0905
Template file for DBL91 with available Observed Brightness temperature.
Flexile Radiance data Simulation
strategies at NCEP
Jack Woollen of NCEP developed more flexible strategies for data bases, nicknamed
DBL91.This system consists of two data files per synoptic time.
DBL91(binary): These files contain all the relevant background and satellite location and
geometry information needed for the radiance simulation. This includes NR surface, upper air,
climatology interpolated to the thinned satellite observation locations reported in the operational
GDAS “radstat” diagnostic files.
OBS-Template(BUFR): The program read the data base which contains information about
observation including location. The radiance data records include a mask indicating which
channel was assimilated in the operational GDAS.
Simulation of radiance requires only DBL 91. After radiance is simulated, OBS-Template
supplies addition observation specific information to recreate the satellite BUFR files correctly
with the simulated values installed, and, if desired, to mask out channels not used in the GDAS.
The first set of DBL91 was generated for existing satellite data used in 2005. Data are
processed at foot print used by NCEP operational data assimilation. The mask for used and
unused channel is included. AIRS, HIRS2, HIRS3, AMSUA, AMSUB, MSU, GOES are
processed. OBS-template was generated in bufr format. This may be good enough for
calibration and testing additional future observation.
When GMAO produces a set of data locations, that can also be used as a template to
generate DBL91 based on the GMAO sampling. DBL91 can be generated for future observation
as well, maintaining a consistent interface for the simulation programs being developed at
NCEP. It is option whether DBL91 to be saved and exchange among various project, or DBL91
to be treated as temporary file produced in simulation process, depending on size of DBL91
compare to the Nature Run.
Observation template
Geometry
Location
Mask
Nature Run
(grib1 reduced Gaussian)
91 level 3-D data (12 Variables)
2-D data (71 Variables)
Climatological data
Need complete NR (3.5TB)
Random access to grib1 data
Need Data Experts
Decoding grib1
Horizontal Interpolation
Need large cpu
Need Radiation experts
DBL91
Running Simulation program (RTM)
Need Data Experts but this
will be small program
Post Processing (Add mask for channel, Packing to BUFR)
Simulated Radiance Data
7
DBL91
Experts for data handling and experts of RTM
are different people.
Content of DBL91
DBL91
Nature Run data at foot print
91 level 3-D data (12 Variables)
2-D data (71 Variables)
Climatological data
All information to simulate Radiances
The DBL91 also used for development of RTM.
DBL91 can be processed for other sampling such as GMAO sampling
DBL91 can be processed for new observation
It is an option whether DBL91 to be saved and exchange among various
project, or DBL91 to be treated as temporary file produced in simulation
process. This depends on size of DBL91 compare to the Nature Run.
8
Possible template for radiance data
Sampling for template for Calibration
A. Foot print used by NCEP GDAS
B A with mask for channel
Let DAS to select channel
C Simple thinning 100km etc and simulate cloudy radiance
Let DAS to select foot print.
D. Sampling based on nature run cloud
GMAO can provide template file.
save undef or 0 for unused channel
does not have to run CRTM
Template for OSSE experiment
A. Instrument designer have to simulate foot print location using orbit generators
B.Sampling based on Nature Run has to be designed
This is major work to be performed by instrument designers
9
Application for DBL91
The DBL91 also used for development of RTM.
DBL91 can be processed for other sampling such as GMAO
sampling
DBL91 can be processed for new observation
DWL91 with sampling based on GDAS usage will be posted from
NASA portal.
In actual simulation, it is optional whether DBL91 to be saved and
exchange among various project, or DBL91 to be treated as
temporary file produced in simulation process. This depends on
size of DBL91 compare to the Nature Run.
DBL91 file structure – information for simulating radstat satellites
NATURE RUN
DWL91 (Binary)
Thinsats.n_t511.dbl91.v0909
Sat location and
geometry
Surface type/veg from
NCEP
Surface and 2D
diagnostics quantities
from NR
91 level upper air from
NR
RADSTAT
Record used foot print and
channel
Template file with TB (BUFR)
Thinsats_rad.gdas.v0905
Complete BUFR report
Foot print used by
NCEPGDAS
Available Observed
Brightness temperature
are saved including
channel which was not
used by GDAS
BUFR
Observd radiance
Template file with QC (BUFR)
Thinsats_rad.gdas.mask.v0909
Complete BUFR
report
Foot print used by
NCEPGDAS
QC info for each
channel. Values 0
for unused channel
Contents of DBL91 binary file
From BUFR satellite file
2005.00
5.00
1.00
21.00
.00
3.00
168.67
59.77
206.00
570.00
2.00
1.00
52.79
59.83
.00
813000.00
004001
004002
004003
004004
004005
004006
006002
005002
001007
002019
005043
008012
007024
007025
010001
007002
YEAR
MNTH
DAYS
HOUR
MINU
SECO
CLON
CLAT
SAID
SIID
FOVN
LSQL
SAZA
SOZA
HOLS
HMSL
YEAR
MONTH
DAY
HOUR
MINUTE
SECOND
DEGREES
DEGREES
CODE TABLE
CODE TABLE
NUMERIC
CODE TABLE
DEGREE
DEGREE
METER
METER
YEAR
MONTH
DAY
HOUR
MINUTE
SECOND
LONGITUDE
LATITUDE
SAT IDENTIFIER
SAT INSTRUMENTS
BEAM POSITION
LAND/SEA QUALIFIER
SAT ZENITH ANGLE
SOLAR ZENITH ANGLE
HEIGHT OF LAND SURFACE
HEIGHT OR ALTITUDE
These variable are sufficient for most of simulation.
assimilation will be added from template file.
From NCEP Climatology
iv=27
iv=28
iv=29
iv=30
!
!
!
!
low
high
low
high
vegetation
vegetation
vegetation
vegetation
cover
cover
type
type
However further variable required for
Vegetation type
ECMWF vegetation types were saved in DBL91L
Convertion from 20 ECMWF surface type to CRTM surface type
DATA ecmwf_match2_crtm/ &
5,&
! CROPS
10 , &
! SHORT GRASS
12 , &
! EVERGREEN NEEDLELEAF
12 , &
! DECIDUOUS NEEDLELEAF
11 , &
!DECIDUOUS BROADLEAF
11 , &
! EVERGREEN BROADLEAF
20, &
! TALL GRASS
0,&
! DESERT
13 , &
! TUNDRA
5,&
! IRRIGATED CROPS
22 , &
! SEMIDESERT
24 , &
! ICE CAPS AND GLACIERS
20 , &
! BOGS AND MARSHES
0,&
! INLAND WATER
0,&
! OCEAN
10 , &
! EVERGREEN SHRUBS
10 , &
! DECIDUOUS SHRUBS
23, &
! MIXED FOREST / WOODLAND
23, &
! INTERRUPTED FOREST
0/
! WATER AND LAND MIXTURES
!
!
!
!
! ---------------------------------------------------------------------------------------! The 24 surface types are:
! 1. water
2. old snow
3. fresh snow
! 4. compacted soil
5. tilled soil
6. sand
! 7. rock
8. irrigated low vegetation 9. meadow grass
! 10. scrub
11. broadleaf forest
12. pine forest
! 13. tundra
14. grass soil
15. broadleaf pine forest
! 16. grass scrub
17. oil grass
18. urban concrete
! 19. pine brush
20. broadleaf brush
21. wet soil
! 22. scrub soil
23. broadleaf 70-pine 30 24. new ice
! ---------------------------------------------------------------------------------------!
Written by Ron Vogel of NCEP
Surface quantities from Nature Run
Grib ID
31 1
32 2
33 3
34 4
44 5
45 6
50 7
57 8
58 9
59 10
78 11
79 12
129 13
136 14
137 15
Sea-ice cover [(0-1)]
Snow albedo [(0-1)]
Snow density [kg m**-3]
Sea surface temperature [K]
Snow evaporation [m of water]
Snowmelt [m of water]
Large-scale precipitation fraction [s]
Downward uv radiation at the surface [w m**-2 s]
Photosynthetically active radiation [w m**-2 s]
Convective available potential energy [J kg**-1]
Total column liquid water [kg m**-2]
Total column ice water [kg m**-2]
Geopotential [m**2 s**-2]
Total column water [kg m**-2]
Total column water vapour [kg m**-2]
NR 91 levels of: pres cloudcov cloudice cloudh2o ozone mmr temperature spfhumid
141
142
143
144
145
146
147
148
151
152
159
164
165
166
167
168
169
172
175
176
177
178
179
180
181
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
Snow depth [m of water equivalent]
Stratiform precipitation [m]
Convective precipitation [m]
Snowfall (convective + stratiform) [m of water equ
Boundary layer dissipation [W m**-2 s]
Surface sensible heat flux [W m**-2 s]
Surface latent heat flux [W m**-2 s]
Charnock
Mean sea-level pressure [Pa]
Surface pressure {pa]
Boundary layer height [m]
Total cloud cover [(0 - 1)]
10 metre U wind component [m s**-1]
10 metre V wind component [m s**-1]
2 metre temperature [K]
2 metre dewpoint temperature [K]
Surface solar radiation downwards [W m**-2 s]
Land/sea mask [(0, 1)]
Surface thermal radiation downwards [W m**-2 s]
Surface solar radiation [W m**-2 s]
Surface thermal radiation [W m**-2 s]
Top solar radiation [W m**-2 s]
Top thermal radiation [W m**-2 s]
East/West surface stress [N m**-2 s]
North/South surface stress [N m**-2 s]
182
186
187
188
189
195
196
197
198
205
206
208
209
210
211
235
238
243
244
245
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Evaporation [m of water]
Low cloud cover [(0 - 1)]
Medium cloud cover [(0 - 1)]
High cloud cover [(0 - 1)]
Sunshine duration [s]
Lat. component of gravity wave stress [N m**-2 s]
Meridional component of gravity wave stress [N m**
Gravity wave dissipation [W m**-2 s]
Skin reservoir content [m of water]
Runoff [m]
Total column ozone [Dobson]
Top net solar radiation, clear sky [W m**-2]
Top net thermal radiation, clear sky [W m**-2]
Surface net solar radiation, clear sky [W m**-2]
Surface net thermal radiation, clear sky [W m**-2]
Skin temperature [K]
Temperature of snow layer [K]
Forecast albedo [(0 - 1)]
Forecast surface roughness [m]
Forecast log of surface roughness for heat
91 level data
Pressure
Cloud cover
Cloud ice water content
Cloud liquid water content
Ozone mass mixing ratio
Temperature
Specific Humidity
(Pa)
(0-1)
(kg/kg)
(Kg/kg)
(kg/kg)
(K)
(Kg/Kg)
91 levels are defined
http://www.ecmwf.int/products/data/technical/model_levels/model_def_91.html
Program to read DBL91 and list of surface data are posted from
http://www.emc.ncep.noaa.gov/research/JointOSSEs
Under “Data Distribution”
Simulation of HIRS3 radiance from NOAA16
from DBL91
Simulation of HIRS3 radiance from NOAA16 from DBL91
CRTM 1.2.2 posted from JCSDA web site was used for
simulation
DBL 91 was generated at foot print used by NCEP GDAS
All information in GDAS bufr files are copied to simulated
radiance file.
Channel which are not used by GDAS was marked in diag
file. Masked out to generate masked radiance data.
Simulated
where
Channel 4
is used
Observed
radiance
where any
channel is
used
Simulated
where any
channel is
used
Long wave
Radiance Data Simulation strategies at NCEP
Step 1. Thinning of radiance data based on real use
► GOES and SBUV are simulated as they are missing from GMAO
dataset.
► Prepbufr is simulated based on CDAS prepqc distribution.
► AMSUA, AMSUB, GOES data have been simulated for entire T511 NR
period.
► DBL91 for AMSUA, AMSUB, GOES, HIRS2, HIRS3, AIRS,MSU are
generated at foot print used by NCEP operational analysis and will be
posted from NASA portal.
► Some limited calibration and validation will be conducted by NCEP and
NESDIS for their own use. However, users are expected to perform their
own calibrations and validation.
Step 2. Simulation of radiance data using cloudy radiance
Cloudy radiance is still under development. Accuracy of
GMAO data sampling will be between Step1 and Step2.