Verify WRF Forecast using MET
Ruifang Li
MMM
[email protected]
METv1.1 Installation


/ptmp/lir/wrf/METv1.1 (bluefire)
/users/lir/wrf/met/METv1.1-gnu (Linux)
MET Components
MET Tools used

PB2NC


Point-Stat


The PB2NC tool is used to stratify the contents of an input PrepBufr point
observation file and reformat it into NetCDF format for use by the Point-Stat
tool
The Point-Stat tool provides verification statistics for forecasts at
observation points, as opposed to over gridded analyses.
VSDB-Analysic

The VSDB-Analysis tool ties together results from the Point-Stat
and Grid-Stat tools by providing summary statistical information and
a way to filter their VSDB output files.
Scripts Path


/ptmp/lir/wrf_test/wrf_em/verification/nu
dge/scripts
I used some of the scripts which were
wroten by our visitor Xiaqun Zhou.
Thanks Xiaoqun
WRF Forcast and Obs Data

Obs Data (Prebufr Format)






/ptmp/liuz/t8_2008_45km/ob/2007081500
/ptmp/liuz/t8_2008_45km/ob/2007081506
.
.
.
/ptmp/liuz/t8_2008_45km/ob/2007081700
WRF Forcast and Obs Data

grid nudging experiment





wrfout_d01_2007-08-14_12:00:00
wrfout_d01_2007-08-15_00:00:00
.
wrfout_d01_2007-08-17_00:00:00
control experiment (without grid nudging)



wrfout_d01_2007-08-15_00:00:00
.
wrfout_d01_2007-08-17_00:00:00
WRF Postprocessing

run_wrfpost_cyc.ksh

Change WRF output in netcdf format to
grib format.
Running Process
Obs in prebufr
point_stat_6000
00L_2007081
5_000000V.vsdb
Obs in prebufr
cnt_point_stat_TMP.vsdb
cnt_point_stat_SPFH.vsdb
Pb2nc.ksh
point_stat_600000L
_2007081 5_0000
06V.vsdb
point_stat.k
sh
fcst in netcdf
fcst in grib
run_wrfpost
_cyc.ksh
.
.
.
.
point_stat_6000
00L_2007081 7
_000000V.vsdb
vsdb_anal
ysis_point.
ksh
cnt_point_stat_UGRD.vsdb
cnt_point_stat_VGRD.vsdb
cnt_point_stat_WIND.vsdb
One record in
cnt_point_stat_TMP.vsdb
V1.1
WRF
180000
20070815_060000 ADPSFC FULL
CNT/0.050
300.77947
300.55386
301.00507
300.55137
300.93672
3.85698
4.23203
297.25917
297.06136
297.45698
3.39207
3.67234
3.35312
3.70185
0.77959
0.79329
0.68545
0.51188
1221
717
3.66328
3.43463
3.64954
2.54916
2.45191
1.01184
1.01155
1.01228
3.70852
3.62637
19.92617
6.49289
6.09545
7.08971
4.34573
-0.00492
0.40473
1.81395
1.62959
1.98116
5.37370
5.30947
5.54463
6.71369
6.68062
Code to pick up statistic values:
pick2ncl_control.f90
pick2ncl_nudge.f90
Get cnt_point_stat_TMP.txt for reading
And cnt_point_stat_TMP.bin for plotting (NCL)
TMP
4.02209
297.04889
0.75658
1134
2.65450
3.83187
4.29965
3.47373
6.88146
Z02
3.86865
297.42627
0.80067
3.52030
2.46988
18.88538
4.46379
3.37264
UW_MEAN
= 1221
4.18829
3.52660
0.74965
3.37731
2.66370
18.48708
0.19351
3.66670
1
Final Result

vi cnt_point_stat_TMP.txt

.
ADPUPA (Up air observations)
RMSE












P1000-1000
P925-875
P875-825
P725-675
P625-575
P525-475
P425-375
P325-275
P225-175
P125-75
number
00
00
1.69 19.
0.84 52.
0.75 63.
0.56 93.
1.16 105.
0.69 83.
0.67 96.
0.84 89.
1.31 77.
4.96 224.
RMSE
number
06
06 ………………………………48 48
-999. -999.
0.67
2.
0.36
1.
0.23
2.
1.06
3.
0.31
1.
0.89
3.
0.66
2.
0.64
2.
5.47
5.
Final Result

vi cnt_point_stat_TMP.txt

.
ADPSFC (surface observations: in land)

RMSE

00
2.86
1.95
2.34
2.05
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00











Z02
1000-1000
P925-875
P875-825
P725-675
P625-575
P525-475
P425-375
P325-275
P225-175
P125-75
number
00
1284.
4.
73.
36.
-999.
-999.
-999.
-999.
-999.
-999.
-999.
RMSE
number
06
06
3.48
1221.
0.03
1.
5.08
73.
1.98
26.
-999.00 -999.
-999.00 -999.
-999.00 -999.
-999.00 -999.
-999.00 -999.
-999.00 -999.
-999.00 -999.
………………………………48
48
Final Result

vi cnt_point_stat_TMP.txt

.
SFCSHP (surface observations: ship)


RMSE
number
00
00
06
148.
1.27
152.
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.
-999.
-999.
-999.
-999.
-999.
-999.
-999.
-999.
-999.

Z02
1.36

1000-1000
P925-875
P875-825
P725-675
P625-575
P525-475
P425-375
P325-275
P225-175
P125-75
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00









-999.
-999.
-999.
-999.
-999.
-999.
-999.
-999.
-999.
-999.
RMSE
number
06
………………………………48
48
Final Result

vi cnt_point_stat_TMP.txt

AIRCFT(aircraft observation)

RMSE

00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00











Z02
1000-1000
P925-875
P875-825
P725-675
P625-575
P525-475
P425-375
P325-275
P225-175
P125-75
number
00
-999.
-999.
-999.
-999.
-999.
-999.
-999.
-999.
-999.
-999.
-999.
RMSE
number
12
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
-999.00
0.48
-999.00
12
-999.
-999.
-999.
-999.
-999.
-999.
-999.
-999.
-999.
1.
-999.
………………………………48
48
Specific Humidity
Temperature
U component
V component
Wind
Appendix A

The steps to run on bluefire
. Run wpp to change wrf output
. in netcdf format to grib format.
1


/ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/run_wrfpost_cyc_control.ksh
/ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/run_wrfpost_cyc_nudge.ksh
. Run point-stat to get matched fcst and obs pairs
2


/ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/point_stat_control.ksh
/ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/point_stat_nudge.ksh
. Run vsdb tool to get summary info of matched fcst and obs pairs
3


/ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/vsdb_analysis_point_control.ksh
/ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/vsdb_analysis_point_nudge.ksh
. Get RMSE and BIAS info of matched fcst and obs pairs
4


/ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/pick2ncl_control.f90
/ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/pick2ncl_control.f90
. Plot figures
5

/ptmp/lir/wrf_test/wrf_em/verification/nudge/scripts/plot/

Questions?

Thanks!