Documente Academic
Documente Profesional
Documente Cultură
Concept paper
Introduction
The World Meteorological Organization’s World Weather Research Program (WWRP) has
previously organized several Forecast Demonstration Projects (FDP) and Research
Development Projects (RDP) to advance and demonstrate state-of-the-art nowcasting and
forecasting systems. Mesoscale Alpine Programme (MAP) was the first RDP (1999) and
was focused on understanding weather systems in complex terrain and flash flood events.
Based on the success of MAP, the MAP-Demonstration Phase was organized in 2005 and
focused on demonstrating the utility of prediction systems for hydrological flash flood
applications. While in complex terrain, the focus was on precipitation. The Sydney 2000
FDP focused on advancing and demonstrating summer convective nowcasting systems.
The Beijing 2008 FDP was conducted with the goal to demonstrate nowcasting advances
since 2000 and facilitate technology transfer into operations. In addition, the second
project, Beijing 2008 RDP was carried out with focus on mesoscale ensemble prediction.
In both projects the focus was on precipitation prediction, convective initiation and summer
severe weather. SNOW-V10 (Science of Nowcasting Olympic Weather for Vancouver
2010) project was approved as an RDP due to the novel aspects of the winter nowcasting,
1
CAS/WWRP/JSC5/Doc. 4.1 : p. 2
From the point of view of weather conditions, orography and meteorological needs these
Olympics have much in common with the recent «Vancouver-2010» Olympic Games.
Similar to Vancouver, high winds, visibility and low cloud, precipitation amount and phase
are the critical weather elements. Following the FDP/RDP of the «Vancouver-2010», the
present project offers a tremendous opportunity to continue and enhance the progress
made there, develop and test new techniques for weather forecasting and nowcasting.
FROST-2014 is expected:
• To extend experience of the B08RDP mesoscale ensemble prediction into
mountain environment in winter season;
• To extend the experience of MAP and MAP D-Phase to various weather elements;
• To extend the experience of SNOW-V10, which was focused primarily on
nowcasting, to more emphasis on NWP.
The Venues
The city of Sochi is located at approximately 44°N, 40°E at the Black sea coast. Sochi
Olympic objects are separated between two clusters: a coastal cluster for ice sport
competitions and a mountain cluster for snow sport events. The latter is located at
Krasnaya Polyana township about 45 km away from the coast (Fig.1). Mountains of
approximately 2 km height are typical for that region. The mountain cluster events are
especially weather-sensitive.
2
CAS/WWRP/JSC5/Doc. 4.1 : p. 3
- The coastal cluster for ice sports competitions (Figure Skating, Short track Skating,
Speed Skating, Ice Hockey, Curling, Ice training); Opening and Closing
Ceremonies;
- The mountain cluster for snow sports competitions (Alpine skiing, Cross-country
skiing, Biathlon, Ski jumping and Nordic Combined, Freestyle and Snowboard,
Bobsleigh, Luge and Skeleton).
Winter weather conditions in the region of Sochi are mainly determined by the quasi-
permanent Black Sea baric depression and the spur of the Asian anticyclone. Rapidly
passing cyclones accompanied by strong winds, snow- and rainfall are alternated with cold
anti-cyclonic intrusions from the east. Main Caucasian ridge mitigates these cold intrusions
and block warm wet landward air flows from the Black sea. The typical sea surface
temperature near Sochi in February-March is 8-10ºC.
Multiyear mean minimum near-surface temperatures in the mountain cluster in the period
of the Olympics are negative at all altitudes; mean maximum temperatures are below zero
at altitudes above 1600 m; and daily mean temperatures are negative at altitudes above
700 m. In some years intense heatwaves might endanger the natural snow cover
existence in the lowermost part of the mountain cluster.
On the other hand, heavy snowfalls are also typical for this area. Maximum registered daily
snowfall reported by the weather station Krasnaya Poliana (WMO index: 37107.
Elevation: 568 m) was 92 cm. Winter maximum is clearly pronounced in the precipitation
annual cycle. Mean monthly precipitation totals in Krasnaya Poliana for February and
March are equal to 123 and 118 mm respectively. They tend to increase with elevation.
Sharp weather contrasts and high spatial and temporal variability are typical for the region
of the Olympics. Steep mountainous terrain and intricate mixture of maritime sub-tropical
and Alpine environments make weather forecasting in this region extremely challenging.
For the territory of Russia northern Caucasus is among the leaders with respect to the
number of annually registered weather hazards (heavy precipitation, strong winds, icing
etc). Although not frequent, thunderstorms might also take place in winter season.
Precipitation intensity and type, gusting winds, visibility and cloud ceiling are the primary
critical weather elements for the Sochi Olympics.
3
CAS/WWRP/JSC5/Doc. 4.1 : p. 4
Deterministic NWP
There are many scientific issues that should be addressed within this deterministic
component of the project, e.g.:
• Impact of horizontal resolution and various physical processes on NWP of high-
impact winter weather over a region with mountain terrain;
• Mesoscale data assimilation and its impact on forecasts of winter weather;
• Impact of better surface-atmosphere coupling on predictability of mesoscale
phenomena;
• Nowcasting potential of numerical models;
• Predictability of various meteorological parameters/phenomena of winter weather in
mountains (precipitation intensity and type, wind speed and direction, visibility, etc.).
The preliminary list of participants of this project component includes: COSMO, AROME,
GEM, WRF, GRAPES (?), and HARMONIE. It is planned that in FDP mode FROST-2014
deterministic forecasts will have horizontal resolution of 2-2.5 km or finer, whereas in RDP
mode 1 km or less. The groups that wish to go beyond this baseline in terms of resolution
are welcome to do so. Besides, various approaches of downscaling of model forecasts to
the locations of individual sport venues will be implemented, verified, and intercompared. It
is worth noting that at the moment no operational model with resolution about 2 km is
implemented for the region in question. Several models are expected to be implemented
for the Sochi region with resolution of 1 km or finer (e.g. GEM/LAM, COSMO, AROME).
4
CAS/WWRP/JSC5/Doc. 4.1 : p. 5
COSMO will be the basic operational mesoscale NWP system of Roshydromet for the
Sochi Olympics.
Ensemble NWP
The main challenge for regional EPS systems is to accurately assess the probability of
High-Impact Weather (HIW) events. With respect to the number of annually registered
weather hazards (heavy precipitation, strong winds, icing etc.), northern Caucasus is one
of the most affected regions on the territory of Russia. This region might be a good testing
ground for the development of new probabilistic forecast products for HIW events. Due to
the strong dependence of many winter sport events on weather conditions, HIW in the
context of winter Olympics is not necessarily linked with very intense or extreme
meteorological phenomena. E.g. for outdoor sport events HIW forecasting also includes
accurate representation of cross-zero temperature transitions (especially critical for cross-
country skiing), precipitation type and other sensible weather changes with respect to the
prescribed decision-making thresholds (Annex 6). Development and demonstration of
various HIW-related specific products is part of this ensemble project component.
EPSs with resolution of about 7 km or coarser are planned to be involved in the project in
forecast demonstration mode, while EPSs with resolution about 2 km will contribute to the
project in research mode. Tentative list of participants: COSMO, ALADIN LAEF, AROME
EPS, GLAMEPS, and HARMON EPS. ECMWF officially informed Roshydromet about its
readiness to provide lateral boundary conditions for a WMO project associated with
«Sochi-2014» Olympics.
Data assimilation
The vast sea area on one side and mountainous terrain on the other side of Sochi impose
serious restrictions on configuration of the ground-based observational network in the
region. This geography requires the extensive use of satellite, Doppler radar and profiler
facilities for sounding of the atmosphere and the underlying surface. This information will
be of utmost importance as a source of meso-scale structures for NWP. Therefore, high-
resolution data assimilation is a matter of particular interest and a new aspect of WWRP
projects.
5
CAS/WWRP/JSC5/Doc. 4.1 : p. 6
Several data assimilation approaches for the atmosphere and the underlying surface are
expected to be tested. Some project participants will conduct experiments with identical
model configurations with and without data assimilation to assess the data assimilation
contribution to forecast performance.
Assimilation of radar data in the region of Sochi may only be beneficial for a short forecast
range because of lack of radar coverage to the west of Olympic venues. Rapid update
cycle capability is therefore needed to exploit the potential benefits. Assimilation of satellite
winds (AMV and ASCAT) and radiances over vast areas of the Black Sea is believed to be
important as its effect may last longer.
List of non-satellite data that are considered to be useful for assimilation in Sochi project
includes:
– Surface observations;
– Radar winds;
– Wind and temperature profiles from local sounders;
– AMDAR.
Assimilation of radar reflectivity aiming for a better representation of the thermodynamic
structure of the atmosphere near precipitating clouds might not be too efficient and useful
in winter, but this is an area that may be addressed in the RDP project.
Data assimilation is to be included in both FDP (the existing technologies) and RDP (new
developments) FROST-2014 components.
Nowcasting
SNOW-V10 was the first WWRP winter complex terrain nowcasting project. It remains to
be demonstrated whether its results are universally applied and can be demonstrated in a
different environment or with different observating network. FROST-2014 provides an
excellent opportunity to extend the experience of SNOW-V10 project in the scientifically
challenging area of winter nowcasting in a region with complex terrain.
Many issues should be tackled within this project component in the RDP mode, e.g.:
- Nowcasting of high impact winter weather and multiple weather elements (wind speed
and direction, wind gust, visibility, precipitation intensity and type) in complex terrain;
- Improvement of blending procedures for NWP with time-extrapolated observations for
winter;
- Radar retrieval of precipitation type and intensity;
- Diabatic and orographic effects on precipitation nowcasting in complex terrain;
- Assessment and account for observational uncertainty (WGNR mandate).
- Identification of local circulations and clouds controlled by effects of flow blocking,
diabatic cooling due to melting snow, and evaporation of precipitation.
6
CAS/WWRP/JSC5/Doc. 4.1 : p. 7
Observations
Roshydromet will provide the project partners with access to additional in-situ and remote
sensing observations not normally available via the GTS. These observations will be
available to the participants via Internet with minimal delays.
7
CAS/WWRP/JSC5/Doc. 4.1 : p. 8
corporation). In general the sampling interval will not exceed 10 minutes. For a subset of
the stations it will be substantially higher.
More details on the AMSs (sensors and coordinates) are presented in Annex 1.
Fig.2 AMSs in the region of Sochi (a similar map with zooming is available at
http://frost2014.meteoinfo.ru). Notation: Roshydromet's AMSs are designated by red
markers with label "*"; "E" - Roshydromet's air quality control stations; "R" - mountain
skiing venue AMSs (owned by the Rosa-Khutor company); "G" - biathlon venue AMSs
(owned by the Gazprom company);"M" – AMSs on the cellphone towers of the Megaphone
operator; "A" - planned AMSs on the Megaphone cellphone towers. Moored sea buoys are
designated by sail boats. Location of Doppler radar on the Akhun mountain is marked by
white nested circles. The mountain cluster is outlined by the red cirle.
Data from the new dual polarization Doppler weather radar WRM200 on Akhun mountain
will be available by winter 2012/2013. Additional dual-polarization Dopplers in nearby
airports might be installed later.
Wind profiler, temperature/humidity profiler and Micro Rain Radar (MRR) will supplement
the network by winter 2012/2013. It is quite likely that another MRR will be installed during
the winter 2011/2012. In the Krasnaya Poliana valley these vertical soundings will be
extremely important for diagnosis of the atmospheric lower layers screened from the
Akhun Doppler radar by the mountains.
The nearest to the mountain cluster upper air sounding station is located in Tuapse
(approximately 100 km north-west). Soundings in Tuapse will be launched every 6 hours.
Other ways to enhance the observational network are looked into (more frequent sounding
8
CAS/WWRP/JSC5/Doc. 4.1 : p. 9
Information Technologies
Unification and integration of data flows from multiple observational platforms and forecast
systems, timely information generation and delivery, efficient means of information
presentation are crucial for the project success. The proposed version of the forecast data
exchange protocol is presented in Annex 2.
Data storage with authorized Internet access and capacity for information rescue and
memory extention was organized for observation and forecast data exchange between the
project participants via FTP and HTTP protocols. Initial version of the project web-site is
available at http://frost2014.meteoinfo.ru. Some ideas for its web-interface that are
currently being implemented, originally were taken from web-resources of the previous
WWRP projects (e.g. elements of multi-window MAP D-Phase web-interface are being
realized on the basis of Google Earth for visualisation of meteorological information).
After the Olympics support of the FROST-2014 http/ftp-server is planned for further
retrospective studies (e.g. in the context of data assimilation).
Annual training courses for future Sochi Olympic forecasters and their practical
participation in meteorological support of the test sport events have been practiced since
autumn 2010. This practice will continue till the Olympics. It will be intensified as more
technical facilities become available for forecasters. To get familiar and develop practical
skills with various new forecast products their early availability is of utmost importance.
This is also important for training of involved sport managers and decision makers.
Enhanced observational facilities and new NWP instruments are expected to give a new
look at the local weather phenomena in the region of the Olympics. The RDP project
9
CAS/WWRP/JSC5/Doc. 4.1 : p. 10
component can be of great help for better understanding of local HIW and development of
conceptual models of local meteorological processes.
Periodic formalized surveys among the Olympic forecasters will complement the results of
objective verification. Year by year interviewing of the forecasters should help to
understand how forecasters’ needs are changing. For example, how understanding of
weather processes (conceptual models) or use of EPS products evolve. Analysis of these
surveys is a part of social impact assessments, because the forecasters themselves or,
e.g., venue managers might be considered as specific users.
First meeting of potential participants of FROST-2014 project was held in Sochi on 1-3
March 2011 (more details are available in the meeting report at
http://frost2014.meteoinfo.ru). The Science Steering Committee (SSC) composed of the
leaders of participating organizations or their representatives was decided to oversee the
project.
Four Working Groups were established to deal with various components of the project
more specifically:
WG1: Observations and nowcasting (including Verification)
Chair: V.Lukyanov/D.Kiktev, International Co-Chair: G.Isaac
WG2: NWP, ensembles and assimilation (including Verification)
Chair: M.Tsyrulnikov/G.Rivin, International Co-Chair: A.Montani
WG3: IT (including graphical tools, formats, archiving and telecommunication)
Chair: D.Kiktev
WG4: Products, training, end user assessment and social impacts
Chair: I.Rozinkina/D.Kiktev
Implementation Plan
Winter 2011-12 is the pre-trial period and winter of 2012-13 the trial period, so that all the
technologies should be implemented and tested during these two periods. “Pre-olympic”
would be the period just before the Olympics where final tuning is done. Data collected
during the following winters will be used for high resolution weather forecasting systems
testing. The system will be revised and further tested. During the winter of 2013/14, the
Olympic Winter, the formal evaluation of nowcasts and forecasts will be made. A summary
of lessons learned and results achieved will be presented at the concluding WWRP
RDP/FDP meeting after the Olympics.
Note:
Road safety nowcasts and forecasts are of great interest for Olympic logistics and
potentially can be a part of the project. However, it might be difficult to provide efficient
support of this activity from the hosting side other than data storage and access facilities,
as Roshydromet doesn’t have its own road AMSs and by now this activity has been
beyond the traditional scope of Roshydromet.
11
CAS/WWRP/JSC5/Doc. 4.1 : p. 12
Annex 1
12
CAS/WWRP/JSC5/Doc. 4.1 : p. 13
13
CAS/WWRP/JSC5/Doc. 4.1 : p. 14
2 АПК-А №1
Krasnaya Poliana 43,68149 40,20546
3 АПК-А №2
Imeretinsky Bay 43,40472 39,95944
4 АПК-А №3
Imeretinsky Bay 43,41056 39,95472
5 Kazachiy Brod 43.5167 39.9833 approximate coords
6 The 5th km 43.6667 40.1833 approximate coords
b) Biathlon and skiing combined complex (Owner – Gazprom. AMSs are equipped
with Vaisala sensors)
14
CAS/WWRP/JSC5/Doc. 4.1 : p. 15
c) Skiing stadium
15
CAS/WWRP/JSC5/Doc. 4.1 : p. 16
Annex 2
All forecasts should be interpolated to the unified common grids (see below) before their
uploading. To avoid inflation of data amount due to the interpolation you can upload
forecasts for the relevant subdomain of your original grid and provide us with your own
interpolation program to the common grid.
• Ensemble FDP
The approximate grid spacing – 7 km. This means 0.0875°/0.063° along latitude/longitude
at the latitude of Sochi.
The recommended grid domain - 286*285 grid points (Roughly ~2000*2000 km):
- 171 steps west and 114 steps east of Krasnaya Poliana (25.2375°E-50.175°E);
- 142 steps south and 142 steps north of Krasnaya Poliana (34.737(3)°N-
52.629(3)°N). Such a coverage is broad enough for synoptic interpretation (see
Fig.1 below).
Individual ensemble members rather than products – it gives more flexibility in further
processing.
• Ensemble RDP
Unified grid step – 2 km. This means 0.0250°/0. 0180° along latitude/longitude at the
latitude of Sochi.
16
CAS/WWRP/JSC5/Doc. 4.1 : p. 17
• Deterministic FDP
Unified grid step – 1 km. This means 0.0125°/0.0090° along latitude/longitude at the
latitude of Sochi.
The recommended domain – 301*301 grid points (roughly 300*300 km):
- 200 grid steps west and 100 steps east of Krasnaya Poliana (37.7°E-41.45°E);
- 150 grid steps south and 150 steps north of Krasnaya Poliana (42.(3)°N-45.0(3)°N).
• Deterministic RDP
The unified grid spacing – 250 or 500 m depending on the highest available model
resolution. The exact domain is to be specified later.
Note: Optimal choice of the set of time levels is dependent on real model resolution. For
250 m model grid spacing half an hour time resolution might not be sufficient.
• Nowcasting
The unified grid domain – as for Deterministic FDP component.
17
CAS/WWRP/JSC5/Doc. 4.1 : p. 18
5) Parameters:
• For model ensembles and nowcasting:
sensible weather and high-impact parameters - precipitation conditions (liquid and
solid precipitation rate, freezing/frozen precipitation, accumulated snow), T2m,
near-surface wind speed/direction/gusts, relative humidity, dew point temperature,
visibility, cloudiness and cloud base and location of the zero-degree isotherm;
Ensemble forecast fields of some other traditional synoptic variables (e.g., 500 hPa
geopotential, T850) are of interest more for the purposes of synoptic interpretation
rather than for forecast validation.
18
CAS/WWRP/JSC5/Doc. 4.1 : p. 19
If meeting the listed requirements appears to be not feasible for a project participant, then
relaxed requirements might be applied.
19
CAS/WWRP/JSC5/Doc. 4.1 : p. 20
Annex 3
FROST-2014 Implementation Plan
20
CAS/WWRP/JSC5/Doc. 4.1 : p. 21
1.18 Experiments with snow satellite Preliminary results of I.Rozinkina April 2012
analysis for COSMO-RU system COSMO-RU runs with snow P.Romanov
(FDP, not real time at that stage) satellite analysis
1.19 Integration of forecast/nowcast data Forecasts/Nowcasts of D.Kiktev Winter 2011-2012
flows, archiving of participating systems on the (Depending on
forecasts/nowcasts and visualization project web-site. Availability the time of
of their results on the project web-site of results to Olympic availability of
forecasters via web- forecasts)
interface. Archiving of
forecasts on the project
server.
1.20 Real-time access to TIGGE forecasts Real-time access to TIGGE T. Paccagnella To be specified
forecasts (with possibility to
request new specific
products)
1.21 Meteorological support of sport test Preliminary practical V.Lukyanov Jan-Mar 2012
events with use of forecast acquaintance of Olympic
information from the project forecasters with new
participants nowcasting/forecasting
products
1.22 Survey among Olympic forecasters «Snapshot» of the current V.Oganesian October-March
(as a part of impact assessment understanding and skill 2011-2012
studies) (FDP) levels, needs and
impressions
1.23 Synoptic evaluation of available Preliminary synoptic T.Dmitrieva, April 2012
FROST-2014 forecasts/nowcasts for assessments of available V.Fedorova,
pre-trial winter (FDP?) FROST-2014 forecasts E.Vasilev
1.24 Objective evaluation of Pre-trial First evaluation results and A.Muravev, Spring 2012
forecasting/nowcasting results (RDP) assessments of practical P.Nurmi,
predictability for Sochi region E.Atlaskin
21
CAS/WWRP/JSC5/Doc. 4.1 : p. 22
22
CAS/WWRP/JSC5/Doc. 4.1 : p. 23
23
CAS/WWRP/JSC5/Doc. 4.1 : p. 24
year (RDP)
3.7 GLAMEPS: Take into account extra GLAMEPS real-time FDP I-L.Frogner 1 Dec 2013
observations in real time in the data- runs with possible
assimilation and, if feasible, the assimilation of regional
ensemble generation (FDP) observations
3.8 Feasibility studies for HarmonEPS in HarmonEPS in test- I-L.Frogner, 1 Dec 2013
test-operational mode. High- operational mode. T.Iversen
resolution verification. (RDP)
3.9 Quasi-operational probabilistic Quasi-operational calibrated I-L.Frogner, 1 Dec 2013
forecasts for several observational EPS forecasts for several T.Iversen
sites and parameters, possibly with observation sites
hourly updates (RDP).
3.10 Operational INCA analysis and INCA deliverables (provided A. Kann, C. Winter 2013/2014
nowcasting for Olympic domain that input data are available Gruber, B. Bica
in sufficient quantity and
quality)
3.11 Deterministic COSMO model runs Results of deterministic high- G.Rivin Winter 2013/2014
with resolution about 1 km (RDP) resolution COSMO runs at
the project server
3.12 Experiments with COSMO-EPS Experimental ensemble high- G.Rivin 1 Dec 2013
2.2.km Tecnology (RDP) resolution COSMO-RU runs E.Astakhova
at the project server A.Montani
3.13 Meteorological support of Olympics Operational practical use D.Kiktev Feb-Mar 2014
and Formal FDP and demonstration of
systems participating in the
FDP project component
3.14 Synoptic evaluation of available Synoptic assessments of T.Dmitrieva, Autumn 2014
FROST-2014 forecasts/nowcasts for FROST-2014 nowcasts and V.Fedorova,
winter 2013/2014 (FDP) forecasts E.Vasilev
3.15 Evaluation and intercomparison of Evaluation results of FDP A.Muravev Autumn 2014
nowcast/forecast results for the P.Nurmi
formal FDP period (FDP) E.Atlaskin
3.16 Diagnostic non-standard verification Diagnostic verifications and A.Muravev Autumn 2014
of project nowcasts/forecasts (RDP) assessments of practical P.Nurmi
predictability for the period of E.Atlaskin and
FROST-2014 activity other project
participants
3.17 Survey among the Olympic «Snapshot» of the current V.Oganesian Oct 2013-Mar
forecasters and managers. (FDP) understanding and skill 2014
levels, needs and
impressions.
3.18 General impact assessment for the General impact assessment V.Oganesian, Autumn 2014
previous period targeting on Olympic for the period of project SERA
forecasters and managers (FDP) activity representative
3.19 Organization of the Science Steering SSC meeting D.Kiktev Spring 2014
Committee meeting.
3.20 Organization of the Final Seminar. Final seminar. D.Kiktev To be decided
Discussion on publication plan Publication plan.
3.21 Preparation of Report to WWRP Project Report submitted to D.Kiktev To be specified
Joint Scientific Committee (JSC) JSC
3.22 Support FROST-2014 http/ftp-server Internet access to the D.Kiktev While interest
for further retrospective studies (e.g. FROST-2014 data server for exists
in the context of data assimilation) research community
3.23 Journal publications
24
CAS/WWRP/JSC5/Doc. 4.1 : p. 25
Annex 4
Verification setup
Introduction
Sochi-2014 Olympics and Paralympics will be held on February 8-23 and March 7-16,
2014 correspondingly. Formal forecast evaluation period for the FDP component of
FROST-2014 project is tentatively set up from 20 January to 20 March 2014 (it is to be
approved by the SSC). Preliminary testing results will be obtained during the pre-trial
(winter 2011-12) and final trial (winter 2012-13) periods. Along with formal evaluation in the
framework of the demonstration project component various kinds of diagnostic verification
will be implemented for better understanding of weak and strong points of the involved
forecast systems.
• Grid-point fields
Due to complexity of the region the available objective analysis is neither detailed nor
reliable enough to be used as an etalon for forecasts validation. Thus, the grid-point fields
will be verified mostly in the points with nearby observations. The precipitation fields will be
also verified against radar composites with horizontal resolution of 2 km. Potentiality of the
wind field verification on the basis of radar radial wind observations is also considered.
At profiler locations, model fields (temperature, humidity, horizontal wind) are to be verified
up to 3 km above the land surface with the resolution of several tens of meters (to be
detailed).
MRR vertical resolution is adjustable. Typical values are 30-100 m. The maximum number
of vertical steps is 31. The exact vertical structure is to be specified.
Verified parameters
The nowcast and EPS output verification is proposed to concentrate on sensible weather
and high-impact parameters: precipitation conditions, T2m, near-surface wind, visibility,
25
CAS/WWRP/JSC5/Doc. 4.1 : p. 26
cloud base, location of the zero isotherm. For deterministic forecasts an expanded list of
parameters and levels will be used (Table 4.1).
Table 4.1
Comment: Temperature, Relative Humidity and Wind forecast data are to be multi-level at
grid-points associated with locations of temperature/humidity and wind profilers.
26
CAS/WWRP/JSC5/Doc. 4.1 : p. 27
Temporal resolution
Various regional AMSs transmit their reports using different time steps. For example, the
land-based AMSs used 10 min steps during the 2010-2011 winter. The AMSs on mobile
communication towers reported more frequently. The exact frequency regime is station-
dependent and it is to be specified.
The proposed temporal resolution for forecast and nowcast grid-point fields and time
series at locations associated with observation sites is presented in «Forecast data
exchange requirements for FROST-2014 project» (The multiple of native model time step
can be used for pointwise time series as well).
A unified analysis of radar and rain gauges data (radar QPE) with horizontal resolution
about 2 km will be developed and used for verification of gridded precipitation products
from the participating systems. Radar based verification techniques applied to precipitation
fields are to be specified.
A set of critical thresholds will be used to transform continuous variables into dichotomous
events. These thresholds will be adjusted for the SOCHI region, considering the sport
needs of the Olympic Games. Preliminary list of thresholds is presented in the Annex 5. In
general SNOW-V10 thresholds are considered to be applicable for FROST-2014.
Common verification measures for dichotomous variables (POD, FAR, TS, ETS, KSS,
HSS) will be applied along with some novelty measures, especially for the most extreme
events (SEDS, EDI). For EPS output, relevant probabilistic measures (ROC, Brier Score,
Reliability Diagram and Frequency Histograms, BSS, RPS, CRPSS) are to be applied.
Object-oriented verification, fuzzy verification, and conditional verification will be applied to
the project nowcasts and forecasts.
27
CAS/WWRP/JSC5/Doc. 4.1 : p. 28
Annex 5
Thresholds for ensemble forecast evaluation
The following thresholds are linked to the sport decision-making requirements for winter
Olympics (Annex 6) and might be subjected to change in case of possible sport demands
revision.
12 1, 5, 10, 20, 50
24 1, 5, 10, 20, 50, 100
(Instantaneous) thresholds for visibility [meters]: 20, 30, 50, 100, 250, 500, 1000.
(Instantaneous) thresholds for the height of the zero isotherm [meters]: 50, 100, 200,
300, 400, 500, 1000, 2000.
28
CAS/WWRP/JSC5/Doc. 4.1 : p. 29
29