Workshop on diagnostics of data assimilation systems performance

The Workshop on Diagnostics of data assimilation system performance was held from 15 to 17 June 2009.

Description

Data assimilation schemes have evolved into complicated systems with millions of degrees of freedom and handling massive amounts of observations. Effective monitoring of these systems is required and emerging techniques are now rapidly developing at most NWP centres. This review of the various methodologies and their effectiveness in diagnosing the impact of observations in NWP is suitably timely.

The workshop will consider all developed techniques to measure the performance of the assimilation system in numerical weather prediction. Impact of observations in the assimilation and the short range forecast will be assessed through different diagnostic techniques. In particular, methodologies to evaluate the analysis optimality related to all the analysis input parameters as the covariance matrices will be presented. Over the last few year, adjoint techniques have also been used to assess the observation impact in the short-range forecast, this methodology will be shown and compared with the more commonly used Observation System Experiment technique. Adjoint technique will further exploit to measure the impact in the short-range forecast of all the analysis input parameters. Methodology for assessing observation and model bias through re-analysis experiment will be also discussed.

Programme

PDF iconAnnex I: Participants

PDF iconAnnex II: Programme

Presentations

Monday 15 June  

Welcome and Introduction

Martin Miller (ECMWF)

-

Data Assimilation Systems - Review

Eugenia Kalnay ( Maryland University)

PDF icon

Objective validation of a data assimilation system: diagnosing sub-optimality - Review

Gerald Desroziers (Meteo-France)

PDF icon

Diagnose model error in data assimilation system

Chiara Piccolo (Met Office)

PDF icon

Observation System Experiment to estimate the impact of observations

Peter Bauer (ECMWF)

PDF icon

Information Content in EnKF and the relation with Cross Validation

Junjie Liu (Berkeley University) - presented by Eugenia Kalnay

PDF icon

Estimation and diagnosis of analysis/background error covariances from an ensemble assimilation

Loik Berre (Météo-France)

PDF icon

Diagnosis of data assimilation systems by using normal modes

Nedjelika Zagar ( University of Ljubljana)

PDF icon

Monitoring long data assimilation time series: a reanalysis perspective with Era-Interim

Paul Poli (ECMWF)

PDF icon

Chemistry Data Assimilation validation with respect to independent data

Angela Benedetti (ECMWF)

PDF icon

Observing Simulated System Experiment to estimate the potential of future observations

Mitchiko Masutani (NOAA)

PDF icon
Tuesday 16 June  

Recent developments in the use and understanding of adjoint-derived estimates of observation impact

Ron Gelaro (GMAO)

PDF icon

Sensitivity analysis in variational data assimilation and applications

Dacian Daescu (Portland State University)

PDF icon

FSO: Monitoring the observation forecast impact

Fernando Prates (ECMWF)

PDF icon

Verification of Ensemble Systems

Olivier Talagrand (LMD)

PDF icon

Convergence and stability of estimated error variances derived from assimilation residuals in observation space

Richard Menard (Environment Canada)

PDF icon

On-line observation covariance matrix tuning based on optimality diagnostic

Bernard Chapnik (Météo-France)

 

PDF icon

Assimilation diagnostics from an ocean 3D-Var/4D-Var system

Anthony Weaver (CERFACS)

PDF icon
Working group discussions -
Wednesday 17 June  
Working group discussions and drafting of recommendations Plenary Session PDF icon

Posters

A scale-based distortion metric for mesoscale weather verification

Chermelle Engel (Melbourne University)

PDF icon

An approach to assess observation impact based on observation-minus-forecast residuals

Ricardo Todling (NASA)

PDF icon

Assimilation diagnostics in the Mercator-Ocean forecasting systems

Elisabeth Remy (CERFACS MERCATOR Ocean)

-

Diagnostics for the Assimilation of Observations in the Boundary Layer

William Grey (Met Office)

PDF icon

Evaluation of the impact of observations on analyses based in information content

Cristina Lupu (Université du Québec à Montréal)

PDF icon

Four Dimensional Observation Impact on the US Navy's Atmospheric Analyses and Forecasts

Liang Xu (Naval Research Laboratory)

PDF icon

Validation of the prototype GMAO OSSE system

Ronald Errico (NASA/GMAO and UMBC/GEST)

-

The Impact of Lightning Data Assimilation on a Winter Storm Simulation over the North Pacific Ocean

Tiziana Cherubini ( University of Hawaii)

-

Proceedings

Observing System Experiments (OSE) to estimate the impact of observations in NWP

P Bauer

PDF icon

Chemistry data assimilation validation using independent observations

A Benedetti

PDF icon

Use of consistent operational ensemble variational assimilation to estimate and diagnose analysis and background error covariances

L Berre

PDF icon

Representation of nocturnal marine stratocumulus cloud by means of a mesoscale model (MM5) [Poster abstract]

G Bogale

PDF icon

Forecast sensitivity to observations (FSO) as a diagnostic tool: monitoring the impact of observations on the short range forecast

C Cardinali

PDF icon

Sensitivity analysis in variational data assimilation and applications

D Daescu

PDF icon

Objective validation of a data assimilation system: diagnosing sub-optimality

G Desroziers

PDF icon

A scale-based distortion metric for mesoscale weather verification [Poster abstract]

C Engel

PDF icon

Recent developments in the use and understanding of adjoint-derived estimates of observation impact

R Gelaro

PDF icon

Diagnostics for the assimilation of observations in the boundary layer in 4DVAR [Poster]

W Grey

PDF icon

Data assimilation systems: Focus on EnKF diagnostics

J Liu

PDF icon

Review of self-sensitivity calculation in an Ensemble Kalman Filter and its extended applications to forecast impacts

E Kalnay

PDF icon

Evaluation of the impact of observations on analyses based in information content [Poster abstract]

C Lupu

PDF icon

Full OSSEs at NCEP and International Joint OSSE effort

M Masutani

PDF icon

Convergence and stability of estimated error variances derived from assimilation residuals in observation space

R Menard

PDF icon

Evolution of forecast error covariances in the dD-Var and ETKF methods

C Piccolo

PDF icon

Monitoring long data assimilation time series: a reanalysis perspective with ERA-Interim

P Poli

PDF icon

An approach to assess observation impact based on observation-minus-forecast residuals [Poster abstract]

R Todling

PDF icon

Ocean assimilation diagnostics from an ensemble 3D-Var system

A Weaver

PDF icon

Four dimensional observation impact on the US Navy's atmospheric analyses and forecasts [Poster abstract]

L Xu

PDF icon

Diagnosis of data assimilation systems by using normal modes

N Zagar

PDF icon

Local information


You can also see an archive of past workshops

View full calendar of events