Morphing and wavelet EnKF data assimilation Jan Mandel Based on - PowerPoint PPT Presentation

Morphing EnKF Spectral and wavelet EnKF Applications Morphing and wavelet EnKF data assimilation Jan Mandel Based on joint work with J. D. Beezley, L. Cobb, A. Krishnamurthy, A. K. Kochanski, K. Eben, P . Jurus, and J. Resler Center for Computational Mathematics Department of Mathematical and Statistical Sciences University of Colorado Denver Supported by NSF grant AGS-0835579 Penn State, November 3, 2011 Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Spectral and wavelet EnKF Applications Outline Morphing EnKF 1 Data assimilation and EnKF Automatic image registration The morphing transformation Spectral and wavelet EnKF 2 State covariance approximation FFT and wavelets Examples Applications 3 Wildfire reaction-diffusion model WRF coupled with wildfire spread Assimilation of precipitation radar data to WRF Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Data assimilation and EnKF Spectral and wavelet EnKF Automatic image registration Applications The morphing transformation Data assimilation – continuous Bayesian view Model must support the assimilation cycle: export, modify, and import state the state must have metadata: what, when, where must support meaningful continuous adjustments to the state – no discrete datastructures Data must have error estimate must have metadata: what, when, where Observation function connects the data and the model creates synthetic data from model state to compare Data assimilation algorithm adjusts the state to match the data balances the uncertainty in the data and in the state it is not the purpose to minimize the error Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Data assimilation and EnKF Spectral and wavelet EnKF Automatic image registration Applications The morphing transformation The Ensemble Kalman Filter (EnKF) uses an ensemble of simulations to estimate model uncertainty by sample covariance converges to Kalman Filter (optimal filter) in large ensemble limit and the Gaussian case uses the model as a black box adjusts the state by making linear combinations of ensemble members (OK, locally in local versions of the filter, but still only linear combinations) if it cannot match the data by making the linear combinations, it cannot track the data probability distributions close to normal needed for proper operation Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Data assimilation and EnKF Spectral and wavelet EnKF Automatic image registration Applications The morphing transformation The Ensemble Kalman Filter (EnKF) X a = X f + K K = P f H T ( HP f H T + R ) − 1 Y − HX f � � , X a : Analysis/Posterior K : Kalman gain ensemble H : Observation function X f : Forecast/Prior P f : Forecast sample ensemble covariance Y : Data R : Data covariance Basic assumptions: Model and observation function are linear Forecast and data distributions are independent and Gaussian (if not, EnKF routinely used anyway) Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Data assimilation and EnKF Spectral and wavelet EnKF Automatic image registration Applications The morphing transformation A simple reaction-diffusion wildfire model 1200 1100 1000 900 Temperature (K) 800 700 600 500 400 300 0 200 400 600 800 1000 X (m) 1D temperature profile 2D temperature profile Solutions produce non-linear traveling waves and thin reaction fronts. Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Data assimilation and EnKF Spectral and wavelet EnKF Automatic image registration Applications The morphing transformation An example in 2D: non-physical results Forecast ensemble Data Analysis ensemble Forecast ensemble generated by random spatial perturbations of the displayed image Analysis ensemble displayed as a superposition of semi-transparent images of each ensemble member Identity observation function, H = I Data variance, 100 K Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Data assimilation and EnKF Spectral and wavelet EnKF Automatic image registration Applications The morphing transformation What went wrong? The Kalman update formula can be expressed as Probability density X a = A ( X f ) T , so X a i ∈ span { X f } , where the analysis ensemble is made of 0 500 1000 1500 Temperature (K) linear combinations of the forecast. Non-Gaussian distribution: Spatial perturbations yield forecast distributions with two modes centered around burning and non-burning regions. Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Data assimilation and EnKF Spectral and wavelet EnKF Automatic image registration Applications The morphing transformation Solution: morphing EnKF Need correction of location, not just amplitude Solution: Use morphs instead of linear combinations Define morphing transform, carries explicit position information In the morphing space, probability distributions are much closer to Gaussian, standard EnKF succesfull Initial ensemble: smooth random perturbation of amplitude and location Applicable to any problem with moving features (error in speed causes error in (picture Gao & Sederberg 1992) location), not necessarily sharp Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Data assimilation and EnKF Spectral and wavelet EnKF Automatic image registration Applications The morphing transformation Image morphing A morphing function, T : Ω → Ω defines a spatial perturbation of an image, u . It is invertible when ( I + T ) − 1 exists. An image u “morphed” by T is defined as ˜ u = u ( x + Tx ) = u ◦ ( I + T )( x ) . ˜ u ◦ I + T = u Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Data assimilation and EnKF Spectral and wavelet EnKF Automatic image registration Applications The morphing transformation Automatic image registration Goal: Given two images u and v , find an invertible morphing function, T , which makes u ◦ ( I + T ) ≈ v , while ensuring that T is “small” as possible. Image registration problem J u → v ( T ) = || u ◦ ( I + T ) − v || R + || T || T → min T || r || R = c R || r || 2 || T || T = c T || T || 2 + c ∇ ||∇ T || 2 c R , c T , and c ∇ are treated as optimization parameters Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Data assimilation and EnKF Spectral and wavelet EnKF Automatic image registration Applications The morphing transformation Automatic registration procedure Avoid getting trapped in local minima Multilevel method Start from the coarsest grid and go up On coarse levels, look for an approximate global match, then refine Smoothing by a Gaussian kernel first to avoid locking the solution in when some fine features match by an accident while the global match is still poor On all levels map out the solutions space by sampling iterate by steepest descent from the best match Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Data assimilation and EnKF Spectral and wavelet EnKF Automatic image registration Applications The morphing transformation Minimization by sampling Probe the solution space by moving the center to sample points and evaluating the objective function and taking the minimum. Morphing function on grid points determined by some sort of interpolation. Refine the grid and repeat until desired accuracy is reached. When using bilinear interpolation, invertibility is guaranteed when all grid quadrilaterals are convex. Smoother interpolation... invertibility more complicated Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Data assimilation and EnKF Spectral and wavelet EnKF Automatic image registration Applications The morphing transformation Grid refinement The objective function need only be calculated locally, within the subgrid, allowing acceptable computational complexity, O ( n log n ) . Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Data assimilation and EnKF Spectral and wavelet EnKF Automatic image registration Applications The morphing transformation Image smoothing Gaussian kernel with bandwidth h − x T x � � G h ( x ) = c h exp 2 h A smoothed temperature Smoothing by convolution with G h ( x ) profile (in blue) with improves performance of steepest bandwidth 200 m . descent methods applied to J u → v ( T ) . Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Data assimilation and EnKF Spectral and wavelet EnKF Automatic image registration Applications The morphing transformation The morphing transformation Augment the state by an explicit information about space deformation: Morphing transformation Given a reference state u 0 � T i The registration map M u 0 u i = r i = u i ◦ ( I + T i ) − 1 − u 0 Residual (of amplitude) M − 1 u 0 [ T i , r i ] = u i = ( u 0 + r i ) ◦ ( I + T i ) The inverse transform u i ,λ = ( u 0 + λ r i ) ◦ ( I + λ T i ) intermediate states for 0 < λ < 1 Linear combinations of [ r i , T i ] give intermediate states. Apply M u 0 to the ensemble and the data, run the EnKF on the transformed variables, and apply the inverse transformation to get the analysis ensemble. Jan Mandel Morphing and wavelet EnKF

Morphing EnKF Data assimilation and EnKF Spectral and wavelet EnKF Automatic image registration Applications The morphing transformation Linear combinations of transformed states are now physically realistic. The first and the last state are actual simulation states, those in between are generated automatically by morphing. Both the position and the amplitudes are interpolated. Jan Mandel Morphing and wavelet EnKF