Computationally Efficient Video Restoration for Nyquist Sampled Imaging Sensors Combining an Affine-motion-based Temporal Kalman Filter and Adaptive Wiener Filter

Document Type

Article

Publication Date

5-2014

Publication Source

Applied Optics

Abstract

In this paper, we present a computationally efficient video restoration algorithm to address both blur and noise for a Nyquist sampled imaging system. The proposed method utilizes a temporal Kalman filter followed by a correlation-model based spatial adaptive Wiener filter (AWF). The Kalman filter employs an affine background motion model and novel process-noise variance estimate. We also propose and demonstrate a new multidelay temporal Kalman filter designed to more robustly treat local motion. The AWF is a spatial operation that performs deconvolution and adapts to the spatially varying residual noise left in the Kalman filter stage. In image areas where the temporal Kalman filter is able to provide significant noise reduction, the AWF can be aggressive in its deconvolution. In other areas, where less noise reduction is achieved with the Kalman filter, the AWF balances the deconvolution with spatial noise reduction. In this way, the Kalman filter and AWF work together effectively, but without the computational burden of full joint spatiotemporal processing. We also propose a novel hybrid system that combines a temporal Kalman filter and BM3D processing. To illustrate the efficacy of the proposed methods, we test the algorithms on both simulated imagery and video collected with a visible camera.

Inclusive pages

C1-C13

ISBN/ISSN

1559-128X

Publisher

OSA: The Optical Society

Volume

53

Peer Reviewed

yes

Issue

13

Link to Full Text

Share

COinS