Single frame image super-resolution: should we process locally or globally?

Abstract

In this paper we study the usefulness of different local and global, learning-based, single-frame image super-resolution reconstruction techniques in handling three specific tasks, namely, de-blurring, de-noising and alias removal. We start with the global, iterative Papoulis-Gerchberg method for super-resolving a scene. Next we describe a PCA-based global method which faithfully reproduces a super-resolved image from a blurred and noisy low resolution input. We also study several multi-resolution processing schemes for super-resolution where the best edges are learned locally from an image database. We show that the PCA-based global method is efficient in handling blur and noise in the data. The local methods are adept in capturing the edges properly. However, both local and global approaches cannot properly handle the aliasing present in the low resolution observation. Hence we propose an alias removal technique by designing an alias-free upsampling scheme. Here the unknown high frequency components of the given partially aliased (low resolution) image is generated by minimizing the total variation of the interpolant subject to the constraint that part of alias free spectral components in the low resolution observation are known precisely and under the assumption of sparsity in the data.