Inpainting and zooming using sparse representations

M. J. Fadili, J. L. Starck, Fionn Murtagh

Research output: Contribution to journalArticlepeer-review

263 Citations (Scopus)


Representing the image to be inpainted in an appropriate sparse representation dictionary, and combining elements from Bayesian statistics and modern harmonic analysis, we introduce an expectation maximization (EM) algorithm for image inpainting and interpolation. From a statistical point of view, the inpainting/interpolation can be viewed as an estimation problem with missing data. Toward this goal, we propose the idea of using the EM mechanism in a Bayesian framework, where a sparsity promoting prior penalty is imposed on the reconstructed coefficients. The EM framework gives a principled way to establish formally the idea that missing samples can be recovered/interpolated based on sparse representations. We first introduce an easy and efficient sparse-representation-based iterative algorithm for image inpainting. Additionally, we derive its theoretical convergence properties. Compared to its competitors, this algorithm allows a high degree of flexibility to recover different structural components in the image (piecewise smooth, curvilinear, texture, etc.). We also suggest some guidelines to automatically tune the regularization parameter.

Original languageEnglish
Pages (from-to)64-79
Number of pages16
JournalComputer Journal
Issue number1
Publication statusPublished - 1 Jan 2009
Externally publishedYes


Dive into the research topics of 'Inpainting and zooming using sparse representations'. Together they form a unique fingerprint.

Cite this