Artificial intelligence enhances blurry faces into 'super-resolution images'

AI system could theoretically be used on low resolution images of almost anything, from microscopy to astronomy

Anthony Cuthbertson
Monday 15 June 2020 06:19 EDT
Comments
The AI system 'imagines' features like eyelashes that are not apparent at the blurred resolution
The AI system 'imagines' features like eyelashes that are not apparent at the blurred resolution (Rudin lab)

Your support helps us to tell the story

From reproductive rights to climate change to Big Tech, The Independent is on the ground when the story is developing. Whether it's investigating the financials of Elon Musk's pro-Trump PAC or producing our latest documentary, 'The A Word', which shines a light on the American women fighting for reproductive rights, we know how important it is to parse out the facts from the messaging.

At such a critical moment in US history, we need reporters on the ground. Your donation allows us to keep sending journalists to speak to both sides of the story.

The Independent is trusted by Americans across the entire political spectrum. And unlike many other quality news outlets, we choose not to lock Americans out of our reporting and analysis with paywalls. We believe quality journalism should be available to everyone, paid for by those who can afford it.

Your support makes all the difference.

Researchers have figured out a way to transform a few dozen pixels into a high resolution image of a face using artificial intelligence.

A team from Duke University in the US created an algorithm capable of "imagining" realistic-looking faces from blurry, unrecognisable pictures of people, with eight-times more effectiveness than previous methods.

"Never have super-resolution images been created at this resolution before with this much detail," said Duke computer scientist Cynthia Rudin, who led the research.

The images generated by the AI do not resemble real people, instead they are faces that look plausibly real. It therefore cannot be used to identify people from low resolution images captured by security cameras.

The PULSE (Photo Upsampling via Latent Space Exploration) system developed by Dr Rudin and her team creates images with 64-times the resolution than the original blurred picture.

The PULSE algorithm is able to achieve such high levels of resolution by reverse engineering the image from high resolution images that look similar to the low resolution image when down scaled.

The images generated by enhancing the pixels do not represent real people
The images generated by enhancing the pixels do not represent real people (Duke University)

Through this process, facial features like eyelashes, teeth and wrinkles that were impossible to see in the low resolution image become recognisable and detailed.

"Instead of starting with the low resolution image and slowly adding detail, PULSE traverses the high resolution natural image manifold, searching for images that downscale to the original low resolution image," states a paper detailing the research.

The AI algorithm is able to enhance a few dozen pixels into a high-resolution picture of a face
The AI algorithm is able to enhance a few dozen pixels into a high-resolution picture of a face (Duke University)

"Our method outperforms state-of-the-art methods in perceptual quality at higher resolutions and scale factors than previously possible."

The system could theoretically be used on low resolution images of almost anything, ranging from medicine and microscopy, to astronomy and satellite imagery.

This means noisy, poor-quality images of distant planets and solar systems could be imagined in high resolution.

The research will be presented at the 2020 Conference on Computer Vision and Pattern Recognition (CVPR) this week.

Join our commenting forum

Join thought-provoking conversations, follow other Independent readers and see their replies

Comments

Thank you for registering

Please refresh the page or navigate to another page on the site to be automatically logged inPlease refresh your browser to be logged in