The next generation of smartphone cameras could see through walls - High-End Smartphones - PC & Tech Authority
Description: The latest camera research is shifting from increasing the number of megapixels towards fusing data with computational processing
Keywords: camera technology,computational processing,imaging techniques,light detectors,pixel cameras

# The next generation of smartphone cameras could see through walls

By Staff Writer
Jan 24, 2018 9:38AM

## The latest camera research is shifting from increasing the number of megapixels towards fusing data with computational processing

You may be pleased with the camera technology in your latest smartphone, which can recognise your face and take slow-mo video in ultra-high definition, but these technological feats are just the start of a larger revolution.

The latest camera research is shifting away from increasing the number of megapixels towards fusing camera data with computational processing. By that, we don't mean the Photoshop style of processing where effects and filters are added to a picture, but rather a radical new approach where the incoming data may not actually look like at an image at all. It only becomes an image after a series of computational steps that often involve complex mathematics and modelling how light travels through the scene or the camera.

This additional layer of processing magically frees us from the chains of conventional imaging techniques. One day we may not even need cameras in the conventional sense any more. Instead we will use light detectors that only a few years ago we would never have considered any use for imaging. And they will be able to do incredible things, like see through fog, inside the human body and even behind walls.

### Single pixel cameras

One extreme example is the single-pixel camera, which relies on a beautifully simple principle. Typical cameras use lots of pixels (tiny sensor elements) to capture a scene that is likely illuminated by a single light source. You can also do things the other way around, capturing information from many light sources with a single pixel.

To do this you need a controlled light source, for example a simple data projector that illuminates the scene one spot at a time or with a series of different patterns. For each illumination spot or pattern, you then measure the amount of light reflected and add everything together to create the final image.

Clearly the disadvantage of taking a photo in this is way is that you have to send out lots of illumination spots or patterns in order to produce one image (which would take just one snapshot with a regular camera). But this form of imaging would allow you to create otherwise impossible cameras, for example that work at wavelengths of light beyond the visible spectrum, where good detectors cannot be made into cameras.

These cameras could be used to take photos through fog or thick falling snow. Or they could mimic the eyes of some animals and automatically increase an image's resolution (the amount of detail it captures) depending on what's in the scene.

It is even possible to capture images from light particles that have never even interacted with the object we want to photograph. This would take advantage of the idea of “quantum entanglement”, that two particles can be connected in a way that means whatever happens to one happens to the other, even if they are a long distance apart. This has intriguing possibilities for looking at objects whose properties might change when lit up, such as the eye. For example, does a retina look the same when in darkness as in light?

### Multi-sensor imaging

Single-pixel imaging is just one of the simplest innovations in upcoming camera technology and relies, on the face of it, on the traditional concept of what forms an picture. However, we are currently witnessing a surge of interest for systems where that use lots of information, but traditional techniques only collect a small part of it.

This is where we could use multi-sensor approaches that involve many different detectors pointed at the same scene. The Hubble telescope was a pioneering example of this, producing pictures made from combinations of many different images taken at different wavelengths. You can biw buy commercial versions of this kind of technology, such as the Lytro camera that collects information about light intensity and direction on the same sensor, to produce images that can be refocused after the image has been taken.

The next generation camera will probably look something like the Light L16 camera (above). This camera features groundbreaking technology based on more than ten different sensors. Their data are combined using a computer to provide a 50Mb, re-focusable and re-zoomable, professional-quality image. The camera itself looks like a very exciting Picasso interpretation of a crazy cell-phone camera.

Yet these are just the first steps towards a new generation of cameras that will change the way in which we think of and take images. Researchers are working hard on the problem of seeing through fog, seeing behind walls, and even imaging deep inside the human body and brain. All of these techniques rely on combining images with models that explain how light travels through through or around different substances.

Another interesting approach that is gaining ground relies on artificial intelligence to “learn” to recognise objects from the data. These techniques are inspired by learning processes in the human brain and are likely to play a major role in future imaging systems.

Single photon and quantum imaging technologies are also maturing to the point they can take pictures with incredibly low light levels and videos with incredibly fast speeds reaching a trillion frames per second. This is enough to even capture images of light itself travelling across as scene.

Some of these applications might require a little time to fully develop but we now know that the underlying physics should allow us to solve these and other problems through a clever combination of new technology and computational ingenuity.

Daniele Faccio is professor of Quantum Technologies at the University of Glasgow. Stephen McLaughlin is head of school of engineering and physical sciences at Heriot-Watt University. This article was originally published on The Conversation.

This article originally appeared at alphr.com

Copyright © Alphr, Dennis Publishing
Tags:
camera technology computational processing high-end smartphones imaging techniques light detectors pixel cameras
By Staff Writer
Jan 24 2018
9:38AM
0 Comments

### Related Articles

- Is Apple planning to kill the original iPhone X?
- MWC 2018 preview: the smartphones we're most excited to see
- Samsung Galaxy S9: Everything we know so far
- Razer Phone cuts deal with Netflix

### Most Read Articles

## The next generation of smartphone cameras could see through walls

## How to: Stream VLC Player to Chromecast

## Super charge your home network for less than $200

## NBN Watch: Let’s be honest, did you expect another reaction?

New Issue ON SALE NOW
SUBSCRIBE
to PC & Tech Authority
SUBSCRIBE
to Hyper
Would you like to receive

#### Our Newsletter?

### Most popular tech stories

- ## The CIO movements that made headlines in 2017

  ## Australia counts down to real-time payments

  ## NBN retailers show signs of competing on quality

  ## The end is finally in sight for NSW Education's LMBR overhaul

  ## NSW Transport's $425m IT overhaul escapes public scrutiny

- ## Macquarie Telecom beats Box over cloud naming rights

  ## SAP is migrating to Microsoft Azure

  ## Adelaide reseller Compute Your World reveals nightmare with NBN

  ## Australia's best tech employers for 2017 revealed

  ## The best and worst channel stocks of 2017

- ## 18 pro tips from the Rainbow Six Siege world cup

  ## 20 key tips for succeeding at Rainbow Six Siege

  ## Every Battlefield game ranked from worst to best

  ## 10 advanced tips for Rainbow Six Siege

  ## 10 best twin-stick shooters on Steam

- ## Top 25 fantasy games of all time

  ## Far Cry 5 hands-on impressions

  ## Top 15 obscure video game consoles for collectors

  ## 10 tips for mastering the chicken meta in PUBG on Xbox One

  ## 12 remastered games you need to play on PS4 or Xbox One

- ## 10 Easy Ways You Can Tell For Yourself That The Earth Is Round

  ## There's still a piece of Canada stuck to Australia

  ## When you burn fat, where does it actually go?

  ## 7 Reasons the Wedgie is Superior to the American Bald Eagle

  ## How to actually succeed on a dating app