Wednesday, April 29, 2020

iPhone SE 2020: Single Image Monocular Depth Estimation

Ben Sandofsky (tweet):

In English, this is the first iPhone that can generate a portrait effect using nothing but a single, 2D image.


The new iPhone SE can’t use focus pixels, because its older sensor doesn’t have enough coverage. Instead, it generates depth entirely through machine learning. It’s easy to test this yourself: take a picture of another picture.


So why does Apple prevent the first party app from shooting non-people? They have a second process that works really well with humans in the frame. Without humans, it sometimes fails in weird ways.


Comments RSS · Twitter

Leave a Comment