Tuesday, June 28, 2016

Behind Apple’s Advanced Computer Vision for Photos.app

Kay Yin (via Accidental Tech Podcast):

Photos app supports detecting 4,432 different scenes and objects. These scenes or objects can be searched for in all languages.

Additionally, you can search for various landmarks. For example, Photos can respond for search query of “Maho” (beach in Saint Martin), despite Photos is not programmed or trained to understand specific landmarks. Behind the scenes, Photos app first generates a generic categorization for the scene, “beach”, then searches through a built-in dictionary for all landmarks that has the name “beach” in its definition. Therefore, cleverly, despite Photos app knows nothing about “Maho” in particular, it is still able to return the right results. The same applies to nature scenes, water scenes and urban scenes.

For your pleasure, here’s a comprehensive list of scenes you can search for.

I would love to see this kind of thing in Lightroom.

Comments RSS · Twitter

Leave a Comment