{"id":45070,"date":"2024-09-24T15:48:25","date_gmt":"2024-09-24T19:48:25","guid":{"rendered":"https:\/\/mjtsai.com\/blog\/?p=45070"},"modified":"2024-10-04T15:21:52","modified_gmt":"2024-10-04T19:21:52","slug":"what-is-a-photo","status":"publish","type":"post","link":"https:\/\/mjtsai.com\/blog\/2024\/09\/24\/what-is-a-photo\/","title":{"rendered":"What Is a Photo?"},"content":{"rendered":"<p><a href=\"https:\/\/www.theverge.com\/24247538\/apple-iphone-16-pro-review\">Nilay Patel<\/a>:<\/p>\n<blockquote cite=\"https:\/\/www.theverge.com\/24247538\/apple-iphone-16-pro-review\">\n<p>It&rsquo;s also notable what <em>isn&rsquo;t<\/em> present on the iPhone this year: there&rsquo;s no generative AI wackiness at all. There&rsquo;s no video boost or face-swapping, no adding yourself to group photos, no drawing to add stuff with AI like on the Pixel or Galaxy phones &mdash; really, none of it. I asked Apple&rsquo;s VP of camera software engineering Jon McCormack about Google&rsquo;s view that the Pixel camera now captures &ldquo;memories&rdquo; instead of photos, and he told me that Apple has a strong point of view about what a photograph is &mdash; that it&rsquo;s something that actually happened. It was a long and thoughtful answer, so I&rsquo;m just going to print the whole thing[&#8230;]<\/p>\n<\/blockquote>\n\n<p><a href=\"https:\/\/daringfireball.net\/linked\/2024\/09\/23\/nilay-patel-iphone-16-pro-review\">John Gruber<\/a> has quoted the relevant section, and it&rsquo;s getting <a href=\"https:\/\/petapixel.com\/2024\/09\/19\/if-you-care-about-photography-apples-approach-should-have-you-cheering\/\">rave<\/a> <a href=\"https:\/\/pxlnv.com\/linklog\/apple-photography-ai-era\/\">reviews<\/a>. Maybe I&rsquo;m just too dumb to see the profundity, but I don&rsquo;t think there&rsquo;s any there there. These are pleasant sounding words along the lines of &ldquo;music is in our DNA,&rdquo; but what is the connection to what the Camera app actually does? Reports are that the photos by default look more processed than before. And Apple, like Samsung and Google, has been including features for years that make the photos not what actually happened.<\/p>\n\n<p><a href=\"https:\/\/www.macstories.net\/linked\/apples-definition-of-a-photo\/\">Federico Viticci<\/a>:<\/p>\n<blockquote cite=\"https:\/\/www.macstories.net\/linked\/apples-definition-of-a-photo\/\"><p>&ldquo;Something that really, actually happened&rdquo; is a great baseline compared to Samsung&rsquo;s nihilistic definition (<a href=\"https:\/\/www.theverge.com\/2024\/2\/2\/24059955\/samsung-no-such-thing-as-real-photo-ai\">nothing is real<\/a>) and Google&rsquo;s relativistic one (<a href=\"https:\/\/www.wired.com\/story\/google-pixel-9-real-tone-pixel-camera-interview\/\">everyone has their own memories<\/a>). [&#8230;] But I have to wonder how malleable that definition will retroactively become to make room for <a href=\"https:\/\/www.macrumors.com\/2024\/08\/28\/apple-intelligence-clean-up-hands-on\/\">Clean Up<\/a> and future generative features of Apple Intelligence.<\/p><\/blockquote>\n\n<p>What McCormack said is that a photo is a &ldquo;<em>celebration<\/em> of something that really, actually happened,&rdquo; not that <em>the image<\/em> in the photo actually happened.<\/p>\n\n<p>Google lets you celebrate a moment where two people were actually standing next to each other by creating such an image from two separate captures where they were standing alone. Apple lets you take a photo of multiple people and objects and remove some of them. What is the distinction here that amounts to a strong point of view? It just seems like a difference in degree. Arguably, the Google example is <em>more<\/em> truthful in that it&rsquo;s helping you recreate an actual moment, whereas the Apple one is letting you tune it up to be more what you remembered or wished for than the reality.<\/p>\n\n<p>If we were talking about this last year, people would say that there&rsquo;s a big philosophical difference because&mdash;although they both combine multiple exposures, add fake bokeh, and use AI to adjust colors and focus, etc.&mdash;Android phones let you <a href=\"https:\/\/rarehistoricalphotos.com\/stalin-photo-manipulation-1922-1953\/\">remove<\/a> objects and iPhones don&rsquo;t. But now Apple is adding that, too. If there&rsquo;s a bright line distinction, I think that was it. Apple crossed it, and I don&rsquo;t think they&rsquo;ll stop there. This is fine. It&rsquo;s a popular feature, and I know people who were considering switching to Android because of it.<\/p>\n\n<p><a href=\"https:\/\/pxlnv.com\/linklog\/apple-photography-ai-era\/\">Nick Heer<\/a>:<\/p>\n<blockquote cite=\"https:\/\/pxlnv.com\/linklog\/apple-photography-ai-era\/\">\n<p>In my testing of Clean Up on an image on the latest iOS 18.1 beta build, Apple <a href=\"https:\/\/c.im\/@nickheer\/113161598455847168\">adds EXIF tags<\/a> to the image to mark it as being <a href=\"https:\/\/cv.iptc.org\/newscodes\/digitalsourcetype\/compositeWithTrainedAlgorithmicMedia\">edited with generative A.I.<\/a> tools. EXIF tags can be erased, though, and I do not see any other indicators.<\/p>\n<\/blockquote>\n\n<p>Previously:<\/p>\n<ul>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2024\/09\/19\/iphone-16-pro-camera\/\">iPhone 16 Pro Camera<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2024\/08\/15\/halide-2-15-process-zero\/\">Halide 2.15: Process Zero<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2024\/06\/10\/apple-intelligence-announced\/\">Apple Intelligence Announced<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2023\/12\/04\/computational-bridal-photo\/\">Computational Bridal Photo<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2023\/02\/22\/the-limits-of-computational-photography\/\">The Limits of Computational Photography<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2023\/01\/10\/iphone-camera-over-processing\/\">iPhone Camera Over Processing<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2022\/03\/24\/iphone-cameras-and-computational-photography\/\">iPhone Cameras and Computational Photography<\/a><\/li>\n<\/ul>\n\n<p id=\"what-is-a-photo-update-2024-09-25\">Update (2024-09-25): <a href=\"https:\/\/social.fouquet.me\/@rene\/113196484873473863\">Ren&eacute; Fouquet<\/a>:<\/p>\n<blockquote cite=\"https:\/\/social.fouquet.me\/@rene\/113196484873473863\"><p>1. Given the iPhone&rsquo;s image processing pipeline&#x2013;something they proudly speak of at every chance they get&#x2013;this statement is already demonstrably false. Photos taken on the iPhone definitely do not show something that actually happened. The darker it gets, the more guesswork flows into an iPhone photo. So much guesswork, in fact, that nighttime photos can easily make up things that have never been there in reality. I have taken a couple of photos that interpreted leafs rustling in the wind as something else entirely.<\/p><p>2. How will they frame it when they will eventually add these features? Because let&rsquo;s be serious for a second here. They didn&rsquo;t add those features out of some philosophical stance against AI generated content. That is just corporate bullshit. They are simply way, WAY behind their competition when it comes to this and haven&rsquo;t gotten around to it (yet), or lack the required competence or whatever. It&rsquo;ll be fun to read the spins after they inevitably change course.<\/p><\/blockquote>\n\n<p id=\"what-is-a-photo-update-2024-10-04\">Update (2024-10-04): <a href=\"https:\/\/daringfireball.net\/thetalkshow\/2024\/09\/26\/ep-409\">The Talk Show<\/a>:<\/p>\n<blockquote cite=\"https:\/\/daringfireball.net\/thetalkshow\/2024\/09\/26\/ep-409\">\n<p>Nilay Patel returns to the show to consider the iPhones 16.<\/p>\n<\/blockquote>","protected":false},"excerpt":{"rendered":"<p>Nilay Patel: It&rsquo;s also notable what isn&rsquo;t present on the iPhone this year: there&rsquo;s no generative AI wackiness at all. There&rsquo;s no video boost or face-swapping, no adding yourself to group photos, no drawing to add stuff with AI like on the Pixel or Galaxy phones &mdash; really, none of it. I asked Apple&rsquo;s VP [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"apple_news_api_created_at":"2024-09-24T19:48:29Z","apple_news_api_id":"37f1d77b-6077-4ef8-8330-ff8901c0644e","apple_news_api_modified_at":"2024-10-04T19:21:54Z","apple_news_api_revision":"AAAAAAAAAAAAAAAAAAAAAQ==","apple_news_api_share_url":"https:\/\/apple.news\/AN_HXe2B3TviDMP-JAcBkTg","apple_news_coverimage":0,"apple_news_coverimage_caption":"","apple_news_is_hidden":false,"apple_news_is_paid":false,"apple_news_is_preview":false,"apple_news_is_sponsored":false,"apple_news_maturity_rating":"","apple_news_metadata":"\"\"","apple_news_pullquote":"","apple_news_pullquote_position":"","apple_news_slug":"","apple_news_sections":"\"\"","apple_news_suppress_video_url":false,"apple_news_use_image_component":false,"footnotes":""},"categories":[2],"tags":[2602,1351,152,2042,51,1748,31,2586,2651,2619,153,42],"class_list":["post-45070","post","type-post","status-publish","format-standard","hentry","category-technology","tag-apple-intelligence","tag-artificial-intelligence","tag-camera","tag-exchangeable-image-file-format-exif","tag-google","tag-high-dynamic-range-hdr","tag-ios","tag-ios-18","tag-iphone-16","tag-iphone-16-pro","tag-photography","tag-samsung"],"apple_news_notices":[],"_links":{"self":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/45070","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/comments?post=45070"}],"version-history":[{"count":3,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/45070\/revisions"}],"predecessor-version":[{"id":45242,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/45070\/revisions\/45242"}],"wp:attachment":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/media?parent=45070"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/categories?post=45070"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/tags?post=45070"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}