{"id":39524,"date":"2023-05-29T15:10:06","date_gmt":"2023-05-29T19:10:06","guid":{"rendered":"https:\/\/mjtsai.com\/blog\/?p=39524"},"modified":"2024-06-10T14:13:25","modified_gmt":"2024-06-10T18:13:25","slug":"apple-intelligence","status":"publish","type":"post","link":"https:\/\/mjtsai.com\/blog\/2023\/05\/29\/apple-intelligence\/","title":{"rendered":"Apple Intelligence"},"content":{"rendered":"<p><a href=\"https:\/\/bitsplitting.org\/2023\/05\/25\/apple-intelligence\/\">Daniel Jalkut<\/a>:<\/p>\n<blockquote cite=\"https:\/\/bitsplitting.org\/2023\/05\/25\/apple-intelligence\/\">\n<p>People are justifiably less confident about Apple&rsquo;s prospective plans in the area of artificial intelligence (AI), and particularly in the realm of large language models: the technology behind such imagination-captivating products as OpenAI&rsquo;s <a href=\"https:\/\/chat.openai.com\">ChatGPT<\/a>, and <a href=\"https:\/\/github.com\/features\/copilot\">GitHub Copilot<\/a> (which itself uses another OpenAI language model).<\/p>\n<p>I zeroed in on ChatGPT and Copilot because it&rsquo;s easy to imagine the functionality of these services shining in the context of two important Apple products: Siri, and its Xcode developer tools. In fact, technology is advancing so quickly that the absence of <em>something like ChatGPT<\/em> and <em>something like Copilot<\/em> in these products seems likely to be viewed as major shortcoming in the near future, if it isn&rsquo;t seen that way already.<\/p>\n<p>[&#8230;]<\/p>\n<p>Apple Intelligence won&rsquo;t be as good as ChatGPT or GitHub Copilot, at least not to start with. But it will be Apple&rsquo;s. They can frame the pros and cons however they see fit, working their typical marketing magic to make its shortcomings seem less important, if not downright advantageous.<\/p>\n<\/blockquote>\n<p>It would seem that Apple is way behind, not only in terms of announced products, but also because, as large language models become commoditized, access to <a href=\"https:\/\/www.wired.com\/story\/stack-overflow-will-charge-ai-giants-for-training-data\/\">proprietary training data<\/a> and <a href=\"https:\/\/mjtsai.com\/blog\/2023\/04\/04\/chatgpt-plug-ins\/\">integrations<\/a> will become key. Apple does have some unique data such as iTunes and App Store reviews, but these seem less useful than what its competitors have. Xcode Cloud could potentially be a great data source, but it, rightly, is designed for <a href=\"https:\/\/developer.apple.com\/xcode-cloud\/\">privacy<\/a>:<\/p>\n<blockquote cite=\"https:\/\/developer.apple.com\/xcode-cloud\/\"><p>Source code is only accessed for builds and the ephemeral build environments are destroyed when your build completes.<\/p><\/blockquote>\n<p>On the other hand, <a href=\"https:\/\/www.makeuseof.com\/bard-vs-chatgpt-vs-offline-alpaca-which-is-the-best-llm\/\">perhaps<\/a> we are not that far from fitting really useful, if not market-leading, models <a href=\"https:\/\/old.reddit.com\/r\/LocalLLaMA\/comments\/128tp9n\/having_a_20_gig_file_that_you_can_ask_an_offline\/\">on<\/a> <a href=\"https:\/\/news.ycombinator.com\/item?id=36027522\">device<\/a>. Apple has great hardware to run them, which is already deployed. It could work offline and preserve your privacy. This could be easier and cheaper to scale up to large numbers of users than models running in data centers.<\/p>\n\n<p>Previously:<\/p>\n<ul>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2023\/05\/12\/llm-coding-tools-in-xcode\/\">LLM Coding Tools in Xcode<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2023\/05\/11\/google-codey\/\">Google Codey<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2023\/05\/01\/turmoil-behind-siri\/\">Turmoil Behind Siri<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2023\/04\/26\/cheating-is-all-you-need\/\">Cheating Is All You Need<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2023\/04\/04\/chatgpt-plug-ins\/\">ChatGPT Plug-ins<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2023\/03\/23\/github-copilot-x\/\">GitHub Copilot X<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2023\/03\/15\/gpt-4\/\">GPT-4<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2023\/02\/24\/googles-bard\/\">Google&rsquo;s Bard<\/a><\/li>\n<li><a href=\"https:\/\/mjtsai.com\/blog\/2020\/08\/07\/why-apple-believes-its-an-ai-leader\/\">Why Apple Believes It&rsquo;s an AI Leader<\/a><\/li>\n<\/ul>\n\n<p id=\"apple-intelligence-update-2023-12-21\">Update (2023-12-21): <a href=\"https:\/\/arstechnica.com\/apple\/2023\/12\/apple-wants-ai-to-run-directly-on-its-hardware-instead-of-in-the-cloud\/\">Tim Bradshaw<\/a>:<\/p>\n<blockquote cite=\"https:\/\/arstechnica.com\/apple\/2023\/12\/apple-wants-ai-to-run-directly-on-its-hardware-instead-of-in-the-cloud\/\">\n<p>Apple&rsquo;s latest research about running large language models on smartphones offers the clearest signal yet that the iPhone maker plans to catch up with its Silicon Valley rivals in generative artificial intelligence.<\/p>\n<p>The paper, entitled &ldquo;<a href=\"https:\/\/arxiv.org\/pdf\/2312.11514.pdf\">LLM in a Flash<\/a>,&rdquo; offers a &ldquo;solution to a current computational bottleneck,&rdquo; its researchers write.<\/p>\n<p style=\"\">Its approach &ldquo;paves the way for effective inference of LLMs on devices with limited memory,&rdquo; they said. Inference refers to how large language models, the large data repositories that power apps like ChatGPT, respond to users&rsquo; queries. Chatbots and LLMs normally run in vast data centers with much greater computing power than an iPhone.<\/p><\/blockquote>\n\n<p id=\"apple-intelligence-update-2024-06-07\">Update (2024-06-07): <a href=\"https:\/\/www.macrumors.com\/2024\/06\/07\/apple-intelligence-service-wwdc\/\">Tim Hardwick<\/a>:<\/p>\n<blockquote cite=\"https:\/\/www.macrumors.com\/2024\/06\/07\/apple-intelligence-service-wwdc\/\"><p>Apple will announce its new AI feature set for Apple devices at WWDC on June 10, and <em>Bloomberg<\/em>&rsquo;s Mark Gurman <a href=\"https:\/\/www.bloomberg.com\/news\/articles\/2024-06-07\/apple-wwdc-2024-what-to-expect-ai-ipados-18-macos-15-siri-updates-more\">reports<\/a> that it will be officially called &ldquo;Apple Intelligence.&rdquo;<\/p><p>[&#8230;]<\/p><p>Apple Intelligence is expected to handle basic AI tasks, and it will work mostly on-device. In other words, the model is powered by the device&rsquo;s onboard processor, rather than in the cloud.<\/p><\/blockquote>","protected":false},"excerpt":{"rendered":"<p>Daniel Jalkut: People are justifiably less confident about Apple&rsquo;s prospective plans in the area of artificial intelligence (AI), and particularly in the realm of large language models: the technology behind such imagination-captivating products as OpenAI&rsquo;s ChatGPT, and GitHub Copilot (which itself uses another OpenAI language model). I zeroed in on ChatGPT and Copilot because it&rsquo;s [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"apple_news_api_created_at":"2023-05-29T19:10:09Z","apple_news_api_id":"4be5bf93-dfc4-45f2-93e9-b88758b6ee0b","apple_news_api_modified_at":"2024-06-07T19:19:33Z","apple_news_api_revision":"AAAAAAAAAAAAAAAAAAAAAg==","apple_news_api_share_url":"https:\/\/apple.news\/AS-W_k9_ERfKT6biHWLbuCw","apple_news_coverimage":0,"apple_news_coverimage_caption":"","apple_news_is_hidden":false,"apple_news_is_paid":false,"apple_news_is_preview":false,"apple_news_is_sponsored":false,"apple_news_maturity_rating":"","apple_news_metadata":"\"\"","apple_news_pullquote":"","apple_news_pullquote_position":"","apple_news_slug":"","apple_news_sections":"\"\"","apple_news_suppress_video_url":false,"apple_news_use_image_component":false,"footnotes":""},"categories":[2],"tags":[2602,1351,31,2321,30,2385,247,1877,226,2230],"class_list":["post-39524","post","type-post","status-publish","format-standard","hentry","category-technology","tag-apple-intelligence","tag-artificial-intelligence","tag-ios","tag-ios-17","tag-mac","tag-macos-14-sonoma","tag-siri","tag-stack-overflow","tag-xcode","tag-xcode-cloud"],"apple_news_notices":[],"_links":{"self":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/39524","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/comments?post=39524"}],"version-history":[{"count":5,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/39524\/revisions"}],"predecessor-version":[{"id":43580,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/posts\/39524\/revisions\/43580"}],"wp:attachment":[{"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/media?parent=39524"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/categories?post=39524"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mjtsai.com\/blog\/wp-json\/wp\/v2\/tags?post=39524"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}