{"id":43622,"date":"2024-06-10T15:40:59","date_gmt":"2024-06-10T19:40:59","guid":{"rendered":"https:\/\/mjtsai.com\/blog\/?p=43622"},"modified":"2024-08-22T14:13:09","modified_gmt":"2024-08-22T18:13:09","slug":"apple-intelligence-announced","status":"publish","type":"post","link":"https:\/\/mjtsai.com\/blog\/2024\/06\/10\/apple-intelligence-announced\/","title":{"rendered":"Apple Intelligence Announced"},"content":{"rendered":"

Apple<\/a> (preview<\/a>, Hacker<\/a> News<\/a>, MacRumors<\/a>, 9to5Mac<\/a>):<\/p>\n

\n

Writing Tools help users feel more confident in their writing. With Rewrite, Apple Intelligence allows users to choose from different versions of what they have written, adjusting the tone to suit the audience and task at hand. From finessing a cover letter, to adding humor and creativity to a party invitation, Rewrite helps deliver the right words to meet the occasion. Proofread checks grammar, word choice, and sentence structure while also suggesting edits — along with explanations of the edits — that users can review or quickly accept. With Summarize, users can select text and have it recapped in the form of a digestible paragraph, bulleted key points, a table, or a list.<\/p>\n

[…]<\/p>\n

In the Notes and Phone apps, users can now record, transcribe, and summarize audio.<\/p>\n

[…]<\/p>\n

Natural language can be used to search for specific photos, such as “Maya skateboarding in a tie-dye shirt,” or “Katie with stickers on her face.” Search in videos also becomes more powerful with the ability to find specific moments in clips so users can go right to the relevant segment. Additionally, the new Clean Up tool can identify and remove distracting objects in the background of a photo — without accidentally altering the subject.<\/p>\n

[…]<\/p>\n

A cornerstone of Apple Intelligence is on-device processing, and many of the models that power it run entirely on device. To run more complex requests that require more processing power, Private Cloud Compute extends the privacy and security of Apple devices into the cloud to unlock even more intelligence.<\/p>\n<\/blockquote>\n\n

Benjamin Mayo<\/a>:<\/p>\n

\n

Apple today unveiled a new version of Siri, that it promises is more natural and helpful. The new Siri is powered by Apple Intelligence generative AI models.<\/p>\n

[…]<\/p>\n

Apple says the new Siri will understand context, so you don’t have to repeat information in subsequent requests.<\/p>\n

[…]<\/p>\n

Siri will have on-screen awareness about what you are currently looking at, and have the ability to take in-app actions.<\/p>\n

[…]<\/p>\n

App Intents will allow Siri to work deeply with first-party and third-party apps.<\/p>\n<\/blockquote>\n\n

But will Siri be able to create a reminder with the literal text of what I said?<\/p>\n\n

Hartley Charlton<\/a> (9to5Mac<\/a>):<\/p>\n

Siri will determine if queries may be useful to forward to ChatGPT, and asks the user for permission to share. This enables Siri to leverage ChatGPT’s image- and text-understanding capabilities with no need to jump between tools.<\/p>

[…]<\/p>

Siri will leverage GPT-4o for free, with no need to create an account. Requests are not logged and IP addresses are obscured.<\/p><\/blockquote>\n\n

Tim Hardwick<\/a>:<\/p>\n

\n

has unveiled a new Image Playground feature that allows you to create generative images on the fly using a range of concepts like themes, costumes, accessories, places, and more.<\/p>\n

You can type a description, and choose from Animation, Illustration, or Sketch, and Image Playground will create the image tailored to your preferences.<\/p>\n<\/blockquote>\n\n

Ryan Christoffel<\/a> (MacRumors<\/a>):<\/p>\n

Apple shared a new feature that will enable you to create an emoji for any occasion. Apple calls this AI-powered feature Genmoji.<\/p>

[…]<\/p>

Since emojis are actually unicode characters that work cross-platform, Apple’s Genmoji won’t technically work the same way as other emoji, since if they were, they wouldn’t display properly on non-Apple devices. Instead, Apple creates Genmoji as images.<\/p><\/blockquote>\n\n

Meek Geek<\/a> wonders whether the hardware requirements are artificial.<\/p>\n\n

Previously:<\/p>\n