Apple Intelligence Revealed at WWDC 2024: Advanced Siri, Genmoji, and More

Apple revealed its AI features at WWDC 2024 that it prefer calling 'Apple Intelligence' and not Artificial Intelligence. The Cupertino-based tech giant avoided using the term AI and instead used term like Machine Learning. From a new redesigned and advanced Siri to AI-powered emoji generation, named 'Genmoji', the new Apple Intelligence brings in a lot of features to iPhones, iPads and Macs. 

Apple Intelligence will arrive on iPhone 15 Pro, iPhone 15 Pro Max, M1 iPad or later, or M1 Mac or later, iPadOS 18 and macOS Sequoia, this fall which we expect to be September. To use Apple Intelligence, the only condition is to have Siri enabled and set the language to English US. Let's check out some of its features below. 

Intelligent Siri

Apple has partnered with OpenAI to bring an improved version of Siri. The voice assistant can now use its brain to manage notifications, write things on its own, and summarise text in various apps. The revamped version comes with a new logo, new interface, and ability to understand advance requests and questions and answer or take action accordingly. Users can now communicate with Siri because of its ability to understand and maintain and conversational tone.

Siri is now able to perform appropriate actions based on information available on the screen. This happens because of a new feature called 'onscreen awareness', that allows Siri to understand the screen content on the device. Siri can now take written prompts. 

Apple has clarified that all this processing is stored on the device to maintain the privacy of all users. For those requests that can not be processed locally, Apple has developed a 'Private Cloud Compute'. Apple says they’ll allow experts to verify these privacy claims.

Genmoji and Image Generation

Apple Intelligence comes with image generation capabilities on various apps. It also brings Genmoji, that allows users to create custom emojis depending on the need and mood of the conversation. Another image generation named Image Playground will arrive soon on iPhones with iOS 18.

Apple has announced Clean Up, an alternative version of Google’s Magic Eraser. It also can remove unwanted objects from the background. The Photos app can now search images by using the activities of the image as commands, thanks to AI.

ChatGPT Integration

Apple devices will now be powered by GPT-4o-based ChatGPT to process the requests that Siri won’t be able to process on its own. Do note that Apple will take the user’s permission before sending its data to ChatGPT and then deliver its response to the user. Apple also said they’re starting with the best chatbot currently available but they’ll also add other AI tools later. 

Call Recordings With Summary and Transcription

Last and the most exciting feature, Apple will now allow iPhones user to record calls and summarise them using Apple Intelligence. Both users will be notified once the call recording has been started. The phone app will have an indicator showing the recording duration and a button to stop recording. Apple Intelligence will transcribe all the data that can be used to create a summary of the entire conversation in the Notes app. Users can also record and translate audio in English, Spanish, German, French, Japanese, Mandarin, Chinese, Cantonese, and Portuguese in the Notes app.