Apple kicked off its annual developer conference WWDC 2024 on Monday, where the technology giant demonstrated how it is incorporating artificial intelligence into its software suite, including a revamped Siri voice assistant and a partnership with ChatGPT owner OpenAI.
The video explains the key takeaways of the conference and allow spectators delve into its new features and functions in detail.
Vision Pro update: Apple‘s augmented reality headset, which was the centrepiece of its conference last year, is getting a major software update including new ways to make content for the device and control it with physical gestures. Sales of Apple’s highly hyped augmented reality headset have been weak in recent months.
- Spatial Photos Experience: Enhances the immersive experience with support for spatial photos.
- New Gestures: Adds support for new gestures, improving interaction.
- SharePlay in Photos App: Allows spatial personas to engage with shared photos.
- Travel Mode: Includes train support for a better travel experience.
- Higher Display Resolution: Later this year, Vision Pro will support a resolution equivalent to two 4K displays.
Siri’s makeover: Apple is hailing this year as the beginning of a new era for its voice assistant, great features will include the ability to take actions within apps on your behalf and better natural language processing to commence with.
Also, Includes,
- Natural Interaction: Redesigned for more natural, relevant, and personal interactions.
- Visual Redesign: A new wake visual that glows around the device display.
- Text Input Support: Similar to other AI chatbots, with on-screen awareness.
- Contextual Actions: Drives context from personal content such as photos, messages, calendar events, etc.
- Rewriting Tool: Helps write specialised content with context awareness.
- Smart Reply: For quick replies.
iOS 18 for iPhone
- Home Screen: Apps and widgets can now be relocated, and the home screen supports customisable colours and new app icons in dark mode.
- Control Centre: Introduces a new group of controls accessible with a swipe-up gesture, showing connected home devices and allowing for quick control customisation. Controls are also accessible from the lock screen, and the Action Button can invoke these controls.
- App Lock: Independent app locking, with hidden apps placed in a secure folder.
- Messages: Includes RCS messaging support, emoji and sticker tatapbacksscheduled messages, text formatting, integrated text effects, and satellite messaging for iPhone 14 and later models.
- Mail: On-device categorisation of emails into primary, transactions, updates, and promotions (coming later this year).
- Game mode: Mac’s game mode is coming to the iPhone.
- Photos: A comprehensive redesign simplifies accessing memories and organising photos, with built-in intelligence for creating collections.
- Audio: Siri supports gestures such as nodding, voice isolation for AirPods Pro, and personalised spatial audio for gaming, with “Need for Speed Mobile” as the first title to support this feature – coming later this year.
- TV: Apple TV Plus gains an insight feature similar to Prime Video’s in-screen option and support for 21:9 format projectors.
watchOS 11 introduces several new features
- Training Load: Tailored for enthusiasts and athletes.
- Vitals App: A new app to view vital health metrics quickly.
- Cycle Tracking: Enhanced with pregnancy tracking features.
- Smart Stacks: Automatically adds widgets like weather and translation.
- Check-In: A new feature coming to the Apple Watch.
The updates in iPadOS 18 are:
- Floating Tab Bar: Customisable and movable into a sidebar.
- SharePlay: Allows remote control of someone else’s iPad.
- Calculator App: Finally coming to the iPad, with Apple Pencil support.
- Smart Script in Notes App: Improves handwriting using on-device machine learning, making it smoother and more legible. Posted text appears in handwritten notes format, with support for spell check, text wrap, and copy/paste functions.