Fanboys are gonna (rightfully) talk shit about how Apple is so far behind the competition when it comes to AI, but aside from that, Apple announced some solid updates this year. Here are some of the things that I'm personally looking forward to.

iOS

• Liquid Design
  • Clear Mode — As someone who has spent an embarrassing amount of time customizing his home screen, I love the idea of optionally switching my icons to Clear.
• Games app — I like the theory that Apple could separate games from the App Store for the purpose of offering a different revenue share for app developers.
• Music app
  • Pinned Playlists — FINALLY. It's always been a pain in the ass to find the right playlist or radio station in the Music app while I'm driving.
• Messages
  • Chat Backgrounds
  • Chat Polls
  • Message Screening — YES. So tired of all the spammy texts, especially during election season.
  • Group Chat Type Indicators
  • Photo Previews — Setting for the Messages app to only send a lower-quality preview of a photo while an iPhone is in Low Data Mode. The full photo will be sent later.
• Clock
  • Snooze Customization — FINALLY.
• Phone
  • Call Screening
  • Hold Assist
• Wallet
  • Order Tracking
  • Flight Tracking
• AirPods
  • Pause-on-Sleep — Nice addition for someone who often falls asleep to podcasts when flying.
• Third-Party Apple Intelligence — BIG ONE. I am desperately hoping social media apps will offer AI-powered smart filters, so I can set up things like, "mute all political posts made by this person".
• Battery Time-to-Charge — FINALLY. Love this for travel.

watchOS

• Wrist Flick Gesture
• Third-Party Control Center Buttons

tvOS

• Profiles on Load — YES. No more dealing with my parents accidentally watching stuff under my Apple TV profile and ruining my watchlist.

macOS

• Spotlight
  • Clipboard History — FINALLY.
  • Intelligent Actions — AWESOME for power users. I've never been a huge Alfred, Keyboard Maestro, or Raycast user, but this offers just enough functionality that I can see myself getting into this.
• Continuity
  • Live Activity
  • Phone app
• Folder Icon Customization

visionOS

• Placement Persistence
  • Widgets — YES. Big improvement to make my surroundings feel more like my very own digital space.
• Spatial Scenes — This is INCREDIBLE. Photos of my beloved dog look ridiculously realistic now.
• Shared Experiences with other AVP users
• Improved Personas
• Jupiter environment
• Unlock iPhone — YES. Now just need iPhone Mirroring.
• Folders — Finally getting around to some of the basics.
• Look-to-Scroll

iPadOS

• Windows Multitasking — FINALLY. I personally won't be using this that much but this bodes extremely well for the iPad's future.
• Open With… — Definitely feeling more like a desktop computer.
• Preview app

A quick rundown of all my most-anticipated announcements (and unannounced tidbits) from WWDC 2024:

visionOS

• Mac Virtual Display — Huge updates for productivity!
  • Mouse Support — This makes working with Vision apps and Mac Virtual Display way more seamless.
  • Wide and Ultra Wide Screen Options — YES. I can easily see myself downgrading from the 16-inch screen to 14-inch for my next MacBook Pro.
• New Gesture — Way easier and efficient to invoke Home View and Control Center! Also alleviates my annoyance with how inefficient it was to see the time.
• Create Spatial Photos — Fucking. Awesome. All of my food photos can be transformed with AI into Spatial Photos. I've already done a few and this is just mind-blowing. It's hard to describe, but the experience is somewhere between looking at a two-dimensional photo and actually being there in the moment.
• Rearrangeable Home View
• New Bora Bora Environment — Great addition! These immersive environments are going to be such delightful additions like getting new watch faces in watchOS.
• AirPlay Receiver — Not sure exactly how I will use this but I appreciate any feature that let's me bring non-AVP things into my AVP.
• Improved Hand Tracking — Upgraded from 30Hz to 90Hz to make my hands feel more realistic when immersed. (For context, Meta Quest is 60Hz.)
• Improved Full Screen Videos in Safari — Huge improvement for watching videos on YouTube, Hulu, and other streaming services that can only be played on AVP via Safari. This gets the YouTube experience from completely unbearable to totally doable. Nothing will beat a native app but this is good enough to significantly increase my AVP usage.

Apps

• New Passwords App — Goodbye, 1Password! For me, this will be a game-changer for helping me manage my parents' passwords.
• Messages Improvements — Some of these are catch-ups but some are also enhancements to subtly keep iMessage blue bubbles positioned above SMS/RCS green bubbles.
  • Scheduled Messages — Finally. I constantly find funny links that I want to send to certain friends but know it's inappropriate to text late at night.
  • Easier Tapbacks — Love to see iMessage adopt this from Slack/Discord.
  • Text Effects — This will be fun to play around with.
  • Messaging via Satellite — Wow. Maybe I can start doing more outdoorsy, off-the-grid type things when I travel?? Very curious to see how this evolves.
• Reminders in Calendar — Goodbye, Fantastical! This alone will save me $57/year.
• Math Notes — Goodbye, Soulver! (Assuming this works as I hope it does.)
• Highlights in Safari — A welcomed enhancement for browsing websites. I like how Apple is using AI to enhance the web instead of trying to replace it like Open AI and Google.
• Redesigned Photos — The navigation is controversial but customizable so we'll see how this pans out.

iOS & iPadOS

• Home Screen and Control Center Customizations — Finally. Not sure how much I will personally use these new options but this should've been implemented years ago.
• Customizable Lock Screen Buttons — I'm looking forward to replacing the bottom-left Flashlight button with Camera and the bottom-right Camera button with Overcast. This just makes so much sense for me when I'm taking food photos with my left hand or opening Overcast when I get in my car.
• Lock/Hide Apps — Finally. Also, this will be awesome for parents who let their kids play with their phones.
• Remote Screen Control during Screen Share — Huge for being our parents' tech support.
• Vocal Shortcuts — Custom voice trigger words!
• Custom Charging Limits — A nice little improvement for maintaining battery health.
• T9 Dialing for iOS — A nice little quality-of-life improvement that is a welcomed copy from Android.
• Calculator App for iPad — Holy. Shit. A basic calculator app should've been added over a decade ago but they just dropped this bomb like Taylor Swift.
• Smart Script for iPad — As someone who has struggled with chicken-scratch handwriting all my life, this thing is absolutely mind-blowing.

AirPods

• Head Gestures — Wow. Such a brilliant feature to answer/reject voice calls.

tvOS

• Subtitles on Mute — A delightful enhancement for such a common use-case.
• InSight for Apple Originals — This won't replace Callsheet for me because it won't have actor ages and heights, but this is a welcomed enhancement that I could see being added to to any video played in the TV app.

watchOS

• Double Tap for Third-Party Apps
• Live Activities
• Distance and Route Maps for More Workouts
• Vitals App
• Custom Ringtones and Text Tones — Finally.

macOS

• iPhone Mirroring — Wow. Apple's Continuity continues to be the gift that keeps on giving! I totally expect this to come to Apple Vision Pro but I'm also curious to see if this will eventually evolve into something like Samsung DeX.
• iOS Notifications on Mac — Fuck yeah. Back in 2011, I wrote about how redundant push notifications will be a problem. Apple went a different route than I proposed but I'm here for it!
• Window Snapping — Finally. Not sure if I will personally use this but this is a welcomed copy from Windows.
• Keep Downloaded for iCloud Files — Big quality-of-life improvement for managing offline assets that are hosted on iCloud Drive.

Apple Intelligence

• Onscreen Awareness and Personal Context — Because the system has an understanding of what you're looking at, what your tendencies are, and what actions your apps can do, Siri can take action inside and across apps. Fucking amazing and I'm dying to play around with it.
• ChatGPT Integration — It's here! It's free! And it's private. (Love how it'll seamless upgrade to ChatGPT Pro too.)
• Priority Notifications — Curious to see how this pans out, especially with the auto-summaries.
• Reduce Interruptions Focus Mode
• Clean Up in Photos — Finally we'll be able to remove people and things from our photos in the native Photos app.
• Smarter Search in Photos — I just want to be able to say, "Siri, show me everything shot on this day."
• "Siri, how do I…?" — Huge for my parents.
• Genmoji — This honestly might replace GIF reactions for me in my daily interactions. Can't wait!

Overall, this would have to be one of the best WWDCs I've seen. It had an excellent variety of quality-of-life improvements, nice catch-ups from Android, meeting AI expectations, and a few mind-blowing announcements. Can't wait to get my hands on the public betas!

Here's a quick rundown of my favorite updates announced at Apple's annual WWDC.

tvOS

• Xbox One and PS4 controller support for games

watchOS 6

• watchOS App Store => Apple Watch Independence!
• streaming support
• menstrual cycle tracking

iOS 13

• system-wide dark mode
• built-in swipe typing
• Maps: favorites, collections, street view
• up to 30% faster Face ID
• up to 2x faster app launch
• Sign in with Apple button — privacy-focused version of "Sign in with Facebook/Twitter/Google"
• HomeKit Secure Video — store videos from HomeKit cameras to iCloud
• HomeKit support for routers
• iMessage Profiles — add your own display name, avatar. Only people in your contacts can see this.
• Memoji — makeup, hats, piercings
• Memoji stickers — automatically turns your memoji into a sticker pack with all standard emoji facial expressions
• Video editing in Photos app
• dual iCloud accounts per device (for personal and work)
• smaller volume HUD — changing volume doesn't bring the stupid dialog in the middle of the screen

Siri

• auto-announce messages on AirPods
• audio sharing — play your music on a friend's AirPods
• Music HandOff to HomePod — music on your iPhone will continue on your HomePod with a physical tap
• live radio stations on HomePod
• Siri Shortcut Events — automatically run shortcuts based on an event
• Voice ID for HomePod => multi-user support

iPadOS 13

• multiple windows for the same app
• easily switching Slide Over apps
• App Exposé
• Safari: download manager
• third-party font management
• built in Zip/Unzip files
• three-finger swipe gesture to undo/redo
• mouse support (hidden as accessibility option)
• iCloud Folder Sharing
• network drives support in Files app
• USB/SD drives support in Files app

Mac Pro

• starts at $5,999
• $4,999 - $5,999 for 32" monitor
• $999 for monitor stand (LOL)

macOS Catalina

• Project Catalyst and SwiftUI— an easy way for developers to make apps for ALL of Apple's platforms! The future of the Apple ecosystem.
• SideCar — wirelessly use your iPad as a second monitor
• full voice control
• Find My - combines Find My iPhone, Find My Friends into one app. WORKS WITH OFFLINE DEVICES
• Activation Lock — like iOS, if someone steals your MacBook, you can lock it down so they cannot format your computer.
• approve with Apple Watch — like Unlock with Apple Watch but for EVERYTHING

ARKit 3

• people inclusion — people are detected in real-time and AR elements can visibly work around people
• motion capture for people

As reported back in December by Mark Gurman in Bloomberg:

Starting as early as next year, software developers will be able to design a single application that works with a touchscreen or mouse and trackpad depending on whether it’s running on the iPhone and iPad operating system or on Mac hardware…

Developers currently must design two different apps -- one for iOS, the operating system of Apple’s mobile devices, and one for macOS, the system that runs Macs. That’s a lot more work. What’s more, Apple customers have long complained that some Mac apps get short shrift…With a single app for all machines, Mac, iPad and iPhone users will get new features and updates at the same time…

Apple is developing the strategy as part of the next major iOS and macOS updates…Codenamed “Marzipan,” the secret project is planned as a multiyear effort that will start rolling out as early as next year…

Simply put, Apple is taking key foundations of iOS and putting it in macOS in an effort to inject the abundance of iOS developer enthusiasm from mobile into desktop.

As I've talked before, this comes at a really interesting time for desktop computers:

• iOS apps are still a booming business
• Android apps continue to grow in revenue
• cross-platform desktop apps based on Electron are growing popular
• Progressive Web Apps are a rising technology that will bring the massive reach of native-like web apps to all devices

These trends all point to one big question — what is the future of desktop apps?

Services like Facebook, Twitter, Instagram, and Amazon will never need the full-blown robustness of a native Mac/Windows desktop app; they'll be able to get by just fine as Progressive Web Apps, especially since Chrome OS and Windows are pushing so hard for the technology.

But what happens to Facebook, Twitter, Instagram, and Amazon when they get much better user engagement when they port their iOS apps to Mac?

Desktop apps will always be more powerful than mobile apps. And mobile apps will always be more powerful than Web Apps. But maybe, if this Marzipan thing gains traction, the future of mobile & desktop ends up being three main platforms — Marzipan for iOS & Mac, Android for non-iPhones, and then Progressive Web App for literally everything else.

So I'm a sentimentalist and a digital hoarder who is particularly OCD about original photos & videos.

Last year, I wrote an email to Apple's SVP of Software to point out a common, real-world problem that comes up every time a group of friends get together:

Hey Craig [Federighi],

The iPhone is the best and most popular camera on the planet…yet sharing photos & videos in full quality with friends & family is so hard! I wish sharing full-quality photos/videos was as easy as sending stickers to a group chat in iMessage.

I was recently on a trip to Hawaii with a dozen of my childhood friends. 10 of us had iPhones and 2 had Samsungs. We’re all taking photos, with plenty of candid shots, great group shots, and just living the moment. But when we wanted to share each other's best photos on Facebook, we were faced with several options that all have downsides:

• Send over iMessage — but then everyone receives a downscaled version of each photo and video.

• Send via AirDrop — (my Samsung friends were getting a jealous about this, lol) but AirDrop assumes all phones are unlocked and within bluetooth range, which isn't always the case. It forces us to take ourselves out of the moment just to make sure all our iPhones are unlocked and ready to accept the AirDrop.

• Share folders via Dropbox or Google Photos — but not everyone has an account on either of those.

• Use iCloud Photo Sharing — but not everyone has that enabled. And even if I send them a link to the album, photos/videos are downscaled to lower quality.

I take pride in the quality of photos I take with my iPhone! It’s a shame though that with all these priceless group photos on our phones, we either have to take ourselves out of the moment to coordinate an AirDrop with everyone, or we have to settle with downscaled versions of photos that are meant to last a lifetime.

I feel that of all the companies in the world, Apple is the only company that could solve this elegantly. Hope you take this into consideration!

-Mel

He read my email that day, but he never emailed me back…

Fast forward eight months later.

On Monday, at Apple's annual developer conference, Craig Federighi announced an awesome new photo sharing feature for the upcoming iOS 12 (skip to 0:30:21):

I'd like to think this feature was created 100% because of me — that way I can justify the celebratory chocolate chip cookie dough cinnamon bun I ate before bed — but even it wasn't, I'm just glad all you guys will be able to use this feature coming this fall.

So buy the best smartphone camera you can afford, take lots and lots of photos, and always, always, always keep the full-quality originals. Because the reality is, you can NEVER go back in time to take better photos of your loved ones.

The rumor of Apple converging iOS and macOS is starting to make a whole lot of sense.

Read More

Hey Craig [Federighi],

The iPhone is the best and most popular camera on the planet…yet sharing photos & videos in full quality with friends & family is so hard! I wish sharing full-quality photos/videos was as easy as sending stickers to a group chat in iMessage.

I was recently on a trip to Hawaii with a dozen of my childhood friends. 10 of us had iPhones and 2 had Samsungs. We’re all taking photos, with plenty of candid shots, great group shots, and just living the moment. But when we wanted to share each other's best photos on Facebook, we were faced with several options that all have downsides:

• Send over iMessage — but then everyone receives a downscaled version of each photo and video.

• Send via AirDrop — (my Samsung friends were getting a jealous about this, lol) but AirDrop assumes all phones are unlocked and within bluetooth range, which isn't always the case. It forces us to take ourselves out of the moment just to make sure all our iPhones are unlocked and ready to accept the AirDrop.

• Share folders via Dropbox or Google Photos — but not everyone has an account on either of those.

• Use iCloud Photo Sharing — but not everyone has that enabled. And even if I send them a link to the album, photos/videos are downscaled to lower quality.

I take pride in the quality of photos I take with my iPhone! It’s a shame though that with all these priceless group photos on our phones, we either have to take ourselves out of the moment to coordinate an AirDrop with everyone, or we have to settle with downscaled versions of photos that are meant to last a lifetime.

I feel that of all the companies in the world, Apple is the only company that could solve this elegantly. Hope you take this into consideration!

-Mel