iOS 15, the next major update of the operating system, is available today, and it brings with it a lot of exciting and useful features, particularly for photographers. Let’s dive in and see what you can expect when you upgrade.
Mobile phones are more capable than ever, and they have become legitimate tools for professional photographers and filmmakers. Part of this has been the rise of computational photography. For example, traditionally, the small sensors of phone cameras have been a serious hindrance to low-light shots. However, after the introduction of Night Mode, which uses a combination of long exposures and machine learning to improve sharpness, noise, exposure, and more, the issue has been mitigated in a lot of situations. I have been genuinely impressed by it, and it has made it possible for me to take good shots in far more situations than ever before. iOS 15 brings with it a range of new features that will improve both real-time interaction and exploration of your photo collections. It’s exciting to see features that not only improve photography and video work, but also turn the camera into a serious production tool.
Live Text
Live Text is essentially real-time OCR (optical character recognition). This allows you to use the camera (or examine photos already taken) to recognize text and take actions using it. For example, say you are out for a walk and see a house for sale that you are interested in. Using Live Text, you can quickly copy all the info from the sign, send it to your partner, email or call the realtor, and more. If you are on a trip in a foreign country, you can translate signs in real-time. What is especially exciting is that the system can recognize handwriting, not just typed text, making it easy to quickly digitize and pull information from a variety of sources.
Visual Lookup
Visual Lookup, like Live Text, is a feature that turns the camera into a useful informational tool. When using the Photos app, you will sometimes see a star attached to the information button (which contains photo metadata) in the bottom toolbar. This indicates that Visual Lookup recognizes an object or scene in the photo and can offer more information on it. For example, you can quickly learn about pieces of art or landmarks, look up books, identify plants or pet breeds, and more. As someone who is obsessed with dogs, this is a ton of fun to use.
Spotlight
Spotlight is iOS’s built-in search tool, and iOS 15 is expanding its capabilities with a focus on images. Users can now search for images on the web or from their own photo albums, even from the lock screen. At this point, after many years with a phone as my primary camera for capturing life’s moments, I have literally tens of thousands of photos, and even with my favorites album and topical albums, it can be tough to find what I am looking for.
Spotlight’s updated features alleviate that problem by adding lots of image search features. Users can now search for natural terms like “dog photos” and get results from their own albums or the web. You can also search for text in photos, objects, people, locations, or even by scenes (such as waterfalls). It is a powerful search implementation that makes it easy to quickly pull up whatever photos you want without any burden to keep things organized yourself, which is especially useful given how many photos most of us have on our phones nowadays.
Memories
Memories is a neat feature that lets you take a look back at past highlights. Not only does iOS pull together photos from previous years on a given date, it compiles them into a watchable clip with a soundtrack.
The new update brings a lot of new songs to the mix, and Apple Music subscribers can also add any of the service’s tens of millions of songs. The song suggestions are personalized to each user’s tastes, the content of the photos and videos, and expert recommendations. The feature takes into account songs that were popular at the time and location of the relevant photos and videos, songs from the artist contained in a concert memory, and more. It’s the kind of contextual awareness that can really ramp up the nostalgia factor of memories. One of my favorite things to do when I am laying in bed in the morning is watching photo and video memories, and having them packaged in such a convenient and well-produced form is awesome.
Further Memories additions include deeper customization of length, songs, and look. The system does a great job of applying adjustments to ensure a consistent aesthetic between photos and videos that make up a given memory, helping to create a more cinematic, consistent, and immersive experience.
Messages
Reading and digesting multiple photos in messages is improved quite a bit now too. Multiples photos now show as collages and stacks that can be easily swiped through. Tapping shows the collection as a grid and allows the user to quickly reply or save the collection. Meanwhile, in the Photos app, users will see a new Shared with You section that collects all photos sent in messages. The library pays attention to photos the user was there for and gives them extra priority in Memories and Featured Photos. The Shared with You section also shows who sent the photos and lets you reply right from the app.
iPhone 13
Along with all the improvements mentioned above, iPhone 13 users get access to some other exciting software features along with the camera hardware improvements on the new models.
Cinematic Mode
Cinematic mode leverages computational photography abilities to create shallow depth of field in videos and to follow the faces in a frame and automatically shift focus to the dominant face at any given time, even if the subjects are moving. You can easily take manual control to focus on any subject you would like or to lock focus on a specific person. One of the neatest features of Cinematic mode is that because the phone records and stores a depth map at the time of capture, you can change focus and depth of field in post, just like Portrait Mode.
ProRes Video
iPhone 13 Pro users also get access to ProRes video, useful for professional filmmakers who want the best possible quality in a common format.
Smart HDR 4 and Photographic Styles
Smart HDR 4 adds new and improved abilities, like better color and contrast, and the ability to independently adjust lighting and toning on different faces in an image. In addition, Photographic Styles allows you to vary basic parameters like contrast and white balance in real-time while composing images without affecting things like skin tones.
Free to Download
Whether you own the new iPhone 13 or an older model, there are a lot of neat new features in iOS 15 that vastly expand the capabilities of your iPhone’s cameras and Photos app. iOS 15 is free to download and is available today.