• Uncategorised

iOS 16’s photo background remover is unbelievably good

Apple rolled out a bunch of features with iOS 16. These include improvements in system apps like Messages, Maps, and Safari, a customizable lock screen, and more. But one of the most entertaining features is the ability to automatically remove the background from images — giving you a Photoshop-like edit with just a couple of taps.

It’s an intriguing feature that combines years of AI research and development. You can lift the subject from the background of an image by simply holding it and pasting it in Messages, Telegram, Safari, etc. I tried the feature on a wide range of photos.

Some were captured by a DSLR, others with a smartphone camera with and without portrait mode. I also tested images of objects, pets, and many other pictures in challenging environments. After trying the feature on 10 different images, the results speak for themselves.

Objects

Prakhar Khanna/Digital Trends

The first image is of the Sony WF-1000XM4 earbuds.

It was taken on a DSLR, which highlighted the earbuds and their case while blurring the packaging. I tapped and held on to the packaging and the system was smart enough to recognize the subject in focus. The AI precisely removed the background with clear edges where there was sufficient light but struggled with the shadows of the case and earbuds.

iOS 16's photo background remover is unbelievably goodPrakhar Khanna/Digital Trends

I chose this second image because I captured it with the portrait mode effect on the iPhone — giving an artistic look to the picture. iOS 16 smartly understood the subject and picked up the phone with my hand.

While I would have liked to have an option to pick just the phone instead of also saving my hand, it did a fine job with the edges. No complaints here.

Pets

iOS 16's photo background remover is unbelievably goodJoe Maring/Digital Trends

Our Section Editor, Joe Maring, sent me this image of his dog in focus with the background far away. I tapped on the dog to lift him off the background, and it worked on the first try.

It is worth noting that alongside the edges of the dog, the edges of his belt were discretely moved from the background. Overall, an impressive job.

iOS 16's photo background remover is unbelievably goodPrakhar Khanna/Digital Trends

While the AI did a good job in well-lit scenarios, Maring and I pushed the limits with this image of his cat sitting on the side of the window. The image is challenging for two reasons.

First, it’s indoors, so there is not enough light in some areas around the cat. Secondly, the sunlight falls on the cat’s head, which could’ve confused iOS 16’s guesswork. But it didn’t.

Apple’s new feature moved the cat from the background with precise edges even in low-lit areas like his tail.

Prakhar Khanna/Digital Trends

Next up is another photo of a cat indoors, but this time with a person petting it. We were worried if iOS 16 would pick the objects in the background alongside the subject, but instead, it picked the human hand. It would have been much better if we could get an option to erase parts of the image we didn’t want – something we hope Apple is working on.

The end result certainly isn’t bad, but it’s an example that there’s still room for improvement.

People

iOS 16's photo background remover is unbelievably goodPrakhar Khanna/Digital Trends

I noticed that it was far easier for iOS 16 to remove the subject from a background when the image was captured in portrait mode. For instance, the above photo was taken in portrait mode on the iPhone 12. It did a decent job in maintaining the edges – even the hair.

But, for some reason, iOS 16 created a blooming effect at my bottom. It could be because the portrait mode might have blurred that area, but it’s a strange anomaly nonetheless.

Prakhar Khanna/Digital Trends

Here, iOS 16 did a decent job in removing the face reflection of a person in the background. But if you are sitting with someone, and both of you are on the same axis, it’ll pick both of you.

For instance, I cropped myself in this image, but the arm of the person sitting beside me couldn’t be removed even when I tapped on myself to lift the subject from the background. The above image wasn’t taken in portrait mode, but iOS 16 still did a decent job at the edges.

iOS 16's photo background remover is unbelievably goodPrakhar Khanna/Digital Trends

This image was captured on the Huawei P50 Pro, which has one of the best portrait modes on a smartphone. But it got tricked in the area near my glasses and hair. iOS 16 went with the portrait mode data to cut out the edges very clearly but got deceived in the same areas where the camera didn’t do well.

The edges around the hair could’ve been much better.

Prakhar Khanna/Digital Trends

By contrast, this image was taken on a DSLR, and iOS 16 was smart enough to retain the laptop alongside me. It performed much better with the hair than in the previous image, cutting around the edges without picking up unwanted background.

Prakhar Khanna/Digital Trends

One area where the iOS 16’s background remover struggles is when there is a crowd. The photo above is a great example.

It was clicked on the iPhone 12 during a concert in a low-lit environment. While it did a decent job near the face, it couldn’t distinguish between the subject and the various hands in the crowd. Again, it would be nice of Apple to give us the option to erase unwanted objects to fix these little mistakes.

But there’s only so much you can do with a tap and hold, thus making us miss 3D Touch even more.

Off to an incredible start

Overall, iOS 16’s background remover does a brilliant job in well-lit scenarios. It works well on pets and objects to clear out the background from the edges, but it seems like Apple is mostly relying on the portrait mode data to lift the subject from the background. As a result, when an image isn’t taken in portrait mode  — or something is blocking the subject — iOS 16 gets confused.

While these are valid complaints, it’s important to take all of this in context. This is the first available version of Apple’s background remover in the first Developer Beta of iOS 16. With iOS 16 not expected to officially launch until September or October, Apple has months ahead to tweak and refine the feature ahead of its public debut.

Considering how good the feature already is at such an early stage, it’s exciting to think where it’ll be in a few months’ time.

Editors’ Recommendations

avery-brand-and-print listed on couponmatrix.ukcountry-attire listed on couponmatrix.ukfriction-free-shaving listed on couponmatrix.uknational-holidays listed on couponmatrix.ukparrot listed on couponmatrix.uksds-london listed on couponmatrix.uk
avery-brand-and-print listed on couponmatrix.ukCarrying on the legacy of Stan Avery, creator of the label, Avery We Print strives to provide labels and stickers in all shapes and sizes to accommodate the multitude of items in modern life that need them. With an Avery We Print promo code you could get all the labels you need for your business endeavours at a stellar discount, including varieties for jars, bags, boxes and other packaging – all available in a great assortment of materials and colours.
country-attire listed on couponmatrix.ukGreat Britain has a long tradition of country living and with it comes a culture and style that is the envy of the world. Take home the essence of this style with Country Attire, who offer the best of British – both contemporary and traditional. Choose from handcrafted heritage pieces and modern designs from top British brands including Barbour, Hunter, Vivienne Westwood and Trickers. It’s not just British brands they stock, you’ll find continental and global brands here too like Ugg, Ray-Ban and Hugo Boss. Shop using a Country Attire discount code and enjoy savings across their store on all of the best of British (and elsewhere).
friction-free-shaving listed on couponmatrix.ukThose who want to take all the stress out of their hair maintenance routine will love what’s on offer at Friction-Free Shaving, more commonly known as FFS. A monthly or bimonthly-based subscription service that puts all your grooming essentials in convenient, compact packages, you can use a FFS discount code to cut the cost of your next clean shave. With an array of creams, gels and other beauty products to back-up their cutting-edge razors, you know your skin will get the pampering it deserves with FFS. If you’re a fan of the FFS system, you can start racking up some easy rewards for yourself by signing up to the company loyalty scheme. Besides offering free shipping on subscription orders, you’ll gain additional perks as you raise through the loyalty ranks, including VIP offers, bonus points and early access to new products and sales. Points can be earned through a variety of methods besides spending money, such as following on social media, leaving reviews or signing up to receive FFS texts. When nothing but the smoothest, cleanest shave will do, you’ll do not better than FFS premium razor blades. Versatile and designed with a Vitamin E strip to prevent any razor rashes from forming, you can keep the cost of these expert refills to a minimum with the latest FFS voucher codes from Groupon. As a vegan-friendly product, FFS razor blades are both effective grooming tools whilst also being suitable for customers of all lifestyles.
national-holidays listed on couponmatrix.ukFor a weekend away at the British seaside, a cheap city break or a European escape, National Holidays can get you there for the best possible price. Book transport and accommodation, and one of the coaches will pick you up from your nearest pick-up point when the day of departure arrives. It’s the easiest way to travel, and you can use a National Holidays discount code for affordable and unforgettable holidays across Britain, Ireland and Europe. You can even book coach holidays to see the F1 Grand Prix, Cirque du Soleil or Disneyland Paris!
parrot listed on couponmatrix.ukAlways leading the way in innovative new forms of technology, Parrot have driven the way into and past the millennia with voice-driven and handheld machinery. Now specialists in the field of portable drones, customers can enjoy this phenomenally fun tech for far less with a Parrot promo code and hit the skies without rinsing the bank balance dry. There’s also an array of handy accessories to boost your devices’ performance and keep it safe and secure.
sds-london listed on couponmatrix.ukSDS London is a luxury fashion brand that offers voucher codes for its customers. The brand was established in 2013 by Sarah-Jane Darlington, who has worked as a fashion designer for over 10 years. The brand offers free shipping on orders over £100, and customers can enjoy discounts of up to 50% off with SDS London voucher codes. Sarah-Jane's designs are known for their elegance and sophistication, and the brand has been featured in Vogue, Elle, and Harper's Bazaar. SDS London's collections include apparel, accessories, and home decor. At Groupon, we believe that everyone deserves to enjoy the luxury of SDS London fixtures at a fraction of the cost. That's why we work hard to find discount codes and vouchers for our customers to use. We want you to be able to shop for your favourite SDS London fittings without breaking the bank, and we'll continue to update our selection of codes so that you can always save on your purchases. Thanks for choosing Groupon! SDS London's Pendant Light selection is a top-performing product that is sure to add a touch of luxury to your home. The light combines a sleek design with a matte finish for that timeless touch. Make the most of the latest SDS London discount code and enjoy this luxury lighting for less. This fixture is the perfect addition to any room, and it will instantly elevate your space, so make the smart choice and opt to illuminate with SDS London!