How Deep Fusion works?

Can someone explain to me how Deep Fusion on iOS13 works? Does it function in the background and is there any indication that the app is active or inactive? How can I know whether it was used to create a photo (like how HDR tag works)?

Hi @Phillips,
Deep Fusion happens automatically and won’t be noticeable like Night Mode, it turns out that it won’t be enabled if you have the Capture Outside of Frame setting turned on So if you have Capture Outside of Frame turned on, Deep Fusion will not be available, and vice versa.
Unlike Night Mode, Deep Fusion will happen automatically and we won’t even notice it. However, it will only activate in certain situations.

With the Wide (Normal) lens, Deep Fusion kicks in at just above the 10 lux floor that triggers Night Mode. Whether Night Mode or Deep Fusion activates depends on the lighting source for the current scene. On the Telephoto camera, Deep Fusion will be active in pretty much everything except the brightest situations, as that is when the Smart HDR goes into effect due to the abundance of highlights.

Essentially, Deep Fusion has the camera shoot a short frame at a negative EV value. This results in a darker image than you would normally like, but it just pulls sharpness from this frame. It also shoots three regular EV0 images and then a long EV+ frame, aligns everything together, and blends all of the images into one.

You end up with two 12MP images that are combined together in a single 24MP photo. The process to do this uses four separate neural networks, which account for all of the noise characteristics of the camera sensors, as well as the photo subject matter.

The machine learning process looks at every individual pixel before combining, and it only takes about one second to process everything. Deep Fusion will happen in the background, and you’ll never really notice it until you see the images it produces.

What is Capture Outside of Frame?

Capture Outside of Frame is a setting available on iPhone 11 and iPhone 11 Pro that lets you capture content outside of the frame on the viewfinder. This captured content only appears when you make edits to the photo, such as cropping, straightening, rotating, and adjusting perspective. For QuickTake video capture, it helps improve the composition.

So why won’t Deep Fusion work with Capture Outside of Frame?

The Capture Outside of Frame feature works by utilizing the Ultra Wide camera to capture the rest of the scene outside of the frame. However, Deep Fusion does not work with the Ultra Wide camera due to the lack of focus pixels and optical image stabilization (this is also why Night Mode does not work with the Ultra Wide lens).

So if you want to compare how effective Deep Fusion is, take a picture with Deep Fusion on, and then turn on Capture Outside of Frame and take the same photo.

Hi Phillips

Please go through the information on the page, explaining all your questions much better. I hope you find it helpful.

hey there!
in this link you will find a lot of information about it