Spatial Reframing builds on Apple's deep investment in spatial computing, specifically technology developed for Apple Vision Pro, to understand where subjects sit in 3D space relative to their surroundings .
Once you activate the tool in the edit mode, you can touch and drag within a photo to find a new perspective you prefer. As you shift the viewpoint, the image effectively pans as if it were a 3D scene . This isn’t limited to photos taken on spatial-capable cameras; the feature works on any image in your library, including photos shot on older or third-party cameras
.
Because the new viewpoint naturally reveals "gaps" that were not present in the original flat image, Apple's generative AI steps in. Apple emphasized during its presentation that the model, which runs on a combination of on-device processing and its Private Cloud Compute (PCC) infrastructure, "only generates new content to fill in the gaps where the perspective has been shifted" .
Crucially, this newly generated infill is not just painted in as a sharp artificial texture. To help the recomposed image look authentic rather than unnaturally enhanced, Apple applies a natural depth-of-field blur to the AI-generated areas, mimicking how a lens might render those parts of the scene . The original captured moment is always preserved, and edits are non-destructive
.
The technical challenge of shifting a photo's perspective is significant, and Apple uses a tiered approach to protect user privacy during processing. Simpler perspective adjustments run entirely on-device using Apple's Foundation Models .
For more computationally complex reframes, the request is offloaded to Private Cloud Compute. In Apple's architecture, data processed on PCC servers is ephemeral; it is only used for the duration of the compute task and is "vaporized" afterward without being stored or accessible to anyone, including Apple .
Every photo adjusted with an Apple Intelligence tool—whether a spatial reframing, an expanded canvas, or a cleaned-up object removal—automatically receives an invisible SynthID watermark . This digital marker, developed using Google DeepMind technology and hidden imperceptibly within the image, is designed to identify photos that have been modified with generative AI without altering the visual quality of the shot
.
Spatial Reframing is the headliner, but it is part of a trio of upgrades to the Photos app on iOS 27, iPadOS 27, and macOS 27 (codenamed "Golden Gate"). The other two tools are :
The first developer betas of iOS 27, iPadOS 27, and macOS 27 were released immediately following the June 8, 2026 keynote . The features will ship to the public this fall, expected alongside the next iPhone lineup
. Access to the new Apple Intelligence editing suite requires an iPhone 16 or later, or an iPad or Mac with Apple silicon
.
Comments
0 comments