- Automatic Opt-In: Apple enabled Enhanced Visual Search by default across iOS and macOS devices, analyzing photos for landmarks without users’ explicit consent, raising privacy concerns.
- Homomorphic Encryption: The feature uses advanced encryption to analyze photo data privately, ensuring neither Apple nor its partners can access the image contents, as claimed.
- Transparency Issues: Critics argue Apple’s lack of upfront communication and opt-in mechanisms undermines user trust, despite its privacy-focused technology.
Last year, Apple introduced a feature called Enhanced Visual Search, which identifies landmarks and points of interest in photos stored in its Photos app. This capability was enabled by default across iOS and macOS devices without users’ explicit consent, sparking privacy concerns as customers recently began noticing the feature. Enhanced Visual Search reportedly launched alongside iOS 18.1 and macOS 15.1 in late October 2024, but Apple’s public documentation explaining the technology surfaced only weeks later, further fueling dissatisfaction over the lack of upfront transparency.
The technology leverages a local machine-learning model to analyze images for regions of interest that may depict landmarks. If a likely match is found, the model creates a vector embedding—a numerical representation of the identified portion. Using homomorphic encryption, this embedding is scrambled, allowing remote servers to perform computations on it without accessing the underlying image data. Apple claims this process, combined with differential privacy and an OHTTP relay, ensures neither the company nor its partners can view users’ photos or associated metadata.
To optimize performance and reduce costs, Apple adjusted the embedding precision to balance computational demands with accuracy. The encrypted embeddings are sent to Apple servers, where further computations are performed to match landmarks from a global index. The identified landmark is then returned to the user’s device, still encrypted, and only the device can decrypt and display the results. While Apple assures users this process is private, skepticism remains, particularly due to the automatic opt-in.
Critics argue that Apple’s approach undermines its privacy-first principles. Enhanced Visual Search processes photos locally and uploads metadata even if users have opted out of iCloud uploads. This lack of an opt-in mechanism has drawn comparisons to Apple’s earlier, controversial CSAM scanning plan. Some believe the current feature may compromise privacy more broadly because it applies to all photos, not just those flagged under specific conditions. The late discovery of this feature by users further erodes trust, as many feel blindsided by its default activation.
While Apple insists the encryption methods used ensure user privacy, the broader issue lies in its unilateral deployment of the feature without adequate user awareness or choice. Critics contend that meaningful privacy preservation requires informed consent, not just theoretical safeguards. Despite Apple’s technical assurances, the community continues to push for clearer communication and the ability to opt-in rather than being automatically included in such initiatives.
