Google’s latest visual search tool, previously exclusive to Samsung Galaxy S24 series and Pixel 8 series users, is now making its way to iPhone users. While the feature comes with some limitations, it marks a significant expansion of Google’s AI-powered capabilities on iOS devices.
Announced by Google Lens Design Manager Minsang Choi in a post on X, the new feature, named ‘Search your screenshot,’ leverages Google Lens technology to enable users to perform custom actions through the Shortcuts app. With this feature, users can capture a screenshot and initiate a visual search using Google Lens directly from their iPhones.
To access the feature, iPhone users need to ensure their devices are running iOS 13 or later and have the latest version of the Google app installed. The Shortcut can be accessed directly through a link shared by Choi or set up manually by configuring the ‘Take screenshot’ and ‘Search Image With Lens’ actions.
Unlike Android’s Circle to Search feature, which can be accessed by holding the navigation bar, iPhone users must map the Shortcut to the Action button on iPhone 15 Pro or iPhone 15 Pro Max models. This can be done by setting up the Shortcut to launch with a double tap or triple tap gesture through the Settings app.
While Google’s new Shortcut offers a convenient way to search for information on iPhones, it does come with some limitations compared to its Android counterpart. For instance, it lacks the ability to draw a circle or highlight specific parts of the screen for lookup. Nevertheless, it provides iPhone users with a streamlined way to perform visual searches with just a few taps, enhancing the overall user experience on iOS devices.
FAQ:
Q: What is Google’s new visual search tool?
A: Google has introduced a new visual search tool that allows users to search for information using images or screenshots. This feature is called “Search your screenshot” on iOS and “Circle to Search” on Android.
Q: Which devices can use this new visual search tool?
A: The feature initially debuted on the Samsung Galaxy S24 series and Google’s Pixel 8 series. It is now rolling out to more users, including iPhone users.
Q: How can iPhone users access this feature?
A: iPhone users can access the “Search your screenshot” feature through the Google app and the Shortcuts app. They need to ensure their device is running iOS 13 or later and have the latest version of the Google app installed.
Q: How do I set up the “Search your screenshot” Shortcut on my iPhone?
A: You can either tap the link shared by Google Lens Design Manager Minsang Choi on X (formerly Twitter) to access the Shortcut directly, or manually set it up by selecting “Take screenshot” followed by “Search Image With Lens” in the Shortcuts app.
Q: Can I launch the Shortcut with a gesture on my iPhone?
A: Yes, you can map the Shortcut to the Action button on the iPhone 15 Pro or iPhone 15 Pro Max models. Alternatively, you can set up the Shortcut to launch with a double tap or triple tap gesture by navigating to Settings > Accessibility > Touch > Back Tap.
Q: Is the “Search your screenshot” feature on iOS as feature-rich as the “Circle to Search” feature on Android?
A: No, the iOS version has some limitations compared to the Android version. While you can pass your screenshot to Google Lens for visual analysis, you cannot draw a circle or highlight a specific part of the screen for lookup on the iOS version.
Q: What are the benefits of using this visual search tool?
A: This feature provides a convenient way to quickly search for information related to images or screenshots on your device with just a few taps, without having to manually describe or type in the details.
