Pinterest is bringing search to the real world.
On Wednesday, the social-network-slash-search-engine introduced Lens, a mobile app that uses the phone’s camera to recognize physical objects and pull up related items from Pinterest. The app appears to be Pinterest’s version of Google’s neglected Goggles app. Google’s app is no longer available in Apple’s App Store; it is still available on Android but hasn’t been updated since May 2014. Bing also has the feature built into its app, added last year.
Based on some GIFs provided by Pinterest, Lens focuses on objects appearing within a circular window — likely to reduce the signal-to-noise ratio — and then presents tags that it associates with the object(s) as well as relevant pins from its platform. Pinterest had teased the product in June 2016 when it announced enhancements to its visual search tool.
Pinterest’s Lens app is still in testing but will be available to iPhone and Android owners in the US sometime soon. While Pinterest claims the company’s technology is able to recognize more than 1 billion objects, for now, Lens “works best for finding home decor ideas, things to wear and food to eat,” according to a company blog post.
As Lens extends Pinterest’s search chops to the real world, the company is also extending search beyond the query bar on its own platform.
Pinterest’s new Shop the Look feature turns items appearing in pins into products people can buy. Relevant products will be highlighted with a blue circle that people can tap to see related products that are available for purchase, either on Pinterest or through a brand’s own site. CB2, Macy’s, Neiman Marcus, Target and Wayfair are among the first brands to market their wares this way on Pinterest; Pinterest is sourcing their products through Curalate, Olapic, Project September, Refinery29 and ShopStyle. Pinterest’s Shop the Look feature is similar to a test Instagram began last year.
Another new feature called Instant Ideas will append a white circle to pins in people’s home feeds that, when tapped, will insert related pins into the feed.