Case Study

Client Need

The client wanted customers to have the ability to visually search across inventory in their three digital marketplaces by capturing an image real-time or uploading an image of a desired product. The visual search engine should present ranked results displayed visually and semantically based on certain criteria based on machine learning intelligence.

Product Challenges

Using Google Cloud Vision API to detect product objects in images, the biggest challenge was training custom machine learning models to understand, classify, and match labels in the client’s product dataset. Another challenge was determining the primary product when more than one product object was present in an image.

The Xperity Solution

Xperity partnered with Plakkr to deliver a cloud-based, visual search engine for customers to more easily find their products. The visual search technology was integrated into a mobile app to enable shoppers to find products simply by taking a photo. The visual search engine uses AI & ML to analyze objects in an image and finds results that relate to visual cues with information on the product (or very similar ones), cost options and how to purchase it. The technology provides convenience, saves time, and provides product search options not previously available.