Sometimes drawing a quick sketch is easier than using text to describe a particular product you have in mind. Researchers at Queen Mary University of London created a tool that recognizes hand-drawn sketches on a smartphone or tablet and uses them to search for products online.
Using two Tesla K80 GPUs and the cuDNN-accelerated Caffe deep learning framework to train their convolutional neural network, their new “Sketch” recognition system achieved 97.94% accuracy in matching shoes and chairs.
“Sketch is a very flexible tool,” co-developer Yi-Zhe Song said. “For example, you might see a pair of shoes that you like, but not approve of every detail of them — such as the buckle or the heel. In that case, you can draw the shoe you would like to see — and then let the computer search for the closest possible match.”
The researchers are talking with online retailers and hope their technology will be used in the online marketplace within six months.
Read more >>
Using Sketches to Search for Products Online
Jul 13, 2016
Discuss (0)
AI-Generated Summary
- Researchers at Queen Mary University of London developed a sketch recognition system that matches hand-drawn sketches to products online.
- The system achieved 97.94% accuracy in matching shoes and chairs using a convolutional neural network trained on two Tesla K80 GPUs with the cuDNN-accelerated Caffe deep learning framework.
- Co-developer Yi-Zhe Song noted that users can draw specific product variations to find the closest match when existing products do not meet all preferences.
- The researchers are discussing the technology with online retailers and hope it will be used in online marketplaces within six months.
Next Step
- Read the Digital Trends article for additional details on the sketch recognition system.
Powered by NVIDIA Nemotron. AI-generated content may summarize information incompletely. Verify important information. Learn more
About the Authors
