BT

Your opinion matters! Please fill in the InfoQ Survey!

Enhancing Google Maps with Deep Learning and Street View

| by Srini Penchikala Follow 17 Followers on Jun 13, 2017. Estimated reading time: 2 minutes |

A note to our readers: As per your request we have developed a set of features that allow you to reduce the noise, while not losing sight of anything that is important. Get email and web notifications by choosing the topics you are interested in.

Google's Ground Truth team recently announced a new deep learning model for the automatic extraction of information from geo-located image files to improve Google Maps. This neural network model achieved a higher accuracy in processing the challenging French Street Name Signs (FSNS) dataset. Julian Ibarz (Google Brain Team) and Sujoy Banerjee (Ground Truth Team) wrote on Google Research Blog website about this TensorFlow model used for solving real-world image text extraction problems.

Google Maps software is used for directions, real-time traffic information and information on businesses, however to provide a better experience to its over one billion users, the information has to reflect the changing world. Street View cars have collected 80 billion images to date and it's impossible to manually analyze this very large image data set to find new or updated information for Google Maps. So one of the goals for the team is to automatically extract structured information from the geo-located images.

The new deep neural network model, now publicly available for use by developers, achieved a higher deep neural network (84.2%) in reading street names out of Street View images from the French Street Name Signs (FSNS) dataset. This model is extensible to extract other types of information out of Street View images like the business names from store fronts.

Text recognition in a natural environment like cities, roads and businesses is a challenging computer vision (CV) and machine learning problem. Factors like distortion, occlusions, directional blur, cluttered background or different viewpoints make the extraction of text from natural scenes more challenging. The Google team used a neural network based model back in 2008 to blur faces and license plates in Street View images to protect the privacy of their users. Based on this research, they have been able to use machine learning to automatically improve Google Maps with relevant up-to-date information.

The deep learning model also automatically labels new Street View imagery, normalizes the text to be consistent with the naming conventions and ignores extraneous text that's not relevant for the data analytics. This allows the team to create new addresses directly from images without even knowing the name of the street or the location of the addresses. For example, when a Street View car drives on a newly built road, the model can analyze the captured images, extract the street names and numbers, and properly create and locate the new addresses automatically on Google Maps.

To apply these models across the large Street View image datasets, the Ground Truth team uses the machine learning chip Tensor Processing Unit (TPU) to reduce the computational cost of the inferences of the pipeline.

 

Rate this Article

Adoption Stage
Style

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Tell us what you think

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

Good Information by Anita Shah

Hello Srini Penchikala,
I really appreciate you for sharing such an amazing & helpful resource. It's really well-researched and quality information.
Thanks

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

1 Discuss

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT