BT

InfoQ Homepage News Teachable Machine: Teach a Machine Using Your Camera in Your Browser

QCon.ai - Applied AI for Developers Apr 15 - 17, 2019, San Francisco. Save an extra $80 with INFOQAI19!

Teachable Machine: Teach a Machine Using Your Camera in Your Browser

Bookmarks

Teachable Machine is a browser application that you can train with your webcam to recognize objects or expressions.

In the demo you use your webcam to recognize three different classes of objects or expressions. Based on your camera input, the site shows different gifs, plays prerecorded sounds, or plays speech. No coding of the user is required, and no hyper-parameters or network architecture has to be programmed. The only feedback from the machine the user has, is the confidence the machine has in each of the predicted classes. Based on the recognized class, the machine shows one of three different gifs: a cat, a dog, or a cute bunny. Users can also program several sounds or words, but can't mix the output modalities. A great explanation of how to use the Teachable Machine can be found on Youtube

All training is done in the browser using the deeplearn.js library. It is a hardware-accelerated javascript library built by the Google Brain PAIR team, that is freely available. The library was announced in August 2017 on the Google blog, and several applications that use the library are available on the deeplearn.js website.

Users only have to take pictures of a few instances of objects they want to recognize. Training is accelerated by downloading the pre-trained neural network called "squeezenet". According to the research paper a squeezenet has 50 times less trainable parameters than comparable neural networks. This means it can be downloaded as a file smaller than half a megabyte. Although the network has less parameters, the output is on par with larger neural networks, and good enough for this simple browser application. The application uses the output of this pretrained network to learn what you are showing to the webcam.

The source code for teachable machine can is available on Github. Instructions to get started with deeplearn.js, and the source code for this library, are also available on Github.

Rate this Article

Adoption
Style

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Community comments

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

BT

Is your profile up-to-date? Please take a moment to review and update.

Note: If updating/changing your email, a validation request will be sent

Company name:
Company role:
Company size:
Country/Zone:
State/Province/Region:
You will be sent an email to validate the new email address. This pop-up will close itself in a few moments.