BT

InfoQ Homepage News Microsoft Announces Container Support for Azure Cognitive Services

QCon.ai - Applied AI for Developers Apr 15 - 17, 2019, San Francisco. Save an extra $80 with INFOQAI19!

Microsoft Announces Container Support for Azure Cognitive Services

Bookmarks

Microsoft has announced container support for Cognitive Services, which allows taking advantage of machine learning capabilities anywhere, whether it is in the cloud, on the edge or on-premises. With Azure Cognitive Services, organizations can start using various cognitive features, like vision, speech and text processing, without the need for a dedicated data scientist.

Support for containerization is accomplished by giving the option to deploy pre-built models as Docker containers, allowing these to run wherever Docker is available. The announcement of Microsoft closely follows Google's launch of Kubeflow Pipelines, which provides support for machine learning through Kubernetes containers. Seeing that, it is logical these services focus on bringing the foundations for ML platforms, allowing companies and developers to instead concentrate on harnessing the actual value which ML and AI can bring.

Source: https://venturebeat.com/2018/11/24/before-you-launch-your-machine-learning-model-start-with-an-mvp/

As Azure Cognitive Services now can run on containers, the need for sending data for these models to Azure is no longer there, as this can now run in any cloud or on the edge. Subsequently, as data no longer must leave the on-premises environment, this also opens possibilities to process data which can not be used in Azure due to privacy or regulatory restrictions. Moreover, scenarios using massive data loads, which would either be too expensive or time-consuming to bring to the cloud, are now capable of processing on the edge as well, while taking advantage of the power of Cognitive Services and the scaling of Docker containers. These statements are confirmed by Eric Boyd, corporate vice president on Azure AI:

With container support, customers can use Azure's intelligent Cognitive Services capabilities, wherever the data resides. This means customers can perform facial recognition, OCR, or text analytics operations without sending their content to the cloud. Their intelligent apps are portable and scale with greater consistency, whether they run on the edge or in Azure.

Initially, five of Azure's Cognitive Services are available through containers, with more expected to follow later.

To get started with Cognitive Services in containers, either sign up for the face and text recognition services or start immediately using one of the other services. The images are available from Microsoft Container Registry or Docker Hub, and after pulling them in they can be configured and used in a Docker environment.

Finally, it is important to note that, when using the containerized services, even though they send none of the processed data to Azure, a connection is still required on start-up and at regular intervals. Metrics for billing are sent over this connection, where the costs currently are the same both when using Azure or the container images.

Rate this Article

Adoption
Style

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Community comments

  • Machine Learning

    by Anthony Manello /

    Your message is awaiting moderation. Thank you for participating in the discussion.

    Do you think it's possible to apply ML to WORKFLOWS?

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

BT

Is your profile up-to-date? Please take a moment to review and update.

Note: If updating/changing your email, a validation request will be sent

Company name:
Company role:
Company size:
Country/Zone:
State/Province/Region:
You will be sent an email to validate the new email address. This pop-up will close itself in a few moments.