BT

InfoQ Homepage Presentations Accelerated Spark on Azure: Seamless and Scalable Hardware Offloads in the Cloud

Accelerated Spark on Azure: Seamless and Scalable Hardware Offloads in the Cloud

Bookmarks
38:06

Summary

Yuval Degani shows how hardware accelerations in Azure can be utilized to speed-up Spark jobs, with the aid of RDMA (Remote Direct Memory Access) support in the VM.

Bio

Yuval Degani is a Senior Manager of Engineering in Mellanox Technologies, leading a team of software engineers based in the San Francisco. His team's focus is introducing new network acceleration technologies to Big Data and ML. Before that, Yuval was a developer, an architect and later a team lead in the areas of low-level kernel development for cutting edge high-performance network devices.

About the conference

The 6th Annual Global Big Data Conference is extended to three days based on feedback from participants. The event will feature many of the Big Data thought leaders from the industry. Annual Global Big Data Conference is an event acclaimed for its highly interactive sessions.

Recorded at:

Nov 03, 2018

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Community comments

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

BT

Is your profile up-to-date? Please take a moment to review and update.

Note: If updating/changing your email, a validation request will be sent

Company name:
Company role:
Company size:
Country/Zone:
State/Province/Region:
You will be sent an email to validate the new email address. This pop-up will close itself in a few moments.