BT

IBM Commits to Advance Apache Spark

| by Alex Giamas Follow 9 Followers on Nov 20, 2015. Estimated reading time: 1 minute |

Earlier last month in Las Vegas, at IBM Insight 2015, IBM announced a major commitment to the Apache Spark project. Referring to it as “potentially the most significant open source project of the next decade” tells a lot about how important IBM believes Apache Spark is. With IDC reporting that 80% of cloud applications in the future will be data intensive, Apache Spark with its real time analytics capabilities can unlock previously unusable data into into useful insights. IBM had already announced an investment of $300 million over the next few years on Apache Spark last June at Spark Summit. This investment included 3,500 IBM developers working on Apache Spark and related projects over the next few years.

The newest announcement expands on the previous offering as IBM doubles down on Apache Spark and betting in its adoption for IBM’s cloud success. IBM announced Spark as a Service as a core offering in its BlueMix platform. This means that developers and data scientists can get real-time analytics in their apps. IBM’s dedication to Apache Spark means that it will rewrite some of its applications to include Apache Spark. These include BigInsights, Data Science Workbench and SPSS Analytics Server and Modeler.

IBM is also open sourcing its SystemML machine learning technology and will collaborate with Databricks in Spark machine learning development. Finally, IBM plans to participate in design of classes both onsite and MOOC through partnerships with AMPLab, DataCamp, MetiStream, Galvanize and Big Data University, aiming to educate more than 1 million data engineers and scientists.

IBM analytics for Apache Spark is available as free trial and starting from $0.7/instance hour.

Rate this Article

Adoption Stage
Style

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Tell us what you think

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread
Community comments

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Email me replies to any of my messages in this thread

Discuss

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT