BT
DevOps Follow 827 Followers

DevOps Workbench Launched by ZeroStack

by Helen Beal Follow 5 Followers on  Jan 12, 2018

Private cloud provider, ZeroStack, has announced a self-service capability from which developers can create their own workbenches. Forty developer tools from a mix of open source and commercial providers are available to users of the DevOps Workbench through Zerostack’s Intelligent Cloud Platform.

AI, ML & Data Engineering Follow 873 Followers

Modern Big Data Pipelines over Kubernetes

by Srini Penchikala Follow 36 Followers on  Jan 08, 2018

Container management technologies like Kubernetes make it possible to implement modern big data pipelines. Eliran Bivas, senior big data architect at Iguazio, spoke at the recent KubeCon + CloudNativeCon North America 2017 Conference about big data pipelines and how Kubernetes can help develop them.

Cloud Follow 283 Followers

Microsoft Updates AI Services and Tools for Data Scientists and Developers

by Kent Weare Follow 10 Followers on  Sep 30, 2017

At the recent Ignite conference, Microsoft released several updates related to its Artificial Intelligence (AI) services and tools. These updates include the release of the Azure ML Experimentation service, Azure ML Model Management service, Azure ML Workbench and the general availability of Microsoft Cognitive Services.

Java Follow 943 Followers

Emerging Technologies for the Enterprise Conference 2017: Day Two Recap

by Michael Redlich Follow 14 Followers on  Apr 30, 2017

Day Two of the 12th annual Emerging Technologies for the Enterprise Conference was held in Philadelphia. This two-day event included keynotes by Blair MacIntyre (augmented reality pioneer) and Scott Hanselman (podcaster), and featured speakers Kyle Daigle (engineering manager at GitHub), Holden Karau (principal software engineer at IBM), and Karen Kinnear (JVM technical lead at Oracle).

Java Follow 943 Followers

Emerging Technologies for the Enterprise Conference 2017: Day One Recap

by Michael Redlich Follow 14 Followers on  Apr 24, 2017

Day One of the 12th annual Emerging Technologies for the Enterprise Conference was held on Tuesday, April 18 in Philadelphia, PA. This two-day event included keynotes by Blair MacIntyre (augmented reality pioneer) and Scott Hanselman (podcaster), and featured speakers Monica Beckwith (JVM consultant at Oracle), Yehuda Katz (co-creator of Ember.js), and Jessica Kerr (lead engineer at Atomist).

Java Follow 943 Followers

Lightbend Speaks to InfoQ on Their Acquisition of OpsClarity

by Michael Redlich Follow 14 Followers on  Feb 24, 2017

Nine months after acquiring BoldRadius, Lightbend announced their acquisition of OpsClarity, a company specializing in monitoring reactive applications. InfoQ interviewed Mark Brewer, president and CEO at Lightbend and Alan Ngai, co-founder of OpsClarity and now VP of cloud services at Lightbend to learn more about this new partnership.

AI, ML & Data Engineering Follow 873 Followers

Apache Eagle, Originally from eBay, Graduates to top-level project

by Alexandre Rodrigues Follow 0 Followers on  Jan 24, 2017

Apache Eagle, an open-source solution for identifying security and performance issues on big data platforms, graduates to Apache top level project on January 10, 2017. Firstly open-sourced by eBay on October 2015, Eagle was created to instantly detect access to sensitive data or malicious activities and, to take actions in a timely fashion.

AI, ML & Data Engineering Follow 873 Followers

Facebook's Comparison of Apache Giraph and Spark GraphX for Graph Data Processing

by Srini Penchikala Follow 36 Followers on  Dec 09, 2016

A Facebook team has recently published a comparison of the performance of their existing Giraph-based graph processing system with the newer GraphX which is part of the popular Spark framework. Their conclusion is that GraphX is neither sufficiently scalable or performant to support their graph processing workloads.

AI, ML & Data Engineering Follow 873 Followers

Julien Le Dem on the Future of Column-Oriented Data Processing with Apache Arrow

by Alexandre Rodrigues Follow 0 Followers on  Dec 08, 2016 1

Julien Le Dem, the PMC chair of the Apache Arrow project, presented on Data Eng Conf NY on the future of column-oriented data processing. Apache Arrow is an open-source standard for columnar in-memory execution. InfoQ interviewed Le Dem to find out the differences between Arrow and Parquet.

AI, ML & Data Engineering Follow 873 Followers

Spark Summit EU Highlights: TensorFlow, Structured Streaming and GPU Hardware Acceleration

by Alexandre Rodrigues Follow 0 Followers on  Nov 13, 2016

Apache Spark integration with deep learning library TensorFlow, online learning using Structured Streaming and GPU hardware acceleration were the highlights of Spark Summit EU 2016 held last week in Brussels.

AI, ML & Data Engineering Follow 873 Followers

Reactive Summit 2016 Conference: Reactive Microservices and Staging Data Pipelines

by Srini Penchikala Follow 36 Followers on  Oct 08, 2016

Reactive microservices, data center scale operating system (DCOS), and staging reactive data pipelines were the highlighted topics at Reactive Summit 2016 Conference held this week. InfoQ team attended the conference and this post is a summary of the first day's events at the conference.

Architecture & Design Follow 2128 Followers

Neha Narkhede: Large-Scale Stream Processing with Apache Kafka

by Ralph Winzinger Follow 0 Followers on  Jun 19, 2016

In her presentation "Large-Scale Stream Processing with Apache Kafka" at QCon New York 2016, Neha Narkhede introduces Kafka Streams, a new feature of Kafka for processing streaming data. According to Narkhede stream processing has become popular because unbounded datasets can be found in many places. It is no longer a niche problem like, for example, machine learning.

AI, ML & Data Engineering Follow 873 Followers

Apache Spark 2.0 Technical Preview

by Alex Giamas Follow 9 Followers on  May 31, 2016

Two years after the first release of Apache Spark, Databricks announced the technical preview of Apache Spark 2.0 , based on upstream branch 2.0.0-preview. The preview is not ready for production, neither in terms of stability nor API, but is a release intended to gather feedback from the community ahead of the general availability of the release.

AI, ML & Data Engineering Follow 873 Followers

Databricks Integrates Spark and TensorFlow for Deep Learning

by Dylan Raithel Follow 9 Followers on  Mar 12, 2016

Since announcements late last year about Google open-sourcing TensorFlow, the company’s open-source library for machine learning, and previous coverage at InfoQ, the data-science community has had an opportunity to try out TensorFlow for their own projects.

AI, ML & Data Engineering Follow 873 Followers

Yahoo! Benchmarks Apache Flink, Spark and Storm

by Abel Avram Follow 9 Followers on  Dec 23, 2015

Yahoo! has benchmarked three of the main stream processing frameworks: Apache Flink, Spark and Storm.

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT