Intel Open-Sources BigDL, Distributed Deep Learning Library for Apache Spark

by Alexandre Rodrigues on  Jan 13, 2017

Intel open-sources BigDL, a distributed deep learning library that runs on Apache Spark. It leverages existing Spark clusters to run deep learning computations and simplifies the data loading from big datasets stored in Hadoop.

Atom 1.13 Brings Benchmarks, Project History, and Keystroke Resolver API

by Sergio De Simone on  Jan 12, 2017

Version 1.13 of Atom, GitHub’s Electron-based open source text editor, adds a host of new features and improvements for users and developers, including a benchmarking tool, a Reopen Project menu option and API, and a custom keystroke resolver to map Chrome keyboard events to Atom-style keystrokes.

AWS Step Functions: Coordinating Distributed Applications and Microservices Using Visual Workflows

by Daniel Bryant on  Jan 05, 2017

Amazon Web Services have launched AWS Step Functions, a service that enables the coordination of distributed applications and microservices using visual workflows. The AWS Step Functions console allows the JSON specification of a state machine to be defined that execute 'steps' within an application, e.g., by calling out to an AWS Lambda function or containerised application running on AWS ECS.

Moving a Monolithic Application towards a Microservices Architecture

by Jan Stenberg on  Dec 31, 2016

Migrating an existing system towards microservices is very different from building a new micoservices-based system, Joris Kuipers, architect at Trfork Amsterdam, claims in a presentation describing an ongoing process of refactoring a large monolithic application, based on CQRS using Axon framework, towards a microservices architecture.

Start with Events and DDD When Building Microservices

by Jan Stenberg on  Dec 28, 2016 2

Domain-Driven Design (DDD) is a great technique bringing designs closer to the domains we are working in, but too often we make early decisions with a focus on structure, which is not the intention of DDD. Instead we should start with the events in a domain, Russ Miles claims when describing the advantages of going “events-first” when building microservices.

Is Gartner's Report of Java EE's Demise Greatly Exaggerated?

by Victor Grazi on  Dec 21, 2016 45

Gartner has produced a report called “Market Guide for Application Platforms”, citing Java EE’s “revenue decline” in reporting “a clear shift” in the application platform market. The Java EE community takes issue with those findings, in personal comments to InfoQ.

Netflix Conductor, an Orchestration Engine for Microservices

by Abel Avram on  Dec 20, 2016 2

Netflix has developed an orchestration engine called “Conductor”, and has used it internally in production for the last year . During this time they executed some 2.6 million process workflows, starting with linear ones and ending with dynamic ones running over multiple days. Now they have open sourced Conductor, making it available to all those interested in workflow orchestration.

Focus on the Process, Not on Individual Microservices

by Jan Stenberg on  Dec 18, 2016

The key to success when working with a microservices based distributed system is to focus on the distributed process as a whole, not on the microservices themselves. The services are the least important part, Eric Ess claimed at the recent Microservices Conference in London, in his presentation on how to monitor distributed processes at

Julien Nioche on StormCrawler, Open-Source Crawler Pipelines Backed by Apache Storm

by Alexandre Rodrigues on  Dec 15, 2016

Julien Nioche, director of DigitalPebble, PMC member and committer of the Apache Nutch web crawler project, talks about StormCrawler, a collection of reusable components to build distributed web crawlers based on the streaming framework Apache Storm. InfoQ interviewed Nioche, main contributor of the project, to find out more about StormCrawler and how it compares to other similar technologies.

Azure Functions Reach General Availability

by Kent Weare on  Dec 10, 2016 2

Microsoft recently announced an addition to its Platform as a Service (PaaS) offering called Azure Functions. Initially launched as a preview service in March 2016, Azure Functions provide developers with an event-driven serverless compute platform that allow organizations to pay for only what they consume.

Julien Le Dem on the Future of Column-Oriented Data Processing with Apache Arrow

by Alexandre Rodrigues on  Dec 08, 2016 1

Julien Le Dem, the PMC chair of the Apache Arrow project, presented on Data Eng Conf NY on the future of column-oriented data processing. Apache Arrow is an open-source standard for columnar in-memory execution. InfoQ interviewed Le Dem to find out the differences between Arrow and Parquet.

Authentication Strategies in Microservices Systems

by Jan Stenberg on  Dec 08, 2016 1

Software security is a complex problem, and is becoming even more complex using Microservices where each service has to deal with security, David Borsos explained at the recent Microservices Conference in London, during his presentation evaluating four end-user authentication options within a microservice based systems.

Amazon Introduces AWS Batch Preview

by Kent Weare on  Dec 04, 2016

At the recent AWS Re:Invent event, Amazon announced a new preview service, called AWS Batch. AWS Batch allows organizations to optimize their scheduling and workload execution across a cloud-based landscape. Amazon has built this service in response to many AWS customers building their own batch platforms using EC2 instances, containers and CloudWatch.

Sharing Experiences from a Microservices Journey

by Mark Little on  Dec 04, 2016

In our continued effort to showcase lessons learned by microservices practitioners, we look at an article Piotr Gankiewicz has recently written with his own tips and tricks. These include references to CQRS, asynchronous architectures, service discovery and how choosing the right database for each service is important.

Developer Panel Discusses Microservices, Containers and Serverless at Microsoft Connect

by Pierre-Luc Maheu on  Nov 30, 2016

A developer panel was held at Microsoft Connect() following the multiple annoucements of new features and releases. Microservices and containers are in the center of the discussion, along with Azure, serverless architecture and developer tooling.