Google Cloud Platform has released an open source Zipkin server that allows Zipkin-compatible clients to send traces to Google’s own Stackdriver Trace distributed tracing service for analysis. This Zipkin/Stackdriver Trace integration is aimed at developers whose applications and services are written in a language or framework that Stackdriver Trace doesn’t officially support.
Intel open-sources BigDL, a distributed deep learning library that runs on Apache Spark. It leverages existing Spark clusters to run deep learning computations and simplifies the data loading from big datasets stored in Hadoop.
Version 1.13 of Atom, GitHub’s Electron-based open source text editor, adds a host of new features and improvements for users and developers, including a benchmarking tool, a Reopen Project menu option and API, and a custom keystroke resolver to map Chrome keyboard events to Atom-style keystrokes.
Amazon Web Services have launched AWS Step Functions, a service that enables the coordination of distributed applications and microservices using visual workflows. The AWS Step Functions console allows the JSON specification of a state machine to be defined that execute 'steps' within an application, e.g., by calling out to an AWS Lambda function or containerised application running on AWS ECS.
Migrating an existing system towards microservices is very different from building a new micoservices-based system, Joris Kuipers, architect at Trfork Amsterdam, claims in a presentation describing an ongoing process of refactoring a large monolithic application, based on CQRS using Axon framework, towards a microservices architecture.
Domain-Driven Design (DDD) is a great technique bringing designs closer to the domains we are working in, but too often we make early decisions with a focus on structure, which is not the intention of DDD. Instead we should start with the events in a domain, Russ Miles claims when describing the advantages of going “events-first” when building microservices.
Gartner has produced a report called “Market Guide for Application Platforms”, citing Java EE’s “revenue decline” in reporting “a clear shift” in the application platform market. The Java EE community takes issue with those findings, in personal comments to InfoQ.
Netflix has developed an orchestration engine called “Conductor”, and has used it internally in production for the last year . During this time they executed some 2.6 million process workflows, starting with linear ones and ending with dynamic ones running over multiple days. Now they have open sourced Conductor, making it available to all those interested in workflow orchestration.
The key to success when working with a microservices based distributed system is to focus on the distributed process as a whole, not on the microservices themselves. The services are the least important part, Eric Ess claimed at the recent Microservices Conference in London, in his presentation on how to monitor distributed processes at jet.com.
Julien Nioche, director of DigitalPebble, PMC member and committer of the Apache Nutch web crawler project, talks about StormCrawler, a collection of reusable components to build distributed web crawlers based on the streaming framework Apache Storm. InfoQ interviewed Nioche, main contributor of the project, to find out more about StormCrawler and how it compares to other similar technologies.
Microsoft recently announced an addition to its Platform as a Service (PaaS) offering called Azure Functions. Initially launched as a preview service in March 2016, Azure Functions provide developers with an event-driven serverless compute platform that allow organizations to pay for only what they consume.
Julien Le Dem, the PMC chair of the Apache Arrow project, presented on Data Eng Conf NY on the future of column-oriented data processing. Apache Arrow is an open-source standard for columnar in-memory execution. InfoQ interviewed Le Dem to find out the differences between Arrow and Parquet.
Software security is a complex problem, and is becoming even more complex using Microservices where each service has to deal with security, David Borsos explained at the recent Microservices Conference in London, during his presentation evaluating four end-user authentication options within a microservice based systems.
At the recent AWS Re:Invent event, Amazon announced a new preview service, called AWS Batch. AWS Batch allows organizations to optimize their scheduling and workload execution across a cloud-based landscape. Amazon has built this service in response to many AWS customers building their own batch platforms using EC2 instances, containers and CloudWatch.
In our continued effort to showcase lessons learned by microservices practitioners, we look at an article Piotr Gankiewicz has recently written with his own tips and tricks. These include references to CQRS, asynchronous architectures, service discovery and how choosing the right database for each service is important.