BT

Apache Flink 1.2 Released with Dynamic Rescaling, Security and Queryable State

by Alexandre Rodrigues on  Feb 15, 2017

Apache Flink 1.2 was announced and features dynamic rescaling, security, queryable state, and more. The release resolved 650 issues, maintains compatibility with all public APIs and ships with Apache Kafka 0.10 and Apache Mesos support. Flink’s dynamic rescaling allows one to change the parallelism of a streaming job or of an operator within the job.

Apache HBase 1.3 Ships with Multiple Performance Improvements

by Alexandre Rodrigues on  Jan 30, 2017

Apache HBase 1.3.0 was released mid-January 2017 and ships with support for date-based tiered compaction and improvements in multiple areas, like write-ahead log (WAL), and a new RPC scheduler, among others. The release includes almost 1,700 resolved issues in total.

Apache Eagle, Originally from eBay, Graduates to top-level project

by Alexandre Rodrigues on  Jan 24, 2017

Apache Eagle, an open-source solution for identifying security and performance issues on big data platforms, graduates to Apache top level project on January 10, 2017. Firstly open-sourced by eBay on October 2015, Eagle was created to instantly detect access to sensitive data or malicious activities and, to take actions in a timely fashion.

Moving a Monolithic Application towards a Microservices Architecture

by Jan Stenberg on  Dec 31, 2016

Migrating an existing system towards microservices is very different from building a new micoservices-based system, Joris Kuipers, architect at Trfork Amsterdam, claims in a presentation describing an ongoing process of refactoring a large monolithic application, based on CQRS using Axon framework, towards a microservices architecture.

Focus on the Process, Not on Individual Microservices

by Jan Stenberg on  Dec 18, 2016

The key to success when working with a microservices based distributed system is to focus on the distributed process as a whole, not on the microservices themselves. The services are the least important part, Eric Ess claimed at the recent Microservices Conference in London, in his presentation on how to monitor distributed processes at jet.com.

Julien Nioche on StormCrawler, Open-Source Crawler Pipelines Backed by Apache Storm

by Alexandre Rodrigues on  Dec 15, 2016

Julien Nioche, director of DigitalPebble, PMC member and committer of the Apache Nutch web crawler project, talks about StormCrawler, a collection of reusable components to build distributed web crawlers based on the streaming framework Apache Storm. InfoQ interviewed Nioche, main contributor of the project, to find out more about StormCrawler and how it compares to other similar technologies.

Julien Le Dem on the Future of Column-Oriented Data Processing with Apache Arrow

by Alexandre Rodrigues on  Dec 08, 2016 1

Julien Le Dem, the PMC chair of the Apache Arrow project, presented on Data Eng Conf NY on the future of column-oriented data processing. Apache Arrow is an open-source standard for columnar in-memory execution. InfoQ interviewed Le Dem to find out the differences between Arrow and Parquet.

Authentication Strategies in Microservices Systems

by Jan Stenberg on  Dec 08, 2016 1

Software security is a complex problem, and is becoming even more complex using Microservices where each service has to deal with security, David Borsos explained at the recent Microservices Conference in London, during his presentation evaluating four end-user authentication options within a microservice based systems.

Honeycomb - A Tool for Debugging Complex Systems

by Hrishikesh Barua on  Oct 31, 2016 1

Honeycomb is a tool for observing and correlating events in distributed systems. It provides a different approach from existing tools like Zipkin in that it moves away from the single-request-tracing model to a more free-form model of collecting and querying data across layers and dimensions.

Yahoo! Open Sources Pulsar, a Pub/Sub Messaging Platform

by Abel Avram on  Sep 10, 2016

Yahoo! has made available Pulsar, their publish-subscribe messaging platform used internally in production by several services.

Data is the Hard Part Working with Microservices

by Jan Stenberg on  Aug 28, 2016 2

One of the hardest problem when creating and developing microservices for an enterprise is their data. Analysing the business domain using Domain-Driven Design (DDD) and reason about what your data represents will help in achieving a microservices architecture, Christian Posta claims in one of a series of blog posts about microservices implementations.

Q&A on Akka.NET 1.1 with Aaron Stannard

by Pierre-Luc Maheu on  Jul 21, 2016

Akka.NET 1.1 was recently released, bringing new features and performance improvements. InfoQ reached out to Aaron Stannard, maintainer of Akka.net, to learn more about Akka.Streams and Akka.Cluster. Stannard also explains how the roadmap is planned with regards to the JVM implementation of Akka.

Five Ways to Not Mess Up Microservices in Production

by Mark Little on  Jun 19, 2016

Alex Zhitnitsky of Takipi has written about five ways to try to improve the chances of successful deployed of microservices into production. As we will see, they share many similarities with other independent efforts, perhaps leading us to agreement on top areas of concern, if not ways of solving these problems.

Combine SQL Server with Hadoop Using PolyBase

by Jonathan Allen on  Jun 02, 2016 2

With the recently released SQL Server 2016, you can now use SQL queries against Hadoop and Azure blob storage. Not only do you no longer need to write map/reduce operations, you can also join relational and non-relational data with a single query.

DevOps Days Kiel Day 1

by Manuel Pais on  May 15, 2016

Summary of DevOps Days Kiel day 1 talks.

BT