BT

Your opinion matters! Please fill in the InfoQ Survey!

Data Science Follow 378 Followers

Microservices and Stream Processing Architecture at Zalando Using Apache Flink

by Srini Penchikala Follow 17 Followers on  Oct 31, 2016 1

Javier Lopez and Mihail Vieru spoke at Reactive Summit 2016 Conference about cloud-based data integration and distribution platform used for stream processing in business intelligence use cases. Their solution is based on technologies such as Flink, Kafka and Elasticsearch.

Data Science Follow 378 Followers

Stream Processing and Lambda Architecture Challenges

by Alexandre Rodrigues  Followers on  Oct 19, 2016 4

Lambda architecture has been a popular solution that combines batch and stream processing. Kartik Paramasivam at LinkedIn wrote about how his team addressed stream processing and Lambda architecture challenges using Apache Samza for data processing. The challenges described are the late arrival of events and the processing of duplicated messages.

Development Follow 225 Followers

Microsoft Open-Sources P Language for Safe Async Event-Driven Programming

by Sergio De Simone Follow 6 Followers on  Oct 12, 2016 1

Microsoft’s recently open-sourced P language aims to make it possible to write safe asynchronous event-driven programs on Linux, macOS, and Windows.

Data Science Follow 378 Followers

Reactive Summit 2016 Conference: Reactive Microservices and Staging Data Pipelines

by Srini Penchikala Follow 17 Followers on  Oct 08, 2016

Reactive microservices, data center scale operating system (DCOS), and staging reactive data pipelines were the highlighted topics at Reactive Summit 2016 Conference held this week. InfoQ team attended the conference and this post is a summary of the first day's events at the conference.

Data Science Follow 378 Followers

Confluent Announces Kafka for the Enterprise with Multi-Datacenter Replication

by Srini Penchikala Follow 17 Followers on  Oct 05, 2016

Confluent Enterprise latest version supports multi-datacenter replication, automatic data balancing, and cloud migration capability. Confluent, provider of the Apache Kafka based streaming platform, announced last week the new features for Confluent Enterprise, to help build streaming data pipelines and develop stream processing applications.

Architecture & Design Follow 901 Followers

Vaughn Vernon on Microservices and Domain-Driven Design

by Jan Stenberg Follow 10 Followers on  Jul 31, 2016

Although a monolith can be modeled in a respectable way, often they are turned into a big ball of mud. This is caused by multiple domain models becoming entangled within the monolith, and in Vaughn Vernon's experience this can happen within a few weeks or months, he claimed in a presentation at the Scala Days conference earlier this year.

Architecture & Design Follow 901 Followers

Neha Narkhede: Large-Scale Stream Processing with Apache Kafka

by Ralph Winzinger  Followers on  Jun 19, 2016

In her presentation "Large-Scale Stream Processing with Apache Kafka" at QCon New York 2016, Neha Narkhede introduces Kafka Streams, a new feature of Kafka for processing streaming data. According to Narkhede stream processing has become popular because unbounded datasets can be found in many places. It is no longer a niche problem like, for example, machine learning.

Architecture & Design Follow 901 Followers

Eric Evans: Is Domain-Driven Design Beneficial for Software Development?

by Jan Stenberg Follow 10 Followers on  Jun 16, 2016 1

The last couple of years the interest in Domain-Driven Design (DDD) has increased, Eric Evans noted in his keynote at the recent DDD eXchange conference in London. He thinks that we are in a time when developers care more about design, partially because we are working more with distributed systems where models have a higher value.

Architecture & Design Follow 901 Followers

Comparison of Event Sourcing with Stream Processing

by Jan Stenberg Follow 10 Followers on  May 25, 2016

Event sourcing and CQRS are two patterns that has emerged in the Domain-Driven Design (DDD) community. Stream processing builds on similar ideas but has emerged in a different community, Martin Kleppmann noted in his presentation at the Domain-Driven Design Europe conference earlier this year comparing event sourcing with stream processing.

Cloud Follow 109 Followers

Azure Stream Analytics Publishing to Power BI Reaches General Availability

by Kent Weare Follow 7 Followers on  May 11, 2016

On Thursday, April 21 Microsoft announced the integration between Azure Stream Analytics and Power BI has reached General Availability (GA). Using this capability, customers can gain real-time insight into their business performance by analyzing in-flight data streams.

Architecture & Design Follow 901 Followers

A Whole System Based on Event Sourcing is an Anti-Pattern

by Jan Stenberg Follow 10 Followers on  Apr 26, 2016 5

Command Query Responsibility Segregation (CQRS) was never meant to be the end goal of what we are trying to achieve, it is a stepping stone towards the ideas of Event sourcing, Greg Young stated in his presentation at the Domain-Driven Design Europe conference earlier this year. He noted though that just applying CQRS is still a valuable pattern.

Cloud Follow 109 Followers

Apache Storm Reaches 1.0, Brings Improved Performance, Many New Features

by Sergio De Simone Follow 6 Followers on  Apr 14, 2016

Version 1.0 is "a major milestone in the evolution of Apache Storm", writes Apache Software Foundation VP for Apache Storm P. Taylor Goetz, and it includes many new features and improvements. In particular, Goetz claims a 3x–16x boost in performance.

Architecture & Design Follow 901 Followers

Microservices for a Streaming World

by Jan Stenberg Follow 10 Followers on  Mar 14, 2016

Embrace decentralization, build service-based systems and attack the problems that come with distributed state using stream processing tools, Ben Stopford urged in his presentation at the recent QCon London conference.

Architecture & Design Follow 901 Followers

Moving from Transactions to Streams to Gain Consistency

by Jan Stenberg Follow 10 Followers on  Mar 13, 2016

With many databases in a system they are rarely independent from each other, instead pieces of the same data are stored in many of them. Using transactions to keep everything in sync is a fragile solution. Working with a stream of changes in the order they are created is a much simpler and more resilient solution, Martin Kleppmann stated in his presentation at the recent QCon London conference.

Architecture & Design Follow 901 Followers

Lagom, a New Microservices Framework

by Jan Stenberg Follow 10 Followers on  Mar 08, 2016 1

Lightbend, the company behind Akka, has released an open source microservices framework, Lagom built on their Reactive Platform, in particular the Play Framework and the Akka family of products together with ConductR for deployment. By default, Lagom is message-driven and asynchronous, and using distributed CQRS persistence patterns with event sourcing as the primary implementation.

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT