BT

Your opinion matters! Please fill in the InfoQ Survey!

Architecture & Design Follow 794 Followers

Jonas Bonér on How Events Are Reshaping Modern Systems

by Srini Penchikala Follow 15 Followers on  Nov 14, 2017

Jonas Bonér talked about event driven services and how event driven architectures (EDA) and event stream processing (ESP) technologies are helping with designing the modern applications based on distributed systems. He spoke at the recent Reactive Summit 2017 Conference.

Architecture & Design Follow 794 Followers

Event Architectures and Event Streaming

by Jan Stenberg Follow 9 Followers on  Sep 06, 2017

When moving from a monolithic system to a distributed or microservices system, you commonly also move from a single source of truth in one database to many databases and thus many sources of truth. Using an event architecture and persisting all events as a stream can give back the single source of truth, Ben Stopford claims in one of a series of blog posts about events, event streams and Kafka.

Architecture & Design Follow 794 Followers

Selecting an Event Architecture

by Jan Stenberg Follow 9 Followers on  Aug 24, 2017

When designing a distributed system, maybe based on microservices, and you are considering an event architecture, there are several models and technologies available. When choosing how to implement the architecture the non-functional requirements are a main factor, David Dawson claims when describing different styles of event architectures in a recent blog post.

Architecture & Design Follow 794 Followers

Versioning of Events in Event Sourced Systems

by Jan Stenberg Follow 9 Followers on  Jul 17, 2017

A challenge with event sourced systems is that events put in the event store years ago must be readable today, even though the software has gone through numerous changes, Greg Young stated in his presentation at this year’s DDD eXchange conference. If a system can be taken down, versioning of events is relatively simple. The real challenge comes when a system can’t be taken down.

Cloud Follow 83 Followers

Integrate 2017 Recap: Adding Intelligence to Integration

by Kent Weare Follow 7 Followers on  Jul 04, 2017

Integrate 2017, an annual integration event focused on Microsoft Integration technologies, took place in London from June 26th – 28th. Some of the key themes that were discussed include the role of cognitive computing in integration, API orchestration, SaaS connectivity, cloud native integration, the impact of serverless on integration and cloud messaging at scale.

Architecture & Design Follow 794 Followers

Overview of the Reliable Event Delivery System at Spotify

by Jan Stenberg Follow 9 Followers on  Mar 31, 2017

Spotify clients generate up to 1.5 million events per second at peak hours and all are handled by their Event Delivery System, designed to have a predictable latency and to never lose an event, Igor Maravic noted in his presentation at the recent QCon London conference, where he gave a high level overview of the system and some of the key operational aspects.

Java Follow 432 Followers

Hazelcast Release Jet, Open-Source Stream Processing Engine

by Ben Evans Follow 12 Followers on  Feb 08, 2017

Hazelcast, previously known for the open-source caching and in-memory data grid technologies, has announced a major release of their new stream processing engine, Jet.

DevOps Follow 305 Followers

Chaperone - A Kafka Auditing Tool from the Uber Engineering Team

by Hrishikesh Barua Follow 4 Followers on  Jan 26, 2017 2

The Uber Engineering team released their Kafka auditing tool called Chaperone as an open-source project. Chaperone allows for auditing and detection of data loss, latency, and duplication of messages in the multi-datacenter and high-volume Kafka setup at Uber.

Data Science Follow 335 Followers

Apache Eagle, Originally from eBay, Graduates to top-level project

by Alexandre Rodrigues Follow 0 Followers on  Jan 24, 2017

Apache Eagle, an open-source solution for identifying security and performance issues on big data platforms, graduates to Apache top level project on January 10, 2017. Firstly open-sourced by eBay on October 2015, Eagle was created to instantly detect access to sensitive data or malicious activities and, to take actions in a timely fashion.

Data Science Follow 335 Followers

Julien Nioche on StormCrawler, Open-Source Crawler Pipelines Backed by Apache Storm

by Alexandre Rodrigues Follow 0 Followers on  Dec 15, 2016

Julien Nioche, director of DigitalPebble, PMC member and committer of the Apache Nutch web crawler project, talks about StormCrawler, a collection of reusable components to build distributed web crawlers based on the streaming framework Apache Storm. InfoQ interviewed Nioche, main contributor of the project, to find out more about StormCrawler and how it compares to other similar technologies.

Cloud Follow 83 Followers

Azure Functions Reach General Availability

by Kent Weare Follow 7 Followers on  Dec 10, 2016 2

Microsoft recently announced an addition to its Platform as a Service (PaaS) offering called Azure Functions. Initially launched as a preview service in March 2016, Azure Functions provide developers with an event-driven serverless compute platform that allow organizations to pay for only what they consume.

Data Science Follow 335 Followers

Microservices and Stream Processing Architecture at Zalando Using Apache Flink

by Srini Penchikala Follow 15 Followers on  Oct 31, 2016 1

Javier Lopez and Mihail Vieru spoke at Reactive Summit 2016 Conference about cloud-based data integration and distribution platform used for stream processing in business intelligence use cases. Their solution is based on technologies such as Flink, Kafka and Elasticsearch.

Data Science Follow 335 Followers

Stream Processing and Lambda Architecture Challenges

by Alexandre Rodrigues Follow 0 Followers on  Oct 19, 2016 4

Lambda architecture has been a popular solution that combines batch and stream processing. Kartik Paramasivam at LinkedIn wrote about how his team addressed stream processing and Lambda architecture challenges using Apache Samza for data processing. The challenges described are the late arrival of events and the processing of duplicated messages.

Data Science Follow 335 Followers

Confluent Announces Kafka for the Enterprise with Multi-Datacenter Replication

by Srini Penchikala Follow 15 Followers on  Oct 05, 2016

Confluent Enterprise latest version supports multi-datacenter replication, automatic data balancing, and cloud migration capability. Confluent, provider of the Apache Kafka based streaming platform, announced last week the new features for Confluent Enterprise, to help build streaming data pipelines and develop stream processing applications.

Architecture & Design Follow 794 Followers

Neha Narkhede: Large-Scale Stream Processing with Apache Kafka

by Ralph Winzinger Follow 0 Followers on  Jun 19, 2016

In her presentation "Large-Scale Stream Processing with Apache Kafka" at QCon New York 2016, Neha Narkhede introduces Kafka Streams, a new feature of Kafka for processing streaming data. According to Narkhede stream processing has become popular because unbounded datasets can be found in many places. It is no longer a niche problem like, for example, machine learning.

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT