BT
AI, ML & Data Engineering Follow 763 Followers

eBay's Accelerator Data Processing Framework Provides Parallel Execution and Live Recommendations

by Srini Penchikala Follow 34 Followers on  May 31, 2018

eBay's Accelerator data processing framework provides parallel execution and automatic organization of source code, input data, and results. It can be used for data analysis, and algorithm development, as well as a live recommendation system.

Architecture & Design Follow 1880 Followers

Retroactive and Future Events in an Event Sourced System

by Jan Stenberg Follow 29 Followers on  Feb 09, 2018

When Thomas Pierrain started a new project with an asset management company, one important requirement was the ability to go back in time to understand why they took decisions that today look strange. At the recent DDD Europe 2018 conference in Amsterdam, Pierrain discussed his experiences when building an event sourced system that included some temporal challenges.

Architecture & Design Follow 1880 Followers

Event Sourcing in an Unreliable World

by Jan Stenberg Follow 29 Followers on  Nov 30, 2017

Examples of event sourced systems are often from process-oriented domains, like e-commerce, with incoming commands that generate events. But there are domains without processes that are intrinsically unreliable where we are collecting events from external event sources with transports that are unreliable, Lorenzo Nicora explained at the recent Microservices Conference µCon London 2017.

Architecture & Design Follow 1880 Followers

Jonas Bonér on How Events Are Reshaping Modern Systems

by Srini Penchikala Follow 34 Followers on  Nov 14, 2017

Jonas Bonér talked about event driven services and how event driven architectures (EDA) and event stream processing (ESP) technologies are helping with designing the modern applications based on distributed systems. He spoke at the recent Reactive Summit 2017 Conference.

AI, ML & Data Engineering Follow 763 Followers

Apache Kafka Reaches 1.0

by Andrew Morgan Follow 3 Followers on  Nov 06, 2017

The Apache Software Foundation has announced Apache Kafka 1.0, adding an improved Streams API, enhanced metrics, improved tolerance for disk failures, general bug fixes, and more.

AI, ML & Data Engineering Follow 763 Followers

Confluent Releases KSQL, a Distributed Streaming SQL Engine for Apache Kafka

by Srini Penchikala Follow 34 Followers on  Oct 25, 2017

Confluent released KSQL: interactive, distributed streaming SQL engine for Apache Kafka. KSQL supports stream processing operations like aggregations, joins, windowing, and sessionization on topics in Apache Kafka. Confluent announced the open source streaming SQL engine at the recent Kafka Summit conference.

Architecture & Design Follow 1880 Followers

Event Architectures and Event Streaming

by Jan Stenberg Follow 29 Followers on  Sep 06, 2017

When moving from a monolithic system to a distributed or microservices system, you commonly also move from a single source of truth in one database to many databases and thus many sources of truth. Using an event architecture and persisting all events as a stream can give back the single source of truth, Ben Stopford claims in one of a series of blog posts about events, event streams and Kafka.

Architecture & Design Follow 1880 Followers

Selecting an Event Architecture

by Jan Stenberg Follow 29 Followers on  Aug 24, 2017

When designing a distributed system, maybe based on microservices, and you are considering an event architecture, there are several models and technologies available. When choosing how to implement the architecture the non-functional requirements are a main factor, David Dawson claims when describing different styles of event architectures in a recent blog post.

Architecture & Design Follow 1880 Followers

Versioning of Events in Event Sourced Systems

by Jan Stenberg Follow 29 Followers on  Jul 17, 2017

A challenge with event sourced systems is that events put in the event store years ago must be readable today, even though the software has gone through numerous changes, Greg Young stated in his presentation at this year’s DDD eXchange conference. If a system can be taken down, versioning of events is relatively simple. The real challenge comes when a system can’t be taken down.

Cloud Follow 251 Followers

Integrate 2017 Recap: Adding Intelligence to Integration

by Kent Weare Follow 9 Followers on  Jul 04, 2017

Integrate 2017, an annual integration event focused on Microsoft Integration technologies, took place in London from June 26th – 28th. Some of the key themes that were discussed include the role of cognitive computing in integration, API orchestration, SaaS connectivity, cloud native integration, the impact of serverless on integration and cloud messaging at scale.

AI, ML & Data Engineering Follow 763 Followers

Nikita Ivanov on Apache Ignite In-Memory Computing Platform

by Alexandre Rodrigues Follow 0 Followers on  Apr 23, 2017

Apache Ignite is an in-memory computing platform with transactional support, that supports both key-value persistence as well as streaming and complex-event processing. Ignite was open-sourced by GridGain in late 2014 and accepted in the Apache Incubator program. InfoQ interviewed Nikita Ivanov, CTO of GridGain, to find out more about Apache Ignite.

Architecture & Design Follow 1880 Followers

Overview of the Reliable Event Delivery System at Spotify

by Jan Stenberg Follow 29 Followers on  Mar 31, 2017

Spotify clients generate up to 1.5 million events per second at peak hours and all are handled by their Event Delivery System, designed to have a predictable latency and to never lose an event, Igor Maravic noted in his presentation at the recent QCon London conference, where he gave a high level overview of the system and some of the key operational aspects.

Architecture & Design Follow 1880 Followers

Challenges Building Facebook Live Streams

by Jan Stenberg Follow 29 Followers on  Mar 30, 2017 2

Facebook Live started in a hackathon two years ago, and was launched to users eight months later. One of the challenges has been dealing with the unpredictable number of viewers of a single stream, Sachin Kulkarni noted in his presentation at the recent QCon London conference, where he described his team's architecture and design considerations when building Facebook live streams.

AI, ML & Data Engineering Follow 763 Followers

Apache Flink 1.2 Released with Dynamic Rescaling, Security and Queryable State

by Alexandre Rodrigues Follow 0 Followers on  Feb 15, 2017

Apache Flink 1.2 was announced and features dynamic rescaling, security, queryable state, and more. The release resolved 650 issues, maintains compatibility with all public APIs and ships with Apache Kafka 0.10 and Apache Mesos support. Flink’s dynamic rescaling allows one to change the parallelism of a streaming job or of an operator within the job.

Java Follow 835 Followers

Hazelcast Release Jet, Open-Source Stream Processing Engine

by Ben Evans Follow 22 Followers on  Feb 08, 2017

Hazelcast, previously known for the open-source caching and in-memory data grid technologies, has announced a major release of their new stream processing engine, Jet.

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT