BT
rss
Cloud Follow 331 Followers

Netflix Keystone Real-Time Stream Processing Platform

by Alex Giamas Follow 10 Followers on  Sep 30, 2018

Netflix recently published a post in their tech blog discussing the design considerations and insights of Keystone, their Real-time stream processing platform. Keystone has been operational since December 2015 and has grown significantly over the years as Netflix subscribers have grown from 65 to over 130 million in the past 3 years. This article follows on the latest state of Keystone platform...

Cloud Follow 331 Followers

Data Artisans Announces Serializable ACID Transactions on Streaming Data

by Eldert Grootenboer Follow 3 Followers on  Sep 12, 2018

Data Artisans has announced the general availability of Streaming Ledger, which extends Apache Flink with capabilities to perform serializable ACID transactions across tables, keys, and event streams. The patent-pending technology is a proprietary add-on for Flink and allows going beyond the current standard where operations could only consistently work on a single key at a time.

AI, ML & Data Engineering Follow 993 Followers

Julien Le Dem on the Future of Column-Oriented Data Processing with Apache Arrow

by Alexandre Rodrigues Follow 1 Followers on  Dec 08, 2016 1

Julien Le Dem, the PMC chair of the Apache Arrow project, presented on Data Eng Conf NY on the future of column-oriented data processing. Apache Arrow is an open-source standard for columnar in-memory execution. InfoQ interviewed Le Dem to find out the differences between Arrow and Parquet.

AI, ML & Data Engineering Follow 993 Followers

Microservices and Stream Processing Architecture at Zalando Using Apache Flink

by Srini Penchikala Follow 37 Followers on  Oct 31, 2016 1

Javier Lopez and Mihail Vieru spoke at Reactive Summit 2016 Conference about cloud-based data integration and distribution platform used for stream processing in business intelligence use cases. Their solution is based on technologies such as Flink, Kafka and Elasticsearch.

AI, ML & Data Engineering Follow 993 Followers

Stream Processing and Lambda Architecture Challenges

by Alexandre Rodrigues Follow 1 Followers on  Oct 19, 2016 4

Lambda architecture has been a popular solution that combines batch and stream processing. Kartik Paramasivam at LinkedIn wrote about how his team addressed stream processing and Lambda architecture challenges using Apache Samza for data processing. The challenges described are the late arrival of events and the processing of duplicated messages.

AI, ML & Data Engineering Follow 993 Followers

Data Streaming Architecture with Apache Flink

by Srini Penchikala Follow 37 Followers on  Jun 09, 2016

Jamie Grier recently spoke at OSCON 2016 Conference about data streaming architecture using Apache Flink. He talked about the building blocks of data streaming applications and stateful stream processing with code examples of Flink applications and monitoring.

AI, ML & Data Engineering Follow 993 Followers

Apache Flink 1.0.0 is Released

by Rags Srinivas Follow 11 Followers on  Mar 24, 2016

InfoQ's Rags Srinivas caught up with Stephan Ewen, a project committer for Apache Flink about the 1.0.0 Release and the roadmap

AI, ML & Data Engineering Follow 993 Followers

Yahoo! Benchmarks Apache Flink, Spark and Storm

by Abel Avram Follow 11 Followers on  Dec 23, 2015

Yahoo! has benchmarked three of the main stream processing frameworks: Apache Flink, Spark and Storm.

Followers

Adatao Launches Full Stack Data Intelligence Platform

by Alex Giamas Follow 10 Followers on  May 04, 2015

Adatao recently announced the general availability of its Data Intelligence platform. Its platform aims to make data analysis and predictive analytics available to everyone in large organizations. Adatao had secured an investment of $13 million last year from a group of investors including Bloomberg Beta, Lightspeed Venture Partners and Andreessen Horowitz.

Followers

Fabian Hueske on Apache Flink Framework

by Srini Penchikala Follow 37 Followers on  Apr 28, 2015

Apache Flink is a distributed data flow processing system for performing analytics on large data sets. It can be used for real time data streams as well as batch data processing. It supports APIs in Java and Scala programming languages. Fabian Hueske, PMC member of Apache Flink, spoke about the data processing framework at the recent ApacheCon Conference.

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT