BT

New Early adopter or innovator? InfoQ has been working on some new features for you. Learn more

Data Science Follow 178 Followers

Dani Traphagen on Next Phase of Distributed Systems with Apache Ignite

by Srini Penchikala Follow 12 Followers on  May 15, 2017

Dani Traphagen from GridGain spoke at OSCON 2017 Conference about Apache Ignite platform. She talked about the paradigm shift in viewing the disk as a bottleneck, the decreasing costs of memory and how to optimize toward the cache, leveraging it for microservices architectures with the open source project Apache Ignite.

Architecture & Design Follow 426 Followers

John Gossman on Microsoft’s Serverless Platform, Azure Functions and Logic Apps

by Srini Penchikala Follow 12 Followers on  Apr 28, 2017

John Gossman, lead architect at Microsoft Azure, spoke on Thursday at ServerlessConf Conference about Microsoft's open source Serverless platform. The Microsoft team also gave demos on Azure Functions, Logic Apps and how to monitor the platform components.

Architecture & Design Follow 426 Followers

Overview of the Reliable Event Delivery System at Spotify

by Jan Stenberg Follow 6 Followers on  Mar 31, 2017

Spotify clients generate up to 1.5 million events per second at peak hours and all are handled by their Event Delivery System, designed to have a predictable latency and to never lose an event, Igor Maravic noted in his presentation at the recent QCon London conference, where he gave a high level overview of the system and some of the key operational aspects.

Architecture & Design Follow 426 Followers

Concurrent and Distributed Programming in the Future

by Jan Stenberg Follow 6 Followers on  Mar 15, 2017

The world is concurrent with everything around us asynchronous and event oriented. Concurrency and the cloud are things every developer will have to deal with in the future, Joe Duffy claimed in his keynote at the recent QCon London conference. At the heart of this is communication, which is essential both for concurrent and distributed systems.

Java Follow 203 Followers

Hazelcast Release Jet, Open-Source Stream Processing Engine

by Ben Evans Follow 10 Followers on  Feb 08, 2017

Hazelcast, previously known for the open-source caching and in-memory data grid technologies, has announced a major release of their new stream processing engine, Jet.

DevOps Follow 150 Followers

Chaperone - A Kafka Auditing Tool from the Uber Engineering Team

by Hrishikesh Barua Follow 4 Followers on  Jan 26, 2017 2

The Uber Engineering team released their Kafka auditing tool called Chaperone as an open-source project. Chaperone allows for auditing and detection of data loss, latency, and duplication of messages in the multi-datacenter and high-volume Kafka setup at Uber.

Data Science Follow 178 Followers

Apache Eagle, Originally from eBay, Graduates to top-level project

by Alexandre Rodrigues Follow 0 Followers on  Jan 24, 2017

Apache Eagle, an open-source solution for identifying security and performance issues on big data platforms, graduates to Apache top level project on January 10, 2017. Firstly open-sourced by eBay on October 2015, Eagle was created to instantly detect access to sensitive data or malicious activities and, to take actions in a timely fashion.

Architecture & Design Follow 426 Followers

Moving a Monolithic Application towards a Microservices Architecture

by Jan Stenberg Follow 6 Followers on  Dec 31, 2016

Migrating an existing system towards microservices is very different from building a new micoservices-based system, Joris Kuipers, architect at Trfork Amsterdam, claims in a presentation describing an ongoing process of refactoring a large monolithic application, based on CQRS using Axon framework, towards a microservices architecture.

Architecture & Design Follow 426 Followers

Start with Events and DDD When Building Microservices

by Jan Stenberg Follow 6 Followers on  Dec 28, 2016 2

Domain-Driven Design (DDD) is a great technique bringing designs closer to the domains we are working in, but too often we make early decisions with a focus on structure, which is not the intention of DDD. Instead we should start with the events in a domain, Russ Miles claims when describing the advantages of going “events-first” when building microservices.

Data Science Follow 178 Followers

Julien Nioche on StormCrawler, Open-Source Crawler Pipelines Backed by Apache Storm

by Alexandre Rodrigues Follow 0 Followers on  Dec 15, 2016

Julien Nioche, director of DigitalPebble, PMC member and committer of the Apache Nutch web crawler project, talks about StormCrawler, a collection of reusable components to build distributed web crawlers based on the streaming framework Apache Storm. InfoQ interviewed Nioche, main contributor of the project, to find out more about StormCrawler and how it compares to other similar technologies.

Cloud Follow 42 Followers

Azure Functions Reach General Availability

by Kent Weare Follow 6 Followers on  Dec 10, 2016 2

Microsoft recently announced an addition to its Platform as a Service (PaaS) offering called Azure Functions. Initially launched as a preview service in March 2016, Azure Functions provide developers with an event-driven serverless compute platform that allow organizations to pay for only what they consume.

Data Science Follow 178 Followers

Microservices and Stream Processing Architecture at Zalando Using Apache Flink

by Srini Penchikala Follow 12 Followers on  Oct 31, 2016 1

Javier Lopez and Mihail Vieru spoke at Reactive Summit 2016 Conference about cloud-based data integration and distribution platform used for stream processing in business intelligence use cases. Their solution is based on technologies such as Flink, Kafka and Elasticsearch.

Data Science Follow 178 Followers

Stream Processing and Lambda Architecture Challenges

by Alexandre Rodrigues Follow 0 Followers on  Oct 19, 2016 4

Lambda architecture has been a popular solution that combines batch and stream processing. Kartik Paramasivam at LinkedIn wrote about how his team addressed stream processing and Lambda architecture challenges using Apache Samza for data processing. The challenges described are the late arrival of events and the processing of duplicated messages.

Development Follow 83 Followers

Microsoft Open-Sources P Language for Safe Async Event-Driven Programming

by Sergio De Simone Follow 4 Followers on  Oct 12, 2016 1

Microsoft’s recently open-sourced P language aims to make it possible to write safe asynchronous event-driven programs on Linux, macOS, and Windows.

Data Science Follow 178 Followers

Reactive Summit 2016 Conference: Reactive Microservices and Staging Data Pipelines

by Srini Penchikala Follow 12 Followers on  Oct 08, 2016

Reactive microservices, data center scale operating system (DCOS), and staging reactive data pipelines were the highlighted topics at Reactive Summit 2016 Conference held this week. InfoQ team attended the conference and this post is a summary of the first day's events at the conference.

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT