BT

New Early adopter or innovator? InfoQ has been working on some new features for you. Learn more

Architecture & Design Follow 484 Followers

Event Architectures and Event Streaming

by Jan Stenberg Follow 6 Followers on  Sep 06, 2017

When moving from a monolithic system to a distributed or microservices system, you commonly also move from a single source of truth in one database to many databases and thus many sources of truth. Using an event architecture and persisting all events as a stream can give back the single source of truth, Ben Stopford claims in one of a series of blog posts about events, event streams and Kafka.

Architecture & Design Follow 484 Followers

Distributed Schedulers with Microservice Architectures

by Andrew Morgan Follow 0 Followers on  Aug 19, 2017

Martin Campbell, microservices scalability expert at DigitalOcean, talked about running a microservice based architecture with a distributed scheduler at MicroXchg Berlin 2017. He focused primarily on the problems encountered along the way, and the tradeoffs between offerings like Kubernetes, Nomad, and Mesos.

Architecture & Design Follow 484 Followers

Process Managers in Event-Based Systems

by Jan Stenberg Follow 6 Followers on  Jul 28, 2017 1

Publishing events to notify about changes in a domain keeps different domains decoupled from each other, but if there really is a logical flow of events it becomes implicit and hard to follow. A better solution is to use a Process Manager to keep track of the overall process, Bernd Rücker stated in his presentation at this year’s DDD eXchange conference.

DevOps Follow 178 Followers

A Comparison of Mapping Approaches for Distributed Cloud Applications

by Hrishikesh Barua Follow 4 Followers on  Jun 29, 2017

An application map is a topology view of the components of a distributed application and the network or interprocess interactions between them. A recent article gives an overview of application mapping approaches adopted by various tools like AppDynamics, OpenTracing and Netsil.

Data Science Follow 212 Followers

FaunaDB: A New Distributed Database from the Team That Scaled Twitter

by Abel Avram Follow 4 Followers on  Mar 24, 2017

Former technical leaders from Twitter and Couchbase have created FaunaDB, a new general-purpose database.

Architecture & Design Follow 484 Followers

Moving Deliveroo from a Monolith to a Distributed System

by Jan Stenberg Follow 6 Followers on  Mar 17, 2017

Deliveroo has grown dramatically the last years, both in terms of business and IT, and is facing a lot of technical challenges with its large monolithic application. The solution is to go distributed, but without microservices, Greg Beech noted in his presentation at the recent QCon London conference, describing their move from a monolith into a distributed system.

Architecture & Design Follow 484 Followers

Concurrent and Distributed Programming in the Future

by Jan Stenberg Follow 6 Followers on  Mar 15, 2017

The world is concurrent with everything around us asynchronous and event oriented. Concurrency and the cloud are things every developer will have to deal with in the future, Joe Duffy claimed in his keynote at the recent QCon London conference. At the heart of this is communication, which is essential both for concurrent and distributed systems.

Architecture & Design Follow 484 Followers

Enterprise Ethereum Alliance Releases Vision Paper

by Kent Weare Follow 7 Followers on  Mar 12, 2017

The newly formed Enterprise Ethereum Alliance has published a Vision Paper outlining “a vision for users and stakeholders to propose, implement, and integrate advances to the Ethereum protocol with support for Enterprise Ethereum protocols.” In this paper the EEA discusses many topics related to Pluggable Consensus, interoperability, Ethereum protocol updates, storage and performance.

Data Science Follow 212 Followers

Apache Flink 1.2 Released with Dynamic Rescaling, Security and Queryable State

by Alexandre Rodrigues Follow 0 Followers on  Feb 15, 2017

Apache Flink 1.2 was announced and features dynamic rescaling, security, queryable state, and more. The release resolved 650 issues, maintains compatibility with all public APIs and ships with Apache Kafka 0.10 and Apache Mesos support. Flink’s dynamic rescaling allows one to change the parallelism of a streaming job or of an operator within the job.

Data Science Follow 212 Followers

Apache HBase 1.3 Ships with Multiple Performance Improvements

by Alexandre Rodrigues Follow 0 Followers on  Jan 30, 2017

Apache HBase 1.3.0 was released mid-January 2017 and ships with support for date-based tiered compaction and improvements in multiple areas, like write-ahead log (WAL), and a new RPC scheduler, among others. The release includes almost 1,700 resolved issues in total.

Data Science Follow 212 Followers

Apache Eagle, Originally from eBay, Graduates to top-level project

by Alexandre Rodrigues Follow 0 Followers on  Jan 24, 2017

Apache Eagle, an open-source solution for identifying security and performance issues on big data platforms, graduates to Apache top level project on January 10, 2017. Firstly open-sourced by eBay on October 2015, Eagle was created to instantly detect access to sensitive data or malicious activities and, to take actions in a timely fashion.

Architecture & Design Follow 484 Followers

Moving a Monolithic Application towards a Microservices Architecture

by Jan Stenberg Follow 6 Followers on  Dec 31, 2016

Migrating an existing system towards microservices is very different from building a new micoservices-based system, Joris Kuipers, architect at Trfork Amsterdam, claims in a presentation describing an ongoing process of refactoring a large monolithic application, based on CQRS using Axon framework, towards a microservices architecture.

Architecture & Design Follow 484 Followers

Focus on the Process, Not on Individual Microservices

by Jan Stenberg Follow 6 Followers on  Dec 18, 2016

The key to success when working with a microservices based distributed system is to focus on the distributed process as a whole, not on the microservices themselves. The services are the least important part, Eric Ess claimed at the recent Microservices Conference in London, in his presentation on how to monitor distributed processes at jet.com.

Data Science Follow 212 Followers

Julien Nioche on StormCrawler, Open-Source Crawler Pipelines Backed by Apache Storm

by Alexandre Rodrigues Follow 0 Followers on  Dec 15, 2016

Julien Nioche, director of DigitalPebble, PMC member and committer of the Apache Nutch web crawler project, talks about StormCrawler, a collection of reusable components to build distributed web crawlers based on the streaming framework Apache Storm. InfoQ interviewed Nioche, main contributor of the project, to find out more about StormCrawler and how it compares to other similar technologies.

Data Science Follow 212 Followers

Julien Le Dem on the Future of Column-Oriented Data Processing with Apache Arrow

by Alexandre Rodrigues Follow 0 Followers on  Dec 08, 2016 1

Julien Le Dem, the PMC chair of the Apache Arrow project, presented on Data Eng Conf NY on the future of column-oriented data processing. Apache Arrow is an open-source standard for columnar in-memory execution. InfoQ interviewed Le Dem to find out the differences between Arrow and Parquet.

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT