InfoQ Homepage Distributed Systems Content on InfoQ
-
Gutenberg – a Publish-Subscribe Service for Datasets Created by Netflix
To propagate datasets from a single producer to multiple consumers, Netflix has created Gutenberg, a service using a publish-subscribe technique to propagate versioned datasets between their microservices. In a blog post, Ammar Khaku, senior software engineer at Netflix, describes an overview of the design as well and some use cases for Gutenberg.
-
Extending the Reach of SQL to IoT Microcontrollers, ITTIA and Cypress Release SDK
In a recent press release, ITTIA, a maker of embedded database software for Internet of Things (IoT) devices, and Cypress Semiconductor Corp, announced a collaborative IoT device and data management capability. The new capability integrates SQL into the WICED SDK and unlocks the power of flash media on Cypress wireless microcontrollers (MCU).
-
Minimizing Backend Complexity with Dark: A New Language with Integrated Editor and Infrastructure
Dark aims to simplify the development of backends by minimizing complexity. Dark is a programming language with an integrated editor and infrastructure for developing and delivering backend applications.
-
Improving Blockchain Performance Off-Chain, Hyperledger Announces Avalon
In a recent blog post, the Hyperledger project announced a new project, called Hyperledger Avalon, that addresses some of the scalability and privacy challenges that are currently associated with many blockchain projects. The projects seek to address these scalability and privacy challenges through the use of trusted off-chain processing, while ensuring the transactions are secure and resilient.
-
Sense and Nonsense in Event Thinking and Microservices
Modularity in the systems we are building is very important, but there are anti-modularity forces that we must deal with to be able to achieve this modularity. In a presentation at the recent Event-driven Microservices Conference, held by AxonIQ, Allard Buijze shared his thoughts and experience building systems based on DDD, CQRS, microservices and event sourcing.
-
Day Two Problems When Using CQRS and Event Sourcing
There are a lot of good reasons for building a CQRS and event-sourcing based system, but there are also problems that appear only after an application is in production. In a presentation at the recent Event-driven Microservices Conference held by AxonIQ, Joris Kuipers shared his experience running and evolving CQRS and event sourced applications in production.
-
Google Releases Cloud Dataproc for Kubernetes in Alpha
Google Cloud Dataproc is an open-source data and analytic processing service based on Hadoop and Spark. Google has recently announced the alpha availability of Cloud Dataproc for Kubernetes, which provides customers with a more efficient method to process data across platforms.
-
ApacheCon 2019 Keynote: Google Cloud Enhances Big-Data Processing with Kubernetes
At ApacheCon North America, Christopher Crosbie gave a keynote talk title "Yet Another Resource Negotiator for Big Data? How Google Cloud is Enhancing Data Lake Processing with Kubernetes." He highlighted Google's efforts to make Apache big-data software "cloud native" by developing open-source Kubernetes Operators to provide control planes for running Apache software in a Kubernetes cluster.
-
Reactive Foundation Launched under the Linux Foundation
The Linux Foundation announced the launch of the Reactive Foundation, a community of leaders established to accelerate technologies for building the next generation of networked applications. The foundation is made up of Alibaba, Facebook, Lightbend, Netifi and Pivotal as initial members, and includes the successful open source Reactive Streams and RSocket specifications.
-
Google Introduces Cloud Storage Connector for Hadoop Big Data Workloads
In a recent blog post, Google announced a new Cloud Storage connector for Hadoop. This new capability allows organizations to substitute their traditional HDFS with Google Cloud Storage. Columnar file formats such as Parquet and ORC may realize increased throughput, and customers will benefit from Cloud Storage directory isolation, lower latency, increased parallelization and intelligent defaults
-
Reasons for Cancelling a Move to Microservices
During a period in which Steven Lemon and his team had less features to implement, the technical leadership at the company decided to move their existing monolith into a microservices architecture. After a month of preparation, they realized that microservices would be hurting their development process. They decided to stay with the monolith and Lemon recently wrote a case study of their findings.
-
Characteristics of Serverless Architecture
Too much of the current literature dealing with serverless architecture is driven by cloud providers and focuses only on the benefits, Wisen Tanasa writes in a recent blog post. When a new technology emerges, it's important to understand the implications of adopting it, and Tanasa therefore tries to give a better, more objective understanding of the traits of serverless architecture.
-
Data Engineering in Badoo: Handling 20 Billion Events Per Day
Badoo is a dating social network that currently handles billions of events per day, explains Vladimir Kazanov, data platform engineering lead. At Skills Matter, he talked through some of the challenges of operating at this scale, and what tooling Badoo uses in order to process and report on this data.
-
Going from Microservices to Serverless: Phil Calçado at QCon New York
At several points throuhgout his career, Phil Calçado, who has experience working with SoundCloud, Meetup and SeatGeek, has worked on transitioning monoliths to a microservices architecture. Recently, the challenge has instead been migrating to serverless. In a presentation at the recent QCon New York conference, he talked about his experience combining the serverless concept with microservices.
-
Microsoft, Salesforce and the Ethereum Foundation Join Open-Source Hyperledger Blockchain Project
In a recent press release, Hyperledger, an open-source blockchain and distributed ledger project, announced eight new members have joined their consortium including Microsoft, Salesforce and the Ethereum Foundation. These organizations join established members like Airbus, Cisco, IBM and Intel.