InfoQ Homepage Architecture Content on InfoQ
-
Staying in Sync: from Transactions to Streams
Martin Kleppmann explores using event streams and Kafka for keeping data in sync across heterogeneous systems, and compares this approach to distributed transactions.
-
Netflix Keystone - How We Built a 700B/day Stream Processing Cloud Platform in a Year
Peter Bakas presents in detail how Netflix has used Kafka, Samza, Docker, and Linux to implement a multi-tenant pipeline processing 700B events/day in the Amazon AWS cloud.
-
Growing Up Unruly
Rachel Davies shares how Unruly keeps their values alive and kicking by employing passionate people. Unruly has grown from a tiny startup to global organisation, being recently acquired by News.
-
Types Working for You, Not against You
Richard Dallaway shows an example of what Scala looks like when using pattern matching over classes, how to encode an idea into types and use advanced features of Scala without complicating the code.
-
Resilient Predictive Data Pipelines
Sid Anand discusses how Agari is applying big data best practices to the problem of securing its customers from email-born threats, presenting a system that leverages big data in the cloud.
-
Microservices for a Streaming World
Ben Stopford discusses using stream processing tools for real-time business apps, handling infinite streams, leveraging high throughput, deploying dynamic, fault-tolerant, and streaming services.
-
Culture and the Games People Play
Roy Rapoport discusses the power of alignment (or lack thereof) using real-world examples, his experience introducing Python in production, and the organizational structures and culture within Netflix
-
Unfrying Your Brain with F#
Andrea Magnorsky discusses active patterns, computation expressions, parsers, using type providers and more. These language features help make code simpler and easier to maintain.
-
The Mechanics of Testing Large Data Pipelines
Mathieu Bastian explores the mechanics of unit, integration, data and performance testing for large, complex data workflows, along with the tools for Hadoop, Pig and Spark.
-
Engineering for the Long Game
Astrid Atkinson discusses approaches to making sure systems and organizations can support continuous innovation, from breaking systems into microservices to engineering for organizational resilience.
-
DDD and Microservices: At Last, Some Boundaries!
Eric Evans introduces a few strategic design concepts and explains how they apply to development of microservices, as a tool for teams trying to grow large systems more coherently.
-
Startup ML: Bootstrapping a Fraud Detection System
Michael Manapat talks about how to choose, train, and evaluate models, how to bridge the gap between training and production systems, and avoiding pitfalls.