InfoQ Homepage Distributed Systems Content on InfoQ
-
Azure Blockchain Workbench 1.6.0 Update Streamlines Development Experience
In a recent blog post, Microsoft announced an update to their Azure Blockchain Workbench service which improves the development experience of building consortium-based blockchain applications. More specifically, this update includes new features such as application versioning, updated messaging capabilities and streamlined smart contract development.
-
Simplifying Blockchain Security Using Hyperledger Ursa
In a recent blog post, the Hyperledger project announced that their latest project, Hyperledger Ursa, has been accepted by the Technical Steering Committee (TSC). Ursa’s primary objective is to simplify and consolidate cryptographic libraries in a trusted, consumable manner for use in distributed ledger technology projects in an interoperable way.
-
The Evolution of Uber’s 100+ Petabyte Big Data Platform
Uber’s engineering team wrote about how their big data platform evolved from traditional ETL jobs with relational databases to one based on Hadoop and Spark. A scalable ingestion model, standard transfer format and a custom library for incremental updates are the key components of the platform.
-
Cloudera and Hortonworks Merge with Goal to Increase Competition with Cloud Offerings
Earlier this month, Cloudera and Hortonworks announced an all-stock merger at a combined value of around $5.2 billion. Analysts have argued that this merger is aimed at increased competition that both companies are facing from cloud vendors like Amazon, Google and Microsoft. In this article we log reactions from analysts and the industry, and the implications for current customers.
-
Q&A with Microsoft's Arindam Chatterjee Discussing Azure HDInsight 4.0
InfoQ caught up with Arindam Chatterjee, principal group manager at Microsoft, regarding the announcements about HDInsight at Microsoft Ignite.
-
Uber Open Sources JVM Profiler for Tracing Distributed JVMs
Uber open sourced a distributed profiler called JVM Profiler in late June. They built JVM Profiler to solve resource allocation issues they had with Apache Spark. Apache Spark is a popular framework for processing large data streams, of which Uber has many. JVM Profiler was built for Spark, but it's applicable to any JVM-based service or application.
-
Q&A with Saumitra Buragohain on Hortonworks Data Platform 3.0
InfoQ caught up with Saumitra Buragohain, senior director of Product Management at Hortonworks, regarding Hadoop in general and HDP 3.0 in particular.
-
Hazelcast Releases Jet 0.6 for Stream and Fast Batch Processing
Hazelcast, maker of distributing computing technologies and tools, have released a new major version (version 0.6) of Jet, their open-source streaming processing engine.
-
Dataiku's Latest Release Integrates Deep-Learning for Computer Vision
Collaborative data science platform Dataiku's latest release of its Data Science Studio includes pre-trained deep learning models for image processing. The DSS platform implements each step of a data-science project from data-sourcing and visualization to production deployment. Its machine-learning module supports standard libraries and it integrates with Hadoop and multiple Spark engines.
-
The Future of Microservices as the IT World Changes: Uwe Friedrichsen at microXchg Berlin
You have finally mastered Microservices, including Docker and Kubernetes, and some other new cool trends. But are you prepared for the future, Uwe Friedrichsen asked in his presentation at microXchg 2018 in Berlin where he explored the future of IT and the consequences for microservices.
-
Designing Reactive Systems Using DDD, Event Storming and Actors
Domain-driven design (DDD) is often used for finding boundaries (bounded contexts) around microservices. But everything in domain-driven design (DDD) is not good for microservice, Lutz Huehnken claimed in a presentation at microxchg 2018 in Berlin where he discussed how DDD, Event Storming and the Akka-based Lagom framework can be used to build reactive systems.
-
The Maturity of Microservices: MicroXchg Berlin Panel Discussion
In the microservices panel at microXchg 2018 in Berlin, Susanne Kaiser, together with the panel, consisting of Stefan Tilkov, Chris Richardson, Elisabeth Engel and Daniel Bryant, discussed the state of microservices as of today and whether the hype is over — is microservices now a mature technique or is serverless the next step?
-
Stefan Tilkov at microXchg Berlin: Microservice Patterns and Antipatterns
In his presentation at microXchg 2018 in Berlin, Stefan Tilkov explored patterns and antipatterns in microservice projects from his perspective, including Evolutionary Architecture, Decoupling Illusion, Distributed Monolith and Entity Service. He especially noted that some of the patterns he considers to be patterns, other people may see as antipatterns, and the other way around.
-
QCon London: Asynchronous Event Architectures with or without Actors
Synchronous request-response communication in microservices systems can be really complicated. Fortunately, asynchronous event-based architectures can be used to avoid this, Yaroslav Tkachenko claimed in a presentation at QCon London 2018, where he described his experiences with event-driven architectures and how Actors can be used in systems built on this architecture.
-
QCon London: Ensuring Data Consistency in Distributed Systems Using CRDTs
Conflict-free Replicated Data Types (CRDTs) is a family of algorithms for ensuring strong eventual consistency in distributed systems without the use of a centralized server that now has been theoretically proven to work, Martin Kleppmann claimed in a presentation at QCon London 2018, where he explored algorithms allowing people to collaborate on shared documents.