LinkedIn’s Joel Koshy details their Kafka usage, debugging and monitoring two production incidents in using the core Kafka infrastructure concepts, semantics and behavioral patterns to plan for and detect similar problems in the future.
Moving applications to the cloud has somewhat become commodity in the meantime - not only for big players, but also for smaller companies that rely on flexibility and resource utilization. In his presentation "Implementing Infrastructure as Code", Kief Morris, cloud practice lead at ThoughWorks, shares some key principles and recommendations on how to leverage cloud based infrastructure.
Windows Management Instrumentation (WMI) is a primary source of data when monitoring Windows systems. Given that the performance counters available vary from machine to machine, a tool is needed to list all counters available. The WMI type provider is one possible option to explore WMI performance counters.
LinkedIn recently detailed open-sourced Kafka Monitor service that they're using to monitor production Kafka clusters as well as extensive testing automation, leading them to identify bugs in the main Kafka trunk and contribute solutions to the open-source community.
As part of the ongoing transition to the module system, CORBA and other Java EE modules won't be included in the default classpath from Java 9 onwards. These modules will still be available, but specific command line flags will have to be used to be able to use them. The change will only affect non-modular applications targeting Java 9, for modular ones already need to indicate their dependencies.
RightScale published the results of its survey report highlighting the devops trends in the industry. Docker, Puppet and Chef dominate the tools market, with Docker adoption rising in the enterprise.
Jenkins recently announced a partnership with Microsoft to run its project infrastructure on Azure. Moving to Azure will enable elastic workloads as well as additional resources for Jenkins services.
AWS recently added a new instance type with nearly 2 terabytes of memory and 128 virtual CPUs. This is the largest virtual server available today in the public cloud, and is a target for memory-intensive workloads such as SAP HANA.
The NOLOCK directive was broken in Cumulative Update #6 for SQL Server 2014 SP1. As a result, databases that relied on that directive may experience unexpected blocking and/or deadlocks.
The next phase of DevOps will involve collaboration between engineering and non-engineering teams.
A major vulnerability in CoreOS Linux Alpha has been patched, with the security team saying the issue was limited to versions 104x.0.0 of the Linux distribution. Principal security engineer for CoreOs, Matthew Garrett, said users needed to be confident that CoreOS were not "shipping alpha releases with gaping security issues, it is a big deal when we fail in that respect."
Matthew (Ford) Kern and Miko have both recently written posts on the topic "Agile is Dead". Matthew relates it to the saturation of agile consulting and the speed of hype cycles. Miko links it to a need to go faster than the approaches embodied in the agile movement and replace agile with DevOps.
Round up of the talks at DevOps Days Kiel's second day.
Apprenda have announced the offering of a commercial Kubernetes distribution alongside enterprise support subscriptions for running Kubernetes in production. These two offerings have been added to Apprenda’s PaaS portfolio primarily via the acquisition of Kismatic Inc, a company that specialises in the deployment and management of Kubernetes within enterprise organisations.
Supergiant is a container hosting platform built using Kubernetes for distributed, stateful applications.