Big data vendors Hortonworks, IBM, and Pivotal recently announced that their Hadoop based platform products will use the common Open Data Platform (ODP). They made the announcement at the recent HadoopSummit Europe Conference of the open platform which includes Apache Hadoop 2.6 (HDFS, YARN, and MapReduce) and Apache Ambari software.
Docker, Inc. has announced the release of Docker Engine 1.6, Registry 2.0, Compose 1.2, Swarm 0.2, and Machine 0.2. This release targets improved developer experience and performance.
Microsoft continues its push to adapt to the new realities brought about by the containers tsunami, having recently announced the Nano Server, a "minimal footprint" Windows Server, and Hyper-V containers, which provide virtual machine isolation capabilities to containers. The Nano Server has 92 percent fewer critical bulletins and requires 80 percent fewer reboots than a typical Windows Server.
At the inaugural O’Reilly Software Architecture conference, Bryan Cantrill shared lessons learnt from building a business around the early adoption of OS-virtualised containers. Core advice included; don’t innovate in too many directions at once; identify the technical differentiators, and focus on ease of use/adoptions for everything else; and don’t give up - technological revolutions take time.
Google announced the general availability of Cloud DNS, expanded locations for load balancing, additional carrier providers for peering, beta availability of Cloud Dataflow and VPN services
Amazon Web Services have recently launched their Amazon Machine Learning service that allows users to learn predictive models in the cloud. After Google with Prediction API, and Microsoft with Azure Machine Learning, Amazon is the latest major cloud service provider to launch a similar service.
Google has published the paper "Large-scale cluster management at Google with Borg", unveiling details on a technology that was very little spoken about in the past.
Atlassian recently released Stash Data Center, a highly available and horizontally scalable deployment option for its on-premises source code and Git repository management solution Stash. New nodes can be added without downtime to provide active-active clustering and instant scalability.
This post talks about using an agile implementation for data warehouse projects.
Twitter recently announced that it has cut-off their firehose data distributor DataSift. This move echoes Twitter's controversial 2012 API changes which restricted the Twitter client ecosystem. There is much speculation as to whether this latest announcement is an attempt to control the tweet analytics space and whether or not this is behaviour fitting of a platform provider.
Recently Adrian Cockcroft gave an interview to ActiveState's John Wetherill about microservices. In it he talks about how polyglot fits into microservices and the impact on him when he head that companies such as Target and Macy's, as well as Homeland Security had adopted that architectural approach.
DevOps promises to break down the barriers between the developers and the systems operators, but success with DevOps hinges on the company's culture and flexibility.
After three developer previews, six release candidates and over 1500 closed tickets the Apache foundation has announced version 1.0 of Apache HBase, a NoSQL database in the Hadoop ecosystem. After more than 7 years of active development, the team behind HBase felt that the project had matured and stabilized enough to warrant a 1.0 version.
Avishai Ish-Shalom talked about the importance of moving from agile cargo cult to agile organizations at DevOps Days Ljubljana 2015. He gives some practical examples and guidance for taking full advantage of Conway's Law.
DevOps Days Ljubljana 2015 took place on the 3rd and 4th April and talks covered the full CAMS spectrum: Culture, Automation, Measurement and Sharing.