Docker Inc. has presented Docker Engine 1.9 at DockerCon EU, which has taken place this month in Barcelona. This new release, which Docker announced at the beginning of the month, includes major changes on networking and volume management. Docker Swarm is ready for production and several improvements were made in Docker Compose, Docker Toolbox and Docker Registry.
Earlier last month in Las Vegas, at IBM Insight 2015, IBM announced a major commitment to the Apache Spark project. Referring to it as “potentially the most significant open source project of the next decade” tells a lot about how important IBM believes Apache Spark is. With IDC reporting that 80% of cloud applications in the future will be data intensive, Apache Spark can unlock previously...
About the same time Google announced open sourcing TensorFlow, Microsoft has pushed to GitHub DMTK, a Distributed Machine Learning Toolkit. While Google has released a one-machine version of TensorFlow, DMTK runs on a cluster of machines.
Fin Kingma talked about motivation and how the success of agile relies on driven people at the Agile Testing Days 2015.
TensorFlow is a machine learning library created by the Brain Team researchers at Google and now open sourced under the Apache License 2.0. TensorFlow is detailed in the whitepaper TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. The source code can be found on Google Git.
Google recently announced they are adding features to its cloud platform that will enable integration between its cloud-based log service and its cloud monitoring service. The intent of providing these capabilities is to allow customers to efficiently move between the Cloud Logging and Cloud Monitoring services when discovering the health of their own services.
At its 2015 Partners User Group Conference, Teradata announced two new software capabilities for real-time ingestion and analysis of massive streams of IoT data. While the Teradata Listener software enables "listening" to multiple, diverse IoT data streams in real time, the new Teradata Aster Analytics on Hadoop software provides scalable analysis of massive IoT data streams.
We want customer sentiment to drive product development. Hypothesis proven by experiments are the best to discover customer sentiment. That's how Stuart Frisby, principal designer at booking.com, argued for extensive use of A/B testing to the OSCON attendees in Amsterdam. Frisby explained what A/B testing done right looks like, what common mistakes to avoid and when A/B testing is not appropiate.
Amazon Web Services have released a series of updates for the Amazon EC2 Container Service (ECS) that include an ECS command line interface, Docker Compose support, task definitions that allow additional Docker configuration options, and an ECS scheduler update that adds support for availability zone awareness.
Twitter is using replicated logs for high performance data collection and analysis of its systems. DistributedLog is the system developed at Twitter for this purpose. Twitter has developed a distributed key-value database, Manhattan. Manhattan can trade consistency for latency in reads following the eventually consistent data model. We examine Twitter's design and tradeoffs for DistributedLog.
Amazon has announced QuickSight at AWS Re:invent conference. QuickSight a complete Business Intelligence solution to help customers gain insights from the data they have stored in AWS.
At Salesforce’s recent Dreamforce conference, the company announced an upcoming IoT platform that will allow for the ingestion of real time data and turn it into actionable tasks across its suite of cloud based services.
At the inaugural HashiConf conference, held in Portland, USA, HashiCorp announced the release of a new distributed scheduler platform named ‘Nomad’ that is capable of scheduling containers, VMs and standalone applications; and a new application delivery tool named ‘Otto’ that builds upon the existing Vagrant tool by enabling the management of remote application deployments.
Force12.io have released a prototype ‘microscaling’ container demonstration running on the Apache Mesos cluster manager, which they claim starts and stops ‘priority 1’ and ‘priority 2’ containers more rapidly than traditional autoscaling approaches when given a simulated demand for the differing workloads. InfoQ discussed the goals and methodology of this approach with Force12.io’s Ross Fairbanks.
Based on their experience with arbitrarily shutting down servers or simulating the shutdown of an entire data center in production, Netflix has proposed a number of principles of chaos engineering.