BT

DistributedLog at Twitter for High Performance Logging

by Alex Giamas on  Oct 20, 2015

Twitter is using replicated logs for high performance data collection and analysis of its systems. DistributedLog is the system developed at Twitter for this purpose. Twitter has developed a distributed key-value database, Manhattan. Manhattan can trade consistency for latency in reads following the eventually consistent data model. We examine Twitter's design and tradeoffs for DistributedLog.

Amazon Announces QuickSight - Business Intelligence for Big Data on AWS

by Matt Kapilevich on  Oct 09, 2015

Amazon has announced QuickSight at AWS Re:invent conference. QuickSight a complete Business Intelligence solution to help customers gain insights from the data they have stored in AWS.

Salesforce Enters IoT Market

by Kent Weare on  Oct 01, 2015

At Salesforce’s recent Dreamforce conference, the company announced an upcoming IoT platform that will allow for the ingestion of real time data and turn it into actionable tasks across its suite of cloud based services.

HashiCorp Release Nomad Scheduler and Otto Application Delivery Tool

by Daniel Bryant on  Sep 28, 2015

At the inaugural HashiConf conference, held in Portland, USA, HashiCorp announced the release of a new distributed scheduler platform named ‘Nomad’ that is capable of scheduling containers, VMs and standalone applications; and a new application delivery tool named ‘Otto’ that builds upon the existing Vagrant tool by enabling the management of remote application deployments.

Force12.io Create a ‘Microscaling’ Framework for Apache Mesos

by Daniel Bryant on  Sep 27, 2015

Force12.io have released a prototype ‘microscaling’ container demonstration running on the Apache Mesos cluster manager, which they claim starts and stops ‘priority 1’ and ‘priority 2’ containers more rapidly than traditional autoscaling approaches when given a simulated demand for the differing workloads. InfoQ discussed the goals and methodology of this approach with Force12.io’s Ross Fairbanks.

Netflix’ Principles of Chaos Engineering

by Abel Avram on  Sep 26, 2015

Based on their experience with arbitrarily shutting down servers or simulating the shutdown of an entire data center in production, Netflix has proposed a number of principles of chaos engineering.

Hortonworks Addresses the IoAT with DataFlow Based on NiFi

by Abel Avram on  Sep 25, 2015

Hortonworks has quietly made available the DataFlow platform which is based on Apache NiFi and attempts to solve the processing needs of the IoAT.

SpringXD being Re-architected and Re-branded to Spring Cloud Data Flow

by Charles Humble on  Sep 25, 2015

Pivotal announced a complete re-design of Spring XD, its big data offering, during last week’s SpringOne2GX conference, with a corresponding re-brand from Spring XD to Spring Cloud Data Flow. The new product is focussed on orchestration.

Splunk for DBAs

by Jonathan Allen on  Sep 24, 2015

The DBA’s primary job is to ensure that the business’s information is always available, with performance coming in at close second. We’ve already talked about optimizing distributed queries in Splunk and map-reduce queries in Hunk. In this report we expand upon that with more information that a DBA needs to know about Splunk databases.

Nginx Announces nginScript, a JavaScript-based Configuration Language

by David Iffland on  Sep 24, 2015

At this year's nginx.conf, Nginx has announced a preview of nginScript, a JavaScript-based server configuration language. Meant to accompany existing scripting offerings like Lua, nginScript will give technologists with experience in JavaScript a lower barrier to entry to create more advanced configuration and delivery options.

Optimizing Distributed Queries in Splunk

by Jonathan Allen on  Sep 23, 2015

Optimizing queries in Splunk’s Search Processing Language is similar to optimizing queries in SQL. The two core tenants are the same: Change the physics and reduce the amount of work done. Added to that are two precepts that apply to any distributed query.

Big Data Architecture: Push, Pull, or Search in Place?

by Jonathan Allen on  Sep 23, 2015

A surprisingly common theme at the Splunk Conference is the architectural question, “Should I push, pull, or search in place?”

Architecture, Tuning, and Troubleshooting a Splunk Indexer Cluster

by Jonathan Allen on  Sep 23, 2015

If you could handle all of the data you need to work with on one machine, then there is no reason to use big data techniques. So clustering is pretty much assumed for any installation larger than a basic proof of concept. In Splunk Enterprise, the most common type of cluster you’ll be dealing with is the Indexer Cluster.

Hunk/Hadoop: Performance Best Practices

by Jonathan Allen on  Sep 23, 2015

When working with Hadoop, with or without Hunk, there are a number of ways you can accidentally kill performance. While some of the fixes require more hardware, sometimes the problems can be solved simply by changing the way you name your files.

Introducing Splunk IT Service Intelligence

by Jonathan Allen on  Sep 22, 2015

Splunk is jumping into the service-monitoring sector with a new visualization called IT Service Intelligence.

General Feedback
Bugs
Advertising
Editorial
Marketing
InfoQ.com and all content copyright © 2006-2015 C4Media Inc. InfoQ.com hosted at Contegix, the best ISP we've ever worked with.
Privacy policy
BT