BT

Glenn Tamkin on Applying Apache Hadoop to NASA's Big Climate Data

by Srini Penchikala on  May 06, 2015

NASA Center for Climate Simulation (NCCS) is using Apache Hadoop for high-performance data analytics. Glenn Tamkin from NASA team, recently spoke at ApacheCon Conference and shared the details of the platform they built for climate data analysis with Hadoop.

Adatao Launches Full Stack Data Intelligence Platform

by Alex Giamas on  May 04, 2015

Adatao recently announced the general availability of its Data Intelligence platform. Its platform aims to make data analysis and predictive analytics available to everyone in large organizations. Adatao had secured an investment of $13 million last year from a group of investors including Bloomberg Beta, Lightspeed Venture Partners and Andreessen Horowitz.

Real-time Data Analytics at Pinterest using MemSQL and Spark Streaming

by Srini Penchikala on  Mar 29, 2015

Pinterest, the company behind the visual bookmarking tool that helps you discover and save creative ideas, is using real-time data analytics for data-driven decision making purposes. It’s experimenting with MemSQL and Spark technologies for real-time user engagement across the globe.

Splunk Enterprise 6.2 Supports Instant Pivot and Enhanced Event Pattern Detection

by Srini Penchikala on  Dec 21, 2014

The latest version of big data analytics tools Splunk Enterprise and Hunk support instant pivot, enhanced event pattern detection, and prebuilt dashboard panels. Splunk Inc., provider of the software platform for operational intelligence, recently announced the general availability (GA) of version 6.2 of Splunk Enterprise and Hunk: Splunk Analytics for Hadoop and NoSQL Data Stores.

LinkedIn Open Sources Cubert With an Eye To Big Data Analytics

by Alex Giamas on  Dec 17, 2014

LinkedIn recently open sourced Cubert, its High Performance Computation Engine for Complex Big Data Analytics. Cubert is a framework written for analysts and data scientists in mind.Developed completely in Java and expressed as a scripting language, Cubert is designed for complex joins and aggregations that frequently arise in the reporting world.

Microsoft Expands Azure Machine Learning and Real Time Analytics Offering

by Alex Giamas on  Oct 31, 2014

Microsoft recently announced new machine learning capabilities for Microsoft Azure platform. Developers can also create their own web services and publish them to Azure Marketplace. Microsoft also announced availability of Apache Storm for Azure. Azure Stream Analytics, Data Factory and Event Hubs for Azure were all announced in the past few weeks by Microsoft. In this article we explore moreabout

Drone Data Adds a New Horizon for Big Data Analytics

by Abhishek Sharma on  Sep 10, 2014

Usage of data generated by drones is going to add a new horizon in data storage and processing. Kirk Borne, professor at George Mason University recently talked about the challenge of processing, storing and transferring this data.

IBM: 70% of Enterprises Are Using Big Data, Cloud, Mobile and Social

by Abel Avram on  Aug 26, 2014 3

With Raising the game - The IBM Business Tech Trends Study (PDF) IBM has evaluated the current adoption landscape of 4 key technologies in the enterprise: Big Data & Analytics, Cloud, Mobile and Social, comparing today’s adoption with 2012’s and Pacesetters against Dabblers.

Missing Backend Services for Mobile

by Manuel Pais on  Jul 22, 2014

Jesper Richter-Reichhelm, Head of Engineering at Wooga, spoke at GOTO Amsterdam 2014 about unexpected difficulties to find commoditized back end services that suited Wooga's mobile games needs. Combining reasonable cost, integration with an existing tool chain and transparent access to data proved impossible more often than not, leading to in-house development of said services.

Ayasdi Partners with Cloudera

by Jérôme Serrano on  Jun 06, 2014

Ayasdi announced last month a partnership with Cloudera, the biggest distributor of Apache Hadoop. The partnership will ensure the compatibility of their solution with Cloudera Enterprise 5, the latest version of Cloudera’s big data platform based on Apache Hadoop.

DataTorrent 1.0 Handles >1B Real-time Events/sec

by Abel Avram on  Jun 03, 2014 7

DataTorrent is a real-time streaming and analyzing platform that can process over 1B real-time events/sec.

Splunk's Hunk 6.1 Brings New Capabilities for Big Data Analytics

by Matt Kapilevich on  May 21, 2014

Splunk, a company specializing in searching, monitoring, and analyzing machine-generated data, has announced the release of Hunk 6.1. Hunk provides an analytics platform for big data. The new release also provides streaming resource libraries to connect Hunk to any NoSQL data store, such as Apache Cassandra, MongoDB, and Neo4j.

Spark Officially Graduates From Apache Incubator

by Alex Giamas on  Feb 28, 2014

Recently, Spark graduated from the Apache incubator. Spark claims up to 100x speed improvements over Apache Hadoop over in-memory datasets and gracefully falling back to 10x speed improvement for on-disk performance. Based on Scala, it can run SQL queries and be used directly in R. It provides Machine Learning, Graph database capabilities and other further discussed in the article.

Spark, Storm and Real Time Analytics

by Alex Giamas on  Jan 31, 2014 2

Hadoop is definitely the platform of choice for Big Data analysis and computation. While data Volume, Variety and Velocity increases, Hadoop as a batch processing framework cannot cope with the requirement for real time analytics. Spark, Storm and the Lambda Architecture can help bridge the gap between batch and event based processing.

Forecasting at Twitter

by Manuel Pais on  Dec 30, 2013

Arun Kejariwal, from Twitter, talked at Velocity Conf London last month about forecasting algorithms used at Twitter to proactively predict system resource needs as well as business metrics such as number of users or tweets. Given the dynamic nature of their data stream, they found that a refined ARIMA model works well once data is cleansed, including removal of outliers.

General Feedback
Bugs
Advertising
Editorial
Marketing
InfoQ.com and all content copyright © 2006-2015 C4Media Inc. InfoQ.com hosted at Contegix, the best ISP we've ever worked with.
Privacy policy
BT