BT

Your opinion matters! Please fill in the InfoQ Survey!

rss
Data Science Follow 378 Followers

Apache Eagle, Originally from eBay, Graduates to top-level project

by Alexandre Rodrigues  Followers on  Jan 24, 2017

Apache Eagle, an open-source solution for identifying security and performance issues on big data platforms, graduates to Apache top level project on January 10, 2017. Firstly open-sourced by eBay on October 2015, Eagle was created to instantly detect access to sensitive data or malicious activities and, to take actions in a timely fashion.

Data Science Follow 378 Followers

Julien Nioche on StormCrawler, Open-Source Crawler Pipelines Backed by Apache Storm

by Alexandre Rodrigues  Followers on  Dec 15, 2016

Julien Nioche, director of DigitalPebble, PMC member and committer of the Apache Nutch web crawler project, talks about StormCrawler, a collection of reusable components to build distributed web crawlers based on the streaming framework Apache Storm. InfoQ interviewed Nioche, main contributor of the project, to find out more about StormCrawler and how it compares to other similar technologies.

Cloud Follow 109 Followers

Apache Storm Reaches 1.0, Brings Improved Performance, Many New Features

by Sergio De Simone Follow 6 Followers on  Apr 14, 2016

Version 1.0 is "a major milestone in the evolution of Apache Storm", writes Apache Software Foundation VP for Apache Storm P. Taylor Goetz, and it includes many new features and improvements. In particular, Goetz claims a 3x–16x boost in performance.

Data Science Follow 378 Followers

Yahoo! Benchmarks Apache Flink, Spark and Storm

by Abel Avram Follow 4 Followers on  Dec 23, 2015

Yahoo! has benchmarked three of the main stream processing frameworks: Apache Flink, Spark and Storm.

Followers

Twitter Has Replaced Storm with Heron

by Abel Avram Follow 4 Followers on  Jun 12, 2015

Twitter has replaced Storm with Heron which provides up to 14 times more throughput and up to 10 times less latency on a word count topology, and helped them reduce the needed hardware to a third.

Followers

Spark, Storm and Real Time Analytics

by Alex Giamas Follow 3 Followers on  Jan 31, 2014 2

Hadoop is definitely the platform of choice for Big Data analysis and computation. While data Volume, Variety and Velocity increases, Hadoop as a batch processing framework cannot cope with the requirement for real time analytics. Spark, Storm and the Lambda Architecture can help bridge the gap between batch and event based processing.

Followers

Twitter Storm: Open Source Real-time Hadoop

by Bienvenido David  Followers on  Sep 26, 2011 5

Twitter has open-sourced Storm, its distributed, fault-tolerant, real-time computation system, at GitHub under the Eclipse Public License 1.0. Storm is the real-time processing system developed by BackType, which is now under the Twitter umbrella.

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT