Articles

Peter Cnudde on How Yahoo Uses Hadoop, Deep Learning and Big Data Platform

Yahoo uses Hadoop for different use cases in big data & machine learning areas. They also use deep learning techniques in their products like Flickr. InfoQ spoke with Peter Cnudde on how Yahoo leverages big data platform technologies.

Spark GraphX in Action Book Review and Interview

“Spark GraphX in Action” book from Manning Publications, authored by Michael Malak and Robin East, provides a tutorial based coverage of Spark GraphX, the graph data processing library from Apache Spark framework. InfoQ spoke with authors about the book and Spark GraphX library as well as overall Spark framework and what's coming up in the area of graph data processing and analytics.

Big Data Processing with Apache Spark - Part 4: Spark Machine Learning

In this fourth installment of Apache Spark article series, author Srini Penchikala discusses machine learning concepts and Spark MLlib library for running predictive analytics using a sample application.

Spark in Action Book Review & Interview

In the "Spark in Action" book, authors Petar Zecevic and Marko Bonaci discuss the Apache Spark framework for data processing (batch and streaming data use cases). They introduce the architecture of Spark and core concepts such as Resilient Distributed Datasets (RDDs). InfoQ spoke with them about Apache Spark, developer tools, and the upcoming features and enhancements in the future releases.

Will AI Surpass Human Intelligence? Interview with Prof. Jürgen Schmidhuber on Deep Learning

Health Informatics and Survival Prediction of Cancer with Apache Spark Machine Learning Library

In this article, author discusses the survival prediction of colorectal cancer as a multi-class classification problem and how to solve that problem using the Apache Spark's MLlib Java API.

Machine Learning and Cognitive Computing

Based on a webinar on analytics, this article covers the topics of machine learning and cognitive computing, and how these fields are related to artificial intelligence (AI). Panelists discuss how this technology is being applied in digital marketing space and what concerns organizations have in providing machine learning services.