Web API Follow 176 Followers

LinkedIn Ordered to Allow Scraping of Public Profile Data

by Shelby Switzer Follow 0 Followers on  Aug 25, 2017

A United States federal judge has ruled that Microsoft’s LinkedIn cannot block third party web scrapers from scraping data from publicly available profiles.

Java Follow 562 Followers

Netflix Introduces Hollow, a Java Library for Processing In-Memory Datasets

by Michael Redlich Follow 8 Followers on  Jan 31, 2017

Netflix recently introduced Hollow, a Java library and toolset for processing in-memory datasets that aren’t characterized as “big data.” A single producer provides datasets from which many consumers have read-only access. The communication mechanism between producer and consumer includes real-time dataset changes.

Data Science Follow 460 Followers

Facebook Builds an Efficient Neural Network Model over a Billion Words

by Alex Giamas Follow 3 Followers on  Dec 12, 2016

Using Neural Networks for sequence prediction is a well-known Computer Science problem with a vast array of applications in speech recognition, machine translation, language modeling and other fields. FB AI Research scientists designed adaptive softmax, an approximation algorithm tailored for GPUs which can be used to efficiently train neural networks over vocabularies of a billion words & beyond.

Data Science Follow 460 Followers

Cloudera Announces Partnership with the Broad Institute

by Dylan Raithel Follow 5 Followers on  Jun 02, 2016

Cloudera announced their partnership with MIT & Harvard's Broad Institute and detailed some of their experience with the Genome Analytics Toolkit pipeline.

Data Science Follow 460 Followers

Yahoo! Benchmarks Apache Flink, Spark and Storm

by Abel Avram Follow 4 Followers on  Dec 23, 2015

Yahoo! has benchmarked three of the main stream processing frameworks: Apache Flink, Spark and Storm.

Culture & Methods Follow 340 Followers

UI Design: Go Out and Get Data

by Ben Linders Follow 13 Followers on  Dec 04, 2015

Chris Atherton did the closing keynote of the GOTO Berlin 2015 conference in which she talked about designing software. She suggests that, in stead of relying on professional opinions on how software should look or work, it can be better to go out and get data from real users. InfoQ interviewed her about designing and testing user interfaces.

Architecture & Design Follow 1138 Followers

Samsung SAMI – a D3 Platform for the IoT

by Abel Avram Follow 4 Followers on  Oct 16, 2015 1

Samsung SAMI is a Data-driven Development (D3) platform for receiving, storing and sending data to/from IoT devices. Any device can send data in various formats which is then normalized into a JSON format and stored in the cloud. Data can then be requested by other devices.


Data Quality at Prezi

by João Miranda Follow 2 Followers on  Jul 18, 2015

For an organization to be data-driven, it's not enough to just dump mountains of data. That data needs to be accurate and meaningful. Julianna Göbölös-Szabó, data engineer at Prezi shared how they improved the quality of its log data. Their solution involved moving from unstructured to structured data with a lightweight, contract-based approach to nudge all teams in the right direction.


Agile View of Big Data

by Savita Pahuja Follow 1 Followers on  Dec 16, 2014

An agile view of Big Data, wherein data is viewed as a real time stream, offers a new look at how data is managed. Using an agile data infrastructure, organizations can conquer Big Data challenges with a level of ease, flexibility and performance. White paper by codeFutures describes the Agile view of Big Data.


Prismatic Adds Data Type Coercion to Schema 0.2

by Tom Coupland Follow 0 Followers on  Feb 19, 2014

Prismatic have added data coercion in the 0.2 release of their Clojure data description library, Schema. The addition of coercion means that the library doesn’t just reject data that has the wrong types, but it can be configured to modify instances to fit the schema. InfoQ talked to Prismatic's Jason Wolfe about Schema.

Login to InfoQ to interact with what matters most to you.

Recover your password...


Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.


More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.


Stay up-to-date

Set up your notifications and don't miss out on content that matters to you