BT

Your opinion matters! Please fill in the InfoQ Survey!

Data Science Follow 329 Followers

Julien Nioche on StormCrawler, Open-Source Crawler Pipelines Backed by Apache Storm

by Alexandre Rodrigues Follow 0 Followers on  Dec 15, 2016

Julien Nioche, director of DigitalPebble, PMC member and committer of the Apache Nutch web crawler project, talks about StormCrawler, a collection of reusable components to build distributed web crawlers based on the streaming framework Apache Storm. InfoQ interviewed Nioche, main contributor of the project, to find out more about StormCrawler and how it compares to other similar technologies.

Data Science Follow 329 Followers

Julien Le Dem on the Future of Column-Oriented Data Processing with Apache Arrow

by Alexandre Rodrigues Follow 0 Followers on  Dec 08, 2016 1

Julien Le Dem, the PMC chair of the Apache Arrow project, presented on Data Eng Conf NY on the future of column-oriented data processing. Apache Arrow is an open-source standard for columnar in-memory execution. InfoQ interviewed Le Dem to find out the differences between Arrow and Parquet.

Architecture & Design Follow 773 Followers

Authentication Strategies in Microservices Systems

by Jan Stenberg Follow 9 Followers on  Dec 08, 2016 3

Software security is a complex problem, and is becoming even more complex using Microservices where each service has to deal with security, David Borsos explained at the recent Microservices Conference in London, during his presentation evaluating four end-user authentication options within a microservice based systems.

DevOps Follow 295 Followers

Honeycomb - A Tool for Debugging Complex Systems

by Hrishikesh Barua Follow 4 Followers on  Oct 31, 2016 1

Honeycomb is a tool for observing and correlating events in distributed systems. It provides a different approach from existing tools like Zipkin in that it moves away from the single-request-tracing model to a more free-form model of collecting and querying data across layers and dimensions.

Architecture & Design Follow 773 Followers

Yahoo! Open Sources Pulsar, a Pub/Sub Messaging Platform

by Abel Avram Follow 4 Followers on  Sep 10, 2016

Yahoo! has made available Pulsar, their publish-subscribe messaging platform used internally in production by several services.

Architecture & Design Follow 773 Followers

Data is the Hard Part Working with Microservices

by Jan Stenberg Follow 9 Followers on  Aug 28, 2016 2

One of the hardest problem when creating and developing microservices for an enterprise is their data. Analysing the business domain using Domain-Driven Design (DDD) and reason about what your data represents will help in achieving a microservices architecture, Christian Posta claims in one of a series of blog posts about microservices implementations.

.NET Follow 126 Followers

Q&A on Akka.NET 1.1 with Aaron Stannard

by Pierre-Luc Maheu Follow 2 Followers on  Jul 21, 2016

Akka.NET 1.1 was recently released, bringing new features and performance improvements. InfoQ reached out to Aaron Stannard, maintainer of Akka.net, to learn more about Akka.Streams and Akka.Cluster. Stannard also explains how the roadmap is planned with regards to the JVM implementation of Akka.

Architecture & Design Follow 773 Followers

Five Ways to Not Mess Up Microservices in Production

by Mark Little Follow 4 Followers on  Jun 19, 2016

Alex Zhitnitsky of Takipi has written about five ways to try to improve the chances of successful deployed of microservices into production. As we will see, they share many similarities with other independent efforts, perhaps leading us to agreement on top areas of concern, if not ways of solving these problems.

Data Science Follow 329 Followers

Combine SQL Server with Hadoop Using PolyBase

by Jonathan Allen Follow 187 Followers on  Jun 02, 2016 2

With the recently released SQL Server 2016, you can now use SQL queries against Hadoop and Azure blob storage. Not only do you no longer need to write map/reduce operations, you can also join relational and non-relational data with a single query.

DevOps Follow 295 Followers

DevOps Days Kiel Day 1

by Manuel Pais Follow 6 Followers on  May 15, 2016

Summary of DevOps Days Kiel day 1 talks.

Data Science Follow 329 Followers

Elephant in the Cloud - Hadoop as a Service

by Srini Penchikala Follow 15 Followers on  May 02, 2016 2

Hadoop and other big data technologies revolutionized the way organizations run data analytics but the organizations are still facing challenges with operating costs of using these technologies for on-premise data processing. Ashish Thusoo recently spoke at Enterprise Data World Conference about Hadoop as a service offering that helps organizations bridge the gaps with these capabilities.

Data Science Follow 329 Followers

Google Cloud Machine Learning and Tensor Flow Alpha Release

by Dylan Raithel Follow 4 Followers on  Apr 18, 2016

Late last month Google released an alpha version of their TensorFlow (TF) integrated cloud machine learning service as a response to a growing need to make their Tensor Flow library to run at scale on the Google Cloud Platform (GCP). Google describes several new feature sets around making TF usage scale by integrating several pieces of the GCP like Dataproc, a managed Hadoop and Spark service.

Cloud Follow 79 Followers

Apache Storm Reaches 1.0, Brings Improved Performance, Many New Features

by Sergio De Simone Follow 5 Followers on  Apr 14, 2016

Version 1.0 is "a major milestone in the evolution of Apache Storm", writes Apache Software Foundation VP for Apache Storm P. Taylor Goetz, and it includes many new features and improvements. In particular, Goetz claims a 3x–16x boost in performance.

Development Follow 180 Followers

GitHub’s DGit Improves Reliability, Performance, and Availability

by Sergio De Simone Follow 5 Followers on  Apr 07, 2016 1

GitHub has been quietly rolling out DGit, short for “distributed Git”, a new distributed storage system built on top of Git with the aim of improving reliability, availability, and performance of using GitHub.

Development Follow 180 Followers

LFE Brings Lisp to the Erlang Virtual Machine

by Sergio De Simone Follow 5 Followers on  Apr 05, 2016

After 8 years of development, Lisp Flavoured Erlang (LFE) has reached version 1.0, bringing stable support for Lisp programming on the Erlang virtual machine (BEAM). LFE was created by Robert Virding, one of the initial developers of Erlang. InfoQ has spoken with Duncan McGreggor, current maintainer of LFE.

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT