BT

Characteristics of Microservices, Applications and Systems

by Jan Stenberg on  Feb 28, 2015

The assumption that a large system must have a single environment, often with a one-to-one mapping between a project’s scope and the system built are challenged today Stefan Tilkov explains when looking into ways to split a large system into smaller parts and comparing the characteristics of systems, applications and microservices.

Google Open Sources MapReduce Framework for C to Run Native Code in Hadoop

by Srini Penchikala on  Feb 25, 2015

Google announced last week the release of open source MapReduce framework for C, called MR4C, that allows developers to run native code in Hadoop framework. MR4C framework brings together the performance and flexibility of natively developed algorithms with the scalability and throughput provided by Hadoop execution framework.

Pivotal Open Sources Their Big Data Suite

by Abel Avram on  Feb 19, 2015 8

Pivotal has decided to open source core components of their Big Data Suite and has announced the Open Data Platform, an initiative promoting open source and standardization for Big Data.

Project Pachyderm Aims to Build a "Modern" Hadoop on Docker

by Matt Kapilevich on  Feb 17, 2015 3

Project Pachyderm Aims to Build "Modern" Hadoop using Docker and CoreOS.

Project Myriad: Mesos and YARN Working Together

by Boris Lublinsky on  Feb 14, 2015 1

An article by Jin Scott - A tale of two clusters: Mesos and YARN – describes hardware silos created by using different resource managers on different hardware clusters, most popular being Mesos and Yarn and introduces Myriad – a solution allowing to run a YARN cluster on Mesos.

Apache Hive 1.0 Released, HiveServer2 Becomes Main Engine, Stable API Defined

by Mikio Braun on  Feb 11, 2015

Apache Hive has released version 1.0 of their project on February 6th, 2015. Originally planned as version 0.14.1, the community voted to change the version numbering to 1.0.0 to reflect the amount of maturity the project has reached.

CoreOS Shipped the First Stable Version of etcd

by Janakiram MSV on  Jan 31, 2015

CoreOS announced the availability of etcd 2.0, the first stable version of the open source distributed key-value store.

Bad Practices Building Microservices

by Jan Stenberg on  Jan 28, 2015 1

When adopting a microservices architecture, using an external architect to create the design of a service instead of helping a team make their own decisions about design and implementation is one of several traps or bad practices that Vladimir Khorikov has experienced in his work.

EMRFS Brings Consistency to Amazon S3

by Jérôme Serrano on  Jan 27, 2015

Amazon recently announced EMRFS, an implementation of HDFS that allows EMR clusters to use S3 with a stronger consistency model. When enabled, this new feature keeps track of operations performed on S3 and provides list consistency, delete consistency and read-after-write-consistency, for any cluster created with Amazon Machine Image (AMI) version 3.2.1 or greater.

Don’t Share Code Between Microservices

by Jan Stenberg on  Jan 25, 2015 12

Reasons for building microservices are often about using isolation as a means to handle change. Sharing code between services couples your services to each other reducing the effectiveness of the isolation and the ability to handle change, David Dawson writes in a series of blog posts questioning the Don’t Repeat Yourself (DRY) principle in connection with microservices.

Distributed, Fault Tolerant Transactions in NoSQL

by Benjamin Darfler on  Jan 08, 2015

Five years ago many NoSQL databases were pre version 1.0 and when, it came to the CAP tradeoff, choosing availability over consistency was in vogue. Fast forward to today and distributed, fault tolerant transactions are moving into the fore as a new round of NoSQL databases seek to redefine our NoSQL expectations.

Apache Spark 1.2.0 Supports Netty-based Implementation, High Availability and Machine Learning APIs

by Rags Srinivas on  Jan 07, 2015

Apache Spark 1.2.0 was released with Netty-based implementation, High Availability and Machine Learning APIs. It represents the work of 172 contributors from over 60 institutions and comprises more than 1000 patches. InfoQ talks with Patrick Wendell, a Spark committer and PMC member.

Splice Machine Version 1.0 Supports Integration with Hadoop and Analytic Window Functions

by Srini Penchikala on  Dec 18, 2014

Splice Machine version 1.0 supports analytic window functions and integration with Hadoop ecosystem. Splice Machine team recently released their Hadoop based RDBMS data management solution that can be used for transactional workloads on Hadoop.

Monoliths from a Microservices Perspective

by Jan Stenberg on  Dec 18, 2014

There is a strong trend for microservice based architectures and frequent discussions comparing them to monoliths, Robert Annett explains and defines a monolith as an architectural style or a pattern using three basic viewtypes for characterization.

LinkedIn Open Sources Cubert With an Eye To Big Data Analytics

by Alex Giamas on  Dec 17, 2014

LinkedIn recently open sourced Cubert, its High Performance Computation Engine for Complex Big Data Analytics. Cubert is a framework written for analysts and data scientists in mind.Developed completely in Java and expressed as a scripting language, Cubert is designed for complex joins and aggregations that frequently arise in the reporting world.

General Feedback
Bugs
Advertising
Editorial
InfoQ.com and all content copyright © 2006-2015 C4Media Inc. InfoQ.com hosted at Contegix, the best ISP we've ever worked with.
Privacy policy
BT