InfoQ Homepage Architecture & Design Content on InfoQ
-
Spark, Storm and Real Time Analytics
Hadoop is definitely the platform of choice for Big Data analysis and computation. While data Volume, Variety and Velocity increases, Hadoop as a batch processing framework cannot cope with the requirement for real time analytics. Spark, Storm and the Lambda Architecture can help bridge the gap between batch and event based processing.
-
Google Sells Motorola to Lenovo
Google has sold Motorola Mobility to Lenovo for $2.91B, and keeps most of the patents in their portfolio while Lenovo gets 2,000 patents. Google may lose money on this deal but the Android ecosystem benefits.
-
Greg Young on Using Complex Event Processing
Complex Event Processing, CEP, can be very useful for problems that have to do with time e.g. querying over historical data when you want to correlate things that have happened at different times, Greg Young explained in a recent presentation.
-
Functional Relational Mapping Library Slick 2.0 Released
Version 2.0 of Slick, a Functional-Relational Mapping, FRM, library for Scala, (corresponding to an Object-Relational Mapper, ORM, for object-oriented languages), was recently released with a code generator for reverse-engineering a database schema and new driver architecture to allow support for non-SQL databases.
-
Presto-as-a-Service: Interactive SQL Queries on AWS
Presto, a technology from Facebook enabling interactive SQL queries on petabytes of data, has now taken a first step into mainstream adoption. Big Data startup Qubole has launched its Presto-as-a-Service alpha with integration to Amazon Web Services.
-
Documentation in Agile: How Much and When to Write It?
The Manifesto for Agile Software Development values "working software over comprehensive documentation". This core value asks us to think about how much and which kinds of documents are needed and when they need to be written.
-
What Is Going on with PaaS?
Despite huge investments and years in development, PaaS has not managed to attract many customers so far. This article digests what several analysts are saying regarding the current status of PaaS and its future.
-
Big Data: Do Languages Really Matter?
Big Data is a field where even a single millisecond loss can be significant over billions of events. Yet, languages often regarded as slow like Python have gained a lot of popularity in the past year. Recent articles and discussions in the Big Data community have started reigniting the debate around the choice of a programming language for data science and Big Data.
-
Google Improves Hadoop Performance with New Cloud Storage Connector
With a new connector, it is now possible for Hadoop to run directly against Google Cloud Storage instead of using the default, distributed file system. This results in lower storage costs, fewer data replication activities, and a simpler overall process.
-
Big Data Revolution and Genomics Analysis
Curoverse and Tute Genomics secured $1.5 million each in seed funding in the past month aiming to bring gene sequencing to the masses. Illumina, Seven Bridges Genomics, Complete Genomics and others are offering researchers and private parties the opportunity to map the full genome sequence for a four figure quote. Illumina recently announced HiSeq X Ten, promising the long-awaited $1,000 genome.
-
Java 8 On Track for March Release
After a slight delay the long anticipated release of Java 8 is now on back on track and scheduled for release on March 18.
-
JArchitect v4.0 Released
Version 4.0 of JArchitect by CoderGears, a tool used to manage Java code bases and application development, is now available. JArchitect allows architects and developers to analyze a code base, automate code reviews, and facilitate refactoring and migration.
-
Apps Have to be iOS 7 Compatible by February 1st
Apple recently announced that iOS applications have to be iOS 7 compatible by February, 1st. To submit new applications or application updates to the iTunes Store, developers have to build their applications with XCode 5 and apps have to be optimized for iOS7. Compatibility with iOS 7 includes changing the UI according to the current Human Interface Guidelines and adapting API changes.
-
Upcoming Book by Gojko Adzic on Improving User Stories
Would better user stories improve software delivery? Gojko Adzic thinks applying small changes to the way teams manage their user stories can have a huge impact on the actual outcomes of their software delivery. He announced that he wants to write a book about improving user stories if at least 5000 people show that they are interested by pre-registering themselves in January.
-
Twitter Open-Sources its MapReduce Streaming Framework Summingbird
Twitter has open sourced their MapReduce streaming framework, called Summingbird. Available under the Apache 2 license, Summingbird is a large-scale data processing system enabling developers to uniformly execute code in either batch-mode (Hadoop/MapReduce-based) or stream-mode (Storm-based) or a combination thereof, called hybrid mode.