InfoQ

InfoQ

Topic/Tag specific view

Data Warehousing Content on InfoQ


Latest featured content about Data Warehousing

Hadoop and NoSQL in a Big Data Environment

Topics
Continuous Delivery,
Big Data,
QCon San Francisco 2011,
NoSQL,
Agile Techniques,
Design Pattern,
Data Access,
QCon,
Database Design,
Conferences,
Database,
Design,
Patterns,
Performance & Scalability,
Object Oriented Design,
Agile,
Data Warehousing,
Data Warehouse,
Design Patterns,
Data Storage,
MapReduce

Ron Bodkin of Big Data Analytics discusses early adoption of Hadoop, NoSQL and big data technologies. He discusses common patterns and explains how developers can write low-level primitives to optimize MapReduce function. Other topics include Hive, Pig, multi tenancy, and security.

News about Data Warehousing

Thoughtworks Technology Radar March 2012

Topics
Puppet,
Chef,
Devops,
Automated testing,
Maven,
Continuous Delivery,
Build systems,
Scrum,
IT Service Management,
Automation,
Languages,
Infrastructure,
Agile Techniques,
Emergent Architecture,
PowerShell,
Testing,
Agile,
git,
Cloud Computing,
Data Warehousing,
Experience Design,
Programming,
github

ThoughtWorks recently published the latest update to its Technology Radar; a report produced to help technology decision makers understand emerging trends in software development techniques, tools, languages and platforms. There are some interesting observations of interest to Agile software development teams.

What’s New in SQL Server 2012 RC0

Topics
SQL Server,
Relational Databases,
Data Access,
Microsoft,
Database,
Data Warehousing,
SQL Server Express,
Companies

Microsoft has released SQL Server 2012 Release Candidate 0. There are many new features, including: AlwaysOn, better performance management, more reporting and visualization tools, Columnstore index, and FileTables. The product will come in 3 main editions: Standard, Business Intelligence and Enterprise.

Olap4j 1.0: a Java API for OLAP Servers

Topics
Java,
Business Intelligence,
Languages,
Data Access,
Database Design,
Programming,
Database,
Enterprise Architecture,
Data Warehousing,
Standardization,
OLAP,
XMLA

Business Intelligence vendor Pentaho has announced the release of olap4j 1.0, a new, common Java API for any online analytical processing (OLAP) server.

Column-based Storage in SQL Server 2011

Topics
SQL Server 2011,
SQL Server,
SQL Server 2012,
Relational Databases,
Data Analysis,
Microsoft,
.NET,
Database Design,
Data Access,
Companies,
Database,
OLAP,
Programming,
Data Warehousing,
OLTP

Imagine ad hock data mining queries against a single table with 1 TB of data and 1.44 billion rows coming back in roughly a second. This is the scenario Microsoft intends to support using 32-core machines and their new column-based storage engine.

Better Developer Experience in Version 1.5 of the Data Access Framework MetaModel

Topics
Java EE,
Java,
Data Access,
Open Source,
Languages,
Data Storage,
Database,
Architecture,
Data Warehouse,
Data Warehousing,
Programming,
Metadata

Eobject.org's open-source Java framework MetaModel implements a unified API for the access, exploration, and query of different datastores. Eobjects.org, both a website and an open source software organization dedicated to "the development of Open Source software related to Business Intelligence and Data Warehousing", has recently published version 1.5 of MetaModel.

A Case for Graph Databases

Topics
GraphDB,
Graph Database,
.NET,
Database Design,
NoSQL,
Programming,
Database,
Data Warehousing

We talk with Daniel Kirstenpfad, founder and CTO of sones GmbH, about Graph Databases and how they can better model some types of data such as relations in a social networking application. A graph database can offer performance benefits over other types of databases because they explicitly represent a graph and are organized to have index free adjacency.

Articles about Data Warehousing

Bridging the gap between BI & SOA

Topics
Web Services,
SOA,
Architecture,
Enterprise Architecture,
Data Warehousing,
SOA Adoption,
Reporting,
Design Patterns,
Web services,
SOA Appliance

Business intelligence (BI) and service-oriented architecture (SOA) have conflicting principles and needs. SOA promotes hiding the data inside the services while BI needs that very data if we want to get meaningful predictions and alerts. This article will show you how you can combine SOA with EDA to solve the BI/SOA conflict and maybe even enhance your SOA.

Presentations about Data Warehousing

Facebook’s Petabyte Scale Data Warehouse using Hive and Hadoop

Topics
QCon San Francisco 2009,
QCon,
Data Analysis,
Architecture,
Conferences,
Data Warehousing,
Database,
Performance & Scalability,
Hadoop

Ashish Thusoo and Namit Jain explain how Facebook manages to deal with 12 TB of compressed new data everyday with Hive’s help. Hive is an open source data warehousing framework built on Hadoop, allowing developers to perform analysis against large datasets using SQL.

Transforming the Reconciliation Process

Topics
QCon London 2009,
Grid Computing,
QCon,
Oracle,
Data Warehousing,
Conferences,
Architecture,
Coherence,
Companies

Brian Oliver explains what the Reconciliation Process is, why the current approach to reconciliation based on client-server is no longer suitable and how data grids and event based reconciliation might help.

Interviews about Data Warehousing

Randy Shoup on Evolvable Systems

Topics
Deployment / Datacenter,
Operations,
Event Driven Architecture,
Database Management,
Data Portability,
Data Access,
QCon,
Database Design,
Infrastructure,
Database,
Data Warehousing,
Architecture,
Conferences,
Data Warehouse,
eBay,
Large Projects

Randy Shoup discusses evolvable systems: how to run different versions of a system in parallel during migrations, decoupling a system with events, schemas at eBay and much more.