Bulk data is commonly accessed via files & FTP. As the world moves toward APIs to facilitate collaboration, what are the requirements for data APIs? This article describes a meta-data driven architecture for bulk data ingestion. Two APIs operate in parallel to provide data changes as well as the data records themselves. An example demonstrates how API responses are parameterized using meta-data.
Over the years Agile has had a number of high profile successes. However, some have suggested that project efficiency and team creativity are impossible to achieve simultaneously. In this article Aaron Kendall of Barnes & Noble discusses a method they have been using that attempts to address these potential conflicts and combines the design of the overall architecture and implementation.
MetaModel - an Apache Incubator project – is a Java library used to browse, query and update various types of data stores including traditional SQL databases, unusual stores such as CSV or Excel, or the more modern NoSQL stores in a uniform and programmatic way.
A new Apache HCatalog provides a metadata and table management system for Hadoop ecosystem, simplifying data interoperability between different data processing tools