InfoQ Homepage Apache Content on InfoQ
-
Indestructible Storage in the Cloud with Apache Bookkeeper
At Salesforce, we required a storage system that could work with two kinds of streams, one stream for write-ahead logs and one for data. But we have competing requirements from both of the streams. Being the pioneers in cloud computing, we also required our storage system to be cloud-aware as the requirements of availability and durability are ever more increasing.
-
Apache Beam Interview with Frances Perry
InfoQ Interviews Apache Beam's Frances Perry about the impetus for using Beam and the future of the top-level open source project and covers the thoughts behind the programming model as well as some of the touch-points in integration with other data engineering tools like Apache Spark and Flink.
-
From Alibaba to Apache: RocketMQ’s Past, Present, and Future
Feng Jia and Wang Xiaorui share the core distributed systems principals behind RocketMQ, Alibaba's distributed messaging and data streaming platform now open sourced through the Apache Foundation.
-
Article Series: Getting a Handle on Data Science as a Software Developer
Software developers and managers are realizing that they need data science among their skills, to be able to tackle pressing problems. In this series, field experts provide guidance to help us navigate among the available data analysis options. They explore ways of understanding where data science is needed and where it’s not, and how to turn it into an asset.
-
Case Study: Selecting Big Data and Data Science Technologies at a large Financial Organisation
Adopting Big Data and Data Science technologies into an organisation is a transformative project similar to an agile transformation and with many similar challenges. In this article, the author describes such a project for a FTSE100 financial services company.
-
Q&A: Relevant Search with Elasticsearch and Solr
In their book "Relevant Search", Doug Turnbull and John Berryman focus on the challenge of providing search results by balancing the needs and intents of the user. Using Elasticsearch and Solr, relevance engineers can constantly tune the needs of the business vs. the needs of the user.
-
Bridging Microsoft Word and the Browser
HTML editors work fine for general formatting, but they don’t have all the capabilities that some businesses require. Creating graphics, diagrams, tracking changes and inserting comments are useful and come out of the box in Microsoft Word In this article, Prasadu Babu Dandu shows how to serve up Word documents as HTML.
-
What is Apache Tez?
Apache Tez is a new distributed execution framework that is targeted to-wards data-processing applications on Hadoop. But what exactly is it? How does it work? In the presentation, “Apache Tez: Accelerating Hadoop Query Processing”, Bikas Saha and Arun Murthy discuss Tez’s design, highlight some of its features and share initial results obtained by making Hive use Tez instead of MapReduce.
-
How LinkedIn Uses Apache Samza
Apache Samza is a stream processor LinkedIn recently open-sourced. In his presentation, Samza: Real-time Stream Processing at LinkedIn, Chris Riccomini discusses Samza's feature set, how Samza integrates with YARN and Kafka, how it's used at LinkedIn, and what's next on the roadmap.
-
Apache MetaModel – Providing Uniform Data Access Across Various Data Stores
MetaModel - an Apache Incubator project – is a Java library used to browse, query and update various types of data stores including traditional SQL databases, unusual stores such as CSV or Excel, or the more modern NoSQL stores in a uniform and programmatic way.
-
Interview with Arun Murthy on Apache YARN
Apache Hadoop YARN – a new Hadoop resource manager - has just been promoted to a high level Hadoop subproject. InfoQ had the chance to discuss YARN with Arun Murthy - founder and architect at Hortonworks.
-
Guardian.co.uk Switching from Java to Scala
Citing a need to be able to respond faster to events, and disappointment in the feature set and timeframe for Java 7, the team behind guardian.co.uk is using Scala as an alternative to Java for their new projects. InfoQ spoke to Web Platform Development Team Lead Graham Tackley about their current stack, the reasons behind the move, and the experience of using Scala in large-scale development.