Google has unveiled their new data-warehouse called Mesa. Mesa is a system that scales across multiple data centers and processes petabytes of data, while being able to respond to queries in sub-second time and maintain ACID properties.
Cloudera recently released an update over Project Rhino and data at-rest encryption in Apache Hadoop. Project Rhino is an effort of Cloudera, Intel and Hadoop community to bring a comprehensive security framework for data protection. InfoQ recently talked to Steven Ross from Cloudera team to learn more about the project.
Vivint recently announced that it is partnering up with Cloudera to analyze more efficiently data coming from Smart Home sensors. The sensors in a residence vary from thermostats to security oriented devices. Analyzing this data centrally, Vivint can provide actionable insights for customers that can provide energy savings. Heating ventilation and cooling(HVAC) accounts for more than 40 percent of
Cloudbreak, a new open-source and cloud-agnostic Hadoop as a Service API, is now open for beta access to application developers and enterprises. SequenceIQ, Cloudbreak's maker, claims that its freely available product will make it easier to manage and monitor on-demand Hadoop clusters while also abstracting their provisioning.
Hadoop distributor Cloudera pursued its strategy of securing the Hadoop ecosystem by acquiring last month the big data encryption and key management startup Gazzang. The deal will strengthen Cloudera's security offering and lead to the creation of a center of excellence for Hadoop security that will initially be fueled by Gazzang’s engineering team.
Ayasdi announced last month a partnership with Cloudera, the biggest distributor of Apache Hadoop. The partnership that will ensure the compatibility of their solution with Cloudera Enterprise 5, the latest version of Cloudera’s big data platform based on Apache Hadoop.
DataTorrent is a real-time streaming and analyzing platform that can process over 1B real-time events/sec.
Splunk, a company specializing in searching, monitoring, and analyzing machine-generated data, has announced the release of Hunk 6.1. Hunk provides an analytics platform for big data. The new release also provides streaming resource libraries to connect Hunk to any NoSQL data store, such as Apache Cassandra, MongoDB, and Neo4j.
This year's ApacheCON North America conference saw key speakers focus on open source and its community. With more than 400 attendees, over 70 projects represented and 180 conference sessions it covered as many diverse topics as diverse the Apache Software Foundation projects are.
Concurrent will release Cascading 3.0 in early summer to allow certain applications to run on multiple Big Data frameworks including MapReduce, Tez, Spark, Storm and others. Additionally, Driven, the new commercial product from Concurrent, provides powerful enterprise data application management for Big Data applications.
Hortonworks announced the release of Hive 0.13 which marks the completion of the Stinger initiative. The new release also includes performance improvements as well as some new SQL features. Hive is an open source SQL Engine written on top of Hadoop that lets users query big data warehouses by writing SQL queries instead of MapReduce jobs.
Starting from the premise that today “80 percent of enterprise data is unstructured and growing at twice the rate of structured data”, Cloudera and MongoDB have announced a “strategic” partnership meant to provide customers the option to combine Cloudera’s Apache-based Big Data platform with MongoDB’s NoSQL solution.
The Internet of Things, Web APIs and Big Data will make continuous development a necessary reality and will tie developers down with maintenance work on completed applications, says Andrew Binstock of Dr. Dobbs. In that case, short sprints, continuous integration and deployment and modern programming practices are even more important to ensure a developer's time is better utilized.
DataBricks, the company behind Apache Spark, has announced a new addition into the Spark ecosystem called Spark SQL. Spark SQL is separate from Shark, and does not use Hive under the hood. InfoQ reached out to Reynold Xin and Michael Armbrust, software engineers at DataBricks, to learn more about Spark SQL.
Cloudera recently released the latest version of its software distribution, CDH5. Almost 20 months after the last major version, CDH4 seems like ages in the Big Data world. We take a look at new features this release brings and the future direction of Cloudera after the latest round of investment from Intel and Google Ventures.