BT

InfoQ Homepage News Hadoop Gets Better Security, Several Operational Improvements

Hadoop Gets Better Security, Several Operational Improvements

This item in chinese

Bookmarks

Hadoop 2.4.0 was recently released with several enhancements to both HDFS and YARN. This includes support for Access Control Lists, Native support for Rolling upgrades, Full HTTPS support for HDFS, Automatic failover of YARN and other operational improvements

This is the second release in 2014 (first one being 2.3.0 in Feb). Below are brief details about the enhancements -

  • Access Control Lists enhance the HDFS permission model to support file access for arbitrary combinations of users and groups. Before this, you could only choose from 3 pre-determined options - a single owner, a single group and all other users
  • Rolling Upgrades make upgrading large Hadoop installations much easier to manage
  • Full HTTPS Support for HDFS across all components - WebHDFS, HsFTP and web interfaces
  • YARN Application History Server - to provide a general solution for recording history of applications that run on YARN
  • A generic Application Timeline Server which provides better metric capabilities for applications that run on YARN for application specific metrics such as containers used or resources consumed
  • Automatic Failover for YARN - applications can failover to a cold standby ResourceManager in case of operational issues such as hardware failures

The team also shared some upcoming features in the next release, 2.5.0 -

  • Further improvements in rolling upgrades
  • Admin-specified labels for servers in YARN for enhanced control and scheduling
  • Allow applications to delegate resources to others in YARN and share YARN's workload-management capabilities as well
  • Automatic sharing of artifacts in YARN distributed cache

You can download the latest release and also look at the release notes for more details. 

Rate this Article

Adoption
Style

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Community comments

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

BT

Is your profile up-to-date? Please take a moment to review and update.

Note: If updating/changing your email, a validation request will be sent

Company name:
Company role:
Company size:
Country/Zone:
State/Province/Region:
You will be sent an email to validate the new email address. This pop-up will close itself in a few moments.