InfoQ

News

Performance Reviews Banished

Posted by Mark Levison on Oct 30, 2008

Community
Agile
Topics
Agile in the Enterprise ,
Governance
Tags
Business/IT Alignment ,
Retrospectives

In the Wall Street Journal Sam Culbert, author and professor of management at UCLA, argues that annual performance and pay reviews are at best dysfunctional. He sees their primary purpose as "intimidation aimed at preserving the boss's authority and power advantage".

Sam gives a number of reasons that performance reviews have this effect:

  • Different Agendas - the boss is focused on improving an employee's performance, while the employee is interested in compensation and career advancement. Each ends up talking past the other.
  • Performance isn't linked to Pay - pay is really determined by market forces and budget. The performance review is just used as a story to justify changes in pay.
  • People aren't Objective - the performance review is supposed to an objective measure of performance. Yet given the same employee two bosses will often give wildly different reviews. He goes on to suggest that 360 reviews are often used for anonymous ax grinding.
  • One Performance Review doesn't fit all Employees - many performance reviews come with predetermined checklists. However the items on these lists often don't match what the role the person plays.
  • Personal Development is hindered - performance reviews can damage the trust that a employee and manager require to effectively plan for growth.
  • Disrupts Teams Performance - with the focus on the performance of the individual the needs of the team go unnoticed. 

Related to the problem of objectivity Linda Rising, author of Fearless Change Patterns,  notes that people will categorize or stereotype others in a very short period of time. "In many cases, a supervisor “determines” the ability of a worker in about three weeks, labeling them as either “can do” or “can’t do” workers. Once a prejudice has been formed, the supervisor views all the actions of that worker through this filter. If two workers make the same mistake, in the case of the “Can’t do” worker, the supervisor will think, “There he/she goes again, making the same mistakes,” while in the case of the “Can do” worker the supervisor will think, “Maybe he/she wasn’t feeling well.” Eventually, the supervisor can only recognize actions that affirm their prejudice."

There are a number of different solutions proposed. Jeff Sutherland (with more detail from Christophe Louvion), co-creator of Scrum, provides five areas of contribution to measure individual team members: Product Delivery, Process Improvement, Organizational Flexibility, Group Learning and Product. For Managers: Organizational Flexibility and Product are replaced by Team building and Enterprise Collaboration. Jeff uses a scale from 1-10, gathering feedback from both the Manager and team mates (averaged). There are two key differences between this and traditional approaches: for ratings outside the range of 4-6 the manager must provide evidence in writing supporting the claim and if the rating from the manager and team differ the higher rating wins. Finally the manager and employee collaborate to determine career goals that the person is passionate about. Jeff recommends conducting reviews on a quarterly basis.

Sam recommends a different approach, he calls them performance previews. He suggests that managers and their employees be held jointly accountable for their results (and their quality). With previews the manager will be focused on what needs to happen in the future. The format: "Bosses should be asking all the questions that occur to them in inquiring about how a subordinate thinks he or she can best perform the job. Then, after they have exhausted their questions, they should ask the subordinate for what else they need to know." Finally Sam says that these previews should happen whenever the employee and manager don't think they're working well together.

Mary Poppendieck's advice is to abandon schemes based on individual measurement and compensation. Instead she offers:

  1. tell people directly what’s important and why. it is cheaper and easier than financial incentive systems signaling what is important
  2. base pay differentials on job complexity, avoid individual performance bonuses because they extinguish collaboration
  3. base collective rewards on broad measures — the larger the group that is measured, the more reliably performance can be accessed. Use profit sharing schemes instead of bonuses to tie people to the organisation goals.
  4. keep in mind the norm of reciprocity — if people feel that they are being treated generously, they will reciprocate it with increased discretionary effort.

Finally Esther Derby just recommends having a conversation, discussing how the quarter/year has gone.

Related Sponsor

VersionOne is recognized by Agile practitioners as the leader in Agile project management tools. Companies such as Adobe, BBC, CNN, Dow, HP, IBM, Sony and 3M have turned to VersionOne to help deliver greater value to their customers.

One quibble with Jeff's approach by Mark Levison Posted Oct 30, 2008 2:12 PM
Point 2 is the killer by Bruce Rennie Posted Oct 30, 2008 2:58 PM
Poppendieck's session... by Kevin E. Schlabach Posted Oct 31, 2008 8:01 AM
Re: Poppendieck's session... by Kevin E. Schlabach Posted Oct 31, 2008 12:47 PM
Re: Poppendieck's session... by chris louvion Posted Nov 2, 2008 5:16 PM
additional information on performance evaluations, broken link by Esther Derby Posted Nov 1, 2008 9:59 AM
Re: additional information on performance evaluations, broken link by Mark Levison Posted Nov 3, 2008 10:27 AM
  1. Back to top

    One quibble with Jeff's approach

    Oct 30, 2008 2:12 PM by Mark Levison

    I see Jeff's solution as an improvement of a fundamentally broken practice. Jeff does nothing to address the lack of objectiveness in the process.

  2. Back to top

    Point 2 is the killer

    Oct 30, 2008 2:58 PM by Bruce Rennie

    In my opinion, anyway.


    How much MORE damage can you do to someone than to say: "4 stars, top performer, wish I had more like you. Oh, btw, here's your 3% raise. Keep up the good work."


    The fact that many companies can do this with a straight face says a lot.

  3. Back to top

    Poppendieck's session...

    Oct 31, 2008 8:01 AM by Kevin E. Schlabach

    I attended Poppendieck's session on this topic at Agile 2008, and my take-away was that performance reviews as a once or twice a year process are a failure (in line with the other sources in this article).

    BUT, the true intention of a performance review if separated from compensation and done monthly or more frequently can be a good thing.

    I think Poppendieck's session slides are on the Agile 2008 site.

    Kevin E. Schlabach
    agile-commentary.blogspot.com/

  4. Back to top

    Re: Poppendieck's session...

    Oct 31, 2008 12:47 PM by Kevin E. Schlabach

    correction, they are on the Poppendieck site:
    www.poppendieck.com/pdfs/The%20Elephant%20in%20...

  5. The link to my post on dumping the performance review and having a conversation seems to be broken. Try this: www.estherderby.com/weblog/archive/2004_11_01_a...

    I had a long talk with the practice director for HR/Compensation at a national consulting firm recently. One of the things I found most interesting was her perception that many companies install elaborate performance management /appraisal systems to "force" managers to give feedback.

    My observation is that many manager don't know how to give feedback. So it seems to me it would be more effective to teach manager how to give useful feedback--close to the event--and help people improve or move to a another place where they can be successful.

    A couple of other related articles here: www.ayeconference.com/should-a-scrummaster-give... and here: www.scrumalliance.org/articles/50-performance-w....

  6. Back to top

    Re: Poppendieck's session...

    Nov 2, 2008 5:16 PM by chris louvion

    Here's a related post following Mary's talk at the agile Bazaar in january: runningagile.com/2008/02/02/of-rewards-and-teams/

  7. Esther - thanks for the correction. That was the item I'd intended to link to in the first place.

    It also interesting (and sad) to read how HR justifies the practice in the first place.

Educational Content

Brian Marick on 4 Challenges and 5 Guiding Values of Agile Software Development

Brian Marick takes us through a quick tour of the most important values and challenges to adopting Agile successfully (they aren't the typical challenges and values we hear in the community).

Are You a Software Architect?

The line between development and architecture is tricky. Does it exist at all? Is an ivory tower actually needed? There's a balance in the middle, but how do you move from developer to architect?

Agile – A Way of Life and Pragmatic Use of Authority

The word 'authority' sometimes produces an allergic response in hard-line agilists. Freedom and authority – both are bad if misused and both are good if used in right spirit for a noble cause.

Getting Started with Grails, Second Edition

"Getting Started with Grails" brings you up to speed on this modern web framework. Companies as varied as LinkedIn, Wired, and Taco Bell are all using Grails. Are you ready to get started as well?

Using ITIL V3 as a Foundation for SOA Governance

Those familiar with only ITIL V2 often scoff at the thought that ITIL could serve as a governance framework for SOA. With ITIL V3, the focus of the framework shifted towards service-orientation.

Adrian Colyer on AspectJ, tc Server and dm Server

SpringSource CTO Adrian Colyer discusses AspectJ, SpringSource's dm Server and tc Server products, OSGi and Scrum.

Adam Wiggins on Heroku

Heroku's Adam Wiggins talks about Rails, Background Jobs, Add-Ons, Ruby, and how Heroku manages to work around Ruby's inefficiencies using Erlang and other languages.

SOA as an Architectural Pattern: Best Practices in Software Architecture

For Grady Booch the foundation of a good architecture is patterns, SOA being just one of many patterns. In this Second Life presentation, Booch attempts to bring more clarity on what architecture is.