Tips for Enabling Continuous Improvement by Teams
Bill Hoberecht - This email address is being protected from spambots. You need JavaScript enabled to view it.

Retrospectives are simple in purpose and easy to describe, yet most organizations are unable to achieve even trivial benefits from this immensely important activity. Thought leaders on retrospectives have published a rich set of materials to help teams adopt retrospectives - their insights are readily available to help you. You'll also find a few important tips that can establish the foundation in your organization for consistently obtaining the best results from your investment in retrospectives.

 

Elements of the Perfect Retrospective

In Retrospectives 2: Perhaps Your Best Source of Valuable Improvement Ideas, I outlined the key reasons a retrospective is a vitally important activity for any organization that seeks to continuously improve its performance and results. In this article, we'll look at establishing retrospectives as a constructive activity performed by your team every cycle, and at the end of every release.
 
Here's the typical scenario: your project has just completed, the celebration pizza was okay, and now it's time to rush on to the next project. Or perhaps you are using an agile or hybrid method - the cycle ended this afternoon, most items completed successfully, and planning for the next one starts first thing tomorrow morning. In both of these cases, lost is the opportunity to mine the expertise and knowhow of the team members, exploring insights gained through the experience and helping the next cycle go better. The retrospective is the ideal vehicle for that.
 

The perfect retrospective is well-planned, makes use of data, has full participation of all team members, and results in improvements that are lasting.

 

The Retrospective - What do the Experts Have to Say?

A retrospective is an interactive meeting in which team members participate in guided activities, coming to a common understanding of how the last cycle went, identifying aspects that stand out as particularly positive or problematic, and planning to institute changes that will improve the next one. The retrospective is held for the practical purpose of continuous improvement. Its purpose is to strengthen teams.

The event goes by several names. Boris Gloger called it a "Heartbeat Retrospective," Norm Kerth a "Project Retrospective," Esther Derby and Diana Larsen an "Agile Retrospective," and Scrum a "Sprint Retrospective." (Many assume retrospectives were invented by Scrum. They weren't!) The Agile Alliance's glossary uses Gloger's term and traces the concept back to the pre-Agile Manifesto days of 1997, when this was a novel idea. For this article I'll lump these all together and call it a "retrospective."

For a team working in short cycles, the retrospective closes each one, generally every few weeks; end-of-release and end-of-project retrospectives cover a longer span and happen less frequently. Retrospectives are equally valuable for any way of working; this technique isn't limited to Scrum and agile teams. A retrospective should cover a "small" duration of work - perhaps a few weeks to a couple of months. Attempting a retrospective for a longer period of time will likely result in faulty recollections, focusing on too few topics, and struggling with too much information to process adequately.

There are thousands of web sites and a shelf of books devoted to the topic of retrospectives. Most of this information is useful and can help you shape your own view of what a retrospective should look like for your team. Here are a few that are worth a glance to give you some varying opinions on retrospectives. These authors have gone through some deep thinking on retrospectives, and they offer valuable insights, approaches and hints.

  1. My favorite is A Five-Step Approach to Retrospectives in which Esther Derby describes a very good outline for retrospectives. You'll have to look far and wide to find a better starting point. Listen to her 50-minute presentation on retrospectives, glance through her slides for some additional insights, then shell out a few bucks for their book, Agile Retrospectives, Second Edition (2024, Esther Derby and Diana Larsen with David Horowitz), an update of the 2006 original, and immerse yourself in the topic. Their simple, direct and immediately useful agenda for a retrospective is:
    1. Set the stage
    2. Gather data
    3. Generate insights
    4. Decide what to do
    5. Close the retrospective
  2. Project Retrospectives: A Handbook for Team Reviews by Norm Kerth is probably the first book to define retrospectives.  Norm's Retrospective Prime Directive puts front and center the important reminder that a retrospective is not to blame or criticize, but to educate.  The directive, in its entirety, is:  Regardless of what we discover, we understand and truly believe that everyone did the best job they could, given what they knew at the time, their skills and abilities, the resources available, and the situation at hand.  Norm also introduced four key retrospective questions to guide the retrospective discussion:  
    1. What did we learn?
    2. What should we do differently next time?
    3. What did we do well, that if we don’t discuss we might forget?
    4. What still puzzles us?
  3. Several consultants have published articles based upon Norm Kerth's book.
    1. Rachel Davies' Refactor Your Software Development Process with Agile Retrospectives is the probably the clearest, easiest to read summary of Norm's retrospective approach. You may want to watch her presentation Team-Driven Improvement with Retrospectives.  Her one-hour presentation Rachel Davies - Inspect and Adapt with Agile Retrospectives is also worth watching.
    2. Steven Rakitin's overview of Project Retrospectives is a good introduction to the topic.  As well, he provides a usable agenda of activities for a retrospective meeting.  (He continues with Norm's approach of having a 3-day project retrospective, while I am an advocate of a retrospective duration that is much, much shorter).
    3. Tim Mackinnon summarizes much of Norm's book in this paper.
  4. The stop/start/continue format (which can be further enhanced with "do more of/less of") is another good way to frame the retrospective using these questions:
    1. What worked well last cycle that we should continue doing?
    2. What didn’t work well last cycle that we should stop doing?
    3. What should we start doing?
  5. Here's an example of A Retrospective Timeline, and you can find an excellent description in this excerpt from Agile Retrospectives: Making Good Teams Great.  The timeline is a means of organizing the cycle's events, identifying events that can drive a retrospective discussion.

 

Enabling the Perfect Retrospective

With all of the expert materials readily available, you might assume that retrospectives are universally adopted and yielding benefits daily. Unfortunately, that isn't the case.

Oftentimes, the impact of the retrospective technique is somewhat underwhelming.  Even disappointing.  I frequently find teams that have no retrospective activities, and I rarely encounter a project team that is actively making use of lessons that have been "learned" from prior projects.  They might be documenting their own lessons, but don't seem to have a mechanism for using that type of information from preceding projects or assuring that today's lessons will be used on later projects.

A second problem shows up a few months after a team introduces retrospective meetings. The first few retrospectives are lively and energetic.  And impactful: they produce real change. Over time the meeting settles into a stale routine with the same format, the same 3 complaints, and an unused action list of changes to be made. The team is conducting retrospectives, so that can be checked off as completed, but improvement is not to be found. Most of the tips below are aimed at that second problem as much as the first.  (For a PMO that got both problems right, see PMI's case study of retrospectives at Intel.)

Many books and articles describe how to execute effective retrospective meetings.  Before we get to that topic (in Retrospectives 4 - The Perfect Retrospective), let's look at how to adopt retrospectives and create an environment that promotes and supports continuously improving team performance:

  1. Bringing Retrospectives into first use
    1. Introduce Retrospectives to the team.  Before you even start retrospective training sessions (let alone conducting the first retrospective) you'll want the team to be aware of the benefits, choices they'll be making in selecting or defining their retrospective techniques, and expectations that they (and others) will have about the outcomes of retrospective activities.
    2. Educate and Train the team and management.  It may be overambitious to assume that convening a set of people (who are unfamiliar with retrospectives) will naturally and consistent yield positive results.  Invest in educating the team and others about the value of continuous improvement, followed by training on specific retrospective techniques and how to apply those techniques in your environment.  These are important enabling actions.  Soft skills training is also helpful.  Retrospective activities are filled with interactions which could potentially be interpreted as criticism or blaming; team members and managers need to be properly prepared with skills for effectively participating and contributing in such situations.
    3. Retrospectives for every cycle.  Incorporate retrospectives into your organization's culture so that it is naturally expected that every cycle, and every project, will have a retrospective with valuable results.
    4. Ensure Role Clarity and Accountability.  In the old days of post mortems, only one person needed to be knowledgeable and skilled in the technique.  In the world of retrospectives, many roles must all contribute to achieve consistent and sustained benefits from retrospectives.  Here's a possible delineation of roles for which people should be trained and adequately prepared:
      1. Manager: create an environment that enables (and expects) retrospectives
      2. Coach: initial training on the method
      3. Team lead or Scrum Master: ongoing training and facilitation
      4. Team Member: active participation
  2. Conducting Retrospectives Every Cycle
    1. Always Use Data.  It's unfortunate that while many web sites focus on various methods of soliciting opinions during a retrospective, few stress the requirement for data.  Don't make that mistake.  Ensure that your chosen retrospective method always includes pre-workshop activities for collecting data that will be the basis for coming to a common understanding of performance and the subsequent analysis and discussion. (Otherwise, your retrospective just becomes a "talk show" where opinions abound - and every opinion, well-founded or not, carries equal weight).
    2. Continuous Collection of Data and Observations.  Even in a cycle of only a couple of weeks, it can be easy to forget a key observation when it comes time for the retrospective meeting. Consider keeping a place (a chat channel, a column on the board) where observations can be recorded in real-time, for further discussion during the retrospective meeting.
    3. Define Success.   Define the measures of a successful cycle (and a successful release) before even starting and then evaluate it, using data, against those criteria.
    4. Retrospective of Retrospectives.  Periodically conduct a retrospective on the retrospective process itself. Continuously improve at improving! Usually, the focus of your retrospective is the most recently completed cycle. Periodically, introduce a trending retrospective that seeks to examine the performance trends of your team over time. I also recommend using these retrospectives to evaluate the value delivered to the customer over time.  This practice is also the best defense against the retrospective going stale.
  3. Continuously Improving through identified actions
    1. Maximizing your retrospective's results. Ensure that the output of your project retrospective is shared and your newly acquired wisdom is applied to other teams and future work - but this doesn't mean publishing a retrospective review document that everyone must read.  Nearly every retrospective I've encountered results in an action item list for that cycle. At one point my department's 12 agile teams were each completing over 20 retrospectives per year; it just doesn't scale well to have each team publish actions and hope that all subsequent cycles and projects will benefit - no one will take the time, when starting a project, to read through a library of project retrospective documents and incorporate all of the learnings into this new project.  Construct your retrospective action items so they contribute to the knowledge base of your organization - generally speaking, your actions should be creating or improving: job aids, processes, training materials, job or role definitions, along with improving skills and knowledge (by training team members & management).  Resist taking the easy path with "one-off" improvement actions that are unlikely to have any sustained improvement impact.
    2. Tracking Completion of Improvement Actions.  For any team that works from a backlog, there's no need to create a special mechanism for recording and tracking improvement action items - create a backlog of "team improvement" items and use your standard planning and delivery processes for selecting from that backlog, completing them, and reviewing the result. And reserve capacity in the next cycle for them; an action with no time allotted is merely a wish.
    3. Viability and Impact of Improvement Actions.  A common consideration in constructing retrospective actions is to ask "who is in control."  That is, for a particular impediment, who controls the ability to improve in that area; typically the choices are "the team" or "management." (The self-assessment in the previous article makes the same point: keep the focus on changes the team itself can make.) Two additional factors should also be considered:  1) Impact: how important is this action?  If it is fully addressed, will it significantly improve our performance; and 2) Viability: how possible is it to accomplish this identified action.  You'll want to be choosing actions that have high impact and are reasonably viable.

 

What's Next?

The 8 hours it would take to read the two books, watch the video presentations, and study all of the articles/slides referenced in this article is certainly a sound investment of time if you are looking to maximize the impact retrospectives can have on your team.  Continuous improvement is no longer the sole responsibility of process engineers and line management; it is now an element of responsibility for every member of a team.  Consider immersing yourself in these reference materials as you prepare to use retrospectives every cycle.

The next article in this series (Retrospectives 4 - The Perfect Retrospective) presents an outline of the activities before, during and after the retrospective meeting, along with several specific tips on conducting a retrospective.