Business Size: Large Enterprise

SAFE Case Study – CMS – Approach to Scaling Agile Using SAFe®

Nearly 140 million Americans rely on Medicare, Medicaid, the Children’s Health Insurance Program, and the health insurance exchanges—all programs administered by the Centers for Medicare & Medicaid Services (CMS). The agency pays out approximately $767 billion in benefits annually and employs 4,100 people to administer programs in partnership with state governments.

Challenge:

Isolated Scrum teams didn’t make much progress within a deeply ingrained waterfall culture and against long-range planning and budgeting.

Industry:

Government, Healthcare

Results:

  • CMS shifted the budget from 100% dedicated to system maintenance to a 40/60 split between maintenance and innovation
  • Help desk tickets decreased by 55%
  • Surveys show a 27% increase in employee satisfaction

Best Practices:

  • Prepare for face-to-face events – CMS found the SAFe Implementation Roadmap and training invaluable to smooth-running PI planning events
  • Establish transparency – Stress the importance of open, honest discussion and engagement
  • Communicate the vision – In opening remarks at PI events, CMS reminded team members that their work directly impacts people’s health and lives

Introduction

Amid the pressures of increasing citizen expectations, the CMS environment is complex and ever-changing as budgets and legislation fluctuate—making for a perfect setting to introduce Lean-Agile principles. A few isolated programs had begun using Scrum practices, but given the size and complexity of programs at CMS, Scrum did not lend itself well to longer-range planning and the identification and mitigation of dependencies among the Scrum teams. In addition, the organization still had cultural battles to overcome.

“We were still suffering from a ‘throw-everything-over-the-wall’ mentality,’” explained Brent Weaver, Director of Systems Implementation at CMS. “The few Agile teams were requiring more of programs and that created more frustration on both sides. There was no vision or framework where everyone saw how they fit together. As a result, what they delivered was late, with defects—and not what the market needed.”

SAFe: Systems Thinking for a Complex Organization

In 2017, Weaver arrived with the charge of improving the Agile transformation for the Center of Clinical Standards and Quality (CCSQ) within CMS. In the search for a new approach, the Scaled Agile Framework® (SAFe®) resonated as the right option.

“SAFe brought a much-needed approach to scaling Agile and systems thinking that was critical to an organization of our size and complexity,” Weaver said.

In preparation to obtain buy-in and funding, Weaver built his knowledge of SAFe by taking some initial courses: Leading SAFe®, and later, Implementing SAFe®. Following the Leading SAFe® course, he made the case for the Framework for leadership and earned the full support of Steve Davidson and Mark Plaugher, Directors of the Information Systems Group within CCSQ. Additionally, Debra Santos, Director of Hospitals, ASC, and QIO Systems was also willing to support the SAFe adoption for one of her systems.

SAFe case study

For help, Weaver tapped Scaled Agile Partner, Agile Six Applications, Inc. With Agile Six, CMS decided to implement SAFe first in a group brand-new to Lean-Agile concepts, rather than with those already using Scrum, for a chance to start from scratch. The first teams on SAFe would be those working on CMS’s Hospital Quality Reporting (HQR) system, which healthcare facilities use to report data to CMS.

With leadership backing, they secured the budget and marked the calendar for the first face-to-face Program Increment (PI) planning event—to take place just six weeks in the future.

PI Planning Day One: Messy and Chaotic

To meet the timeframe, CMS decided to shortcut the recommendations from the SAFe Implementation Roadmap and skip SAFe training—a decision that created significant challenges and that, in hindsight, they wouldn’t recommend to other organizations. The fact that many team members were located outside the area, and many were contractors, played into that decision.

To help prepare for PI planning, HQR conducted a four-hour, half-day mock PI session with about 20 percent of team members to give them an idea of what to expect.

For the actual PI Planning event, CMS brought together more than 120 people, with approximately a quarter of them coming from out of town. The first day, unfortunately, proved to be chaotic and more challenging than expected for several reasons, according to Weaver and Ernie Ramirez, President of Agile Six Applications:

  • They underestimated the refinement status of the backlog and didn’t follow all relevant parts of the SAFe Implementation Roadmap
  • They had a single Certified SAFe® Program Consultant (SPC) in Ramirez (the recommendation is 3 – 5 per 100 development practitioners)
  • The agency skipped Leading SAFe®, SAFe® for Teams, and SAFe® Product Owner/Product Manager training
  • They did not identify Value Streams
  • CMS simultaneously created the implementation plan and prepared for the Agile Release Train (ART) launch

“It cannot be overstated how horrible day one of that PI went,” Ramirez said. “We didn’t lay out an implementation plan as well as we should have, and the development contractor didn’t have the resources or roles we thought they did.”

PI Planning Day Two: ‘Quarter-Million-Dollar Conversations’

Day two, however, could not have played out more differently. “At the end of day one, rather than throw in the towel, we rolled up our sleeves, and resolved to do better in day 2. We came out of day two with a plan that the teams would ultimately deliver on over the next 12 weeks,” Ramirez said.

Ramirez points to a few reasons for the turnaround. After the first day, people returned knowing more of what to expect and came more prepared. Also, the two-day format created a sense of urgency to make progress. Additionally, Ramirez walked around troubleshooting any issues immediately as they arose.

“After the first day, everyone had an opportunity to ‘sleep on it,’” he said. “A lot of the frustration at the end of the first day kind of washed out and everyone came back with a renewed focus and commitment to get the plan done,” Ramirez said.

Team members and program managers alike left the event more hopeful than ever before, believing they could actually hit the plan’s targets. Most promising, Weaver and Ramirez noticed productive discussions happening throughout the room—often between people who had worked together for several years, but had never actually met one another in person.

“We witnessed a lot of team and cross-team bonding that just cannot be replicated over WebEx, Hangouts or Zoom,” Ramirez said. “There is something immeasurably valuable about being in the same room with someone, laughing, joking and yes, respectfully arguing. A lot of trust was earned and built on day two.”

“Quarter-million-dollar conversations were happening all over the place,” Weaver said. “That’s what it would have cost to fix problems down the road if those conversations had not happened.”

SAFe case study

Communication, Collaboration across CMS + Contractors

Following that first PI, CMS began adhering to the SAFe Implementation Roadmap. They delivered Leading SAFe®, SAFe® for Teams, and SAFe® Product Owner/Product Manager training. Unlike the first PI, they identified Value Streams.

“For the second PI, we found a lot of value in identifying Value Streams and ARTs, which helped people understand where they fit in and how teams fit together,” Ramirez said.

Agile Six also delivered training to external contractors, including Leading SAFe®, SAFe® for Teams, and SAFe® Product Owner/Product Manager. Several people at contractor organizations earned their SAFe® Program Consultant (SPC) certification and began training their own people—knowing that it is likely to give them one more strength to promote as they seek to win future contracts with CMS.

During RFPs, contract organizations routinely compete against each other. However, once on contract, they must work with team members from competing firms. As an unexpected benefit, SAFe helped unify CMS team members and contractors, as well as contractors from various companies. Face-to-face, they collaborate more effectively and come to personally know the people behind the roles, developing comfortable working relationships with each other.

“It’s fundamentally better for American taxpayers that teams work together and break those walls down,” Weaver said. “I’m really proud of contractors’ ability to collaborate, share information, and work as a single team. Doing so has helped us reduce trouble tickets, so we know we’re delivering higher-quality solutions.

Because of CMS’s heavy use of contractors, each ART is comprised of people from numerous organizations. That required transformation leaders to be sensitive to job functions and responsibilities across the different companies on a single ART to foster trust and teamwork instead of competition. Having a single backlog for an ART creates further harmony among diverse team members.

27% Boost in Employee Satisfaction

So far, CMS has trained more than 200 people, including 25 – 30 Certified SAFe® Program Consultants (SPCs). The agency has also since launched four more Agile Release Trains (ARTs).

With training and preparation, participants have been more engaged in PI Planning events after that first learning experience. Communication, says Weaver and Ramirez, has been critical to the acceptance of the new way of working. Especially in the early days, they had to communicate clearly and persistently to convince people to join in the effort and assuage fears about what this meant for their futures.

SAFe Case Study

“We really had to do a lot of selling on SAFe to get people comfortable,” Weaver said. “People were genuinely apprehensive about changing the way they have worked for so long, but as they have seen results, they have embraced it.”

And over time, HQR has implemented other SAFe concepts such as Weighted Shortest Job First (WSJF). Well ahead of a PI, the primary stakeholder has time to weigh the value of work and prioritize—which takes some of the emotion out of the decision, Ramirez says.

They are also in the process of adjusting budgets to fit more with shorter-term planning. Instead of years in advance, they began thinking in terms of three-month increments, in which Ramirez called a halfway step between the traditional approach and the ‘wild west’ of Scrum.

Higher Quality, Happier People

After a bumpy beginning, CMS points to measurable progress:

  • Budget shift to modernization versus maintenance – Instead of 100% of the budget going to maintain the existing HQR system, now only 40% is dedicated to it. A full 60% of the budget goes toward innovation for the system, helping the agency deliver on citizen expectations.
  • Higher quality – The HQR group reports a 55% decrease in help desk tickets from hospitals—demonstrating a direct impact to customer satisfaction.
  • Happier people – Surveys conducted before and after SAFe show a 27% increase in employee satisfaction.

While CMS can’t yet measure customer satisfaction gains directly, they know that fewer quality issues and more innovation contribute to that goal.

“SAFe provided a map that enabled us to shift to modernizing versus just maintaining the status quo,” Weaver said. “Beneficiaries will ultimately benefit from more user-friendly, human-centered design systems, which will allow us to reduce the burden on our providers.”

The group’s success has caught the attention of others, with trains now starting in other CMS groups. “Other programs within CMS have approached HQR asking us how to drive the same outcomes,” Santos said. “It’s a testament to how far we’ve come in the past year.”

  • Transformation starts with leadership – Ideally, you need two to three leaders who are fully committed to the change. If possible, send them through SPC training.
  • Coaches are a MUST – CMS found substantial value in them
  • Agile contracting is necessary – Rigid contracts that have highly specific deliverables can be an obstacle to agility and to embracing shifting priorities as new data emerges
  • Use contractors that understand Lean-Agile principles – Hire teams that truly understand what this means, not just those who can talk the talk
  • Find collaborative work space – From PI planning events to day-to-day work, collaborative work space enables teams to capture the value of face-to-face interaction
  • Just do it! – “If we could time-travel and do it again, we would emphasize a sense of urgency to get going,” Weaver said. “Set a near-term date and follow the roadmap.”
  • Engage employees – Any effort is only as strong as its people. Approach the change with empathy for what your team is undergoing and leverage the support of management and coaches to keep employees engaged and excited.
  • Start with Essential SAFe® – CMS found it valuable to simplify as much as possible and started with a program that lent itself to Essential SAFe. The learnings they achieved will influence larger programs, which will require multiple Value Streams.

Share:

Back to: All Case Studies

Explore more Case Studies

Suggested Case Study:

NHS Blood and Transplant

Read the Case Study

Deutsche Bahn – Lean-Agile Transformation Story

Agile Planning for Transportation

“For Deutsche Bahn Digital Sales, SAFe is the framework for the strategic digitalization program … With it, we are delivering faster and more effectively on our objectives, which drives our ability to compete in the digital age.”

—Matthias Opitz, Senior Program Manager, DB Vertrieb, Deutsche Bahn

Challenge:

After privatizing the company, Deutsche Bahn faced new market forces, along with increasing competition from new transportation players.

Industry:

Transportation

Results:

  • Lead time dropped from 12 months to 3-4 months
  • Coverage of test automation improved from 30% or less to 80-90%
  • Greater collaboration among teams and better results have raised employees’ satisfaction levels

Best Practices:

  • Start ASAP – Begin, even if imperfectly. “It’s more important to give people a chance to work in this environment than to wait until everyone is trained,” said Thorsten Janning, SAFe Fellow, of KEGON.
  • Train extensively – That said, train management and teams as much as possible before the first PI Planning event.
  • Get expert help – DB worked with Scaled Agile Partner, KEGON, from the start and continues to do so for the support and experienced guidance a partner can bring. Progress is a continuous process of asking questions, which a partner can help answer.

The partner that made it happen:

See Partner

Introduction

In recent years, Deutsche Bahn (DB)—one of Europe’s largest railway operators—has faced unprecedented change. In 1994, the two railways of East and West Germany merged after the country’s reunification. While the company was adjusting to the Lean-agile transition, it was also contending with rising costs and greater competition than ever before from other railway operators, long-distance bus services and new, fast-acting players providing ride services and car-sharing.

Agile Planning for Transportation

Within this challenging environment, in 2014 DB embarked on a digital transformation to modernize the way their business units operate, from cargo transport to passenger ticket sales. It was up to each business unit to decide on a path forward to meet those goals.

Initially, the business units implemented Lean-Agile practices at the team level, on a small scope. Yet as they began trying to deliver on objectives, they fell short of targets—especially on larger solutions. The company struggled with lengthy decision cycles; fragmented responsibility; constant design, coordination and estimation; changing requirements; and many, many dependencies.

“In nearly every business unit, the transformation projects struggled to deliver large solutions,” said Matthias Opitz, Senior Program Manager, DB Vertrieb. “We were going around in circles analyzing, and the processes were so complex that the organization was not able to deliver simple minimum viable products.”

It was clear the effort would require a considerable overhaul of its long-established ways of working.

Full-Speed Ahead in DB Cargo

The company looked for a Lean-Agile methodology capable of handling its complex environment on a larger scale and found it in the Scaled Agile Framework® (SAFe®).

Within each segment of the company, at least one business unit rolled SAFe out as part of the digital transformation initiative:

  • DB Cargo: Freight transportation and Logistics
  • DB Netze: Infrastructure/rail network
  • DB Vertrieb: Passenger transport

“For Deutsche Bahn Digital Sales, SAFe is the framework for the strategic digitalization program,” Opitz said. “It brought a continuous delivery process that keeps us on track toward our objectives.”

DB Vertrieb started its Lean-Agile transformation in 2015, when the business unit established an effort named ‘KAI‘ (an acronym for the German words meaning customer centricity, agility, and innovation), which stressed five attributes:

  • Customer excitement over optimization of profits
  • Iteration over perfection
  • Participation over hierarchy and silos
  • Trust and personal responsibility over top-down
  • Active participation instead of business as usual

To ease the transition, the company engaged Scaled Agile Partner KEGON as its primary provider for training and coaching. With KEGON, the DB companies began comprehensive training to prepare everyone who would be joining an Agile Release Train (ART), a team of teams in the Framework.

Lean-Agile leaders at DB Cargo and DB Vertrieb took the Leading SAFe® course, with others taking role-based training such as SAFe® Scrum Master, SAFe® for Teams, and SAFe® Product Owner/Product Manager. At least nine change agents at DB business units also earned SAFe® Program Consultant (SPC) certification in order to teach their colleagues. DB saw training as essential for helping people through the inevitable challenges that would come up, including resistance.

“Training was very important for giving us confidence and answers to questions that came up,” Opitz said. “Because we trained all participants, training also helped open discussions and convince skeptical people that this was the right way to go.”

Delivering on All Commitments

DB Cargo was the first division within the company to kick off the first ART with a Program Increment (PI) planning event. Managers of the other business units attended only to observe.

In that meeting, they accomplished several of their top objectives:

  • Clarified an incremental release strategy
  • Identified business epics regarding end-to-end processes
  • Prioritized business epics with weighted shortest job first (WSJF)
  • Analyzed business epics and identified features
  • Figured out dependencies and planned teams’ work for the coming PI
Agile Planning for Transportation

SAFe practices such as the Program Board gave participants clear insight, for the first time, into the company’s numerous dependencies. With that visual aid, they realized that changes to peripheral systems would affect the critical path of the initiative, allowing teams to coordinate appropriately.

As the PI got underway, leaders and team members alike hit challenges with breaking old habits. The governance and budgeting structures remained in a waterfall construct early on, but began to move toward Lean budgeting as DB Vertrieb kicked off PIs in 2017.

To bridge this gap, Opitz stresses that the business units had to ensure that SAFe and the new approach extended to the broader organization, beyond IT. Therefore, DB Vertrieb decided to establish a ‘Target Operating Model’ (TOM) for the business unit and to perform the transformation activities in a dedicated ART. Shared services departments such as HR, controlling, communication, training
and support, and marketing were brought into the fold.

Any doubt or resistance soon faded away as teams delivered perfectly on target for their first PI. “At first, everyone looked at the committed backlog and said, ‘It’s too much,’” Opitz said. “But by the end of this first PI, we had delivered almost everything, which was a surprise to everyone.”

With SAFe, DB Vertrieb finally implemented a process by which to plan requirements, prioritize, and synchronize the various programs, and to break down the requirements and epics into features and stories. Additionally, automated epic and feature reporting brought critical transparency regarding implementation status.

“Just a year ago, it was a big challenge to do specifications,” Opitz said. “Now we have a process that makes it happen.”

Steps to Success

A number of steps and factors contributed to DB Vertrieb’s SAFe transformation. For one, DB leveraged Agile metrics to manage Portfolios and ARTs, and to help secure funding for them. In turn, management supported the effort by funding standing teams. They also invested in co-located and synchronous PI planning events for all ARTs in 2019.

Agile Planning for Transportation

The company performed a Value Stream analysis, which resulted in four Value Streams covering vertical products and horizontal services.

Toward continuous improvement of testing, teams performed system tests and implemented integrated development test servers.

Starting at the Portfolio level, they switched from a traditional requirements specification process to Agile requirements engineering.

DB Vertrieb found that self-organized teams were empowered to make decisions. In one case, a team detected an incorrect architectural decision when communicating with a stakeholder.

Share:

Back to: All Case Studies

Explore more Case Studies

Suggested Case Study: TomTom

Read the Case Study

Cisco IT – Adopting Agile Development – A SAFe Case Study

Cisco - SAFe for Agile development

“Continuous delivery improved quality, increased productivity, and improved the employee experience.”

—Ashish Pandey, Technical Lead, CSIT Team

Challenge:

Cisco wanted to shift away from waterfall, and replace periodic major releases with continuous delivery of new features.

Industry:

Information Technology, Telecommunications

Results:

Cisco achieved significant improvements by using SAFe on two major projects:

  • 16% drop in the defect rejected ratio (DRR)
  • 40% decrease in critical and major defects
  • 14% increase in defect removal efficiency (DRE)
  • Improved employee satisfaction by eliminating the need for after-hours work and reducing meetings/calls
  • 25 percent fewer quality assurance defects
  • Sprints that ran more efficiently each subsequent time

Best Practices:

  • Carefully build teams – Build teams with the best members from any location.
  • Assemble the right tools – Cisco realized it could not have conducted regression testing every two weeks without test automation tools.
  • Adjust as needed – For un-integrated or loosely integrated products, features or components, consider eliminating the Program level of SAFe.

Introduction

Cisco IT constantly looks for new ways to go faster and simplify. As part of its digital IT strategy, the Cisco Cloud and Software IT (CSIT) organization wanted to adopt more Agile development as a way to replace periodic major releases with continuous delivery of new features.

Cisco - SAFe for Agile development

“Our goals are to speed up releases, increase productivity, and improve quality,” says Ashish Pandey, technical lead for the CSIT team.

Although a few small teams had adopted Agile techniques, waterfall was still the norm for teams that were large, distributed, or working on complex projects.

To solve these challenges, CSIT moved to the Scaled Agile Framework® (SAFe®) and immediately began applying scaled Agile practices on two major initiatives: their Subscription Billing Platform, and the Webex app for Samsung tablets..

Cisco® Subscription Billing Platform Challenge

For its Subscription Billing Platform (SBP)—which supports various subscription services—the company originally formed different teams for design, build, test and deploy. In waterfall fashion, each team began work once the previous team had completed their part.

Cisco - SAFe for Agile development
  • The separate tracks bogged down the process
  • Release cycles exceeded three months
  • They got late closure on requirements documents
  • Teams missed delivery dates
  • There were quality issues due to late integration cycles
  • Teams worked long hours to make up for schedule slippage

The Solution

  • On SBP, Cisco launched three Agile Release Trains (ARTs) in 2015: capabilities, defects and fixes, and projects.
  • All three trains worked together to build and test small features within one SaaS component, while regularly delivering tested features to the system integration and testing team.
  • Every day, the delivery team met for 15 minutes and determined action items.

Results – 40% Defect Reduction

Cisco delivered the new release of SBP on time and with all planned capabilities. When the company compared this release to those using waterfall, it found a 16 percent drop in the defect rejected ratio (DRR). Plus, critical and major defects decreased by 40 percent.

Continuous delivery also increased defect removal efficiency (DRE) by 14 percent due to greater collaboration among international teams, and by helping members identify opportunities for improvement during daily meetings.

Cisco - SAFe for Agile development

The CSIT team attributes those quality improvements to several factors:

  • Improving team collaboration and focus
  • Enabling all team members to see current project status, promoting accountability
  • Helping the three teams see beyond their own track
  • Enabling teams to manage themselves

Additionally, the new way of working improved employee satisfaction by eliminating the need for after-hours work and reducing meetings and calls. Employees also saw how they fit into the bigger picture.

WebEx® App for Samsung

Challenge

In early 2014, the application for WebEx Meetings came pre-installed on Android tablets. Leading up to the release, developers had to work quickly to meet the release date, despite frequently changing requirements.

Solution

The team followed an Agile Scrum framework with three sprints for geographic rollout, the first two consisting of three weeks and the last of five weeks.

During planning, Cisco IT and others gathered requirements, and evaluated the readiness of environments, partners, and engineering and marketing teams.
Developers employed extreme programming, including test-driven development, where they first write an automated test case for a new function. Then they produced the minimal amount of code needed to pass the test and then refined code to make it simpler and easier to maintain.

Results – 25% Reduction in Quality Assurance Defects

On the WebEx app, Cisco reduced quality assurance defects by 25 percent. Plus, with developers checking code in several times a day, the business group reviewed new features sooner in the cycle than before. And each sprint ran more efficiently than the last.

Ultimately, Samsung sold more than 35 million tablets with the new app, creating wide exposure for the brand.

Share:

Back to: All Case Studies

Explore more Case Studies

Suggested Case Study: Royal Philips

Read the Case Study

Johnson Controls – Bringing More Engagement by Adopting SAFe

“SAFe brings so much more engagement, which has really been key for all parties. I wouldn’t want to do it any other way.”

—Rajbir Bal, Program Manager, Access Control

Challenge:

JCI’s access control division needed to improve coordination among firmware and software teams across three locations with the goals of improving time-to-market, quality, and engagement.

Industry:

Information Technology

Solution:

SAFe®

Results:

  • The division releases at least 2-4X more frequently than before
  • JCI reduced the size of its bug backlog by at least 3X
  • Access control delivers on its commitments 100 percent of the time
  • Customers/stakeholders appreciate the chance to provide feedback during the process—instead of at the end

Best Practices:

  • Get help – Especially early on, partner with a consultant
  • Train leadership – JCI trained resource managers, product management, and directors to get buy-in before moving forward
  • Train SPCs – They serve as change agents and coaches
  • Follow progress – JCI used automated Agile dashboards in Team Foundation Server

The partner that made it happen:

See Partner

Introduction

Johnson Controls Inc. (JCI), a global diversified technology leader, serves customers in more than 150 countries and reports $30 billion in annual revenue. The company’s access control division develops systems to help buildings achieve maximum security while increasing efficiency and lowering costs.

Johnson Controls - a Case Study of Implementing SAFe

Developing access control systems demands that firmware and software teams work together to deliver on a coordinated schedule. At JCI, those teams are spread across Southern California, Milwaukee, and India.

In 2014, the division began an effort targeted at improving time-to-market and the predictability of releases. They also sought to identify quality issues sooner, increase transparency, and raise team engagement.

“We were having very little success at agility planning, predicting releases and committing to and delivering on the timeline,” explained David Richter, Director of Engineering, Access Control. “We wanted to increase our flexibility and ability to react to change, and to react to our customer’s needs in a positive and respectful manner.”
But Richter and other change agents knew they would have to contend with several roadblocks along the path to SAFe transformation:

  • Changing the established paradigm of working in waterfall
  • Aligning teams in three disparate locations

Taking the SAFe route

JCI identified the Scaled Agile Framework® (SAFe®) as the most promising route for instilling lasting Lean-Agile practices.

“SAFe brought all the practices for us to start and then learn and adapt as we go,” said Rajbir Bal, Program Manager, Access Control. “It also forced us to have tough discussions early and throughout development—versus down the road when we got close to release.”

To gain leadership backing, the Director of Engineering gave decision-makers clear reasons for deploying SAFe and the expected outcomes. Concurrently, Scaled Agile Gold Partner Icon Agility Services trained leaders in Leading SAFe® so they would fully understand the Framework. This worked well as change agents succeeded in securing executive backing.

They followed with Leading SAFe® for directors, product managers, and resource managers, bringing together 15 individuals from California, Milwaukee, and India. Next, they defined the structure of the various teams that would begin the first Agile Release Train (ART), and put all team members through SAFe® for Teams training.

Two individuals, including Bal, earned certification as SAFe® Program Consultants (SPCs) in order to serve as change agents and coaches. Following certification, they became authorized to deliver SAFe® Scrum Master, SAFe for Teams, and SAFe® for Product Owner/Product Manager training.

In addition to Bal, other coaches included engineering managers and the director of engineering, while Scrum Masters became coaches at the team level. When it was apparent that Scrum Masters and Product Owners had an overlap of responsibility, or at least their understanding of it, Bal brought them together in one location for a custom Product Owner/Scrum Master workshop to clarify roles and responsibilities.

Navigating the path to alignment

In 2015, JCI launched its first ART at a Program Increment (PI) Planning meeting with about 100 people and followed Essential SAFe. Bal and others knew they were taking the first steps toward progress, however, early planning events felt chaotic.

“The first two PIs were not fun and we did not come out with committed plans,” Bal said. “Some features were not well defined, people were not clear on the process, and we needed more time to break down user stories.”

Bal attributes the discord to a couple of factors. The company included some user interface teams in that first ART, but not others, which caused misalignment. Geographic distribution also created challenges.

For more cohesive teams, they tried several approaches. First, they brought representatives from India to present on behalf of their teams. However, in doing so, they lacked the voices of those not in attendance.

Instead, they decided to start concurrent planning in the U.S. and India, with India beginning 12 hours ahead due to the time zone differences. As teams in India complete their planning days, those in the U.S. come in early to overlap with them. The Indian teams present their planning via videoconference. The same goes for day two of planning. American teams presented in what was the evening for their Indian counterparts.

Richter notes that, in those early months, JCI attempted to modify the Framework. Only some teams attended training and the company followed three-week sprints. “We tried to make changes to SAFe, but that was a disaster,” he said. “After that experience, we then started following SAFe exactly.”

Johnson Controls - a Case Study of Implementing SAFe

Many people also insisted on continuing lengthy documentation of functional and design specs, after 50 years of following this practice. But that changed over several PIs. “We realized that documentation is not adding value,” Bal said. “Instead, we switched more to flow diagrams and writing code versus paragraph after paragraph of specs.”

With these tweaks, subsequent PIs progressed more smoothly as everyone became accustomed to the ceremonies and practices of SAFe. They made better use of their time at PI planning events. By the third PI, all teams also joined the train.

Over time, JCI found it more feasible to modify the framework to its own processes. In the access control division, developers must follow a specific process. They found that SAFe allowed them to implement Lean-Agile methods that worked in conjunction with these required processes. Other modifications included concurrent planning for India and the U.S., and face-to-face meetings between Product Owners and Scrum Masters to walk through the features radiator.

Acting like ‘One Big Team’

Richter and Bal saw a number of positive outcomes emerge during the transformation:

  • Increased ownership – Entire teams committed to goals in PI planning and delivered on those goals
  • Less technical debt – Issues were identified earlier in development, which allowed for course corrections along the way, instead of at the end of development
  • Greater participation – All levels joined in, including business partners and architecture
  • Earlier decisions – Using the Lean Startup Cycle, they make go/no-go decisions sooner in the cycle than they had before practicing SAFe
  • More automation – Automation reduced the overhead of testing and corrects quality issues earlier
  • Enhanced transparency – People bring up issues sooner, rather than at the end of a PI
  • Greater teamwork – Inter-team collaboration improved as well, with individuals reaching out to help others when needed

“We started acting like one big team, instead of a bunch of teams of teams,” Bal said. “We saw more engagement at all levels.”

Driving time-to-market, quality, predictability

Johnson Controls - a Case Study of Implementing SAFe

After early growing pains, JCI began seeing the results of its efforts:

  • Faster time-to-market – The division releases at least 2-4X more frequently than before
  • Higher quality – JCI reduced the size of its bug backlog by at 3 times
  • Predictability – Access control delivers on its commitments 100 percent of the time
  • Customer satisfaction – Customers appreciate the chance to provide feedback during the process—instead of at the end

“This wasn’t an easy process for us,” Bal said. “It takes time getting everyone jelling PI over PI. But SAFe brings so much more engagement, which has really been key for all parties. I wouldn’t want to do it any other way.”

For more details on JCI’s Essential SAFe implementation, download the supplemental PowerPoint presentation.

Download the Case Study Supplement

Share:

Back to: All Case Studies

Explore more Case Studies

Suggested Case Study:

Deutsche Bhan

Read the Case Study

Telia Finland – SAFe Transformation Journey

“SAFe seemed like a 1-to-1 match for us. Someone had already come up with a model to address our needs, which brought better requirements management, prioritization, governance, and a common language for the entire organization.”

—Risto Reinikainen, Head of Lean Agile Center of Excellence, Telia Finland

Challenge:

In the competitive, fast-moving telecom market, Telia Finland sought to deliver more capabilities to customers, but that longstanding waterfall methods kept it from moving forward.

Industry:

Telecommunications

Solution:

SAFe®

Results:

  • 39 percent more capabilities than before
  • 34 percent less cost
  • 94 percent accuracy delivering on commitments for a major rebranding
  • Teams deliver incrementally and more often
  • People are more engaged in and satisfied with their work

Best Practices:

  • Don’t skip training – Telia trained as many people as possible on Leading SAFe and Implementing SAFe, with many earning SAFe® Agilist (SA) and SAFe® Program Consultant (SPC) certifications. When they hit the critical mass, everything began running more and more smoothly.
  • Get help, especially in the beginning – Telia engaged partners for training and guidance for the first one to two years to speed up implementation
  • Prepare suppliers – The company provided way of working documentation (WoW) and training for suppliers
  • Plan ahead – Do your homework on epics and features, and prepare carefully for ceremonies, especially for PI Planning

The partner that made it happen:

See Partner

Introduction

Telia is a leading telecom operator in the Nordic and Baltic regions with 21,000 employees and 84.2 billion SEK ($9.46 billion USD) in net sales. Telia Finland is a major player in the Finnish market with operations on mobile, broadband, fixed line, and TV.

Within the country, multiple companies compete for a share of the telecom market. To stay ahead of the competition, in 2011 Telia Finland began a transformation initiative to deliver innovations to customers faster. At the time, the company struggled with infrequent and often delayed releases—about every nine to 12 months—and quality issues, with various groups placing the blame on others.

telecom and SAFe

“The market, especially in the mobile business, is constantly changing,” said Risto Reinikainen, Head of Lean Agile Center of Excellence at Telia Finland. “To compete, we have to be very proactive and agile in bringing out cutting-edge offerings.”

To that end, individual teams and projects spent several years applying more or less homegrown practices to achieve goals, including improving communication, putting more emphasis on statements of work, better requirements management, and close follow-up of activities. Yet none of these disparate activities produced the results they sought and most projects continued in waterfall.

SAFe®: A Perfect Fit

Driven by an urgent need to change, Telia researched Agile methodologies. When they came across SAFe, it seemed like a perfect fit for their objectives.

“SAFe seemed like a 1-to-1 match for us,” Reinikainen said. “Someone had already come up with a model to address most of our needs, which brought better requirements management, prioritization, governance, and a common language for the entire organization.”

To begin the journey of adopting SAFe, Telia engaged partners such as Scaled Agile Partner CGI for training and coaching. Partners initially trained approximately 100 people on Leading SAFe®. The next natural step was to train Telia’s own people on Implementing SAFe®. During the fall of 2016, four people earned SAFe® Program Consultant (SPC) certification and began leading training as well..

The company kicked off its first Program Increment (PI) in 2015. Since many within the company had worked with loose Agile concepts previously, most individuals were ready and willing to embrace a more mature framework. Yet, the first few PIs did not go as smoothly as hoped as people were still getting accustomed to the new terminology and method. The structure, however, kept people engaged and with a clearer vision about their roles.

“The First Planning sessions were more or less chaotic,” Reinikainen said. ”Epics and features were far too big and not mature enough; routines and tools were missing; some teams were still waterfalling their sprints; and areas such as test automation and configuration management were not ready for Agile operations.”

The company applied that experience and devised various steps to prepare people for PIs. They trained as many people as possible on Leading SAFe® with many earning SAFe® Agilist (SA) certifications. To that, they added their own ”war stories” to educate team members and give them more insight throughout the training.

To prepare suppliers to join Agile Release Trains (ARTs), Telia created a guidelines document on working with Telia and applying SAFe, and a workshop to reinforce the concepts. Every few weeks, coaches followed up with suppliers to ensure they were working in the new model. The common language of SAFe effectively unified the internal and external team members across locations.

Once Telia reached around 200-250 people trained, Reinikainen noticed a new synergy; people were using the same terminology and applying the concepts more cohesively and naturally. Today, the company has trained more than 400 people. They promote continuous improvement and best practices with Communities of Practice.

An Answer for Complexity: Large Solution Level SAFe

Initially, Telia began with Program-level SAFe, but then moved to Portfolio-level SAFe. More recently, they moved to Full SAFe, including SAFe’s Large Solution level, to accommodate complexity, which includes more than 200 systems, many dependencies, and numerous external suppliers. Particularly, the Large Solution level offers the roles, artifacts, and processes for larger, multi-year projects such as those at Telia.

From Telia’s perspective, Full SAFe and SAFe’s Large Solution level brought much-needed additions:

telecom and SAFe
  • More transparency to all development activities and resourcing
  • Coordination and synchronization between waterfall projects and Agile Release Trains (ARTs)
  • Control, visibility, and transparency to connect all trains, suppliers, and programs
  • Greater value creation with one prioritized portfolio backlog

“Large Solution SAFe brought a systematic approach to our complex environment that we definitely needed in order to coordinate our work,” said Nina Pakkanen, a Solution Train Engineer (STE) at Telia.

In Inspect & Adapt sessions at the close of PIs, comments from team members confirmed that the Large Solution level had achieved what Telia anticipated:

  • “Large Solution Level makes epics more concrete prior to actual implementation.”
  • “Capability and feature-level analysis are much clearer now.”
  • “Transparency and collaboration with the business has improved a lot.”

Additionally, Telia consolidated from seven development portfolios into a single operational one that includes all B2B, B2C, B2O, and channel solutions—resulting in better visibility into resources, activities, and priorities. Before, the various portfolios competed for the same resources and projects.

Pulling Off a Rebrand—On Time

In 2017, when the company rebranded under the name Telia Finland, SAFe provided essential structure to coordinate the many pieces. Overnight, everything had to be branded with the Telia Finland name, from the website to napkins.

With everyone committed to the goal, they delivered smoothly by the target date. What’s more, they did so with 94 percent accuracy on their commitments.

“At night it was the old name, and in the morning everything was under the new name,” Pakkanen said. “It was truly a success that we carried out such a big initiative on time.”

Delivering More, and More Often

Telia currently runs two Agile Release Trains and two Large Solution Trains with around 350 people. Since moving to SAFe, the company has noted quantitative and qualitative results to show its progress:

  • More capabilities – The development organization delivers approximately 39 percent more capabilities than before
  • Greater predictability – Telia has much-improved insight into what’s coming in the next one to two years
  • Cost reduction – Telia reduced the price per developed capability by around 34 percent
  • More frequent delivery – Teams deliver incrementally and more often
  • Higher engagement – Leaders note that people are more engaged in and satisfied with their work

Such results have helped earn middle management buy-in for the transformation; their commitment has increased in step with results.

“People know the old way doesn’t work, and they are now seeing that SAFe is a better approach,” Pakkanen said. “We’ve demonstrated that, even on the largest projects, this creates more communication, more transparency, and more progress.”

Share:

Back to: All Case Studies

Explore more Case Studies

Suggested Case Study: Swisscom

Read the Case Study

Air France-KLM – Accelerating Agile Adoption with SAFe

Air France - Scaled Agile Practices with SAFe

“We wanted to experiment and demonstrate Agile principles and practices across domains. By empowering each business domain, acknowledging specific contexts in domains, fostering sharing, and ‘try and learn,’ SAFe has helped us get on the right track to success.”

—Claire Charbit, Program Management NWOW Agile Adoption, Air France-KLM

Challenge:

Air France – KLM sought to scale Agile practices companywide to improve time to market and efficiency, but must contend with specific contexts and regulations in the different businesses of the airlines.

Industry:

Transportation, Aviation

Results:

  • SAFe teams released 17 times in the live environment in seven months compared to every six months previously
  • On average, SAFe teams release 20% more effectively than waterfall teams
  • The company gained 20% market share in the small and medium logistics market alone
  • On one offering, the company exceeded expectation by 25%
  • Air France – KLM is more intimate with its clients

Best Practices:

  • Focus on Transversal Topics for a sustainable adoption – “From day one, make them part of the adoption,” Moreau says. These topics affect all domains.
  • Let domains and teams define objectives – Teams are more committed and empowered if they set their own goals
  • Train continuously – The Core Team regularly holds Agile Booster workshops to help with specific adoption challenges such as how to deal with conflicting priorities from both airlines, and what does it mean to have an Agile mindset?

Introduction

One of Europe’s largest passenger airline groups, Air France – KLM operates up to 2,200 flights daily and carries over 93 million passengers annually. The company’s five airlines—Air France, KLM Royal Dutch Airlines, Transavia, HOP! Air France and Joon—cover 320 destinations across 114 countries.

Air France - Scaled Agile Practices with SAFe

In a highly competitive industry, where information systems can be strategic competitive assets, Air France – KLM set out to reduce its time-to-market with business applications. To do so, the company decided to improve the business/IT collaboration by breaking down silos and expanding Lean-Agile practices.

“Before, in moving from waterfall to Agile, we were not able to make the leap on a broader scale,” says Edwin Borst, Program Management NWOW #agile Adoption, Air France – KLM.

Achieving its goals would require bringing together diverse cultures at French and Dutch offices, as well as contending with diverse contexts, operational constraints or regulations across the different business domains.

An Agile Adoption Empowering Business Domains and Teams

After the successful launch of three ARTs in the Commercial Digital business domain in the late summer of 2016, the company decided to leverage this success and create a broader-scale adoption. Pieter Bootsma, Executive Vice-President of Commercial Strategy at Air France – KLM, noted: “We can all benefit from Agile in the whole group and not only at Commercial Digital.” So, in late 2016, the company chose to foster and accelerate the adoption and scaling of Agile practices.

Prior to launching the broad SAFe adoption, a small group of transformation leaders spent several months defining the scope of the deployment, the way the adoption would be conducted, and preparing for the adoption of SAFe on a larger scale. The leaders decided to adopt Lean-Agile principles and values in the way the program would be set up and run. The goal: demonstrate the mindset and practices, and see the benefits of this approach in a Change Management context.

  • Empower each business domain via its own self-organized, multidisciplinary, “Agile adoption team”
  • Deliver the change in short cycles, enabling experimentation and quick adaptation
  • Start small with minimum viable products (MVPs)
  • Share and learn from each others’ domains
  • Differentiate and adapt to each domain’s specifications and context
Air France - Scaled Agile Practices with SAFe

In late 2016, the company chose the Scaled Agile Framework® (SAFe®) to foster and accelerate the adoption and scaling of Agile practices across the various business domains.

“In order to manage our Agile adoption program across 11 business domains within Air France – KLM, we formed an Agile Release Plane (ARP, modified to fit the industry), inspired by SAFe,” says Didier Lavielle,  Program Management NWOW #agile Adoption, Air France – KLM. “SAFe gives us the framework we have been missing while at the same time empowering each business domain to define their own way to reach their goals.”

Each business domain (Commercial, Cargo, Flight and Ground Operations, Engineering & Maintenance, Finance, Human Resources) joined the ART with its own change team—named Agile Adoption Team—and self-organized as a product team. As a mix of IT and business, the Adoption Team defines the specific objectives, approach, and steps to take in its domain: people to train, Agile product teams to form, coaching needed, communication plan, monitoring progress, and more.

The company formed “Transversal Tracks,” (groups that tie into all business domains), which joined the ART: Human Resources (e.g. role description, training, and coaching), Finance and Portfolio Management (IT investment processes), Tooling and Capabilities, Communication, and “IT Readiness.” This setup brought value to the 11 domains by not having to reinvent the wheel and ensured consistency in harmonized solutions.

Air France – KLM engaged with BlinkLane Consulting for guidance and training. Around 150 team members in the Agile Adoption ART, from the various business domains and Transversal Track teams, attended Introduction to Agile training, with about 50% of them taking the Leading SAFe course.

Some of the Transversal tracks went through specially designed workshops regarding Lean Budgeting, Agile KPIs & Reporting, and Agile HR, for instance. Those supporting the various adoption teams either attended the SAFe Scrum Master training or were already certified SPCs. So far, more than 300 colleagues from the Adoption ART and from the regular ARTs have followed the Leading SAFe training.

Aligning the Stakeholders on a “Definition of Awesome”

Prior to kickoff, all business domains and Transversal Track groups aligned on a common definition of awesome with four themes:

Agile Enterprise – In the Air France – KLM enterprise, the autonomous, stable, and cross-functional teams are the cornerstones of the organization for driving innovation and continuous improvement. The Transversal processes support and stimulate an Agile way of working and mindset at all levels. This allows the company to focus on continuously maximizing quality and delivering value to the customer.

Value Creation – The Agile adoption aims to create more value—for customers and employees. Quality as well as effectiveness go up. The company succeeds by driving down the time-to-market, and increasing the Net Promotor Score.

Leadership – Air France – KLM develops servant leaders who empower Agile teams and value streams. They engender trust, work with a clear purpose, and provide direction to all levels of the Agile Enterprise. They are recognized for their Agile leadership, enabling others to succeed and drive the organization for continuous improvement. They focus on goals instead of tasks.

Employee Engagement – The organization is recognized as a best place to work. As a result, it attracts talented people. It works closely with customers. People feel responsible and autonomous for their products and results. Employee satisfaction is high and demonstrated by EPS (active promotors).

Big-Room Kickoff in Paris: PI Planning Event #1

Air France - Scaled Agile Practices with SAFe

The company officially kicked off the Air France – KLM New Ways of Working #agile ART at the first PI planning event in March 2017 in Paris. The Release Train Engineer (RTE), Odile Moreau from BlinkLane, was part of a small group of transformation leaders called The Core Team. The team, which includes three from Air France – KLM and three from BlinkLane, helps foster the adoption and structure; organize the program and its events; support the domains and the Transversal tracks; and monitor the progress and the results.

The five Transversal tracks, 11 business domain adoption teams, and the Core Team formed the ART, with 150 people. The company’s group CIO, Jean-Christophe Lalanne, and Commercial Strategy EVP, Pieter Bootsma, attended as executive sponsors and set the tone for the importance of the initiative.

At the first PI event, Air France – KLM introduced a logo created specifically for the program, which added strategic emphasis.

Team members from France and the Netherlands came together, bringing distinctive cultures and very diverse states of Agile: some were new to Agile principles and some brought several years of experience

“Although this approach and the PI Planning event was new for most people, everyone was really driven and motivated to share experiences, learn from each other, try and experiment, and work toward results,” Lavielle says.

Yet despite that excitement, many were hesitant to break out of their own groups and talk with those they had never met. Thus transformation leaders requested that anyone adding yarn to the program board—indicating dependencies—discuss it directly with the individuals involved.

As the first PI progressed, teams achieved about 60 percent of their stated objectives, on average. In leading up to the second PI, they applied the lessons learned and set more accurate, quantifiable objectives.

At the start of the second PI, Air France – KLM began a new practice of having each business domain and Transversal Track share its business results with the entire group as a PI begins. At the same time, this served as an opportunity to Inspect and Adapt what worked and what didn’t.

By the third PI, in the fall of 2017, Air France – KLM had grown to 208 product teams and eight ARTs across Commercial Digital, Cargo, Commercial, and AF Flight Ops. The KLM HR division and the AF Ground Services have both organized Value Stream workshops to either launch new trains or reorganize their current Agile teams into an ART. The same applies to Digital Commercial. Following on the continuous Inspect & Adapt, Commercial Digital will also reorganize its current ARPs to allow for more alignment on the business objectives and improve its delivery model.

Lessons Learned and Best Practices

Along the way, they learned a number of lessons to improve their efforts going forward:

  • Have an approach for dealing with the diversity across domains, both in their Agile maturity and in their specific context and constraints (operational, security, and regulations)
  • Establish strong ownership in each business domain via an individual adoption team
  • Since most of the dependencies lie between Transversal Tracks (HR or Finance impediments) and business domains, co-create solutions for Transversal topics that facilitate exchanges and encourage learning from each other
  • Actively address the challenge of changing the managerial mindset and leadership styles
  • Understand that setting realistic goals for the next 15 weeks will be difficult for most, as is learning to set smaller, more realistic goals
  • Encourage individuals to ask for help from someone in a Transversal Track or the Core Team
  • Ensure that the team members who are not 100% dedicated and co-located commit to objectives and organize in a way to still be able to work together and produce results
  • Ask for regular feedback to respond to uncertainties and come up with valuable results
  • Leave personal egos at the door and achieve common objectives

Investing in Role-Based Training

Where it can, the company trains with the SAFe curriculum. All RTEs go through SAFe Release Train Engineer training. Scrum Masters with the PSM certification are offered the SAFe for Scrum Master training and certification when joining an ARP. The same applies for Product Owner. Team members also attend SAFe for Teams when they join an ARP. Additionally, the company developed training and workshops for Lean Budgeting, using the Weighted Shortest Job First, and other practical guidelines.

A community of 40 coaches support the effort at various levels: teams, domain, adoption, and enterprise. This community is growing in maturity and results. In the third PI, the company will focus on internalization and growth of the coaches, ensuring a more sustainable and economical support for the Agile community.

Air France - Scaled Agile Practices with SAFe

Results: 20% More Effective Delivery

Since deploying SAFe, Air France – KLM notes greater collaboration between business domains and Transversal Tracks. Within three months, their efforts began paying off in business results in the Cargo group:

Time-to-market – Each ART team delivers on its promises every three weeks. Since moving to SAFe, the company released 17 times in the live environment in seven months compared to every six months previously.

Quality – Of the 17 releases, the company had to delay just one due to a major incident

Productivity – SAFe teams deliver, on average, more than 20% more effectively than waterfall teams

Adaptability – With a PI cycle of 12 weeks, Air France – KLM has been able to pivot its vision three times in the past year, allowing the company to tap into new business opportunities much more quickly and easily

Market share – The company gained 20% market share in the small and medium logistics market alone with this flexibility

Predictability – The velocity of ARTs builds in more predictability and enables teams to take ownership and show greater craftsmanship. Team stability is also an important success factor in results

Business value – On one offering, the company exceeded expectation by 25%

Employee satisfaction – PI Planning results in better transparency and autonomy for the teams. Seeing the vision in the Cargo group encourages team members to contribute to the business value and increases their work satisfaction, as well as collaboration between business and IT

Customer satisfaction – Air France – KLM is more intimate with its clients. All Product Owners from the business side have a greater understanding of the demand. Going live with small changes and new functionality every three weeks gives them a faster feedback loop and more rapid pivoting, enabling groups to deliver greater value in its IT solutions

Air France - Scaled Agile Practices with SAFe

Air France – KLM looks forward to seeing ever-greater progress as it moves toward DevOps, allowing the ARTs to deliver end-to-end with an integrated team.

“We have started experimenting more with weighted shortest job first (WSJF) in our priority at the Features level,” Moreau says. “We also want to harness the work with Portfolio Management and Lean budgeting.”

Share:

Back to: All Case Studies

Explore more Case Studies

Suggested Case Study:

Deutsche Bhan

Read the Case Study

Fannie Mae – Adopting Agility in Business Using SAFe

“SAFe provided the agility, visibility, and transparency needed to ensure we could integrate with numerous other efforts, get predictable in our delivery, and ensure timelines are met.”

–David McMunn, Director of Fannie Mae’s Agile COE

Challenge:

Within three years, the organization would need to stand-up an entirely new business model that would change the way securities are issued to the market—and do so within aggressive timelines.

Industry:

Financial Services, Government

Results:

  • Releases now happen every month, instead of once or twice a year.
  • They integrate reliably every two weeks.
  • Fannie Mae reduced delivery risks.
  • The organization reduced the defect rate substantially.
  • Teams now deliver more than 30 attributes per sprint compared to 2-5 before.
  • Velocity increased from 10 story points to more than 30.

Best Practices:

  • Sync cadence – Establishing a common cadence was critical to success. Engineering practices must evolve in order to comply with bi­modal governance.
  • Work on database modeling upfront – For any data-heavy effort, perform advance work on database modeling to avoid the impact of changes identified later in the sprint.
  • Develop a playbook – Such guidance reduces rework for multiple teams working in parallel.

Introduction

Fannie Mae is the leading provider of mortgage financing in the United States. Operating under a congressional charter, Fannie Mae—and its sibling organization Freddie Mac—play an important role in the nation’s housing finance system; they provide liquidity, stability, and affordability to the mortgage market.

Coming out of the housing crisis in 2013, Fannie Mae recognized that the lending environment it was moving into required it to be even more responsive to meet rapidly changing customer needs. Further, Fannie Mae recognized that agility was critical to achieving this objective—not just in technology, but across the organization.

In January 2015, Fannie Mae was preparing to align with guidance provided by the Federal Housing Finance Agency (FHFA) and Congress, under a new joint venture named Common Securitization Solutions (CSS). As part of this effort, Fannie Mae undertook an initiative to transform some of their key internal business processes to align with CSS to build a universal securitization platform for the issuance and management of mortgage-backed securities.

SAFe for Mortgage Financing

Within three years, Fannie Mae planned to develop an entirely new business model that would change the way securities are issued to the market—and do so within aggressive timelines. More than 20 development teams, encompassing over 300 individuals, were needed to integrate development and testing efforts across 30 assets. As Fannie Mae prepared to implement this change, the organization encountered several challenges as the new model was being defined based on continuously evolving requirements.

“When you’re doing a large-scale integration with a lot of data, the number-one factor for success is early integration and early testing,” says Atif Salam, Director of Enterprise Data at Fannie Mae. “The federal mandate required us to mitigate risk from the get-go, and we realized early on it would not be possible following a waterfall approach. There was no better way for us to mitigate that risk than to adopt Agile.”

Overcoming Initial Roadblocks

Enterprise Data’s efforts to adopt Agile uncovered several challenges, both internal and external:

Challenge #1: No Agile capability evident for the initial two teams at the outset of the Enterprise Data initiative.

The first Enterprise Data teams were brand new to Agile, the Scrum methodology and, having been formed specifically for this initiative, working with each other.

Prior to adopting SAFe, Enterprise Data developed a standard on-boarding approach and entrance criteria for standing up new teams. Additionally, external Agile subject matter expertise was brought in to train and work with the teams, and an Agile Mature Model (AMM) was created to baseline behaviors and practices, as well as identify areas for optimization.

Thereafter, once the decision had been made to adopt SAFe, the program began to work through the SAFe Readiness Checklist. The AMM was used to set target benchmarks that all program teams were required to meet in order to ensure there was sufficient capability in place from which to scale.

Challenge #2: At the outset of the Enterprise Data initiative, a Scrum team could only complete a single user story due to inflexible architecture, end-to-end testing challenges, and numerous build constraints. Further, it was typical for the work to be gated by subject matter expertise between developers who viewed data attributes as a data point, comprised of both sourcing and vending complexities, that could only be implemented sequentially.

In response, technical leads focused on eliminating constraints, reducing complexity, and optimizing workflow. Specifically, Technical Leads worked with the teams to leverage cross-functional team/paired programming constructs to augment technical expertise. As a result, the teams began to view data attributes not as a data point, comprised of both sourcing and vending complexities, but rather as having two distinct pieces of business value, specifically sourcing and vending.

Additionally, they made the effort to move system integration testing (SIT), as well as user acceptance testing (UAT), left into the Scrum team. As a result, and over time, each team began to complete multiple user stories within a given sprint. Additionally, the organization adopted an emergent design mindset, formed cross-functional Agile feature teams, and aligned to a common cadence that synchronized their activities (e.g. sprint planning, Scrum-of-Scrums, sprint reviews).

SAFe for Mortgage Financing

Challenge #3: At the outset of Enterprise Data’s journey, complexity was further complicated by the fact that teams were required to develop and integrate their code in the same mainline, thereby replacing branching as an accepted technical practice. Additionally, Fannie Mae required new release traceability management that would satisfy corporate and federal governance requirements.

To address these challenges, technical leads and shared services focused on building a continuous integration capability, across all teams, using the same codebase. The organization had always had application lifecycle management (ALM), however, it needed to re­think continuous integration to realize true efficiencies. Over the course of 10 months, the organization focused on leveraging automation to reduce the time to implement builds from once every six months to multiple times a day.

Additionally, Enterprise Data adopted behavior-driven development engineering practices for traceability, automated testing, and prototyping.

SAFe for Mortgage Financing

Challenge #4: Upstream technical dependencies specific to architecture, database design/modeling, and test data provisioning prevented the teams from completing a single user story within the two-week sprint cadence.

In addition to the technical challenges the teams were facing, there were also multiple upstream dependencies on architecture, data modeling, and test data management that they had to resolve before a User Story could be implemented by a team working in a two-week cadence.

Initially, working ahead of the teams, a group of business analysts were assembled and assigned to groom the program backlog sufficiently so that User Stories met, or exceeded, 80% of the sprint team’s Definition of Ready. Despite this focus, however, there was barely enough ready work in the program backlog for the teams to bring into their respective sprint planning. This was due to the lead times required to resolve upstream dependencies as well as the need to respond to continually changing requirements.

In preparation for scaling, Enterprise Data worked with their business stakeholders to create a roadmap of features spanning one business quarter. Simultaneously, they focused on optimizing backlog health, sufficient in depth to support the Agile teams, for at least two consecutive sprints. Additionally, adopting a system perspective, the entire value stream was analyzed to better anticipate, and mitigate for, internal/external technical dependencies.

Challenge #5: The organization’s culture was accustomed to working within a traditional implementation methodology.

At the outset, Fannie Mae had a traditional command and control culture, supported by a broader ecosystem of corporate functions that had to change to support Agile. Those leading the change made a significant effort to work with leadership and management to pivot from the traditional role of directing delivery to becoming Lean-Agile leaders and critical change agents, both supporting the teams as well as modeling the values and principles of the Agile Manifesto.

As already noted, leadership and management changed their focus to clearing impediments impacting the teams. Additionally, they influenced corporate functions to align in support of Agile, get the business integrated and involved, as well as to put the pieces in place to create an environment focused on continuous learning. “Historically we would have seen challenges as failures in requirements or development rather than opportunities to fail fast and learn, and improve,” Salam explains.

While still new to their roles, the Lean-Agile leaders infused a sense of purpose in the teams and gave them autonomy to implement the work while decentralizing decision-making and minimizing constraints.

SAFe: Agility. Visibility. Transparency.

Although Fannie Mae had pockets of Agile capability up to this point, leadership understood that a scaled Agile methodology was required to achieve their objectives. Fortunately, individuals within the company had prior success with large-scale Agile deployments using the Scaled Agile Framework® (SAFe®).

Fannie Mae teamed up with an external Scaled Agile Gold partner to develop and mature its Scrum capability and then deploy SAFe. As the first to make the SAFe transition, the Enterprise Data division became the torch bearer.

“We had multiple waterfall efforts, third-party integration, and a hard regulatory mandate that made coordination and execution exceptionally difficult,” explains David McMunn, the Director of Fannie Mae’s Agile Center of Excellence (COE). “SAFe provided the agility, visibility, and transparency needed to ensure we could integrate with the numerous other efforts, get predictable in our delivery, and ensure timelines are met.”

Fannie Mae applied a dogmatic approach to ensure the organization was developing a consistent set of practices across multiple teams at the outset. External coaches delivered Agile, Scrum Master, Product Owner, Leading SAFe (SA), and SAFe for Teams (SP) training. The SAFe training was then mandatory for every new team joining the effort.

Fannie Mae launched its first Agile Release Train (ART) encompassing six programs, across 12 teams, with more than 130 people, in June of 2015. Admittedly, that first Program Increment (PI) offered some learning experiences.

“In spite of all the preparation that went into the backlog, setting expectations, confirming attendance from stakeholders, and the training prior to planning, the first PI was somewhat of a chaotic experience,” says Scott Richardson, Chief Data Officer at Fannie Mae.

Context setting provided by the business, product, and architecture leads took time away from team break-out sessions and, as a result, the teams struggled to resolve all of the open requirements and scope questions to complete their plans.

“But by the end of the second day,” Richardson continues, “we started to see progress.” The teams had mapped out their dependencies on the program board, resolved, owned, accepted, or mitigated (ROAM) all of the known risks in the PI and achieved a Fist of Five confidence score of 3.

“The session offered the very first opportunity for all stakeholders to work together on this multi-million dollar program.” Richardson adds. “A new way of managing large-scale integration efforts at Fannie Mae was emerging that would spread across the technology enterprise.”

Over the next few PIs, the organization knew more clearly how to prepare for the PI planning meeting and confidence scores began averaging 4 and higher.

Modeling Confidence in the New Methodology

During cross-team planning in an early PI, it became clear that several teams were not on track to deliver important capabilities within the targeted timeline. “Some of my best new Agile team leaders offered to throw more people at the problem ‘just this once,’ and crash the schedule like they did in the old days,” Richardson says. “It’s in those moments that you need to model confidence in the Agile method, to be the calm in the eye of the storm.”
Instead, the Agile team leaders were encouraged to go back to the Product Owners regarding the change in priorities and empower them to devise a new minimum viable product. “Within a couple of hours, everything was back on track with planning, and ultimately all the teams delivered, and the external customer delivery was on-time,” Richardson says. “Now they carry this story with them, and are empowered to solve problems and make decisions in truly productive ways. It’s part of the culture.”

SAFe for Mortgage Financing

Gains across the Board

Today, Fannie Mae has come a long way. The Enterprise Data division delivered an integrated solution on time and with much higher quality than was expected for an effort of this size. From a broader perspective, the transformation to SAFe revolutionized how the organization plans for the delivery of large-scale programs.

Fannie Mae has seen improvements on multiple fronts:

  • Reduced risk – Fannie Mae reduced delivery risks through the relentless focus on innovation and automation to ship “production ready” code with higher and higher frequency. They significantly mitigated the risk inherent in complex integration between legacy and new architectures/applications, as well as between internal and external systems.
  • Faster feedback cycles – Enterprise Data delivers system demos and integrated code every two weeks. Releases now happen every month, instead of once or twice a year, for the largest application across the enterprise, with millions of lines of code.
  • Improved predictability – Teams, within the program and across the enterprise, integrate reliably every two weeks.
  • Boosted quality – The organization reduced the defect rate substantially.
  • Increased business value – Teams now deliver more than 30 attributes per sprint compared to 2-5 attributes when Agile was first adopted within Enterprise Data.
  • Better team progress – Teams undergo regular AHR (Agility Health Reviews) cycles and have matured to higher Agile Maturity Model levels.
  • Greater efficiency – Fannie Mae realizes significant efficiency through a reduction in technical debt.

After the initial deployment, the division rolled out SAFe to the rest of the organization, training up to 600 people on Leading SAFe, SAFe Advanced Scrum Master, SAFe Scrum Master, SAFe Product Manager/Product Owner, and SAFe for Teams, depending on roles. Several employees went on to achieve their SPC certification.

Currently, Fannie Mae runs three ARTs. The Enterprise Data ART recently completed its 13th PI. Additionally, there are more than 200 Lean-Agile teams across Enterprise IT, encompassing over 3,000 people. Functional and business portfolios are adopting lightweight Lean-Agile values and practices as part of their day-to-day activities.

“This way of working has spread across the organization,” Salam says. “It’s changing the way we deliver for the customer, the way we hire and do our budgeting, and is continuously extending further and further into the business.”

Share:

Back to: All Case Studies

Explore more Case Studies

Suggested Case Study:

Dutch Tax and Customs Administration

Read the Case Study

Australia Post – Implementing SAFe in Delivery Services

“SAFe has really helped bring the organization along its transformation journey. Its real value has been in the way it links strategy with decentralized execution, using metrics to enable a high level of transparency and fact-based decision making to focus on achieving business outcomes.”

–Natalie Field, Head of MyPost Consumer

Challenge:

Effectively deliver solutions that sustain and further enable Australia Post as a trusted services provider, and delight customers with personalized digital products and services.

Industry:

Delivery Services

Results:

  • 100-fold increase in yearly production deployments with 98% cost reduction, enabling iterative product development
  • 400% Agile Release Train productivity increase over 18 months
  • Strong overall delivery predictability of 80%+
  • First-Time Delivery rate improved by 7 percentage points
  • Net Promoter Score rose by 8 points
  • Increased employee satisfaction and engagement

Best Practices:

  • Establish a learning and improvement mindset – Place a primary focus on learning and continuous improvement across all facets of delivery to achieve consistent growth in maturity and effectiveness.
  • Measure outcomes – Enabling a metrics and measurement capability links teams to business strategy and is key to ensuring business outcomes are effectively achieved.
  • Align to DevOps principles – Building a strong technology delivery platform aligned to DevOps principles enables iterative and innovative product
  • Focus on the entire system of work – Build organizational advocacy and sustainability by facilitating change and enablement for shared teams that support and govern Agile Release Trains.

Introduction

Australia Post is Australia’s iconic postal services provider. For 208 years, the organization has been integral to how people and communities connect across Australia. Through a collective workforce of over 50,000 people, Australia Post serves communities, citizens, and businesses, from large corporations to government departments.

Australia Post - Implementing SAFe in Delivery Services

Like many organizations, Australia Post’s business has been disrupted and must transform to adapt to the digital era. Traditional business pillars such as letters are in persistent decline, while the company faces fierce competition, but also immense opportunity with the growth of ecommerce. For Australia Post, that opportunity lies in creating sustainable competitive advantage through trusted relationships between consumers, businesses, and government.

Given these forces, Australia Post needed a new way of working to both sustain and further enable the organization as a trusted services provider, and to delight its customers with personalized digital products and services.

SAFe: Driving Change with Lean Structure and Common Language

Over the past four years, Australia Post has invested in its technology, people, and culture to change the way it works to focus on customer experiences and continuous innovation. To help achieve this agility in business, Australia Post selected and adopted the Scaled Agile Framework® (SAFe®) not only as an operating model but as a tool for change. With SAFe, the organization aims to describe, communicate, and build an understanding of how to leverage Lean and Agile principles across the organization.

“The structure and discipline outlined in SAFe have been a powerful way to communicate a different way of working,” says Daniel Fajerman, Head of Digital Engineering. “Using an industry-proven framework offered a strong basis to start the conversation about working differently, providing a common language and consistent base to work off.”

Achieving Sustainable Change

The goal at Australia Post is sustainable, lasting change that fundamentally shifts how the organization approaches and delivers against its strategies. To do so, Australia Post must equip its people with knowledge and the ability to advocate for and be a part of this new way of working.

A broad and comprehensive training and enablement strategy was rolled out across the organization to build experience and maturity. With help from Mark Richards of CoActivation, a Scaled Agile partner, Australia Post trained more than 900 people in Leading SAFe® and SAFe for Teams® courses. This included key roles across executive leadership, within business functions such as finance, risk, architecture, security, marketing and sales, and of course technology leadership and teams.

Australia Post - Implementing SAFe in Delivery Services

From the beginning, Australia Post applied a persistent focus on cadence and synchronization – keys to building alignment and embedding disciplined delivery practices across diverse teams. With all of Australia Post on the same sprint (and then Program Increment) cadence, scaling teams and ultimately forming these into Agile Release Trains (ARTs) became a natural evolution.

Achieving sustainable change focused on four key interrelated areas of emphasis across the organization:

  • Cross-functional, long-running teams – Moving from transient project teams to cross-functional, long-running teams aligned to customer experiences was a foundational, critical change to the way people work.
  • Culture – Australia Post invested significantly in evolving the culture of the organization to one where curiosity, innovation, and a learning mindset predominate.
  • Technology enablement – Beyond cultural and process changes, improving delivery flow and time-to-value requires an effective build pipeline and deployment infrastructure aligned to DevOps principles.
  • System of work – Implementing a new way of working spans well beyond delivery teams to every part of the organization that supports the delivery of business initiatives. The change team worked closely with shared services groups to tailor approaches to enable and meet their needs under the Framework, including new innovative funding and governance models.

This multi-pronged approach formed sustainable building blocks for change and enablement. With the goal of implementing Agile Release Trains (ARTs), the early focus was on long-running teams and culture to allow maturity to build and grow. The greatest traction came with the advocacy and leadership of business sponsors and leads, who understood the increased business opportunity and had confidence in the delivery model.

MyPost Consumer – Creating a Platform for Personalized Services

Australia Post - Implementing SAFe in Delivery Services

Today, five ARTs now support Australia Post’s value streams and associated enterprise strategies. One of those trains, the MyPost Consumer ART, sits within Australia Post’s Consumer market segment value stream. Established in 2015 to play a significant role in the shift toward customer centricity, MyPost Consumer is creating an omni-channel platform to offer personalized services to customers. The train’s primary focus: the parcel delivery experience, which sits at the heart of Australia Post’s business.

The train is made up of 110 cross-functional roles, with each team responsible for specific components of the parcel delivery experience. As a multi-channel, multi-technology program, only 30% of features are purely digital. The most impactful features require changes to multiple channels and enterprise technology systems.

“Getting the job done right is about focusing as much on how we work together, as what we are working on,” says Natalie Field, Head of MyPost Consumer. “We know there are many unknowns in achieving our program strategy and we don’t, and won’t, always get it right. However we also know that by respecting each other, and staying committed to rapid learning cycles, we will always come up with great solutions. “

The train has achieved strong outcomes over the past couple of years. Australia Post attributes the success of the train to several pillars:

Create a customer-centric culture
Building a customer-centric culture meant creating an environment that empowers the entire team to make fact-based, data-driven decisions and equipping everyone to be advocates for the customer experience.

Focus on metrics to drive business outcomes
A strong focus on measurement has resulted in significant positive impact across the organization’s primary success measures. To help achieve this outcome, teams are equipped with technology tools and the ability to collect and report on data. This empowers teams to learn fast about in-market feature performance and make changes when necessary. The result is a data-driven approach to how the train identifies, prioritises, implements, and learns from each Program Increment.

Improve continuously for greater predictability and performance
Success of the train hinges on an ability to improve continuously and focus relentlessly on evolving the experience to meet customer needs. The train adapts and responds to market demands, continually improving technology capabilities to advance the business across its digital channel, retail stores, delivery network, and call centre.

Raising Satisfaction and Throughput, with Lower Cost

A strong focus on measurement and learning to maximize business outcomes resulted in significant positive impact:

  • Improved first-time delivery – The First-Time Delivery rate jumped by 7 percentage points over 12 months.
  • Reduced cost – Australia Post reduced its infrastructure costs by 98%.
  • Predictability – The train consistently delivered on 80% or more of its objectives.
  • Customer satisfaction – The Net Promoter Score rose by 8 points over the course of one year.
  • Employee engagement – Employee satisfaction and engagement increased.
  • Industry accolades – The train was voted the Best Customer Centric Project in Australia / New Zealand by the CX Management Conference.
Australia Post - Implementing SAFe in Delivery Services

Australia Post continues to evolve and grow to meet the needs of its business. Its focus on continuous improvement means the organization ever challenges itself to create the next wave of trusted services for its customers.

“SAFe has really helped bring the organization along its transformation journey,” Field says. “Its real value has been in the way it links strategy with decentralized execution, using metrics to enable a high level of transparency and fact-based decision making to focus on achieving business outcomes.”

Share:

Back to: All Case Studies

Explore more Case Studies

Suggested Case Study:

Dutch Tax and Customs Administration

Read the Case Study

Standard Bank – Successful SAFe Journey to Agile at Scale

Presented at 2017 SAFe Summit by Alex Keyter, Lean-Agile Coach at Standard Bank

Share:

Standard Bank embarked on a SAFe transformation journey in 2014 with IT initiating approximately 600 projects annually to help keep the bank at the leading edge. Historically, teams completed only a small percentage of projects within the defined timeframe, budget, and scope.

A visit to Silicon Valley’s top technology companies by our IT executives triggered the start of a number of Lean-Agile proofs-of-concept, showcasing the potential of Agility in the enterprise. However, their efforts stalled when they attempted to expand beyond a few development teams working in isolation.

With a clear IT strategy in place, the Standard Bank turned to the Scaled Agile Framework® (SAFe®) and gained support from its executives to forge ahead with deploying the Scaled Agile Framework across the organization. Prior to launching the first Agile Release Train, significant time was spent on designing Portfolios, Programs and SAFe Teams. Standard Bank also initiated programs that focused on transforming management and leadership; developing a culture that fosters autonomy mastery and purpose; and re-skilling individuals to return to the heart of IT as software engineers, quality engineers, and user experience analysts.

With a large number of ARTs already in their third and fourth Program Increment, the value of the SAFe transformation is tangible with the motivated staff producing quality, more frequent, predictable delivery. Coupled with the successes, Standard Bank drives continuous improvement through role maturity, enhanced engineering capability and ART optimization.

Read the full case study.

Back to: Customer Stories

Explore more Customer Stories

Next: FedEx Customer Story

Learn more

Capital One – Benefits of SAFe for Financial Services

Capital One - Benefits of SAFe for Financial Services

“The products we’re developing are bigger than one Agile team. For the teams to interact and plan together, we really needed SAFe as the foundation. It brings the practices and methodologies to coordinate multiple teams working on the same product at the same time.”

—Mike Eason, CIO, Commercial Banking

Challenge:

Capital One sought to be more responsive to the market, to transform software delivery to an agile framework, and to do it at scale.

Industry:

Financial Services

Results:

  • Raised employee engagement by 15-20%
  • Employed Agile and scaled agile across the enterprise; business and tech.
  • Re-thinking the strategy on outsourced applications led to a drastic shift towards building internally

Best Practices:

  • Establish communities of practice—Peer groups for Scrum Masters, RTEs, and System Teams enable these individuals to learn from each other.
  • Support innovation—Commercial Banking leads Innovation Renovations similar to the Shark Tank TV show, where individuals present ideas for improvement.
  • Recognize accomplishments—Commercial Banking calls out specific individuals for their efforts at PI events, and enhances morale and a sense of fun by requesting that people write what they appreciate about others on “walking billboards” on each other’s’ backs.

Introduction

One of the most widely recognized brands in America, Capital One is a diversified bank that offers a broad array of financial products and services to consumers, small businesses, and commercial clients. The company employs more than 47,000 people, and in 2016, reported revenue of $25 billion.

Benefits of SAFe for Financial Services

Since launching in the mid ‘90s, Capital One has been a disrupter. Smaller and nimbler than its competitors, it could react to market demands quickly. But as it grew, it lost some of that agility.

2010 began a transformation starting with the renaming of the Capital One’s IT groups to Capital One Technology. “This was more than a name change,” Capital One CIO Rob Alexander said.  “It was a declaration that we would no longer be a traditional bank IT shop.  From now that day on, we would be an organization working to transform Capital One into a technology company.”

In 2012, Capital One’s Commercial Banking group set out to be more responsive to customer and market needs.  Knowing the organization relied on a lot of outsourced functions, the team set out on a transformational journey to bring IT development back in-house.

As the transformation picked up steam; it was clear, talent would be the lynchpin to execute against their development goals.  To maximize the transformation, the following was always the question:

“How do we work in a way that allows great talent to do great work?” (Rob Alexander, CIO, Capital One)

The CIO of the company’s Commercial Banking Technology team, Mike Eason, explains the motivation for change.  “Like many companies with outsourced technology, we knew we needed to gain control over our customer experience and become more nimble,” Eason says. “We took a step back and said, ‘we need to build our own technology to respond more rapidly to the market.’”

In 2013, the group began taking steps toward building an Agile workforce, however, Eason describes it as going through the motions. Development was largely still a waterfall approach. And while technology leaders were fully on board, opportunities remained to gain the full support of upper management.

SAFe: ‘A Well-Supported Framework with Clear Guidelines’

For the guidance it needed, Commercial Banking turned to the Scaled Agile Framework® (SAFe®).

“We looked at other frameworks for Agile, but SAFe offered a well-supported framework with clear guidelines, training, and experts to support us throughout the journey,” says Anand Francis, Director of Agile Coaching Services, Capital One Commercial Banking.

“The products we’re developing are bigger than one Agile team,” Eason adds. “For the teams to interact and plan together, we really needed SAFe as the foundation. It brings the practices and methodologies to coordinate multiple teams working on the same product at the same time.”

With the decision to go SAFe, support from the Capital One Commercial Operations Leader was a key factor, helping to influence large scale buy-in from other executives. Moving beyond rhetoric of “business and IT” alignment, Capital One business executives have agile teams dedicated to their products, services, and broader business strategies.

Goal: 100% Training

Prior to the first Program Increment (PI), all team members went through Agile 101 training. Today, half of the Release Train Engineers (RTEs) are SAFe Program Consultants (SPCs). Out of 50 Scrum Master roles, one quarter have achieved SAFe® Scrum Master (SSM) Certification while 10 percent are SPCs.

“Our goal is to have 50 percent of our Scrum Master population SAFe Scrum Master certified and 100% of our RTE population SAFe RTE certified by the end of the year,” Francis says.

Capital One now includes Agile, Design Thinking, and SAFe training courses in its Capital One University. Employees can choose from a number of SAFe courses, including Leading SAFe, SAFe Product Owner/Product Manager, and SAFe Release Train Engineer.

Empowering Teams

SAFe for Financial Services

Capital One held its first Program Increment (PI) Planning meeting in 2013. In-house Agile coaches provided continuous guidance to Scrum Masters, RTEs, and Product Owners.

As Commercial Banking kicked off its first PI, a mindset shift was necessary for associates and to continue to move forward on two big themes: one, we as an organization needed to be great at delivering software; and two, we needed to be great at delivering data solutions that support how we make decisions for customers, how we interact with them, and how we make decisions internally. Christy Gurkin, the RTE on the first Agile Release Train (ART), found that while teams were initially resistant to the change, they soon began embracing the new approach.

“I noticed that people who normally would not have talked together were initiating conversations on their own, without me having to push it,” she says.

Eason also notes that, early on, teams lacked the autonomy to deliver independently because too many outside dependencies slowed down the process. Capital One addressed this by changing team structure. Instead of teams that focused on a single aspect, such as building an API, they transitioned to full-feature teams—equipping an entire team to deliver working software independently in a two-week sprint.

With this shift in team composition, and a greater focus on DevOps and continuous integration/continuous development, the company gained momentum.

Capital One additionally reduced team sizes down to seven or eight people. “By reducing team sizes, we improved team chemistry, which left them feeling like they had the autonomy to solve issues themselves,” Eason says.

Commercial Banking also took a major step in moving from project-centric budgeting to team-centric budgeting. “Before, no one wanted the project to end because then the resources would be distributed somewhere else,” Eason says. “Leadership and teams are now aligned to products, and make decisions on how much to invest in the products themselves instead of justifying every single project.”

As a result, teams are more nimble to ‘turn on a dime’ as needed, without the pressure of having to see a specific project to the end.

“Teams feel more beholden to the product they’re working on versus moving from project to project,” Francis adds.

A Transformation Guided by Teams

In addition to performing Inspect and Adapt after every PI, Commercial Banking designed and developed an Agile maturity assessment to help trains and teams understand where they are on their transformation journey. Once a quarter, they ask individuals to react anonymously to neutral statements across five areas: sustainability, value delivery, scaled agile, culture, and technical health.

“A lot of companies think they’re in one place, but they’re really in another,” says Greg Jaeger, Agile Coach. “Our goal was honest opinions and honest assessment because that’s the only way to help each member of the team, each team, each train, and each program get better—not only in being Agile or SAFe but in actual product delivery.”

Areas with low scores indicate the need for a discussion. In response, individuals at the Team and Program levels identify areas to improve for the next six sprints. Based on items chosen at those levels, Agile coaches formulate an Agile transformation path for every value stream.

Faster Delivery, Happier People

Benefits of SAFe for Financial Services

Today, Commercial Banking has 13 ARTs and seven Value Streams. Since deploying SAFe, the group has seen gains that benefit employees, partners, customers, and the organization as a whole:

Time-to-market— As we build out our physical campus, we have tried to create work spaces that enable that collaboration at the agile scrum team level, but also, we operate what is called the scaled agile framework.  That implies that we need to be able to be effective in collaborating at both the individual team level, but also across multiple teams.

Taking an iterative approach to frequently deliver to production brought about efficiency and speed not previously seen.  “We’re truly able to deliver working software into production at the end of every sprint,” Eason says. “What took us six months to complete before, now we might complete in a couple of months. And by bringing development in-house, we have working solutions much faster than any vendor partnership could deliver.”

Commercial Banking turned the ratio of vendor-created applications to those built in-house upside down.

Engagement—With employee engagement up 15-20 percent overall, morale and retention have improved.

Predictability—With each PI, Commercial Banking sees greater predictability in what it can deliver. PI planning plays a major role in setting expectations and encouraging follow-through.

Customer satisfaction—Eason says business partners prefer the new approach and would not want to go back to the old way of working. Likewise, the businesses that Commercial Banking serve have responded positively to the opportunity to see demos and progress along the way, rather than only having insight into fully completed projects.

“It’s been great to have clients with us on the design and test aspects of development,” Eason says.

The journey continues at Capital One, with Commercial Banking continuously refining after every PI. Success so far, aided by SAFe, greatly fuels that momentum.

“SAFe has enabled us to go to production in a safer and more scalable way more often than we would have normally,” Anand says.

“We are in that journey, and it is important that as the leadership team in technology,” says Capital One CIO Rob Alexander, “we are communicating to our whole organization that this is what excellence in software delivery looks like.”

Share:

Back to: All Case Studies

Explore more Case Studies

Suggested Case Study: Standard Bank

Read the Case Study