The Operational Resilience Evidence Gap: Can You Prove Your Teams Are Ready?
Organizations invest significant time and resources in risk assessments, business continuity plans, and resilience exercises. Yet when disruption strikes, how confident can they be that their people will make effective decisions, coordinate across functions, and keep critical operations running?
Having documented plans and meeting regulatory requirements provides an important foundation for operational resilience. However, the ability to respond when circumstances change requires something more: evidence of what people can do under pressure.
In iluminr's recent webinar, So You Think You're Resilient? Prove It, Michael Rasmussen, CEO of GRC 20/20 Research, joined quantitative risk expert Graeme Keith and former business continuity executive Mark Heywood to explore what it takes to demonstrate operational resilience.
Their discussion raised an important question for risk and resilience leaders: How do you move from documenting preparedness to demonstrating your organization's ability to respond?
The difference between looking resilient and being resilient
Many organizations can demonstrate that they've identified their risks, documented their response plans, and completed their scheduled exercises.
But how much does that evidence reveal about their ability to manage an actual disruption?
Mark Heywood challenged organizations to consider whether their risk management activities demonstrate meaningful response capabilities or simply provide assurance that established processes have been followed.
"I think that it's considerably easier to look resilient than it is to be resilient." ~ Mark Heywood
He illustrated the point through the sinking of the Titanic in 1912.
Despite meeting the maritime safety regulations of its time, the Titanic carried insufficient lifeboat capacity for everyone on board. The regulations had been developed when ships were significantly smaller and had not kept pace with changing circumstances.
Heywood described this as an "imagination gap": the limitations that arise when organizations rely on established assumptions without considering how risks, systems, and circumstances have evolved.
The lesson extends to modern operational resilience. Regulations establish important expectations, but organizations also need to explore what could happen beyond the scenarios those requirements explicitly address.
A successful audit, a completed risk assessment, or a well-rehearsed tabletop exercise can offer valuable assurance. The question is whether that assurance reflects what people can do when faced with unfamiliar challenges.
Why traditional operational resilience exercises are no longer enough
Traditional tabletop exercises play an important role in helping organizations understand their response arrangements. However, the time and resources required to develop and deliver them often limit how frequently teams can practice.
Heywood described the familiar process of spending months preparing an executive exercise, running a single scenario, producing a report, and repeating the process the following year.
That approach creates opportunities to test particular plans and assumptions, but it leaves limited room to explore the many ways disruption might unfold.
Consider how people develop any complex skill. Practicing once a year offers little opportunity to reinforce learning, identify weaknesses, and improve performance.
Operational resilience presents a similar challenge.
Teams need regular opportunities to make decisions under pressure, work through uncertainty, and learn how their actions influence outcomes.
As Heywood pointed out during the discussion, organizations may devote considerable resources to a single annual exercise, yet gain limited insight into how they would respond to a broader range of disruptions.
This is particularly important because real incidents rarely follow a predetermined script.
Continuous resilience testing allows organizations to explore a wider range of disruptions, identify recurring capability gaps, and strengthen their ability to respond to unfamiliar situations.
With shorter, repeatable exercises, organizations can make better use of limited training time and extend participation across more teams and functions.
Understanding how interconnected risks can escalate
One of the strongest themes from the discussion was the importance of understanding how risks interact.
Graeme Keith explained that significant failures often emerge through the relationships between systems, processes, and business functions.
Individual teams may be managing their responsibilities effectively, yet an unexpected interaction between dependencies can still cause widespread disruption.
A supplier interruption, technology failure, or operational bottleneck might appear manageable in isolation. When combined with other vulnerabilities, the consequences can become much more serious.
For resilience leaders, this creates a challenge.
Identifying individual risks is important, but organizations also need to understand the relationships between them, how failures might cascade, and where intervention could change the outcome.
Keith encouraged organizations to consider the decisions available to them, the objectives they need to protect, and the causal relationships connecting the two.
He also emphasized the role of storytelling in understanding risk. Exploring how different disruptions might unfold helps organizations recognize relationships and potential consequences that may be overlooked when risks are considered individually.
"The whole essence of uncertainty modeling is understanding the plurality of the future." ~ Graeme Keith
This is where scenario testing becomes particularly valuable.
By placing teams in realistic situations involving interconnected risks, organizations can explore how decisions are made when information is incomplete and circumstances change.
The resulting insights can expose assumptions that may not be apparent through traditional risk assessments alone.
Building cognitive flexibility through continuous practice
One of the most valuable capabilities discussed during the webinar was cognitive flexibility: the ability to adapt decisions and responses as circumstances evolve.
Heywood argued that resilient organizations develop this capability through repeated planning and exposure to different situations.
"Truly resilient organisations display high levels of cognitive flexibility." ~ Mark Heywood
He used an example shared by Keith to illustrate the point.
Keith described experiencing a severe allergic reaction to a wasp sting, despite having previously prepared for a different emergency involving venomous snakes.
Although the original threat was unexpected, the preparedness measures already in place helped support an effective response.
The organization-level lesson is important.
Resilience doesn't require a plan for every possible disruption. It requires people who can recognize what's happening, draw on existing knowledge, and adapt their response when the situation changes.
As Heywood later emphasized:
"Resilience for me is about getting comfortable with the fact that there are gaps, getting comfortable with the fact that you cannot plan for everything."
Keith expanded on this by explaining that remaining in "control doesn't always mean staying on the original course."
Sometimes, organizations need to adjust their approach or reconsider immediate objectives to protect what matters most.
Developing that flexibility takes practice across multiple scenarios.
A team that has only rehearsed one type of incident may become familiar with a particular response sequence. A team exposed to varied disruptions has more opportunities to understand underlying dependencies, explore alternative decisions, and recognize when its original assumptions no longer apply.
How can organizations measure operational resilience?
Measuring operational resilience requires evidence of what an organization can do when its people, processes, and systems are tested under realistic conditions.
Michael Rasmussen highlighted three complementary forms of evidence:
- Assessed risk: What the organization understands about potential disruptions and their consequences.
- Documented readiness: The plans, responsibilities, and arrangements established to manage those disruptions.
- Demonstrated capability: What people can do when those arrangements are tested under pressure.
Each provides a different view of resilience.
A risk model might assume that a critical service can switch to an alternative provider within a defined period. A continuity plan might document the steps involved.
An exercise can reveal whether the relevant people recognize the need to act, have the necessary information and authority, and can execute the response.
Importantly, Rasmussen acknowledged that an exercise provides evidence of performance under the specific conditions tested. It cannot guarantee how an organization will respond to every future incident.
This makes continuous testing particularly valuable.
By testing different scenarios over time, organizations can develop a broader picture of their response capabilities and identify areas that require further improvement.
Useful evidence may include how teams recognize emerging problems, make decisions, coordinate across functions, escalate issues, and adapt when circumstances change.
Rasmussen also encouraged organizations to consider the purpose of the information they collect.
"What decision should this help us make?"
It's an important question for resilience leaders who are increasingly expected to demonstrate the value of their testing programs.
Data gathered through exercises should help organizations understand their capabilities, identify improvement priorities, and make more informed decisions about where to invest resources.
From annual exercises to continuous resilience assurance
For many resilience teams, the challenge is finding the capacity to conduct more exercises while managing growing operational complexity and regulatory expectations.
Organizations need to test more scenarios, engage more people, and produce meaningful evidence, often without additional resources.
This requires a practical approach to scaling resilience exercises.
Short, frequent scenario-based exercises can complement traditional tabletop testing by creating more opportunities for teams to practice between major exercises.
They can also help organizations move beyond relying on a small group of experienced crisis and resilience professionals.
When disruption occurs, operational teams, business leaders, technology specialists, and other employees may all be required to make decisions or take action.
Building response capability across these functions is essential to organizational resilience.
iluminr's Microsimulations support this approach by enabling organizations to run short, repeatable exercises across different teams and risk scenarios.
They also help capture evidence of how people respond, providing insights that can inform capability development and future resilience testing.
For organizations working to demonstrate resilience, this creates an opportunity to connect planning, testing, and improvement through ongoing evidence of response capability.
Resilience is the ability to adapt when things don't go to plan
A central message from the webinar was that organizations cannot anticipate every disruption.
Even sophisticated risk models and carefully prepared response plans have limitations.
What matters is whether people understand the systems they operate within, recognize when circumstances are changing, and have the capability to respond effectively.
As Keith explained, maintaining control may involve adjusting course when the original objectives or assumptions are no longer achievable.
That capability develops through a combination of risk understanding, planning, scenario testing, and repeated practice.
For resilience leaders, the question extends beyond whether an exercise has been completed or a plan has been reviewed.
It's whether the organization is learning from those activities and developing the capabilities needed to respond to whatever comes next.
Watch the on-demand webinar: So You Think You're Resilient? Prove It
Hear the full discussion with Michael Rasmussen, Graeme Keith, and Mark Heywood as they explore the intersection of risk modeling, storytelling, scenario testing, and organizational adaptability.
See how iluminr can help you scale resilience testing
Discover how iluminr's Microsimulations enable organizations to exercise more frequently, engage teams across the business, and build measurable evidence of response capability.




