A Big Reform Can Contain Very Little Learning

Institutional reform is often judged by its visible scale. Large restructurings, major legislative packages, new digital platforms, extensive procedural redesigns and sweeping changes in authority are naturally interpreted as signs of deep transformation because, when an institution changes dramatically on the surface, it seems reasonable to assume that something equally significant must have happened underneath. Yet the size of organisational change and the depth of institutional learning are not the same thing. An institution can modify structures, workflows and technologies extensively while leaving many of its underlying assumptions, interpretive categories and judgement patterns substantially intact, which means that REFORM SCALE ≠ LEARNING DEPTH. The organisation may look different, operate through new channels and allocate responsibility differently while still perceiving the world through much the same cognitive architecture as before.

A government, for example, can merge departments, create new agencies, replace information systems and redesign reporting lines without fundamentally changing how it frames the problems those arrangements are intended to address. It can decentralise implementation while preserving the same central assumptions, introduce sophisticated analytics while continuing to ask essentially the same questions, or automate decisions without reconsidering the criteria those decisions encode. In each case the reform may be substantial and consequential, yet its visible magnitude can conceal considerable cognitive continuity. This distinction matters because institutional change is much easier to observe than institutional learning: reform leaves tangible artefacts in the form of new organisational charts, rules, teams, systems, programmes and job descriptions, whereas cognitive modification concerns less visible changes in what the institution notices, how it interprets evidence, which distinctions it considers important, which assumptions it treats as plausible and how it judges uncertainty. The larger the visible reform becomes, therefore, the stronger the temptation is to use organisational scale as a proxy for cognitive depth, even though the relationship between the two may be surprisingly weak.

Imagine a ministry that experiences repeated implementation failures across several programmes and responds with an ambitious reform in which two directorates are merged, regional offices are reorganised, new reporting requirements are introduced and a large digital platform is deployed to improve oversight. The institution has undeniably changed, and the new arrangements may even improve coordination and performance. Yet suppose that its core interpretation of implementation failure remains untouched: problems continue to be understood primarily as failures of local compliance rather than as possible signals about policy design, incentives, information flows or variation in local conditions. The reform has then altered the structure through which monitoring occurs while preserving the diagnosis that determines what monitoring is expected to reveal. In such a case, the organisation may have changed extensively while its learning remained comparatively shallow, demonstrating why VISIBLE TRANSFORMATION ≠ DEEP COGNITIVE MODIFICATION.

The reverse is equally important. A relatively small institutional change can represent significant learning if it modifies something cognitively fundamental. An organisation that adds a single question to a decision process may alter how future cases are interpreted; a new requirement to document uncertainty may change how evidence is weighed; a revised indicator may redirect attention towards a population that was previously invisible; and a seemingly minor change in who participates in a review process may expose assumptions that had never previously been challenged. None of these modifications necessarily requires a major restructuring, yet each can alter the machinery from which future judgement is generated. A procedural change may therefore be shallow when it merely standardises behaviour, while a small representational change may be deep if it changes what the institution is capable of seeing.

This distinction becomes especially important in reform programmes driven by urgency. When political or public pressure demands visible action, large interventions can be easier to justify than subtle cognitive changes because a new agency, platform or regulatory framework communicates seriousness in ways that a revised interpretation of evidence or a change in diagnostic categories rarely can. The visibility of reform can consequently become entangled with perceptions of its significance, while the amount of organisational effort invested can reinforce the assumption that substantial learning must have occurred. Large programmes consume funding, political capital, management attention and staff time, and because so much energy has been invested in transformation, the institution can gradually treat the cost and disruption of reform as indirect evidence of cognitive depth. Yet an organisation can spend years redesigning structures and still preserve the same basic model of the problem it is trying to solve.

Technology provides a particularly clear illustration. A public organisation may undertake an ambitious digital transformation that replaces legacy systems, centralises data, automates workflows and introduces artificial intelligence into administrative processes. Operationally, the change can be enormous, affecting thousands of staff and millions of transactions, but if the institution continues to define success through the same narrow metrics, categorise citizens through the same assumptions and treat uncertainty through the same decision rules, the underlying cognitive transformation may remain limited. The institution has modernised its instruments without necessarily revising its interpretation. Conversely, a much smaller change in how uncertainty is represented could have deeper consequences: if staff begin to distinguish systematically between absence of evidence and evidence of absence, that conceptual modification can alter how risk, exceptions and incomplete information are handled across a wide range of future decisions. The visible intervention is modest, but the cognitive consequence can propagate through the institution.

For this reason, the depth of institutional learning should be assessed through what has changed in future-generating capability rather than through the physical or organisational scale of reform. The relevant question is not simply how much of the institution was rearranged, but which parts of its cognitive architecture were modified and how consequential those modifications are for future perception and judgement. Deep learning might change what the institution pays attention to, revise a causal assumption, alter how evidence is interpreted, introduce a distinction that makes a previously invisible problem recognisable, change who is considered a legitimate source of knowledge or modify the way uncertainty affects action. None of these developments necessarily requires dramatic reorganisation, and some may initially be embodied in a single procedure, category or decision rule whose organisational footprint is small but whose downstream cognitive consequences are substantial.

This creates a particular challenge for evaluation because conventional reform metrics naturally favour what can be counted. Evaluators can record programmes redesigned, units merged, systems replaced, budgets allocated or staff retrained, and these measures provide useful information about implementation effort. They reveal much less, however, about the depth of learning embedded in those activities. Assessing learning requires a different set of questions: whether the institution revised assumptions that previously generated error, whether it changed how important and unimportant information are distinguished, whether experience modified how future problems will be framed, whether new categories became available, or whether the relationship between knowledge and authority changed. These questions shift attention from the quantity of reform activity towards the quality of cognitive modification.

The distinction also helps explain why institutions can experience repeated waves of large-scale reform without resolving persistent problems. A major restructuring fails to produce the expected results, so another restructuring follows, perhaps with an even more ambitious scope. Yet if both interventions operate from essentially the same diagnosis, the institution can generate increasing amounts of organisational change without achieving corresponding depth of learning. Such an organisation may appear highly adaptive because it changes frequently, while remaining cognitively conservative because its assumptions, categories and causal models survive each transformation. Institutional dynamism and institutional learning can therefore diverge: an organisation can alter its forms repeatedly while preserving much of the cognition that made reform necessary in the first place.

Deep learning can look much less dramatic precisely because it often occurs at the level of distinctions, models and judgement rules. When an institution stops treating complaints as isolated incidents and begins interpreting them as possible signals of systemic friction, very little may change immediately in the organisational chart. Over time, however, that reinterpretation can alter measurement, escalation, policy design and accountability because a category that once meant “individual dissatisfaction” has acquired a different institutional meaning. The initial cognitive change is small in visible scale but potentially large in future consequences. In this sense, SMALL REFORM ≠ SHALLOW LEARNING, just as BIG REFORM ≠ DEEP LEARNING; the relationship between organisational magnitude and cognitive depth is not linear.

None of this means that major reform cannot embody deep learning. Sometimes an institution revises its understanding of a problem so fundamentally that existing structures no longer fit what it has learned, making extensive organisational transformation both necessary and appropriate. In those circumstances, reform scale and learning depth may align closely. The mistake lies not in associating reform with learning, but in inferring the depth of one from the visible magnitude of the other. The appropriate test is causal: what changed because the institution learned something? If a reform is large because experience produced a fundamentally different interpretation of the problem, its scale may indeed reflect deep learning. If it is large because leadership demanded visible action, new technology became available or organisational pressure required restructuring, magnitude alone tells us much less.

The same reasoning applies to small reforms, whose apparent modesty can conceal very different cognitive significance. A minor procedural adjustment may be genuinely trivial, or it may encode a profound revision in how the institution understands evidence, responsibility or uncertainty. What matters is not the organisational footprint of the change but what that change modifies in the architecture of future judgement. Institutional maturity therefore requires the ability to separate the spectacle of reform from the substance of learning, particularly when organisations assess their own capacity to adapt. An institution that equates large change with deep learning may systematically overestimate itself, believing that repeated restructuring, digitisation or redesign demonstrates growing intelligence when the more demanding question is whether those interventions have actually changed how the institution thinks.

A big reform can therefore contain very little learning because organisational magnitude and cognitive depth are different variables. Institutions can transform structures, technologies and formal processes while preserving many of the assumptions and judgement patterns that generated previous behaviour, just as a comparatively small change in what an institution notices, measures, represents or treats as relevant evidence can constitute much deeper learning by altering the machinery from which future decisions will be generated. The depth of institutional learning is ultimately revealed not by how much visible architecture has changed, but by how deeply experience has modified the cognitive architecture through which the institution will encounter the future.