Designing Accountability into Public-Sector AI: Australia’s New Reference Architecture

Australia's Digital Transformation Agency has presented a shared blueprint for government AI systems. Its central proposition is that accountability should be built into the connections between data, software, suppliers and people, rather than added after a service has already become dependent on them

An AI project can appear to begin with a model, yet some of its most consequential decisions concern everything around it. Which records can it access? Where does its output enter a public-service workflow? Who can interrupt an action, and what evidence remains afterwards? Those questions are partly technical, but their answers shape the exercise of public authority.

On 30 October 2026, Australia’s Digital Transformation Agency announced its AI Reference Architecture, or AIRA. It offers reusable structures agencies can adapt to their circumstances and risks. Use is voluntary: the architecture supports applicable requirements rather than replacing them.

This is guidance for designing systems, not an announcement of demonstrated service improvements. Its significance lies in making choices visible before commitments become difficult to reverse. The analysis below explores that proposition through illustrative examples, rather than claiming outcomes from agencies using the new resource.

A common language for different parts of government

The DTA describes a functional stack covering interaction, workflow coordination, intelligence and analytics, data, and infrastructure. It connects those building blocks with communication, assurance and human control. This makes the system around AI an explicit subject of design, alongside the capabilities of the model.

A common architectural vocabulary can help people ask questions across professional boundaries. A service manager may be concerned about an unresolved case, a security team about access and a procurement specialist about supplier obligations. A shared description makes it easier to establish whether they are discussing different aspects of the same dependency.

That is an opportunity rather than an automatic benefit. A diagram that nobody uses in operational decisions provides little assurance. The practical value would come from connecting each part of the design to someone who understands its purpose, knows its constraints and can act when it creates a problem.

Locate the point where information becomes action

Consider a hypothetical assistant that prepares material for a caseworker. Retrieving documents, drafting a summary and updating a case record are separate activities. If the system can perform all three, an error can move from a proposed interpretation into an authoritative record unless the workflow contains an effective review point.

An architectural discussion should therefore ask where the transition occurs. Does a person approve a draft before it is saved? Can a subsequent step use an unverified summary? Which permissions prevent a tool intended for preparation from changing the underlying case?

These are proposed design questions, not a description of a particular AIRA implementation. Their purpose is to connect human responsibility with the actual sequence of operations. Saying that a person remains accountable is more meaningful when the system makes clear which action that person is approving and what happens without their approval.

Different adoption routes provide different forms of control

The companion guide explores four situations: enabling AI inside an existing vendor platform, building a service in-house, procuring an agentic call-centre solution and adding machine learning to case management. It distinguishes governing a system from configuring it or directly designing its components.

This is a useful corrective to treating all AI procurement as the same decision. An agency enabling an existing feature may have little influence over the underlying model, while an in-house project may permit more design choices. Greater technical choice also brings greater responsibility for integration and maintenance.

The guide presents scenarios as starting points, not comprehensive assessments or a single correct architecture. That limitation matters. An illustrative product or workflow can help an agency formulate questions, but it cannot establish whether a current offering satisfies the needs of a real service.

Build an evidence trail that survives change

A public body needs to understand more than whether a system produced a plausible answer today. If a resident questions an outcome later, the organisation may need to identify the information used, the version of the relevant component and the role of the official who reviewed it.

A practical design could preserve that context alongside the result. It could distinguish retrieved material from generated interpretation and make significant changes traceable. These are editorial recommendations; they do not imply that every item should be retained indefinitely or that more logging is always better.

The aim is proportionate evidence. Records should help explain important actions without accumulating unnecessary personal information or becoming impossible to examine. Decisions about retention, access and review therefore belong in the design discussion, rather than being left for an incident to expose.

Stopping a system is an organisational capability

The DTA announcement emphasises that people should be able to monitor, pause, change or stop systems within suitable timeframes. A control on a screen is only one part of that capability. Someone must recognise the need to use it and have the authority and practical means to do so.

Imagine a hypothetical service where an assistant repeatedly routes enquiries incorrectly. Pausing the component would not be enough if the organisation had no alternative way to handle incoming work. The design should consider how service continues, who communicates the change and how affected records are reviewed.

Testing such arrangements before deployment would make them more credible. Staff could rehearse escalation and recovery using a limited scenario, discover unclear responsibilities and adjust the process. A safety mechanism is most useful when the surrounding institution can operate it under pressure.

Use architecture to preserve future choices

Early integration decisions can influence what an agency is able to change later. If records, business rules and model interactions are tightly bound to one arrangement, replacing a component may require much more work than anticipated. A successful demonstration may conceal that longer-term dependency.

An agency could examine whether its own information can be exported in a useful form, whether interfaces are documented and which changes require supplier involvement. These are suggested assessment questions, not claims that the architecture eliminates dependence on external providers.

The relevant goal is an informed choice about dependence. Some specialised services may justify accepting constraints, but the organisation should understand their consequences. Architecture can make those trade-offs discussable while options are still available, instead of turning them into surprises after adoption.

Judge the blueprint by the decisions it improves

The published resource connects AIRA with Australia’s existing public-service AI plan and responsible-use policy. That relationship places the architecture between broad expectations and the design of a particular service: it can help translate intentions into operational questions.

Its value will depend on whether agencies use those questions to make better decisions. Useful evidence would include clearer responsibility, more realistic procurement expectations and controls that work during testing and normal operations. Publication of guidance alone does not establish those outcomes.

For other administrations, the wider lesson is that AI governance is partly a matter of system design. Accountability becomes tangible where permissions, information flows, evidence and human judgement meet. Making those connections visible early gives a public body a stronger basis for deciding what it can safely operate, what it must change and what it should decline to deploy.

Illustrative photograph: Parliament House and the parliamentary precinct, Canberra. Photo: Nick Pitsas / CSIRO, via Wikimedia Commons, CC BY 3.0.