AI Architecture Decision Record Template

This template is used to document architecture decisions for AI use cases, AI control designs, AI patterns, AI integrations, AI vendors, AI agents, and AI-enabled workflows.

An Architecture Decision Record captures the decision, context, options considered, rationale, consequences, controls required, evidence required, and review conditions.

The purpose is to make AI architecture decisions traceable, reviewable, and reusable.


1. Decision Information

Decision Title

[Enter short decision title]

Decision ID

[Enter decision ID]

Date

[Enter date]

Status

Select one:

[ ] Proposed
[ ] Under review
[ ] Approved
[ ] Approved with conditions
[ ] Rejected
[ ] Superseded
[ ] Deprecated
[ ] Deferred

Decision Owner

Name:
Function:
Email:

2. Decision Context

Background

[Describe the context that led to this architecture decision]

Business Need

[Describe the business need or problem this decision addresses]

Technical Context

[Describe the technical environment, systems, platforms, data sources, vendors, tools, workflows, or integrations involved]

AI Pattern

Select all that apply:

[ ] Copilot
[ ] Internal LLM application
[ ] RAG system
[ ] AI-enabled SaaS
[ ] Embedded vendor AI
[ ] Agent
[ ] AI-enabled workflow automation
[ ] Customer-facing AI
[ ] Employee-facing AI
[ ] Developer AI tool
[ ] Security operations AI
[ ] Decision-supporting AI
[ ] Action-capable AI
[ ] Other

Assigned Risk Tier

Select one:

[ ] Tier 1: Low-risk productivity or public-data use
[ ] Tier 2: Internal productivity with enterprise data
[ ] Tier 3: Decision-supporting AI
[ ] Tier 4: Action-capable AI
[ ] Tier 5: High-impact autonomous or regulated AI
[ ] Unknown / pending assessment

3. Decision Statement

Architecture Decision

[State the decision clearly. Example: The AI use case will use user-delegated identity for retrieval and a separate agent identity for tool execution.]

Decision Summary

[Summarize the decision in one or two paragraphs]

Decision Scope

Select all that apply:

[ ] AI pattern
[ ] Model or AI service
[ ] Vendor or platform
[ ] Identity model
[ ] Data boundary
[ ] Retrieval architecture
[ ] Prompt/input control
[ ] Output/decision control
[ ] Tool/action control
[ ] Human accountability
[ ] Monitoring/logging/evidence
[ ] Assurance/testing
[ ] Incident containment/recovery
[ ] Operating model
[ ] Other

4. Options Considered

Option 1

Option name:
Description:
Benefits:
Risks:
Control implications:
Reason accepted or rejected:

Option 2

Option name:
Description:
Benefits:
Risks:
Control implications:
Reason accepted or rejected:

Option 3

Option name:
Description:
Benefits:
Risks:
Control implications:
Reason accepted or rejected:

Additional Options

[Add additional options if required]

5. Architecture Principles Considered

Select all applicable principles:

[ ] AI must be inventoried before it is trusted.
[ ] AI must not receive authority without identity.
[ ] AI must not access data without boundaries.
[ ] AI inputs must be treated as control surfaces.
[ ] AI outputs must not become decisions without control.
[ ] AI must not execute actions without control.
[ ] Human accountability must remain assigned.
[ ] AI must be tested before and after deployment.
[ ] AI must be observable and reconstructable.
[ ] AI failure must be containable.

Principle Alignment Notes

[Describe how the decision aligns with or deviates from relevant principles]

6. Control Impact Assessment

AI Inventory and Classification

[Describe inventory, classification, lifecycle, and risk-tier implications]

AI Identity and Access Control

[Describe identity model, delegated authority, service accounts, agent identities, access review, and revocation implications]

Data Boundary Control

[Describe data sources, data classification, retrieval boundaries, retention, training/reuse, and output sensitivity implications]

Prompt and Input Control

[Describe allowed inputs, prohibited inputs, prompt injection risk, system prompt protection, context isolation, and input logging implications]

Output and Decision Control

[Describe output classification, validation, review, approval, generated records, downstream use, and correction implications]

Tool and Action Control

[Describe tools, APIs, workflows, action classification, approval gates, blast-radius limits, kill switches, and rollback implications]

Human Accountability Model

[Describe business owner, technical owner, decision owner, approver, escalation, override, and exception ownership implications]

AI Assurance and Testing

[Describe required testing, validation, prompt injection testing, data leakage testing, tool/action testing, regression testing, and assurance evidence]

Monitoring, Logging, and Evidence

[Describe required logs, evidence, monitoring, retention, reconstruction, SIEM/SOC/GRC integration, and audit needs]

Incident Containment and Recovery

[Describe containment paths, revocation, kill switches, evidence preservation, rollback, vendor escalation, and recovery implications]

7. Identity and Access Decision

Identity Model Selected

Select all that apply:

[ ] Direct user identity
[ ] Delegated user authority
[ ] Service identity
[ ] Application identity
[ ] Agent identity
[ ] Vendor-managed identity
[ ] Hybrid identity
[ ] Not applicable

Identity Decision Rationale

[Explain why this identity model was selected]

Access Boundary

[Describe systems, data, tools, APIs, workflows, and environments AI can access]

Revocation Path

[Describe how access can be revoked, suspended, disabled, or rotated]

8. Data Boundary Decision

Data Sources Approved

Data Source Classification Owner Boundary / Restriction
[Source] [Classification] [Owner] [Boundary]

Retrieval Boundary

[Describe retrieval scope, filtering, access enforcement, classification restrictions, and tenant/user/session boundaries]

Retention and Reuse Decision

[Describe whether prompts, outputs, context, logs, embeddings, or interaction history may be retained or reused]

Vendor Data Processing Decision

[Describe whether data is processed by a vendor, retained by a vendor, or used for training/product improvement]

9. Prompt and Input Decision

Allowed Inputs

[Describe allowed inputs]

Prohibited Inputs

[Describe prohibited inputs]

System Prompt Control

[Describe system prompt ownership, versioning, access control, testing, and rollback]

Prompt Injection Control

[Describe prompt injection mitigation, trusted/untrusted content separation, external content handling, and testing requirements]

Context Isolation

[Describe context isolation across users, tenants, sessions, repositories, trust zones, and data classifications]

10. Output and Decision Decision

Output Classification

[Describe output types and impact]

Validation Requirement

[Describe validation, review, approval, or sampling requirements]

Recommendation vs Decision Separation

[Describe how AI recommendation is separated from final decision]

Generated Record Handling

[Describe provenance, retention, correction, and record ownership]

Downstream Use Controls

[Describe controls before AI output is used by downstream systems or workflows]

11. Tool and Action Decision

Tools or APIs Approved

Tool / API / Workflow Action Type Risk Level Approval Required Logging Required
[Tool] [Action] [Low/Medium/High/Critical] [Yes/No] [Yes/No]

Action Boundaries

[Describe allowed and prohibited actions]

Approval Gates

[Describe approval gates for high-risk actions]

Blast-Radius Limits

[Describe limits on records, users, amount, rate, systems, environments, or action scope]

Kill Switch and Rollback

[Describe kill switch, revocation, rollback, or compensation path]

12. Evidence and Monitoring Decision

Required Evidence

Select all that apply:

[ ] Inventory record
[ ] Risk assessment
[ ] Identity/access approval
[ ] Data source approval
[ ] Prompt/input evidence
[ ] Retrieval logs
[ ] Output logs
[ ] Validation records
[ ] Decision evidence
[ ] Tool call logs
[ ] Action logs
[ ] Approval records
[ ] Exception records
[ ] Assurance test results
[ ] Incident evidence
[ ] Vendor evidence

Logging Approach

[Describe logging approach, metadata/full content/redaction/reference-only, retention, and access control]

Monitoring Approach

[Describe monitoring, alerts, anomaly detection, policy violations, SIEM/SOC integration, or manual review]

Evidence Retention

[Describe evidence retention period and storage location]

13. Assurance Decision

Required Assurance

Select all that apply:

[ ] Design review
[ ] Pre-deployment testing
[ ] Prompt injection testing
[ ] Data leakage testing
[ ] Retrieval boundary testing
[ ] Output validation testing
[ ] Tool misuse testing
[ ] Approval gate testing
[ ] Logging completeness testing
[ ] Evidence reconstruction testing
[ ] Kill switch testing
[ ] Rollback testing
[ ] Vendor assurance review
[ ] Regression testing
[ ] Incident tabletop

Assurance Acceptance Criteria

[Describe what must pass before this architecture decision is considered ready]

Regression Triggers

[Describe changes that require retesting or architecture review]

14. Consequences

Positive Consequences

[Describe benefits of the decision]

Negative Consequences

[Describe tradeoffs, limitations, risks, or operational burden]

Residual Risks

[Describe risks that remain after the decision and required controls]

Required Compensating Controls

[Describe compensating controls if any control requirement cannot be fully met]

15. Exceptions and Conditions

Exceptions Required?

[ ] No
[ ] Yes
[ ] Unknown

Exception Summary

Requirement Exception Needed Rationale Compensating Control Expiry
[Requirement] [Yes/No] [Rationale] [Control] [Date]

Approval Conditions

[List conditions required for approval]

16. Review and Approval

Reviewers

Reviewer Function Review Area Decision Date
[Name] [Function] [Area] [Approved/Rejected/Conditional] [Date]

Final Decision

Select one:

[ ] Approved
[ ] Approved with conditions
[ ] Rejected
[ ] Deferred
[ ] Requires additional review

Final Decision Notes

[Document approval, conditions, rejection rationale, or next steps]

Approved By

Name:
Function:
Date:

17. Review Triggers

This decision should be reviewed if any of the following occur:

[ ] Model or provider changes
[ ] Vendor feature changes
[ ] System prompt changes
[ ] Retrieval logic changes
[ ] Data source changes
[ ] Tool/API access changes
[ ] Workflow changes
[ ] Risk tier changes
[ ] Incident occurs
[ ] Assurance finding is opened
[ ] Regulatory requirement changes
[ ] Business process changes
[ ] External exposure changes
[ ] Production scale increases
[ ] Exception expires

Next Review Date

[Enter date]

18. Summary

Decision ID:
Decision title:
Use case:
AI pattern:
Risk tier:
Decision:
Key rationale:
Required controls:
Required evidence:
Required assurance:
Exceptions:
Approval status:
Next review date: