AI Architecture Decision Record Template
This template is used to document architecture decisions for AI use cases, AI control designs, AI patterns, AI integrations, AI vendors, AI agents, and AI-enabled workflows.
An Architecture Decision Record captures the decision, context, options considered, rationale, consequences, controls required, evidence required, and review conditions.
The purpose is to make AI architecture decisions traceable, reviewable, and reusable.
1. Decision Information
Decision Title
[Enter short decision title]
Decision ID
[Enter decision ID]
Date
[Enter date]
Status
Select one:
[ ] Proposed
[ ] Under review
[ ] Approved
[ ] Approved with conditions
[ ] Rejected
[ ] Superseded
[ ] Deprecated
[ ] Deferred
Decision Owner
Name:
Function:
Email:
Related AI Use Case
Related AI Inventory Record
Related Documents
2. Decision Context
Background
[Describe the context that led to this architecture decision]
Business Need
[Describe the business need or problem this decision addresses]
Technical Context
[Describe the technical environment, systems, platforms, data sources, vendors, tools, workflows, or integrations involved]
AI Pattern
Select all that apply:
[ ] Copilot
[ ] Internal LLM application
[ ] RAG system
[ ] AI-enabled SaaS
[ ] Embedded vendor AI
[ ] Agent
[ ] AI-enabled workflow automation
[ ] Customer-facing AI
[ ] Employee-facing AI
[ ] Developer AI tool
[ ] Security operations AI
[ ] Decision-supporting AI
[ ] Action-capable AI
[ ] Other
Assigned Risk Tier
Select one:
[ ] Tier 1: Low-risk productivity or public-data use
[ ] Tier 2: Internal productivity with enterprise data
[ ] Tier 3: Decision-supporting AI
[ ] Tier 4: Action-capable AI
[ ] Tier 5: High-impact autonomous or regulated AI
[ ] Unknown / pending assessment
3. Decision Statement
Architecture Decision
[State the decision clearly. Example: The AI use case will use user-delegated identity for retrieval and a separate agent identity for tool execution.]
Decision Summary
[Summarize the decision in one or two paragraphs]
Decision Scope
Select all that apply:
[ ] AI pattern
[ ] Model or AI service
[ ] Vendor or platform
[ ] Identity model
[ ] Data boundary
[ ] Retrieval architecture
[ ] Prompt/input control
[ ] Output/decision control
[ ] Tool/action control
[ ] Human accountability
[ ] Monitoring/logging/evidence
[ ] Assurance/testing
[ ] Incident containment/recovery
[ ] Operating model
[ ] Other
4. Options Considered
Option 1
Option name:
Description:
Benefits:
Risks:
Control implications:
Reason accepted or rejected:
Option 2
Option name:
Description:
Benefits:
Risks:
Control implications:
Reason accepted or rejected:
Option 3
Option name:
Description:
Benefits:
Risks:
Control implications:
Reason accepted or rejected:
Additional Options
[Add additional options if required]
5. Architecture Principles Considered
Select all applicable principles:
[ ] AI must be inventoried before it is trusted.
[ ] AI must not receive authority without identity.
[ ] AI must not access data without boundaries.
[ ] AI inputs must be treated as control surfaces.
[ ] AI outputs must not become decisions without control.
[ ] AI must not execute actions without control.
[ ] Human accountability must remain assigned.
[ ] AI must be tested before and after deployment.
[ ] AI must be observable and reconstructable.
[ ] AI failure must be containable.
Principle Alignment Notes
[Describe how the decision aligns with or deviates from relevant principles]
6. Control Impact Assessment
AI Inventory and Classification
[Describe inventory, classification, lifecycle, and risk-tier implications]
AI Identity and Access Control
[Describe identity model, delegated authority, service accounts, agent identities, access review, and revocation implications]
Data Boundary Control
[Describe data sources, data classification, retrieval boundaries, retention, training/reuse, and output sensitivity implications]
Prompt and Input Control
[Describe allowed inputs, prohibited inputs, prompt injection risk, system prompt protection, context isolation, and input logging implications]
Output and Decision Control
[Describe output classification, validation, review, approval, generated records, downstream use, and correction implications]
Tool and Action Control
[Describe tools, APIs, workflows, action classification, approval gates, blast-radius limits, kill switches, and rollback implications]
Human Accountability Model
[Describe business owner, technical owner, decision owner, approver, escalation, override, and exception ownership implications]
AI Assurance and Testing
[Describe required testing, validation, prompt injection testing, data leakage testing, tool/action testing, regression testing, and assurance evidence]
Monitoring, Logging, and Evidence
[Describe required logs, evidence, monitoring, retention, reconstruction, SIEM/SOC/GRC integration, and audit needs]
Incident Containment and Recovery
[Describe containment paths, revocation, kill switches, evidence preservation, rollback, vendor escalation, and recovery implications]
7. Identity and Access Decision
Identity Model Selected
Select all that apply:
[ ] Direct user identity
[ ] Delegated user authority
[ ] Service identity
[ ] Application identity
[ ] Agent identity
[ ] Vendor-managed identity
[ ] Hybrid identity
[ ] Not applicable
Identity Decision Rationale
[Explain why this identity model was selected]
Access Boundary
[Describe systems, data, tools, APIs, workflows, and environments AI can access]
Revocation Path
[Describe how access can be revoked, suspended, disabled, or rotated]
8. Data Boundary Decision
Data Sources Approved
Retrieval Boundary
[Describe retrieval scope, filtering, access enforcement, classification restrictions, and tenant/user/session boundaries]
Retention and Reuse Decision
[Describe whether prompts, outputs, context, logs, embeddings, or interaction history may be retained or reused]
Vendor Data Processing Decision
[Describe whether data is processed by a vendor, retained by a vendor, or used for training/product improvement]
9. Prompt and Input Decision
Allowed Inputs
[Describe allowed inputs]
Prohibited Inputs
[Describe prohibited inputs]
System Prompt Control
[Describe system prompt ownership, versioning, access control, testing, and rollback]
Prompt Injection Control
[Describe prompt injection mitigation, trusted/untrusted content separation, external content handling, and testing requirements]
Context Isolation
[Describe context isolation across users, tenants, sessions, repositories, trust zones, and data classifications]
10. Output and Decision Decision
Output Classification
[Describe output types and impact]
Validation Requirement
[Describe validation, review, approval, or sampling requirements]
Recommendation vs Decision Separation
[Describe how AI recommendation is separated from final decision]
Generated Record Handling
[Describe provenance, retention, correction, and record ownership]
Downstream Use Controls
[Describe controls before AI output is used by downstream systems or workflows]
11. Tool and Action Decision
Tools or APIs Approved
Action Boundaries
[Describe allowed and prohibited actions]
Approval Gates
[Describe approval gates for high-risk actions]
Blast-Radius Limits
[Describe limits on records, users, amount, rate, systems, environments, or action scope]
Kill Switch and Rollback
[Describe kill switch, revocation, rollback, or compensation path]
12. Evidence and Monitoring Decision
Required Evidence
Select all that apply:
[ ] Inventory record
[ ] Risk assessment
[ ] Identity/access approval
[ ] Data source approval
[ ] Prompt/input evidence
[ ] Retrieval logs
[ ] Output logs
[ ] Validation records
[ ] Decision evidence
[ ] Tool call logs
[ ] Action logs
[ ] Approval records
[ ] Exception records
[ ] Assurance test results
[ ] Incident evidence
[ ] Vendor evidence
Logging Approach
[Describe logging approach, metadata/full content/redaction/reference-only, retention, and access control]
Monitoring Approach
[Describe monitoring, alerts, anomaly detection, policy violations, SIEM/SOC integration, or manual review]
Evidence Retention
[Describe evidence retention period and storage location]
13. Assurance Decision
Required Assurance
Select all that apply:
[ ] Design review
[ ] Pre-deployment testing
[ ] Prompt injection testing
[ ] Data leakage testing
[ ] Retrieval boundary testing
[ ] Output validation testing
[ ] Tool misuse testing
[ ] Approval gate testing
[ ] Logging completeness testing
[ ] Evidence reconstruction testing
[ ] Kill switch testing
[ ] Rollback testing
[ ] Vendor assurance review
[ ] Regression testing
[ ] Incident tabletop
Assurance Acceptance Criteria
[Describe what must pass before this architecture decision is considered ready]
Regression Triggers
[Describe changes that require retesting or architecture review]
14. Consequences
Positive Consequences
[Describe benefits of the decision]
Negative Consequences
[Describe tradeoffs, limitations, risks, or operational burden]
Residual Risks
[Describe risks that remain after the decision and required controls]
Required Compensating Controls
[Describe compensating controls if any control requirement cannot be fully met]
15. Exceptions and Conditions
Exceptions Required?
[ ] No
[ ] Yes
[ ] Unknown
Exception Summary
Approval Conditions
[List conditions required for approval]
16. Review and Approval
Reviewers
Final Decision
Select one:
[ ] Approved
[ ] Approved with conditions
[ ] Rejected
[ ] Deferred
[ ] Requires additional review
Final Decision Notes
[Document approval, conditions, rejection rationale, or next steps]
Approved By
Name:
Function:
Date:
17. Review Triggers
This decision should be reviewed if any of the following occur:
[ ] Model or provider changes
[ ] Vendor feature changes
[ ] System prompt changes
[ ] Retrieval logic changes
[ ] Data source changes
[ ] Tool/API access changes
[ ] Workflow changes
[ ] Risk tier changes
[ ] Incident occurs
[ ] Assurance finding is opened
[ ] Regulatory requirement changes
[ ] Business process changes
[ ] External exposure changes
[ ] Production scale increases
[ ] Exception expires
Next Review Date
[Enter date]
18. Summary
Decision ID:
Decision title:
Use case:
AI pattern:
Risk tier:
Decision:
Key rationale:
Required controls:
Required evidence:
Required assurance:
Exceptions:
Approval status:
Next review date: