AI-assisted review¶
AI agents can accelerate a production-readiness review, especially when controls can be evaluated from source, tests, infrastructure definitions, configuration schemas, and repository documentation. They should be used as evidence finders and gap detectors—not as autonomous release authorities.
What an agent can often inspect¶
- build, test, lint, and deployment configuration;
- dependency manifests, lockfiles, and update policy;
- authentication, authorization, input handling, and security-sensitive code paths;
- database migrations and backward-compatibility patterns;
- automated tests and their relationship to critical journeys;
- infrastructure-as-code, observability definitions, and runbooks;
- documented architecture, recovery, incident, and support procedures;
- the current diff and the controls it could invalidate.
What usually needs human or external evidence¶
- the exact production configuration and deployed artifact;
- successful backup restoration, failover, capacity, or incident drills;
- alert delivery and on-call authority in real operating conditions;
- legal, regulatory, privacy, accessibility, and contractual applicability;
- third-party contracts, organizational processes, and staff availability;
- penetration-test findings or production telemetry not present in the repository;
- the authority to accept residual risk and approve a launch.
An agent must label these controls Blocked or Unknown, not infer a pass from missing information.
Recommended workflow¶
- Put
CLAUDE.mdat the root of the application repository, or copy its instructions into the agent context. - Choose a full lifecycle review, a release-diff review, or an evidence challenge.
- Give the agent the release identifier, intended environment, architecture overview, critical journeys, and applicable conditional modules.
- Allow read-only inspection and relevant test commands. Require permission before code or configuration changes.
- Require a citation for each Pass: file and line, test output, command result, artifact, or external evidence reference.
- Have a qualified person review high-impact conclusions and every proposed exception.
Useful output contract¶
Ask the agent to return:
- release and scope understood;
- immediate no-go findings;
- a control table with
USEQ-*orPRC-*ID, status, evidence, confidence, owner, and next action; - unknowns that require human or external evidence;
- changed controls invalidated by the release diff;
- prioritized blockers and recommended verification commands;
- an explicit statement that the agent is not making the final release decision.
Anti-patterns¶
- Asking “is this production ready?” without release scope or evidence criteria.
- Treating a repository-only release review as a complete lifecycle assessment when governance, product, operational, or external evidence was never supplied.
- Treating the absence of a visible vulnerability as proof of security.
- Allowing the agent to mark organizational or production-only controls as passed from source code.
- Counting passed boxes or reporting a readiness percentage without blocker analysis.
- Letting an agent accept risk on behalf of a named human owner.
- Running destructive, load, failover, migration, or production tests without explicit authorization and safe boundaries.
Review the reviewer¶
Challenge the agent’s findings. Check that cited evidence supports the exact control, pertains to the exact release, comes from the intended environment, is current enough, and demonstrates behavior rather than intent. The evidence challenge prompt is designed for a second-pass review.