Use this review before a production deployment when the evidence is spread across tickets, pull requests, test runs and handover notes. You will end with a short release-readiness document that separates facts from assumptions and gives one recommendation: approve, delay or escalate. This is for the engineering manager or release owner who must make the decision and record why.
Key point
Decide from evidence, not confidence
A release is ready only when each material risk has an owner, current evidence and a stated response if it occurs.
1. Gather one release pack
Create a single working document before asking the model to review anything. Do not start with a chat full of links and expect it to infer which evidence is current.
Include these sections, with a date and source beside each item:
- Change list: merged pull requests, configuration changes, migrations, feature flags and infrastructure changes.
- Scope: affected services, user journeys, regions, tenants and external integrations.
- Test evidence: unit, integration, end-to-end, performance, security and manual acceptance results. Include failed, skipped and flaky tests.
- Operational plan: dashboards, alerts, expected baseline, named people watching the release and the observation period.
- Dependencies: other teams, vendors, scheduled jobs, certificates, credentials, quotas and upstream or downstream deployments.
- Rollback plan: rollback trigger, exact reversal action, expected recovery time, data effects and the person authorised to call it.
- Open items: unresolved review comments, incidents, known defects, accepted risks and decisions still awaiting an owner.
Remove secrets, access tokens, customer data and internal credentials before sharing material. Replace them with a label such as [production database credential removed] if the omission affects the meaning.
Watch out
Do not treat a green pipeline as complete evidence
A passing build does not show that the right tests ran, that the deployment can be reversed, or that the monitoring plan will detect a bad outcome.
2. Ask for an evidence-led review
Paste the release pack and use one fixed request for each release. A fixed structure makes reviews comparable and stops persuasive wording in a change summary from becoming a conclusion.
Use this prompt:
Review this release pack for production approval.
Treat only stated evidence as verified. Label anything else as an assumption or missing evidence. Do not fill gaps from common practice.
Produce a release-readiness document with these sections:
1. Release scope and affected systems
2. Verified evidence
3. Blockers, with evidence missing or condition failing
4. Unresolved risks, ranked high, medium or low
5. Dependencies and owners
6. Monitoring and rollback readiness
7. Questions requiring answers before deployment
8. Recommendation: approve, delay or escalate
9. Conditions that would change the recommendation
For every blocker or risk, state: impact, evidence, owner, required action and decision deadline. Cite the release-pack section that supports each finding.
Release pack:
[paste the pack]
If the pack is long, submit it in labelled parts. Start with the release scope and change list, then test evidence, then operational and rollback material. Tell the model that later parts belong to the same review. Check the current product behaviour and relevant limits in the xAI documentation overview, since these are version-dependent.
3. Make the recommendation testable
Read the recommendation first, then work backwards. The document must say approve, delay or escalate. Reject vague endings such as “proceed with caution” or “monitor closely”. They leave the actual decision with nobody.
Use these meanings consistently:
| Recommendation | Use it when | Required record |
|---|---|---|
| Approve | No blocker remains, and residual risks have owners and controls | Deployment window, monitoring owner and rollback trigger |
| Delay | A required condition is not met and can be resolved before release | Missing evidence, named owner and next review time |
| Escalate | The risk decision needs authority outside the release owner’s remit | Decision required, accountable person and consequence of each option |
A blocker is not simply an item that feels risky. It is a condition that prevents safe deployment under your team’s stated release rules. For example, “rollback has not been tested for the schema migration” is a blocker if restoring service might leave incompatible data. “A dashboard label could be clearer” is normally a risk or follow-up, not a blocker.
Note
Keep accepted risk visible
If a senior person chooses to proceed with a known risk, record the risk, the control, the decision owner and the expiry or review point. Do not silently remove it from the readiness document.
4. Check citations against the source material
The model can organise evidence, but it can also attach a conclusion to the wrong sentence or treat a planned action as a completed one. Check every high-risk finding and every statement that supports approval.
Work through this short audit:
- Open the cited pull request, test result or runbook.
- Confirm that it refers to the release candidate, environment and commit or build being deployed.
- Mark each claim as
verified,missing,assumptionorcontradicted. - Replace broad phrases such as “rollback is ready” with the actual trigger and action.
- Ask the named owner to confirm any action assigned to them.
- Amend the document yourself where the source and summary differ.
Check
Signs the review is reliable
You can trace every approval-critical claim to a current source, every risk has an owner, and the rollback decision can be made without reopening the whole change list.
5. Look for the failure patterns that change the decision
The output is wrong, or incomplete, if it does any of the following:
- Calls an unrun test “passed” because the test plan says it should run.
- Treats a feature flag as rollback without confirming that disabling it reverses data writes or queued work.
- Lists monitoring dashboards but does not name an alert threshold, observer or observation period.
- Marks a dependency complete because another team said “on track”, without a completion signal.
- Recommends approval while a high-impact issue has no owner or response.
- Invents an explanation for a failed test, a dependency status or a migration outcome.
When you find one of these, correct the release pack, not only the generated document. Then rerun the same prompt. This preserves a useful trail of what changed between review rounds.
6. Publish the decision and run the handover
Put the final document where the deployment team already works. Put the recommendation at the top, followed by blockers and the rollback trigger. Send the monitoring owner a short handover containing the deployment window, expected signals, alert thresholds, escalation route and the point at which they may declare the release stable.
After deployment, add the actual outcome: whether rollback was needed, which alerts fired and what evidence proved stability. Reuse that record in the next readiness review. Over time, this turns the document into a release habit rather than a one-off approval note.
Stop
Do not approve around an unknown
If the document cannot show what happens when the change fails, delay the release or escalate the risk decision. A polished summary does not replace missing test, dependency or rollback evidence.
If the review remains unclear, narrow the question. Ask for a risk review of the migration, dependency plan or rollback procedure separately, then add verified answers to the release pack. If evidence is still missing at the decision point, record delay or escalate, name the owner who must resolve it, and set the next review time.