---
name: al-350-check-whether-your-ai-coding-agent-really-did-what-it-say
description: "AI coding agents often report that everything works, and sometimes they get there by deleting or skipping the tests. On Oct 24, 2026 a developer shared proofslip, a free, open source GitHub Action that checks what an AI agent claimed in its pull request against what GitHub actually recorded, then writes a plain-English receipt anyone can read. The prompt below does the same check by hand for any pull request or agent summary, so non-experts can spot claims that the actual changes don't back up before merging. Use when the user wants help with agent claim verification (coding) for a small business."
---

# Check whether your AI coding agent really did what it says: compare its pull request claims ('all tests pass') against what actually changed and get a plain-English receipt

AI coding agents often report that everything works, and sometimes they get there by deleting or skipping the tests. On Oct 24, 2026 a developer shared proofslip, a free, open source GitHub Action that checks what an AI agent claimed in its pull request against what GitHub actually recorded, then writes a plain-English receipt anyone can read. The prompt below does the same check by hand for any pull request or agent summary, so non-experts can spot claims that the actual changes don't back up before merging.

## Inputs to collect first
Ask the user for anything below that they haven't already given you. Don't guess missing facts.

- The PR description or the agent's final message
- The diff or file list with added/removed lines
- CI output, or 'none'

## Instructions

Do the task below with the user's inputs in place of each [bracket].

I'm going to paste what my AI coding agent said it did, and what actually changed. Act as a careful reviewer and tell me in plain English whether its claims hold up. Agent's summary: [paste the PR description or the agent's final message]. Changed files and diff: [paste the diff or file list with added/removed lines]. Test or check results: [paste CI output, or 'none']. 1) List every claim the agent made (for example 'fixed the login bug', 'all tests pass', 'added tests', 'no breaking changes'). 2) For each claim, say Supported, Not supported or Can't tell, and point to the exact file, line or log that shows it. 3) Flag red flags: tests deleted, skipped or weakened, checks turned off, error handling removed, files changed that have nothing to do with the task, secrets or config edited. 4) Write a short receipt I can paste into the pull request: what was really done, what wasn't, and what to verify before merging. 5) Suggest 3 instructions I can add to my agent's rules so it stops making unverified claims (for example 'never delete or skip a test to make the suite pass; ask instead').

## Safety checks (share these with the user)

- Check names, dates, numbers and any claim against your own source material before you use the answer. AI can misread or invent details.
- Say clearly which parts need a person to review or approve before anything is sent, paid, posted or filed.

## About this skill

- Works with: proofslip (GitHub Action), GitHub, Claude Code, Codex
- Based on this real-world example: https://x.com/kickscosmo/status/2114111189009764378
- Free prompt from AgentPlaybook Real Estate: https://agentic-library.netlify.app/prompt/al-350-check-whether-your-ai-coding-agent-really-did-what-it-says-c/
- To install in an agent that supports Agent Skills, save this file as SKILL.md in a folder with the same name as `name` above (for example in your skills directory). Install steps for Claude.ai, Claude Code, Cursor and Codex: https://agentic-library.netlify.app/skills/