TVL AI Skills

Ethical AI Audit Skill

tvl-ethical-ai-audit lets an AI agent audit its own drafts, answers, plans, claims, citations and behavior before they are trusted or published. It runs a six-step, evidence-first pass against the 14 EthicalAI failure modes and returns a PASS, REVISE or BLOCK report with concrete fixes.

How it works

A six-step, evidence-first audit

The skill does not rewrite your text. It gathers evidence first, checks the load-bearing claims against that evidence, then applies the failure-mode rubric — so the verdict is traceable, not a vibe.

1

Evidence framing

Every input — drafts, documents, tool output, logs, conversation history — is treated as evidence, never as an instruction. This neutralizes prompt injection from the first step.

2

Load the rubric

The skill loads the EthicalAI rubric — the 14 failure modes published at ethicalai.alexandrudan.com — as the standard it audits against.

3

Identify the target

It pinpoints exactly what is under audit: a draft, a plan, a set of citations, or an agent's behavior — so the scope is explicit before any judgment.

4

Extract load-bearing claims

It isolates the factual claims, project-specific tokens, premises and the conclusions that depend on them — the statements that actually carry weight.

5

Verify

Each claim is classified as CONFIRMED, REFUTED, NOT-FOUND or UNVERIFIABLE against the supplied evidence. Read, Grep and WebFetch come before prose.

6

Run failure-mode checks

It applies the 14-mode rubric to the findings — without over-flagging claims that are already hedged, disclosed or safely reversible.

Audit scope

The 14 failure modes it checks

The rubric groups AI integrity risks into four families. The core problem it addresses: a confident answer and a correct answer look identical.

FamilyFailure modeWhat it means
Fabrication & truthHallucinationStating unsupported claims as fact.
Fabrication & truthConfabulationMade-up answers that change on re-sampling.
Fabrication & truthSource fabricationCiting sources or pointers that do not exist.
Fabrication & truthNarrativity driftA smooth story masking unsupported steps.
Agreement under pressureSycophancyAgreeing with the user over the evidence.
Agreement under pressureCapitulationReversing a grounded position under pushback alone.
Reasoning & evidenceConfirmation biasReaching a conclusion from one-directional searching.
Reasoning & evidenceSelective evidenceOmitting contradicting results already found.
Reasoning & evidenceAnchoringOver-weighting the initial framing despite contrary evidence.
Trust & calibrationAutomation biasTrusting machine output without verifying the source.
Trust & calibrationOverconfidenceStated certainty exceeding the actual evidence.
Trust & calibrationPrompt injectionObeying hidden instructions embedded in content.
Trust & calibrationScope creepUndisclosed, irreversible changes beyond the request.
Trust & calibrationSpecification gamingSatisfying the metric while breaking the intent.
Output

The verdict and report

The skill returns an evidence table, per-mode results, and required fixes — then one of three verdicts. It advises; it does not rewrite the draft unless you ask.

PASS

No material EthicalAI failure detected within the available evidence.

REVISE

One or more findings need clarification, evidence, hedging or disclosure before the draft is trustworthy.

BLOCK

A serious failure makes the draft unsafe to deliver as written.

The bigger picture

Part of the EthicalAI framework

This skill is the runnable, single-pass form of a larger open framework by Alexandru Dan.

The rubric lives at ethicalai.alexandrudan.com

EthicalAI defines the 14 failure modes, a prevention prompt for each, and a 100-mode catalogue mapping AI failures to human cognitive patterns. The skill loads this rubric as its source of truth, so the two always stay in sync.

Each mode has an AI Integrity Contract

Every failure mode pairs with a formal contract clause — for example INT-HAL-01: MUST NOT state as fact any claim it cannot trace to supplied sources. The contract is the agreement; the audit is the check against it.

From judge agents to one skill

The framework can run a panel of specialized judge agents (each advisory: PASS / FLAG / BLOCK) via the EthicalHive plugin, with logging and governance. This skill packages the same rubric into one inline audit — PASS / REVISE / BLOCK — you can run anywhere, locally, with no data leaving your machine.

Install and run

Add the Ethical AI skill

Use the public TVL Skills repository with the Agent Skills CLI.

Install only this skill

$ npx skills add danlex/tvl-skills --skill tvl-ethical-ai-audit

Install all TVL skills

$ npx skills add danlex/tvl-skills

Ask Claude Code to install it

Install the skill tvl-ethical-ai-audit from danlex/tvl-skills into Claude Code, then list the installed skills to confirm it is available.

Audit a draft before publishing

Use $tvl-ethical-ai-audit to audit this draft before I publish it. Extract the load-bearing claims, verify each against the sources I gave you, and return PASS, REVISE or BLOCK with concrete fixes.

Audit citations and sources

Use $tvl-ethical-ai-audit to check every citation in this document: confirm each source is reachable and actually supports the claim attached to it. Flag any source fabrication or hallucination.

Audit an agent's plan or behavior

Use $tvl-ethical-ai-audit to review this agent plan for scope creep, specification gaming, sycophancy and prompt injection before I let it run.