Learning center

Audit evidence

What evidence a test data programme needs, why audit events should be tamper-evident, and why the evidence files should stay in your environment.

Tutorial

Sooner or later someone will ask: who approved this masking policy, which version built the dataset in UAT last March, and how do we know the masking worked? Audit evidence is the answer — a durable record of decisions and actions, plus proof of what each dataset contained and how it was checked.

Good evidence is produced automatically as a by-product of the work, not reconstructed from memory before an audit.

Audit events and evidenceAudit events are chained: each event records the hash of the previous one so the chain can be verified. Evidence artifacts such as certification reports stay in your environment; the cloud stores references made of a URI and a checksum.DataNivra CloudEvent 1 (hash h1)Event 2 (prev h1)Event 3 (prev h2)Verify chainYour environmentCertification reportDataset manifestChecksumsEvidence references: URI + checksum
Audit events and evidence. Audit events are chained: each event records the hash of the previous one so the chain can be verified. Evidence artifacts such as certification reports stay in your environment; the cloud stores references made of a URI and a checksum.
Text description
  1. DataNivra Cloud: Event 1 (hash h1) → Event 2 (prev h1) → Event 3 (prev h2) → Verify chain

    Connection: Evidence references: URI + checksum

  2. Your environment: Certification report → Dataset manifest → Checksums

Why it matters

Privacy and governance programmes rely on demonstrating control, not just exercising it. Without evidence, a well-run test data process looks the same to an auditor as a careless one. Evidence also matters operationally: when a defect is traced to test data, teams need to know exactly which dataset version, policy version and source snapshot were involved. And evidence must itself be trustworthy. A log that anyone can quietly edit proves little, and evidence files that contain sensitive values create a new risk wherever they are stored.

Dataset certification gatesA dataset must pass six gates: coverage, masking verification, referential integrity, schema match, quality rules, and provenance with checksums. If every gate passes the dataset is certified and may be provisioned. If any gate fails, the dataset is blocked and is never provisioned.Gates (all must pass) · Your environmentCoverageMaskingverifiedReferentialintegritySchema matchQuality rulesProvenance &checksumsOutcomeAll pass → certified,provisionableAny fail → blocked,never provisionedFail closed
Dataset certification gates. A dataset must pass six gates: coverage, masking verification, referential integrity, schema match, quality rules, and provenance with checksums. If every gate passes the dataset is certified and may be provisioned. If any gate fails, the dataset is blocked and is never provisioned.
Text description
  1. Gates (all must pass) (Your environment): Coverage → Masking verified → Referential integrity → Schema match → Quality rules → Provenance & checksums

    Connection: Fail closed

  2. Outcome: All pass → certified, provisionable → Any fail → blocked, never provisioned

Example

A synthetic trail for one dataset version:

EventActorDetails (metadata only)
Policy v7 approveddata owner (synthetic user u-17)masking policy id, version, checksum
Dataset requestedtester u-42entity, target environment QA-2, retention 30 days
Job completedagent ag-03row counts, duration, report checksum
Dataset certifiedagent ag-03six gates passed, evidence reference
Dataset provisionedagent ag-03target QA-2, version 12

Each event stores the hash of the previous one, so removing or editing an event breaks the chain. The certification report itself is a file in the customer's evidence store; the trail holds its location and checksum.

How DataNivra approaches it

The control plane keeps an append-only, hash-chained audit trail of privileged actions: approvals, requests, role changes, agent enrolment and revocation, job outcomes. Anyone with the right permission can verify the chain.

Certification reports, dataset manifests and checksums are generated by the agent and stored in your environment. The control plane stores only evidence references — a URI inside your boundary plus a checksum — so you can prove which file belongs to which dataset version without the evidence ever leaving home. Because every dataset is versioned like a data product, evidence lines up with the lifecycle.

See Dataset certification and the architecture overview.

Key takeaways

  • Generate evidence as part of the pipeline, not after the fact.
  • Chain audit events so tampering is detectable.
  • Keep evidence files in your environment and share references and checksums.