Industry packs

Energy & Utilities industry pack

Synthetic customer, premise, metering, billing and field-service test data with linked masking

Preview only · not activatable yet Version 2.0.0 · Complete

Everything on this page works without an account. Prefer a conversation? Request a demo (optional). Missing something? Request a feature.

This pack is installed and passes DataNivra’s pack conformance kit through the real engine, but it cannot be activated yet: no plan includes it yet, the standard agent image does not ship it, the control-plane catalogue does not list it and the hosted sandbox has no synthetic estate for it. You can explore its synthetic records, masking and scenarios on this page and in the browser demo. Tell us if you need it: demand decides which packs become activatable next.

Problems this pack solves

Masked data that still joins across 4 systems

7 cross-system relationships link billing, customer, field and metering; the pack's masking keeps one pseudonym per identity on every side. For example, customer.premises.premise_id and metering.meters.premise_ref get the same pseudonym.

The cases production samples rarely contain

8 ready-made scenarios generate them on demand, for example: reads estimated because no actual read was obtained, and bills issued on estimates; overdue bills, failed collections with reasons and payment arrangements for the debt; meters exchanged at the same premise, with the field visits that performed the exchange.

Sensitive fields found and masked before anyone sees them

37 columns across 10 entities are classified (direct identifier, financial, PHI, PII, quasi identifier and sensitive) and covered by 3 masking templates you review and approve.

Evidence that each dataset is fit to use

2 certification presets check masking coverage, referential integrity, orphans and row counts before a dataset can be provisioned; a failed dataset is never provisioned.

Entities and relationships

10 entities across 4 source systems, generated from the pack’s own entity model.

Entity graph of the Energy & Utilities pack10 entities in 4 systems (customer, metering, billing, field) linked by 12 relationships, 7 of them across systems. The table after the graph lists every relationship.customermeteringbillingfieldUtilityCustomer (customer.utility_customers)UtilityCustomercustomer.utility_custo…Premise (customer.premises)Premisecustomer.premisesAccount (customer.accounts)Accountcustomer.accountsMeter (metering.meters)Metermetering.metersMeterRead (metering.meter_reads)MeterReadmetering.meter_readsMeterExchange (metering.meter_exchanges)MeterExchangemetering.meter_exchang…UtilityBill (billing.utility_bills)UtilityBillbilling.utility_billsBillPayment (billing.bill_payments)BillPaymentbilling.bill_paymentsPaymentArrangement (billing.payment_arrangements)PaymentArrangementbilling.payment_arrang…ServiceOrder (field.service_orders)ServiceOrderfield.service_orders
Arrows point from the referencing entity to the one it references. Solid: a foreign key inside one system. Dashed: a cross-system relationship — the pack keeps the same pseudonym on both sides, so masked data still joins.
All 12 relationships as a table
Relationships of the Energy & Utilities pack
EntityReferencesColumnsKind
AccountUtilityCustomercustomer_id → customer_idWithin a system
AccountPremisepremise_id → premise_idWithin a system
MeterReadMetermeter_id → meter_idWithin a system
MeterExchangeMeterold_meter_id → meter_idWithin a system
BillPaymentUtilityBillbill_id → bill_idWithin a system
MeterPremisepremise_ref → premise_idAcross systems (pack relationship template)
MeterExchangePremisepremise_ref → premise_idAcross systems (pack relationship template)
UtilityBillAccountaccount_ref → account_numberAcross systems (pack relationship template)
UtilityBillPremisepremise_ref → premise_idAcross systems (pack relationship template)
PaymentArrangementAccountaccount_ref → account_numberAcross systems (pack relationship template)
ServiceOrderPremisepremise_ref → premise_idAcross systems (pack relationship template)
ServiceOrderMetermeter_ref → meter_idAcross systems (pack relationship template)

Realistic synthetic records

Synthetic data. Every record on this page is synthetic, generated from a fixed seed by the pack's own generator; masked values come from the real masking engine.

Premise — customer.premises (synthetic)
premise_id sensitivestreet_address sensitivecity sensitivepostal_code sensitivegrid_ref sensitiveproperty_typecountry_code
PRM0000000017093 Juniperwell RowOrrinwick99604ZZ-GR-321252HOUSEZZ
PRM0000000022539 Willowmere TerraceOrrinhaven63528ZZ-GR-937966COMMERCIAL_UNITZZ

Masking: before and after

Template Linked utility test data (UTL_LINKED_TEST_DATA) applied to a synthetic Premise record from customer.premises.

Synthetic Premise record before and after masking
ColumnClassified asBefore (synthetic)After masking
premise_idDirect identifierPRM000000001PRM964250154
street_addressPII, Quasi identifier7093 Juniperwell Row7504 Willowmere Street
cityQuasi identifierOrrinwickGantton
postal_codePII, Quasi identifier9960465262
grid_refQuasi identifierZZ-GR-321252SG-ZJ-950942

Same pseudonym in two systems. The identifier PRM000000001 appears in customer.premises.premise_id and in metering.meters.premise_ref. Both become PRM964250154, so the masked systems still join (relationship UTL_METER_PREMISE).

Masked with a fixed public sample key so this example is reproducible; your data is masked with your own key, referenced from your secret store.

Synthetic scenarios you can run

10 runnable scenarios. Preview them in your browser without an account; the hosted sandbox opens when the pack becomes activatable.

Everyday supply

Normal UTL_EVERYDAY_SUPPLY

Ordinary customers, premises, accounts, meters, reads, bills and field visits

Everyday, valid records: the baseline most tests expect. Children per parent record: 1–3.

Preview in the browser demo: Everyday supply

Estimated reads

Rare UTL_ESTIMATED_READS

Reads estimated because no actual read was obtained, and bills issued on estimates

Valid but uncommon business situations that production samples often miss. Children per parent record: 2–4.

Preview in the browser demo: Estimated reads

Customers in arrears

Rare UTL_CUSTOMERS_IN_ARREARS

Overdue bills, failed collections with reasons and payment arrangements for the debt

Valid but uncommon business situations that production samples often miss. Children per parent record: 1–3.

Preview in the browser demo: Customers in arrears

Meter exchanges

Rare UTL_METER_EXCHANGES

Meters exchanged at the same premise, with the field visits that performed the exchange

Valid but uncommon business situations that production samples often miss. Children per parent record: 1–3.

Preview in the browser demo: Meter exchanges

Vulnerable customers

Rare UTL_VULNERABLE_CUSTOMERS

Customers registered for priority services with synthetic reasons

Valid but uncommon business situations that production samples often miss. Children per parent record: 1–2.

Preview in the browser demo: Vulnerable customers

Zero and negative consumption

Boundary UTL_ZERO_AND_NEGATIVE_CONSUMPTION

Reads at the consumption boundary: exactly zero (vacant premises) and negative corrections

Values at the edges of valid ranges (limits, thresholds, extremes). Children per parent record: 3–6.

Preview in the browser demo: Zero and negative consumption

Back billing

Rare UTL_BACK_BILLING

Back-bills catching up long unbilled periods after missing or faulty reads

Valid but uncommon business situations that production samples often miss. Children per parent record: 1–2.

Preview in the browser demo: Back billing

Outage surge

Rare UTL_OUTAGE_SURGE

A network outage: many outage-response visits within two days, one outage reference

Valid but uncommon business situations that production samples often miss. Children per parent record: 2–5.

Preview in the browser demo: Outage surge

Duplicate reads

Duplicate UTL_DUPLICATE_READS

Meter reads submitted twice with identical content under new read ids

Records that repeat others under new keys (clean-up and matching tests). Children per parent record: 2–4.

Preview in the browser demo: Duplicate reads

Supply histories

Historical UTL_SUPPLY_HISTORIES

Multi-year, referentially intact supply, read and billing histories without gaps

Old records for archive, migration and retention tests. Children per parent record: 2–4.

Preview in the browser demo: Supply histories

Negative tests, kept apart. This scenario produces deliberately broken data for error handling and never passes certification as valid data:

  • UTL_BROKEN_REFERENCES — Dangling cross-system references and invalid values for error-handling tests

Sample schemas and representative outputs

The schema the pack expects in each system (also as CREATE TABLE DDL in the downloads). A run produces a masked or synthetic dataset with the same tables, a certification report with the gates of the chosen preset, and an evidence manifest with checksums — the rows stay in your environment.

UtilityCustomer — customer.utility_customers · 10 columns

A household or small-business customer.

ColumnTypeRequiredSensitive classes
customer_id (key)VARCHAR(12)YesDirect identifier
given_nameVARCHAR(64)YesPII, Direct identifier
family_nameVARCHAR(64)YesPII, Direct identifier
birth_dateDATENoPII, Quasi identifier
national_idVARCHAR(16)NoPII, Direct identifier
emailVARCHAR(128)NoPII, Direct identifier
phoneVARCHAR(32)NoPII, Direct identifier
priority_service_flagBOOLEANYes—
vulnerability_reasonVARCHAR(32)NoPHI, Sensitive
customer_sinceDATEYes—
Premise — customer.premises · 7 columns

A supplied property / service point (the demo subset root: its accounts, holders, meters, reads, bills and field visits travel with it).

ColumnTypeRequiredSensitive classes
premise_id (key)VARCHAR(12)YesDirect identifier
street_addressVARCHAR(128)YesPII, Quasi identifier
cityVARCHAR(64)YesQuasi identifier
postal_codeVARCHAR(10)NoPII, Quasi identifier
grid_refVARCHAR(16)NoQuasi identifier
property_typeVARCHAR(16)Yes—
country_codeVARCHAR(2)Yes—
Account — customer.accounts · 8 columns

A supply account (one fuel) of a customer at a premise.

ColumnTypeRequiredSensitive classes
account_number (key)VARCHAR(12)YesFinancial, Direct identifier
customer_idVARCHAR(12)YesDirect identifier
premise_idVARCHAR(12)YesDirect identifier
fuelVARCHAR(12)Yes—
tariff_codeVARCHAR(8)Yes—
statusVARCHAR(14)Yes—
payment_methodVARCHAR(16)Yes—
opened_onDATEYes—
Meter — metering.meters · 7 columns

A meter installed (or formerly installed) at a premise.

ColumnTypeRequiredSensitive classes
meter_id (key)BIGINTYes—
meter_serialVARCHAR(14)YesDirect identifier
premise_refVARCHAR(12)YesDirect identifier
fuelVARCHAR(12)Yes—
meter_typeVARCHAR(12)Yes—
statusVARCHAR(10)Yes—
installed_onDATEYes—
MeterRead — metering.meter_reads · 7 columns

A register read of a meter; consumption is the difference to the previous read.

ColumnTypeRequiredSensitive classes
read_id (key)BIGINTYes—
meter_idBIGINTYes—
read_atTIMESTAMPYesQuasi identifier
read_valueDECIMAL(12,3)YesQuasi identifier
consumptionDECIMAL(12,3)YesQuasi identifier
read_typeVARCHAR(10)Yes—
quality_flagVARCHAR(12)Yes—
MeterExchange — metering.meter_exchanges · 7 columns

Replacement of a meter at a premise by a new one (identified by its serial).

ColumnTypeRequiredSensitive classes
exchange_id (key)BIGINTYes—
old_meter_idBIGINTYes—
new_meter_serialVARCHAR(14)YesDirect identifier
premise_refVARCHAR(12)YesDirect identifier
exchanged_onDATEYes—
reasonVARCHAR(20)Yes—
final_read_valueDECIMAL(12,3)YesQuasi identifier
UtilityBill — billing.utility_bills · 9 columns

A bill for one account and billing period.

ColumnTypeRequiredSensitive classes
bill_id (key)BIGINTYes—
account_refVARCHAR(12)YesFinancial, Direct identifier
premise_refVARCHAR(12)YesDirect identifier
period_startDATEYes—
period_endDATEYes—
consumptionDECIMAL(12,3)YesQuasi identifier
amount_dueDECIMAL(12,2)YesFinancial
bill_typeVARCHAR(10)Yes—
statusVARCHAR(16)Yes—
BillPayment — billing.bill_payments · 9 columns

A payment or collection attempt against a bill.

ColumnTypeRequiredSensitive classes
payment_id (key)BIGINTYes—
bill_idBIGINTYes—
amountDECIMAL(12,2)YesFinancial
paid_atTIMESTAMPYes—
methodVARCHAR(16)Yes—
payer_ibanVARCHAR(34)NoFinancial, Direct identifier
mandate_referenceVARCHAR(20)NoFinancial, Direct identifier
statusVARCHAR(10)Yes—
failure_reasonVARCHAR(24)No—
PaymentArrangement — billing.payment_arrangements · 7 columns

An instalment plan agreed for an account in arrears.

ColumnTypeRequiredSensitive classes
arrangement_id (key)BIGINTYes—
account_refVARCHAR(12)YesFinancial, Direct identifier
arrears_balanceDECIMAL(12,2)YesFinancial
instalment_amountDECIMAL(12,2)YesFinancial
days_in_arrearsINTYes—
start_dateDATEYes—
statusVARCHAR(10)Yes—
ServiceOrder — field.service_orders · 10 columns

A field visit to a premise and one of its meters.

ColumnTypeRequiredSensitive classes
order_id (key)BIGINTYes—
premise_refVARCHAR(12)YesDirect identifier
meter_refBIGINTYes—
order_typeVARCHAR(16)Yes—
technician_nameVARCHAR(96)YesPII, Direct identifier
scheduled_forDATEYes—
completed_atTIMESTAMPNo—
statusVARCHAR(10)Yes—
outage_refVARCHAR(12)No—
technician_notesVARCHAR(400)NoSensitive

Compatible connectors

Verified with this pack version: PostgreSQL and Local files (Parquet / CSV). 17 more connectors are compatible by capability: they support what the pack needs, but have not been verified with this pack yet.

ConnectorStatus with Energy & Utilities
Local files (Parquet / CSV)Verified with this pack
PostgreSQLVerified with this pack
Amazon S3 / S3-compatible storageCompatible by capability (not yet verified with this pack)
Apache Kafka (connector in preview)Compatible by capability (not yet verified with this pack)
Azure Blob Storage / Data Lake StorageCompatible by capability (not yet verified with this pack)
DatabricksCompatible by capability (not yet verified with this pack)
Generic SQL (SQLAlchemy)Compatible by capability (not yet verified with this pack)
Google BigQueryCompatible by capability (not yet verified with this pack)
HTTP APIs (connector in preview)Compatible by capability (not yet verified with this pack)
IBM Db2 (connector in preview)Compatible by capability (not yet verified with this pack)
Mainframe files (EBCDIC / copybook) (connector in preview)Compatible by capability (not yet verified with this pack)
MariaDBCompatible by capability (not yet verified with this pack)
Microsoft SQL ServerCompatible by capability (not yet verified with this pack)
MongoDB (connector in preview)Compatible by capability (not yet verified with this pack)
MySQLCompatible by capability (not yet verified with this pack)
Oracle DatabaseCompatible by capability (not yet verified with this pack)
Parquet filesCompatible by capability (not yet verified with this pack)
SnowflakeCompatible by capability (not yet verified with this pack)
SQLite (developer evaluation) (connector in preview)Compatible by capability (not yet verified with this pack)

Prerequisites and expected setup effort

You need

  • This pack is not in any plan yet.
  • One DataNivra agent inside your network (outbound HTTPS only) that ships Energy & Utilities 2.0.0.
  • Read-only access to a compatible source (verified with this pack: PostgreSQL, Local files (Parquet / CSV)).
  • A non-production target environment the agent may write test data to.
  • A masking key in your own secret store, referenced as vault://…, azure-kv://… or env://… (DataNivra only ever sees the reference).
  • For production sources, a second person who approves policies (separation of duties).

A DataNivra agent that reports its installed industry packs (releases after agent 0.3.0); the control plane runs a pack job only on an agent holding the exact active pack version with the catalogued integrity digest.

Expected setup effort (estimates)

StepEstimate
Try the synthetic sandbox
No install: sign up and open the sandbox.
Minutes (estimate)
Install (or reuse) the agent
One Docker command or a Helm chart; outbound HTTPS only.
Under an hour (estimate)
Connect a source
Register a read-only source through the existing connector workflow.
Under an hour (estimate)
Review and approve policies
Create drafts from the Energy & Utilities templates, review and approve them.
Under an hour (estimate)
First certified dataset
Run the first job; certification and evidence are produced automatically.
Minutes (estimate)

Certification presets in plain language

UTL_STRICT

Every gate; full masking coverage; zero orphaned accounts, meters, reads, bills, payments, arrangements or field visits; exact row counts. Default for masked utility test data.

  • Masking coverage of at least 100% of sensitive columns
  • No orphaned child records
  • Empty-value ratio may rise by at most 5%
  • Row counts must match exactly
16 gates it requires
  • POLICY_COVERAGE: every sensitive column is covered by an approved policy
  • MASKING_COMPLETION: masking finished on every covered column
  • REFERENTIAL_INTEGRITY: every reference still points at an existing record
  • SCHEMA_VALIDATION: the output schema matches the source schema
  • DATA_QUALITY: empty-value ratios stay within the preset’s drift limit
  • ROW_COUNT_RECONCILIATION: row counts match the plan within the tolerance
  • ORPHAN_DETECTION: no child record lost its parent
  • PROVENANCE: every row is tagged masked or synthetic
  • MANIFEST: a manifest lists every output table with checksums
  • POLICY_VERSION: the exact approved policy versions are recorded
  • ENGINE_VERSION: the engine version is recorded
  • CHECKSUMS: output checksums are recorded for later verification
  • IDENTITY_CONSISTENCY: linked identifiers got the same pseudonym in every system
  • SOURCE_READ_ONLY: the source was only read, never written
  • EGRESS_GUARD: no row-level data left the agent
  • CONNECTOR_HEALTH: the connectors stayed healthy during the run

UTL_SCENARIO_TESTING

Every gate, with slightly relaxed NULL-ratio drift for scenario datasets whose business states (open visits, successful collections, customers without priority services) leave optional fields empty.

  • Masking coverage of at least 100% of sensitive columns
  • No orphaned child records
  • Empty-value ratio may rise by at most 15%
  • Row counts must match exactly
16 gates it requires
  • POLICY_COVERAGE: every sensitive column is covered by an approved policy
  • MASKING_COMPLETION: masking finished on every covered column
  • REFERENTIAL_INTEGRITY: every reference still points at an existing record
  • SCHEMA_VALIDATION: the output schema matches the source schema
  • DATA_QUALITY: empty-value ratios stay within the preset’s drift limit
  • ROW_COUNT_RECONCILIATION: row counts match the plan within the tolerance
  • ORPHAN_DETECTION: no child record lost its parent
  • PROVENANCE: every row is tagged masked or synthetic
  • MANIFEST: a manifest lists every output table with checksums
  • POLICY_VERSION: the exact approved policy versions are recorded
  • ENGINE_VERSION: the engine version is recorded
  • CHECKSUMS: output checksums are recorded for later verification
  • IDENTITY_CONSISTENCY: linked identifiers got the same pseudonym in every system
  • SOURCE_READ_ONLY: the source was only read, never written
  • EGRESS_GUARD: no row-level data left the agent
  • CONNECTOR_HEALTH: the connectors stayed healthy during the run

Activation status

What is missing before you can activate the Energy & Utilities pack yourself:

  • no plan includes it yet
  • the standard agent image does not ship it
  • the control-plane catalogue does not list it
  • the hosted sandbox has no synthetic estate for it

Until then, preview it in the browser demo and download its synthetic asset bundle below.

Tell us you need the Energy & Utilities pack or request a feature for it.

Downloads

Version 2.0.0, 61 files (199.9 KB), all synthetic and generated from the pack itself. Every file’s SHA-256 is listed in MANIFEST.json.

Start here (2)
Entity–relationship diagram (2)
Sample schemas (5)
Policy templates (9)
API, CLI, SDK and CI/CD examples (10)
Synthetic sample data (CSV, JSON, Parquet) (31)

Troubleshooting

The reason codes you can meet on the way, with the recovery step. Every code is also in the error-code catalog.

SANDBOX_PACK_NOT_OFFERED — Synthetic estate not offered
A requested synthetic estate (industry pack) is not available in the hosted sandbox. What to do: Start the sandbox with the default estates.
ENTITLEMENT_REQUIRED — Plan does not include this
Your plan does not include this feature or industry pack. What to do: Upgrade in Billing & Plan.
PACK_INTEGRITY_UNVERIFIED — Pack integrity not verified
This pack version was registered without an integrity digest, so it cannot be activated (fail closed). What to do: Ask your operator to re-register the pack catalogue with the current control-plane image (register-pack), then activate again.
PACK_DEPENDENCY_INACTIVE — Required pack not active
This pack depends on another industry pack that is not active for your organization. What to do: Activate the packs this pack depends on first, then activate it again.
AGENT_PACK_MISSING — No agent can run this industry pack
The job's agent does not report the pack (older agents report no packs at all), so the job was not sent. What to do: Upgrade the agent to a release that reports its installed packs and ships this pack, then run the request again.
AGENT_PACK_VERSION_INCOMPATIBLE — Industry pack version differs on the agent
The agent holds a different version of the pack than the one the job was approved for. What to do: Deploy an agent with the pack's active version, or roll the pack back in Industry packs.
AGENT_PACK_INTEGRITY_MISMATCH — Agent pack differs from the catalogue
The agent reports the pack's version with a different integrity digest than the catalogued one, so the job was not sent. What to do: Redeploy the agent from the official signed image for this release, then run the request again.
PACK_TEMPLATES_UNAVAILABLE — Pack templates not registered
This pack version was registered without its policy templates. What to do: Ask your operator to re-register the pack catalogue (register-pack); create policies manually meanwhile.
PACK_TEMPLATE_KEY_REF_REQUIRED — Masking key reference required
A selected template keeps identities linked across systems and needs your masking key reference. What to do: Provide key_ref, e.g. vault://your-vault/tdm-masking-key, then create the drafts again.
PACK_NOT_ENABLED — Industry pack not enabled
The industry pack is not enabled for this tenant. What to do: Enable the pack (if your plan includes it).

Frequently asked questions

Are the Energy & Utilities records on this page real?
No. Every record on this page is synthetic, generated from a fixed seed by the pack's own generator; masked values come from the real masking engine. The masking example uses a fixed public sample key; your own data is masked with a key from your secret store.
Can I activate the Energy & Utilities pack myself?
This pack is installed and passes DataNivra’s pack conformance kit through the real engine, but it cannot be activated yet: no plan includes it yet, the standard agent image does not ship it, the control-plane catalogue does not list it and the hosted sandbox has no synthetic estate for it. You can explore its synthetic records, masking and scenarios on this page and in the browser demo. Tell us if you need it: demand decides which packs become activatable next.
Which databases and files does the Energy & Utilities pack work with?
Verified with this pack version: PostgreSQL and Local files (Parquet / CSV). 17 more connectors are compatible by capability: they support what the pack needs, but have not been verified with this pack yet.
How long does a first certified Energy & Utilities dataset take?
Estimates, not guarantees — try the synthetic sandbox: minutes; install (or reuse) the agent: under an hour; connect a source: under an hour; review and approve policies: under an hour; first certified dataset: minutes.
Which test scenarios does the Energy & Utilities pack include?
10 runnable scenarios (everyday supply, estimated reads, customers in arrears, meter exchanges and more), plus 1 negative-test scenario kept apart from valid data.
Do Energy & Utilities rows leave my network?
No. The DataNivra agent runs inside your environment: it reads the source, masks, subsets, generates and certifies there, and sends only metadata, aggregate counts and evidence to the DataNivra control plane (customer-resident processing, zero raw-production-data egress).

Learn the concepts, then come back to activate

Regulatory context

The Energy & Utilities pack covers data that laws and industry rules often treat as sensitive. It supports your privacy and governance programmes by keeping those records inside your environment and producing certification evidence; it does not, by itself, make any system or organisation compliant with any law, regulation or standard.

Everything on this page works without an account. Prefer a conversation? Request a demo (optional). Missing something? Request a feature.