Compliance / Overview

Regulatory Compliance Patterns for Data Platforms

Regulatory compliance patterns for data platforms. Cross-industry matrix mapping BCBS 239, DORA, HIPAA, and Solvency II to platform design decisions.

Executive Summary

  • Maps regulatory requirements to platform design choices, not to specific cloud controls.
  • Industries covered: banking (BCBS 239, DORA), healthcare (HIPAA), insurance (Solvency II, IFRS 17), plus the cross-industry EU AI Act.
  • The EDP’s append-only, historized, lineage-tracked design satisfies many requirements that operational platforms struggle with. Compliance here is an architecture feature, not a bolt-on audit exercise.
graph TB
    subgraph "Regulatory Requirements"
        REG[Regulators<br/>BCBS 239 · DORA · HIPAA · Solvency II]
    end

    subgraph "Platform Design Decisions"
        LIN[Lineage<br/>Source to report]
        QUA[Quality Gates<br/>Per medallion layer]
        ACC[Access Control<br/>Column / row level]
        RET[Retention<br/>Policy-driven lifecycle]
        AUD[Audit Trail<br/>Query + access + change]
        RES[Data Residency<br/>Region-specific deployment]
    end

    subgraph "Evidence Artifacts"
        E1[Lineage reports]
        E2[Quality dashboards]
        E3[Access reviews]
        E4[Retention logs]
        E5[Audit exports]
    end

    REG --> LIN
    REG --> QUA
    REG --> ACC
    REG --> RET
    REG --> AUD
    REG --> RES

    LIN --> E1
    QUA --> E2
    ACC --> E3
    RET --> E4
    AUD --> E5

Cross-Industry Compliance Matrix

Regulators across industries ask surprisingly similar questions. The specifics differ (BCBS 239 cares about risk data aggregation, HIPAA cares about protected health information), but the underlying architectural demands converge. This matrix maps common regulatory themes to the platform design decisions that satisfy them.

Regulatory ThemeWhat Regulators WantPlatform Design DecisionWhich Layer
Data lineageTrace any number to its sourceEnd-to-end lineage from source to consumptionCross-cutting
Data qualityAccurate, complete, timely dataQuality gates at bronze/silver/gold boundariesLayer 4 (EDP)
Access controlLeast privilege, audit trailColumn/row-level security, IAM policiesCross-cutting
Data retentionKeep data for mandated periodsTiered storage with retention policiesLayer 4 (EDP)
Right to deleteGDPR Article 17 complianceSoft delete with audit trail in append-only modelLayer 4 (EDP)
Audit trailWho accessed what, whenQuery logging, access auditingCross-cutting
Data residencyData stays in mandated geographyRegion-specific deployment, cross-region restrictionsInfrastructure
Incident reportingReport breaches within mandated timeframesMonitoring, alerting, incident workflowsCross-cutting
Third-party riskManage vendor and outsourcing riskVendor assessment, contract requirementsGovernance
Business continuityRecover from failuresBackup, DR, multi-region redundancyInfrastructure
AI training data governanceProvenance, representativeness, bias examination (EU AI Act Art. 10)Versioned datasets, lineage, quality gates, documented compositionLayer 4 (EDP) + cross-cutting

Notice that most themes map to cross-cutting concerns or Layer 4 (the EDP itself). This is not a coincidence. Regulators care about data governance, and governance is the EDP’s primary job.

How EDP Design Satisfies Compliance

The EDP is not compliant by accident. Its core design properties align with what regulators have been asking for decades.

Append-only storage. Regulators want to know what data looked like at a point in time. An append-only model preserves every version of every record. You never have to explain why you overwrote something, because you did not overwrite anything. This directly satisfies audit trail, data retention, and right-to-delete requirements (soft delete with a tombstone record, full history preserved).

Historized data model. Slowly changing dimensions, snapshot tables, and temporal joins are not just analytical conveniences. They are regulatory necessities. When a regulator asks “what was this customer’s risk rating on March 15,” you need the answer without reconstructing it from transaction logs.

End-to-end lineage. Every transformation from source to consumption layer is tracked, versioned, and queryable. This is the difference between telling a regulator “we think this number came from system X” and showing them a lineage graph that proves it.

Governed access model. Column-level security, row-level filtering, and role-based access are built into the platform layer, not bolted on per report. When an auditor asks who can see customer social security numbers, the answer is a policy query, not a spreadsheet maintained by hand.

Quality gates at layer boundaries. Data quality checks at bronze-to-silver and silver-to-gold transitions catch issues before they propagate to regulatory reports. A failed quality gate stops bad data from reaching consumption, which is far better than discovering the problem during a regulatory examination.

Industry-Specific Guides

Each industry has unique regulatory requirements that go beyond the common themes above. These guides map specific regulations to platform design decisions:

  • Banking: BCBS 239 and DORA: risk data aggregation, reporting accuracy, digital operational resilience
  • Healthcare: HIPAA: protected health information, minimum necessary standard, breach notification
  • Insurance: Solvency II: risk capital reporting, data quality for actuarial models, regulatory submissions
  • EU AI Act: data governance and record-keeping obligations for high-risk AI systems, applicable from August 2026

Compliance vs Implementation

This guide covers design decisions: the architectural choices that determine whether a platform can satisfy regulatory requirements regardless of which cloud or technology stack you deploy on.

For implementation-specific patterns (GCP controls, CMEK encryption, VPC Service Controls, audit logging configuration), see reference-data-platform-gcp. That repo translates the design decisions documented here into concrete infrastructure-as-code and cloud-native controls.

The separation is deliberate. Design decisions are stable across cloud providers and survive technology migrations. Implementation details change when you switch from GCP to Azure, or when a cloud provider deprecates a service. Keep the two concerns separate, and your compliance posture survives platform evolution.

Using this framework for an architecture review or a target-state design? Start with the review checklists, open an issue on GitHub, or reach the author at sunil@sunilprakash.com.

Search the guide