Evidence / Evidence Tables

Evidence Tables

Evidence tables for enterprise data architecture claims. Six core theses with counter-arguments, failure signals, recommended patterns, and target outcomes.

This section of the guide deals in three kinds of evidence, and every page says which it is using. Published sources: regulatory text, cloud architecture guidance, and specifications, cited where used. Practitioner observation: recurring failure patterns and review findings from inside large regulated enterprises, stated as experience rather than measurement. Illustrative application: composite cases, worked ADRs, and target ranges that show the frameworks in use. None of it is presented as audited outcomes, and the distinction is the point: a guide that blurs these categories cannot be trusted on any of them.

For each major thesis in this guide, the tables below show the claim, why teams believe the opposite, what breaks, how to detect the problem, the recommended pattern, and what good looks like. The last row of each table is a target to hold your platform to, not a reported result. Provenance: author position, informed by practitioner observation.


Claim 1: EDP and operational platforms have fundamentally different design goals

DimensionDetail
ClaimEDP and operational platforms have fundamentally different design goals.
Why teams believe the opposite”One platform is simpler, cheaper, and avoids data silos.”
What breaksOperational workloads get analytical SLAs. Analytical workloads compete for capacity with operational queries. Cost model becomes unpredictable.
Signal to detectSLA breaches on queries that should be sub-second. Platform team firefighting operational issues. Analytical reports delayed by operational load.
Recommended patternSeparate platforms with well-defined integration (events, APIs, feature serving). See Target-State Architecture.
What good looks likeOperational p99 latency in the tens of milliseconds. Analytical query performance unaffected by operational load. Most platform team time on planned work.

Claim 2: Bronze/silver/gold is a data refinement pattern, not a business process layer

DimensionDetail
ClaimBronze/silver/gold is a data refinement pattern, not a business process layer.
Why teams believe the oppositeLayer names sound like workflow stages (raw/validated/approved).
What breaksBusiness logic embedded in dbt models. Process changes require pipeline changes. No human task model.
Signal to detectdbt models contain business rules. Teams request “hold/release” logic in transformation layer. Exception handling is “rerun the pipeline.”
Recommended patternWorkflow engine for business process, EDP for data refinement. See Anti-Pattern #2.
What good looks likeBusiness process changes deploy independently from data pipeline changes. Exceptions route to a workflow queue instead of pipeline reruns.

Claim 3: “Just query the lakehouse from the model” breaks at production scale

DimensionDetail
Claim”Just query the lakehouse from the model” breaks at production scale.
Why teams believe the oppositeData is already in the lakehouse, seems efficient to query directly.
What breaksQuery costs explode. Compute contention with analytics users. Latency orders of magnitude too slow for inference. No feature reuse.
Signal to detectML serving latency >1s. Lakehouse compute costs spike during inference. Same features recomputed for every model.
Recommended patternFeature store (offline from EDP, online for serving). See AI/ML Platform Relationship.
What good looks likeInference latency in the tens of milliseconds. Feature compute costs shared across models. Lakehouse compute stable.

Claim 4: Data contracts are not optional

DimensionDetail
ClaimData contracts are not optional.
Why teams believe the opposite”We trust our upstream teams” or “contracts slow us down.”
What breaksSchema changes break downstream consumers without warning. Quality degrades silently. No one knows who owns what.
Signal to detectDownstream pipeline failures caused by upstream schema changes. Multiple teams producing conflicting versions of the same metric. “Who owns this table?” has no answer.
Recommended patternFormal contracts with schema, quality, SLA, ownership, evolution rules. See Data Contracts.
What good looks likeNear-zero unplanned downstream breakages from schema changes. Data owner identifiable in minutes via the catalog.

Claim 5: Compliance is an architecture feature, not a bolt-on

DimensionDetail
ClaimCompliance is an architecture feature, not a bolt-on.
Why teams believe the opposite”We’ll add compliance controls after we build the platform.”
What breaksAudit preparation takes weeks/months. Lineage gaps make regulatory submissions unreliable. Retrofitting access controls disrupts existing consumers.
Signal to detectRegulatory audit preparation >2 weeks. “Where did this number come from?” requires manual investigation. Access reviews reveal over-provisioned accounts.
Recommended patternLineage, quality gates, column-level security, audit logging designed in from day one. See Compliance Overview.
What good looks likeAudit preparation measured in days. End-to-end lineage from source to report automated. Access reviews automated quarterly.

Claim 6: Most enterprises need centralized platform with federated ownership, not pure data mesh

DimensionDetail
ClaimMost enterprises need centralized platform with federated ownership, not pure data mesh.
Why teams believe the oppositeData mesh promises domain autonomy and reduced bottlenecks.
What breaksDomains produce incompatible products. No cross-domain analytics. No centralized governance. Compliance unverifiable.
Signal to detectCross-domain queries require manual joins across systems. Data quality varies wildly by domain. Central team cannot answer regulatory questions.
Recommended patternCentral EDP with self-serve tooling, domain-owned schemas and contracts, centrally defined governance. See Data Mesh.
What good looks likeCross-domain analytics delivered in weeks, not months. Data product discoverability from tribal knowledge to searchable catalog.

Using this framework for an architecture review or a target-state design? Start with the review checklists, open an issue on GitHub, or reach the author at sunil@sunilprakash.com.

Search the guide