Skip to main content
Data Architecture

How to Build a Data Lakehouse in 8 Steps (2026 Build Guide)

The programmes I am asked to rescue are rarely wrong about the architecture. They are wrong about the order. Invert two steps and you pay for the same work twice. The eight-step build sequence, with the entry and exit condition for each and what a six-week first slice really covers.

Amit Kumar Singh - Technology Consulting Partner at MyData Insights

Technology Consulting Partner · MyData Insights

14+ years in industrial data · Former Accenture & EY · India, GCC, SEA

20 August 2026 · 13 min read

The bottom line

Build a data lakehouse in eight steps, in order: name the decision and metric; inventory and profile sources with real access; design workspace and security topology; land Bronze with replayability; resolve master data and agree metric definitions in writing; build Silver with data-quality constraints; model Gold and the semantic layer with a final reconciliation; then serve, monitor and retire the legacy report. Steps 1 and 5 are the ones most often skipped and the ones that decide whether the programme lands. A first governed slice — one decision, one metric, one or two sources — is realistic in six weeks when access is genuinely available in week one; 8–12 weeks when it is not.

They are rarely wrong about the architecture — they are wrong about the order

The programmes I am asked to rescue are rarely wrong about the architecture. They are wrong about the order. Order is the whole discipline: invert two steps and you pay for the same work twice.

This is the build sequence — eight steps, each with an entry condition (what must be true before you start) and an exit condition (what "done" actually means). The sequence is not arbitrary: steps 1 and 5 are the ones most often skipped and the ones that decide whether the programme lands.

What is the right order to build a data lakehouse?

StepEntry conditionExit condition ("done")
1. Name the decision and metricA named operating owner will take the meetingOne decision, one metric, one baseline value, signed by that owner
2. Inventory sources, secure real accessStep 1 metric fixes which systems are in scopeWorking credentials, a profiled row count and null rate per table, change-capture method confirmed
3. Design the topologySource and consumer lists are stableWorkspace, domain, environment and role map approved; Git and pipeline connected; no data items yet
4. Land Bronze with replayabilityTopology exists; credentials workEvery source reloadable from origin, with load timestamp and lineage on every row
5. Resolve master data, agree definitionsBronze holds real records to argue overWritten definitions with named owners; survivorship rules; a signed metric specification
6. Build Silver with data-quality constraintsMetric definitions signedConformed entities, deduplicated, incremental, constraint violations counted
7. Model Gold and the semantic layerSilver stable for a full period; grain declaredDirect Lake model reconciled to source for a closed period, variance explained line by line
8. Serve, monitor, retire the legacy reportReconciliation acceptedLegacy report switched off on a dated decision; usage, capacity and freshness monitored

Steps 1–3: name the decision, inventory sources, design topology

Step 1 — name the decision that changes and the metric that proves it. Interview the operating owner, not IT, and write one sentence: "we currently decide X on Y evidence, at Z frequency, and we want better evidence." Done is one page: one decision, one metric, one baseline number, one named owner, one review date. The most common failure is accepting "we need better visibility" as a decision — it cannot be tested, so nothing can ever be declared finished.

Step 2 — inventory the sources and secure real access. Get a real connection to SAP, Business Central, the WMS or the MES, and profile the actual data — Power Query's profiling defaults to the first 1,000 rows, so switch to "based on entire data set" because the first 1,000 rows of a sorted extract lie. Done is, per in-scope table: row count, null rate on join keys, distinct count on the business key, date range, confirmed change-capture method. The failure is access granted on paper only — a ticket says the service account exists; nobody has connected with it.

Step 3 — design the topology before you create a single item. Draw the workspace, domain, environment and role map; choose the Git provider and branching model (each workspace connects to one branch, so parallel development needs parallel workspaces). Done is an approved topology diagram, workspaces created and empty, Git connected, pipeline defined, roles assigned to security groups not individuals. The failure is building in one workspace "for now" — splitting layers later means moving items, reissuing permissions and repointing shortcuts, a fortnight that buys nothing visible.

Steps 4–6: Bronze, master data, Silver

Step 4 — land Bronze with replayability and source fidelity. Build ingestion and keep the original payload; Bronze holds no business rules, no deduplication, no renamed columns. Done is every source loading on schedule, a replay procedure documented and executed at least once, row counts reconciling to source. The failure is cleaning on the way in — trim whitespace and cast a date in Bronze and you can never prove what the source sent, the first step towards a data swamp with better branding.

Step 5 — resolve master data and agree metric definitions in writing. This is the critical path. Put the four versions of the same customer on a screen in front of the people who own them and agree which record wins; convert the Step 1 metric into a written specification — inclusions, exclusions, grain, time basis. This step needs Bronze loaded, because people concede a definition when looking at their own bad data and not before. Done is a signed specification and a mapping table per conformed entity — signed meaning a name and a date. The failure is deferring it to "the data quality workstream" and building Gold anyway; every measure built before definitions are agreed is rework.

Step 6 — build Silver with data-quality constraints and incremental processing. Apply the Step 5 rules in code: type casting, deduplication, referential integrity, UOM standardisation, master-data conformance — processed incrementally, with constraints declared in the pipeline (ON MISMATCH DROP or FAIL) not checked afterwards in a report. Done is incremental loads inside the schedule window, constraint-violation counts trended, an owner per rule. The failure is one Silver table per report request — that recreates the silo, invisible until the fourteenth table.

Step 5 is the critical path and cannot be compressed by tooling. Master-data conformance is an organisational agreement rendered in code — it needs Bronze loaded so people argue over their own real data.

Steps 7–8: model Gold, reconcile, then retire the legacy report

Step 7 — model Gold, build the semantic layer, and reconcile. Declare the grain as a sentence ("one row per delivery line per confirmation event") and refuse any measure that does not work at it; build the Direct Lake model and reconcile to the source system for a closed period. Reconciliation is a deliverable, not a test — a variance sheet finance signs, explaining every difference line by line. Where the numbers differ because the old report was wrong, say so. The failure is declaring victory on "close enough" — a 0.4% unexplained variance is not a rounding issue to a CFO, it is a reason to keep the old report.

Step 8 — serve, monitor, and retire the legacy report. Roll out with training, instrument capacity, freshness and adoption, and switch off the report the new one replaces. Retirement is the step that determines whether the programme succeeded. Never retire before the replacement is reconciled — that is how a programme loses its sponsor. Done is the legacy report switched off on a dated decision, usage of the new asset trending up, the Step 1 metric re-measured against its baseline. The failure is that nobody senior will make the retirement call, so both run in parallel indefinitely.

What a six-week first slice actually covers

Six weeks is an honest effort range for one decision, one metric and one to two source systems — not a guarantee, and not a full estate.

WeekSteps in playWhat is deferred
11 & 2 — decision, metric, baseline; source access and profilingAll sources not touching the Step 1 metric
23 & 4 — topology, Git, pipeline, first Bronze loadsMulti-domain topology; production capacity sizing
34 & 5 — Bronze complete and replayable; master-data workshops beginEnterprise MDM tooling; full survivorship
45 & 6 — definitions signed; Silver built for in-scope entitiesConstraint coverage beyond the in-scope entities
57 — Gold model, Direct Lake, first reconciliation passRow-level security beyond the pilot group
67 & 8 — reconciliation accepted, rollout to pilot, monitoring liveLegacy retirement (scheduled 2–4 weeks after acceptance)

The caveat: six weeks holds when Step 2 finds working credentials in week one and Step 5 has a decision-maker who will sign. Where a source needs a BASIS change window, or master-data ownership is genuinely contested, the realistic range stretches to 8–12 weeks for the same scope.

Where this breaks, and what it does not fix

Step 5 cannot be compressed by tooling — master-data conformance is an organisational agreement rendered in code. Some decisions are cheap only in Step 4 — change data feed is not retrospective, and mirrored or shortcut data stays read-only. A six-week slice does not size a production capacity — pilot consumption says little about 200 users hitting a Direct Lake model at 08:30 on a Monday.

Step 8 depends on authority you may not have — if the legacy report's owner outranks the programme sponsor, retirement does not happen and the build becomes an expensive second opinion. And this sequence assumes one decision at a time — four parallel first slices to please four departments dilute the same engineers across four Step 5 arguments, and all four slip.

What to do first

Answer these four this week, in writing:

  • Which single operating decision changes if this data arrives daily instead of monthly — and who owns that decision?
  • What is the current value of the metric that proves it, measured today, however imperfectly?
  • Has anyone actually connected to each in-scope source with the service account, or does a ticket merely say it exists?
  • Who has authority to switch off the report this replaces, and will they commit to a date before the build starts?

If the fourth question has no name against it, fix that before writing a line of code. We run these builds on Microsoft Fabric, OneLake and Power BI, with the reconciliation treated as a deliverable, not a test.

The order is the discipline: name the decision (Step 1) and resolve master data with signed definitions (Step 5) before you build Gold, and reconcile before you retire. Skip either and you pay twice. Book a diagnostic with Amit — no slides, no pitch deck, no obligation to proceed. First value in six weeks: one decision, one metric, one reconciled slice.

Free Assessment

Where does your operation sit on the data maturity curve?

8 questions. 3 minutes. You get a scored breakdown across data infrastructure, analytics readiness, and automation potential — with a specific next step for your industry.

Data ArchitectureLakehouseMicrosoft FabricBuild GuideMedallion

Your Data · Our Technology · Our Automation

Get practical insights every fortnight

Amit writes about Microsoft Fabric, Power BI, AI in operations, and digital transformation for manufacturing and supply chain leaders. Practitioner perspective - no fluff, no vendor spin.

No spam. Unsubscribe any time. Also on Substack.

FAQ

Common questions

How long does it take to build a data lakehouse?

A first governed slice — one decision, one metric, one or two source systems, Bronze through Gold with a reconciled semantic model — is realistic in six weeks when source access is genuinely available in week one. Where credentials need a change window or master-data ownership is contested, 8–12 weeks is the honest range.

What is the first step in building a data lakehouse?

Naming one operating decision the platform must change and one metric that proves it changed, with its current baseline value and a named operating owner. Not architecture, not tooling, not source inventory — without a named decision there is no exit criterion for the programme.

Which step do lakehouse projects most often skip?

Master-data resolution and written metric definitions — Step 5. It is slow, political and produces no demonstrable artefact, so teams defer it and build Gold anyway, then discover the rework in UAT when the one person whose number does not match finds it.

Should I design workspaces before or after loading data?

Before. Fabric workspace roles, domain assignment, Git branching and the deployment pipeline shape are all far easier to set once than to change later — splitting layers across workspaces after go-live means moving items and repointing shortcuts.

Do I need to retire the old report?

Yes, and it should be a named step with a dated decision and an owner. Running the legacy report alongside the new one indefinitely gives the organisation two numbers and a recurring reconciliation meeting — and quietly loses the sponsor.

How do I prove the lakehouse numbers are right?

Reconcile to the source system for a closed period and produce a variance sheet that itemises and explains every difference, accepted in writing by the finance or operations owner. Treat it as a deliverable rather than a test.

Is this the challenge you're facing?

Book a 30-minute call. We'll look at your specific operation and tell you what's achievable - plainly and without slides.