Skip to main content
Data Platform

What Skills Do You Need on Your Team to Run a Data Lakehouse?

The lakehouse is built; now who runs it? The honest answer for a mid-market business is fewer specialists than the vendor implies and more ownership than they admit — and the roles that matter are not the ones on the architecture diagram.

Amit Kumar Singh - Technology Consulting Partner at MyData Insights

Technology Consulting Partner · MyData Insights

14+ years in industrial data · Former Accenture & EY · India, GCC, SEA

16 September 2026 · 9 min read

The bottom line

Running a data lakehouse does not require the large specialist team vendors imply, but it does require ownership that many mid-market businesses underestimate. The essential capabilities are a data platform engineer (to maintain pipelines and the model), a semantic-model and BI owner (to keep the governed model and reports trustworthy), and a named business data owner per domain (to own definitions and priorities). On a governed Microsoft platform your existing IT skills cover much of it, and a fractional or partner-supported model can fill the specialist gaps — but the ownership cannot be outsourced.

The Question After Go-Live

The lakehouse project has a clear owner while it is being built. The harder question, and the one that decides whether the investment lasts, comes at go-live: who runs it now. A platform nobody owns degrades — pipelines break and are not fixed, the model drifts, definitions fork, and within a year the business is back to spreadsheets with an expensive lakehouse gathering dust.

Two myths distort the answer. Vendors imply you need a large team of specialists — data engineers, scientists, architects — which frightens mid-market businesses out of building at all. And optimists imply the platform runs itself, which is how it degrades. The truth is in between: fewer people than the vendor implies, more ownership than the optimist admits.

What you actually need is a small set of capabilities and, above all, clear ownership. The roles that matter are not the exotic ones on the architecture diagram.

Two myths: that you need a big specialist team (frightens mid-market out of building) and that the platform runs itself (how it degrades). The truth is fewer people than the vendor implies, more ownership than the optimist admits.

The Platform Engineer

The first essential capability is a data platform engineer — the person who keeps the pipelines running and the platform healthy. When a source changes, a load fails, or a new data source needs connecting, this is who handles it. On a Microsoft estate, this is Fabric, Data Factory, OneLake and the pipeline layer — and importantly, these are Microsoft skills your existing IT or BI team may already have or can readily build.

This does not have to be a dedicated hire in a mid-market business. It is often an existing IT or BI person who takes on the platform as part of their remit, supported by training and by a partner for the harder problems. The key is that someone owns pipeline health and platform maintenance as a named responsibility, not that you have hired a data-engineering specialist.

The failure mode is nobody owning it — the pipelines built by the project team break after handover and there is no one whose job it is to fix them. Assigning that ownership is more important than the seniority of the person who holds it.

The Semantic-Model and BI Owner

The second capability is ownership of the semantic model and the reporting on top of it. This is the person who keeps the governed model trustworthy — who owns the measure definitions (OEE, OTIF, margin), applies changes properly rather than letting analysts fork them, manages row-level security and the report estate, and is the point of accountability for "is this number right."

This is a Power BI and modelling skill, and again it is often an existing BI analyst elevated to own the governed model rather than a new specialist. The shift is from building lots of reports to stewarding one governed model that everything reads from — a different discipline, but a learnable one for a capable BI person.

This role is what prevents the slow drift back to chaos: without a model owner, every analyst builds their own version of margin and the governed model erodes. With one, the model stays the single source of truth long after go-live.

The model owner keeps the governed model trustworthy — one definition of every measure, changes applied properly, accountability for "is this number right." Without it, analysts fork the model and it erodes back to chaos.

The Business Data Owner

The third capability is the one most often missed, and it is not a technical role at all: a named business data owner for each domain. This is the operations or finance leader who owns what the numbers mean and what the priorities are — who decides how OTIF is defined for the business, which data problems matter most, and whether a new requirement is worth building.

Without this, the technical team makes business decisions by default — defining metrics in a vacuum, prioritising by whoever shouts loudest — and the platform drifts from what the business actually needs. The business data owner keeps the lakehouse aligned to operations, because they own the meaning and the priorities that the engineers and the model owner then implement.

This role cannot be outsourced and does not require technical skill; it requires business authority and engagement. It is the ownership half of "more ownership than the optimist admits" — and it is where mid-market lakehouse investments most often quietly fail, not for lack of engineering but for lack of a business owner.

Where a Fractional Model Fits

For a mid-market business, the gap is usually not the business owner or the everyday platform maintenance — it is the specialist depth for the harder problems and the senior data leadership to set direction. Hiring a full-time senior data architect or a chief data officer is often more than the business needs or can justify.

This is where a fractional model fits: a fractional data consultant or fractional Chief Data Officer provides the senior direction, the architecture decisions, and the specialist support for the hard problems, part-time, alongside your internal platform engineer and model owner who handle the day-to-day. The business gets senior capability without a senior full-time cost, and the internal team is supported rather than left to sink or swim.

The combination that works for most mid-market businesses is: internal ownership of platform, model and business definitions, plus fractional senior and specialist support. That covers the capability without the headcount the vendor implied you would need.

So What — the Honest Staffing

Running a data lakehouse needs three capabilities and a lot less exotic headcount than the vendor diagram suggests: a platform engineer (often an existing IT/BI person) to keep it healthy, a semantic-model owner to keep the governed model trustworthy, and a named business data owner per domain to own definitions and priorities. On a Microsoft estate the first two are largely existing skills; the third is business authority, not technical skill.

What cannot be skipped is ownership. The platform degrades not for lack of a data-science team but for lack of someone whose job it is to own each layer. And what does not need to be hired full-time is senior direction and specialist depth — a fractional model covers that alongside the internal owners.

So the honest answer to "what skills do I need" is: fewer specialists than you fear, more ownership than you expect, and a fractional partner for the senior gap. That is a team a mid-market business can actually field — which is the point of building on a governed platform in the first place.

Fewer specialists than you fear, more ownership than you expect, and a fractional partner for the senior gap. Platform engineer, model owner, business data owner — that is a team a mid-market business can actually field.

If your lakehouse is built but you are unsure who runs it — or the vendor implied a team you cannot justify — that staffing question is worth getting right. 30 minutes with Amit on your team — the ownership you need internally, and where a fractional model covers the senior gap. No slides. No pitch deck. No obligation to proceed.

Free Assessment

Where does your operation sit on the data maturity curve?

8 questions. 3 minutes. You get a scored breakdown across data infrastructure, analytics readiness, and automation potential — with a specific next step for your industry.

Data PlatformMicrosoft FabricLakehouseTeamFractional CDOGovernance

Your Data · Our Technology · Our Automation

Get practical insights every fortnight

Amit writes about Microsoft Fabric, Power BI, AI in operations, and digital transformation for manufacturing and supply chain leaders. Practitioner perspective - no fluff, no vendor spin.

No spam. Unsubscribe any time. Also on Substack.

FAQ

Common questions

What skills do you need to run a data lakehouse?

Three capabilities: a data platform engineer to keep pipelines and the platform healthy (often an existing IT or BI person on a Microsoft estate, not a new specialist); a semantic-model and BI owner to keep the governed model and reports trustworthy; and a named business data owner per domain to own what the numbers mean and which priorities matter. The first two are largely existing Microsoft skills; the third is business authority rather than technical skill. Ownership matters more than exotic headcount.

Do you need a big data team to run a lakehouse?

No. Vendors imply a large team of specialists, which frightens mid-market businesses out of building, but the reality is fewer people and more ownership. On a governed Microsoft platform, existing IT and BI skills cover much of the day-to-day, and specialist depth plus senior direction can come from a fractional or partner model. What you cannot skip is clear ownership of each layer — the platform degrades for lack of an owner, not for lack of a data-science team.

What is the most commonly missed role in running a lakehouse?

The business data owner — a named operations or finance leader who owns what the numbers mean and what the priorities are for each domain. It is not a technical role and cannot be outsourced; it requires business authority and engagement. Without it, the technical team defines metrics in a vacuum and prioritises by whoever shouts loudest, and the platform drifts from what the business needs. This is where mid-market lakehouse investments most often quietly fail.

When does a fractional CDO make sense for running a lakehouse?

When you need senior data leadership and specialist depth for the hard problems but cannot justify a full-time senior architect or chief data officer — which is most mid-market businesses. A fractional data consultant or fractional CDO provides direction, architecture decisions and specialist support part-time, alongside internal owners handling platform, model and business definitions day to day. You get senior capability without the senior full-time cost, and the internal team is supported rather than left to sink or swim.

Related FAQs

Questions operations leaders ask

Continue Reading

Related Articles

Data Platform

Microsoft Fabric vs a Legacy BI Stack (SSIS + SSAS + Power BI): The Migration Case

The most common estate I walk into is not a mess. It is an on-premises SQL Server, a set of SSIS packages built between 2014 and 2019, one or two SSAS cubes, and Power BI bolted on the front. It runs. Finance closes on it. The reason I get called is a symptom — the person who wrote the packages left, the overnight batch now finishes at 07:20 and the plant meeting is at 07:30. "It is old" is not a business case.

16 min read

Data Platform

Microsoft Fabric vs SAP Datasphere: Which One Do You Actually Need

The SAP account team says the analytics answer is SAP Datasphere, because that is where the business semantics already live. Two weeks later the Microsoft team says Fabric, because that is where Power BI, the MES extracts and the 3PL feeds already live. Both are internally consistent, and neither mentions the other except to dismiss it. The IT Head is asked to pick, and picks badly — because the two products solve different halves of one problem.

16 min read

Data Platform

The Hidden Costs of a Microsoft Fabric Migration Nobody Tells You About

The awkward conversation happens in month five, not month one. The platform works. The first three reports are live. Then the finance business partner circulates the actual run-rate against the approved business case, and the number is 30–50% over — not because the partner overran, but because six or seven cost lines were never in the case at all. I sell Fabric implementations. This names the costs my own proposals have to cover.

15 min read

Want to see how MDI solves this in your industry? Explore industry solutions

Is this the challenge you're facing?

Book a 30-minute call. We'll look at your specific operation and tell you what's achievable - plainly and without slides.