Skip to main content
Enterprise Data Integration

Your Data Is Already There.
It Just Needs to Connect.

ETL & Data Integration on Microsoft Fabric — SAP, Dynamics 365, NetSuite

MDI builds a real-time data integration platform on Microsoft Fabric — connecting SAP, ERP, IoT, cloud, and on-premise systems into a single governed data pipeline. SAP data integration consulting, ERP migration, and live operational feeds. No batch lag. No brittle ETL.

Book a Free Integration ReviewSee the Fabric Platform

30+

Source Systems Integrated

14+

Years of Integration Work

<1m

Real-Time Data Latency

0

Custom ABAP Required

REAL-TIME

Real-Time Data Integration

The Problem

Your operational data — sensor readings, production counts, despatch confirmations — lands in the lakehouse hours after the event. By the time a dashboard refreshes, the shift manager has already made the decision on gut feel. The data that should have driven the decision is still sitting in a batch queue.

What We Build

We implement Fabric Eventstream and Azure Event Hubs to capture operational data as it happens — sub-second latency from IoT sensor, SCADA, MES, or any streaming source into OneLake. No batch window. No scheduled refresh. The platform is always current.

Fabric Eventstream for IoT and SCADA data
Azure Event Hubs integration into OneLake
KQL Database for time-series operational data
OPC-UA and MQTT connector setup
Real-time alert rules via Fabric Activator
Live Power BI dashboards with sub-minute refresh
<1m

Data latency from production floor to dashboard

24/7

Continuous integration — no nightly batch windows

80%

Exception alerts automated, zero manual triage

Book a Discovery CallView Case Studies
SAP & ERP

SAP & ERP Data Integration

The Problem

SAP sits at the centre of your business — purchasing, production orders, financial postings, stock movements. But getting that data into your analytics layer cleanly is where most integrations fail. OData feeds timeout. BAPIs need custom ABAP. Direct database connections violate SAP licensing. The result is a reporting environment that's perpetually three steps behind the ERP.

What We Build

MDI has production SAP integration experience across SAP Business ByDesign, SAP S/4HANA, SAP ECC, and Oracle ERP. We connect using certified OData V4 APIs, Fabric Mirroring, or Azure Data Factory SAP connectors — whichever fits your licensing model and data volume without custom ABAP.

SAP Business ByDesign OData API integration
SAP S/4HANA and ECC connector setup
Oracle ERP Cloud and Fusion integration
Dynamics 365 F&O and Business Central
Fabric Mirroring for Azure SQL and Cosmos DB
Delta extraction — incremental loads, not full dumps
14→1

ERP Excel extracts replaced with live integrated data

90%

Faster financial close data availability

0

Custom ABAP written — certified API-first approach

Book a Discovery CallView Case Studies
PIPELINE MIGRATION

Data Pipeline Migration to Fabric

The Problem

Azure Data Factory pipelines that made sense in 2020 are now a maintenance tax. Every schema change breaks three downstream jobs. SSIS packages run on a server nobody has touched in four years. Informatica licences are renewing at a cost that no longer makes sense. The data engineering team spends more time fixing pipelines than building new capability.

What We Build

We audit your existing ADF, SSIS, or Informatica estate, classify each pipeline by complexity and criticality, and migrate to Fabric Dataflows Gen2 and Mirroring. The result is fewer moving parts, no separate orchestration layer, and integration logic that lives inside the same governed workspace as your analytics.

ADF pipeline audit and migration to Dataflows Gen2
SSIS package modernisation to Fabric pipelines
Informatica to Fabric migration planning
Fabric Mirroring to replace scheduled full-load ETL
Monitoring and alerting on new pipeline estate
Documentation and runbook handover
70%

Reduction in pipeline maintenance overhead post-migration

0

Separate orchestration servers to maintain

1

Workspace for all integration logic — not scattered across services

Book a Discovery CallView Case Studies

Systems We Connect in Production

Our unified data integration platform covers the full enterprise technology stack — from legacy on-premise systems to modern cloud-native APIs.

Microsoft Fabric

MirroringEventstreamDataflows Gen2PipelinesKQL DatabaseOneLake

ERP Sources

SAP ByDesignSAP S/4HANASAP ECCOracle ERPDynamics 365NetSuite

Cloud & Databases

Azure SQLCosmos DBSnowflakePostgreSQLMySQLADLS Gen2

Streaming & IoT

Azure Event HubsIoT HubMQTT / OPC-UASCADA / MESKafkaService Bus

Legacy Integration

ADFSSISInformaticaTalendMuleSoftSFTP / FTP

BI & Output

Power BI Direct LakeAzure SynapseREST APIsSharePointTeamsEmail Alerts

Common questions

Data Integration — what buyers ask us

How long does a typical data integration project take?

A focused single-source integration (e.g. SAP ByDesign into Fabric) typically takes 4–8 weeks from kick-off to production. A full enterprise integration across 5–10 source systems with a medallion architecture build is a 3–4 month engagement. We give a firm timeline after a 1-hour discovery call where we scope the source systems and data volumes.

Do we need to replace our existing Azure services to work with you?

No. We work with what you have. If ADF pipelines are running and working, we leave them running. We build on top of or alongside your current estate, and migrate selectively where the business case for Fabric Mirroring is clear. We don't rip and replace — we improve incrementally.

Can you integrate with on-premise systems?

Yes. We use the On-Premises Data Gateway for ADF and Fabric connections to on-premise SQL Server, Oracle, and file shares. For plant-floor OT systems (SCADA, PLC, MES), we use Azure IoT Hub or Event Hubs with edge agents where needed.

What is your approach to data governance during integration?

Every integration we build follows a medallion pattern — raw data in bronze, validated and conformed data in silver, business-ready aggregates in gold. Access controls, sensitivity labels, and lineage tracking are configured from day one, not retrofitted later. Microsoft Purview is configured as part of the workspace setup.

Do you support ongoing maintenance after go-live?

Yes. We offer a retainer model for pipeline monitoring, incident response, schema change management, and new source onboarding. Most clients start with a 3-month post-go-live support agreement and convert to an ongoing retainer once they see what proactive management looks like.

How do I stream IoT and SCADA data into Microsoft Fabric in real time?

Use Fabric Eventstream to ingest OPC-UA and MQTT feeds from the plant floor, landing them in a lakehouse or KQL database in OneLake. Where an edge gateway is needed, Azure IoT Hub or Event Hubs forwards the signals into Eventstream. The data is queryable within seconds, so a real-time OEE or condition-monitoring dashboard reads live machine state, not an overnight extract.

What is Fabric Eventstream and how is it used for operational data ingestion?

Fabric Eventstream is the real-time ingestion engine in Microsoft Fabric — it captures high-velocity events from IoT sensors, SCADA tags, Kafka, or Event Hubs and routes them to OneLake, a KQL database, or Power BI. For operational data it replaces a custom streaming pipeline: you configure sources and destinations rather than build and maintain code. It is the layer behind real-time plant-floor and logistics dashboards.

How do I connect OPC-UA data from a factory floor to a cloud analytics platform?

Bridge OPC-UA from the plant with an edge agent — Azure IoT Edge or an OPC-UA-to-MQTT gateway — that forwards tags to Azure IoT Hub or Event Hubs, then into Fabric Eventstream and OneLake. This keeps the OT network isolated while the analytics platform reads a governed copy. Machine signals then join ERP and MES data in the same lakehouse.

What is the latency of Microsoft Fabric Eventstream for plant-floor data?

Fabric Eventstream makes events queryable in seconds — typically sub-10-second end to end for plant-floor signals into a KQL database. That is fast enough for live line monitoring and threshold alerting, though not a substitute for the millisecond control loop the PLC handles. For most operational dashboards, seconds-fresh is the practical target.

How do I build a real-time logistics dashboard with live ERP and WMS data?

Land ERP and WMS data in OneLake through Fabric Mirroring or Azure Data Factory, stream movement events via Eventstream, then build the dashboard in Power BI on Direct Lake. Dispatchers see OTIF risk and dwell time as shipments move, not in a next-day report. Fabric Activator can raise an alert when a shipment breaches its window.

How can manufacturers eliminate nightly batch windows from their data pipeline?

Replace nightly extracts with Fabric Mirroring, which replicates the source database into OneLake continuously, and Direct Lake, which lets Power BI read the live Delta tables with no refresh. The batch window disappears because data is never loaded once a day — it is always current. Reports reflect the running shift instead of last night.

How do I integrate SAP ByDesign with Microsoft Fabric without custom ABAP?

Connect SAP ByDesign through its standard OData services and custom analytical queries, pulled into OneLake via Azure Data Factory or Fabric pipelines — no ABAP development required. Data lands in the bronze layer, conforms through silver, and surfaces as governed Power BI datasets. This stays within standard SAP licensing and survives ByD updates.

What is the best way to connect SAP S/4HANA to Power BI without CSV exports?

Connect SAP S/4HANA through OData, CDS views, or Fabric Mirroring rather than manual CSV exports, so data flows on a governed schedule into OneLake. Power BI reads it on Direct Lake, current and reconciled to SAP. The CSV habit ends — and with it the version-control and audit problems it creates.

How do I connect SAP Business One to Microsoft Fabric for real-time reporting?

Connect SAP Business One via its SQL database (HANA or SQL Server) using Azure Data Factory or the On-Premises Data Gateway, landing data in OneLake for near-real-time reporting. Incremental extraction keeps the load light on the B1 server. Power BI on Direct Lake then reports live without nightly exports.

What SAP integration methods work within standard licensing — OData vs direct database?

OData uses SAP's standard service layer, stays cleanly within licensing, and survives upgrades, but can be slower for very large extracts. Direct database access (HANA or the underlying SQL) is faster for bulk and delta loads but must respect SAP licensing terms and is more sensitive to schema changes. We default to OData for governed, supported extraction and use direct database access only where volume requires it and licensing permits — confirmed with your SAP team first.

How do I do incremental (delta) extraction from SAP into a data lakehouse?

Use change-data-capture or timestamp/watermark logic so each run pulls only records changed since the last load, rather than a full extract. On Fabric, delta-enabled pipelines or Mirroring land the changes in the bronze layer and merge them through silver. This keeps the SAP load light and the lakehouse current without nightly full reloads.

How do I integrate Dynamics 365 with Microsoft Fabric for supply chain analytics?

Connect Dynamics 365 through Fabric's native Dataverse link, which writes Dataverse tables to OneLake as Delta with no custom pipeline. Supply chain entities — orders, inventory, shipments — land governed and current. Power BI on Direct Lake then reports across Dynamics and other sources in one model.

How do I migrate Azure Data Factory pipelines to Microsoft Fabric?

Assess each Azure Data Factory (ADF) pipeline first, then re-platform the ones worth keeping as Fabric Data Pipelines or Dataflows Gen2, which share much of the ADF design surface. Where a source supports it, replace the pipeline entirely with Fabric Mirroring. We migrate selectively — pipelines that work and are low-cost can keep running via the mounted ADF in Fabric.

What is the process for replacing SSIS packages with Fabric Dataflows Gen2?

Map each SSIS package to its source, transformation, and destination, then rebuild the logic as Fabric Dataflows Gen2 (Power Query) or Data Pipelines, landing output in OneLake as Delta. Lift-and-shift via Azure-SSIS is possible as an interim step, but the durable move is to rebuild on Fabric so there is no separate runtime to maintain. We migrate package by package, validating row counts against the old output.

How do I assess which ADF pipelines to migrate versus retire?

Inventory the pipelines, then score each on usage, business value, run cost, and failure rate. The high-value, frequently-run pipelines migrate first; orphaned or duplicate pipelines retire. As with reports, a small fraction usually carries most of the value — migrating everything is wasted effort.

What is the difference between Fabric Mirroring and Dataflows Gen2 for data integration?

Mirroring continuously replicates an entire source database into OneLake as Delta with near-zero configuration — best when you want a live copy of a system like SQL Server, Azure SQL, or Cosmos DB. Dataflows Gen2 is for transformation: shaping, cleaning, and combining data with Power Query before it lands. Use Mirroring to get data in fast and unchanged; use Dataflows Gen2 where the data needs work on the way. Most estates use both — Mirroring for ingestion, Dataflows Gen2 for the silver layer.

How do I reduce pipeline maintenance overhead in a manufacturing data environment?

Cut the number of moving parts: replace hand-built extract pipelines with Fabric Mirroring where possible, consolidate transformations into governed Dataflows Gen2, and standardise on the medallion pattern so failures are localised. Fewer custom pipelines means fewer schema-change breakages — the main source of data-team firefighting. The result is engineers building new data products instead of fixing brittle ETL.

How do I integrate WMS and TMS data with ERP data for a unified logistics view?

Land WMS, TMS, and ERP data in OneLake and conform them in the silver layer to a shared logistics model — orders, shipments, and inventory keyed consistently. Once joined, OTIF, dwell time, and cost-to-serve read from one governed model in Power BI. The unified view is what turns three systems into a single logistics picture.

How do I connect a third-party logistics (3PL) system to Microsoft Fabric?

Connect a 3PL system through its API, SFTP file feed, or database, landing the data in OneLake via Azure Data Factory or Fabric pipelines on a governed schedule. Conform it in silver to the same keys as your ERP so 3PL shipments reconcile to orders. You then track 3PL performance in the same Power BI model as in-house operations.

How do I build an integrated view of inventory across multiple warehouses?

Bring each warehouse's stock data — from WMS, ERP, or spreadsheets — into OneLake and conform it to one item-and-location model in the silver layer. A single governed measure for on-hand, in-transit, and available-to-promise then reports across all sites in Power BI. Planners see one inventory position instead of reconciling separate site reports.

How do I connect Kafka or Azure Event Hubs to Microsoft Fabric for supply chain events?

Fabric Eventstream connects natively to Apache Kafka and Azure Event Hubs as sources, routing supply-chain events into OneLake, a KQL database, or Power BI. No custom consumer code is required — you configure the source and destination. This is how order, shipment, and telemetry event streams land in the same platform as ERP data.

How do I apply data governance to an enterprise data integration pipeline?

Build every pipeline on the medallion pattern — raw in bronze, conformed in silver, business-ready in gold — with access controls, sensitivity labels, and lineage configured from day one, not retrofitted. Microsoft Purview catalogues the data and tracks lineage across sources. Governance is part of the build, so you always know where a number came from.

How does Microsoft Purview connect with Fabric for data lineage and governance?

Purview integrates with Fabric to catalogue OneLake data, classify sensitive fields, and map end-to-end lineage from source system through bronze, silver, and gold to the Power BI report. An auditor or analyst can trace any figure back to its origin. It turns governance from a spreadsheet exercise into a queryable, current map of the estate.

How do I ensure data quality across multiple integrated ERP and WMS systems?

Apply validation rules in the silver layer — referential checks, range checks, and reconciliation against control totals — so bad records are caught and quarantined before they reach a dashboard. Conforming keys across ERP and WMS surfaces mismatches (an order with no shipment, stock with no item master) as data-quality exceptions. The result is one reconciled dataset rather than three systems that quietly disagree.

Tell Us What Needs to Connect.We'll Tell You Exactly How.

A 30-minute call. Bring your source systems list, your current pain points, and whatever you know about data volumes. We'll tell you what the integration architecture looks like and whether Microsoft Fabric is the right platform for it.

Book a Free Integration ReviewSend a Message