<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Data Lakehouse on Sam Debruyn</title><link>https://debruyn.dev/tags/data-lakehouse/</link><description>Recent content in Data Lakehouse on Sam Debruyn</description><generator>Hugo</generator><language>en-us</language><copyright>© Copyright Debruyn Consultancy</copyright><lastBuildDate>Fri, 08 May 2026 12:18:17 +0200</lastBuildDate><atom:link href="https://debruyn.dev/tags/data-lakehouse/index.xml" rel="self" type="application/rss+xml"/><item><title>From Lock-In to Openness: The Shift in Data Platforms</title><link>https://debruyn.dev/speaking/dmf26-session/</link><pubDate>Tue, 05 May 2026 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/dmf26-session/</guid><description>&lt;!-- SUMMARY: Explores how the data platform industry is converging toward open, interoperable architectures with decoupled storage, compute, and governance—moving away from proprietary vendor lock-in toward composable, standards-based data platforms. --&gt;
&lt;p&gt;&lt;img src="./from-lock-in-to-openness-the-shift-in-data-platfo_debruyn_1063183_banner.jpeg" alt="promo"&gt;&lt;/p&gt;
&lt;p&gt;&lt;img src="./V2_EN_DMF26_MediaKit_Banner-16_9.jpg" alt="mediakit"&gt;&lt;/p&gt;
&lt;p&gt;&lt;a
 href="https://www.datamakersfest.com/" data-umami-event="outbound_link_click" data-umami-event-url="https://www.datamakersfest.com/" target="_blank" rel="noreferrer noopener"
 &gt;Website&lt;/a&gt;
 | &lt;a
 href="https://tickets.datamakersfest.com/purchase" data-umami-event="outbound_link_click" data-umami-event-url="https://tickets.datamakersfest.com/purchase" target="_blank" rel="noreferrer noopener"
 &gt;Tickets&lt;/a&gt;
 | &lt;a
 href="https://www.datamakersfest.com/agenda" data-umami-event="outbound_link_click" data-umami-event-url="https://www.datamakersfest.com/agenda" target="_blank" rel="noreferrer noopener"
 &gt;Agenda&lt;/a&gt;
&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Take a look at the marketing of any modern data platform and you’ll notice a common theme — they all emphasize their openness. But what does that really mean? What happened to the good old days of vendor lock-in? And how “open” are these platforms, really?&lt;/p&gt;</description></item><item><title>Thread by Thread: Lessons from Migrating to Fabric</title><link>https://debruyn.dev/speaking/fabric-february-2026/</link><pubDate>Thu, 05 Feb 2026 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/fabric-february-2026/</guid><description>&lt;!-- SUMMARY: Practical guide to implementing Microsoft Fabric in production, covering architecture design (medallion, workspace setup), security integration with Microsoft Entra ID and PIM, SQL-first development with dbt, capacity management, monitoring with Soda, and lessons learned from challenges like security context issues, orchestration, and cost optimization. --&gt;
&lt;p&gt;&lt;a
 href="https://www.fabricfebruary.com/tickets/" data-umami-event="outbound_link_click" data-umami-event-url="https://www.fabricfebruary.com/tickets/" target="_blank" rel="noreferrer noopener"
 &gt;Tickets&lt;/a&gt;
 | &lt;a
 href="https://www.fabricfebruary.com/schedule/#sz-tab-46058" data-umami-event="outbound_link_click" data-umami-event-url="https://www.fabricfebruary.com/schedule/#sz-tab-46058" target="_blank" rel="noreferrer noopener"
 &gt;Schedule&lt;/a&gt;
&lt;/p&gt;</description></item><item><title>SQL Resurgence: Unleashing data potential with dbt</title><link>https://debruyn.dev/speaking/fabric-winterfest-2025-dbt/</link><pubDate>Thu, 27 Nov 2025 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/fabric-winterfest-2025-dbt/</guid><description>&lt;!-- SUMMARY: Deep dive into dbt and the SQL resurgence in modern data platforms. Covers dbt fundamentals, the analytics engineering discipline, key features like data lineage and testing, the new dbt-fabric adapter, and practical benefits for building version-controlled, reproducible data transformations. --&gt;
&lt;p&gt;&lt;em&gt;The largest Microsoft Fabric community event in Belgium&lt;/em&gt;&lt;/p&gt;</description></item><item><title>Thread by Thread: Lessons from Migrating to Fabric</title><link>https://debruyn.dev/speaking/fabric-winterfest-2025/</link><pubDate>Thu, 27 Nov 2025 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/fabric-winterfest-2025/</guid><description>&lt;!-- SUMMARY: Real-world Fabric migration journey covering workspace design, medallion architecture, security with Entra ID and PIM, SQL-first approach with dbt, OneLake shortcuts, data quality monitoring with Soda, capacity management, and lessons learned from pilot to full adoption. --&gt;
&lt;p&gt;&lt;em&gt;The largest Microsoft Fabric community event in Belgium&lt;/em&gt;&lt;/p&gt;
&lt;p&gt;&lt;a
 href="https://www.fabricwinterfest.be/blueslope" data-umami-event="outbound_link_click" data-umami-event-url="https://www.fabricwinterfest.be/blueslope" target="_blank" rel="noreferrer noopener"
 &gt;Agenda&lt;/a&gt;
 | &lt;a
 href="https://www.fabricwinterfest.be/" data-umami-event="outbound_link_click" data-umami-event-url="https://www.fabricwinterfest.be/" target="_blank" rel="noreferrer noopener"
 &gt;Tickets&lt;/a&gt;
&lt;/p&gt;</description></item><item><title>SQL Resurgence: Unleashing data potential with dbt</title><link>https://debruyn.dev/speaking/dataminds-connect-2025/</link><pubDate>Mon, 06 Oct 2025 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/dataminds-connect-2025/</guid><description>&lt;!-- SUMMARY: An exploration of dbt's rise as the leading data transformation tool, covering analytics engineering principles, modular SQL development with Jinja, data lineage and testing, and the new dbt-fabric adapter bringing dbt support to Microsoft Fabric. --&gt;
&lt;p&gt;&lt;a
 href="https://datamindsconnect.be/registration/" data-umami-event="outbound_link_click" data-umami-event-url="https://datamindsconnect.be/registration/" target="_blank" rel="noreferrer noopener"
 &gt;Tickets &amp;amp; registration&lt;/a&gt;
 | &lt;a
 href="https://datamindsconnect.be/agenda/" data-umami-event="outbound_link_click" data-umami-event-url="https://datamindsconnect.be/agenda/" target="_blank" rel="noreferrer noopener"
 &gt;Schedule&lt;/a&gt;
&lt;/p&gt;</description></item><item><title>From Fabric to Fantastic: How dbt Makes Your Lakehouses and Warehouses Shine</title><link>https://debruyn.dev/speaking/sqlbits-2025/</link><pubDate>Fri, 20 Jun 2025 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/sqlbits-2025/</guid><description>&lt;!-- SUMMARY: Learn how dbt empowers analytics engineering on Microsoft Fabric by providing SQL-based data transformation with automated testing, data lineage, documentation, and modular development patterns. Explore dbt's open-source ecosystem and how it streamlines data warehouse and lakehouse implementations. --&gt;
&lt;p&gt;&lt;a
 href="https://sqlbits.com/" data-umami-event="outbound_link_click" data-umami-event-url="https://sqlbits.com/" target="_blank" rel="noreferrer noopener"
 &gt;More information&lt;/a&gt;
 | &lt;a
 href="https://sqlbits.com/attend/the-agenda-2025/friday/#From_Fabric_to_Fantastic_How_dbt_Makes_Your_Lakehouses_and_Warehouses_Shine" data-umami-event="outbound_link_click" data-umami-event-url="https://sqlbits.com/attend/the-agenda-2025/friday/#From_Fabric_to_Fantastic_How_dbt_Makes_Your_Lakehouses_and_Warehouses_Shine" target="_blank" rel="noreferrer noopener"
 &gt;Session details&lt;/a&gt;
 | &lt;a
 href="https://events.sqlbits.com/2025/begin" data-umami-event="outbound_link_click" data-umami-event-url="https://events.sqlbits.com/2025/begin" target="_blank" rel="noreferrer noopener"
 &gt;Tickets&lt;/a&gt;
 | &lt;a
 href="https://sqlbits.com/attend/the-agenda-2025/friday/" data-umami-event="outbound_link_click" data-umami-event-url="https://sqlbits.com/attend/the-agenda-2025/friday/" target="_blank" rel="noreferrer noopener"
 &gt;Agenda&lt;/a&gt;
&lt;/p&gt;</description></item><item><title>Fabric Fortresses: Setting Up Microsoft Fabric for Your Enterprise Needs</title><link>https://debruyn.dev/speaking/techorama-2025-fabric-fortresses/</link><pubDate>Wed, 28 May 2025 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/techorama-2025-fabric-fortresses/</guid><description>&lt;!-- SUMMARY: Enterprise-focused security architecture for Microsoft Fabric covering defense-in-depth principles, private networking, authentication &amp; authorization, access controls, workspace identity, disaster recovery, and monitoring with Microsoft Purview --&gt;
&lt;p&gt;&lt;a
 href="https://techorama.be/" data-umami-event="outbound_link_click" data-umami-event-url="https://techorama.be/" target="_blank" rel="noreferrer noopener"
 &gt;More information&lt;/a&gt;
 | &lt;a
 href="https://techorama.be/agenda/session/fabric-fortresses-setting-up-microsoft-fabric-for-your-enterprise-needs/" data-umami-event="outbound_link_click" data-umami-event-url="https://techorama.be/agenda/session/fabric-fortresses-setting-up-microsoft-fabric-for-your-enterprise-needs/" target="_blank" rel="noreferrer noopener"
 &gt;Session details&lt;/a&gt;
 | &lt;a
 href="https://pretix.eu/techorama-be/2025/" data-umami-event="outbound_link_click" data-umami-event-url="https://pretix.eu/techorama-be/2025/" target="_blank" rel="noreferrer noopener"
 &gt;Tickets&lt;/a&gt;
&lt;/p&gt;
&lt;p&gt;&lt;img src="https://techorama.be/assets/images/logo/logo.svg" alt="logo"&gt;&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Join us to master Microsoft Fabric for enterprise-level challenges. Learn how to integrate private networking, manage resilience and disaster recovery, ensure seamless access control and configure vigilant monitoring to safeguard your data architecture. We’ll use Workspace Identity, Private Endpoints, and go through all the different ways to provide or restrict access to your data. By the end of this talk, you’ll be ready to build a robust and secure data platform on Microsoft Fabric.&lt;/p&gt;</description></item><item><title>From Flat to Sparkling: Monitoring Data Quality with Soda in Microsoft Fabric</title><link>https://debruyn.dev/speaking/dataminds-saturday-2025/</link><pubDate>Sat, 22 Feb 2025 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/dataminds-saturday-2025/</guid><description>&lt;!-- SUMMARY: Explore automated data quality monitoring and testing with Soda in Microsoft Fabric, including data warehouse and lakehouse integration, data contracts, and long-term metrics management. --&gt;
&lt;p&gt;&lt;a
 href="https://datamindssaturday.be/" data-umami-event="outbound_link_click" data-umami-event-url="https://datamindssaturday.be/" target="_blank" rel="noreferrer noopener"
 &gt;Free registration&lt;/a&gt;
 | &lt;a
 href="https://datamindssaturday.be/agenda/" data-umami-event="outbound_link_click" data-umami-event-url="https://datamindssaturday.be/agenda/" target="_blank" rel="noreferrer noopener"
 &gt;Agenda&lt;/a&gt;
&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;After loading all of your data into OneLake, you might be wondering how to ensure its quality. In this session, we’ll explore and demonstrate how Soda can help you monitor data quality with automated data testing and alerting, write and monitor data contracts, and browse data quality metrics in a user-friendly dashboard.&lt;/p&gt;</description></item><item><title>Fabric Fortresses: Setting Up Microsoft Fabric for Your Enterprise Needs</title><link>https://debruyn.dev/speaking/fabric-february-2025/</link><pubDate>Thu, 06 Feb 2025 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/fabric-february-2025/</guid><description>&lt;!-- SUMMARY: Enterprise security architecture for Microsoft Fabric, covering private networking, authentication/authorization with Microsoft Entra ID, privileged access management, monitoring, and disaster recovery best practices. --&gt;
&lt;p&gt;&lt;a
 href="https://www.fabricfebruary.com/" data-umami-event="outbound_link_click" data-umami-event-url="https://www.fabricfebruary.com/" target="_blank" rel="noreferrer noopener"
 &gt;More information, schedule, and tickets&lt;/a&gt;
&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Join us to master Microsoft Fabric for enterprise-level challenges. Learn how to integrate private networking, manage resilience and disaster recovery, ensure seamless access control and configure vigilant monitoring to safeguard your data architecture. We’ll use Workspace Identity, Private Endpoints, and go through all the different ways to provide or restrict access to your data. By the end of this talk, you’ll be ready to build a robust and secure data platform on Microsoft Fabric.&lt;/p&gt;</description></item><item><title>From Flat to Sparkling: Monitoring Data Quality with Soda in Microsoft Fabric</title><link>https://debruyn.dev/speaking/cloudbrew-2024/</link><pubDate>Fri, 13 Dec 2024 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/cloudbrew-2024/</guid><description>&lt;!-- SUMMARY: Comprehensive overview of data quality monitoring in Microsoft Fabric using Soda, covering quality dimensions, management strategies, and practical integration patterns for both Lakehouses and Data Warehouses. --&gt;
&lt;p&gt;&lt;a
 href="https://www.cloudbrew.be/#registration" data-umami-event="outbound_link_click" data-umami-event-url="https://www.cloudbrew.be/#registration" target="_blank" rel="noreferrer noopener"
 &gt;Tickets&lt;/a&gt;
&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;After loading all of your data into OneLake, you might be wondering how to ensure its quality. In this session, we’ll explore and demonstrate how Soda can help you monitor data quality with automated data testing and alerting, write and monitor data contracts, and browse data quality metrics in a user-friendly dashboard.&lt;/p&gt;</description></item><item><title>Medallion for Data Mesh: Exploring Workspace, Capacity, and Domain Design in Microsoft Fabric</title><link>https://debruyn.dev/speaking/databash-2024/</link><pubDate>Sat, 19 Oct 2024 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/databash-2024/</guid><description>&lt;!-- SUMMARY: Design scalable medallion architectures in Microsoft Fabric by leveraging workspaces, capacities, and domain-driven design principles for multi-team data platforms. --&gt;
&lt;p&gt;&lt;img src="promo.png" alt=""&gt;&lt;/p&gt;
&lt;p&gt;&lt;a
 href="https://databash.live/" data-umami-event="outbound_link_click" data-umami-event-url="https://databash.live/" target="_blank" rel="noreferrer noopener"
 &gt;More information&lt;/a&gt;
&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Designing a medallion architecture is more than just setting up a few Lakehouses and Data Warehouses. In this session, data architects and engineers learn how to design a medallion architecture with Fabric Workspaces, Capacities, and Domains. We’ll cover the segregation of responsibilities, granular access control, and how to pick and choose the right Capacities for every workload. By the end of this talk, you’ll be ready to design a scalable and secure data platform with Microsoft Fabric.&lt;/p&gt;</description></item><item><title>Medallion for Data Mesh: Exploring Workspace, Capacity, and Domain Design in Microsoft Fabric</title><link>https://debruyn.dev/speaking/dataminds-connect-2024/</link><pubDate>Wed, 09 Oct 2024 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/dataminds-connect-2024/</guid><description>&lt;!-- SUMMARY: Learn how to design a scalable medallion architecture in Microsoft Fabric using workspaces, capacities, and domains for proper separation of concerns, access control, and cost optimization. --&gt;
&lt;p&gt;&lt;img src="promo.png" alt=""&gt;&lt;/p&gt;
&lt;p&gt;&lt;a
 href="https://datamindsconnect.be/registration/" data-umami-event="outbound_link_click" data-umami-event-url="https://datamindsconnect.be/registration/" target="_blank" rel="noreferrer noopener"
 &gt;Tickets &amp;amp; registration&lt;/a&gt;
 | &lt;a
 href="https://datamindsconnect.be/agenda/" data-umami-event="outbound_link_click" data-umami-event-url="https://datamindsconnect.be/agenda/" target="_blank" rel="noreferrer noopener"
 &gt;Schedule&lt;/a&gt;
&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Designing a medallion architecture is more than just setting up a few Lakehouses and Data Warehouses. In this session, data architects and engineers learn how to design a medallion architecture with Fabric Workspaces, Capacities, and Domains. We’ll cover the segregation of responsibilities, granular access control, and how to pick and choose the right Capacities for every workload. By the end of this talk, you’ll be ready to design a scalable and secure data platform with Microsoft Fabric.&lt;/p&gt;</description></item><item><title>Medallion for Data Mesh: Exploring Workspace, Capacity, and Domain Design in Microsoft Fabric [EXTENDED TALK / DEEP-DIVE]</title><link>https://debruyn.dev/speaking/fabric-friday-holland-2024/</link><pubDate>Fri, 04 Oct 2024 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/fabric-friday-holland-2024/</guid><description>&lt;!-- SUMMARY: Deep-dive on implementing medallion architecture (bronze/silver/gold) within Microsoft Fabric workspaces while applying data mesh principles including domains, governance, access control, and capacity design for scalable, secure data platforms. --&gt;
&lt;p&gt;&lt;a
 href="https://datasaturday.nl/" data-umami-event="outbound_link_click" data-umami-event-url="https://datasaturday.nl/" target="_blank" rel="noreferrer noopener"
 &gt;More information&lt;/a&gt;
 | &lt;a
 href="https://www.eventbrite.nl/e/data-saturday-holland-fabric-friday-2024-tickets-924629470637?aff=oddtdtcreator" data-umami-event="outbound_link_click" data-umami-event-url="https://www.eventbrite.nl/e/data-saturday-holland-fabric-friday-2024-tickets-924629470637?aff=oddtdtcreator" target="_blank" rel="noreferrer noopener"
 &gt;Tickets&lt;/a&gt;
&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Designing a medallion architecture is more than just setting up a few Lakehouses and Data Warehouses. In this session, data architects and engineers learn how to design a medallion architecture with Fabric Workspaces, Capacities, and Domains. We’ll cover the segregation of responsibilities, granular access control, and how to pick and choose the right Capacities for every workload. By the end of this talk, you’ll be ready to design a scalable and secure data platform with Microsoft Fabric.&lt;/p&gt;</description></item><item><title>NL dbt meetup: From Fabric to Fantastic: How dbt Makes Your Lakehouses and Warehouses Shine</title><link>https://debruyn.dev/speaking/dbt-amsterdam-sept24/</link><pubDate>Fri, 20 Sep 2024 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/dbt-amsterdam-sept24/</guid><description>&lt;!-- SUMMARY: Explores the medallion architecture and how dbt transforms data in Microsoft Fabric's unified lakehouse and warehouse. Covers dbt-fabric as an open-source project with emerging support for Fabric's OneLake storage and multiple SQL engines. --&gt;
&lt;p&gt;On the 20th of September, I spoke at the &lt;a
 href="https://www.meetup.com/amsterdam-dbt-meetup/" data-umami-event="outbound_link_click" data-umami-event-url="https://www.meetup.com/amsterdam-dbt-meetup/" target="_blank" rel="noreferrer noopener"
 &gt;NL dbt meetup&lt;/a&gt;
.&lt;/p&gt;</description></item><item><title>Medallion for Data Mesh: Exploring Workspace, Capacity, and Domain Design in Microsoft Fabric</title><link>https://debruyn.dev/speaking/fabric-brussels-medallion/</link><pubDate>Thu, 20 Jun 2024 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/fabric-brussels-medallion/</guid><description>&lt;!-- SUMMARY: Learn how to design a scalable medallion architecture in Microsoft Fabric by organizing Workspaces, Capacities, and Domains for proper data segregation, access control, and workload-specific performance optimization. --&gt;
&lt;p&gt;On June 20th I spoke at the &lt;a
 href="https://fabric.brussels/" data-umami-event="outbound_link_click" data-umami-event-url="https://fabric.brussels/" target="_blank" rel="noreferrer noopener"
 &gt;Fabric Brussels&lt;/a&gt;
 meetup.&lt;/p&gt;
&lt;p&gt;Register &lt;a
 href="https://forms.office.com/pages/responsepage.aspx?id=or1tU0T1_E2a4TbdNDE4YrxmHz45pZ1AkIhuaKbV_QlUM0syTjhDTjFKTk9XVjVGN1I4V0FOVlJFUy4u" data-umami-event="outbound_link_click" data-umami-event-url="https://forms.office.com/pages/responsepage.aspx?id=or1tU0T1_E2a4TbdNDE4YrxmHz45pZ1AkIhuaKbV_QlUM0syTjhDTjFKTk9XVjVGN1I4V0FOVlJFUy4u" target="_blank" rel="noreferrer noopener"
 &gt;here&lt;/a&gt;
.&lt;/p&gt;
&lt;p&gt;&lt;a
 href="https://www.fabricbelgium.be/events-7" data-umami-event="outbound_link_click" data-umami-event-url="https://www.fabricbelgium.be/events-7" target="_blank" rel="noreferrer noopener"
 &gt;Event details&lt;/a&gt;
&lt;/p&gt;</description></item><item><title>SQL Resurgence - Unleashing Data Potential with dbt on Databricks</title><link>https://debruyn.dev/speaking/sql-resurgence-databricks/</link><pubDate>Thu, 11 Jan 2024 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/sql-resurgence-databricks/</guid><description>&lt;p&gt;&lt;a
 href="https://www.meetup.com/databricks-user-group-belgium/events/297810226/" data-umami-event="outbound_link_click" data-umami-event-url="https://www.meetup.com/databricks-user-group-belgium/events/297810226/" target="_blank" rel="noreferrer noopener"
 &gt;Event details&lt;/a&gt;
&lt;/p&gt;
&lt;p&gt;I spoke at the Databricks meetup on how you can use dbt with SQL on Databricks to unleash the full potential of your data. The event was held at Cegeka in Antwerp, Belgium.&lt;/p&gt;
&lt;p&gt;Speakers:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Sam Debruyn (tech lead data &amp;amp; cloud @ dataroots)&lt;/li&gt;
&lt;li&gt;Fabrice Deseyn (data architect &amp;amp; team lead @ Cegeka)&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;&lt;img src="img1.JPEG" alt="photo"&gt;
&lt;img src="img2.JPEG" alt="photo"&gt;
&lt;img src="img3.JPEG" alt="photo"&gt;
&lt;img src="img4.JPEG" alt="photo"&gt;
&lt;img src="img5.JPEG" alt="photo"&gt;&lt;/p&gt;</description></item><item><title>Fabric: Lakehouse or Data Warehouse?</title><link>https://debruyn.dev/2023/fabric-lakehouse-or-data-warehouse/</link><pubDate>Thu, 19 Oct 2023 10:24:43 +0200</pubDate><guid>https://debruyn.dev/2023/fabric-lakehouse-or-data-warehouse/</guid><description>&lt;p&gt;There are 2 kinds of companies currently active in the Microsoft data space: those who are migrating to Microsoft Fabric, and those who will &lt;em&gt;soon&lt;/em&gt; be planning their migration to Microsoft Fabric. 😅 One question that often comes back is&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Should I focus on the Lakehouse or the Data Warehouse?&lt;/p&gt;
&lt;/blockquote&gt;
&lt;p&gt;Let&amp;rsquo;s answer that in this post. I can already tell you this: you&amp;rsquo;re asking the wrong question 😉&lt;/p&gt;</description></item><item><title>Data Agility Unleashed: A Deep Dive into Microsoft Fabric's Features (dataroots Fabric Event)</title><link>https://debruyn.dev/speaking/dataroots-fabric/</link><pubDate>Mon, 16 Oct 2023 00:00:00 +0000</pubDate><guid>https://debruyn.dev/speaking/dataroots-fabric/</guid><description>&lt;p&gt;I was invited to speak at the dataroots Microsoft Fabric Event in Leuven, Belgium. The event was held at De Hoorn, an old brewery in the city center.&lt;/p&gt;
&lt;p&gt;Speakers:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Sam Debruyn (tech lead data &amp;amp; cloud @ dataroots)&lt;/li&gt;
&lt;li&gt;Jonas Tundo (CEO @ dataroots)&lt;/li&gt;
&lt;li&gt;Priya Sathy (Partner Director of Products @ Microsoft)&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Pictures:&lt;/p&gt;</description></item><item><title>Is Microsoft Fabric just a rebranding?</title><link>https://debruyn.dev/2023/is-microsoft-fabric-just-a-rebranding/</link><pubDate>Mon, 02 Oct 2023 10:53:24 +0200</pubDate><guid>https://debruyn.dev/2023/is-microsoft-fabric-just-a-rebranding/</guid><description>&lt;p&gt;It&amp;rsquo;s a question I see popping up every now and then. Is Microsoft Fabric just a rebranding of existing Azure services like Synapse, Data Factory, Event Hub, Stream Analytics, etc.? Is it something more? Or is it something entirely new?&lt;/p&gt;
&lt;p&gt;I hate clickbait titles as much as you do. So, before we dive in, let me answer the question right away. &lt;strong&gt;No, Fabric is not just a rebranding.&lt;/strong&gt; I would not even describe Fabric as an &lt;em&gt;evolution&lt;/em&gt; (as Microsoft often does), but rather as a &lt;em&gt;&lt;strong&gt;revolution&lt;/strong&gt;&lt;/em&gt;! Now, let&amp;rsquo;s find out why.&lt;/p&gt;</description></item><item><title>My take-aways from Big Data London: Delta Lake &amp; the open lakehouses</title><link>https://debruyn.dev/2023/my-take-aways-from-big-data-london-delta-lake-the-open-lakehouses/</link><pubDate>Mon, 25 Sep 2023 10:20:35 +0100</pubDate><guid>https://debruyn.dev/2023/my-take-aways-from-big-data-london-delta-lake-the-open-lakehouses/</guid><description>Last week I attended Big Data London. Both days were filled with interesting sessions, mostly focussing on one of the vendors also exhibiting at the conference. There are 2 things I am taking away from this conference: Delta Lake has won the data format wars, and your next data platform is either Snowflake, either an open Lakehouse.</description></item><item><title>Fabric end-to-end use case: Analytics Engineering part 1 - dbt with the Lakehouse</title><link>https://debruyn.dev/2023/fabric-end-to-end-use-case-analytics-engineering-part-1-dbt-with-the-lakehouse/</link><pubDate>Mon, 11 Sep 2023 09:59:11 +0200</pubDate><guid>https://debruyn.dev/2023/fabric-end-to-end-use-case-analytics-engineering-part-1-dbt-with-the-lakehouse/</guid><description>&lt;p&gt;Welcome to the fourth part of a 5-part series on an end-to-end use case for Microsoft Fabric. This post will focus on the analytics engineering part of the use case.&lt;/p&gt;

&lt;p&gt;In this series, we will explore how to use Microsoft Fabric to ingest, transform, and analyze data using a real-world use case. The series focuses on data engineering and analytics engineering. We will be using OneLake, Notebooks, Lakehouse, SQL Endpoints, Data Pipelines, dbt, and Power BI.&lt;/p&gt;</description></item><item><title>Fabric end-to-end use case: Data Engineering part 1 - Spark and Pandas in Notebooks</title><link>https://debruyn.dev/2023/fabric-end-to-end-use-case-data-engineering-part-1-spark-and-pandas-in-notebooks/</link><pubDate>Mon, 28 Aug 2023 08:58:56 +0200</pubDate><guid>https://debruyn.dev/2023/fabric-end-to-end-use-case-data-engineering-part-1-spark-and-pandas-in-notebooks/</guid><description>&lt;p&gt;Welcome to the second part of a 5-part series on an end-to-end use case for Microsoft Fabric. This post will focus on the data engineering part of the use case.&lt;/p&gt;

&lt;p&gt;In this series, we will explore how to use Microsoft Fabric to ingest, transform, and analyze data using a real-world use case. The series focuses on data engineering and analytics engineering. We will be using OneLake, Notebooks, Lakehouse, SQL Endpoints, Data Pipelines, dbt, and Power BI.&lt;/p&gt;</description></item><item><title>Fabric end-to-end use case: overview &amp; architecture</title><link>https://debruyn.dev/2023/fabric-end-to-end-use-case-overview-architecture/</link><pubDate>Mon, 21 Aug 2023 09:59:15 +0200</pubDate><guid>https://debruyn.dev/2023/fabric-end-to-end-use-case-overview-architecture/</guid><description>&lt;p&gt;Welcome to the first part of a 5-part series on an end-to-end use case for Microsoft Fabric. This post will focus on the architecture overview of the use case.&lt;/p&gt;

&lt;p&gt;In this series, we will explore how to use Microsoft Fabric to ingest, transform, and analyze data using a real-world use case. The series focuses on data engineering and analytics engineering. We will be using OneLake, Notebooks, Lakehouse, SQL Endpoints, Data Pipelines, dbt, and Power BI.&lt;/p&gt;</description></item><item><title>Let Fabric teach you how to code with Data Wrangler</title><link>https://debruyn.dev/2023/let-fabric-teach-you-how-to-code-with-data-wrangler/</link><pubDate>Wed, 09 Aug 2023 10:22:38 +0200</pubDate><guid>https://debruyn.dev/2023/let-fabric-teach-you-how-to-code-with-data-wrangler/</guid><description>&lt;p&gt;I&amp;rsquo;m going to be honest with you. I&amp;rsquo;m bad at writing Pandas data transformation code. Throughout the years I mostly focussed on the Spark APIs in Scala and PySpark, SQL, dbt, and some others, but I find the Pandas APIs usually just confusing and hard to read. I don&amp;rsquo;t like the black box magic and lock-in of low-code solutions either. Did you know that Microsoft Fabric has the perfect middle ground for this? It&amp;rsquo;s called Data Wrangler. Let&amp;rsquo;s dive in!&lt;/p&gt;</description></item><item><title>Connect to Fabric Lakehouses &amp; Warehouses from Python code</title><link>https://debruyn.dev/2023/connect-to-fabric-lakehouses-warehouses-from-python-code/</link><pubDate>Tue, 11 Jul 2023 09:14:24 +0200</pubDate><guid>https://debruyn.dev/2023/connect-to-fabric-lakehouses-warehouses-from-python-code/</guid><description>&lt;p&gt;In this post, I will show you how to connect to your Microsoft Fabric Lakehouses and Warehouses from Python.&lt;/p&gt;</description></item><item><title>Preparing a migration to Microsoft Fabric: from Azure Synapse Serverless SQL</title><link>https://debruyn.dev/2023/preparing-a-migration-to-microsoft-fabric-from-azure-synapse-serverless-sql/</link><pubDate>Tue, 04 Jul 2023 11:16:45 +0200</pubDate><guid>https://debruyn.dev/2023/preparing-a-migration-to-microsoft-fabric-from-azure-synapse-serverless-sql/</guid><description>&lt;p&gt;If all those posts about Microsoft Fabric have made you curious, you might want to consider it as your next data platform. Since it is very new, not all features are available yet and most are still in preview. You could already adopt it, but if you want to deploy this to a production scenario, you&amp;rsquo;ll want to wait a bit longer. In the meantime, you can already start preparing for the migration. Let&amp;rsquo;s dive into the paths to migrate to Microsoft Fabric. Today: starting from Synapse Serverless SQL Pools.&lt;/p&gt;</description></item><item><title>Microsoft Fabric's Auto Discovery: a closer look</title><link>https://debruyn.dev/2023/microsoft-fabrics-auto-discovery-a-closer-look/</link><pubDate>Wed, 28 Jun 2023 09:00:00 +0200</pubDate><guid>https://debruyn.dev/2023/microsoft-fabrics-auto-discovery-a-closer-look/</guid><description>&lt;p&gt;In &lt;a
 href="https://debruyn.dev/tags/fabric/"
 &gt;previous posts&lt;/a&gt;
, I dug deeper into Microsoft Fabric&amp;rsquo;s SQL-based features and we even &lt;a
 href="https://debruyn.dev/2023/exploring-onelake-with-microsoft-azure-storage-explorer/"
 &gt;explored OneLake using Azure Storage Explorer&lt;/a&gt;
. In this post, I&amp;rsquo;ll take a closer look at Fabric&amp;rsquo;s &lt;strong&gt;auto-discovery&lt;/strong&gt; feature using Shortcuts. Auto-discovery, what&amp;rsquo;s that?&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Fabric&amp;rsquo;s Lakehouses can automatically discover all the datasets already present in your data lake and expose these as tables in Lakehouses (and Warehouses).&lt;/p&gt;
&lt;/blockquote&gt;
&lt;p&gt;Cool, right? At the time of writing, there is a single condition: the tables must be stored in the Delta Lake format. Let&amp;rsquo;s take a closer look.&lt;/p&gt;</description></item><item><title>Exploring OneLake with Microsoft Azure Storage Explorer</title><link>https://debruyn.dev/2023/exploring-onelake-with-microsoft-azure-storage-explorer/</link><pubDate>Tue, 20 Jun 2023 09:30:57 +0200</pubDate><guid>https://debruyn.dev/2023/exploring-onelake-with-microsoft-azure-storage-explorer/</guid><description>&lt;h2 id="recap-onelake--delta-lake"&gt;Recap: OneLake &amp;amp; Delta Lake&lt;/h2&gt;
&lt;p&gt;One of the coolest things about &lt;a
 href="https://www.microsoft.com/en-us/microsoft-fabric/" data-umami-event="outbound_link_click" data-umami-event-url="https://www.microsoft.com/en-us/microsoft-fabric/" target="_blank" rel="noreferrer noopener"
 &gt;Microsoft Fabric&lt;/a&gt;
 is that it nicely decouples storage and compute and it is very transparent about the storage: everything ends up in the OneLake. This is a huge advantage over other data platforms since you don&amp;rsquo;t have to worry about moving data around, it is always available, wherever you need it.&lt;/p&gt;</description></item><item><title>Welcome to the 3rd generation: SQL in Microsoft Fabric</title><link>https://debruyn.dev/2023/welcome-to-the-3rd-generation-sql-in-microsoft-fabric/</link><pubDate>Thu, 15 Jun 2023 20:15:11 +0200</pubDate><guid>https://debruyn.dev/2023/welcome-to-the-3rd-generation-sql-in-microsoft-fabric/</guid><description>&lt;p&gt;&lt;img src="fabric_header.jpeg" alt="Fabric header"&gt;&lt;/p&gt;
&lt;p&gt;While typing this blog post, I&amp;rsquo;m flying back from the &lt;a
 href="https://dataplatformnextstep.com/" data-umami-event="outbound_link_click" data-umami-event-url="https://dataplatformnextstep.com/" target="_blank" rel="noreferrer noopener"
 &gt;Data Platform Next Step&lt;/a&gt;
 conference where I gave a talk about using &lt;a
 href="https://www.getdbt.com/" data-umami-event="outbound_link_click" data-umami-event-url="https://www.getdbt.com/" target="_blank" rel="noreferrer noopener"
 &gt;dbt&lt;/a&gt;
 with &lt;a
 href="https://learn.microsoft.com/en-us/fabric/" data-umami-event="outbound_link_click" data-umami-event-url="https://learn.microsoft.com/en-us/fabric/" target="_blank" rel="noreferrer noopener"
 &gt;Microsoft Fabric&lt;/a&gt;
. DP Next Step was the first conference focussed on Microsoft data services right after the announcement of Microsoft Fabric so a lot of speakers were Microsoft employees and most of the talks had some Fabric content.&lt;/p&gt;
&lt;p&gt;&lt;img src="fabric.png" alt="Microsoft Fabric logo"&gt;&lt;/p&gt;
&lt;p&gt;Fabric Fabric Fabric, what is it all about? In this post I&amp;rsquo;ll go deeper into what it is, why you should care and focus specifically on the SQL aspect of Fabric.&lt;/p&gt;</description></item></channel></rss>