Introduction
Welcome to Excel Jet Consult. In this blog, we will focus on Lakehouse object of the Microsoft Fabric technology. Let’s get started.
What is Microsoft Lakehouse?
Microsoft Fabric Lakehouse is an amazing data architecture platform that allows organizations to store, manage, and analyze structured and unstructured data in a single location. It is a flexible and scalable solution that enables organizations to handle large volumes of data using various tools and frameworks to process and analyze that data
The Lakehouse creates a serving layer by automatically generating a SQL endpoint and a default dataset during creation 1. This new functionality allows users to work directly on top of the Delta tables in the lake to provide a frictionless and performant experience all the way from data ingestion to reporting 1. An important distinction between default warehouse is that it’s a read-only experience and doesn’t support the full T-SQL surface area of a transactional data warehouse. Note that only the tables in Delta format are available in the SQL endpoint. Parquet, CSV, and other formats can’t be queried using the SQL endpoint. If you don’t see your table, convert it to Delta format.
Fact and Dimension Tables in the Lakehouse
Data engineers can interact with the lakehouse and the data within the lakehouse in several ways. The Lakehouse explorer is the main Lakehouse interaction page. Data engineer and users can load data in their Lakehouse using the Dataflow Gen2, Data Pipeline and Open Notebook. They can explore data in the Lakehouse using the object explorer, write SQL queries against the data in the SQL endpoint, create measures and visuals. Data engineers can use notebooks to write code to read, transform, and write directly to Lakehouse as tables and or folders. Data engineers can also use data integration tools such as pipeline copy tool to pull data from other sources and land into the Lakehouse.
