What's new in Microsoft Fabric?
This page is continuously updated with a recent review of what's new in Microsoft Fabric.
- To follow the latest in Fabric news and features, see the Microsoft Fabric Updates Blog.
- For community, marketing, case studies, and industry news, see the Microsoft Fabric Blog.
- Follow the latest in Power BI at What's new in Power BI?
- For older updates, review the Microsoft Fabric What's New archive.
New to Microsoft Fabric?
This section includes articles and announcements for users new to Microsoft Fabric.
- Learning Paths for Fabric
- Get started with Microsoft Fabric
- End-to-end tutorials in Microsoft Fabric
- Definitions of terms used in Microsoft Fabric
Month | Feature | Learn more |
---|---|---|
May 2024 | Power BI: Subscriptions, licenses, and trials | Information on Power BI implementation planning and key considerations for planning subscriptions, licenses, and trials for Power BI and Fabric. |
May 2024 | Register for the Microsoft Build: Microsoft Fabric Cloud Skills Challenge | Starting May 21, 2024, sign up for the Microsoft Build: Microsoft Fabric Cloud Skills Challenge and prepare for Exam DP-600 and upskill to the Fabric Analytics Engineer Associate certification. |
Features currently in preview
The following table lists the features of Microsoft Fabric that are currently in preview. Preview features are sorted alphabetically.
Note
Features currently in preview are available under supplemental terms of use, review for legal terms that apply to Azure features that are in beta, preview, or otherwise not yet released into general availability. Microsoft Fabric provides previews to give you a chance to evaluate and share feedback with the product group on features before they become generally available (GA).
Feature | Learn more |
---|---|
Data Science AI skill (preview) | You can now build your own generative AI experiences over your data in Fabric with the AI skill (preview)! You can build question and answering AI systems over your Lakehouses and Warehouses. For more information, see Introducing AI Skills in Microsoft Fabric: Now in Public Preview. To get started, try AI skill example with the AdventureWorks dataset. |
Capacity pools preview | Capacity administrators can now create custom pools (preview) based on their workload requirements, providing granular control over compute resources. Custom pools for Data Engineering and Data Science can be set as Spark Pool options within Workspace Spark Settings and environment items. |
CI/CD for Fabric Data Pipelines preview | Git Integration and integration with built-in Deployment Pipelines to Data Factory data pipelines is now in preview. For more information, see Data Factory Adds CI/CD to Fabric Data Pipelines. |
Code-First AutoML preview | In Synapse Data Science, the new AutoML feature enables automation of your machine learning workflow. AutoML, or Automated Machine Learning, is a set of techniques and tools that can automatically train and optimize machine learning models for any given data and task type. |
Code-First Hyperparameter Tuning preview | In Synapse Data Science, FLAML is now integrated for hyperparameter tuning, currently a preview feature. Fabric's flaml.tune feature streamlines this process, offering a cost-effective and efficient approach to hyperparameter tuning. |
Copilot in Fabric is available worldwide | Copilot in Fabric is now available to all customers, including Copilot for Power BI, Data Factory, Data Science & Data Engineering, and Real-Time Intelligence. Read more in our Overview on Copilot in Fabric. |
Data Activator preview | We're thrilled to announce that Data Activator is now in preview and is enabled for all existing Microsoft Fabric users. |
Data workflows in Data Factory preview | Data workflows (preview) in Data Factory, powered by Apache Airflow, offer seamless authoring, scheduling, and monitoring experience for Python-based data processes defined as Directed Acyclic Graphs (DAGs). For more information, see Quickstart: Create a Data workflow. |
Data Wrangler for Spark DataFrames preview | Data Wrangler now supports Spark DataFrames in preview, users can now edit Spark DataFrames in addition to pandas DataFrames with Data Wrangler. |
Domains in OneLake (preview) | Domains in OneLake help you organize your data into a logical data mesh, allowing federated governance and optimizing for business needs. You can now create sub domains, default domains for users, and move workspaces between domains. For more information, see Fabric domains. |
Introducing external data sharing (preview) | External Data Sharing (preview) is a new feature that makes it possible for Fabric users to share data from within their Fabric tenant with users in another Fabric tenant. |
Fabric gateway enables OneLake shortcuts to on-premises data | Connect to on-premises data sources with a Fabric on-premises data gateway on a machine in your environment, with networking visibility of your S3 compatible, Amazon S3, or Google Cloud Storage data source. Then, you create your shortcut and select that gateway. For more information, see Create shortcuts to on-premises data. |
Fabric Runtime 1.3 (Apache Spark 3.5, Delta Lake 3.1, R 4.3.3, Python 3.11) (preview) | The enhancements in Fabric Runtime 1.3 include the incorporation of Delta Lake 3.1, compatibility with Python 3.11, support for Starter Pools, integration with Environment, and library management capabilities. Additionally, Fabric Runtime now enriches the data science experience by supporting the R language and integrating Copilot. |
Fabric Spark connector for Fabric Synapse Data Warehouse in Spark runtime (preview) | The Fabric Spark connector for Synapse Data Warehouse (preview) enables a Spark developer or a data scientist to access and work on data from a warehouse or SQL analytics endpoint of the lakehouse (either from within the same workspace or from across workspaces) with a simplified Spark API. |
Fabric workload dev kit (preview) | The Microsoft Fabric workload development kit extends to additional workloads and offers a robust developer toolkit for designing, developing, and interoperating with Microsoft Fabric using frontend SDKs and backend REST APIs. |
Folder in Workspace preview | As an organizational unit in the workspace, folder addresses this pain point by providing a hierarchical structure for organizing and managing your items. For more information, see Create folders in workspaces (preview). |
GitHub integration for source control (preview) | Fabric developers can now choose GitHub or GitHub Enterprise as their source control tool, and version their Fabric items there. For more information, see Get started with Git integration (preview). |
GraphQL API in Microsoft Fabric preview | The new API for GraphQL is a data access layer that allows us to query multiple data sources quickly and efficiently in Fabric. For more information, see What is Microsoft Fabric API for GraphQL? |
Integrating On-Premises Data into Microsoft Fabric using Data Pipelines in Data Factory preview | You can use the on-premises Data Gateway (preview), to connect to on-premises data sources using dataflows and data pipelines with Data Factory. For more information, see How to access on-premises data sources in Data Factory for Microsoft Fabric. |
Kusto Cache consumption preview | The preview of Kusto Cache consumption means that you will start seeing billable consumption of the OneLake Cache Data Stored meter from the KQL Database and Eventhouse items. For more information, see KQL Database consumption. |
Lakehouse schemas feature | The Lakehouse schemas feature (preview) introduces data pipeline support for reading the schema info from Lakehouse tables and supports writing data into tables under specified schemas. Lakehouse schemas allow you to group your tables together for better data discovery, access control, and more. |
Lakehouse support for git integration and deployment pipelines (preview) | The Lakehouse now integrates with the lifecycle management capabilities in Microsoft Fabric, providing a standardized collaboration between all development team members throughout the product's life. Lifecycle management facilitates an effective product versioning and release process by continuously delivering features and bug fixes into multiple environments. |
Managed virtual networks (preview) | Managed virtual networks are virtual networks that are created and managed by Microsoft Fabric for each Fabric workspace. |
Microsoft 365 connector now supports ingesting data into Lakehouse (preview) | The Microsoft 365 connector now supports ingesting data into Lakehouse tables. |
Microsoft Fabric Admin APIs | Fabric Admin APIs are designed to streamline administrative tasks. The initial set of Fabric Admin APIs is tailored to simplify the discovery of workspaces, Fabric items, and user access details. |
Mirroring in Microsoft Fabric preview | With Mirroring in Fabric, you can easily bring your databases into OneLake in Microsoft Fabric, enabling seamless zero-ETL, near real-time insights on your data – and unlocking warehousing, BI, AI, and more. For more information, see What is Mirroring in Fabric?. |
Native Execution Engine for Apache Spark | The Native Execution Engine for Apache Spark on Fabric Data Engineering and Data Science for Fabric Runtime 1.2 is now in preview. For more information, see Native execution engine for Fabric Spark. |
Notebook Git integration preview | Fabric notebooks now offer Git integration for source control using Azure DevOps. It allows users to easily control the notebook code versions and manage the git branches by using the Fabric Git functions and Azure DevOps. |
Notebook in Deployment Pipeline Preview | Now you can also use notebooks to deploy your code across different environments, such as development, test, and production. You can also use deployment rules to customize the behavior of your notebooks when they're deployed, such as changing the default Lakehouse of a Notebook. Get started with deployment pipelines, and Notebook shows up in the deployment content automatically. |
OneLake data access roles | OneLake data access roles for lakehouse are in preview. Role permissions and user/group assignments can be easily updated through a new folder security user interface. |
OneLake Shortcuts API | New REST APIs for OneLake Shortcuts allow programmatic creation and management of shortcuts, currently in preview. You can now programmatically create, read, and delete OneLake shortcuts. For example, see Use OneLake shortcuts REST APIs. |
OneLake shortcuts to S3-compatible data sources preview | OneLake shortcuts to S3-compatible data sources are now in preview. Create an Amazon S3 compatible shortcut to connect to your existing data through a single unified name space without having to copy or move data. |
OneLake shortcuts to Google Cloud Storage preview | OneLake shortcuts to Google Cloud Storage are now in preview. Create a Google Cloud Storage shortcut to connect to your existing data through a single unified name space without having to copy or move data. |
Prebuilt Azure AI services in Fabric preview | The preview of prebuilt AI services in Fabric is an integration with Azure AI services, formerly known as Azure Cognitive Services. Prebuilt Azure AI services allow for easy enhancement of data with prebuilt AI models without any prerequisites. Currently, prebuilt AI services are in preview and include support for the Microsoft Azure OpenAI Service, Azure AI Language, and Azure AI Translator. |
Real-Time hub | Real-Time hub is single, tenant-wide, unified, logical place for streaming data-in-motion. It enables you to easily discover, ingest, manage, and consume data-in-motion from a wide variety of sources. It lists all the streams and Kusto Query Language (KQL) tables that you can directly act on. It also gives you an easy way to ingest streaming data from Microsoft products and Fabric events. For more information, see Real-Time hub overview. |
REST APIs for Fabric Data Factory pipelines preview | The REST APIs for Fabric Data Factory Pipelines are now in preview. REST APIs for Data Factory pipelines enable you to extend the built-in capability in Fabric to create, read, update, delete, and list pipelines. |
Spark Run Series Analysis preview | The Spark Monitoring Run Series Analysis features allow you to analyze the run duration trend and performance comparison for Pipeline Spark activity recurring run instances and repetitive Spark run activities, from the same Notebook or Spark Job Definition. |
Splunk add-on preview | Microsoft Fabric add-on for Splunk allows users to ingest logs from Splunk platform into a Fabric KQL DB using the Kusto python SDK. |
Task flows in Microsoft Fabric (preview) | The preview of task flows in Microsoft Fabric is enabled for all Microsoft Fabric users. With Fabric task flows, when designing a data project, you no longer need to use a whiteboard to sketch out the different parts of the project and their interrelationships. Instead, you can use a task flow to build and bring this key information into the project itself. |
Warehouse restore points and restore in place | You can now create restore points and perform an in-place restore of a warehouse to a past point in time. Restore in-place is an essential part of data warehouse recovery, which allows to restore the data warehouse to a prior known reliable state by replacing or over-writing the existing data warehouse from which the restore point was created. |
Warehouse source control (preview) | Using Git integration and/or deployment pipelines with your warehouse, you can manage development and deployment of versioned warehouse objects. You can use SQL Database Projects extension available inside of Azure Data Studio and Visual Studio Code. For more information on warehouse source control, see CI/CD with Warehouses in Microsoft Fabric. |
Generally available features
The following table lists the features of Microsoft Fabric that have transitioned from preview to general availability (GA) within the last six months.
Month | Feature | Learn more |
---|---|---|
July 2024 | Update records in a KQL Database preview | The .update command is now generally available. Learn more about how to Update records in a Kusto database. |
July 2024 | Warehouse queries with time travel (GA) | Warehouse in Microsoft Fabric offers the capability to query the historical data as it existed in the past at the statement level, now generally available. The ability to query data from a specific timestamp is known in the data warehousing industry as time travel. |
June 2024 | OneLake availability of Eventhouse in Delta Lake format | As part of the One logical copy promise, we're excited to announce that OneLake availability of Eventhouse in Delta Lake format is Generally Available. |
May 2024 | Microsoft Fabric Private Links | Azure Private Link for Microsoft Fabric secures access to your sensitive data in Microsoft Fabric by providing network isolation and applying required controls on your inbound network traffic. For more information, see Announcing General Availability of Fabric Private Links. |
May 2024 | Trusted workspace access | Trusted workspace access in OneLake shortcuts is now generally available. You can now create data pipelines to access your firewall-enabled Azure Data Lake Storage Gen2 (ADLS Gen2) accounts using Trusted workspace access (preview) in your Fabric Data Pipelines. Use the workspace identity to establish a secure and seamless connection between Fabric and your storage accounts. Trusted workspace access also enables secure and seamless access to ADLS Gen2 storage accounts from OneLake shortcuts in Fabric. |
May 2024 | Managed private endpoints | Managed private endpoints for Microsoft Fabric allow secure connections over managed virtual networks to data sources that are behind a firewall or not accessible from the public internet. For more information, see Announcing General Availability of Fabric Private Links, Trusted Workspace Access, and Managed Private Endpoints. |
May 2024 | Eventhouse | Eventhouse is a new, dynamic workspace hosting multiple KQL databases, generally available as part of Fabric Real-Time Intelligence. An Eventhouse offers a robust solution for managing and analyzing substantial volumes of real-time data. Get started with a guide to Create and manage an Eventhouse. |
May 2024 | Data Engineering: Environment | The Environment in Fabric is now generally available. The Environment is a centralized item that allows you to configure all the required settings for running a Spark job in one place. At GA, we added support for Git, deployment pipelines, REST APIs, resource folders, and sharing. |
May 2024 | Microsoft Fabric Core REST APIs | Microsoft Fabric Core APIs are now generally available. The Fabric user APIs are a major enabler for both enterprises and partners to use Microsoft Fabric as they enable end-to-end fully automated interaction with the service, enable integration of Microsoft Fabric into external web applications, and generally enable customers and partners to scale their solutions more easily. |
May 2024 | Power Query Dataflow Gen2 SDK for VS Code | The Power Query SDK is now generally available in Visual Studio Code! To get started with the Power Query SDK in Visual Studio Code, install it from the Visual Studio Code Marketplace. |
April 2024 | Semantic Link | Semantic links are now generally available! The package comes with our default VHD, and you can now use Semantic link in Fabric right away without any pip installation. |
Community
This section summarizes new Microsoft Fabric community opportunities for prospective and current influencers and MVPs.
- Sign up for the Fabric Community Newsletter.
- Join a local Fabric User Group or join a local event.
- To learn about the Microsoft MVP Award and to find MVPs, see mvp.microsoft.com.
- Are you a student? Learn more about the Microsoft Learn Student Ambassadors program.
- Vote and contribute to Microsoft Fabric Ideas.
- Visit the Microsoft Fabric Career Hub for everything you need on your certification journey, including a 50% discount on exams.
- Watch and subscribe to Microsoft Fabric videos on YouTube.
- Ask and answer questions in the Microsoft Fabric community.
Important
Join us at Europe's first Fabric Community Conference, the ultimate Power BI, Fabric, SQL & AI learning event in Stockholm, Sweden from September 24-27, 2024. Register today using code MSCUST
for an exclusive discount on top of early bird pricing!
Month | Feature | Learn more |
---|---|---|
August 2024 | Winners of the Fabric Community Sticker Challenge | Congratulations to the winners of the Fabric Community Sticker Challenge! |
July 2024 | Fabric Influencers Spotlight | Introducing the new Fabric Influencers Spotlight series of articles to highlight and amplify blog posts, videos, presentations, and other content related to Microsoft Fabric. Read blogs from Microsoft MVPs and Fabric Super Users from the Fabric community. |
June 2024 | Solved Fabric Community posts are now available in the Fabric Help Pane | You can now find solved posts from Fabric Community discussions in the Fabric Help Pane. |
May 2024 | Announcing Microsoft Fabric Community Conference Europe | Announcing the Microsoft Fabric Community Conference Europe on September 24, 2024. Register today! |
May 2024 | Register for the Microsoft Build: Microsoft Fabric Cloud Skills Challenge | Starting May 21, 2024, sign up for the Microsoft Build: Microsoft Fabric Cloud Skills Challenge and prepare for Exam DP-600 and upskill to the Fabric Analytics Engineer Associate certification. |
For older updates, review the Microsoft Fabric What's New archive.
Power BI
Important
If you are accessing Power BI on a web browser version older than Chrome 94, Edge 94, Safari 16.4, Firefox 93, or equivalent, you need upgrade your web browser to a newer version by August 31, 2024. Using an outdated browser version after this date, may prevent you from accessing features in Power BI.
Updates to Power BI Desktop and the Power BI service are summarized at What's new in Power BI?
Microsoft Copilot in Microsoft Fabric
With Copilot and other generative AI features in preview, Microsoft Fabric brings a new way to transform and analyze data, generate insights, and create visualizations and reports. For more information, see Copilot in Fabric.
Month | Feature | Learn more |
---|---|---|
June 2024 | Copilot privacy and security | For more information on the privacy and security of Copilot in Microsoft Fabric, and for detail information on each workload, see Privacy, security, and responsible use for Copilot in Microsoft Fabric (preview). |
May 2024 | The AI and Copilot setting automatically delegated to capacity admins | In the tenant admin portal, you can delegate the enablement of AI and Copilot features to Capacity administrators. This AI and Copilot setting is automatically delegated to capacity administrators and tenant administrators won't be able to turn off the delegation. |
May 2024 | Copilot for Data Warehouse | Copilot for Data Warehouse (preview) is now available, offering the Copilot chat pane, quick actions, and code completions. For more information and sample scenarios, see Announcing the Public Preview of Copilot for Data Warehouse in Microsoft Fabric. |
For older updates, review the Microsoft Fabric What's New archive.
Data Factory in Microsoft Fabric
This section summarizes recent new features and capabilities of Data Factory in Microsoft Fabric. Follow issues and feedback through the Data Factory Community Forum.
Month | Feature | Learn more |
---|---|---|
August 2024 | Certified connector updates | Updated Dataflow Gen2 connectors have been released, as well as two new Data pipeline connectors for Salesforce and Vertica. For more information, see the August 2024 Certified connector updates. |
August 2024 | Data Warehouse Connector Supports TLS 1.3 | The Data Warehouse connector now supports TLS 1.3, the latest version of the Transport Layer Security protocol. |
August 2024 | Connect to your Azure Resources by Modern Get Data Experience in Data pipeline | You can easily browse and connect to your Azure resources automatically with the modern data experience of Data Pipeline. |
July 2024 | Use existing connections from the OneLake Datahub integration | You can now select any existing connections from OneLake Datahub, not just your recent and favorite ones. This makes it easier to access your data sources from the homepage of modern get data in data pipeline. For more information, see Modern Get Data experience. |
July 2024 | Snowflake storage integration | Connect and integrate Snowflake's storage integration to streamline data workflows and optimize performance across all staging scenarios, without the need to bring external storage to stage your dataset. For more information, see Snowflake connector. |
July 2024 | Edit JSON code for Data pipelines | You can now edit the JSON behind your Data Factory pipelines in Fabric. When you design low-code pipeline workflows, directly editing the JSON code behind your visual pipeline canvas can increase your flexibility and improve your market time. |
July 2024 | Dataflow Gen2 certified connector updates | New and updated Dataflow Gen2 connectors have been released, including two new connectors in Fabric Data Factory data pipeline: Azure MySQL Database Connector and Azure Cosmos DB for MongoDB Connector. For more information, see the July 2024 Certified connector updates. |
July 2024 | Support for editing Navigation steps | Introducing a new experience to edit navigation steps within Dataflow, to connect to a different object, inside of the Applied steps section of the Query settings pane. For more information, see Editing Navigation steps. |
July 2024 | Global view in Manage connections | The new Global view in Manage connections allows you to see all the available connections in your Fabric environment so you can modify them or delete them without ever having to leave the Dataflow experience. For more information, see Global view in Manage connections. |
July 2024 | Fast Copy with On-premises Data Gateway Support in Dataflow Gen2 | Fast Copy in Dataflow Gen2 now supports on-premise data stores using a gateway to access on-premise stores like SQL Server with Fast Copy in Dataflow Gen2. |
July 2024 | Fabric API for GraphQL (preview) pricing | API for GraphQL in Fabric starts billing on July 12, 2024, as part of your existing Power BI Premium or Fabric Capacity. Use the Fabric Capacity Metrics app to track capacity usage for API for GraphQL operations, under the name "Query". |
June 2024 | Dataflow Gen2 certified connector updates | New and updated Dataflow Gen2 connectors have been released. For more information, see the June 2024 Certified connector updates. |
June 2024 | New data pipeline connector updates | More connectors are now available for data pipeline. For more information, see the June 2024 Fabric update. |
June 2024 | Lakehouse schemas feature | The Lakehouse schemas feature (preview) introduces data pipeline support for reading the schema info from Lakehouse tables and supports writing data into tables under specified schemas. Lakehouse schemas allow you to group your tables together for better data discovery, access control, and more. |
June 2024 | Move Data Across Workspace via Data pipeline Modern Get Data Experience | You can now move data among Lakehouses, warehouses, etc. across different workspaces. In Pipeline Modern Get Data, select a Fabric item from another workspace under Explorer on the left side of the OneLake data hub. |
June 2024 | Create a new Warehouse as destination in Data pipeline | You can now create a new Warehouse as a destination in Data Pipeline, instead of only selecting an existing one. |
May 2024 | Data Factory Announcements at Microsoft Build Recap | Don't miss any of the Data Factory in Fabric announcements, here's a recap of all new features in Data Factory in Fabric from Build 2024. |
May 2024 | New certified connectors | The Power Query SDK and Power Query Connector Certification process has introduced several new Power Query connectors, including connectors for Oracle database, MySQL, Oracle Cloud Storage, Azure AI, Azure Files, Dynamics AX, Google Bigquery, Snowflake ADBC, and more coming soon. |
May 2024 | API for GraphQL in Microsoft Fabric (preview) | The new API for GraphQL is a data access layer that allows us to query multiple data sources quickly and efficiently in Fabric. For more information, see What is Microsoft Fabric API for GraphQL? |
May 2024 | Power Query Dataflow Gen2 SDK for VS Code GA | The Power Query SDK is now generally available in Visual Studio Code! To get started with the Power Query SDK in Visual Studio Code, install it from the Visual Studio Code Marketplace. |
May 2024 | Refresh the Refresh History Dialog | The Refresh History details popup window now has a Refresh button. |
May 2024 | New and updated certified connectors | The Power Query SDK and Power Query Connector Certification process has introduced four new and updated Power Query connectors. |
May 2024 | Data workflows in Data Factory preview | Data workflows (preview) in Data Factory, powered by Apache Airflow, offer seamless authoring, scheduling, and monitoring experience for Python-based data processes defined as Directed Acyclic Graphs (DAGs). For more information, see Quickstart: Create a Data workflow. |
May 2024 | Trusted Workspace Access in Fabric Data Pipelines preview | Use the workspace identity to establish a secure and seamless connection between Fabric and your storage accounts. You can now create data pipelines to access your firewall-enabled Azure Data Lake Storage Gen2 (ADLS Gen2) accounts using Trusted workspace access (preview) in your Fabric Data Pipelines. |
May 2024 | Blob storage Event Triggers for Data Pipelines preview | Azure Blob storage event triggers (preview) in Fabric Data Factory Data Pipelines use Fabric Reflex alerts and event streams to create event subscriptions to your Azure storage accounts. |
May 2024 | Azure HDInsight activity for data pipelines | The Azure HDInsight activity allows you to execute Hive queries, invoke a MapReduce program, execute Pig queries, execute a Spark program, or a Hadoop Stream program. |
May 2024 | Copy data assistant | Start using the Modern Get Data experience by selecting Copy data assistant in the Pipeline landing page or Use copy assistant in the Copy data drop down. You can easily connect to recently used Fabric items and provides an intuitive way to read sources from sample data and new connections. |
May 2024 | Edit the Destination Table Column Type when Copying Data | You can edit destination table column types when copying data for a new or autocreated destination table for many data stores. For more information, see Configure Lakehouse in a copy activity. |
April 2024 | Spark job definition activity | With the new Spark job definition activity, you'll be able to run a Spark job definition in your pipeline. |
April 2024 | Fabric Warehouse in ADF copy activity | You can now connect to your Fabric Warehouse from an Azure Data Factory/Synapse pipeline. You can find this new connector when creating a new source or sink destination in your copy activity, in the Lookup activity, Stored Procedure activity, Script activity, and Get Metadata activity. |
April 2024 | Edit column type to destination table support added to Fabric Warehouse and other SQL data stores | When moving data from any supported data sources into Fabric Warehouse or other SQL data stores (SQL Server, Azure SQL Database, Azure SQL Managed Instance, or Azure Synapse Analytics) via data pipelines, users can now specify the data type for each column. |
April 2024 | Performance improvements when writing data to SFTP | The SFTP connector has been improved to offer better performance when writing to SFTP as destination. |
April 2024 | Service Principal Name authentication kind support for On-Premises and virtual network data gateways | Azure Service Principals (SPN) are now supported for on-premises data gateways and virtual network data gateways. Learn how to use the service principal authentication kind in Azure Data Lake Storage, Dataverse, Azure SQL Database, Web connector, and more. |
April 2024 | New and updated Certified connectors | The Power Query SDK and Power Query Connector Certification process has introduced 11 new and updated custom Power Query connectors. |
April 2024 | New Expression Builder Experience | A new experience in the Script activity in Fabric Data Factory pipelines to make it even easier to build expressions using the pipeline expression language. |
April 2024 | Data Factory Increases Maximum Activities Per Pipeline to 80 | We have doubled the limit on number of activities you can define in a pipeline from 40 to 80. |
April 2024 | REST APIs for Fabric Data Factory pipelines preview | The REST APIs for Fabric Data Factory Pipelines are now in preview. REST APIs for Data Factory pipelines enable you to extend the built-in capability in Fabric to create, read, update, delete, and list pipelines. |
For older updates, review the Microsoft Fabric What's New archive.
Data Factory in Microsoft Fabric samples and guidance
Month | Feature | Learn more |
---|---|---|
July 2024 | Connect to your Azure Resources from Fabric with the Data Pipeline Modern Get Data Experience | Learn how to connect to your Azure resources automatically with the modern get data experience of Data Pipelines. |
July 2024 | Fabric Data Pipelines – Advanced Scheduling Techniques (Part 2: Run a Pipeline on a Specific Day) | This blog provides a tutorial on the ability to schedule a Pipeline on a specific day of the month, including both the start of the month along with the last day of the month. |
June 2024 | A Data Factory Pipeline Navigator mind map | The ultimate Data Factory Pipeline Mind Map helps you navigate Data Factory pipelines on your Data Factory journey to build a successful Data Integration project. |
May 2024 | Semantic model refresh activity | Learn how to use the much-requested Semantic model refresh activity in Data pipelines and how you can now create a complete end-to-end solution that spans the entire pipeline lifecycle. |
Synapse Data Engineering in Microsoft Fabric
This section summarizes recent new features and capabilities of the Data Engineering workload in Microsoft Fabric.
Month | Feature | Learn more |
---|---|---|
August 2024 | MsSparkUtils upgrade to NotebookUtils | The library MsSparkUtils has been rebranded as NotebookUtils. While NotebookUtils is backward compatible with MsSparkUtils , new features will only be added to the NotebookUtils namespace. For more information, see NotebookUtils (former MSSparkUtils) for Fabric. |
August 2024 | Import Notebook UX improvement | The Import Notebook feature user interface has been enhanced - you can now effortlessly import notebooks, reports, or paginated reports using the unified entry in the workspace toolbar. |
August 2024 | Lifecycle of Apache Spark runtimes in Fabric | The Lifecycle of Apache Spark runtimes document details the release cadence and versioning for the Azure-integrated platform based on Azure Spark. For more information, see the Fabric runtime lifecycle blog post. |
July 2024 | MSSparkUtils API | The mssparkutils.runtime.context is a new API that provides context information of the current live session, including the notebook name, default lakehouse, workspace info, if it's a pipeline run, etc. For more information, see Microsoft Spark Utilities (MSSparkUtils) for Fabric. |
July 2024 | Environment Resources folder | The new Environment Resources Folder is a shared repository designed to streamline collaboration across multiple notebooks. |
June 2024 | Fabric Spark connector for Fabric Synapse Data Warehouse in Spark runtime (preview) | The Fabric Spark connector for Synapse Data Warehouse (preview) enables a Spark developer or a data scientist to access and work on data from a warehouse or SQL analytics endpoint of the lakehouse (either from within the same workspace or from across workspaces) with a simplified Spark API. |
June 2024 | External data sharing public API preview | REST APIs for OneLake external data sharing are now available in preview. Users can now scale their data sharing use cases by automating the creation of shares with the public API. |
June 2024 | Capacity pools preview | Capacity administrators can now create custom pools (preview) based on their workload requirements, providing granular control over compute resources. Custom pools for Data Engineering and Data Science can be set as Spark Pool options within Workspace Spark Settings and environment items. |
June 2024 | Native Execution Engine for Apache Spark | The Native Execution Engine for Apache Spark on Fabric Data Engineering and Data Science for Fabric Runtime 1.2 is now in preview. For more information, see Native execution engine for Fabric Spark. |
June 2024 | OneLake data access roles API | Following the release of OneLake data access roles in preview, new APIs are available for managing data access roles. These APIs can be used to programmatically manage granular data access for your lakehouses. |
May 2024 | Runtime 1.3 (Apache Spark 3.5, Delta Lake 3.1, R 4.3.3, Python 3.11) (preview) | The enhancements in Fabric Runtime 1.3 include the incorporation of Delta Lake 3.1, compatibility with Python 3.11, support for Starter Pools, integration with Environment, and library management capabilities. Additionally, Fabric Runtime now enriches the data science experience by supporting the R language and integrating Copilot. |
May 2024 | Spark Run Series Analysis and Autotune feature preview | The Spark Monitoring Run Series Analysis features allow you to analyze the run duration trend and performance comparison for Pipeline Spark activity recurring run instances and repetitive Spark run activities, from the same Notebook or Spark Job Definition. |
May 2024 | OneLake shortcuts to on-premises and network-restricted data sources (preview) | Connect to on-premises data sources with a Fabric on-premises data gateway on a machine in your environment, with networking visibility of your S3 compatible, Amazon S3, or Google Cloud Storage data source. Then, you create your shortcut and select that gateway. For more information, see Create shortcuts to on-premises data. |
May 2024 | Comment @tagging in Notebook | Notebook now supports the ability to tag others in comments, just like the familiar functionality of using Office products. |
May 2024 | Notebook ribbon upgrades | New features in the Fabric notebook ribbon including the Session connect control and Data Wrangler button on the Home tab, High concurrency sessions, new View session information control including the session timeout. |
May 2024 | Data Engineering: Environment GA | The Environment in Fabric is now generally available. The Environment is a centralized item that allows you to configure all the required settings for running a Spark job in one place. At GA, we added support for Git, deployment pipelines, REST APIs, resource folders, and sharing. |
May 2024 | Public API for Workspace Data Engineering/Science | REST API support for Fabric Data Engineering/Science workspace settings allows users to create/manage their Spark compute, select the default runtime/default environment, enable or disable high concurrency mode, or ML autologging. |
April 2024 | Fabric Spark Optimistic Job Admission | Fabric Spark Optimistic Job Admission reduces the frequency of throttling errors (HTTP 430: Spark Capacity Limit Exceeded Response) and improves the job admission experience for our customers, especially during peak usage hours. |
April 2024 | Single Node support for starter pools | The Single Node support for starter pools feature lets you set your starter pool to max one node and get super-fast session start times for your Spark sessions. |
April 2024 | Container Image for Synapse VS Code | To simplify the development process, we have released a container image for Synapse VS Code that contains all the necessary dependencies for the extension. |
April 2024 | Git integration with Spark Job definition | Git integration with Spark Job definitions allows you to check in the changes of your Spark Job Definitions into a Git repository, which will include the source code of the Spark jobs and other item properties. |
April 2024 | New Revamped Object Explorer experience in the notebook | The new Object Explorer experience improves flexibility and discoverability of data sources in the explorer and improve the discoverability of Resource folders. |
April 2024 | %Run your scripts in Notebook** |
Now you can use %run magic command to run your Python scripts and SQL scripts in Notebook resources folder, just like Jupyter notebook %run command. |
April 2024 | OneLake shortcuts to S3-compatible data sources preview | OneLake shortcuts to S3-compatible data sources are now in preview. Create an Amazon S3 compatible shortcut to connect to your existing data through a single unified name space without having to copy or move data. |
April 2024 | OneLake shortcuts to Google Cloud Storage preview | OneLake shortcuts to Google Cloud Storage are now in preview. Create a Google Cloud Storage shortcut to connect to your existing data through a single unified name space without having to copy or move data. |
April 2024 | OneLake data access roles | OneLake data access roles for lakehouse are in preview. Role permissions and user/group assignments can be easily updated through a new folder security user interface. |
For older updates, review the Microsoft Fabric What's New archive.
Synapse Data Engineering samples and guidance
Month | Feature | Learn more |
---|---|---|
August 2024 | Build a custom Sparklens JAR | In this blog, you will learn how to build the sparklens JAR for Spark 3.X, which can be used in Microsoft Fabric. |
July 2024 | Create a shortcut to a VPC-protected Amazon S3 bucket | Learn how to create a shortcut to a VPC-protected Amazon S3 bucket, using the on-premises data gateway and AWS Virtual Private Cloud (VPC). |
July 2024 | Move Your Data Across Workspaces Using Modern Get Data of Fabric Data Pipeline | The new modern get data experience of data pipeline now supports copying to Lakehouse and warehouse across different workspaces with an intuitive experience. |
June 2024 | Demystifying Data Ingestion in Fabric: Fundamental Components for Ingesting Data into a Fabric Lakehouse using Fabric Data Pipelines | Learn about a batch data Ingestion framework based on experience working with different customers while building a lakehouse in Fabric. |
June 2024 | Boost performance and save costs with Fast Copy in Dataflows Gen2 | Learn how the Fast Copy feature helps to enhance the performance and cost-efficiency of your Dataflows Gen2. |
May 2024 | Copy Data from Lakehouse in another Workspace using Data pipeline | Learn how to copy data between Lakehouse that cross different workspaces via Data pipeline. |
May 2024 | Profiling Microsoft Fabric Spark Notebooks with Sparklens | In this blog, you will learn how to leverage Sparklens, an open-source Spark profiling tool, to profile Microsoft Fabric Spark Notebooks and improve the performance of your spark code. |
Synapse Data Science in Microsoft Fabric
This section summarizes recent improvements and features for Data Science in Microsoft Fabric.
Month | Feature | Learn more |
---|---|---|
August 2024 | Apply MLFlow tags on ML experiment runs and model versions | You can now apply MLflow tags directly on ML experiment runs and ML model versions from the user interface. |
August 2024 | Track related ML Experiment runs in your Spark Application | You can now use an enhancement to the Monitoring Hub to track related ML experiment runs within Spark applications. You can also integrate Experiment items into the Monitoring Hub. |
August 2024 | Use PREDICT with Fabric AutoML models | You can now move from training with AutoML to making predictions by using the built-in Fabric PREDICT UI and code-first APIs for batch predictions. For more information, see Machine learning model scoring with PREDICT in Microsoft Fabric. |
August 2024 | Data Science AI skill (preview) | You can now build your own generative AI experiences over your data in Fabric with the AI skill (preview)! You can build question and answering AI systems over your Lakehouses and Warehouses. For more information, see Introducing AI Skills in Microsoft Fabric: Now in Public Preview. To get started, try AI skill example with the AdventureWorks dataset. |
July 2024 | Semantic link preinstalled | Semantic Link in now included in the default runtime. If you use Fabric with Spark 3.4 or later, semantic link is already in the default runtime, and you don't need to install it. |
July 2024 | Semantic Link Labs | Semantic Link Labs is a library of helpful python solutions for use in Microsoft Fabric notebooks. Semantic Link Labs helps Power BI developers and admins easily automate previously complicated tasks, as well as make semantic model optimization tooling more easily accessible within the Fabric ecosystem. For Semantic Link Labs documentation, see semantic-link-labs documentation. For more information and to see it in action, read the Semantic Link Labs announcement blog. |
June 2024 | Capacity pools preview | Capacity administrators can now create custom pools (preview) based on their workload requirements, providing granular control over compute resources. Custom pools for Data Engineering and Data Science can be set as Spark Pool options within Workspace Spark Settings and environment items. |
June 2024 | Native Execution Engine for Apache Spark | The Native Execution Engine for Apache Spark on Fabric Data Engineering and Data Science for Fabric Runtime 1.2 is now in preview. For more information, see Native execution engine for Fabric Spark. |
May 2024 | Public API for Workspace Data Engineering/Science | REST API support for Fabric Data Engineering/Science workspace settings allows users to create/manage their Spark compute, select the default runtime/default environment, enable or disable high concurrency mode, or ML autologging. |
April 2024 | Semantic Link GA | Semantic links are now generally available! The package comes with our default VHD. You can now use Semantic link in Fabric right away without any pip installation. |
April 2024 | Capacity level delegation for AI and Copilot | Tenant admins can now enable AI and Copilot in Fabric for the entire organization, certain security groups, or for a specific Capacity. |
For older updates, review the Microsoft Fabric What's New archive.
Synapse Data Science samples and guidance
Month | Feature | Learn more |
---|---|---|
June 2024 | Building Custom AI Applications with Microsoft Fabric: Implementing Retrieval Augmented Generation for Enhanced Language Models | This guide walks you through implementing a RAG (Retrieval Augmented Generation) system in Microsoft Fabric using Azure OpenAI and Azure AI Search. |
Synapse Data Warehouse in Microsoft Fabric
This section summarizes recent improvements and features for Synapse Data Warehouse in Microsoft Fabric.
Month | Feature | Learn more |
---|---|---|
August 2024 | Mirroring integration with modern get data experience | You can now use the Modern Get Data experience to choose from all the available mirrored databases in the OneLake data hub. |
August 2024 | T-SQL DDL support in Azure SQL Database mirrored database | You can now run DDL operations on a Azure SQL Database mirrored database such as Drop Table, Rename Table, and Rename Column. |
August 2024 | Delta Lake log publishing pause and resume | You can now pause and resume the publishing of Delta Lake Logs for Warehouses. For more information, see Delta Lake logs in Warehouse in Microsoft Fabric. |
August 2024 | Managing V-Order behavior of Fabric Warehouses | You can now manage V-Order behavior at the warehouse level. For more information, see Understand V-Order for Microsoft Fabric Warehouse. |
August 2024 | TRUNCATE T-SQL support | The TRUNCATE T-SQL command is now supported in Warehouse tables. |
July 2024 | ALTER TABLE and nullable column support | We've added T-SQL ALTER TABLE support for some operations, as well as nullable column support to tables in the warehouse. For more information, see ALTER TABLE (Transact-SQL). |
July 2024 | Warehouse queries with time travel (GA) | Warehouse in Microsoft Fabric offers the capability to query the historical data as it existed in the past at the statement level, now generally available. The ability to query data from a specific timestamp is known in the data warehousing industry as time travel. |
July 2024 | Restore warehouse experience in the Fabric portal | You can now create restore points and perform a restore in-place of a warehouse item. For more information, see Seamless Data Recovery through Warehouse restoration. |
July 2024 | Warehouse source control (preview) | Using Git integration and/or deployment pipelines with your warehouse, you can manage development and deployment of versioned warehouse objects. You can use SQL Database Projects extension available inside of Azure Data Studio and Visual Studio Code. For more information on warehouse source control, see CI/CD with Warehouses in Microsoft Fabric. |
July 2024 | Time travel and clone table retention window expanded | The retention period for time travel queries and clone table is now 30 days. |
June 2024 | Restore in place portal experience | You can now create user-created restore points in your warehouse via the Fabric portal. For more information, see Restore in-place of a warehouse in Microsoft Fabric. |
June 2024 | Fabric Spark connector for Fabric Data Warehouse in Spark runtime (preview) | The Fabric Spark connector for Fabric Data Warehouse (preview) enables a Spark developer or a data scientist to access and work on data from Fabric DW and SQL analytics endpoint of the lakehouse (either from within the same workspace or from across workspaces) with a simplified Spark API. |
May 2024 | Monitor Warehouse tools | You can Monitor Synapse Data Warehouse activity with a variety of tools, including: Billing and utilization reporting in Synapse Data Warehouse, monitor connections, sessions, and requests using DMVs, Query insights, and now Query activity. For more information, read Query activity: A one-stop view to monitor your running and completed T-SQL queries. |
May 2024 | Copilot for Data Warehouse | Copilot for Data Warehouse (preview) is now available, offering the Copilot chat pane, quick actions, and code completions. Sign up here to enable Copilot for Data Warehouse in your organization today! |
May 2024 | Warehouse queries with time travel (preview) | Warehouse in Microsoft Fabric offers the capability to query the historical data as it existed in the past at the statement level, currently in preview. The ability to query data from a specific timestamp is known in the data warehousing industry as time travel. |
May 2024 | COPY INTO enhancements | COPY INTO now supports Microsoft Entra ID authentication and access to firewall protected storage via the trusted workspace functionality. For more information, see COPY INTO enhancements and COPY INTO (Transact-SQL). |
April 2024 | Fabric Warehouse in ADF copy activity | You can now connect to your Fabric Warehouse from an Azure Data Factory/Synapse pipeline. You can find this new connector when creating a new source or sink destination in your copy activity, in the Lookup activity, Stored Procedure activity, Script activity, and Get Metadata activity. |
April 2024 | Git integration | Git integration for the Warehouse allows you to check in the changes of your Warehouse to an Azure DevOps Git repository as a SQL database project. |
April 2024 | Partition elimination | Partition elimination is a performance improvement for tables with a large number of files. The SQL analytics endpoint of a Lakehouse uses partition elimination to read data from only those partitions that are relevant to the query. Recent improvements boosted performance even more when queries are aimed at a few partitions in a table that has many files. |
For older updates, review the Microsoft Fabric What's New archive.
Synapse Data Warehouse samples and guidance
Month | Feature | Learn more |
---|---|---|
August 2024 | Mirroring SQL Server database to Fabric | While SQL Server isn't currently supported for Fabric mirrored databases, learn how to extend Fabric mirroring to an on-prem SQL Server database as a source, using a combination of SQL Server Transactional replication and Fabric Mirroring. |
July 2024 | Microsoft Entra authentication for Fabric Synapse Data Warehouse | For sample connection strings and more information on using Microsoft Entra as an alternative to SQL Authentication, see Microsoft Entra authentication as an alternative to SQL authentication. |
June 2024 | Mastering Enterprise T-SQL ETL/ELT: A Guide with Data Warehouse and Fabric Pipelines | Learn about foundational elements of an enterprise-scale ETL/ELT framework using Fabric Pipelines and a Data Warehouse for performing our transformations in T-SQL. Additionally, we will examine a dynamic SQL script designed to incrementally process tables throughout your enterprise. |
April 2024 | Fabric Change the Game: Azure SQL Database mirror into Microsoft Fabric | A step-by-step guide to mirror your Azure SQL Database into Microsoft Fabric. |
Real-Time Intelligence in Microsoft Fabric
This section summarizes recent improvements and features for Real-Time Intelligence in Microsoft Fabric.
Month | Feature | Learn more |
---|---|---|
August 2024 | Fabric Real-Time Hub Teaching Bubbles | New teaching bubbles provide a step-by-step guide through its major functionalities. These interactive guides allow you to seamlessly navigate each tab of the Real-Time Hub. For more information, see Fabric Real-Time Hub Teaching Bubble. |
August 2024 | KQL Queryset REST API support | The new Fabric Queryset REST APIs allow you to create/update/delete KQL Querysets in Fabric, and programmatically manage them without manual intervention. For more information, see KQL Queryset REST API support. |
July 2024 | Update records in a KQL Database preview | The .update command is now generally available. Learn more about how to Update records in a Kusto database. |
July 2024 | Real-Time Dashboards 1s and 10s refresh rate | Real-time Dashboards now support ultra-low refresh rates of just 1 or 10 seconds. For more information, see Create a Real-Time Dashboard (preview). |
June 2024 | Graph Semantics in Eventhouse | Graph Semantics in Eventhouse allows users to model their data as graphs and perform advanced graph queries and analytics using the Kusto Query Language (KQL). |
June 2024 | Set alerts on Real-time Dashboards with Data Activator triggers | Real-Time Dashboard visuals now support alerts, to extend monitoring support with Data Activator. With integration with Data Activator, you'll receive timely alerts as your key metrics change in real-time. |
June 2024 | OneLake availability of Eventhouse in Delta Lake format GA | As part of the One logical copy promise, we're excited to announce that OneLake availability of Eventhouse in Delta Lake format is Generally Available. |
June 2024 | Real-Time Dashboards | Real-Time Dashboards interact with data dynamically and in real time. Real-Time Dashboards natively visualize data stored in Eventhouses. Real-time Dashboards support ultra-low refresh rates of just 1 or 10 seconds. For more information, see Visualize and Explore Data with Real-Time Dashboards. |
May 2024 | Eventhouse GA | Eventhouse is a new, dynamic workspace hosting multiple KQL databases, generally available as part of Fabric Real-Time Intelligence. An Eventhouse offers a robust solution for managing and analyzing substantial volumes of real-time data. Get started with a guide to Create and manage an Eventhouse. |
May 2024 | Copilot for Real-Time Intelligence | Copilot for Real-Time Intelligence is now in preview! For those who are already fans of KQL or newcomers exploring its potential, Copilot can help you get started, and navigate data with ease. |
May 2024 | Automating Fabric items with Real-Time Intelligence | Learn how to interact with data pipelines, notebooks, spark jobs in a more event-driven way. |
May 2024 | Real-Time Intelligence | This month includes the announcement of Real-Time Intelligence, the next evolution of Real-Time Analytics and Data Activator. |
May 2024 | Real-Time Intelligence new preview features | At Build 2024, a dozen new features and capabilities were announced for Real-Time Intelligence, organized into categories of Ingest & Process, Analyze & Transform, and Visualize & Act. |
May 2024 | Real-Time hub preview | Real-Time hub is single, tenant-wide, unified, logical place for streaming data-in-motion. It enables you to easily discover, ingest, manage, and consume data-in-motion from a wide variety of sources. It lists all the streams and Kusto Query Language (KQL) tables that you can directly act on. It also gives you an easy way to ingest streaming data from Microsoft products and Fabric events. For more information, see Real-Time hub overview. |
May 2024 | Get Events preview | The Get Events experience allows users to connect to a wide range of sources directly from Real-Time hub, Eventstreams, Eventhouse, and Data Activator. Using Get Events, bring streaming data from Microsoft sources directly into Fabric with a first-class experience. |
May 2024 | Enhanced Eventstream capabilities preview | With enhanced Eventstream capabilities, you can now stream data not only from Microsoft sources but also from other platforms like Google Cloud, Amazon Kinesis, Database change data capture streams, and more, using our new messaging connectors. |
May 2024 | Event streams - enhanced capabilities preview | The preview of enhanced capabilities supports many new sources - Google Cloud Pub/Sub, Amazon Kinesis Data Streams, Confluent Cloud Kafka, Azure SQL Database Change Data Capture (CDC), PostgreSQL Database CDC, MySQL Database CDC, Azure Cosmos DB CDC, Azure Blob Storage events, and Fabric workspace item events, and a new Stream destination. It supports two distinct modes, Edit mode and Live view, in the visual designer. It also supports routing based on content in data streams. For more information, see What is Fabric event streams. |
April 2024 | Kusto Cache consumption preview | The preview of Kusto Cache consumption means that you will start seeing billable consumption of the OneLake Cache Data Stored meter from the KQL Database and Eventhouse items. For more information, see KQL Database consumption. |
April 2024 | Pause and Resume in Eventstream preview | The Pause and Resume feature enables you to pause data streaming from various sources and destinations within Eventstream. You can then resume data streaming seamlessly from the paused time or a customized time, ensuring no data loss. |
For older updates, review the Microsoft Fabric What's New archive.
Real-Time Intelligence samples and guidance
Month | Feature | Learn more |
---|---|---|
August 2024 | Advanced Time Series Anomaly Detector in Fabric | Read an example using the time-series-anomaly-detector in Fabric to upload stocks change table to Fabric, train the multivariate anomaly detection model in a Python notebook using Spark engine, and predict anomalies by applying the trained model to new data using Eventhouse (Kusto) engine. |
August 2024 | Acting on Real-Time data using custom actions with Data Activator | Learn how to monitor and acting on data is to use Data Activator, which is a no-code experience in Microsoft Fabric for taking action automatically when the condition of the package temperature is detected in the data. |
July 2024 | Build real-time order notifications with Eventstream's CDC connector | Read about a a real-life example of how an online store used Eventstream's CDC connector from Azure SQL Database. |
July 2024 | Automating Real-Time Intelligence Eventhouse deployment using PowerShell | Let's build a PowerShell script to automate the deployment of Eventhouse, KQL Database, Tables, Functions, and Materialized Views into a workspace in Microsoft Fabric. |
May 2024 | Alerting and acting on data from the Real-Time hub | Microsoft Fabric's new Real-Time hub and Data Activator provide a no-code experience for automatically taking actions when patterns or conditions are detected in changing data and is embedded around the Real-Time hub to make creating alerts always accessible. |
May 2024 | Using APIs with Fabric Real-Time Intelligence: Eventhouse and KQL DB | Learn how to create/update/delete items in Fabric with the KQL APIs, accessing the data plane of a resource. |
May 2024 | Connect and stream events with the Get events experience | The Get events experience streamlines the process of browsing and searching for sources and streams. |
May 2024 | Acquiring Real-Time Data from New Sources with Enhanced Eventstream | Learn how to connect to new sources in Eventstream. Start by creating an eventstream and choosing "Enhanced Capabilities (preview)". |
Microsoft Fabric core features
News and feature announcements core to the Microsoft Fabric experience.
Month | Feature | Learn more |
---|---|---|
August 2024 | OneLake data access role improvements | Based on key feedback, we've updated data access roles with a user interface redesign. For more information, see Get started with OneLake data access roles (preview). |
August 2024 | Workspace filter improvement to support nested folders | We have upgraded the filter experience to support filtering through the entire workspace or through a specific folder with all its nested folders. |
August 2024 | Announcing the availability of Trusted workspace access and Managed private endpoints in any Fabric capacity | Use Trusted workspace access and Managed Private endpoints in Fabric with any F capacity and enjoy the benefits of secure and optimized data access and connectivity. |
July 2024 | SOC certification compliance | We are excited to announce that Microsoft Fabric, our all-in-one analytics solution for enterprises, is now System and Organization Controls (SOC) 1 Type II, SOC 2 Type II, and SOC 3 compliant. |
July 2024 | Microsoft Fabric .NET SDK | We are excited to announce the very first release of the Microsoft Fabric .NET SDK! For more information on the REST API documentation, see Microsoft Fabric REST API documentation. |
June 2024 | Power BI Admin portal Usage metrics dashboard retirement | Effective July 2024, the Power BI Admin portal Usage metrics dashboard is removed. Comparable insights are now supported out-of-the-box through the Admin monitoring workspace (preview). The Admin monitoring workspace provides several Power BI reports and semantic models, including the Feature Usage and Adoption report which focuses on Fabric tenant inventory and audit activity monitoring. |
May 2024 | Microsoft Fabric Private Links GA | Azure Private Link for Microsoft Fabric secures access to your sensitive data in Microsoft Fabric by providing network isolation and applying required controls on your inbound network traffic. For more information, see Announcing General Availability of Fabric Private Links. |
May 2024 | Trusted workspace access GA | Trusted workspace access in OneLake shortcuts is now generally available. You can now create data pipelines to access your firewall-enabled Azure Data Lake Storage Gen2 (ADLS Gen2) accounts using Trusted workspace access (preview) in your Fabric Data Pipelines. Use the workspace identity to establish a secure and seamless connection between Fabric and your storage accounts. Trusted workspace access also enables secure and seamless access to ADLS Gen2 storage accounts from OneLake shortcuts in Fabric. |
May 2024 | Fabric APIs walkthrough | Learn about using REST APIs in Fabric, including creating workspaces, adding permission, dropping, creating, executing data pipelines, and how to pause/resume Fabric activities using the management API. |
May 2024 | Managed private endpoints GA | Managed private endpoints for Microsoft Fabric allow secure connections over managed virtual networks to data sources that are behind a firewall or not accessible from the public internet. For more information, see Announcing General Availability of Fabric Private Links, Trusted Workspace Access, and Managed Private Endpoints. |
May 2024 | Fabric UX System | The Fabric UX System represents a leap forward in design consistency and extensibility for Microsoft Fabric. |
May 2024 | Microsoft Fabric Core REST APIs | Microsoft Fabric Core APIs are now generally available. The Fabric user APIs are a major enabler for both enterprises and partners to use Microsoft Fabric as they enable end-to-end fully automated interaction with the service, enable integration of Microsoft Fabric into external web applications, and generally enable customers and partners to scale their solutions more easily. |
May 2024 | Microsoft Fabric Admin APIs preview | Fabric Admin APIs are designed to streamline administrative tasks. Now, you can manage both Power BI and the new Fabric items (previously referred to as artifacts) using the same set of APIs. Before this enhancement, you had to navigate using two different APIs—one for Power BI items and another for new Fabric items. |
May 2024 | Fabric workload dev kit (preview) | The Microsoft Fabric workload development kit extends to additional workloads and offers a robust developer toolkit for designing, developing, and interoperating with Microsoft Fabric using frontend SDKs and backend REST APIs. |
May 2024 | Introducing external data sharing (preview) | External Data Sharing (preview) is a new feature that makes it possible for Fabric users to share data from within their Fabric tenant with users in another Fabric tenant. |
May 2024 | Task flows in Microsoft Fabric (preview) | The preview of task flows in Microsoft Fabric is enabled for all Microsoft Fabric users. With Fabric task flows, when designing a data project, you no longer need to use a whiteboard to sketch out the different parts of the project and their interrelationships. Instead, you can use a task flow to build and bring this key information into the project itself. |
For older updates, review the Microsoft Fabric What's New archive.
Continuous Integration/Continuous Delivery (CI/CD) in Microsoft Fabric
This section includes guidance and documentation updates on development process, tools, source control, and versioning in the Microsoft Fabric workspace.
Month | Feature | Learn more |
---|---|---|
July 2024 | GitHub integration for source control (preview) | Fabric developers can now choose GitHub or GitHub Enterprise as their source control tool, and version their Fabric items there. For more information, see Get started with Git integration (preview). |
July 2024 | Microsoft Fabric .NET SDK | We are excited to announce the very first release of the Microsoft Fabric .NET SDK! For more information on the REST API documentation, see Microsoft Fabric REST API documentation. |
June 2024 | Introducing New Branching Capabilities in Fabric Git Integration | New branching capabilities in Fabric Git integration include a redesigned Source Control pane, the ability to quickly create a new connected workspace and branch, and contextual related branches to find content related to the current workspace. |
May 2024 | Deployment pipelines APIs for CI/CD | Fabric deployment pipelines APIs have been introduced, starting with the 'Deploy' API, which will allow you to deploy the entire workspace, or only selected items. |
May 2024 | New items in Fabric CI/CD | Data pipelines, Warehouse, Spark, and Spark jobs are now available for CI/CD in git integration and deployment pipelines. |
April 2024 | Introducing Trusted Workspace Access in Fabric Data Pipelines | Create data pipelines in Fabric to access your firewall-enabled ADLS Gen2 storage accounts with ease and security. This feature leverages the workspace identity to establish a secure and seamless connection between Fabric and your storage accounts. |
For older updates, review the Microsoft Fabric What's New archive.
Continuous Integration/Continuous Delivery (CI/CD) samples
Month | Feature | Learn more |
---|---|---|
August 2024 | Exploration of Microsoft Fabric's CI/CD Features | A guided tour of Microsoft Fabric's CI/CD features for data pipelines, lakehouse, notebooks, reports, and semantic models. |
June 2024 | Getting started with development in isolation using a Private Workspace | In this walkthrough, we'll talk about how to set up git for a private workspace from a main branch, which is connected to a shared dev team workspace and then how to commit changes from the private workspace into the main branch of the shared workspace. |
Archive
For older updates, review the Microsoft Fabric What's New archive.