Microsoft Azure emissions insights (preview)
Important
Some or all of this functionality is available as part of a preview release. The content and the functionality are subject to change.
The Microsoft Azure emissions insights (preview) capability helps you to centralize, query, and analyze your Azure emissions data. You can analyze the trends over time for your emissions by subscriptions and resources and develop insights into the top emissions contributors. Explore your Azure emissions data with interactive dashboards, where you can compare, slice, and drill down the data by time and resources. You can also run analytical queries and create custom reports on the Azure emissions data in lakehouses. These reports provide actionable insights that help identify opportunities to reduce your Microsoft cloud emissions.
The items deployed in this capability include notebooks and lakehouses that ingest, aggregate and store data. This solution deploys these three lakehouses:
- ConfigAndDemoData: Stores the demo data.
- IngestedRawData: Stores raw data from external data sources.
- AggregatedData: Stores the aggregated data that you can use to analyze emissions.
All resources that this solution deploys are prebuilt and deployed into your Microsoft Fabric workspace. The resources are open, and you can customize them to meet your needs. The Microsoft Azure emissions insights (preview) capability includes the following features:
Import and transform data
You can bring data from disparate data sources to your IngestedRawData lakehouse where the data is stored without any modifications or transformations. This capability deploys three lakehouses, two notebooks, one dataset, and one report.
For a quick start, this capability also comes with demo data. You can set up the capability along with demo data by following the instructions in Set up demo data for Sustainability data solutions in Microsoft Fabric (preview).
Important
Don't change any files in the ConfigAndDemoData folder, because the report might not work for demo data.
Prerequisites
Microsoft Cloud for Sustainability APIs for Azure support EA Direct, MCA, and MPA accounts with direct billing relationships with Microsoft. Customers who purchase Azure from a Cloud Solution Provider (CSP) aren't supported and must work directly with their CSP to learn about their cloud emissions. Legacy accounts, credits-based accounts, China enrollments, and Azure Government accounts aren't supported. To check your account type, go to Check the type of your account.
To successfully enable access to your organization's data, a relevant administrator must perform the first-time setup. Azure MCA accounts require a billing account administrator with a role as billing account reader, contributor, or owner. Azure EA accounts require an enterprise administrator or enterprise administrator - read-only. Check your role in the Azure portal.
Set up the data for Azure emissions
When you deploy the Azure emissions analytics (preview) capability in Sustainability data solutions in Fabric, it takes a few minutes to pull your Azure emissions data into your IngestedRawData lakehouse. You can monitor the status in the Monitoring hub of your workspace.
After the data loads in the IngestedRawData lakehouse, you can enrich and transform it with these steps:
- Run the LoadEmissionsDataToTables notebook with the SOURCE_ABFSS_PATH variable set to RAW_DATA_EMISSIONS_ABFSS_PATH to copy the raw data from the Files section of IngestedRawData lakehouse to the Tables section of the AggregatedData lakehouse.
Note
Microsoft Azure emissions insights (preview) only supports full refresh snapshots. Before loading the demo data, ensure you don't have any of your data in the tables of the AggregatedData lakehouse. If data exists, it will be overwritten.
- Run the GenerateAggregateTables notebook to modify the tables that are compatible with the report. This notebook also performs a few data aggregations to provide more insights about the emissions data.
Import the latest data in the lakehouse
To fetch the latest emissions data into the IngestedRawData lakehouse, select the Update data button in the Items in this deployment section.
It takes a few minutes to pull your Azure emissions data into your IngestedRawData lakehouse. You can monitor the status in the Monitoring hub of your workspace.
When the data finishes updating, you can follow the steps in Set up the data for Azure emissions and Data visualization and analysis.
Visualize data and analytics
After the data loads into the tables, you can use the prebuilt Power BI dashboard for analyzing the emissions with these steps:
Provide your credentials. You can skip this step if you already provided your credentials.
Open the AnalyzeAzureEmissionsDataset semantic model from your workspace or from the Microsoft Azure emissions insights (preview) capability detail page.
On the top left, select File, and then select Settings. In the Data source credentials section, select Edit credentials.
Provide your Fabric credentials in the dialog box for authenticating the AggregatedData lakehouse data source. Select the following values:
Field Value Authentication method OAuth2 Privacy level setting for this data source Organizational Select Sign in.
Go back to the semantic model home page and select Refresh now from the Refresh menu option. After the refresh completes, the dataset is refreshed with data from the AggregatedData lakehouse.
If there are any errors in the refresh, you can find the error details by viewing the Refresh history option on the Refresh menu.
- Open the AnalyzeAzureEmissions report from the capability detail page or from your workspace. The report with the emissions data appears.
Note
Emissions data only appears if the data exists in the AggregatedData lakehouse.