Managed attributes in the Microsoft Purview Data Map
Managed attributes are user-defined attributes that provide a business or organization level context to an asset. When applied to assets, managed attributes enable data consumers using the data catalog to gain context on the role an asset plays in a business.
Terminology
Managed attribute: A set of user-defined attributes that provide a business or organization level context to an asset. A managed attribute has a name and a value. For example, 'Department' is an attribute name and 'Finance' is its value. Attribute group: A grouping of managed attributes that allow for easier organization and consumption.
Create managed attributes
- Open managed attributes in the Microsoft Purview Data Map:
- If you're using the Microsoft Purview portal (https://purview.microsoft.com):
- Open the data map application
- Select the Metamodel dropdown
- Select Managed attributes
- If you're using the classic Microsoft Purview governance portal (https://web.purview.azure.com):
- Open the Microsoft Purview Data Map
- Select Managed attributes under the Annotation management section.
- If you're using the Microsoft Purview portal (https://purview.microsoft.com):
- Select New. Choose whether you wish to start by creating an attribute group or a managed attribute.
- To create an attribute group, enter a name and a description.
- Managed attributes have a name, attribute group, data type, and associated asset types. They also have a required flag that can only be enabled when created as part of creating a new attribute group. Associated asset types are the data asset types you can apply the attribute to. For example, if you select "Azure SQL Table" for an attribute, it will be applied to Azure SQL Table assets, but not Azure Synapse Dedicated Table assets.
- Select Create to save your attribute.
These attributes will be automatically applied to the specified resources without a value. You'll need to apply a value for each asset.
Required managed attributes
When you create a managed attribute as part of a managed attribute group, you can add the required flag. The required flag means that a value must be provided for this managed attribute. When a data asset is edited the required attribute must be filled out before you can close the editor.
Note
- You can't add the required flag to an existing attribute in editing.
- You can't add the required flag while creating a new attribute outside of an attribute group. You can only add this flag while creating an attribute group.
- Open the data map application and navigate to Managed attributes in the Annotation management section.
- Select New and select Attribute group.
- Select New attribute.
- Fill out your attribute details, and select the Mark as required flag.
- Select Apply and finish adding other attributes to complete your attribute group.
Add value for managed attribute
Once a managed attribute has been created, you'll need to add a value for each of your assets. You can add values to your assets by:
- Search for your data asset in the Microsoft Purview Data Catalog
- On the overview for your asset, you should see the managed attributes section with all attributes that have values. (You can see attributes without values by using the Show attributes without a value toggle.)
- Select the Edit button.
- Under Managed attributes, add values for each of your attributes.
- If any attributes are Required you will not be able to save until you've added a value for that attribute.
Expiring managed attributes
In the managed attribute management experience, managed attributes can't be deleted, only expired. Expired attributes can't be applied to any assets and are, by default, hidden in the user experience. By default, expired managed attributes aren't removed from an asset. If an asset has an expired managed attribute applied, it can only be removed, not edited.
Both attribute groups and individual managed attributes can be expired. To mark an attribute group or managed attribute as expired, select the Edit icon.
Select Mark as expired and confirm your change. Once expired, attribute groups and managed attributes can't be reactivated.
Create managed attributes using APIs
Managed attributes can be programmatically created and applied using the business metadata APIs in Apache Atlas 2.2. For more information, see the Use Atlas 2.2 APIs tutorial.
Searching by managed attributes
Once you have created managed attributes, you can refine your data catalog searches using these attributes.
In a data catalog search, to refine by a managed attribute, first select Add filter at the top of the search.
Select the drop-down, scroll to your list of managed attributes, and select one.
Select your operator, which will be different based on the kinds of values allowed by the attribute. In this example, we've selected Cost Center, which is a text value, so we can compare Cost Center with the text we'll enter.
Enter your values and the search will run with your new filter.
Best practices for using managed attributes
Use managed attributes to extend the fields available for an asset in the Microsoft Purview Data Catalog. Managed attributes are key-value pairs that add structured metadata to your data catalog. When Microsoft Purview scans data, it adds technical information about the data like data type, classification, etc. If you want to add more fields, you’ll need to define managed attributes.
In the following example, a managed attribute lets me tag tables with the department that publishes them. I use a managed attribute because I want to make sure assets are always tagged in exactly the same way with this information. I also want to filter by the publisher field when I search for data.
The managed attribute in this example helps people quickly find all data published by the supply chain team, but doesn't help someone understand the definition of a publisher or what it means if supply chain is the publisher of the data. For any information that needs a business explanation, use terms.
Known limitations
Below are the known limitations of the managed attribute feature as it currently exists in Microsoft Purview.
- Managed attributes can only be deleted if they haven't been applied to any assets.
- Managed attributes can't be applied via the bulk edit experience.
- After creating an attribute group, you can't edit the name of the attribute group.
- After creating a managed attribute, you can't update the attribute name, attribute group or the field type.
- A managed attribute can only be marked as required during the creation of an attribute group.