Custom Rule Classification Tagging

Question

Hi Team,

I want to confirm if I have 900 + tables with n number of columns. I have created 140 custom rules, and if I run incremental scan then I found out only few columns got mapped, however other eligible columns didn't get map. Is there a limit in scans that only top 200 columns will be mapped? and we will have to keep running scans until it is all mapped. Please confirm.

Please Note - We have total 900+ columns and created customer rules around 142, 400 columns were not mapped in incremental scan.

Answer 1

@Sharma, Praghya (CONTRACTOR) - Thanks for the question and using MS Q&A platform.

There is no limit on the number of columns that can be mapped using custom rules in Microsoft Purview. However, there are a few things to keep in mind that may affect the mapping of columns:

Make sure that the custom rules are defined correctly and are targeting the correct columns. If the rules are not defined correctly, then the columns may not be mapped correctly.

When running an incremental scan, only the changes since the last scan will be picked up. If the columns were not mapped in the previous scan, then they will not be picked up in the incremental scan. You may need to run a full scan to ensure that all columns are mapped.

The mapping of columns may also depend on the data type and format of the columns. If the data type or format of the column is not recognized by Purview, then it may not be mapped correctly.

In your case, since you have 900+ columns and only 400 columns were not mapped in the incremental scan, it is possible that the custom rules are not targeting the correct columns or the data type or format of the columns is not recognized by Purview. I would recommend reviewing the custom rules and the data types and formats of the columns to ensure that they are defined correctly. If necessary, you may need to run a full scan to ensure that all columns are mapped.