Scan Big Query in Purview. Zone Europe-west

Ortiz Ocio Leire TEF-D 20 Reputation points
2023-10-24T10:01:45.2833333+00:00

I need to run an scan for BigQuery, I have set up the scan, like this:

User's image

The output is always the same, it doesn't matter if I define a dataset or not.

User's image

From my VM I can access, and query and retrieve results for all the existing datasets under that configuration.

However the log on the IR, give me this error:

User's image

Could you please tell me, what specific list of permissions are required to apply in Big Query for this connection?

Thanks !

Microsoft Purview
Microsoft Purview
A Microsoft data governance service that helps manage and govern on-premises, multicloud, and software-as-a-service data. Previously known as Azure Purview.
968 questions
{count} votes

Accepted answer
  1. KranthiPakala-MSFT 46,427 Reputation points Microsoft Employee
    2023-11-14T23:53:02.8+00:00

    @Ortiz Ocio Leire TEF-D I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others Opens in new window or tab", I'll repost your solution in case you'd like to accept the answer Opens in new window or tab.

    As the error message is not relevant to the actual issue and misleading users, I'll report this to respective product owners to enhance the error message.

    Error Message:

    • User's image

    Solution:

    • The reason why it was blocking the scan was due to Big Query JDBC version. The version '01.02.21.1025' is not valid. Using the version: 1.3.0.1001 it works.

    If I missed anything please let me know and I'd be happy to add it to my answer, or feel free to comment below with any additional information.

    I hope this helps!

    If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.

    0 comments No comments

1 additional answer

Sort by: Most helpful
  1. KranthiPakala-MSFT 46,427 Reputation points Microsoft Employee
    2023-10-24T16:47:58.7233333+00:00

    @Ortiz Ocio Leire TEF-D Thanks for using Microsoft Q&A forum and posting your query.

    From the screenshot you have shared, I notice that your dataset location is Europe-West3. That could the reason you are seeing this error.

    In the official connector documentation, there is a limitation stated related to dataset region for BigQuery projects. Currently, Microsoft Purview only supports scanning Google BigQuery datasets in US multi-regional location. If the specified dataset is in other location e.g. us-east1 or EU, you will observe scan completes but no assets shown up in Microsoft Purview or unexpected errors.

    Doc link: Google BigQuery - Microsoft Purview Known limitations
    User's image

    Please consider changing the region in the schema and re-ran the Purview scan.

    In addition, please ensure provide necessary permissions to your schema and the Project as discussed in this thread: Scan BigQuery in Microsoft Purview

    Hope this info helps. Let us know how it goes.


    Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

    0 comments No comments