Fabric Data fetching API

Shubham 0

I have created an azure app from which I need to pull user data present on their fabric workspaces (lakehouses, warehouses etc.).
Fabric APIs like :

GET https://api.fabric.microsoft.com/v1/workspaces/<workspace_id>/lakehouses/<lakehouse_id>

returns onelake paths and connection strings like :

{

  "id": "<lakehouse_id>",

  "type": "Lakehouse",

  "displayName": "TestLakehouse",

  "description": "",

  "workspaceId": "<workspace_id>",

  "properties": {

    "oneLakeTablesPath": "https://onelake.dfs.fabric.microsoft.com/<workspace_id>/<lakehouse_id>/Tables",

    "oneLakeFilesPath": "https://onelake.dfs.fabric.microsoft.com/<workspace_id>/<lakehouse_id>/Files",

    "sqlEndpointProperties": {

      "connectionString": ".........dcgootakasfs4i.datawarehouse.fabric.microsoft.com",

      "id": "<connection_id>",

      "provisioningStatus": "Success"

    }

  }

}

I have access token from this api:

https://login.microsoftonline.com/common/oauth2/v2.0/token

But not able to access onelake api with this and what can I use to connect with connection string returned in response without any authorization.

Is there any other way to access data stored on the fabric workspace.

Amira Bedhiafi 26,656 Reputation points

2024-09-05T19:51:01.1066667+00:00
Make sure that the token you are obtaining has the correct scope for accessing the Fabric APIs. When you request the token from https://login.microsoftonline.com/common/oauth2/v2.0/token, it must include the proper scopes related to Fabric APIs.

You need to specify the correct resource or scope parameter when requesting the access token. For Fabric APIs, you might need to provide specific resource identifiers such as:

scope=https://fabric.microsoft.com/.default

In your code, ensure that you are calling the correct API endpoint with the workspace and lakehouse IDs. From your example:

GET https://api.fabric.microsoft.com/v1/workspaces/<workspace_id>/lakehouses/<lakehouse_id>

The connectionString that you received in the response is likely to be used for querying data, especially if it’s a SQL endpoint. You can use this connection string to query the data using a tool or SDK that supports SQL-like access to Azure resources.

For example, in Azure Data Factory (ADF) or Synapse, you can use the returned connectionString to create a linked service or a dataset.

If you are connecting to the SQL endpoint in a custom application, you can use libraries like SQLAlchemy:

from sqlalchemy import create_engine # Use the connection string returned by the API connection_string = "your_connection_string_from_api" engine = create_engine(f'mssql+pyodbc:///?odbc_connect={connection_string}') with engine.connect() as connection: result = connection.execute("SELECT * FROM your_table") for row in result: print(row)

If you are accessing OneLake data (using the oneLakeTablesPath or oneLakeFilesPath), ensure that:

Your OAuth2 token is valid for OneLake access.

You may need to use Azure Blob storage SDK or ADLS Gen2 SDK to interact with those paths since OneLake is built on top of ADLS (Azure Data Lake Storage).

from azure.storage.filedatalake import DataLakeServiceClient servicefrom azure.storage.filedatalake import DataLakeServiceClient service_client = DataLakeServiceClient(account_url="https://<workspace_id>.dfs.fabric.microsoft.com", credential="your_token") # Access a specific file system or directory file_system_client = service_client.get_file_system_client(file_system="<lakehouse_id>")

If you're using Azure Data Factory (ADF) to connect to these resources, you should create linked services for the data source:

For the oneLakeTablesPath and oneLakeFilesPath, you can use ADF's ADLS Gen2 linked service.

For the SQL connection string, you can use ADF's Azure SQL or Synapse linked service.
Smaran Thoomu 17,120 Reputation points Microsoft Vendor

2024-09-06T19:02:12.3666667+00:00

@Shubham Following up to see if the below answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Shubham 0

I am using these scopes :

"https://api.fabric.microsoft.com/Workspace.ReadWrite.All", "https://api.fabric.microsoft.com/Item.ReadWrite.All", "https://api.fabric.microsoft.com/SQLEndpoint.Execute.All", "https://api.fabric.microsoft.com/Lakehouse.ReadWrite.All"


connection_string = f"Driver={{ODBC Driver 18 for SQL Server}};Server={server};Authentication=ActiveDirectoryServicePrincipal;UID={client_id};PWD={client_secret};TrustServerCertificate=no"

but while connecting with above I either get login timeout or authentication failed.

Smaran Thoomu 17,120 Reputation points Microsoft Vendor

2024-09-11T06:15:52.36+00:00

@Shubham Following up to see if the below answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

1 answer

Smaran Thoomu 17,120 Reputation points Microsoft Vendor

2024-09-05T21:46:08.3166667+00:00

@Shubham - Thanks for the question and using MS Q&A platform.

Microsoft Fabric is currently not supported in the Q&A forums, the supported products are listed over here https://docs.microsoft.com/en-us/answers/products (more to be added later on).

Can you please open as a new thread in MS Fabric community: https://community.fabric.microsoft.com/t5/General-Discussion/bd-p/ac_generaldiscussion

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Please sign in to rate this answer.
Smaran Thoomu 17,120 Reputation points Microsoft Vendor

2024-09-09T10:21:10.7566667+00:00

@Shubham Following up to see if the above answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Fabric Data fetching API

1 answer

Your answer