How to connect to secondary Azure data lake in Synapse via fsspec

Rama 0 Reputation points
2023-07-17T21:45:08.94+00:00

I am trying to connect to a secondary account via fsspec in synapse notebook but it fails saying KeyError: "Collision between inferred and specified storage options:\n- 'account_name'"

I think its because the adls_account_name which I am using is not the default one. Is there any way to set the linkedservice to secondary ADL?

User's image

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,553 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,296 questions
{count} votes

1 answer

Sort by: Most helpful
  1. PRADEEPCHEEKATLA 90,596 Reputation points
    2023-07-19T06:45:29.56+00:00

    @Rama - Thanks for the question and using MS Q&A platform.

    Kindly check the linked service connection which you are trying to connect. Make sure you are able to successfully connect to the storage account:

    User's image

    As per the repro, I'm able to successfully able to Write data using linked service without any issue:

    User's image

    Here is the output of the write file:

    User's image

    For more details, refer to Tutorial: Use FSSPEC to read/write ADLS data in serverless Apache Spark pool in Synapse Analytics

    In case, if you are unable to resolve the issue - please share the stack trace of the error message which you are experiencing? And the screenshot of the linked service connection?

    Hope this helps. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.