The file updated in databricks is not reflecting in Azure Portal

Amey Pimpley 1 Reputation point
2020-12-11T03:08:59.943+00:00

I have a databrick workspace, where I read a file from Azure blob storage, updated a file and uploaded it in another Azure blob storage space. Now when I access that file through any databricks workspace, I can see the file and access the content of it. But when I check the file in Azure storage space, I can't see that file at all. Attaching the pics for both the scenarios.

Is there any known issue? or I need to do some changes to reflect it in Azure blob storage.

47138-microsoftteams-image-1.png47265-microsoftteams-image.png

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,938 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. PRADEEPCHEEKATLA-MSFT 77,751 Reputation points Microsoft Employee
    2020-12-11T10:07:22.35+00:00

    Hello @Amey Pimpley ,

    Thanks for the ask and using the Microsoft Q&A forum.

    Could you please verify you are using the same storage account? And also please do clarify this statement "updated a file and uploaded it in another Azure blob storage space".

    Reason: The above screenshots didn't match with each other /mnt shows the different file name and Azure Portal shows different file name.

    Example: When you check the files available in mnt/log-parquet-archive/H19/BGM shows H194787.parquet and file available from Azure portal /log-parquet-archive/H19/BGM shows db test.txt.

    It should show the same file when you check in Azure Databricks or Azure Portal like shown below:

    Azure Databricks view:

    47402-image.png

    Azure Portal view:

    47385-image.png

    Hope this helps.