Error creating table from spark "The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rwx-wx---"

Richard Luis Díaz 21 Reputation points
2021-01-11T16:34:32.613+00:00

55491-image.png

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,938 questions
{count} votes

2 answers

Sort by: Most helpful
  1. KranthiPakala-MSFT 46,492 Reputation points Microsoft Employee
    2021-01-11T19:34:26.963+00:00

    HI @Richard Luis Díaz ,

    Thanks for your query and using Microsoft Q&A forum.
    Are you experiencing this issue consistently or a transient one?

    To better understand if the error is really related to permissions or if it’s actually something else, could you please check if you have all permissions on the tmp/hive folder in ADLS Gen2

    55531-image.png

    If the issue is consistent and you have all permissions on tmp/hive folder, could you please confirm if you have immediately added the Storage Blob Data Contributor access to your ADLS Gen2 right after creating the Synapse workspace rather than later?

    The steps for adding user and workspace identity etc. with Storage Blob Data Contributor access must be added during actual installation/creating of workspace or immediately afterwards to take effect.

    Looking forward to your response.

    Thanks


  2. Richard Luis Díaz 21 Reputation points
    2021-01-16T09:43:02.74+00:00

    Hi, at the time of deploying the workspace, the Storage Blob Data Contributor permissions were added. Still, with the user who made the implementation I get the same error. In this case, are the identity credentials used? Or the user's permissions?

    57197-image.png

    To solve the problem quickly I had to provide "Other" permissions to write, read and execute at the ACL level. But I understand that this is not correct, I have not tried to give permissions to the identity, which could also be an option. The weird thing is that being Storage Blob Data Contributor it doesn't work.

    57333-image.png

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.