How to connect to a Kerberized Hive

Felipe González 1 Reputation point
2021-03-17T18:55:34.057+00:00

Hi everyone, I have a Kerberized Hadoop environment (hive, hbase, hdfs, etc) and I would like to use ADF to connect to my Data Lake and process data. Reviewing the ADF documentation it is does not exists support to kerberos from hive connector, so my question is about what kind of alternatives do I have to connect to my environment and working with my data. Thank you

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,150 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. KranthiPakala-MSFT 46,442 Reputation points Microsoft Employee
    2021-03-17T19:28:37.177+00:00

    Hi @Felipe González ,

    Welcome to Microsoft Q&A forum and thanks for your query.

    There was recent discussion on the same requirement in this thread : ADF connection to Hive Kerberos auth?

    As called out in the documentation Kerberos authentication is not supported by ADF native Hive connector.
    In order to workaround, the product team suggested to give a try with ODBC connector with Hive driver and see if that helps. The user in the above thread confirmed that they were able to use ODBC connector for Kerberos auth.

    I would also recommend you to please share your feedback/suggestion in ADF user voice forum: https://feedback.azure.com/forums/270578-azure-data-factory
    All the feedback shared in this forum are actively monitored and reviewed by ADF engineering team. Also please do share the feedback link here once it is posted, as it would help other users to upvote and/or comment on the idea which would help to increase the feature request implementation.

    Hope this helps.

    ----------

    Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.