ADF can not parse Parquet files

Melih Kavraz 1 Reputation point
2022-11-24T08:21:06.88+00:00

I have a pipeline that consist copy data activity like following;

263746-screenshot-2022-11-24-at-111959.png

I installed OpenJDK on all servers where we use our Integration Runtime. But still, I get error like the following;

 {  
        "errorCode": "2200",  
        "message": "ErrorCode=JreNotFound,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Java Runtime Environment cannot be found on the Self-hosted Integration Runtime machine. It is required for parsing or writing to Parquet/ORC files. Make sure Java Runtime Environment has been installed on the Self-hosted Integration Runtime machine.,Source=Microsoft.DataTransfer.Richfile.ParquetTransferPlugin,''Type=System.DllNotFoundException,Message=Unable to load DLL 'jvm.dll': The specified module could not be found. (Exception from HRESULT: 0x8007007E),Source=Microsoft.DataTransfer.Richfile.HiveOrcBridge,'",  
        "failureType": "UserError",  
        "target": "Copy data1",  
        "details": []  
    }  

It seems Integration Runtime can not detect OpenJDK files, I wonder, should I install Oracle JDK instead of OpenJDK?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,379 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,651 questions
{count} votes

2 answers

Sort by: Most helpful
  1. AaronHughes 396 Reputation points
    2022-11-25T09:01:23.423+00:00

    if your using the SHIR
    you need jre 8 to read or write to parquet - this is a basic install for the functionality

    if openjdk then there is some updating needed - follow -

    https://learn.microsoft.com/en-us/azure/data-factory/format-parquet#using-self-hosted-integration-runtime

    264213-image.png

    1 person found this answer helpful.
    0 comments No comments

  2. ShaikMaheer-MSFT 38,551 Reputation points Microsoft Employee Moderator
    2022-11-25T08:43:39.2+00:00

    Hi @Melih Kavraz ,

    Thank you for posting query in Microsoft Q&A Platform.

    Similar issue was addressed in below link. Kindly recheck all the points mentioned there met in your case or not.
    https://stackoverflow.com/questions/53424666/unable-to-load-dll-jvm-dll-the-specified-module-could-not-be-found-azure-data-fa

    Hope this helps. Please let me know if any further queries.

    --------------------

    Please consider hitting Accept Answer button. Accepted answers help community as well.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.