ADF to Hive using Linked service

ADFARI23 21 Reputation points
2022-08-16T20:08:25.9+00:00

We have created a linked service to Hive in data factory and using copy activity to bring data from Hive to SQL MI. Usual queries are working fine but sub-queries are not working and getting time out issue. Please see the below sample query and error message

select * from custtable where modifieddate in (select max(modifieddate) from custtable)

Error:

ERROR [HY000] [Microsoft][Hardy] (35) Error from server: error code: '1' error message: 'Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask'.,Source=Microsoft.DataTransfer.Runtime.GenericOdbcConnectors,''Type=System.Data.Odbc.OdbcException,Message=ERROR [HY000] [Microsoft][Hardy] (35) Error from server: error code: '1'

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,528 questions
{count} votes