Azure Data Factory

1 answer

Azure Data Factory Rest Linked service returns Array og Json objects instead of Set of Json Objects

I have set up a Linked Service of type "REST" to copy data from an API to Blob storage. I have a copy activity, which uses a dataset from the Linked Service and a Json dataset on top of a Blob storage Linked service. The API that I am using,…

asked

Thomas Sørensen 0

commented

HimanshuSinha-msft 18,536 Microsoft Employee

0 answers

How to read .xls file with content type application/octet-stream using copy activity

Hi Team, I am not able to copy .xls file which having content type as application/octet-stream. Can you please help me to resolve this issue without changing file extension.

asked

Sharad Gawade 0

commented

BhargavaGunnam-MSFT 10,636 Microsoft Employee

1 answer

Dataflow Error: The spark job of Dataflow completed, but the runtime state is either null or still InProgress.

Hi Microsoft Team, I have this error whenever I run with "Debug" a pipeline that contains a Data Flow. I tried to create new pipeline, new Data Flow but still the same error. It can be reproduced all the time. My last Pipeline Run ID is:…

asked

Cosmin Nicolae Cristea 0

commented

Bert Natenstedt 1

1 answer

DAG runs stuck in running state using Azure Data Factory Managed Airflow (version 2.4.3)

I'm following Microsoft's tutorial on how does managed airflow work using the tutorial.py script referenced in the documentation (see code block below). I've set up my airflow environment in azure data factory using the same configuration in the…

asked

Pete Trenkwalder 5

commented

HimanshuSinha-msft 18,536 Microsoft Employee

0 answers

How to handle pagination with $skipToken in Azure Data Factory

I'm curious how to handle pagination with $skipToken in Azure Data Factory According to the documentation (Pagination support) it seems quite simple in case when we have @odata.nextLink to use as next URL (Microsoft Graph API), but it's more complicated…

asked

Bartosz Pelikan 36

commented

HimanshuSinha-msft 18,536 Microsoft Employee

1 answer

ADF Rest API - How To Handle "too many requests" error (429)

Hello, I am struggling with integrating API source into Azure SQL DB using Azure Data Factory. Problem is that I am getting "too many requests" error (429) randomly when trying to get data from API source. It looks like error is caused by some…

asked

Tomasz Swinarski 0

edited a comment

HimanshuSinha-msft 18,536 Microsoft Employee

1 answer

SFTP Error of Host Not Found in Azure Data Factory

Hello Team, Greetings of the Day!!! Getting error while connecting to SFTP in Azure Data Factory. Doing Azure Data Factory HOL Lab from GitHub :-…

asked

Niral Dave 5

commented

HimanshuSinha-msft 18,536 Microsoft Employee

0 answers

how to dynamically transform one activity output and feed in another activity in ADF

If I directly give (@{item().id} @{item().col1} @{item().col2} @{item().name} @{item().col5}) in set variable is gives back result "C0004\t1000\t\tAT020\t1102" but I give the activity output (@activity('Lookup_DB_column…

asked

Arundhati Sen 101

commented

BhargavaGunnam-MSFT 10,636 Microsoft Employee

1 answer

String was not recognized as a valid DateTime

Hi team, The data in my excel is in format dd-MM-yyyy but while copying to azure postgressql database, I am getting error saying that "String was not recognized as a valid DateTime". Could you please help me on this asap

asked

Dinesh Prajapati 86

commented

HimanshuSinha-msft 18,536 Microsoft Employee

I have an existing GitHub repository and I want to import resources from my ADF Live environment to the repo. I can connect to it fine and browse the repos in my account, but when I click Import I get this error. You don't have permission to import…

asked

Mark Allison 126

commented

Mark Allison 126

3 answers

Issue with ADF Pipeline loosing Connectivity Refreshing Analaysis services Model

Erroor Recieved - Operation on target ThrowErrorOnFailure failed: Error calling the endpoint ''. Response status code: 'NA - Unknown'. More details: Exception message: 'NA - Unknown [ClientSideException] Invalid URI: The URI scheme is not valid.'. …

asked

Elvin Caldwell 1

commented

83390558 0

1 answer

ADF Dataflows flatten a JSON using unroll by not working.

Hi I have a JSON like this in my file and i am trying t flatten it using the flatten transformation in dataflow. when i click on unroll by all the elements are displayed but i am unable to select any.. how can i do that .? or is there any other way i…

asked

Tarapareddy,Saikrishna 61

answered

KranthiPakala-MSFT 35,932 Microsoft Employee

0 answers

Error code 3608: 'Invoking Azure function failed with HttpStatusCode - InternalServerError.'

Dear Team, Pipelines are getting failure because of this Error associated with Azure Function. Please assist me with your solution.

asked

Rajkumar Govindaraj 20

edited the question

Rajkumar Govindaraj 20

0 answers

ADF - Run an activity if any one of a set of activities fail and capture failed activity details in that activity

Currently I am running one generic activity when any of the activities in the pipeline fail based on the answer provided in https://learn.microsoft.com/en-us/answers/questions/208812/adf-run-an-activity-if-any-one-of-a-set-of-activit But I want to…

asked

Prasad Ambulkar 0

edited the question

Prasad Ambulkar 0

0 answers

Nested Execute Pipeline issue in ADF master pipeline

Hi ,In my case i have a master pipeline which has nested Execute pipelines like execute1 pipeline contains lookup and foreach inside foreach execute2 .inside execute 2 get metadata and and foreach again inside foreach execute3 .execute3 contains lookup…

asked

Prapul Kumar Dongari 71

Filter

Content

6,716 questions with Azure Data Factory tags