How do I add header with token in Azure Data Factory

Magnus 26

Hi!

I'm trying to connect to a GraphQL api with the http connector in Azure Data Factory. GraphQL wants a header in this format:

Authorization: token xxxxxxxxxxxxx

How do I add that header?

/Magnus

3 answers

MartinJaffer-MSFT 26,011 Reputation points

2022-03-07T21:05:47.753+00:00
Hello @Magnus ,
Thanks for the question and using MS Q&A platform.

As we understand the ask here is how to add the authorization header when using http connector . Note, usually I see Authorization: Bearer XXXX not Authorization: token XXXX. Please double check which one it should be in your case.

Open the dataset, and add a parameter. In this example I can calling it tokenparam.

In the Additional Headers textbox enter the following dynamic content: @markus.bohland@hotmail.de ('Authorization: token ',dataset().tokenparam)

Go to the copy activity and find the new place to enter parameter value. Reference wherever you are getting the token value from.

Please do let me if you have any queries.

Thanks
Martin

Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

Want a reminder to come back and check responses? Here is how to subscribe to a notification

If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
Please sign in to rate this answer.

1 person found this answer helpful.
Magnus 26 Reputation points

2022-03-08T11:39:16.42+00:00

Hi! Thanks for trying to help. If I change to Bearer I get this so yes it must be token.

The dataset is a http json. If I do like you suggested and then click Preview data I get "Bad Json". As you can see I'm posting a GraphQL query and I've tried in a number of ways, without Query, with Query. I don't know if it's that that is the issue here. Do I need to add an additional header application/json?
Sign in to comment
Magnus 26 Reputation points

2022-03-09T08:00:47.387+00:00

Sorry for the last post. It returns "Invalid json syntax". If I haven't published a pipeline is there any way in ADF to see what is returned when Previewing data?
Please sign in to rate this answer.
MartinJaffer-MSFT 26,011 Reputation points

2022-03-10T18:01:45.953+00:00

Ahh, I think I know what is happening this time. When you did "Preview Data", it needed to give a value for the token. Since preview only takes into account the current activity, it doesn't run other activities. Thus it tries to use the default value for the token. If the default value wan't valid, then an error message was probably returned instead of data. So the error message wasn't valid JSON.

TLDR: temporarily try pasting in a current and valid token instead of passing through parameters. This should work for preview. Or put it in the default values.

@Magnus

Magnus 26 Reputation points

2022-03-14T09:44:45.48+00:00

I tried to do as you proposed but the same error. I created a new pipeline with an web activity and used json as a dataset without paramters. Then created the Authorizaton header with token. Same error

Look at the respone.

MartinJaffer-MSFT 26,011 Reputation points

2022-03-16T16:47:16.17+00:00

Invalid JSON syntax.... okay. So looking at your request message body...

query { employees(last: 1000) { edges { ...

That is not JSON.

Is the response body expected to return JSON @Magnus ?

Magnus 26 Reputation points

2022-03-17T08:52:13.613+00:00

Yes it returns pure json. It works if I use the http client in a C# console app or using a Python script, I've tested both.

Magnus 26 Reputation points

2022-03-18T13:18:00.42+00:00

Yes the response returns JSON. It works if I code in C# using the http client or in Python.
Sign in to comment
Magnus 26 Reputation points

2022-05-12T08:13:19.413+00:00

I solved this, sorry for late reply all.

First of all I moved the authorization to the Linked service

Then I created a Json dataset and connected it to the Linked service.

Added a Copy Data in the pipeline and set the properties to this

What's really really important here is the formatting of the GraphQL in the Request Body. The data has to be on one line, no line breaks. The spacing is also very important to get it to work.

Hope this helped someone.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment