Error "The 'Authorization' header is missing" when using web activity in ADF to access Key Vault values
Hi,
This post is written to ask for help on an issue we ran into when following https://medium.com/analytics-vidhya/azure-data-factory-access-microsoft-graph-api-3bbab165eb40 to access Graph API using ADF. The link will be super useful in understanding the context of the question.
An unexpected error populated at the beginning for the web activity to extract the key vault secret firstly saying link missing API version, after updated the API version at the end of URL a new error pop up as 400 Bad Request without further details on what exactly the error is. By following https://the.agilesql.club/2021/03/adf-error-trying-to-debug-pipeline-badrequest/ we were able to find the root cause by the network tab using chrome dev tools as shown below:
{"error":{"code":"AuthenticationFailed","message":"Authentication failed. The 'Authorization' header is missing."}}
Since both errors are not alarmed in the medium instruction mentioned at beginning, can anyone help us to solve this issue to get the pipeline work? If this is not the way you think is the best practice to access Graph API using ADF, any other similar detailed instruction shared is extremely appreciated.
Many thanks and happy holidays in advance!