"BadRequest" error while trying to test a connection in a BLOB source on Azure Data Factory

Question

I have a BLOB dataset in Azure Data Factory with some JSON files that I want to feed into a Data Flow. The connection to the BLOB itself seem to be working since when I click "Test Connection" it gives me a green icon, and it is able to load some preview data. However, when I go to the Data Flow and select this Dataset as a source, the "Test Connection" button gives me the following error:

BadRequest - RunId: d1507e64-538d-4c06-a1ab-b68ac72b8af0

Which doesn't help much. What is possibly happening here?

Answer 1

Hi Ícaro Costa ,

Welcome to Microsoft Q&A platform and thanks for posting your question here. As I understand your issue you are facing an error : "BadRequest" when you are trying to test connection of a JSON dataset inside your dataflow. Please let me know if that is not the case .

Make sure you are not using Self hosted IR in dataflow since Dataflow only supports Auto Resolve Integration Runtime

Point the linked service to AutoResolve Integration Runtime that is the default IR in Azure datafactory.

---

Hope it helps. Please do consider clicking Accept Answer and Up-Vote for the same as accepted answers help community as well.

Answer 2

I think I understood what the problem was, I was using different integration runtimes to test the different connections. So, the problem is resolved if you select the same integration runtime you used to connect the dataset on the debug session.

Answer 3

I resolved this issue by restarting the debug flows (sometimes the engine not find the spark engine)