Error in copy activity-The linked service in sink dataset does not support sink.

KEERTHANA JAYADEVAN 66 Reputation points
2023-09-14T11:49:12.1666667+00:00

I am trying to build a pipeline which copies data from on prem to Google cloud storage.

I have a source csv dataset, setup the linked service with self hosted IR.

My sink is also csv Google cloud storage. While debugging, I'm getting the following error(screenshot):gcp.jpg

How can I resolve this?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,532 questions
{count} votes

2 answers

Sort by: Most helpful
  1. Amira Bedhiafi 22,691 Reputation points
    2023-09-14T14:26:22.6433333+00:00

    This error message you have means that the sink linked service isn't set up correctly or doesn't support the particular data transfer method you are attempting.

    Check on this link : https://stackoverflow.com/questions/75941650/can-we-use-adf-to-copy-data-into-google-cloud-stoarge

    I think based on the documentation :

    Google Cloud Storage only supports as Source of the copy the activity. Currently it is not supported as the sink of the copy activity.

    https://learn.microsoft.com/en-us/azure/data-factory/connector-overview#supported-data-stores

    0 comments No comments

  2. KranthiPakala-MSFT 46,462 Reputation points Microsoft Employee
    2023-09-14T18:14:14.3933333+00:00

    @KEERTHANA JAYADEVAN Welcome to Microsoft Q&A forum and thanks for reaching out here.

    As @Amira Bedhiafi rightly pointe out, Currently ADF Google cloud storage connector only supports as source but not as sink.

    To know more about what connectors support source and sink and applicable in other activities, please refer to this connectors documentations: ADF Connectors Overview
    User's image

    Possible workaround:
    As ADF doesn't have an out of box sink connector for Google cloud storage, if you can use the Google cloud Storage REST API's, then probably you can use REST Connector in COPY activity and Google cloud REST API to copy the content. Else you may also explore Custom Activity and write your own code to meet your business need.

    Hope this info helps.

    If the response/information from @Amira Bedhiafi was helpful please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.