synapse studio and existing data factory development

Question

synapse studio and existing data factory development

I have an existing azure data factory with pipelines data flows linked servers etc. publishing to my synapse DB, Im confused how this integrates with synapse studio. do I need to migrate the data factory to synapse studio and if so How is this accomplished ?

is there a route to publish to Data Factory. ie connect to data factory and publish goes to it ?

Until it launched I thought from comments and blogs on line from the preview that it was an environment like visual studio with "Deployments" ?

Apologies for the multiple questions but they are related.

HimanshuSinha-msft 18,621 Reputation points Microsoft Employee

2020-12-07T23:08:48.657+00:00

Hello @Colin Robinson ,

Thanks for the ask and using the forum .
Can I request you to please eloborate what do you mena by "publishing to my synapse DB" ? Do you mean that the sink is Synapase ? As I understand the ADF is working just fine , why do you want to migrate that ?

Thanks
Himanshu
Silvano P 91 Reputation points

2020-12-07T23:14:15.727+00:00

Hello @HimanshuSinha-msft ,

Probably @Colin Robinson wants to have everything under Synapse Studio.

It will make sense to have everything in one place, that's one of the huge advantage of Synapse.

I have the same request, I have Dataset, Self Integration Runtime, pipelines etc. etc. what is the best practice to migrate a Data Factory Pipeline to a Synapse Pipeline?

Thank you so much
HimanshuSinha-msft 18,621 Reputation points Microsoft Employee

2020-12-10T21:07:16.91+00:00

Hello @Colin Robinson ,
There is not automatic export/import yet.

We can manually export current ADF dataflow descriptions and import into Synapse pipeline. Have they tried that?

Linked Service and Data Set concepts are same.

Quickstart: Transform data using a mapping data flow - Azure Synapse Analytics | Microsoft Learn

Hello,

I request the ask to be logged here .

https://feedback.azure.com/forums/307516-azure-synapse-analytics

All of the feedback you share in these forums will be monitored and reviewed by the Microsoft engineering teams responsible for building Synapse .

Please do update the thread with the url of the ask , so that it helps other community members with the simialr ask .

Thanks
Himanshu

HimanshuSinha-msft 18,621 Reputation points Microsoft Employee

2020-12-07T23:08:48.657+00:00

Hello @Colin Robinson ,

Thanks for the ask and using the forum .
Can I request you to please eloborate what do you mena by "publishing to my synapse DB" ? Do you mean that the sink is Synapase ? As I understand the ADF is working just fine , why do you want to migrate that ?

Thanks
Himanshu
Silvano P 91 Reputation points

2020-12-07T23:14:15.727+00:00

Hello @HimanshuSinha-msft ,

Probably @Colin Robinson wants to have everything under Synapse Studio.

It will make sense to have everything in one place, that's one of the huge advantage of Synapse.

I have the same request, I have Dataset, Self Integration Runtime, pipelines etc. etc. what is the best practice to migrate a Data Factory Pipeline to a Synapse Pipeline?

Thank you so much
HimanshuSinha-msft 18,621 Reputation points Microsoft Employee

2020-12-10T21:07:16.91+00:00

Hello @Colin Robinson ,
There is not automatic export/import yet.

We can manually export current ADF dataflow descriptions and import into Synapse pipeline. Have they tried that?

Linked Service and Data Set concepts are same.

Quickstart: Transform data using a mapping data flow - Azure Synapse Analytics | Microsoft Learn

Hello,

I request the ask to be logged here .

https://feedback.azure.com/forums/307516-azure-synapse-analytics

All of the feedback you share in these forums will be monitored and reviewed by the Microsoft engineering teams responsible for building Synapse .

Please do update the thread with the url of the ask , so that it helps other community members with the simialr ask .

Thanks
Himanshu

Answer 1

Colin Robinson 31

the method ive found requires connecting your existing repository to devops git repository, importing into that, then disconnecting source control so no more changes get synced from the data factory Source. Then connect your new studio workspace to the said dev ops repository. this seems to work fine although your data factory objects are spread across the workspace studio tabs they do all seem to be present.

Tendai Takavarasha 1 Reputation point

2021-08-31T21:57:40.857+00:00

This solution worked for me!

synapse studio and existing data factory development

1 answer

Activity