Hello @Maria Giugno : Can you try using Bulk Insert instead of Polybase or Copy command, that should work
Linked Service dataset to blob storage - Invalid plugin type on Copy Activity - How do I bypass this error?
Hi, I appreciate your assistance with this in advance. I am using Synapse for the first time. The Data Flow that I am trying to build is unsuccessful. I am trying to get data from Linked Service (Google AdWords) to Synapse data hub in the workspace instead of in an integration datasets copy the data to a blob.
![184550-image.png][1]
The lookup activity is all set:
{
"name": "Google_AdWords_Campaign_Lookup",
"type": "Lookup",
"dependsOn": [],
"policy": {
"timeout": "7.00:00:00",
"retry": 0,
"retryIntervalInSeconds": 30,
"secureOutput": false,
"secureInput": false
},
"userProperties": [],
"typeProperties": {
"source": {
"type": "GoogleAdWordsSource"
},
"dataset": {
"referenceName": "Google_AdWords_Campaign",
"type": "DatasetReference"
},
"firstRowOnly": false
}
}
The copy activity is where I cannot get past and I need to perform a 2 step copy or a data flow activity:
{
"name": "Copy_data1_GoogleAdwords_Campaign",
"type": "Copy",
"dependsOn": [],
"policy": {
"timeout": "7.00:00:00",
"retry": 0,
"retryIntervalInSeconds": 30,
"secureOutput": false,
"secureInput": false
},
"userProperties": [
{
"name": "Destination",
"value": "tmsfilesystem/Google AdWords/New"
}
],
"typeProperties": {
"source": {
"type": "GoogleAdWordsSource"
},
"sink": {
"type": "DelimitedTextSink",
"storeSettings": {
"type": "AzureBlobStorageWriteSettings"
},
"formatSettings": {
"type": "DelimitedTextWriteSettings",
"quoteAllText": true,
"fileExtension": ".txt"
}
},
"enableStaging": true,
"stagingSettings": {
"linkedServiceName": {
"referenceName": "AzureBlobStorage_Google_AdWords_Campaign",
"type": "LinkedServiceReference"
},
"path": "tmsfilesystem/Google AdWords"
},
"parallelCopies": 2,
"dataIntegrationUnits": 2,
"translator": {
"type": "TabularTranslator",
"mappings": [
{
"source": {
"name": "Year"
},
"sink": {
"type": "String",
"ordinal": 1
}
},
{
"source": {
"name": "Week"
},
"sink": {
"type": "String",
"ordinal": 2
}
},
{
"source": {
"name": "Quarter"
},
"sink": {
"type": "String",
"ordinal": 3
}
},
{
"source": {
"name": "Month"
},
"sink": {
"type": "String",
"ordinal": 4
}
},
{
"source": {
"name": "DayOfWeek"
},
"sink": {
"type": "String",
"ordinal": 5
}
},
{
"source": {
"name": "Date"
},
"sink": {
"type": "String",
"ordinal": 6
}
},
{
"source": {
"name": "AdNetworkType"
},
"sink": {
"type": "String",
"ordinal": 7
}
},
{
"source": {
"name": "ViewThroughConversions"
},
"sink": {
"type": "String",
"ordinal": 8
}
},
{
"source": {
"name": "VideoViews"
},
"sink": {
"type": "String",
"ordinal": 9
}
},
{
"source": {
"name": "VideoViewRate"
},
"sink": {
"type": "String",
"ordinal": 10
}
},
{
"source": {
"name": "VideoQuartileP75Rate"
},
"sink": {
"type": "String",
"ordinal": 11
}
},
{
"source": {
"name": "VideoQuartileP50Rate"
},
"sink": {
"type": "String",
"ordinal": 12
}
},
{
"source": {
"name": "VideoQuartileP25Rate"
},
"sink": {
"type": "String",
"ordinal": 13
}
},
{
"source": {
"name": "VideoQuartileP100Rate"
},
"sink": {
"type": "String",
"ordinal": 14
}
},
{
"source": {
"name": "ValuePerCurrentModelAttributedConversion"
},
"sink": {
"type": "String",
"ordinal": 15
}
},
{
"source": {
"name": "ValuePerConversionsByConversionDate"
},
"sink": {
"type": "String",
"ordinal": 16
}
},
{
"source": {
"name": "ValuePerConversion"
},
"sink": {
"type": "String",
"ordinal": 17
}
},
{
"source": {
"name": "ValuePerAllConversionsByConversionDate"
},
"sink": {
"type": "String",
"ordinal": 18
}
},
{
"source": {
"name": "ValuePerAllConversions"
},
"sink": {
"type": "String",
"ordinal": 19
}
},
{
"source": {
"name": "TopImpressionPercentage"
},
"sink": {
"type": "String",
"ordinal": 20
}
},
{
"source": {
"name": "SearchTopImpressionShare"
},
"sink": {
"type": "String",
"ordinal": 21
}
},
{
"source": {
"name": "SearchRankLostTopImpressionShare"
},
"sink": {
"type": "String",
"ordinal": 22
}
},
{
"source": {
"name": "SearchRankLostImpressionShare"
},
"sink": {
"type": "String",
"ordinal": 23
}
},
{
"source": {
"name": "SearchRankLostAbsoluteTopImpressionShare"
},
"sink": {
"type": "String",
"ordinal": 24
}
},
{
"source": {
"name": "SearchImpressionShare"
},
"sink": {
"type": "String",
"ordinal": 25
}
},
{
"source": {
"name": "SearchExactMatchImpressionShare"
},
"sink": {
"type": "String",
"ordinal": 26
}
},
{
"source": {
"name": "SearchClickShare"
},
"sink": {
"type": "String",
"ordinal": 27
}
},
{
"source": {
"name": "SearchBudgetLostTopImpressionShare"
},
"sink": {
"type": "String",
"ordinal": 28
}
},
{
"source": {
"name": "SearchBudgetLostImpressionShare"
},
"sink": {
"type": "String",
"ordinal": 29
}
},
{
"source": {
"name": "SearchBudgetLostAbsoluteTopImpressionShare"
},
"sink": {
"type": "String",
"ordinal": 30
}
},
{
"source": {
"name": "SearchAbsoluteTopImpressionShare"
},
"sink": {
"type": "String",
"ordinal": 31
}
},
{
"source": {
"name": "RelativeCtr"
},
"sink": {
"type": "String",
"ordinal": 32
}
},
{
"source": {
"name": "PhoneThroughRate"
},
"sink": {
"type": "String",
"ordinal": 33
}
},
{
"source": {
"name": "PhoneImpressions"
},
"sink": {
"type": "String",
"ordinal": 34
}
},
{
"source": {
"name": "PhoneCalls"
},
"sink": {
"type": "String",
"ordinal": 35
}
},
{
"source": {
"name": "PercentNewVisitors"
},
"sink": {
"type": "String",
"ordinal": 36
}
},
{
"source": {
"name": "InvalidClicks"
},
"sink": {
"type": "String",
"ordinal": 37
}
},
{
"source": {
"name": "InvalidClickRate"
},
"sink": {
"type": "String",
"ordinal": 38
}
},
{
"source": {
"name": "Interactions"
},
"sink": {
"type": "String",
"ordinal": 39
}
},
{
"source": {
"name": "InteractionRate"
},
"sink": {
"type": "String",
"ordinal": 40
}
},
{
"source": {
"name": "InteractionEventTypes"
},
"sink": {
"type": "String",
"ordinal": 41
}
},
{
"source": {
"name": "Impressions"
},
"sink": {
"type": "String",
"ordinal": 42
}
},
{
"source": {
"name": "GmailSecondaryClicks"
},
"sink": {
"type": "String",
"ordinal": 43
}
},
{
"source": {
"name": "GmailSaves"
},
"sink": {
"type": "String",
"ordinal": 44
}
},
{
"source": {
"name": "GmailForwards"
},
"sink": {
"type": "String",
"ordinal": 45
}
},
{
"source": {
"name": "Engagements"
},
"sink": {
"type": "String",
"ordinal": 46
}
},
{
"source": {
"name": "EngagementRate"
},
"sink": {
"type": "String",
"ordinal": 47
}
},
{
"source": {
"name": "CurrentModelAttributedConversionsValuePerCost"
},
"sink": {
"type": "String",
"ordinal": 48
}
},
{
"source": {
"name": "CurrentModelAttributedConversionsValue"
},
"sink": {
"type": "String",
"ordinal": 49
}
},
{
"source": {
"name": "CurrentModelAttributedConversionsFromInteractionsValuePerInteraction"
},
"sink": {
"type": "String",
"ordinal": 50
}
},
{
"source": {
"name": "CurrentModelAttributedConversionsFromInteractionsRate"
},
"sink": {
"type": "String",
"ordinal": 51
}
},
{
"source": {
"name": "CurrentModelAttributedConversions"
},
"sink": {
"type": "String",
"ordinal": 52
}
},
{
"source": {
"name": "Ctr"
},
"sink": {
"type": "String",
"ordinal": 53
}
},
{
"source": {
"name": "CrossDeviceConversions"
},
"sink": {
"type": "String",
"ordinal": 54
}
},
{
"source": {
"name": "CostPerCurrentModelAttributedConversion"
},
"sink": {
"type": "String",
"ordinal": 55
}
},
{
"source": {
"name": "CostPerConversion"
},
"sink": {
"type": "String",
"ordinal": 56
}
},
{
"source": {
"name": "CostPerAllConversions"
},
"sink": {
"type": "String",
"ordinal": 57
}
},
{
"source": {
"name": "CostMicros"
},
"sink": {
"type": "String",
"ordinal": 58
}
},
{
"source": {
"name": "ConversionsValueByConversionDate"
},
"sink": {
"type": "String",
"ordinal": 59
}
},
{
"source": {
"name": "ConversionsValue"
},
"sink": {
"type": "String",
"ordinal": 60
}
},
{
"source": {
"name": "ConversionsFromInteractionsRate"
},
"sink": {
"type": "String",
"ordinal": 61
}
},
{
"source": {
"name": "ConversionsByConversionDate"
},
"sink": {
"type": "String",
"ordinal": 62
}
},
{
"source": {
"name": "Conversions"
},
"sink": {
"type": "String",
"ordinal": 63
}
},
{
"source": {
"name": "ContentRankLostImpressionShare"
},
"sink": {
"type": "String",
"ordinal": 64
}
},
{
"source": {
"name": "ContentImpressionShare"
},
"sink": {
"type": "String",
"ordinal": 65
}
},
{
"source": {
"name": "ContentBudgetLostImpressionShare"
},
"sink": {
"type": "String",
"ordinal": 66
}
},
{
"source": {
"name": "Clicks"
},
"sink": {
"type": "String",
"ordinal": 67
}
},
{
"source": {
"name": "BounceRate"
},
"sink": {
"type": "String",
"ordinal": 68
}
},
{
"source": {
"name": "AverageTimeOnSite"
},
"sink": {
"type": "String",
"ordinal": 69
}
},
{
"source": {
"name": "AveragePageViews"
},
"sink": {
"type": "String",
"ordinal": 70
}
},
{
"source": {
"name": "AverageCpv"
},
"sink": {
"type": "String",
"ordinal": 71
}
},
{
"source": {
"name": "AverageCpm"
},
"sink": {
"type": "String",
"ordinal": 72
}
},
{
"source": {
"name": "AverageCpe"
},
"sink": {
"type": "String",
"ordinal": 73
}
},
{
"source": {
"name": "AverageCpc"
},
"sink": {
"type": "String",
"ordinal": 74
}
},
{
"source": {
"name": "AverageCost"
},
"sink": {
"type": "String",
"ordinal": 75
}
},
{
"source": {
"name": "AllConversionsValueByConversionDate"
},
"sink": {
"type": "String",
"ordinal": 76
}
},
{
"source": {
"name": "AllConversionsValue"
},
"sink": {
"type": "String",
"ordinal": 77
}
},
{
"source": {
"name": "AllConversionsFromInteractionsRate"
},
"sink": {
"type": "String",
"ordinal": 78
}
},
{
"source": {
"name": "AllConversionsByConversionDate"
},
"sink": {
"type": "String",
"ordinal": 79
}
},
{
"source": {
"name": "AllConversions"
},
"sink": {
"type": "String",
"ordinal": 80
}
},
{
"source": {
"name": "ActiveViewViewability"
},
"sink": {
"type": "String",
"ordinal": 81
}
},
{
"source": {
"name": "ActiveViewMeasurableImpressions"
},
"sink": {
"type": "String",
"ordinal": 82
}
},
{
"source": {
"name": "ActiveViewMeasurableCostMicros"
},
"sink": {
"type": "String",
"ordinal": 83
}
},
{
"source": {
"name": "ActiveViewMeasurability"
},
"sink": {
"type": "String",
"ordinal": 84
}
},
{
"source": {
"name": "ActiveViewImpressions"
},
"sink": {
"type": "String",
"ordinal": 85
}
},
{
"source": {
"name": "ActiveViewCtr"
},
"sink": {
"type": "String",
"ordinal": 86
}
},
{
"source": {
"name": "ActiveViewCpm"
},
"sink": {
"type": "String",
"ordinal": 87
}
},
{
"source": {
"name": "AbsoluteTopImpressionPercentage"
},
"sink": {
"type": "String",
"ordinal": 88
}
},
{
"source": {
"name": "Customer_trackingUrlTemplate"
},
"sink": {
"type": "String",
"ordinal": 89
}
},
{
"source": {
"name": "Customer_timeZone"
},
"sink": {
"type": "String",
"ordinal": 90
}
},
{
"source": {
"name": "Customer_testAccount"
},
"sink": {
"type": "String",
"ordinal": 91
}
},
{
"source": {
"name": "Customer_resourceName"
},
"sink": {
"type": "String",
"ordinal": 92
}
},
{
"source": {
"name": "Customer_remarketingSetting_googleGlobalSiteTag"
},
"sink": {
"type": "String",
"ordinal": 93
}
},
{
"source": {
"name": "Customer_payPerConversionEligibilityFailureReasons"
},
"sink": {
"type": "String",
"ordinal": 94
}
},
{
"source": {
"name": "Customer_optimizationScoreWeight"
},
"sink": {
"type": "String",
"ordinal": 95
}
},
{
"source": {
"name": "Customer_optimizationScore"
},
"sink": {
"type": "String",
"ordinal": 96
}
},
{
"source": {
"name": "Customer_manager"
},
"sink": {
"type": "String",
"ordinal": 97
}
},
{
"source": {
"name": "Customer_id"
},
"sink": {
"type": "String",
"ordinal": 98
}
},
{
"source": {
"name": "Customer_hasPartnersBadge"
},
"sink": {
"type": "String",
"ordinal": 99
}
},
{
"source": {
"name": "Customer_finalUrlSuffix"
},
"sink": {
"type": "String",
"ordinal": 100
}
},
{
"source": {
"name": "Customer_descriptiveName"
},
"sink": {
"type": "String",
"ordinal": 101
}
},
{
"source": {
3 answers
Sort by: Most helpful
-
-
Maria Giugno 76 Reputation points
2022-03-22T20:43:09.503+00:00 Bulk Insert instead of copy activity when using a pipeline to copy data from a linked service.
-
Pratik Somaiya 4,211 Reputation points
2022-03-29T03:53:59.623+00:00 Hello @Maria Giugno
As confirmed by you, Bulk Insert option would allow to copy the data
Thanks for confirmation, you can Accept this Answer and Upvote the same