Copy Data Tool for Google AdWords not allowing all columns in a table

Quinn S 0 Reputation points
2023-08-21T18:45:07.5666667+00:00

I would like to build a pipeline from Google AdWords to a SQL table on Azure. When I select "GoogleAds"."Shopping_Performance_View", it works perfectly, but is missing several columns that I want and only has the last day of data.

User's image

I can also get it to run successfully using the "Use Query" option instead of the "Existing tables" option, but it still only lets me see the last day of data, even if I try to filter specifically do a different date.

SELECT 
*
FROM shopping_performance_view 

When I go to https://developers.google.com/google-ads/api/fields/v14/shopping_performance_view_query_builder, I can validate a potential query and it says it should run.

SELECT 
  campaign.name, 
  campaign.base_campaign, 
  campaign.campaign_group, 
  campaign.id, 
  campaign.labels, 
  campaign.campaign_budget, 
  segments.ad_network_type, 
  segments.click_type, 
  segments.device, 
  metrics.clicks, 
  metrics.conversions, 
  metrics.cost_micros, 
  metrics.impressions, 
  metrics.value_per_conversion, 
  customer.id, 
  customer.optimization_score, 
  customer.optimization_score_weight, 
  campaign.shopping_setting.sales_country, 
  customer.call_reporting_setting.call_conversion_action, 
  customer.conversion_tracking_setting.conversion_tracking_id, 
  segments.date, 
  ad_group.campaign, 
  ad_group.name, 
  segments.product_aggregator_id, 
  segments.product_brand, 
  segments.product_channel, 
  segments.product_country, 
  segments.product_custom_attribute0, 
  segments.product_custom_attribute1, 
  segments.product_custom_attribute2, 
  segments.product_custom_attribute3, 
  segments.product_custom_attribute4, 
  segments.product_item_id, 
  segments.product_title, 
  segments.product_type_l1, 
  segments.product_type_l2, 
  segments.product_type_l3, 
  segments.product_type_l4, 
  segments.product_type_l5, 
  metrics.conversions_value, 
  metrics.cost_per_conversion 
FROM shopping_performance_view 
WHERE 
  segments.date >= '2018-01-01'

However, when I select any column that wasn't already in the table that I got by selection *, it gives me an error like this, even though google query validator says it should be fine:

User's image

What can I do to get around this problem? I need all of these columns to create my table.

TLDR;

  • I can't get more than one day of data from Google Ad Words using ADF
  • I can't get all of the columns I need from shopping_performance_view

Thank you!

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,629 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.