Synapse Copy activity with Auto create does not work

Sunita Gannavarapu 66 Reputation points Microsoft Employee
2022-02-02T05:10:43.187+00:00

Trying to use Synapse copy activity to copy data from Parquet source file to Synapse dedicated pool table.

Target table does not exist , so trying to use the AutoCreate option . Given a dummy table name is the target dataset.

When giving the table name it gives error :

"message": "ErrorCode=UserErrorSqlDWCopyCommandError,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=SQL DW Copy Command operation failed with error 'Invalid object name 'dbo.test'.

When not specifying the table name it fails the validation saying table name required.

170320-sinkds.png
170330-autocreatesink.png

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,696 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,196 questions
{count} votes

Accepted answer
  1. HimanshuSinha-msft 19,386 Reputation points Microsoft Employee
    2022-02-02T23:36:11.61+00:00

    Hello @Sunita Gannavarapu ,
    Thanks for the ask and using Microsoft Q&A platform .
    As we understand the ask here is how to use the 'Auto table create feature" . Please do let me know if that not accurate
    From the screenshoot i think you are using the "Copy command" option . Do this fix , please following the below steps .

    1. Select the copy method to "Bulk Insert"
    2. Debug the pipeline and it should work fine .
      170714-image.png

    Please do let me if you have any queries .
    Thanks
    Himanshu

    -------------------------------------------------------------------------------------------------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

0 additional answers

Sort by: Most helpful