Synapse Copy Data from SQL to Data Lake, need to over write file each day

Computer Mike 86 Reputation points
2022-02-15T13:37:40.357+00:00

I am using the copy data task in Synapse to copy the result of a procedure to a csv file. I want to overwrite the file with each run, but I don't see an option. Is there one? Is there a work around? Any link or help appreciated.

Mike

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,467 questions
0 comments No comments
{count} votes

Accepted answer
  1. AnnuKumari-MSFT 31,721 Reputation points Microsoft Employee
    2022-02-15T15:18:21.203+00:00

    Hi @Computer Mike ,
    Thankyou for using Microsoft Q&A platform and posting your query.
    As I understand your query, the ask is to overwrite the file every time it gets copied. Could you please share the screenshot of your sink dataset for us to understand if the file name and path is static or dynamic?

    If you use the same file path and file name every time you perform the copy , it is the default behavior that the file would be overwritten.

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you.
      Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful