Facing Error in copy activity while try to data preview before data load.

Question

Facing Error in copy activity while try to data preview before data load.

Lokesh Rajpoot 46

The function convertFromUtc is currently not supported for schema operations. Activity ID: b20ca41c-0ef3-4f8d-8e0d-07996890811b

The scenario is that i am load data from SAP to ADLS and at the load time i had used addition column feature at source end in copy activity
Column_name=Insert_date

value=>@formatDateTime(convertFromUtc(utcnow(), 'India Standard Time') ,'yyyy-MM-dd')

In this when i trigger or debug the pipeline then its execute smoothly but if i tried to do preview data then its raised error please find attached screenshot for more details.

1 answer

Your answer

Answer 1

ShaikMaheer-MSFT 38,556 Microsoft Employee Moderator

Hi @Lokesh Rajpoot ,

Thank you for posting query in Microsoft Q&A Platform.

When we click on preview button from source tab of Copy activity, then its actually a schema operation to consider additional column as well to show in preview. And at this moment the function which you used @convertFromUtc not supports schema operations. Hence you are seeing that error.

But still when we run the pipeline in debug mode or trigger more additional column data will get correctly in sink location. If your intention is only to take date in format yyyy-MM-dd then you can consider using expressions as @formatDateTime(utcNow(),'yyyy-MM-dd')

Hope this helps. Please let us know if any further queries.

--------------

Please consider hitting Accept Answer button. Accepted answers help community as well.

Lokesh Rajpoot 46 Reputation points

2022-09-02T07:01:16.347+00:00

Thanks for your Quick response @ShaikMaheer-MSFT But as i am working from central region and my Pipeline Trigger at 2 A.M. Then @formatDateTime(utcNow(),'yyyy-MM-dd') this give us wrong date because utcnow() running 5 hr 30min later from India Standard Time
ShaikMaheer-MSFT 38,556 Reputation points Microsoft Employee Moderator

2022-09-02T08:27:52.533+00:00

Hi @Lokesh Rajpoot ,

Got your point. So make sure data preview happens. Please use below expression that helps to convert to different timezone by adding hours and minutes.

@formatDateTime(addminutes(addhours(utcnow(),5),30),'yyyy-MM-dd')

Hope this helps.

----------

Please consider hitting Accept Answer button. Accepted answers helps community as well.
ShaikMaheer-MSFT 38,556 Reputation points Microsoft Employee Moderator

2022-09-06T09:02:01.53+00:00

Hi @Lokesh Rajpoot ,

Just checking in to see if the below answer helped. If this answers your query, do click and upvote for the same. And, if you have any further query do let us know.

Share via

Facing Error in copy activity while try to data preview before data load.

1 answer

Your answer