I want to pick those files as well whose last modified date is +10 second after my current copy activity starts

Gulhasan.Siddiquee 101 Reputation points
2023-11-14T07:51:55.8633333+00:00

I am picking files from a folder to convert it into parquet . But it is missing some files during filtration ,hence those files not getting converted into parquet.

So I am trying to add 10 second as buffer using addSeconds('2018-03-15T00:00:00Z', 10) function . At End time of filtered by last modified , we were using using UTCNOW(). But I am not able to use this utcnow() within addSeconds() funtion .

I used it in this format :-

@addSeconds('utcnow()', 50)

Getting below error:-

In function 'addSeconds', the value provided for date time string 'utcnow()' was not valid. The datetime string must match ISO 8601 format.

So I am looking for an alternate to this.

Azure SQL Database
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,315 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,826 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,520 questions
0 comments No comments
{count} votes

0 additional answers

Sort by: Most helpful