Azure Data Factory COSMOS DB Analytical Store Queries

Question

Azure Data Factory COSMOS DB Analytical Store Queries

Ramesh V 20

Hi, I'm trying to follow this article and filter records for deletes ex: c.__usr_opType='UPDATE' and this query gives some syntax errors. Need help with few samples. I tried this filter in the source query settings. Here is the error message: cannot resolve 'c.__usr_opType' given input columns: [c.__sys_invOffsetLSID, c.__sys_invOffsetRecordIdx, c.__sys_invType, c.__sys_isSystemRelocated, c.__sys_isTombstone, c.__sys_recordIndex, c.__sys_sequenceNumber, c._etag, c._rid, c._ts, 'Project [*] +- 'Filter (('c.__usr_opType = UPDATE) OR (__sys_isTombstone#8975L = cast(1 as bigint))) https://learn.microsoft.com/en-us/azure/cosmos-db/get-started-change-data-capture Thanks & Regards, Ramesh

Ramesh V 20 Reputation points

2024-02-05T13:27:15.6066667+00:00

Hi @Shaktisingh , I'm using Azure data factory to query data from COSMOS DB analytical store . Steps are in the below URL, I'm trying to use where clause to filter records . where c.__usr_opType='UPDATE' https://learn.microsoft.com/en-us/azure/cosmos-db/get-started-change-data-capture After trying few different options I see that we need capture intermediate updates to be enabled and filters can't be applied on the source query

Thanks & Regards, Ramesh
SSingh-MSFT 16,461 Reputation points Moderator

2024-02-06T15:45:41.2833333+00:00

Hi Ramesh V,

This is strange and not expected. I would recommend you to please file a support ticket for deeper investigation and in case if you don't have a support plan, do let us know here so that we can check on other options to unblock you. Thanks

1 answer

Your answer

Ramesh V 20 Reputation points

2024-02-05T13:27:15.6066667+00:00

Hi @Shaktisingh , I'm using Azure data factory to query data from COSMOS DB analytical store . Steps are in the below URL, I'm trying to use where clause to filter records . where c.__usr_opType='UPDATE' https://learn.microsoft.com/en-us/azure/cosmos-db/get-started-change-data-capture After trying few different options I see that we need capture intermediate updates to be enabled and filters can't be applied on the source query

Thanks & Regards, Ramesh
SSingh-MSFT 16,461 Reputation points Moderator

2024-02-06T15:45:41.2833333+00:00

Hi Ramesh V,

This is strange and not expected. I would recommend you to please file a support ticket for deeper investigation and in case if you don't have a support plan, do let us know here so that we can check on other options to unblock you. Thanks

Answer 1

SSingh-MSFT 16,461 Moderator

Hi Ramesh V,

Welcome to Microsoft Q&A forum.

As I understand, you are getting error in Azure Cosmos Mongo DB cluster queries as cannot resolve column.

Could you please more details of the steps you are taking for the above execution?

Are you performing this using Azure portal?

What sample data and query is being used?

What are the configuration and network settings of thie DB?

Share any more relevant information using screenshots.

Thanks

Share via

Azure Data Factory COSMOS DB Analytical Store Queries

1 answer

Your answer