Data Type Incompatibility when Migrating from OGG to EventHub

Vamshi Krishna, Nomula 1

We are working on Migration project moving data from On-prem Oracle to Azure via OGG.

In the onpremise source , for few columns data type is double but when these OGG replicats push the data to Event Hub , data in event hub is storing the column as Big int . we need know why this change has been happening . Also, this issue was happening only to few tables. other tables got loaded without any hicups.

Also, when we run the second pipeline to move the data from Event hub to Final Raw layer using Dataflows , big int data type in Event Hub is replicated as long data type in data flows. Due to this my second pipeline getting failed due to data type incompatibility between long and Double (Target system)

Please let me know how can we resolve this issue

KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee

2022-09-28T20:27:41.73+00:00

Hello @Vamshi Krishna, Nomula ,

Thanks for the question and using MS Q&A platform.

Could you please elaborate a bit on these statements - Also, this issue was happening only to few tables. other tables got loaded without any hicups. - Does the data type double is changing to big int for only few tables and for others is it remaining the same as double type?

When you say Also, when we run the second pipeline to move the data from Event hub to Final Raw layer using Dataflows , big int data type in Event Hub is replicated as long data type in data flows. Due to this my second pipeline getting failed due to data type incompatibility between long and Double (Target system) - What is the service when you referenced pipeline and data flows? Is Azure data factory or some other Azure Service or something else?

Thank you
KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee

2022-10-04T01:44:16.24+00:00

Hello @Vamshi Krishna, Nomula ,

We still have not heard back from you. Just wanted to check if you still need assistance on the above query. In case if you had already found relevant info, please feel free to share it here with community. Otherwise, please confirm on the above requested details.

Thanks