Best way to copy (and tranform) records between two Azure TSI environments

Petja Belemezova 1 Reputation point
2022-10-18T09:15:39.897+00:00

We need to create another TSI environment and transfer all the data from an old TSI instance with minor modifications (for example, convert true/false values to 1/0). What would be the best, most efficient and performant way to do it? Are there any helpful tools to use, or is a custom solution the only way?
The Query API does not seem a very good option as it provides the data in a very different format from the one that needs to be fed into the event hub for TSI.
An important consideration is the number of records that need to be transferred - there are billions at this point and increasing.
We are currently not looking at migration to Azure Data Explorer, this would be done at a later stage.

Thank you.

Azure Time Series Insights
Azure Time Series Insights
An Azure internet of things (IoT) analytics platform to monitor, analyze, and visualize industrial IoT analytics data at scale.
77 questions
{count} votes