Copy Data from On-premise - Self Hosted Runtime

Question

Copy Data from On-premise - Self Hosted Runtime

39861377 141

Hi, Our goal is to fetch data from Globalshop ERP. We have setup an ODBC connection and using Zen Monitor to query the data. On the same system where Zen Monitor is installed we've a Self-hosted runtime installed. I'm using Copy Activity to fetch data from this database, but the copy speed is extremely slow e.g. To fetch 1,00,000 records it takes 45 minutes. The system where integration runtime is installed has a total of 8GB RAM out of which 2GB is usually available. I would like to know how I can fix this performance issue. Whether is it the low RAM availability or the ERP system capability causing this issue? We do have a good internet connectivity.

2 answers

Your answer

Answer 1

HimanshuSinha 19,527 Microsoft Employee Moderator

Hello 39861377 , Thanks for the question and using MS Q&A platform. Let me start with the fact that your SHIR is running on 8GB memory, which to me is on the lower side of resources . If possible you can move to a machine with more memory. I could request you to check if you can try out the Degree of copy parallelism and try with a small number and see if that helps. User's image

Thanks
Himanshu

Please accept as "Yes" if the answer provided is useful , so that you can help others in the community looking for remediation for similar issues.

39861377 141 Reputation points

2023-04-13T12:53:43.61+00:00

@HimanshuSinha-msft Shouldn't 8GB be enough to quick fetch around 1,00,000 records? Isn't 45mins a bit too long?
HimanshuSinha 19,527 Reputation points Microsoft Employee Moderator

2023-04-13T17:20:39.83+00:00

Yes, it should be good generally, but then I am not sure what other process is running in the machine. Please try out to the parallelism option and see how it goes .
HimanshuSinha 19,527 Reputation points Microsoft Employee Moderator

2023-04-27T20:17:07.6666667+00:00

Hello 39861377 ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .

In case if you have any resolution please do share that same with the community as it can be helpful to others .

Otherwise, will respond back with the more details and we will try to help .

Thanks

Himanshu

Answer 2

Deleted

This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

Comments have been turned off. Learn more

Share via

Copy Data from On-premise - Self Hosted Runtime

2 answers

Your answer