Databricks Cluster (GC issue)

Imran Mondal 246

I have the below cluster setting. Currently, I am getting data every 30 Milliseconds. So for 1 hr, I am getting around 1 GB of Data. I am running this job every 5 hrs but it is throwing me GC error, Please help me.

Also attached my current cluster setting. Any help would be great.

HimanshuSinha-msft 19,376 Reputation points Microsoft Employee

2021-04-14T16:02:35.707+00:00

Hello @Imran Mondal ,

Thanks for the ask and using the Microsoft Q&A platform .
Can you please share the exact error which you are seeing ?

Thanks
Himanshu
Imran Mondal 246 Reputation points

2021-04-14T16:42:56.21+00:00

Hi @HimanshuSinha-msft
HimanshuSinha-msft 19,376 Reputation points Microsoft Employee

2021-04-19T21:05:40.95+00:00

Hello @Imran Mondal ,

Thanks for the patience , unfortunately we are not getting the kind of response from the team here . if you have a support plan you may file a support ticket, else could you please send an email to azcommunity@microsoft.com with the below details, so that we can create a one-time-free support ticket for you to work closely on this matter.
Subscription ID:
Subject : Attn Himanshu
Please let me know once you have done the same.

Thanks
Himanshu
HimanshuSinha-msft 19,376 Reputation points Microsoft Employee

2021-04-27T03:48:47.633+00:00

Hello @Imran Mondal ,
We haven’t received any email from you as requested in the last response and was just checking back to see if you have a resolution.
In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, please respond back with the more details as requested and we will try to help .
Thanks
Himanshu
Imran Mondal 246 Reputation points

2021-05-03T06:24:21.29+00:00

Hi @HimanshuSinha-msft sorry for the late reply, I was on Vacation. This issue is resolved once we increase the cluster size.