Hi Prakhar!
Thanks for the swift response! My PC is at "Optimized Default Settings" option in the BIOS, and I checked my CPU and it is set at 3.8Ghz. My GPU cooling seems fine and temperatures is around 60C while gaming. I will monitor my CPU temperature and let you know if it's around 90c/high when gaming. It peaked at the 90c threshold when I ran Prime95.
In the meantime, if you find any other potential culprits, I'm all ears.
Thanks!