VS is limited to 4GB as it is a 32-bit process so having 32GB doesn't really help here. To help alleviate this newer updates to VS have started moving lots of stuff out of process to reduce memory constraints. However you can still run out of memory for large enough solutions.
I would recommend that you use the Report a Problem in the top right of VS to report the issue. As part of this you can replicate the issue while recording the problem and this will send the necessary information to MS for diagnostics.
You might also need to temporarily disable any extensions you are running to eliminate an issue with extensions. Extensions like ReSharper and CodeRush can use up a lot of memory, causing issues.