HDInsight: Commands to clean up the space

Question

Hi,

at my workplace, we are using HDInsight 3.6. We have encountered space issues before, but we were able to resolve them by simply executing the simple cleanup commands from the edge node. Unfortunately, these commands have not been useful recently. Despite removing the unwanted files from directories, the space doesn't get freed up. Does anyone have any other practical suggestions for cleaning up disk space?

testuser@ed06-test:~$ df -h /
Filesystem Size Used Avail Use% Mounted on
/dev/sda1 124G 124G 190M 100% /

**

• Tried Commands:

**
hdfs dfs -rm -R -skipTrash /<folder-path>
hdfs dfs -expunge

Answer 1

Hello @vijay singh parmar ,

Welcome to the MS Q&A platform.

This article helps on how to resolve the cluster node runs out of disk space in Azure HDInsight.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators