Azure HDInsight Spark job is failing with Logger Error

Aishwarya Gopikrishnan 1 Reputation point

Hello Team,

Our jobs are recently failing with this error- ERROR RawSocketSender [MdsLoggerSenderThread]: org.fluentd.logger.sender.RawSocketSender Broken pipe (Write failed)
All these pyspark jobs were running fine until recently and suddenly they are failing with this error. Also we didnt make any kind of code changes. Please help me in understanding the error

Azure HDInsight
Azure HDInsight
An Azure managed cluster service for open-source analytics.
199 questions
{count} votes