Azure HDInsight
An Azure managed cluster service for open-source analytics.
210 questions
Azure HDInsight Spark job is failing with Logger Error
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 75%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAG%3C/text%3E%3C/svg%3E)
Aishwarya Gopikrishnan
1
Reputation point
Hello Team,
Our jobs are recently failing with this error- ERROR RawSocketSender [MdsLoggerSenderThread]: org.fluentd.logger.sender.RawSocketSender
java.net.SocketException: Broken pipe (Write failed)
All these pyspark jobs were running fine until recently and suddenly they are failing with this error. Also we didnt make any kind of code changes. Please help me in understanding the error
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT 26,086 Reputation points2022-09-30T01:25:32.33+00:00 Hello and welcome to Microsoft Q&A @Aishwarya Gopikrishnan
A broken pipe is a very deep level error. Deeper than I can help with here. I'd like to guide you to support services where they can take a deep investigation into your logs.
If you do not have a support plan, I can give you a 1 time free support ticket. Let me know if you need that. Directions on that to follow in private message.
-
MartinJaffer-MSFT 26,086 Reputation points
2022-10-04T16:32:49.827+00:00 Hello @Aishwarya Gopikrishnan ,
We haven’t received any email from you as requested in the last response and was just checking back to see if you have a resolution. In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, please respond back with the more details as requested and we will try to help .Thanks
Martin
Sign in to comment
Sign in to answer