got the ERROR RawSocketSender while running the synapse notebook in a cluster

Question

error:

ERROR RawSocketSender [MdsLoggerSenderThread]: org.fluentd.logger.sender.RawSocketSender java.net.ConnectException: Connection refused (Connection refused)   at java.net.PlainSocketImpl.socketConnect(Native Method)   at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)   at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)   at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)   at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)   at java.net.Socket.connect(Socket.java:607)   at org.fluentd.logger.sender.RawSocketSender.connect(RawSocketSender.java:86)   at org.fluentd.logger.sender.RawSocketSender.reconnect(RawSocketSender.java:95)   at org.fluentd.logger.sender.RawSocketSender.flush(RawSocketSender.java:194)   at org.fluentd.logger.sender.RawSocketSender.send(RawSocketSender.java:185)   at org.fluentd.logger.sender.RawSocketSender.emit(RawSocketSender.java:150)   at org.fluentd.logger.sender.RawSocketSender.emit(RawSocketSender.java:132)   at org.fluentd.logger.sender.RawSocketSender.emit(RawSocketSender.java:127)   at org.fluentd.logger.FluentLogger.log(FluentLogger.java:101)   at org.fluentd.logger.FluentLogger.log(FluentLogger.java:86)   at com.microsoft.mdsdclient.MessageSendingRunnable$1.call(Unknown Source)   at com.microsoft.mdsdclient.MessageSendingRunnable$1.call(Unknown Source)   at com.microsoft.mdsdclient.RetryUtil.retry(Unknown Source)   at com.microsoft.mdsdclient.RetryUtil.retry(Unknown Source)   at com.microsoft.mdsdclient.MessageSendingRunnable.sendMessage(Unknown Source)   at com.microsoft.mdsdclient.MessageSendingRunnable.run(Unknown Source)   at java.lang.Thread.run(Thread.java:750)

Getting the above error while running the azure synapse notebook in xxlarge cluster, can you please let me why we are getting this error, due to which we are not able to run the tasks

Answer 1

@Venkataswamy M - Thanks for the question and using MS Q&A platform.

The error message you provided indicates that the connection to the Fluentd logging service is being refused. This could be due to a number of reasons, such as network connectivity issues or configuration problems.

To troubleshoot this issue, you can try the following steps:

• Check the network connectivity between the Synapse workspace and the Fluentd logging service. Make sure that there are no firewall rules or network restrictions that are blocking the connection.
• Verify that the Fluentd logging service is running and configured correctly. Check the logs and configuration files for any errors or misconfigurations.
• Ensure that the Synapse workspace is configured to use the correct Fluentd logging endpoint and port. Double-check the configuration settings to make sure that they are correct.
• Try restarting the Synapse spark cluster and the Fluentd logging service to see if that resolves the issue.

If none of these steps resolve the issue, share more details on how you have configured Fluentd logging service along with the code which you are running and also share the complete stack trace of the error message for further assistance.