Hello Daniel Adaji,
Welcome to the MS Q&A platform.
Per the error message "InvalidAbfsRestOperationExceptionjava.net.SocketTimeoutException: Read timed out" the read operation from the Azure Blob Storage timed out. This can be caused by a slow network connection or a large amount of data being transferred.
You can try increasing the timeout value for the read operation by setting the
spark.hadoop.fs.azure.read.request.timeout configuration property in Synapse. The default value is 120 seconds. You can increase it to a higher value, such as 300 seconds, by adding the following line of code to your Spark code:
You can also try increasing the number of retries for the read operation by setting the
spark.hadoop.fs.azure.read.request.maxRetries Configuration property. The default value is 4. You can increase it to a higher value, such as 8, by adding the following line of code to your Spark code:
I hope this helps. Please let us know if you have any further questions.