error using concurrent.futures (ThreadPoolExecutor) in Synapse Apache Spark notebook

Question

I have an unpredictable error

com.fasterxml.jackson.databind.exc.MismatchedInputException: No content to map due to end-of-input
at [Source: (String)""; line: 1, column: 0]

using concurrent.futures.ThreadPoolExecutor approach to parallel tasks in my python code for apache spark notebook

for example using simple example. but sometimes it works.

import concurrent.futures  
import time  
  
def subjob(i):  
    print(i)  
  
  
def main(p):  
    with concurrent.futures.ThreadPoolExecutor(max_workers=5) as executor:  
        futures = {executor.submit(subjob, i): i for i in p}  
        for future in concurrent.futures.as_completed(futures):  
            print("outer job done\n")  
  
if __name__ == "__main__":  
    p = [1,2]  
    main(p)  

Answer 1

Hi @alexander tikhomirov ,

Thank you for posting query in Microsoft Q&A Platform.

I used same code which shared you. In my case, I am not seeing errors. Please check below screenshot.

Please check my Spark pool configurations.

Could you please cross verify your Spark Pool configurations with above and see if that helps?

Hope this helps. Please let us know if any further queries.

---------------

Please consider hitting Accept Answer. Accepted answers helps community as well.