Hello Subedi, Manish,
Welcome to the Microsoft Q&A forum.
After further checking with my internal team, the issue turned out to be due to a recent Spark upgrade. Could you please raise a support case so that a support engineer can downgrade the Spark version for your workspace?
In case if you don't have a support plan, please let me know so that I can enable a one time free support request to work on this case.