Python version on Databricks

Question

We have a requirement to use certain Python 3.10 functionality.
Is there a way to upgrade the Python version to 3.10 on Azure Databricks?
Even with the latest version of Databricks runtime 10.4, it still comes with Python 3.8 by default.
Is a timeline by when 3.10 will be available and if not, is there some way to choose the Python version >3.8 on the databricks runtime we choose?
I see a related question in stackoverflow https://stackoverflow.com/questions/72863008/how-to-upgrade-python-version-in-databricks but wanted to confirm if the answer is correct.

Answer 1

Hello @Chand, Anupam SBOBNG-ITA/RX ,

Thanks for the question and using MS Q&A platform.

Unfortunately, it is not possible to update the python version on the Databricks Runtime.

Note: The latest Azure Databricks Runtime 11.2 supports Python: 3.9.5.

For more details, refer to Azure Databricks Runtime Release.

Workaround would be create a Customize containers with Databricks Container Services which helps to install custom python version and libraries as per your requirement.

I see a related question in stackoverflow https://stackoverflow.com/questions/72863008/how-to-upgrade-python-version-in-databricks but wanted to confirm if the answer is correct.

Yes, it's correct. With customize containers you will be able to install python 3.10.5 on a Docker image that a cluster can utilise instead of the standard runtime.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is jhow you can be part of Q&A Volunteer Moderators