Azure synapse spark import spark sql functions failed

Question

How to import org.apache.spark.sql.functions._ in synapse spark pool python notebook ? I got error

anyone has the idea ?

Answer 1

Hello @sakuraime ,

Thanks for the question and using MS Q&A platform.

You can access the standard functions using the following import statement in your Scala application: import org.apache.spark.sql.functions._

For more details, refer to Spark SQL Built-in Standard Functions.

For Python, you need to use pyspark.sql.functions to List of built-in functions available for DataFrame.

For more details, refer to pyspark.sql module.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators