How can I use MSSparkUtils in Scala from Intelij?

Question

How can I use MSSparkUtils in Scala from Intelij?

Madeline Stager 31

I found this documentation of MSSparkUtils which is available in Scala.

https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/microsoft-spark-utilities?pivots=programming-language-scala#credentials-utilities

I'm trying to use the MSSparkUtils from a Scala script that is submit to synapse as a batch job. I'm updating the script from Intelij and can't compile since it can't find the reference for mssparkutils. Is there a package I can include so I can compile in Intelij while using mssparkutils?

PRADEEPCHEEKATLA 90,661 Reputation points Moderator

2021-11-02T10:33:36.93+00:00

Hello @Madeline Stager ,

Thanks for the question and using MS Q&A platform.

We are reaching out to the internal team to get more details on this ask. I will be update you once I hear back from the team.

Accepted answer

0 additional answers

Your answer

PRADEEPCHEEKATLA 90,661 Reputation points Moderator

2021-11-02T10:33:36.93+00:00

Hello @Madeline Stager ,

Thanks for the question and using MS Q&A platform.

We are reaching out to the internal team to get more details on this ask. I will be update you once I hear back from the team.

Answer 1

Hello @Madeline Stager ,

Thanks for the question and using MS Q&A platform.

You can download the mssparkutils package from below MVN repo and import the jar into your local project. With that, you should be able to compile the project successfully: https://mvnrepository.com/artifact/com.microsoft.azure.synapse/synapseutils

Hope this will help. Please let us know if any further queries.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
Want a reminder to come back and check responses? Here is how to subscribe to a notification
If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Share via

How can I use MSSparkUtils in Scala from Intelij?

0 additional answers

Your answer