Install a different version of SynapseML on Fabric
SynapseML is preinstalled on Fabric. If you want to use another version, you can install it with %%configure.
Note
Fabric notebook does not officially support %%configure for now, and there's no guarantee of service-level agreement or future compatibility with official releases.
Install SynapseML with %%configure
The following example installs SynapseML v0.11.1 on Fabric. To use the example, paste it into a code cell in a notebook and run the cell.
%%configure -f
{
"name": "synapseml",
"conf": {
"spark.jars.packages": "com.microsoft.azure:synapseml_2.12:0.11.1,org.apache.spark:spark-avro_2.12:3.3.1",
"spark.jars.repositories": "https://mmlspark.azureedge.net/maven",
"spark.jars.excludes": "org.scala-lang:scala-reflect,org.apache.spark:spark-tags_2.12,org.scalactic:scalactic_2.12,org.scalatest:scalatest_2.12,com.fasterxml.jackson.core:jackson-databind",
"spark.yarn.user.classpath.first": "true",
"spark.sql.parquet.enableVectorizedReader": "false",
"spark.sql.legacy.replaceDatabricksSparkAvro.enabled": "true"
}
}
Check SynapseML version
To verify that the installation was successful, run the following code in a cell. The version number returned should match the version number you installed (0.11.1).
import synapse.ml.cognitive
print(f"SynapseML cognitive version: {synapse.ml.cognitive.__version__}")
import synapse.ml.lightgbm
print(f"SynapseML lightgbm version: {synapse.ml.lightgbm.__version__}")