Edit

Install a different version of SynapseML on Fabric

  • Article

SynapseML is preinstalled on Fabric. If you want to use another version, you can install it with %%configure.

Note

Fabric notebook does not officially support %%configure for now, and there's no guarantee of service-level agreement or future compatibility with official releases.

Install SynapseML with %%configure

The following example installs SynapseML v0.11.1 on Fabric. To use the example, paste it into a code cell in a notebook and run the cell.

%%configure -f
{
  "name": "synapseml",
  "conf": {
      "spark.jars.packages": "com.microsoft.azure:synapseml_2.12:0.11.1,org.apache.spark:spark-avro_2.12:3.3.1",
      "spark.jars.repositories": "https://mmlspark.azureedge.net/maven",
      "spark.jars.excludes": "org.scala-lang:scala-reflect,org.apache.spark:spark-tags_2.12,org.scalactic:scalactic_2.12,org.scalatest:scalatest_2.12,com.fasterxml.jackson.core:jackson-databind",
      "spark.yarn.user.classpath.first": "true",
      "spark.sql.parquet.enableVectorizedReader": "false",
      "spark.sql.legacy.replaceDatabricksSparkAvro.enabled": "true"
  }
}

Check SynapseML version

To verify that the installation was successful, run the following code in a cell. The version number returned should match the version number you installed (0.11.1).

import synapse.ml.cognitive
print(f"SynapseML cognitive version: {synapse.ml.cognitive.__version__}")

import synapse.ml.lightgbm
print(f"SynapseML lightgbm version: {synapse.ml.lightgbm.__version__}")

Related content