Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Score a table of data with a model that's registered in Unity Catalog, and write the predictions to a Delta table. A batch inference job loads the model by alias, such as Champion, instead of by version number. When you reassign the alias to a new model version, the job uses the new version on its next run, without code changes.
Requirements
You need the following before you run batch inference:
A model registered in Unity Catalog. See Register a model in Unity Catalog.
A model version with the
Championalias. The examples on Register a model in Unity Catalog assign theChallengeralias. After you validate that version, assignChampionto it. You must own the registered model, and have theUSE SCHEMAandUSE CATALOGprivileges on its catalog and schema, to set an alias:from mlflow import MlflowClient MlflowClient().set_registered_model_alias("<catalog>.<schema>.<model>", "Champion", <version>)Or replace
@Championin the following examples with@Challenger.The
EXECUTEprivilege on the registered model, and theUSE CATALOGandUSE SCHEMAprivileges on its catalog and schema.A table of input data with the columns that the model expects. This data can come from feature tables. See Build feature tables for machine learning.
Choose an inference method
Match the method to the size and type of your data:
| Method | Use for | Example |
|---|---|---|
| pandas on one node | Small batches and validation runs in a notebook | Score data with pandas |
| Spark user-defined function (UDF) | Large tables, distributed across a cluster, in batch or streaming jobs | Score data with a Spark UDF |
| pandas UDF for images | Computer vision models that score images stored in cloud object storage | Reference solution for image applications |
Score data with pandas
Load the model as a generic Python function, and call predict():
import mlflow
mlflow.set_registry_uri("databricks-uc")
model = mlflow.pyfunc.load_model("models:/<catalog>.<schema>.<model>@Champion")
input_df = spark.table("<catalog>.<schema>.<input-table>").toPandas()
input_df["prediction"] = model.predict(input_df)
To load a specific version instead, use models:/<catalog>.<schema>.<model>/<version>. See Load model version by alias for inference workloads.
Score data with a Spark UDF
Load the model as a Spark user-defined function (UDF), so that scoring runs in parallel across the cluster, and write the predictions to a Delta table:
import mlflow
mlflow.set_registry_uri("databricks-uc")
model_udf = mlflow.pyfunc.spark_udf(spark, "models:/<catalog>.<schema>.<model>@Champion")
input_data = spark.table("<catalog>.<schema>.<input-table>")
predictions = input_data.withColumn("prediction", model_udf())
predictions.write.mode("overwrite").saveAsTable("<catalog>.<schema>.<predictions-table>")
To restore the model's library dependencies in the UDF, pass env_manager="virtualenv" to spark_udf. See Log, load, and register MLflow models.
To run the scoring on a schedule, add the notebook to a job. See Orchestrate workloads with Lakeflow Jobs.
Next steps
| Resource | Description |
|---|---|
| Build AI agents on Azure Databricks | Build AI agents on top of your governed data |
| Deploy models for batch inference and prediction | Learn about the batch inference options on Azure Databricks, including AI Functions |