AI Functions on Azure Databricks
Important
This feature is in Public Preview.
This article describes Azure Databricks AI Functions, built-in SQL functions that allow you to apply AI on your data directly from SQL.
SQL is crucial for data analysis due to its versatility, efficiency, and widespread use. Its simplicity enables swift retrieval, manipulation, and management of large datasets. Incorporating AI functions into SQL for data analysis enhances efficiency, which enables businesses to swiftly extract insights.
Integrating AI into analysis workflows provides access to information previously inaccessible to analysts, and empowers them to make more informed decisions, manage risks, and sustain a competitive advantage through data-driven innovation and efficiency.
AI functions using Databricks Foundation Model APIs
Note
For Databricks Runtime 15.0 and above, these functions are supported in notebook environments including Databricks notebooks and workflows.
These functions invoke a state-of-the-art generative AI model from Databricks Foundation Model APIs to perform tasks like, sentiment analysis, classification and translation. See Analyze customer reviews using AI Functions.
- ai_analyze_sentiment
- ai_classify
- ai_extract
- ai_fix_grammar
- ai_gen
- ai_mask
- ai_similarity
- ai_summarize
- ai_translate
ai_query
Note
- For Databricks Runtime 14.2 and above, this function is supported in notebook environments including Databricks notebooks and workflows.
- For Databricks Runtime 14.1 and below, this function is not supported in notebook environments, including Databricks notebooks.
The ai_query()
function allows you to serve your machine learning models and large language models using Databricks Model Serving and query them using SQL. To do so, this function invokes an existing Databricks Model Serving endpoint and parses and returns its response. You can use ai_query()
to query endpoints that serve custom models, foundation models made available using Foundation Model APIs, and external models.
Feedback
https://aka.ms/ContentUserFeedback.
Coming soon: Throughout 2024 we will be phasing out GitHub Issues as the feedback mechanism for content and replacing it with a new feedback system. For more information see:Submit and view feedback for