Solution ideas
This article describes a solution idea. Your cloud architect can use this guidance to help visualize the major components for a typical implementation of this architecture. Use this article as a starting point to design a well-architected solution that aligns with your workload's specific requirements.
This architecture shows how you can bring your trained AI model to the edge with Azure Stack Hub and integrate it with your applications for low-latency intelligence.
Architecture
Download a Visio file of this architecture.
Dataflow
- Data is processed using Azure Data Factory, to be placed on Azure Data Lake.
- Data from Azure Data Factory is placed into the Azure Data Lake Storage for training.
- Data scientists train a model using Azure Machine Learning. The model is containerized and put into an Azure container registry.
- The model is deployed to a Kubernetes cluster on Azure Stack Hub.
- The on-premises web application can be used to score data that's provided by the end user, to score against the model that's deployed in the Kubernetes cluster.
- End users provide data that's scored against the model.
- Insights and anomalies from scoring are placed into a queue.
- A function app gets triggered once scoring information is placed in the queue.
- A function sends compliant data and anomalies to Azure Storage.
- Globally relevant and compliant insights are available for consumption in Power BI and a global app.
- Feedback loop: The model retraining can be triggered by a schedule. Data scientists work on the optimization. The improved model is deployed and containerized as an update to the container registry.
Components
Key technologies used to implement this architecture:
- Azure Machine Learning: Build, deploy, and manage predictive analytics solutions.
- Azure Data Factory: Ingest data into Azure Data Factory.
- Azure Data Lake Storage: Load data into Azure Data Lake Storage Gen2 with Azure Data Factory.
- Container Registry: Store and manage container images across all types of Azure deployments.
- Azure Kubernetes Service (AKS): Simplify the deployment, management, and operations of Kubernetes.
- Azure Storage: Durable, highly available, and massively scalable cloud storage.
- Azure Stack Hub: Build and run innovative hybrid applications across cloud boundaries.
- Azure Functions: Event-driven serverless compute unit for on-demand tasks running without the needs of maintaining the computing server.
- Azure App Service: Path that captures end-user feedback data to enable model optimization.
Scenario details
With the Azure AI tools, edge, and cloud platform, edge intelligence is possible. The next generation of AI-enabled hybrid applications can run where your data lives. With Azure Stack Hub, bring a trained AI model to the edge, integrate it with your applications for low-latency intelligence, and continuously feedback into a refined AI model for improved accuracy, with no tool or process changes for local applications. This solution idea shows a connected Stack Hub scenario, where edge applications are connected to Azure. For the disconnected-edge version of this scenario, see the article AI at the edge - disconnected.
Potential use cases
There's a wide range of Edge AI applications that monitor and provide information in near real-time. Areas where Edge AI can help include:
- Security camera detection processes.
- Image and video analysis (the media and entertainment industry).
- Transportation and traffic (the automotive and mobility industry).
- Manufacturing.
- Energy (smart grids).
Next steps
- Want to learn more? Check out the Introduction to Azure Stack module
- Get Microsoft Certified for Azure Stack Hub with the Azure Stack Hub Operator Associate certification
- How to install the AKS Engine on Linux in Azure Stack Hub
- How to install the AKS Engine on Windows in Azure Stack Hub
- Deploy your machine learning models to an edge device with Azure Stack Edge Devices
- Innovate further and deploy Azure AI services (Speech, Language, Decision, Vision) containers to Azure Stack Hub
For more information about the featured Azure services, see the following articles and samples:
- App Service documentation
- Azure Data Lake Storage Gen 2
- Azure Kubernetes Service (AKS) documentation
- Azure Machine Learning documentation
- Azure Stack Hub documentation
- Azure Stack Hub Deployment Options
- Container Registry documentation
- Storage documentation
- Azure Samples -Azure Stack Hub Foundation (on GitHub)
- Azure hybrid and multicloud patterns and solutions documentation
Related resources
See the following related architectures: