AI edge engineer
At a glance
-
Level
-
Skill
-
Subject
The interplay between AI, cloud, and edge is a rapidly evolving domain. Currently, many IoT solutions are based on basic telemetry. The telemetry function captures data from edge devices and stores it in a data store. Our approach extends beyond basic telemetry. We aim to model problems in the real world through machine learning and deep learning algorithms and implement the model through AI and Cloud on to edge devices. The model is trained in the cloud and deployed on the edge device. The deployment to the edge provides a feedback loop to improve the business process (digital transformation).
In this learning path, we take an interdisciplinary engineering approach. We aspire to create a standard template for many complex areas for deployment of AI on edge devices such as Drones, Autonomous vehicles etc. The learning path presents implementation strategies for an evolving landscape of complex AI applications. Containers are central to this approach. When deployed to edge devices, containers can encapsulate deployment environments for a range of diverse hardware. CICD (Continuous integration - continuous deployment) is a logical extension to deploying containers on edge devices. In future modules in this learning path, we may include other techniques such as serverless computing and deployment on Microcontroller Units.
The engineering-led approach underpins themes / pedagogies for engineering education such as
- Systems thinking
- Experimentation and Problem solving
- Improving through experimentation
- Deployment and analysis through testing
- Impact on other engineering domains
- Forecasting behaviour of a component or system
- Design considerations
- Working within constraints/tolerances and specific operating conditions including device constraints
- Safety and security considerations
- Building tools which help to create the solution
- Improving processes - Using edge(IoT) to provide an analytics feedback loop to the business process to drive processes
- The societal impact of engineering
- The aesthetical impact of design and engineering
- Deployments at scale
- Solving complex business problems by an end-to-end deployment of AI, edge, and cloud.
Ultimately, AI, cloud, and edge technologies deployed as containers in CICD mode can transform whole industries by creating an industry-specific, self-learning ecosystem spanning the entire value chain. We aspire to design such a set of templates/methodologies for the deployment of AI to edge devices in the context of the cloud. In this learning path, you will:
- Learn about creating solutions using IoT and the cloud
- Understand the process of deploying IoT based solutions on edge devices
- Learn the process of implementing models to edge devices using containers
- Explore the use of DevOps for edge devices
Prerequisites
None
Get started with Azure
Choose the Azure account that's right for you. Pay as you go or try Azure free for up to 30 days. Sign up.
Achievement Code
Would you like to request an achievement code?
Modules in this learning path
Assess the characteristics of Azure IoT Hub and determine scenarios when to use IoT Hub.
Explain the essential characteristics of IoT Edge and the functionality of its components (modules, runtime, and cloud interface). Characterize the types of problems that you can solve with IoT Edge. Describe how the elements of IoT Edge can be combined to solve the problem of deploying IoT applications in the cloud.
Deploy a pre-built temperature simulator module to an IoT Edge device using a container. Check that the module was successfully created and deployed and view simulated data.
Implement a cognitive service for performing language detection on an IoT Edge device. Describe the components and steps for implementing a cognitive service on an IoT Edge device.
Analyze the significance of MLOps in the development and deployment of machine learning models for IoT Edge. Describe the components of the MLOps pipeline and show how you can combine them to create models that can be retrained automatically for IoT Edge devices.
Define a solution for smoke testing for virtual Azure IoT Edge devices. Your solution employs a CI/CD (continuous integration/continuous deployment) strategy using Azure DevOps and Azure Pipelines on a Kubernetes cluster.
Determine the types of business problems that can be solved using Azure Sphere. Explain the capabilities and the components (microcontroller unit, operating system, cloud-based security service) for the Azure Sphere. Describe how the components provide a secure platform to develop, deploy, and maintain secure internet connected IoT solutions.
Implement a neural network model for performing real-time image classification on a secured, internet-connected microcontroller-based device (Azure Sphere). Describe the components and steps for implementing a pre-trained image classification model on Azure Sphere.
Deploy an Azure Sphere device application to monitor ambient conditions for laboratory conditions. The application will monitor the room environment conditions, connect to IoT Hub, and send telemetry data from the device to the cloud. You'll control cloud-to-device communications and undertake actions as needed.
Deploy an Azure Sphere application to monitor ambient conditions for a laboratory. The application monitors the room environment, connect to Azure IoT Central, and send telemetry data from the device to the cloud. You control cloud-to-device communications and undertake actions as needed.
Build an Azure IoT Edge image recognition solution for a self-checkout scenario. The exported Azure AI Custom Vision classification model runs locally in an IoT Edge module, and the Camera Capture module calls Azure Speech (via a Foundry resource) at runtime to synthesize item labels as audio.
Use a Live Video Analytics module on IoT Edge and deploy a Custom Vision machine learning solution to an IoT Edge device. The solution will identify void spaces in shelves. Check that the solution is successfully deployed and test your solution from a web application.
Review how a historical Live Video Analytics on IoT Edge solution used Azure resources, IoT Edge modules, a YOLO model, and a web app to process camera video and validate object detection at the edge.