Image classification with convolutional neural networks (CNNs)

Blob Storage
Container Registry
Data Science Virtual Machines
Kubernetes Service
Machine Learning

Solution ideas

This article is a solution idea. If you'd like us to expand the content with more information, such as potential use cases, alternative services, implementation considerations, or pricing guidance, let us know by providing GitHub feedback.

With the rise of technologies such as the Internet of Things (IoT) and AI, the world is generating large amounts of data. Extracting relevant information from the data has become a major challenge. Image classification is a relevant solution to identifying what an image represents. Image classification can help you categorize high volumes of images. Convolutional neural networks (CNNs) render good performance on image datasets. CNNs have played a major role in the development of state-of-the-art image classification solutions.

There are three main types of layers in CNNs:

  • Convolutional layers
  • Pooling layers
  • Fully connected layers

The convolutional layer is the first layer of a convolutional network. This layer can follow another convolutional layer or pooling layers. In general, the fully connected layer is the final layer in the network.

As the number of layers increases, the complexity of the model increases, and the model can identify greater portions of the image. The beginning layers focus on simple features, such as edges. As the image data advances through the layers of the CNN, the network starts recognizing more sophisticated elements or shapes in the object. Finally, it identifies the expected object.

Potential use cases

  • This solution can help automate failure detection, which is preferable to relying solely on human operators. For instance, this solution can boost productivity by identifying faulty electronic components. This capability is important for lean manufacturing, cost control, and waste reduction in manufacturing. In circuit-board manufacturing, faulty boards can cost manufacturers money and productivity. Assembly lines rely on human operators to quickly review and validate boards that are flagged as potentially faulty by assembly-line test machines.
  • Image classification is ideal for the healthcare industry. Image classification helps detect bone cracks, various types of cancer, and anomalies in tissues. You can also use image classification to flag irregularities that can indicate the presence of disease. An image classification model can improve the accuracy of MRIs.
  • In the agriculture domain, image classification solutions help identify plant diseases and plants that require water. As a result, image classification helps to reduce the need for human intervention.

Architecture

Architecture diagram: image classification with convolutional neural networks and Azure Machine Learning. Download an SVG file of this architecture.

Dataflow

  1. Image uploads to Azure Blob Storage are ingested by Azure Machine Learning.
  2. Because the solution follows a supervised learning approach and needs data labeling to train the model, the ingested images are labeled in Machine Learning.
  3. The CNN model is trained and validated in the Machine Learning notebook. Several pre-trained image classification models are available. You can use them by using a transfer learning approach. For information about some variants of pre-trained CNNs, seeĀ Advancements in image classification using convolutional neural networks. You can download these image classification models and customize them with your labeled data.
  4. After training, the model is stored in a model registry in Machine Learning.
  5. The model is deployed through batch managed endpoints.
  6. The model results are written to Azure Cosmos DB and consumed through the front-end application.

Components

  • Blob Storage is a service that's part of Azure Storage. Blob Storage offers optimized cloud object storage for large amounts of unstructured data.
  • Machine Learning is a cloud-based environment that you can use to train, deploy, automate, manage, and track machine learning models. You can use the models to forecast future behavior, outcomes, and trends.
  • Azure Cosmos DB is a globally distributed, multi-model database. With Azure Cosmos DB, your solutions can elastically scale throughput and storage across any number of geographic regions.
  • Azure Container Registry builds, stores, and manages container images and can store containerized machine learning models.

Contributors

This article is maintained by Microsoft. It was originally written by the following contributor.

Principal author:

To see non-public LinkedIn profiles, sign in to LinkedIn.

Next steps