Create your first Object detection model

  • 5 minutes

Sign in to AI Builder

Follow these steps to sign in to AI Builder:

  1. Go to Power Apps or Power Automate and sign in with your organizational account.

  2. In the left pane, select AI Builder > Explore.

  3. Select Object Detection.

  4. Enter a name for your model.

  5. If you want to create your model by using your own photos, make sure that you have at least fifteen examples that contain the object that you want to recognize. Otherwise, you can use sample data to create the model.

  6. Select Create.

This guided experience will walk through each step of the model creation process. You can save your work and return at any time. Progress will be saved automatically when you switch between steps.

If you want to use sample data, download the AIBuilder_Lab.zip file and extract it inside a folder on your computer. The documents that are used in this exercise are located in the AIBuilder_Lab\Lab Images\ObjectDetection_Green Tea\Train folder.

Select the domain

Select the domain that applies to your model. A domain helps specialize the model algorithm for better accuracy. For the purpose of this exercise, select the default value Common objects and then select Next.

Screenshot of Power Apps A I Builder on the "Select domain" step offers Common objects, Objects on retail shelves, and Brand logos options

Choose objects

Define the objects that you want to recognize. If you use the sample dataset, enter the following object names: Green Tea Cinnamon, Green Tea Mint, and Green Tea Rose. Otherwise, enter the object names that you want to recognize. Select Next to continue.

The Choose objects step offers a list of object names for your model to detect.

Add images

Follow these steps to add images:

  1. Select Add images.

  2. Select Upload from local storage.

  3. Select at least 15 images. (You will need at least 15 images for each of the objects that you want to tag. An image can contain multiple objects.)

  4. Select Upload images.

  5. After the images have uploaded, select Next.

The Add images step allows you to upload images.

Tag images

The next step is to tag your images. You will be able to see which images have already been tagged or not.

The Tag images step lets you tag the objects in your images.

  1. Select an image to start tagging. You'll be presented with a full-screen experience to perform the tagging. The algorithm will suggest bounding boxes around the objects in the picture that you can resize to adjust to your object.

    In the Object tagging screen, Tagging progress shows image 14 of 15, on which a can of Contoso Green tea Mint is outlined. You can also select and drag to draw your own boxes.

    The outline of the Green tea Mint is hand selected and a Choose object dialog is popped up next to it.

    You can follow the tagging progress on the right panel. You will need to tag, at a minimum, 15 images for each object (an image can contain multiple objects).

  2. When you are finished, select Done tagging.

  3. Select Next.

  4. Review the summary of your model's details. If everything appears acceptable, select Train.

Now that you've created an Object detection model in AI Builder, you'll learn how to test your model and use it in Power Apps and Power Automate.