Edit and retrain a lead scoring model

When the prediction accuracy of a lead scoring model doesn't meet your expectations, or a model duplicates an existing one, you can edit the attributes it uses and retrain it.

Note

Models that were published before the real-time scoring feature was rolled out need to be edited and published again to be used for real-time scoring. The real-time scoring feature is being rolled out in a phased manner across different geographic regions. To verify whether the feature is available in your region, look for version 9.0.22121.10001 in the Latest version availability section. The feature will be enabled one week after the feature rollout. Real-time scoring will be available only after its enabled for your region.

License and role requirements

Requirement type	You must have
License	Dynamics 365 Sales Premium or Dynamics 365 Sales Enterprise More information: Dynamics 365 Sales pricing
Security roles	System Administrator More information: Predefined security roles for Sales

Edit a model

1. Go to Change area in the lower-left corner of the Sales Hub app, and select Sales Insights settings.

2. On the site map under Predictive models, select Lead scoring.

3. On the Predictive lead scoring page, open the model and make sure that Retrain automatically is turned off.

4. Select Edit model and perform any of the following actions:

   • Select an attribute to view insights about its influence on the model.

   • Select attributes that you want the model to consider—including custom attributes—from the lead entity and its related entities (contact and account) to train the model.

   • Select intelligent fields to include in the model.

   

   Note

   The scoring model doesn't support the following types of attributes:

   • Attributes on custom entities
   • Date and time–related attributes
   • System-generated attributes such as leadscore, leadgrade, version number, entity image, exchange rate, and predictive score ID

5. (Optional) Scroll to the right of the attributes list and turn on Ignore empty values.

   By default, empty values in the attribute are included for training the model. If you notice that empty values are acting as detractors or are producing false positives, turn on Ignore empty values.

   

   The Ignore empty values option is disabled for the following type of attributes:

   • Attributes that are automatically validated for empty values, such as firstname_validation_engineered.
   • Attributes that affect the score based on whether the value exists or not, such as zipcode or business phone.

   When you turn on Ignore empty values for an attribute, the scoring widget indicates that the score is calculated after excluding blank values.

6. Select Retrain model.

   Allow a few minutes for the model to be retrained. When it's ready, you'll receive a message like this one:

   

7. If you want the application to automatically retrain the model after every 15 days, select Retrain automatically.

8. Perform one of the following actions:

   • If you're ready to publish, select Publish. The model is applied to leads that match the criteria specified in the model configuration. Users can see the lead scoring in their views under the Lead score column and a widget in the lead form. More information: Convert leads into opportunities

   • If you want to verify the model's accuracy, select View Details and then select the Performance tab. For more information, see View the accuracy and performance of a predictive scoring model.

   • If the accuracy of the retrained model aren't satisfactory, edit the attributes and retrain the model. If you want to go back to the previous version, revert to that version.

Select intelligent fields

Intelligent fields help the model better understand records and distinguish between factors that improve score and those that harm it. For example, the model can distinguish between business email addresses and personal email addresses by identifying and grouping email types using data that's available in the application and intelligence that has been added to the model. Through this identification, the model can generate detailed insights about how the groups of fields affect predictive scores.

Edit the model as described in the previous section to choose the intelligent fields that you want your model to use. The following image illustrates how you can select intelligent fields.

Select the link in the Prediction influence column to view insights about the field's influence, such as its qualification rate and the most influential factors, both positive and negative, for the rate. Learn how to view the influence of an attribute on the model.

You can select the following fields: Email domain validation (Email), First name validation (First name), and Last name validation (Last name). The model always gives preference to:

• Email addresses that are part of a business domain
• First and last names that contain alphanumeric characters and no special characters

By default, intelligent fields are considered while training a model by using out-of-the-box values. If the outcome of the intelligent fields is satisfactory, the model includes the fields to train; otherwise, the fields are ignored. However, even if the outcome is unsatisfactory, you can still choose to include the intelligent fields to train the model if necessary.

Note

Intelligent fields aren't available in the lead entity or its related entities, contact and account.

Retrain a model

Retrain a model when its prediction accuracy score doesn't meet your organization's standards, or the model is too old. Typically, retraining increases a model's prediction accuracy score. The application uses the latest leads in your organization to train the model so that it can provide more accurate scores to your sellers.

For better prediction accuracy scoring, retrain a model after the data in your organization is refreshed.

You can retrain a model automatically or manually.

Automatic retraining

Automatic retraining allows the application to retrain a model every 15 days. This allows the model to learn from the latest data and improves its prediction accuracy score.

To retrain a model automatically, go to the model's Predictive lead scoring page and select Retrain automatically. By default, this option is turned on when a model is published.

Depending on the model's accuracy, the application makes an informed decision whether to publish or ignore the retrained model. The application automatically publishes the model in the following scenarios:

• When the accuracy of the retrained model is equal to or greater than 95 percent of the accuracy of the active model.
• When the current model is more than three months old.

Otherwise, the application keeps the current model.

Manual retraining

You can retrain a model manually in the following cases:

• You want to edit the model for better accuracy and retrain it.
• You've turned off Retrain automatically.

In both cases, you have to edit the model to trigger manual retraining.

Can't find the options in your app?

There are three possibilities:

• You don't have the necessary license or role.
• Your administrator hasn't turned on the feature.
• Your organization is using a custom app. Check with your administrator for exact steps. The steps described in this article are specific to the out-of-the-box Sales Hub and Sales Professional apps.