Tutorial: Configure Dagster Cloud for automatic user provisioning

This tutorial describes the steps you need to perform in both Dagster Cloud and Microsoft Entra ID to configure automatic user provisioning. When configured, Microsoft Entra ID automatically provisions and de-provisions users and groups to Dagster Cloud using the Microsoft Entra provisioning service. For important details on what this service does, how it works, and frequently asked questions, see Automate user provisioning and deprovisioning to SaaS applications with Microsoft Entra ID.

Supported capabilities

  • Create users in Dagster Cloud.
  • Remove users in Dagster Cloud when they do not require access anymore.
  • Keep user attributes synchronized between Microsoft Entra ID and Dagster Cloud.
  • Provision groups and group memberships in Dagster Cloud.
  • Single sign-on to Dagster Cloud (recommended).

Prerequisites

The scenario outlined in this tutorial assumes that you already have the following prerequisites:

Step 1: Plan your provisioning deployment

  1. Learn about how the provisioning service works.
  2. Determine who will be in scope for provisioning.
  3. Determine what data to map between Microsoft Entra ID and Dagster Cloud.

Step 2: Configure Dagster Cloud to support provisioning with Microsoft Entra ID

  1. Sign in to your Dagster Cloud account.
  2. Click the user menu (your icon) > Cloud Settings.
  3. Click the Provisioning tab.
  4. If SCIM provisioning isn't enabled, click the Enable SCIM provisioning button to enable it.
  5. Click Create SCIM token to create an API token. This token will be used to authenticate requests from Microsoft Entra ID to Dagster Cloud. Keep the API token handy - you'll need it later in step 5.

Add Dagster Cloud from the Microsoft Entra application gallery to start managing provisioning to Dagster Cloud. If you have previously setup Dagster Cloud for SSO you can use the same application. However it's recommended that you create a separate app when testing out the integration initially. Learn more about adding an application from the gallery here.

Step 4: Define who will be in scope for provisioning

The Microsoft Entra provisioning service allows you to scope who will be provisioned based on assignment to the application and or based on attributes of the user / group. If you choose to scope who will be provisioned to your app based on assignment, you can use the following steps to assign users and groups to the application. If you choose to scope who will be provisioned based solely on attributes of the user or group, you can use a scoping filter as described here.

  • Start small. Test with a small set of users and groups before rolling out to everyone. When scope for provisioning is set to assigned users and groups, you can control this by assigning one or two users or groups to the app. When scope is set to all users and groups, you can specify an attribute based scoping filter.

  • If you need more roles, you can update the application manifest to add new roles.

Step 5: Configure automatic user provisioning to Dagster Cloud

This section guides you through the steps to configure the Microsoft Entra provisioning service to create, update, and disable users and/or groups in TestApp based on user and/or group assignments in Microsoft Entra ID.

To configure automatic user provisioning for Dagster Cloud in Microsoft Entra ID:

  1. Sign in to the Microsoft Entra admin center as at least a Cloud Application Administrator.

  2. Browse to Identity > Applications > Enterprise applications

    Screenshot of Enterprise applications blade.

  3. In the applications list, select Dagster Cloud.

    Screenshot of the Dagster Cloud link in the Applications list.

  4. Select the Provisioning tab.

    Screenshot of Provisioning tab.

  5. Set the Provisioning Mode to Automatic.

    Screenshot of Provisioning tab automatic.

  6. Under the Admin Credentials section, input your Dagster Cloud Tenant URL and Secret Token. The Tenant URL is https://*your-org-name*.dagster.cloud/scim/v2 and the Secret Token is the SCIM token you created in step 2 above. Click Test Connection to ensure Microsoft Entra ID can connect to Dagster Cloud.

    Screenshot of Token.

  7. In the Notification Email field, enter the email address of a person or group who should receive the provisioning error notifications and select the Send an email notification when a failure occurs check box.

    Screenshot of Notification Email.

  8. Select Save.

  9. Under the Mappings section, select Synchronize Microsoft Entra users to Dagster Cloud.

  10. Review the user attributes that are synchronized from Microsoft Entra ID to Dagster Cloud in the Attribute-Mapping section. The attributes selected as Matching properties are used to match the user accounts in Dagster Cloud for update operations. If you choose to change the matching target attribute, you'll need to ensure that the Dagster Cloud API supports filtering users based on that attribute. Select the Save button to commit any changes.

    Attribute Type Supported for filtering Required by Dagster Cloud
    userName String
    active Boolean
    displayName String
    emails[type eq "work"].value String
    name.givenName String
    name.familyName String
    externalId String
  11. If you'd like to synchronize Microsoft Entra groups to Dagster Cloud then under the Mappings section, select Synchronize Microsoft Entra groups to Dagster Cloud.

  12. Review the group attributes that are synchronized from Microsoft Entra ID to Dagster Cloud in the Attribute-Mapping section. The attributes selected as Matching properties are used to match the groups in Dagster Cloud for update operations. Select the Save button to commit any changes.

    Attribute Type Supported for filtering Required by Dagster Cloud
    displayName String
    externalId String
    members Reference
  13. To configure scoping filters, refer to the following instructions provided in the Scoping filter tutorial.

  14. To enable the Microsoft Entra provisioning service for Dagster Cloud, change the Provisioning Status to On in the Settings section.

    Screenshot of Provisioning Status Toggled On.

  15. Define the users and/or groups that you would like to provision to Dagster Cloud by choosing the desired values in Scope in the Settings section.

    Screenshot of Provisioning Scope.

  16. When you're ready to provision, click Save.

    Screenshot of Saving Provisioning Configuration.

This operation starts the initial synchronization cycle of all users and groups defined in Scope in the Settings section. The initial cycle takes longer to perform than subsequent cycles, which occur approximately every 40 minutes as long as the Microsoft Entra provisioning service is running.

Step 6: Monitor your deployment

Once you've configured provisioning, use the following resources to monitor your deployment:

  • Use the provisioning logs to determine which users have been provisioned successfully or unsuccessfully
  • Check the progress bar to see the status of the provisioning cycle and how close it's to completion
  • If the provisioning configuration seems to be in an unhealthy state, the application goes into quarantine. Learn more about quarantine states here.

More resources

Next steps