Microsoft Discovery: Discovery Engine task execution fails with Cosmos DB authentication error (invalid_configuration)

福森 健人 0 Reputation points
2026-08-13T03:08:33.6366667+00:00

We are evaluating Microsoft Discovery (workspace region: UK South) and Discovery Engine task execution consistently fails in our environment.

What we did

  1. Created tasks with validation criteria and assigned agents in Discovery Studio (Workbench).
  2. Attached the Storage Asset to the shared session.
  3. Started the Discovery Engine (status: Active).
  4. Instructed execution from a prompt, following the official demo deck steps.

Tasks are never processed, and the session returns the following error:


[foundry_server_error] HTTP 400 (ServiceError: invalid_configuration)

Authentication to the configured database failed. Please verify that your

Cosmos DB account credentials and managed identity configuration are correct.

Request ID: 4c94c8821755387858a48145d610d187

Our troubleshooting so far

  • The CogLoop container app (app-dwsp-cogloop-70ktwwaa) fails data-plane authentication to the Discovery-managed Cosmos DB (cosmos-dwsp-database-70ktwwaa, database aifsdata, container cogloop).
  • The CogLoop's AZURE_CLIENT_ID matches the Client ID of the Discovery-managed identity (mi-dwsp-identity-70ktwwaa), so the identity wiring looks correct.
  • The Cosmos DB account is inside the Discovery Network Security Perimeter (Enforced mode).
  • The Discovery control plane's SqlRoleAssignments/write operation on the Cosmos DB shows Succeeded.
  • Customer-side resources (user-assigned managed identity, Blob storage) work fine — chat sessions, agents, and containerized tool execution on the Supercomputer node pool all succeed. Only Engine-driven task execution fails.

All of the failing components are inside the managed resource group (mrg-dwsp-linkx-...), which customers cannot access or repair. We believe the CogLoop-to-Cosmos DB managed identity / data-plane role assignment / NSP configuration on the Discovery-managed side needs to be checked and fixed.

Additional observation (possibly related)

Supercomputer node pool cold start times are very inconsistent: ~40 minutes on one day, over 60 minutes without success on another, then a few minutes on a different session on the same day (Standard_D4s_v6, min 0 / max 2).

We can share the subscription ID, tenant ID, and full timestamps privately if a support engineer picks this up. Thank you.

Microsoft Foundry
Microsoft Foundry

A unified Azure platform for creating and managing AI models, agents, and applications with built‑in enterprise security, monitoring, and governance


1 answer

Sort by: Most helpful
  1. 福森 健人 0 Reputation points
    2026-08-17T06:18:51.7133333+00:00

    Hello Anshika, thank you for the response.

    Let me clarify and update the symptom, as we have narrowed it down further since the original post.

    Updated symptom: automatic task creation by cognition does not work

    • When we manually create a task in the shared session and manually trigger it (clicking the task / instructing execution), the task now executes and completes.
    • However, the Discovery Engine's cognition never creates tasks automatically. According to the documentation (Discovery Engine overview, "Full delegation" pattern), cognition should decompose a high-level objective into child tasks and "create new tasks when it identifies gaps or opportunities." In our environment, no tasks are ever auto-generated — neither decomposition of a root task with a broad objective, nor gap-driven task creation while the Engine is Active.
    • We followed the official demo deck steps exactly (root task with a broad objective + validation requirements, agent available, Engine status Active, default chat model deployment present).

    Since auto-created tasks would be written by the CogLoop container to the Discovery-managed Cosmos DB (account cosmos-dwsp-database-70ktwwaa, database aifsdata, container cogloop), we believe this is consistent with the Cosmos DB data-plane authentication error reported earlier ([foundry_server_error] HTTP 400, ServiceError: invalid_configuration). The write path used by cognition appears to be the broken component.

    Regarding your questions 1–3 (Cosmos DB network/NSP configuration):

    The Cosmos DB account in question is not a customer resource. It is provisioned and managed by Microsoft Discovery inside the managed resource group (mrg-dwsp-linkx-...), which customers cannot access or modify. We therefore cannot inspect or change its firewall, private endpoint, or NSP settings, and we cannot swap in a non-NSP Cosmos DB account for testing. All of these settings were configured by the Discovery service itself.

    Regarding question 4 (timestamp and Request ID):

    • Failed execution (UTC): <YYYY-MM-DD HH:MM UTC>
    • Request ID: <request-id> (the earlier one was 4c94c8821755387858a48145d610d187)

    Given that every failing component lives in the Microsoft-managed resource group, we believe backend investigation by the Discovery engineering team is required — specifically the CogLoop managed identity's data-plane role assignment and the NSP configuration on the managed Cosmos DB. Could you please escalate this to the backend team? We are happy to share the subscription ID, tenant ID, and workspace details through a private channel.

    Thank you.

    Was this answer helpful?

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.