Getting unknown test failed for simple user schema on scim validator but postman tests pass

Question

We've got a very simple schema and only support users (Details below). When running the scim validator we're getting an "unknown test failed" error and we're not sure why. We can successfully run the relevant postman tests from the scim reference code and I'm not seeing any unusual calls come into our service in app insights that would explain it.

Is supporting the /schemas endpoint mandatory for the scim validator as mentioned here? We don't but it's not mandatory as far as I can tell from the RFC.

How do we proceed with getting our implementation approved?

I asked the following on techcommunity, which includes more info, but apparently this is the right place to ask so I'm copying it here.

We've got a very simple schema that only includes the following user attributes (All required) with no group support:

• userName
• active
• emails[type eq "work"].value
• name.givenName
• name.familyName
 

When I run the validator I'm getting the following error: Unknown test failed. Object ref not set to an instance of an object

        "FailedTests": [

            {

                "$id": "31",

                "Description": "One or more errors occurred. (Object reference not set to an instance of an object.)",

                "Name": "Unknown test failed",

                "Results": [

                    {

                        "$id": "32",

                        "Message": "Internal server error: One or more errors occurred. (Object reference not set to an instance of an object.)",

                        "Outcome": 1,

                        "MoreInformation": ""

                    }

                ],

                "ResponseHeaders": "",

                "ResponseStatus": "One or more errors occurred. (Object reference not set to an instance of an object.)",

                "ResponseBody": "",

                "InitialRequestBody": "",

                "RequestBody": "One or more errors occurred. (Object reference not set to an instance of an object.)",

                "SFComplianceOptional": false,

                "HasTestPassed": false,

                "TestexecutionTime": 0

            }

        ],

I've run through the postman tests directly and they're all passing, or failing for valid reasons i.e.

Get User Filters fails due to DisplayName not being supported in our schema
Get User1 Check Patch due to Formatted not being supported in our schema
Create user1 fails as emailName357 is not a valid email address format
I can change the above 3 tests to use valid data and then they pass as expected

 

Based on the above, I'm not seeing anything wrong with our implementation. Is the error an issue with the scim validator itself or am I missing something? How do we proceed with getting our implementation approved?

Answer 1

@Andrew Tombs

Thank you for your detailed post!

Error:

Unknown test failed:

• One or more errors occurred. (Object reference not set to an instance of an object.)
• Internal server error: One or more errors occurred. (Object reference not set to an instance of an object.)

I understand that you're running into issues with the SCIM Validator when testing your schema and to hopefully help point you in the right direction, can you share some more info below.

• Can you give more information about the request you are sending to the Validator?
• What values are you providing within the request body and headers?
• Have you tried running the Validator with the default attributes or uploading the schema to see if you receive the same errors?

Any additional information or screenshots would be greatly appreciated!

When it comes to the /Schemas endpoint I don't believe this is mandatory, but it does look like it's recommended since the /schemas endpoint allows for discovery of the attributes supported.

---

Additional Links:

• Known Issues with Microsoft Entra SCIM Validator
• /Schemas (Schema discovery)
• Schema discovery

I hope this helps!

If you have any other questions, please let me know. Thank you for your time and patience throughout this issue.

---

If the information helped address your question, please Accept the answer. This will help us and also improve searchability for others in the community who might be researching similar information.