Troubleshooting Azure Cosmos DB Emulator Startup Failure after Certificate Manipulation

William 0

I am experiencing difficulties with the Azure Cosmos DB Emulator on my system. Initially, I faced a certificate error, which led me to delete the Cosmos DB related certificates from both the Trusted Root and Personal stores. Afterward, I attempted to regenerate these certificates using Microsoft.Azure.Cosmos.Emulator.exe /GenCert, but this did not resolve the issue.

Current Problem: Now, when I try to start the Emulator, I receive the following error message:

Error: multiple attempts to restart one of the Azure Cosmos Emulator processes were detected. The emulator will shutdown. If the problem persists please try uninstalling the Azure Cosmos Emulator, remove the CosmosDBEmulator directory from your %%LOCALAPPDATA%% and reinstall.

Event Viewer Logs:

Faulting application name: Microsoft.Azure.Cosmos.StartupEntryPoint.exe, version: 2.14.0.0
Faulting module name: KERNELBASE.dll
Exception code: 0xe0434352

Detailed cryptographic exception information

Application: Microsoft.Azure.Cosmos.StartupEntryPoint.exe
Framework Version: v4.0.30319
Description: The process was terminated due to an unhandled exception.
Exception Info: System.Security.Cryptography.CryptographicException
   at System.Security.Cryptography.Utils.CreateProvHandle(System.Security.Cryptography.CspParameters, Boolean)
   at System.Security.Cryptography.Utils.GetKeyPairHelper(System.Security.Cryptography.CspAlgorithmType, System.Security.Cryptography.CspParameters, Boolean, Int32, System.Security.Cryptography.SafeProvHandle ByRef, System.Security.Cryptography.SafeKeyHandle ByRef)
   at System.Security.Cryptography.RSACryptoServiceProvider.GetKeyPair()
   at System.Security.Cryptography.RSACryptoServiceProvider..ctor(Int32, System.Security.Cryptography.CspParameters, Boolean)
   at System.Security.Cryptography.X509Certificates.X509Certificate2.get_PrivateKey()
   at Microsoft.Azure.Cosmos.ServiceFramework.EntryPoint.AclCertificateUtil.SetCertificateAcl(System.Security.Cryptography.X509Certificates.X509Certificate2, System.String, Boolean)
   at Microsoft.Azure.Cosmos.ServiceFramework.EntryPoint.AclCertificateUtil.SetCertificateAclByCommonName(System.String, System.String, System.Security.Cryptography.X509Certificates.StoreName, System.Security.Cryptography.X509Certificates.StoreLocation, Boolean, Boolean)
   at Microsoft.Azure.Documents.Services.StartupEntryPoint.GatewayServiceSetupCommand.GatewayInit(System.Fabric.CodePackageActivationContext)
   at Microsoft.Azure.Documents.Services.StartupEntryPoint.GatewayServiceSetupCommand+<>c.<AddCommand>b__3_1()
   at Microsoft.Extensions.CommandLineUtils.CommandLineApplication.Execute(System.String[])
   at Microsoft.Azure.Documents.Services.StartupEntryPoint.ServiceStartupEntryPoint.Main(System.String[])

Attempts to Resolve:

Used the installer's repair tool.
Tried regenerating the certificates.
Reviewed Event Viewer for additional clues.

Constraints: I am hesitant to uninstall and reinstall the Cosmos DB Emulator due to uncertainty about handling data backup and restoration. I also have a trace file available if it might be helpful for diagnostic purposes but I cant upload it here.

Any insights or suggestions would be greatly appreciated !

GeethaThatipatri-MSFT 29,482 Reputation points Microsoft Employee

2023-11-19T14:56:33.41+00:00

Hi @William Thanks for posting your question in the Microsoft Q&A forum.

I found So forum link on the similar error if it might help you. https://stackoverflow.com/questions/59786722/cosmos-db-emulator-wont-start-on-windows-10

Regards

Geetha

William 0

Hi Geetha, I've tried to rebuild the performance counters twice but i didnt seem to help me.

Heres the minidump file ive found in C:\Users\USER\AppData\Local\CrashDumps

************* Preparing the environment for Debugger Extensions Gallery repositories **************
   ExtensionRepository : Implicit
   UseExperimentalFeatureForNugetShare : true
   AllowNugetExeUpdate : true
   AllowNugetMSCredentialProviderInstall : true
   AllowParallelInitializationOfLocalRepositories : true

   -- Configuring repositories
      ----> Repository : LocalInstalled, Enabled: true
      ----> Repository : UserExtensions, Enabled: true

>>>>>>>>>>>>> Preparing the environment for Debugger Extensions Gallery repositories completed, duration 0.000 seconds

************* Waiting for Debugger Extensions Gallery to Initialize **************

>>>>>>>>>>>>> Waiting for Debugger Extensions Gallery to Initialize completed, duration 0.016 seconds
   ----> Repository : UserExtensions, Enabled: true, Packages count: 0
   ----> Repository : LocalInstalled, Enabled: true, Packages count: 36

Microsoft (R) Windows Debugger Version 10.0.25921.1001 AMD64
Copyright (c) Microsoft Corporation. All rights reserved.


Loading Dump File [C:\Users\WilliamPoncelet\AppData\Local\CrashDumps\Microsoft.Azure.Cosmos.StartupEntryPoint.exe.1704.dmp]
User Mini Dump File: Only registers, stack and portions of memory are available

Symbol search path is: srv*
Executable search path is: 
Windows 10 Version 22631 MP (20 procs) Free x64
Product: WinNt, suite: SingleUserTS
Edition build lab: 22621.1.amd64fre.ni_release.220506-1250
Debug session time: Sun Nov 19 17:04:23.000 2023 (UTC - 5:00)
System Uptime: 1 days 4:32:17.492
Process Uptime: 0 days 0:00:02.000
.......

Press ctrl-c (cdb, kd, ntsd) or ctrl-break (windbg) to abort symbol loads that take too long.
Run !sym noisy before .reload to track down problems loading symbols.

.........................................................
...........................
Loading unloaded module list
..............................................
This dump file has an exception of interest stored in it.
The stored exception information can be accessed via .ecxr.
(6a8.5158): CLR exception - code e0434352 (first/second chance not available)

+------------------------------------------------------------------------+
| This target supports Hardware-enforced Stack Protection. A HW based    |
| "Shadow Stack" may be available to assist in debugging and analysis.   |
| See aka.ms/userhsp for more info.                                      |
|                                                                        |
| dps @ssp                                                               |
|                                                                        |
+------------------------------------------------------------------------+

For analysis of this file, run !analyze -v
----------------------------------------------------------------------------
The user dump currently examined is a minidump. Consequently, only a subset
of sos.dll functionality will be available. If needed, attaching to the live
process or debugging a full dump will allow access to sos.dll's full feature
set.
To create a full user dump use the command: .dump /ma <filename>
----------------------------------------------------------------------------
ntdll!NtWaitForMultipleObjects+0x14:
00007fff`eb58fec4 c3              ret
0:000> !analyze -v
*******************************************************************************
*                                                                             *
*                        Exception Analysis                                   *
*                                                                             *
*******************************************************************************

DEBUG_FLR_EXCEPTION_CODE(80090016) and the ".exr -1" ExceptionCode(e0434352) don't match

KEY_VALUES_STRING: 1

    Key  : Analysis.CPU.mSec
    Value: 2202

    Key  : Analysis.Elapsed.mSec
    Value: 13429

    Key  : Analysis.IO.Other.Mb
    Value: 25

    Key  : Analysis.IO.Read.Mb
    Value: 60

    Key  : Analysis.IO.Write.Mb
    Value: 210

    Key  : Analysis.Init.CPU.mSec
    Value: 812

    Key  : Analysis.Init.Elapsed.mSec
    Value: 104196

    Key  : Analysis.Memory.CommitPeak.Mb
    Value: 322

    Key  : CLR.BuiltBy
    Value: NET481REL1LAST_C

    Key  : CLR.Engine
    Value: CLR

    Key  : CLR.Exception.System.Security.Cryptography.CryptographicException._message
    Value: Keyset does not exist

    Key  : CLR.Exception.Type
    Value: System.Security.Cryptography.CryptographicException

    Key  : CLR.Version
    Value: 4.8.9181.0

    Key  : Failure.Bucket
    Value: CLR_EXCEPTION_System.Security.Cryptography.CryptographicException_80090016_mscorlib.dll!System.Security.Cryptography.Utils.CreateProvHandle

    Key  : Failure.Hash
    Value: {55381df9-ffb4-c790-587c-03f68e23e45f}

    Key  : Timeline.OS.Boot.DeltaSec
    Value: 102737

    Key  : Timeline.Process.Start.DeltaSec
    Value: 2

    Key  : WER.OS.Branch
    Value: ni_release

    Key  : WER.OS.Version
    Value: 10.0.22621.1

    Key  : WER.Process.Version
    Value: 2.14.0.0


FILE_IN_CAB:  Microsoft.Azure.Cosmos.StartupEntryPoint.exe.1704.dmp

NTGLOBALFLAG:  0

PROCESS_BAM_CURRENT_THROTTLED: 0

PROCESS_BAM_PREVIOUS_THROTTLED: 0

APPLICATION_VERIFIER_FLAGS:  0

CONTEXT:  (.ecxr)
rax=0000000000000000 rbx=00000000e0434352 rcx=000002ecdaa4c378
rdx=000002ecdaa4c3a6 rsi=0000000000000001 rdi=0000000000000005
rip=00007fffe8bc565c rsp=000000ff39bfe480 rbp=000002ecc2705928
 r8=000000ff39bfde59  r9=000000ff39bfe570 r10=000002ecdbc7d150
r11=000002ecdaa4c378 r12=0000000000004000 r13=000002ecc21a4760
r14=000000ff39bfe618 r15=000002ecc27017b0
iopl=0         nv up ei pl nz na pe nc
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202
KERNELBASE!RaiseException+0x6c:
00007fff`e8bc565c 0f1f440000      nop     dword ptr [rax+rax]
Resetting default scope

EXCEPTION_RECORD:  (.exr -1)
ExceptionAddress: 00007fffe8bc565c (KERNELBASE!RaiseException+0x000000000000006c)
   ExceptionCode: e0434352 (CLR exception)
  ExceptionFlags: 00000081
NumberParameters: 5
   Parameter[0]: ffffffff80090016
   Parameter[1]: 0000000000000000
   Parameter[2]: 0000000000000000
   Parameter[3]: 0000000000000000
   Parameter[4]: 00007fffc4f20000

PROCESS_NAME:  Microsoft.Azure.Cosmos.StartupEntryPoint.exe

EXCEPTION_CODE_STR:  80090016

FAULTING_THREAD:  ffffffff

STACK_TEXT:  
000000ff`39bfe7f0 00007fff`c39288fb mscorlib_ni!System.Security.Cryptography.Utils.CreateProvHandle+0x57921b
000000ff`39bfe850 00007fff`c33afea0 mscorlib_ni!System.Security.Cryptography.Utils.GetKeyPairHelper+0x60
000000ff`39bfe8d0 00007fff`c340295b mscorlib_ni!System.Security.Cryptography.RSACryptoServiceProvider.GetKeyPair+0x8b
000000ff`39bfe920 00007fff`c34028bb mscorlib_ni!System.Security.Cryptography.RSACryptoServiceProvider..ctor+0xcb
000000ff`39bfe970 00007fff`c18a392c System_ni!System.Security.Cryptography.X509Certificates.X509Certificate2.get_PrivateKey+0xec
000000ff`39bfe9b0 00007fff`65931662 Microsoft_Azure_Cosmos_StartupEntryPoint!Microsoft.Azure.Cosmos.ServiceFramework.EntryPoint.AclCertificateUtil.SetCertificateAcl+0x132
000000ff`39bfea70 00007fff`659342ee Microsoft_Azure_Cosmos_StartupEntryPoint!Microsoft.Azure.Cosmos.ServiceFramework.EntryPoint.AclCertificateUtil.SetCertificateAclByCommonName+0x21e
000000ff`39bfeaf0 00007fff`6591914a Microsoft_Azure_Cosmos_StartupEntryPoint!Microsoft.Azure.Documents.Services.StartupEntryPoint.GatewayServiceSetupCommand.GatewayInit+0x75a
000000ff`39bfeba0 00007fff`65905601 Microsoft_Azure_Cosmos_StartupEntryPoint!Microsoft.Azure.Documents.Services.StartupEntryPoint.GatewayServiceSetupCommand+<>c.<AddCommand>b__3_1+0x11
000000ff`39bfebd0 00007fff`65904d47 Microsoft_Extensions_CommandLineUtils!Microsoft.Extensions.CommandLineUtils.CommandLineApplication.Execute+0x7c7
000000ff`39bfecf0 00007fff`659009e6 Microsoft_Azure_Cosmos_StartupEntryPoint!Microsoft.Azure.Documents.Services.StartupEntryPoint.ServiceStartupEntryPoint.Main+0x156


STACK_COMMAND:  !C:\ProgramData\Dbg\sym\SOS_AMD64_AMD64_4.8.9181.00.dll\64B85271232000\SOS_AMD64_AMD64_4.8.9181.00.dll.pe 0x2ecc2705990 ; ** Pseudo Context ** ManagedPseudo ** Value: ffffffff ** ; kb

SYMBOL_NAME:  mscorlib_ni!System.Security.Cryptography.Utils.CreateProvHandle+23

MODULE_NAME: mscorlib

IMAGE_NAME:  mscorlib.dll

FAILURE_BUCKET_ID:  CLR_EXCEPTION_System.Security.Cryptography.CryptographicException_80090016_mscorlib.dll!System.Security.Cryptography.Utils.CreateProvHandle

BUCKET_ID_MODPRIVATE: 1

OS_VERSION:  10.0.22621.1

BUILDLAB_STR:  ni_release

OSPLATFORM_TYPE:  x64

OSNAME:  Windows 10

FAILURE_ID_HASH:  {55381df9-ffb4-c790-587c-03f68e23e45f}

Followup:     MachineOwner
---------

Share via

Troubleshooting Azure Cosmos DB Emulator Startup Failure after Certificate Manipulation

Your answer