Dump file analysis, Tomcat crash for no reason

Question

Hello, Tomcat is crashing from time to time. Here is what windbg reports of the dmp file. Any guidance would be greatly appreciated:

A fatal error has been detected by the Java Runtime Environment:

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000267bc373945, pid=4324, tid=0x0000000000001d48

JRE version: OpenJDK Runtime Environment (8.0_432-b06) (build 1.8.0_432-b06)

Java VM: OpenJDK 64-Bit Server VM (25.432-b06 mixed mode windows-amd64 compressed oops)

Problematic frame: # J 9616 C2 java.util.LinkedHashMap.get(Ljava/lang/Object;)Ljava/lang/Object; (33 bytes) @ 0x00000267bc373945 [0x00000267bc373900+0x45]

Core dump written. Default location: E:\Program Files\Apache Software Foundation\Tomcat 9.0\hs_err_pid4324.mdmp

If you would like to submit a bug report, please visit: # https://github.com/adoptium/adoptium-support/issues

--------------- T H R E A D ---------------

Current thread (0x00000267e2e68800): JavaThread "http-nio-24050-exec-1" daemon [_thread_in_Java, id=7496, stack(0x0000008cf6d00000,0x0000008cf6e00000)]

siginfo: ExceptionCode=0xc0000005, reading address 0x00000000000001d0

Registers: RAX=0x00000267dcb08930, RBX=0x00000267dcb08930, RCX=0x000000074c89f420, RDX=0x000000074c89f420 RSP=0x0000008cf6dfc990, RBP=0x000000074c89f420, RSI=0x00000267c7020000, RDI=0x000000074c89f478 R8 =0x000000006a83a640, R9 =0x000000000000000a, R10=0x0000000000000000, R11=0x00000267bc373920 R12=0x0000000000000000, R13=0x0000008cf6dfca08, R14=0x00000007c002d7d0, R15=0x00000267e2e68800 RIP=0x00000267bc373945, EFLAGS=0x0000000000010246

Top of Stack: (sp=0x0000008cf6dfc990) 0x0000008cf6dfc990: 00000267ea77a4b8 00000267e2e68800 0x0000008cf6dfc9a0: 0000008cf6dfca70 00000267e8840555 0x0000008cf6dfc9b0: 0000000000000000 000000074c89f478 0x0000008cf6dfc9c0: 00000267c7020000 000000006a83a640 0x0000008cf6dfc9d0: 0000008cf6dfca58 00000267baa8811c 0x0000008cf6dfc9e0: 00000267e8840580 00000267000000b9 0x0000008cf6dfc9f0: 0000008cf6dfca58 00000267baa67f14 0x0000008cf6dfca00: 00000267baa67f14 000000006a83a640 0x0000008cf6dfca10: 000000074c89f420 0000008cf6dfca18 0x0000008cf6dfca20: 00000267e8840555 0000008cf6dfca70 0x0000008cf6dfca30: 00000267e8840970 0000000000000000 0x0000008cf6dfca40: 00000267e8840580 0000008cf6dfca08 0x0000008cf6dfca50: 0000008cf6dfca68 0000008cf6dfcab8 0x0000008cf6dfca60: 00000267baa67f14 000000006a83a640 0x0000008cf6dfca70: 000000074c89f230 0000008cf6dfca78 0x0000008cf6dfca80: 00000267ea778e39 0000008cf6dfcad0

Instructions: (pc=0x00000267bc373945) 0x00000267bc373925: ff ff 55 48 83 ec 60 48 8b ea 4c 89 44 24 38 4d 0x00000267bc373935: 85 c0 0f 84 98 02 00 00 45 8b 50 08 49 c1 e2 03 0x00000267bc373945: 4d 8b 92 d0 01 00 00 49 bb 40 06 98 dc 67 02 00 0x00000267bc373955: 00 4d 3b d3 0f 85 5a 02 00 00 4d 8b 10 4d 8b da

Register to memory mapping: RAX={method} {0x00000267dcb08938} 'get' '(Ljava/lang/Object;)Ljava/lang/Object;' in 'java/util/LinkedHashMap' RBX={method} {0x00000267dcb08938} 'get' '(Ljava/lang/Object;)Ljava/lang/Object;' in 'java/util/LinkedHashMap' RCX=0x000000074c89f420 is an oop java.util.LinkedHashMap - klass: 'java/util/LinkedHashMap' RDX=0x000000074c89f420 is an oop java.util.LinkedHashMap - klass: 'java/util/LinkedHashMap' RSP=0x0000008cf6dfc990 is pointing into the stack for thread: 0x00000267e2e68800 RBP=0x000000074c89f420 is an oop java.util.LinkedHashMap - klass: 'java/util/LinkedHashMap' RSI=0x00000267c7020000 is an unknown value RDI=0x000000074c89f478 is an oop [error occurred during error reporting (printing register info), id 0xc0000005] Stack: [0x0000008cf6d00000,0x0000008cf6e00000], sp=0x0000008cf6dfc990, free space=1010k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) C 0x00000267bc373945

--------------- P R O C E S S ---------------

Java Threads: ( => current thread ) 0x00000267e2120000 JavaThread "Catalina-utility-2" [_thread_blocked, id=8432, stack(0x0000008cf7900000,0x0000008cf7a00000)] 0x00000267e211c800 JavaThread "http-nio-24050-Acceptor" daemon [_thread_in_native, id=10056, stack(0x0000008cf7800000,0x0000008cf7900000)] 0x00000267e211f000 JavaThread "http-nio-24050-Poller" daemon [_thread_in_native, id=2536, stack(0x0000008cf7700000,0x0000008cf7800000)] 0x00000267e2e71000 JavaThread "http-nio-24050-exec-10" daemon [_thread_blocked, id=8088, stack(0x0000008cf7600000,0x0000008cf7700000)] 0x00000267e2e6b800 JavaThread "http-nio-24050-exec-9" daemon [_thread_blocked, id=12012, stack(0x0000008cf7500000,0x0000008cf7600000)] 0x00000267e2e70000 JavaThread "http-nio-24050-exec-8" daemon [_thread_blocked, id=7644, stack(0x0000008cf7400000,0x0000008cf7500000)] 0x00000267e2e6a800 JavaThread "http-nio-24050-exec-7" daemon [_thread_blocked, id=6112, stack(0x0000008cf7300000,0x0000008cf7400000)] 0x00000267e2e6f800 JavaThread "http-nio-24050-exec-6" daemon [_thread_blocked, id=11368, stack(0x0000008cf7200000,0x0000008cf7300000)] 0x00000267e2e6e800 JavaThread "http-nio-24050-exec-5" daemon [_thread_blocked, id=7408, stack(0x0000008cf7100000,0x0000008cf7200000)] 0x00000267e2e67000 JavaThread "http-nio-24050-exec-4" daemon [_thread_blocked, id=7472, stack(0x0000008cf7000000,0x0000008cf7100000)] 0x00000267e2e6a000 JavaThread "http-nio-24050-exec-3" daemon [_thread_blocked, id=7600, stack(0x0000008cf6f00000,0x0000008cf7000000)] 0x00000267e2e69000 JavaThread "http-nio-24050-exec-2" daemon [_thread_blocked, id=8632, stack(0x0000008cf6e00000,0x0000008cf6f00000)] =>0x00000267e2e68800 JavaThread "http-nio-24050-exec-1" daemon [_thread_in_Java, id=7496, stack(0x0000008cf6d00000,0x0000008cf6e00000)] 0x00000267e2e6c800 JavaThread "Catalina-utility-1" [_thread_blocked, id=10248, stack(0x0000008cf6c00000,0x0000008cf6d00000)] 0x00000267e2e6d000 JavaThread "pool-2-thread-1" [_thread_blocked, id=10540, stack(0x0000008cf6b00000,0x0000008cf6c00000)] 0x00000267e2e67800 JavaThread "OracleTimeoutPollingThread" daemon [_thread_blocked, id=8328, stack(0x0000008cf6a00000,0x0000008cf6b00000)] 0x00000267e2e62000 JavaThread "tiposFormatoEnvio.data" daemon [_thread_blocked, id=12092, stack(0x0000008cf6800000,0x0000008cf6900000)] 0x00000267e2e63000 JavaThread "usuarios.data" daemon [_thread_blocked, id=4112, stack(0x0000008cf6700000,0x0000008cf6800000)] 0x00000267e2e66000 JavaThread "menus.data" daemon [_thread_blocked, id=452, stack(0x0000008cf6600000,0x0000008cf6700000)] 0x00000267e2e63800 JavaThread "delegaciones.data" daemon [_thread_blocked, id=12036, stack(0x0000008cf6500000,0x0000008cf6600000)] 0x00000267e3347000 JavaThread "tiposSolicitud.data" daemon [_thread_blocked, id=8992, stack(0x0000008cf6400000,0x0000008cf6500000)] 0x00000267e3346000 JavaThread "tiposDocGeneral.data" daemon [_thread_blocked, id=3752, stack(0x0000008cf6300000,0x0000008cf6400000)] 0x00000267e3348800 JavaThread "empresas.data" daemon [_thread_blocked, id=5612, stack(0x0000008cf6200000,0x0000008cf6300000)] 0x00000267e3347800 JavaThread "departamentos.data" daemon [_thread_blocked, id=6348, stack(0x0000008cf6100000,0x0000008cf6200000)] 0x00000267e3345800 JavaThread "idiomas.data" daemon [_thread_blocked, id=9360, stack(0x0000008cf6000000,0x0000008cf6100000)] 0x00000267e2881800 JavaThread "traducciones.data" daemon [_thread_blocked, id=10424, stack(0x0000008cf5f00000,0x0000008cf6000000)] 0x00000267de54e000 JavaThread "tiposDocumento.data" daemon [_thread_blocked, id=3256, stack(0x0000008cf5e00000,0x0000008cf5f00000)] 0x00000267e241d800 JavaThread "configuraciones.data" daemon [_thread_blocked, id=10336, stack(0x0000008cf5d00000,0x0000008cf5e00000)] 0x00000267df1f7000 JavaThread "tiposFactura.data" daemon [_thread_blocked, id=8180, stack(0x0000008cf5c00000,0x0000008cf5d00000)] 0x00000267dea7b800 JavaThread "perfiles.data" daemon [_thread_blocked, id=1680, stack(0x0000008cf5b00000,0x0000008cf5c00000)] 0x00000267df355000 JavaThread "literales.data" daemon [_thread_blocked, id=6152, stack(0x0000008cf5a00000,0x0000008cf5b00000)] 0x00000267e000f000 JavaThread "net.sf.ehcache.CacheManager@17b48da1" daemon [_thread_blocked, id=10880, stack(0x0000008cf5900000,0x0000008cf5a00000)] 0x00000267deb47800 JavaThread "GC Daemon" daemon [_thread_blocked, id=11504, stack(0x0000008cf5800000,0x0000008cf5900000)] 0x00000267deb51800 JavaThread "AsyncFileHandlerWriter-1" daemon [_thread_blocked, id=11876, stack(0x0000008cf5700000,0x0000008cf5800000)] 0x00000267de32a000 JavaThread "FileHandlerLogFilesCleaner-1" daemon [_thread_blocked, id=6676, stack(0x0000008cf5600000,0x0000008cf5700000)] 0x00000267dd5b0800 JavaThread "Service Thread" daemon [_thread_blocked, id=10688, stack(0x0000008cf5400000,0x0000008cf5500000)] 0x00000267dd547800 JavaThread "C1 CompilerThread1" daemon [_thread_blocked, id=9180, stack(0x0000008cf5300000,0x0000008cf5400000)] 0x00000267dd53f800 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=9684, stack(0x0000008cf5200000,0x0000008cf5300000)] 0x00000267dd536000 JavaThread "Attach Listener" daemon [_thread_blocked, id=1248, stack(0x0000008cf5100000,0x0000008cf5200000)] 0x00000267dd535000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=10984, stack(0x0000008cf5000000,0x0000008cf5100000)] 0x00000267b9e11000 JavaThread "Finalizer" daemon [_thread_blocked, id=12280, stack(0x0000008cf4f00000,0x0000008cf5000000)] 0x00000267dd521000 JavaThread "Reference Handler" daemon [_thread_blocked, id=9984, stack(0x0000008cf4e00000,0x0000008cf4f00000)] 0x00000267b9da1800 JavaThread "main" [_thread_blocked, id=8848, stack(0x0000008cf4a00000,0x0000008cf4b00000)]

Other Threads: 0x00000267dd4fe000 VMThread [stack: 0x0000008cf4d00000,0x0000008cf4e00000] [id=6192] 0x00000267dd5d6000 WatcherThread [stack: 0x0000008cf5500000,0x0000008cf5600000] [id=11652]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None heap address: 0x00000005c0000000, size: 8192 MB, Compressed Oops mode: Zero based, Oop shift amount: 3 Narrow klass base: 0x0000000000000000, Narrow klass shift: 3 Compressed class space size: 1073741824 Address: 0x00000007c0000000

Heap: PSYoungGen total 1288704K, used 963210K [0x0000000715580000, 0x000000076ff80000, 0x00000007c0000000) eden space 1258496K, 74% used [0x0000000715580000,0x000000074e4a4298,0x0000000762280000) from space 30208K, 99% used [0x0000000762280000,0x0000000763ffe840,0x0000000764000000) to space 40448K, 0% used [0x000000076d800000,0x000000076d800000,0x000000076ff80000) ParOldGen total 122368K, used 63919K [0x00000005c0000000, 0x00000005c7780000, 0x0000000715580000) object space 122368K, 52% used [0x00000005c0000000,0x00000005c3e6bcc0,0x00000005c7780000) Metaspace used 79488K, capacity 81630K, committed 81752K, reserved 1122304K class space used 8333K, capacity 8795K, committed 8832K, reserved 1048576K Card table byte_map: [0x00000267c9e20000,0x00000267cae30000] byte_map_base: 0x00000267c7020000 Marking Bits: (ParMarkBitMap*) 0x000000006a8ac930 Begin Bits: [0x00000267cb8e0000, 0x00000267d38e0000) End Bits: [0x00000267d38e0000, 0x00000267db8e0000) Polling page: 0x00000267ba5c0000 CodeCache: size=245760Kb used=40627Kb max_used=40638Kb free=205132Kb bounds [0x00000267baa60000, 0x00000267bd250000, 0x00000267c9a60000] total_blobs=11682 nmethods=11077 adapters=515 compilation: enabled Compilation events (10 events): Event: 9830.333 Thread 0x00000267dd547800 nmethod 14464 0x00000267bd246bd0 code [0x00000267bd246d40, 0x00000267bd247070] Event: 9830.333 Thread 0x00000267dd547800 14465 3 org.apache.catalina.connector.Request::access$000 (8 bytes) Event: 9830.334 Thread 0x00000267dd547800 nmethod 14465 0x00000267bd2471d0 code [0x00000267bd247340, 0x00000267bd2474f0] Event: 9830.334 Thread 0x00000267dd547800 14462 3 org.apache.catalina.connector.Request::isAsyncDispatching (34 bytes) Event: 9830.334 Thread 0x00000267dd547800 nmethod 14462 0x00000267bd2475d0 code [0x00000267bd247760, 0x00000267bd247c70] Event: 9830.334 Thread 0x00000267dd547800 14463 3 org.apache.tomcat.websocket.server.WsFilter::doFilter (139 bytes) Event: 9830.335 Thread 0x00000267dd547800 nmethod 14463 0x00000267bd247e10 code [0x00000267bd248080, 0x00000267bd248e00] Event: 9830.335 Thread 0x00000267dd547800 14467 1 java.lang.invoke.DirectMethodHandle::internalMemberName (5 bytes) Event: 9830.335 Thread 0x00000267dd547800 nmethod 14467 0x00000267bd249490 code [0x00000267bd2495e0, 0x00000267bd2496f8] Event: 9830.423 Thread 0x00000267dd53f800 14468 4 org.apache.catalina.loader.WebappClassLoaderBase::loadClass (7 bytes) GC Heap History (10 events): Event: 31.628 GC heap before {Heap before GC invocations=20 (full 2): PSYoungGen total 832512K, used 816166K [0x0000000715580000, 0x0000000757380000, 0x00000007c0000000) eden space 798208K, 100% used [0x0000000715580000,0x0000000746100000,0x0000000746100000) from space 34304K, 52% used [0x0000000746100000,0x0000000747289bd8,0x0000000748280000) to space 33792K, 0% used [0x0000000755280000,0x0000000755280000,0x0000000757380000) ParOldGen total 87552K, used 24703K [0x00000005c0000000, 0x00000005c5580000, 0x0000000715580000) object space 87552K, 28% used [0x00000005c0000000,0x00000005c181fcc8,0x00000005c5580000) Metaspace used 54567K, capacity 55846K, committed 55896K, reserved 1099776K class space used 6205K, capacity 6523K, committed 6528K, reserved 1048576K Event: 31.705 GC heap after Heap after GC invocations=20 (full 2): PSYoungGen total 1027072K, used 15246K [0x0000000715580000, 0x0000000756880000, 0x00000007c0000000) eden space 1004544K, 0% used [0x0000000715580000,0x0000000715580000,0x0000000752a80000) from space 22528K, 67% used [0x0000000755280000,0x0000000756163b90,0x0000000756880000) to space 31744K, 0% used [0x0000000752a80000,0x0000000752a80000,0x0000000754980000) ParOldGen total 87552K, used 36778K [0x00000005c0000000, 0x00000005c5580000, 0x0000000715580000) object space 87552K, 42% used [0x00000005c0000000,0x00000005c23ea828,0x00000005c5580000) Metaspace used 54567K, capacity 55846K, committed 55896K, reserved 1099776K class space used 6205K, capacity 6523K, committed 6528K, reserved 1048576K } Event: 33.299 GC heap before {Heap before GC invocations=21 (full 2): PSYoungGen total 1027072K, used 584621K [0x0000000715580000, 0x0000000756880000, 0x00000007c0000000) eden space 1004544K, 56% used [0x0000000715580000,0x0000000738187ae8,0x0000000752a80000) from space 22528K, 67% used [0x0000000755280000,0x0000000756163b90,0x0000000756880000) to space 31744K, 0% used [0x0000000752a80000,0x0000000752a80000,0x0000000754980000) ParOldGen total 87552K, used 36778K [0x00000005c0000000, 0x00000005c5580000, 0x0000000715580000) object space 87552K, 42% used [0x00000005c0000000,0x00000005c23ea828,0x00000005c5580000) Metaspace used 57493K, capacity 58854K, committed 59028K, reserved 1101824K class space used 6329K, capacity 6667K, committed 6784K, reserved 1048576K Event: 33.352 GC heap after Heap after GC invocations=21 (full 2): PSYoungGen total 1036288K, used 8320K [0x0000000715580000, 0x0000000766c00000, 0x00000007c0000000) eden space 1004544K, 0% used [0x0000000715580000,0x0000000715580000,0x0000000752a80000) from space 31744K, 26% used [0x0000000752a80000,0x00000007532a02e0,0x0000000754980000) to space 31232K, 0% used [0x0000000764d80000,0x0000000764d80000,0x0000000766c00000) ParOldGen total 87552K, used 46586K [0x00000005c0000000, 0x00000005c5580000, 0x0000000715580000) object space 87552K, 53% used [0x00000005c0000000,0x00000005c2d7ea40,0x00000005c5580000) Metaspace used 57493K, capacity 58854K, committed 59028K, reserved 1101824K class space used 6329K, capacity 6667K, committed 6784K, reserved 1048576K } Event: 33.352 GC heap before {Heap before GC invocations=22 (full 3): PSYoungGen total 1036288K, used 8320K [0x0000000715580000, 0x0000000766c00000, 0x00000007c0000000) eden space 1004544K, 0% used [0x0000000715580000,0x0000000715580000,0x0000000752a80000) from space 31744K, 26% used [0x0000000752a80000,0x00000007532a02e0,0x0000000754980000) to space 31232K, 0% used [0x0000000764d80000,0x0000000764d80000,0x0000000766c00000) ParOldGen total 87552K, used 46586K [0x00000005c0000000, 0x00000005c5580000, 0x0000000715580000) object space 87552K, 53% used [0x00000005c0000000,0x00000005c2d7ea40,0x00000005c5580000) Metaspace used 57493K, capacity 58854K, committed 59028K, reserved 1101824K class space used 6329K, capacity 6667K, committed 6784K, reserved 1048576K Event: 33.902 GC heap after Heap after GC invocations=22 (full 3): PSYoungGen total 1036288K, used 0K [0x0000000715580000, 0x0000000766c00000, 0x00000007c0000000) eden space 1004544K, 0% used [0x0000000715580000,0x0000000715580000,0x0000000752a80000) from space 31744K, 0% used [0x0000000752a80000,0x0000000752a80000,0x0000000754980000) to space 31232K, 0% used [0x0000000764d80000,0x0000000764d80000,0x0000000766c00000) ParOldGen total 122368K, used 47886K [0x00000005c0000000, 0x00000005c7780000, 0x0000000715580000) object space 122368K, 39% used [0x00000005c0000000,0x00000005c2ec3920,0x00000005c7780000) Metaspace used 57493K, capacity 58854K, committed 59028K, reserved 1101824K class space used 6329K, capacity 6667K, committed 6784K, reserved 1048576K } Event: 37.921 GC heap before {Heap before GC invocations=23 (full 3): PSYoungGen total 1036288K, used 1004544K [0x0000000715580000, 0x0000000766c00000, 0x00000007c0000000) eden space 1004544K, 100% used [0x0000000715580000,0x0000000752a80000,0x0000000752a80000) from space 31744K, 0% used [0x0000000752a80000,0x0000000752a80000,0x0000000754980000) to space 31232K, 0% used [0x0000000764d80000,0x0000000764d80000,0x0000000766c00000) ParOldGen total 122368K, used 47886K [0x00000005c0000000, 0x00000005c7780000, 0x0000000715580000) object space 122368K, 39% used [0x00000005c0000000,0x00000005c2ec3920,0x00000005c7780000) Metaspace used 61872K, capacity 63520K, committed 63576K, reserved 1105920K class space used 6636K, capacity 7034K, committed 7040K, reserved 1048576K Event: 37.989 GC heap after Heap after GC invocations=23 (full 3): PSYoungGen total 1217024K, used 16275K [0x0000000715580000, 0x0000000765d80000, 0x00000007c0000000) eden space 1200640K, 0% used [0x0000000715580000,0x0000000715580000,0x000000075ea00000) from space 16384K, 99% used [0x0000000764d80000,0x0000000765d64d58,0x0000000765d80000) to space 30208K, 0% used [0x0000000762280000,0x0000000762280000,0x0000000764000000) ParOldGen total 122368K, used 47894K [0x00000005c0000000, 0x00000005c7780000, 0x0000000715580000) object space 122368K, 39% used [0x00000005c0000000,0x00000005c2ec5920,0x00000005c7780000) Metaspace used 61872K, capacity 63520K, committed 63576K, reserved 1105920K class space used 6636K, capacity 7034K, committed 7040K, reserved 1048576K } Event: 84.234 GC heap before {Heap before GC invocations=24 (full 3): PSYoungGen total 1217024K, used 1216915K [0x0000000715580000, 0x0000000765d80000, 0x00000007c0000000) eden space 1200640K, 100% used [0x0000000715580000,0x000000075ea00000,0x000000075ea00000) from space 16384K, 99% used [0x0000000764d80000,0x0000000765d64d58,0x0000000765d80000) to space 30208K, 0% used [0x0000000762280000,0x0000000762280000,0x0000000764000000) ParOldGen total 122368K, used 47894K [0x00000005c0000000, 0x00000005c7780000, 0x0000000715580000) object space 122368K, 39% used [0x00000005c0000000,0x00000005c2ec5920,0x00000005c7780000) Metaspace used 68875K, capacity 70586K, committed 70744K, reserved 1112064K class space used 7426K, capacity 7799K, committed 7808K, reserved 1048576K Event: 84.317 GC heap after Heap after GC invocations=24 (full 3): PSYoungGen total 1288704K, used 30202K [0x0000000715580000, 0x000000076ff80000, 0x00000007c0000000) eden space 1258496K, 0% used [0x0000000715580000,0x0000000715580000,0x0000000762280000) from space 30208K, 99% used [0x0000000762280000,0x0000000763ffe840,0x0000000764000000) to space 40448K, 0% used [0x000000076d800000,0x000000076d800000,0x000000076ff80000) ParOldGen total 122368K, used 63919K [0x00000005c0000000, 0x00000005c7780000, 0x0000000715580000) object space 122368K, 52% used [0x00000005c0000000,0x00000005c3e6bcc0,0x00000005c7780000) Metaspace used 68875K, capacity 70586K, committed 70744K, reserved 1112064K class space used 7426K, capacity 7799K, committed 7808K, reserved 1048576K } Deoptimization events (10 events): Event: 8446.769 Thread 0x00000267e2e70000 Uncommon trap: reason=unstable_if action=reinterpret pc=0x00000267bb23fe2c method=java.io.WinNTFileSystem.parentOrNull(Ljava/lang/String;)Ljava/lang/String; @ 62 Event: 8446.786 Thread 0x00000267e2e70000 Uncommon trap: reason=unstable_if action=reinterpret pc=0x00000267bb1c56a0 method=org.apache.catalina.webresources.DirResourceSet.getResource(Ljava/lang/String;)Lorg/apache/catalina/WebResource; @ 40 Event: 8446.789 Thread 0x00000267deb51800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00000267bccd7ff0 method=java.util.concurrent.ThreadPoolExecutor.getTask()Ljava/lang/Runnable; @ 149 Event: 8995.576 Thread 0x00000267e2e6d000 Uncommon trap: reason=predicate action=maybe_recompile pc=0x00000267bd0a0670 method=java.util.regex.Pattern$SliceI.match(Ljava/util/regex/Matcher;ILjava/lang/CharSequence;)Z @ 21 Event: 9823.279 Thread 0x00000267e2e69000 Uncommon trap: reason=unstable_if action=reinterpret pc=0x00000267bc2bb9f4 method=org.apache.tomcat.util.buf.AbstractChunk.isNull()Z @ 4 Event: 9823.284 Thread 0x00000267e2e67000 Uncommon trap: reason=unstable_if action=reinterpret pc=0x00000267bc46b424 method=java.io.CharArrayWriter.write(Ljava/lang/String;II)V @ 23 Event: 9828.775 Thread 0x00000267e211f000 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x00000267bc6e65d4 method=java.util.HashMap.removeNode(ILjava/lang/Object;Ljava/lang/Object;ZZ)Ljava/util/HashMap$Node; @ 143 Event: 9828.815 Thread 0x00000267e211f000 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x00000267bc6e65d4 method=java.util.HashMap.removeNode(ILjava/lang/Object;Ljava/lang/Object;ZZ)Ljava/util/HashMap$Node; @ 143 Event: 9829.777 Thread 0x00000267e2e6a000 Uncommon trap: reason=unstable_if action=reinterpret pc=0x00000267bb64c024 method=java.io.WinNTFileSystem.isLetter(C)Z @ 21 Event: 9830.358 Thread 0x00000267e2e67000 Uncommon trap: reason=unstable_if action=reinterpret pc=0x00000267bc7e6eb8 method=org.apache.tomcat.util.http.MimeHeaders.createHeader()Lorg/apache/tomcat/util/http/MimeHeaderField; @ 125 Classes redefined (0 events): No events Internal exceptions (10 events): Event: 9281.676 Thread 0x00000267e2e6a800 Exception (0x000000073ae6d710) thrown at [C:\workspace\openjdk-build\workspace\build\src\hotspot\src\share\vm\prims\jni.cpp, line 712] Event: 9361.977 Thread 0x00000267e2e69000 Exception (0x00000007418c2aa8) thrown at [C:\workspace\openjdk-build\workspace\build\src\hotspot\src\share\vm\prims\jni.cpp, line 712] Event: 9442.539 Thread 0x00000267e2e6a800 Exception (0x000000073ae6da50) thrown at [C:\workspace\openjdk-build\workspace\build\src\hotspot\src\share\vm\prims\jni.cpp, line 712] Event: 9523.070 Thread 0x00000267e2e69000 Exception (0x00000007418c2de8) thrown at [C:\workspace\openjdk-build\workspace\build\src\hotspot\src\share\vm\prims\jni.cpp, line 712] Event: 9603.444 Thread 0x00000267e2e6a800 Exception (0x000000073ae6dd90) thrown at [C:\workspace\openjdk-build\workspace\build\src\hotspot\src\share\vm\prims\jni.cpp, line 712] Event: 9684.588 Thread 0x00000267e2e69000 Exception (0x00000007418c3128) thrown at [C:\workspace\openjdk-build\workspace\build\src\hotspot\src\share\vm\prims\jni.cpp, line 712] Event: 9764.448 Thread 0x00000267e2e6a800 Exception (0x000000073ae6e0d0) thrown at [C:\workspace\openjdk-build\workspace\build\src\hotspot\src\share\vm\prims\jni.cpp, line 712] Event: 9823.345 Thread 0x00000267e2e6a800 Exception (0x000000073ae872f0) thrown at [C:\workspace\openjdk-build\workspace\build\src\hotspot\src\share\vm\runtime\sharedRuntime.cpp, line 609] Event: 9830.358 Thread 0x00000267e2e67000 Exception (0x0000000746f32558) thrown at [C:\workspace\openjdk-build\workspace\build\src\hotspot\src\share\vm\runtime\sharedRuntime.cpp, line 609] Event: 9830.424 Thread 0x00000267e2e68800 Implicit null exception at 0x00000267bc373945 to 0x0000000000000000 Events (10 events): Event: 9830.420 Executing VM operation: Deoptimize Event: 9830.421 Executing VM operation: Deoptimize done Event: 9830.423 Executing VM operation: GetOrSetLocal Event: 9830.423 Executing VM operation: GetOrSetLocal done Event: 9830.423 Executing VM operation: GetOrSetLocal Event: 9830.423 Executing VM operation: GetOrSetLocal done Event: 9830.423 Executing VM operation: RevokeBias Event: 9830.423 Executing VM operation: RevokeBias done Event: 9830.424 Executing VM operation: RevokeBias Event: 9830.424 Executing VM operation: RevokeBias done Dynamic libraries: 0x00007ff7f5fd0000 - 0x00007ff7f6021000 E:\Program Files\Apache Software Foundation\Tomcat 9.0\bin\Tomcat9.exe 0x00000267ba230000 - 0x00000267ba41e000 C:\Windows\SYSTEM32\ntd1l.dll 0x00000267b9e20000 - 0x00000267b9ed3000 C:\Windows\System32\kern3l32.dll 0x00007fff13a60000 - 0x00007fff13c4e000 C:\Windows\SYSTEM32\ntdll.dll 0x00007fff11ff0000 - 0x00007fff120a3000 C:\Windows\System32\KERNEL32.DLL 0x00007fff10430000 - 0x00007fff106cd000 C:\Windows\System32\KERNELBASE.dll 0x00007fff0f620000 - 0x00007fff0f933000 C:\Program Files\SentinelOne\Sentinel Agent 23.1.6.896\InProcessClient64.dll 0x00007fff12270000 - 0x00007fff12318000 C:\Windows\System32\ADVAPI32.dll 0x00007fff12480000 - 0x00007fff1251e000 C:\Windows\System32\msvcrt.dll 0x00007fff110c0000 - 0x00007fff11162000 C:\Windows\System32\sechost.dll 0x00007fff114a0000 - 0x00007fff115b8000 C:\Windows\System32\RPCRT4.dll 0x00007fff10900000 - 0x00007fff10926000 C:\Windows\System32\bcrypt.dll 0x00007fff12520000 - 0x00007fff13a18000 C:\Windows\System32\SHELL32.dll 0x00007fff10930000 - 0x00007fff1097a000 C:\Windows\System32\cfgmgr32.dll 0x00007fff10770000 - 0x00007fff1086a000 C:\Windows\System32\ucrtbase.dll 0x00007fff11bd0000 - 0x00007fff11c77000 C:\Windows\System32\shcore.dll 0x00007fff11170000 - 0x00007fff1149a000 C:\Windows\System32\combase.dll 0x00007fff10870000 - 0x00007fff108f2000 C:\Windows\System32\bcryptPrimitives.dll 0x00007fff0fae0000 - 0x00007fff10228000 C:\Windows\System32\windows.storage.dll 0x00007fff106d0000 - 0x00007fff10770000 C:\Windows\System32\msvcp_win.dll 0x00007fff0fa70000 - 0x00007fff0fa93000 C:\Windows\System32\profapi.dll 0x00007fff0fa10000 - 0x00007fff0fa6d000 C:\Windows\System32\powrprof.dll 0x00007fff12210000 - 0x00007fff12262000 C:\Windows\System32\shlwapi.dll 0x00007fff10c80000 - 0x00007fff10ca9000 C:\Windows\System32\GDI32.dll 0x00007fff10980000 - 0x00007fff10b28000 C:\Windows\System32\gdi32full.dll 0x00007fff10f20000 - 0x00007fff110b7000 C:\Windows\System32\USER32.dll 0x00007fff10b30000 - 0x00007fff10b50000 C:\Windows\System32\win32u.dll 0x00007fff0faa0000 - 0x00007fff0fab1000 C:\Windows\System32\kernel.appcore.dll 0x00007fff10b50000 - 0x00007fff10b6b000 C:\Windows\System32\cryptsp.dll 0x00007fff0f5e0000 - 0x00007fff0f5ea000 C:\Windows\SYSTEM32\VERSION.dll 0x00007fff0f5d0000 - 0x00007fff0f5da000 C:\Windows\SYSTEM32\FLTLIB.DLL 0x000000006a090000 - 0x000000006a926000 E:\Program Files\Java\jdk8u432-b06-jre\bin\server\jvm.dll 0x00007fff123a0000 - 0x00007fff123a8000 C:\Windows\System32\PSAPI.DLL 0x00007fff02890000 - 0x00007fff02899000 C:\Windows\SYSTEM32\WSOCK32.dll 0x00007fff123b0000 - 0x00007fff1241d000 C:\Windows\System32\WS2_32.dll 0x00007fff02810000 - 0x00007fff02834000 C:\Windows\SYSTEM32\WINMM.dll 0x00007fff02840000 - 0x00007fff0285b000 C:\Windows\SYSTEM32\VCRUNTIME140.dll 0x00007fff02700000 - 0x00007fff0272d000 C:\Windows\SYSTEM32\WINMMBASE.dll 0x00007fff0ba10000 - 0x00007fff0ba20000 E:\Program Files\Java\jdk8u432-b06-jre\bin\verify.dll 0x00007fff091c0000 - 0x00007fff091eb000 E:\Program Files\Java\jdk8u432-b06-jre\bin\java.dll 0x00007ffef4190000 - 0x00007ffef420b000 C:\Program Files\SentinelOne\Sentinel Agent 23.1.6.896\SentinelJava64.dll 0x00000267ba8d0000 - 0x00000267baa26000 C:\Windows\System32\ole32.dll 0x00007fff092f0000 - 0x00007fff09308000 E:\Program Files\Java\jdk8u432-b06-jre\bin\zip.dll 0x00007fff00f60000 - 0x00007fff00f7c000 E:\Program Files\Java\jdk8u432-b06-jre\bin\net.dll 0x00007fff0eec0000 - 0x00007fff0ef27000 C:\Windows\system32\mswsock.dll 0x00007fff00ef0000 - 0x00007fff00f03000 E:\Program Files\Java\jdk8u432-b06-jre\bin\nio.dll 0x00007fff09900000 - 0x00007fff0990d000 E:\Program Files\Java\jdk8u432-b06-jre\bin\management.dll 0x0000000180000000 - 0x0000000180374000 E:\Program Files\Apache Software Foundation\Tomcat 9.0\bin\tcnative-1.dll 0x00007fff10230000 - 0x00007fff1042e000 C:\Windows\System32\CRYPT32.dll 0x00007fff0fac0000 - 0x00007fff0fad2000 C:\Windows\System32\MSASN1.dll 0x00007fff0e9e0000 - 0x00007fff0ea13000 C:\Windows\system32\rsaenh.dll 0x00007fff0f090000 - 0x00007fff0f09c000 C:\Windows\SYSTEM32\CRYPTBASE.dll 0x00007fff00e80000 - 0x00007fff00ea5000 E:\Program Files\Java\jdk8u432-b06-jre\bin\sunec.dll 0x00007fff08de0000 - 0x00007fff08dee000 E:\Program Files\Java\jdk8u432-b06-jre\bin\sunmscapi.dll 0x00007fff0f190000 - 0x00007fff0f1bc000 C:\Windows\SYSTEM32\ncrypt.dll 0x00007fff02860000 - 0x00007fff0286c000 C:\Windows\SYSTEM32\VCRUNTIME140_1.dll 0x00007fff0f150000 - 0x00007fff0f18c000 C:\Windows\SYSTEM32\NTASN1.dll 0x00007fff072e0000 - 0x00007fff072f6000 C:\Windows\system32\napinsp.dll 0x00007fff0ec00000 - 0x00007fff0ecc6000 C:\Windows\SYSTEM32\DNSAPI.dll 0x00007fff13a20000 - 0x00007fff13a28000 C:\Windows\System32\NSI.dll 0x00007fff0ebb0000 - 0x00007fff0ebed000 C:\Windows\SYSTEM32\IPHLPAPI.DLL 0x00007fff073b0000 - 0x00007fff073be000 C:\Windows\System32\winrnr.dll 0x00007fff0a680000 - 0x00007fff0a69b000 C:\Windows\system32\NLAapi.dll 0x00007fff07300000 - 0x00007fff07315000 C:\Windows\system32\wshbth.dll 0x00007fff09f90000 - 0x00007fff09f9a000 C:\Windows\System32\rasadhlp.dll 0x00007fff0bd30000 - 0x00007fff0bda9000 C:\Windows\System32\fwpuclnt.dll 0x00007fff0f5f0000 - 0x00007fff0f619000 C:\Windows\SYSTEM32\USERENV.dll 0x00007fff0bca0000 - 0x00007fff0bcb6000 C:\Windows\SYSTEM32\dhcpcsvc6.DLL 0x00007fff0bc20000 - 0x00007fff0bc3c000 C:\Windows\SYSTEM32\dhcpcsvc.DLL 0x00007fff0ea70000 - 0x00007fff0eaa1000 C:\Windows\SYSTEM32\ntmarta.dll 0x00007fff09da0000 - 0x00007fff09f8d000 C:\Windows\system32\DBGHELP.DLL 0x00007fff09c80000 - 0x00007fff09caa000 C:\Windows\SYSTEM32\dbgcore.DLL VM Arguments: jvm_args: -Dcatalina.home=E:\Program Files\Apache Software Foundation\Tomcat 9.0 -Dcatalina.base=E:\Program Files\Apache Software Foundation\Tomcat 9.0 -Djava.io.tmpdir=E:\Program Files\Apache Software Foundation\Tomcat 9.0\temp -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=E:\Program Files\Apache Software Foundation\Tomcat 9.0\conf\logging.properties exit abort -Xms128m -Xmx8192m -agentpath:C:\Program Files\SentinelOne\Sentinel Agent 23.1.6.896\SentinelJava64.dll=extendedCapabilities java_command: java_class_path (initial): E:\Program Files\Apache Software Foundation\Tomcat 9.0\bin\bootstrap.jar;E:\Program Files\Apache Software Foundation\Tomcat 9.0\bin\tomcat-juli.jar Launcher Type: generic Environment Variables: JAVA_HOME=C:\app\administrador\product\11.2.0\client_1\jdk\ PATH=E:\Program Files\Java\jdk8u432-b06-jre\bin;C:\app\administrador\product\11.2.0\client_1\bin;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0;C:\Windows\System32\OpenSSH;C:\app\administrador\product\11.2.0\client_1\jdk\bin;C:\Users\administrador.TRANSFESA\AppData\Local\Microsoft\WindowsApps USERNAME=Administrador OS=Windows_NT PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 85 Stepping 7, GenuineIntel

--------------- S Y S T E M ---------------

OS: Windows Server 2019 , 64 bit Build 17763 (10.0.17763.6292) CPU:total 2 (initial active 2) (2 cores per cpu, 1 threads per core) family 6 model 85 stepping 7, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt

Answer 1

Hello,

Thank you for posting in Microsoft Community forum.

Based on the description, I understand your question is related to Tomcat crash.

I understand you would like to analyze the full system memory dump, but please understand the detailed dump analysis will require more professional resources and this may beyond this forum's range.

But you can still check some available information in Microsoft documents:

Resolving Blue Screen errors in Windows - Microsoft Support

Stop error, bug check, or blue screen error troubleshooting - Windows Client | Microsoft Learn

Best Regards,

Wesley Li

Answer 2

Hello,

Ok, but do you know if the error EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000267bc373945, pid=4324, tid=0x0000000000001d48 is related to something specific? so we can near down the problem.

I've anylized the dump and this is the outcome:

*******************************************************************************

* *

* Exception Analysis *

* *

*******************************************************************************

KEY_VALUES_STRING: 1

Key  : AV.Dereference

Value: NullClassPtr

Key  : AV.Fault

Value: Read

Key  : Analysis.CPU.mSec

Value: 5359

Key  : Analysis.DebugAnalysisManager

Value: Create

Key  : Analysis.Elapsed.mSec

Value: 9273

Key  : Analysis.Init.CPU.mSec

Value: 3624

Key  : Analysis.Init.Elapsed.mSec

Value: 121079

Key  : Analysis.Memory.CommitPeak.Mb

Value: 125

Key  : Timeline.OS.Boot.DeltaSec

Value: 7553513

Key  : Timeline.Process.Start.DeltaSec

Value: 9832

Key  : WER.OS.Branch

Value: rs5\_release

Key  : WER.OS.Timestamp

Value: 2018-09-14T14:34:00Z

Key  : WER.OS.Version

Value: 10.0.17763.1

Key  : WER.Process.Version

Value: 1.4.0.0

FILE_IN_CAB: hs_err_pid4324.mdmp

NTGLOBALFLAG: 0

PROCESS_BAM_CURRENT_THROTTLED: 0

PROCESS_BAM_PREVIOUS_THROTTLED: 0

APPLICATION_VERIFIER_FLAGS: 0

CONTEXT: (.ecxr)

rax=00000267dcb08930 rbx=00000267dcb08930 rcx=000000074c89f420

rdx=000000074c89f420 rsi=00000267c7020000 rdi=000000074c89f478

rip=00000267bc373945 rsp=0000008cf6dfc990 rbp=000000074c89f420

r8=000000006a83a640 r9=000000000000000a r10=0000000000000000

r11=00000267bc373920 r12=0000000000000000 r13=0000008cf6dfca08

r14=00000007c002d7d0 r15=00000267e2e68800

iopl=0 nv up ei pl zr na po nc

cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010246

00000267bc373945 4d8b92d0010000 mov r10,qword ptr [r10+1D0h] ds:00000000000001d0=????????????????

Resetting default scope

EXCEPTION_RECORD: (.exr -1)

ExceptionAddress: 00000267bc373945

ExceptionCode: c0000005 (Access violation)

ExceptionFlags: 00000000

NumberParameters: 2

Parameter[0]: 0000000000000000

Parameter[1]: 00000000000001d0

Attempt to read from address 00000000000001d0

PROCESS_NAME: Tomcat9.exe

READ_ADDRESS: 00000000000001d0

ERROR_CODE: (NTSTATUS) 0xc0000005 - La instrucci n en 0x%p hace referencia a la memoria en 0x%p. La memoria no se pudo %s.

EXCEPTION_CODE_STR: c0000005

EXCEPTION_PARAMETER1: 0000000000000000

EXCEPTION_PARAMETER2: 00000000000001d0

IP_ON_HEAP: 00000267ea77a4b8

The fault address in not in any loaded module, please check your build's rebase

log at \bin\build_logs\timebuild\ntrebase.log for module which may

contain the address if it were loaded.

FRAME_ONE_INVALID: 1

STACK_TEXT:

0000008cf6dfc990 00000267ea77a4b8 : 00000267e2e68800 0000008cf6dfca70 00000267e8840555 0000000000000000 : 0x00000267`bc373945

0000008cf6dfc998 00000267e2e68800 : 0000008cf6dfca70 00000267e8840555 0000000000000000 000000074c89f478 : 0x00000267`ea77a4b8

0000008cf6dfc9a0 0000008cf6dfca70 : 00000267e8840555 0000000000000000 000000074c89f478 00000267c7020000 : 0x00000267`e2e68800

0000008cf6dfc9a8 00000267e8840555 : 0000000000000000 000000074c89f478 00000267c7020000 000000006a83a640 : 0x0000008c`f6dfca70

0000008cf6dfc9b0 0000000000000000 : 000000074c89f478 00000267c7020000 000000006a83a640 0000008cf6dfca58 : 0x00000267`e8840555

SYMBOL_NAME: Tomcat9.exe!unknown_error_in_process

MODULE_NAME: Tomcat9

IMAGE_NAME: Tomcat9.exe

STACK_COMMAND: ~37s; .ecxr ; kb

FAILURE_BUCKET_ID: NULL_CLASS_PTR_READ_c0000005_Tomcat9.exe!unknown_error_in_process

OS_VERSION: 10.0.17763.1

BUILDLAB_STR: rs5_release

OSPLATFORM_TYPE: x64

OSNAME: Windows 10

IMAGE_VERSION: 1.4.0.0

FAILURE_ID_HASH: {6d62fe1e-2a13-90b1-92fb-616ea29c07ec}

Followup: MachineOwner

---

Thanks

Answer 3

did you ever get it to fix i been having problems lately with same crash

Answer 4

No, I'm still trying to open a request with Microsoft but seems impossible.