October 14, 2019 at 8:47 am
Hi Guys,
I got 14 dumps in last two days, I tried to use WinDbg to check what is going, but I don't get a clear information from the output, can anyone help pinpoint the cause?
I know it is very likely failed at sqlmin!CChangeTrackingDatabase::CleanupNextTable+711, but not sure is it failed at specific database, or something else. thanks in advance.
Microsoft SQL Server 2014 (SP3-CU4) (KB4500181) - 12.0.6329.1 (X64)
Jul 20 2019 21:42:29
Copyright (c) Microsoft Corporation
Enterprise Edition (64-bit) on Windows NT 6.3 <X64> (Build 9600: )
Microsoft (R) Windows Debugger Version 10.0.18362.1 AMD64
Copyright (c) Microsoft Corporation. All rights reserved.
Loading Dump File [C:\Users\xxx.yyy\Documents\SQLDump0054\SQLDump0054.mdmp]
Comment: 'Program fault handler'
Comment: '10/13/19 10:26:40 spid 30 Exception 0xc0000005 EXCEPTION_ACCESS_VIOLATION reading address 0000000000000000 at 0x00007FFB6B25F021
'
User Mini Dump File: Only registers, stack and portions of memory are available
Symbol search path is: srv*
Executable search path is:
Windows 8 Version 9200 MP (24 procs) Free x64
Product: Server, suite: TerminalServer SingleUserTS
Machine Name:
Debug session time: Sun Oct 13 07:27:20.000 2019 (UTC + 8:00)
System Uptime: 27 days 7:29:30.265
Process Uptime: 27 days 7:26:14.000
................................................................
................................................................
..............
Loading unloaded module list
................................................................
This dump file has an exception of interest stored in it.
The stored exception information can be accessed via .ecxr.
(f80.13f8): Access violation - code c0000005 (first/second chance not available)
For analysis of this file, run !analyze -v
ntdll!NtWaitForSingleObject+0xa:
00007ffb`88d0079a c3 ret
0:000> .ecxr
Unable to load image C:\Program Files\Microsoft SQL Server\MSSQL12.INSTANCE1\MSSQL\Binn\sqlmin.dll, Win32 error 0n2
*** WARNING: Unable to verify timestamp for sqlmin.dll
rax=00006a826517f474 rbx=0000005668600390 rcx=6bdeede020640000
rdx=0000000000000000 rsi=000001e5295451c0 rdi=000001e529545200
rip=00007ffb6b25f021 rsp=0000015c88f7d6b0 rbp=0000015c88f7dc90
r8=0000000000000001 r9=0000000000000000 r10=0000005941541a78
r11=0000000000000001 r12=0000000000000000 r13=0000000000000001
r14=0000000000000000 r15=0000006ed7b0bf68
iopl=0 nv up ei pl nz na po nc
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010206
sqlmin!CChangeTrackingDatabase::CleanupNextTable+0x711:
00007ffb6b25f021 498b06 mov rax,qword ptr [r14] ds:0000000000000000=????????????????
0:000> !analyze -v
*******************************************************************************
* *
* Exception Analysis *
* *
*******************************************************************************
*** WARNING: Unable to verify timestamp for sqllang.dll
*** WARNING: Unable to verify timestamp for sqldk.dll
Unable to load image C:\Windows\assembly\NativeImages_v4.0.30319_64\mscorlib\fe2524177eb3088c77be666722039f52\mscorlib.ni.dll, Win32 error 0n2
*** WARNING: Unable to verify timestamp for mscorlib.ni.dll
*** WARNING: Unable to verify timestamp for sqlservr.exe
Failed to request MethodData, not in JIT code range
KEY_VALUES_STRING: 1
Key : AV.Dereference
Value: NullPtr
Key : AV.Fault
Value: Read
Key : CLR.Engine
Value: CLR
Key : CLR.Version
Value: 4.0.30319.0
Key : Timeline.OS.Boot.DeltaSec
Value: 2359770
Key : Timeline.Process.Start.DeltaSec
Value: 2359574
PROCESSES_ANALYSIS: 1
SERVICE_ANALYSIS: 1
STACKHASH_ANALYSIS: 1
TIMELINE_ANALYSIS: 1
Timeline: !analyze.Start
Name: <blank>
Time: 2019-10-14T07:32:08.925Z
Diff: 115488925 mSec
Timeline: Dump.Current
Name: <blank>
Time: 2019-10-12T23:27:20.0Z
Diff: 0 mSec
Timeline: Process.Start
Name: <blank>
Time: 2019-09-15T16:01:06.0Z
Diff: -1935393296 mSec
Timeline: OS.Boot
Name: <blank>
Time: 2019-09-15T15:57:50.0Z
Diff: -1935197296 mSec
DUMP_CLASS: 2
DUMP_QUALIFIER: 400
CONTEXT: (.ecxr)
rax=00006a826517f474 rbx=0000005668600390 rcx=6bdeede020640000
rdx=0000000000000000 rsi=000001e5295451c0 rdi=000001e529545200
rip=00007ffb6b25f021 rsp=0000015c88f7d6b0 rbp=0000015c88f7dc90
r8=0000000000000001 r9=0000000000000000 r10=0000005941541a78
r11=0000000000000001 r12=0000000000000000 r13=0000000000000001
r14=0000000000000000 r15=0000006ed7b0bf68
iopl=0 nv up ei pl nz na po nc
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010206
sqlmin!CChangeTrackingDatabase::CleanupNextTable+0x711:
00007ffb6b25f021 498b06 mov rax,qword ptr [r14] ds:0000000000000000=????????????????
Resetting default scope
FAULTING_IP:
sqlmin!CChangeTrackingDatabase::CleanupNextTable+711
00007ffb`6b25f021 498b06 mov rax,qword ptr [r14]
EXCEPTION_RECORD: (.exr -1)
ExceptionAddress: 00007ffb6b25f021 (sqlmin!CChangeTrackingDatabase::CleanupNextTable+0x0000000000000711)
ExceptionCode: c0000005 (Access violation)
ExceptionFlags: 00000000
NumberParameters: 2
Parameter[0]: 0000000000000000
Parameter[1]: 0000000000000000
Attempt to read from address 0000000000000000
DEFAULT_BUCKET_ID: NULL_POINTER_READ_NOSOS
PROCESS_NAME: sqlservr.exe
FOLLOWUP_IP:
sqlmin!CChangeTrackingDatabase::CleanupNextTable+711
00007ffb`6b25f021 498b06 mov rax,qword ptr [r14]
READ_ADDRESS: 0000000000000000
ERROR_CODE: (NTSTATUS) 0xc0000005 - The instruction at 0x%p referenced memory at 0x%p. The memory could not be %s.
EXCEPTION_CODE: (NTSTATUS) 0xc0000005 - The instruction at 0x%p referenced memory at 0x%p. The memory could not be %s.
EXCEPTION_CODE_STR: c0000005
EXCEPTION_PARAMETER1: 0000000000000000
EXCEPTION_PARAMETER2: 0000000000000000
WATSON_BKT_PROCSTAMP: 4df2bcc2
WATSON_BKT_PROCVER: 10.0.40219.325
PROCESS_VER_PRODUCT: Microsoft® Visual Studio® 2010
WATSON_BKT_MODULE: sqlmin.dll
WATSON_BKT_MODSTAMP: 5d33c9e7
WATSON_BKT_MODOFFSET: c2f021
WATSON_BKT_MODVER: 2014.120.6329.1
BUILD_VERSION_STRING: 6.3.9600.19358 (winblue_ltsb_escrow.190505-1600)
MODLIST_WITH_TSCHKSUM_HASH: 3a7b6853e9d7e902fe09461b67379411b77d954a
MODLIST_SHA1_HASH: 55336b838e2f423ed19b88672c0478525241857a
COMMENT: Program fault handler
NTGLOBALFLAG: 0
PROCESS_BAM_CURRENT_THROTTLED: 0
PROCESS_BAM_PREVIOUS_THROTTLED: 0
DUMP_FLAGS: 800288c
DUMP_TYPE: 1
MISSING_CLR_SYMBOL: 0
ANALYSIS_SESSION_HOST: Workstation-XXXYYY
ANALYSIS_SESSION_TIME: 10-14-2019 15:32:08.0925
ANALYSIS_VERSION: 10.0.18362.1 amd64fre
MANAGED_CODE: 1
MANAGED_ENGINE_MODULE: clr
MANAGED_ANALYSIS_PROVIDER: SOS
MANAGED_THREAD_ID: 13f8
THREAD_ATTRIBUTES:
OS_LOCALE: ENA
ADDITIONAL_DEBUG_TEXT: SOS.DLL is not loaded for managed code. Analysis might be incomplete
BUGCHECK_STR: APPLICATION_FAULT_NULL_POINTER_READ_INVALID_POINTER_READ_NOSOS
PRIMARY_PROBLEM_CLASS: APPLICATION_FAULT
PROBLEM_CLASSES:
ID: [0n313]
Type: [@ACCESS_VIOLATION]
Class: Addendum
Scope: BUCKET_ID
Name: Omit
Data: Omit
PID: [Unspecified]
TID: [0x13f8]
Frame: [0] : sqlmin!CChangeTrackingDatabase::CleanupNextTable
ID: [0n285]
Type: [INVALID_POINTER_READ]
Class: Primary
Scope: BUCKET_ID
Name: Add
Data: Omit
PID: [Unspecified]
TID: [0x13f8]
Frame: [0] : sqlmin!CChangeTrackingDatabase::CleanupNextTable
ID: [0n300]
Type: [NULL_POINTER_READ]
Class: Primary
Scope: DEFAULT_BUCKET_ID (Failure Bucket ID prefix)
BUCKET_ID
Name: Add
Data: Omit
PID: [0xf80]
TID: [0x13f8]
Frame: [0] : sqlmin!CChangeTrackingDatabase::CleanupNextTable
ID: [0n251]
Type: [NOSOS]
Class: Addendum
Scope: DEFAULT_BUCKET_ID (Failure Bucket ID prefix)
BUCKET_ID
Name: Add
Data: Omit
PID: [Unspecified]
TID: [Unspecified]
Frame: [0]
LAST_CONTROL_TRANSFER: from 00007ffb6b260374 to 00007ffb6b25f021
STACK_TEXT:
0000015c88f7d6b0 00007ffb6b260374 : 00007ffb6e1df5b0 00007ffb6e1df5b0 0000008d4d9e49f0 0000000000000000 : sqlmin!CChangeTrackingDatabase::CleanupNextTable+0x711
0000015c88f7db90 00007ffb6a87b256 : 0000000000000000 0000000000000000 0000008d4d9e49f0 0000005668600320 : sqlmin!CChangeTrackingCleanupTask::CleanupCurrentDatabase+0x144
0000015c88f7de40 00007ffb6a647d03 : 00000003000007d0 0000000000000000 00007ffb6e1df5b0 0000000000000000 : sqlmin!CChangeTrackingCleanupTask::ProcessTskPkt+0x15a
0000015c88f7e100 00007ffb6a6479aa : 00007ffb6e1df5b0 0000006000000000 0000008d00000000 0000008d4d9e4a10 : sqlmin!TaskReqPktTimer::ExecuteTask+0x63
0000015c88f7e1e0 00007ffb6834498f : 0000000000000000 0000006077bb0d20 0000000000000000 0000015c88f7efe0 : sqlmin!OnDemandTaskContext::ProcessTskPkt+0x3e2
0000015c88f7e430 00007ffb6a647685 : 0000000000000000 0000000000000000 0000000000000000 0000000000000000 : sqllang!SystemTaskEntryPoint+0x426
0000015c88f7efb0 00007ffb71bf4800 : 0000009200000000 0000015c88f7f100 00007ff78235f508 00007ffb71bf39a1 : sqlmin!OnDemandTaskContext::FuncEntryPoint+0x25
0000015c88f7efe0 00007ffb71bf45c7 : 0000006077bb0000 00007ffb71bf3fbd 0000002bf7ab2108 000000540a7a9c68 : sqldk!SOS_Task::Param::Execute+0x21e
0000015c88f7f5e0 00007ffb71bf4296 : 00000092fb810040 0000002bf7ab2108 00000092fb810040 0000000000000000 : sqldk!SOS_Scheduler::RunTask+0xab
0000015c88f7f650 00007ffb71c0b54f : 00000032b4398160 0000006077bb0160 0000006077bb0160 0000006077bb0160 : sqldk!SOS_Scheduler::ProcessTasks+0x279
0000015c88f7f6d0 00007ffb71c0b6a0 : 0000006077bb0160 0000070b84f2f251 0000006077bb0160 00007ff78235f508 : sqldk!SchedulerManager::WorkerEntryPoint+0x24c
0000015c88f7f770 00007ffb71c0b629 : 0000006077bb0160 0000015c88f7f810 00000092fb300250 0000015c88f7f810 : sqldk!SystemThread::RunWorker+0x8f
0000015c88f7f7a0 00007ffb71c0beb8 : 0000000000000001 00007ff78235f508 0000000000000001 0000009200000001 : sqldk!SystemThreadDispatcher::ProcessWorker+0x366
0000015c88f7f850 00007ffb880513f2 : 0000000000000000 0000000000000000 00007ff78235f508 0000000000000000 : sqldk!SchedulerManager::ThreadEntryPoint+0x226
0000015c88f7f8f0 00007ffb88c854f4 : 00007ffb880513d0 0000000000000000 0000000000000000 0000000000000000 : kernel32!BaseThreadInitThunk+0x22
0000015c88f7f920 0000000000000000 : 0000000000000000 0000000000000000 0000000000000000 0000000000000000 : ntdll!RtlUserThreadStart+0x34
THREAD_SHA1_HASH_MOD_FUNC: cb461755ae3269f82b5d054444fda95091855a7f
THREAD_SHA1_HASH_MOD_FUNC_OFFSET: ed0fbd3816979e177238340b8f947590296aa8b4
THREAD_SHA1_HASH_MOD: 36b18d37bf5d256196e1ab87bd429e6699ad0d67
FAULT_INSTR_CODE: 49068b49
SYMBOL_STACK_INDEX: 0
SYMBOL_NAME: sqlmin!CChangeTrackingDatabase::CleanupNextTable+711
FOLLOWUP_NAME: MachineOwner
MODULE_NAME: sqlmin
IMAGE_NAME: sqlmin.dll
DEBUG_FLR_IMAGE_TIMESTAMP: 5d33c9e7
STACK_COMMAND: ~0s ; .ecxr ; kb
FAILURE_BUCKET_ID: NULL_POINTER_READ_NOSOS_c0000005_sqlmin.dll!CChangeTrackingDatabase::CleanupNextTable
BUCKET_ID: APPLICATION_FAULT_NULL_POINTER_READ_INVALID_POINTER_READ_NOSOS_sqlmin!CChangeTrackingDatabase::CleanupNextTable+711
FAILURE_EXCEPTION_CODE: c0000005
FAILURE_IMAGE_NAME: sqlmin.dll
BUCKET_ID_IMAGE_STR: sqlmin.dll
FAILURE_MODULE_NAME: sqlmin
BUCKET_ID_MODULE_STR: sqlmin
FAILURE_FUNCTION_NAME: CChangeTrackingDatabase::CleanupNextTable
BUCKET_ID_FUNCTION_STR: CChangeTrackingDatabase::CleanupNextTable
BUCKET_ID_OFFSET: 711
BUCKET_ID_MODTIMEDATESTAMP: 5d33c9e7
BUCKET_ID_MODCHECKSUM: 3e22a7a
BUCKET_ID_MODVER_STR: 2014.120.6329.1
BUCKET_ID_PREFIX_STR: APPLICATION_FAULT_NULL_POINTER_READ_INVALID_POINTER_READ_NOSOS_
FAILURE_PROBLEM_CLASS: APPLICATION_FAULT
FAILURE_SYMBOL_NAME: sqlmin.dll!CChangeTrackingDatabase::CleanupNextTable
WATSON_STAGEONE_URL: http://watson.microsoft.com/StageOne/sqlservr.exe/10.0.40219.325/4df2bcc2/sqlmin.dll/2014.120.6329.1/5d33c9e7/c0000005/00c2f021.htm?Retriage=1
TARGET_TIME: 2019-10-12T23:27:20.000Z
OSBUILD: 9200
OSSERVICEPACK: 19358
SERVICEPACK_NUMBER: 0
OS_REVISION: 0
SUITE_MASK: 272
PRODUCT_TYPE: 3
OSPLATFORM_TYPE: x64
OSNAME: Windows 8
OSEDITION: Windows 8 Server TerminalServer SingleUserTS
USER_LCID: 0
OSBUILD_TIMESTAMP: 2019-05-06 10:41:50
BUILDDATESTAMP_STR: 190505-1600
BUILDLAB_STR: winblue_ltsb_escrow
BUILDOSVER_STR: 6.3.9600.19358
ANALYSIS_SESSION_ELAPSED_TIME: 19639
ANALYSIS_SOURCE: UM
FAILURE_ID_HASH_STRING: um:null_pointer_read_nosos_c0000005_sqlmin.dll!cchangetrackingdatabase::cleanupnexttable
FAILURE_ID_HASH: {47998ccc-6fcf-f846-0dac-e620a1d46e79}
Followup: MachineOwner
---------
October 14, 2019 at 9:35 am
Debugging dumps is advanced stuff. I'd raise a call with Microsoft, if I were you. They're likely to be able to pinpoint the cause much faster than you can.
John
October 14, 2019 at 10:37 am
Agreed; Microsoft.
Viewing 3 posts - 1 through 2 (of 2 total)
You must be logged in to reply to this topic. Login to reply