assist needed for the SQL Server dump

  • i1888

    SSCommitted

    Points: 1810

    Hi Guys,

    I got 14 dumps in last two days, I tried to use WinDbg to check what is going, but I don't get a clear information from the output, can anyone help pinpoint the cause?

    I know it is very likely failed at sqlmin!CChangeTrackingDatabase::CleanupNextTable+711, but not sure is it failed at specific database, or something else. thanks in advance.

    Microsoft SQL Server 2014 (SP3-CU4) (KB4500181) - 12.0.6329.1 (X64)

    Jul 20 2019 21:42:29

    Copyright (c) Microsoft Corporation

    Enterprise Edition (64-bit) on Windows NT 6.3 <X64> (Build 9600: )

     

    Microsoft (R) Windows Debugger Version 10.0.18362.1 AMD64

    Copyright (c) Microsoft Corporation. All rights reserved.

    Loading Dump File [C:\Users\xxx.yyy\Documents\SQLDump0054\SQLDump0054.mdmp]

    Comment: 'Program fault handler'

    Comment: '10/13/19 10:26:40 spid 30 Exception 0xc0000005 EXCEPTION_ACCESS_VIOLATION reading address 0000000000000000 at 0x00007FFB6B25F021

    '

    User Mini Dump File: Only registers, stack and portions of memory are available

    Symbol search path is: srv*

    Executable search path is:

    Windows 8 Version 9200 MP (24 procs) Free x64

    Product: Server, suite: TerminalServer SingleUserTS

    Machine Name:

    Debug session time: Sun Oct 13 07:27:20.000 2019 (UTC + 8:00)

    System Uptime: 27 days 7:29:30.265

    Process Uptime: 27 days 7:26:14.000

    ................................................................

    ................................................................

    ..............

    Loading unloaded module list

    ................................................................

    This dump file has an exception of interest stored in it.

    The stored exception information can be accessed via .ecxr.

    (f80.13f8): Access violation - code c0000005 (first/second chance not available)

    For analysis of this file, run !analyze -v

    ntdll!NtWaitForSingleObject+0xa:

    00007ffb`88d0079a c3 ret

    0:000> .ecxr

    Unable to load image C:\Program Files\Microsoft SQL Server\MSSQL12.INSTANCE1\MSSQL\Binn\sqlmin.dll, Win32 error 0n2

    *** WARNING: Unable to verify timestamp for sqlmin.dll

    rax=00006a826517f474 rbx=0000005668600390 rcx=6bdeede020640000

    rdx=0000000000000000 rsi=000001e5295451c0 rdi=000001e529545200

    rip=00007ffb6b25f021 rsp=0000015c88f7d6b0 rbp=0000015c88f7dc90

    r8=0000000000000001 r9=0000000000000000 r10=0000005941541a78

    r11=0000000000000001 r12=0000000000000000 r13=0000000000000001

    r14=0000000000000000 r15=0000006ed7b0bf68

    iopl=0 nv up ei pl nz na po nc

    cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010206

    sqlmin!CChangeTrackingDatabase::CleanupNextTable+0x711:

    00007ffb6b25f021 498b06 mov rax,qword ptr [r14] ds:0000000000000000=????????????????

    0:000> !analyze -v

    *******************************************************************************

    * *

    * Exception Analysis *

    * *

    *******************************************************************************

    *** WARNING: Unable to verify timestamp for sqllang.dll

    *** WARNING: Unable to verify timestamp for sqldk.dll

    Unable to load image C:\Windows\assembly\NativeImages_v4.0.30319_64\mscorlib\fe2524177eb3088c77be666722039f52\mscorlib.ni.dll, Win32 error 0n2

    *** WARNING: Unable to verify timestamp for mscorlib.ni.dll

    *** WARNING: Unable to verify timestamp for sqlservr.exe

    Failed to request MethodData, not in JIT code range

    KEY_VALUES_STRING: 1

    Key : AV.Dereference

    Value: NullPtr

    Key : AV.Fault

    Value: Read

    Key : CLR.Engine

    Value: CLR

    Key : CLR.Version

    Value: 4.0.30319.0

    Key : Timeline.OS.Boot.DeltaSec

    Value: 2359770

    Key : Timeline.Process.Start.DeltaSec

    Value: 2359574

    PROCESSES_ANALYSIS: 1

    SERVICE_ANALYSIS: 1

    STACKHASH_ANALYSIS: 1

    TIMELINE_ANALYSIS: 1

    Timeline: !analyze.Start

    Name: <blank>

    Time: 2019-10-14T07:32:08.925Z

    Diff: 115488925 mSec

    Timeline: Dump.Current

    Name: <blank>

    Time: 2019-10-12T23:27:20.0Z

    Diff: 0 mSec

    Timeline: Process.Start

    Name: <blank>

    Time: 2019-09-15T16:01:06.0Z

    Diff: -1935393296 mSec

    Timeline: OS.Boot

    Name: <blank>

    Time: 2019-09-15T15:57:50.0Z

    Diff: -1935197296 mSec

    DUMP_CLASS: 2

    DUMP_QUALIFIER: 400

    CONTEXT: (.ecxr)

    rax=00006a826517f474 rbx=0000005668600390 rcx=6bdeede020640000

    rdx=0000000000000000 rsi=000001e5295451c0 rdi=000001e529545200

    rip=00007ffb6b25f021 rsp=0000015c88f7d6b0 rbp=0000015c88f7dc90

    r8=0000000000000001 r9=0000000000000000 r10=0000005941541a78

    r11=0000000000000001 r12=0000000000000000 r13=0000000000000001

    r14=0000000000000000 r15=0000006ed7b0bf68

    iopl=0 nv up ei pl nz na po nc

    cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010206

    sqlmin!CChangeTrackingDatabase::CleanupNextTable+0x711:

    00007ffb6b25f021 498b06 mov rax,qword ptr [r14] ds:0000000000000000=????????????????

    Resetting default scope

    FAULTING_IP:

    sqlmin!CChangeTrackingDatabase::CleanupNextTable+711

    00007ffb`6b25f021 498b06 mov rax,qword ptr [r14]

    EXCEPTION_RECORD: (.exr -1)

    ExceptionAddress: 00007ffb6b25f021 (sqlmin!CChangeTrackingDatabase::CleanupNextTable+0x0000000000000711)

    ExceptionCode: c0000005 (Access violation)

    ExceptionFlags: 00000000

    NumberParameters: 2

    Parameter[0]: 0000000000000000

    Parameter[1]: 0000000000000000

    Attempt to read from address 0000000000000000

    DEFAULT_BUCKET_ID: NULL_POINTER_READ_NOSOS

    PROCESS_NAME: sqlservr.exe

    FOLLOWUP_IP:

    sqlmin!CChangeTrackingDatabase::CleanupNextTable+711

    00007ffb`6b25f021 498b06 mov rax,qword ptr [r14]

    READ_ADDRESS: 0000000000000000

    ERROR_CODE: (NTSTATUS) 0xc0000005 - The instruction at 0x%p referenced memory at 0x%p. The memory could not be %s.

    EXCEPTION_CODE: (NTSTATUS) 0xc0000005 - The instruction at 0x%p referenced memory at 0x%p. The memory could not be %s.

    EXCEPTION_CODE_STR: c0000005

    EXCEPTION_PARAMETER1: 0000000000000000

    EXCEPTION_PARAMETER2: 0000000000000000

    WATSON_BKT_PROCSTAMP: 4df2bcc2

    WATSON_BKT_PROCVER: 10.0.40219.325

    PROCESS_VER_PRODUCT: Microsoft® Visual Studio® 2010

    WATSON_BKT_MODULE: sqlmin.dll

    WATSON_BKT_MODSTAMP: 5d33c9e7

    WATSON_BKT_MODOFFSET: c2f021

    WATSON_BKT_MODVER: 2014.120.6329.1

    BUILD_VERSION_STRING: 6.3.9600.19358 (winblue_ltsb_escrow.190505-1600)

    MODLIST_WITH_TSCHKSUM_HASH: 3a7b6853e9d7e902fe09461b67379411b77d954a

    MODLIST_SHA1_HASH: 55336b838e2f423ed19b88672c0478525241857a

    COMMENT: Program fault handler

    NTGLOBALFLAG: 0

    PROCESS_BAM_CURRENT_THROTTLED: 0

    PROCESS_BAM_PREVIOUS_THROTTLED: 0

    DUMP_FLAGS: 800288c

    DUMP_TYPE: 1

    MISSING_CLR_SYMBOL: 0

    ANALYSIS_SESSION_HOST: Workstation-XXXYYY

    ANALYSIS_SESSION_TIME: 10-14-2019 15:32:08.0925

    ANALYSIS_VERSION: 10.0.18362.1 amd64fre

    MANAGED_CODE: 1

    MANAGED_ENGINE_MODULE: clr

    MANAGED_ANALYSIS_PROVIDER: SOS

    MANAGED_THREAD_ID: 13f8

    THREAD_ATTRIBUTES:

    OS_LOCALE: ENA

    ADDITIONAL_DEBUG_TEXT: SOS.DLL is not loaded for managed code. Analysis might be incomplete

    BUGCHECK_STR: APPLICATION_FAULT_NULL_POINTER_READ_INVALID_POINTER_READ_NOSOS

    PRIMARY_PROBLEM_CLASS: APPLICATION_FAULT

    PROBLEM_CLASSES:

    ID: [0n313]

    Type: [@ACCESS_VIOLATION]

    Class: Addendum

    Scope: BUCKET_ID

    Name: Omit

    Data: Omit

    PID: [Unspecified]

    TID: [0x13f8]

    Frame: [0] : sqlmin!CChangeTrackingDatabase::CleanupNextTable

    ID: [0n285]

    Type: [INVALID_POINTER_READ]

    Class: Primary

    Scope: BUCKET_ID

    Name: Add

    Data: Omit

    PID: [Unspecified]

    TID: [0x13f8]

    Frame: [0] : sqlmin!CChangeTrackingDatabase::CleanupNextTable

    ID: [0n300]

    Type: [NULL_POINTER_READ]

    Class: Primary

    Scope: DEFAULT_BUCKET_ID (Failure Bucket ID prefix)

    BUCKET_ID

    Name: Add

    Data: Omit

    PID: [0xf80]

    TID: [0x13f8]

    Frame: [0] : sqlmin!CChangeTrackingDatabase::CleanupNextTable

    ID: [0n251]

    Type: [NOSOS]

    Class: Addendum

    Scope: DEFAULT_BUCKET_ID (Failure Bucket ID prefix)

    BUCKET_ID

    Name: Add

    Data: Omit

    PID: [Unspecified]

    TID: [Unspecified]

    Frame: [0]

    LAST_CONTROL_TRANSFER: from 00007ffb6b260374 to 00007ffb6b25f021

    STACK_TEXT:

    0000015c88f7d6b0 00007ffb6b260374 : 00007ffb6e1df5b0 00007ffb6e1df5b0 0000008d4d9e49f0 0000000000000000 : sqlmin!CChangeTrackingDatabase::CleanupNextTable+0x711

    0000015c88f7db90 00007ffb6a87b256 : 0000000000000000 0000000000000000 0000008d4d9e49f0 0000005668600320 : sqlmin!CChangeTrackingCleanupTask::CleanupCurrentDatabase+0x144

    0000015c88f7de40 00007ffb6a647d03 : 00000003000007d0 0000000000000000 00007ffb6e1df5b0 0000000000000000 : sqlmin!CChangeTrackingCleanupTask::ProcessTskPkt+0x15a

    0000015c88f7e100 00007ffb6a6479aa : 00007ffb6e1df5b0 0000006000000000 0000008d00000000 0000008d4d9e4a10 : sqlmin!TaskReqPktTimer::ExecuteTask+0x63

    0000015c88f7e1e0 00007ffb6834498f : 0000000000000000 0000006077bb0d20 0000000000000000 0000015c88f7efe0 : sqlmin!OnDemandTaskContext::ProcessTskPkt+0x3e2

    0000015c88f7e430 00007ffb6a647685 : 0000000000000000 0000000000000000 0000000000000000 0000000000000000 : sqllang!SystemTaskEntryPoint+0x426

    0000015c88f7efb0 00007ffb71bf4800 : 0000009200000000 0000015c88f7f100 00007ff78235f508 00007ffb71bf39a1 : sqlmin!OnDemandTaskContext::FuncEntryPoint+0x25

    0000015c88f7efe0 00007ffb71bf45c7 : 0000006077bb0000 00007ffb71bf3fbd 0000002bf7ab2108 000000540a7a9c68 : sqldk!SOS_Task::Param::Execute+0x21e

    0000015c88f7f5e0 00007ffb71bf4296 : 00000092fb810040 0000002bf7ab2108 00000092fb810040 0000000000000000 : sqldk!SOS_Scheduler::RunTask+0xab

    0000015c88f7f650 00007ffb71c0b54f : 00000032b4398160 0000006077bb0160 0000006077bb0160 0000006077bb0160 : sqldk!SOS_Scheduler::ProcessTasks+0x279

    0000015c88f7f6d0 00007ffb71c0b6a0 : 0000006077bb0160 0000070b84f2f251 0000006077bb0160 00007ff78235f508 : sqldk!SchedulerManager::WorkerEntryPoint+0x24c

    0000015c88f7f770 00007ffb71c0b629 : 0000006077bb0160 0000015c88f7f810 00000092fb300250 0000015c88f7f810 : sqldk!SystemThread::RunWorker+0x8f

    0000015c88f7f7a0 00007ffb71c0beb8 : 0000000000000001 00007ff78235f508 0000000000000001 0000009200000001 : sqldk!SystemThreadDispatcher::ProcessWorker+0x366

    0000015c88f7f850 00007ffb880513f2 : 0000000000000000 0000000000000000 00007ff78235f508 0000000000000000 : sqldk!SchedulerManager::ThreadEntryPoint+0x226

    0000015c88f7f8f0 00007ffb88c854f4 : 00007ffb880513d0 0000000000000000 0000000000000000 0000000000000000 : kernel32!BaseThreadInitThunk+0x22

    0000015c88f7f920 0000000000000000 : 0000000000000000 0000000000000000 0000000000000000 0000000000000000 : ntdll!RtlUserThreadStart+0x34

    THREAD_SHA1_HASH_MOD_FUNC: cb461755ae3269f82b5d054444fda95091855a7f

    THREAD_SHA1_HASH_MOD_FUNC_OFFSET: ed0fbd3816979e177238340b8f947590296aa8b4

    THREAD_SHA1_HASH_MOD: 36b18d37bf5d256196e1ab87bd429e6699ad0d67

    FAULT_INSTR_CODE: 49068b49

    SYMBOL_STACK_INDEX: 0

    SYMBOL_NAME: sqlmin!CChangeTrackingDatabase::CleanupNextTable+711

    FOLLOWUP_NAME: MachineOwner

    MODULE_NAME: sqlmin

    IMAGE_NAME: sqlmin.dll

    DEBUG_FLR_IMAGE_TIMESTAMP: 5d33c9e7

    STACK_COMMAND: ~0s ; .ecxr ; kb

    FAILURE_BUCKET_ID: NULL_POINTER_READ_NOSOS_c0000005_sqlmin.dll!CChangeTrackingDatabase::CleanupNextTable

    BUCKET_ID: APPLICATION_FAULT_NULL_POINTER_READ_INVALID_POINTER_READ_NOSOS_sqlmin!CChangeTrackingDatabase::CleanupNextTable+711

    FAILURE_EXCEPTION_CODE: c0000005

    FAILURE_IMAGE_NAME: sqlmin.dll

    BUCKET_ID_IMAGE_STR: sqlmin.dll

    FAILURE_MODULE_NAME: sqlmin

    BUCKET_ID_MODULE_STR: sqlmin

    FAILURE_FUNCTION_NAME: CChangeTrackingDatabase::CleanupNextTable

    BUCKET_ID_FUNCTION_STR: CChangeTrackingDatabase::CleanupNextTable

    BUCKET_ID_OFFSET: 711

    BUCKET_ID_MODTIMEDATESTAMP: 5d33c9e7

    BUCKET_ID_MODCHECKSUM: 3e22a7a

    BUCKET_ID_MODVER_STR: 2014.120.6329.1

    BUCKET_ID_PREFIX_STR: APPLICATION_FAULT_NULL_POINTER_READ_INVALID_POINTER_READ_NOSOS_

    FAILURE_PROBLEM_CLASS: APPLICATION_FAULT

    FAILURE_SYMBOL_NAME: sqlmin.dll!CChangeTrackingDatabase::CleanupNextTable

    WATSON_STAGEONE_URL: http://watson.microsoft.com/StageOne/sqlservr.exe/10.0.40219.325/4df2bcc2/sqlmin.dll/2014.120.6329.1/5d33c9e7/c0000005/00c2f021.htm?Retriage=1

    TARGET_TIME: 2019-10-12T23:27:20.000Z

    OSBUILD: 9200

    OSSERVICEPACK: 19358

    SERVICEPACK_NUMBER: 0

    OS_REVISION: 0

    SUITE_MASK: 272

    PRODUCT_TYPE: 3

    OSPLATFORM_TYPE: x64

    OSNAME: Windows 8

    OSEDITION: Windows 8 Server TerminalServer SingleUserTS

    USER_LCID: 0

    OSBUILD_TIMESTAMP: 2019-05-06 10:41:50

    BUILDDATESTAMP_STR: 190505-1600

    BUILDLAB_STR: winblue_ltsb_escrow

    BUILDOSVER_STR: 6.3.9600.19358

    ANALYSIS_SESSION_ELAPSED_TIME: 19639

    ANALYSIS_SOURCE: UM

    FAILURE_ID_HASH_STRING: um:null_pointer_read_nosos_c0000005_sqlmin.dll!cchangetrackingdatabase::cleanupnexttable

    FAILURE_ID_HASH: {47998ccc-6fcf-f846-0dac-e620a1d46e79}

    Followup: MachineOwner

    ---------

  • John Mitchell-245523

    SSC Guru

    Points: 148771

    Debugging dumps is advanced stuff.  I'd raise a call with Microsoft, if I were you.  They're likely to be able to pinpoint the cause much faster than you can.

    John

  • Beatrix Kiddo

    SSC-Dedicated

    Points: 32407

    Agreed; Microsoft.

Viewing 3 posts - 1 through 3 (of 3 total)

You must be logged in to reply to this topic. Login to reply