Opened 10 years ago

Closed 10 years ago

#10522 closed bug (fixed)

Assert failed in TrashWatcher

Reported by: kallisti5 Owned by: axeld
Priority: normal Milestone: R1
Component: System/Kernel Version: R1/Development
Keywords: vfs Cc:
Blocked By: Blocking:
Platform: x86-64

Description

This may be related to the virtio driver in use... however wanted to post the backtrace somewhere as it is a assertion failure.

hrev46844 x86_64 virtio disk building openssl recipe.

PANIC: ASSERT FAILED (/home/kallisti5/Code/haiku/src/system/kernel/fs/vfs.cpp:1032): oldRefCount > 0; vnode 0xffffffff92edb380

Welcome to Kernel Debugging Land...
Thread 537 "TrashWatcher" running on CPU 0
stack trace for thread 537 "TrashWatcher"
    kernel stack: 0xffffffff897ec000 to 0xffffffff897f1000
      user stack: 0x00007f6234b71000 to 0x00007f6234bb1000
frame                       caller             <image>:function + offset
 0 ffffffff897f0a58 (+  16) ffffffff8013224d   <kernel_x86_64> arch_debug_stack_trace + 0x13
 1 ffffffff897f0a68 (+  16) ffffffff8009bf09   <kernel_x86_64> stack_trace_trampoline(void*) + 0x09
 2 ffffffff897f0a78 (+  24) ffffffff8012ad52   <kernel_x86_64> arch_debug_call_with_fault_handler + 0x16
 3 ffffffff897f0a90 (+  96) ffffffff8009c717   <kernel_x86_64> debug_call_with_fault_handler + 0x68
 4 ffffffff897f0af0 (+  96) ffffffff8009d6fd   <kernel_x86_64> kernel_debugger_loop(char const*, char const*, __va_list_tag*, int) + 0x224
 5 ffffffff897f0b50 (+  80) ffffffff8009d9b6   <kernel_x86_64> kernel_debugger_internal(char const*, char const*, __va_list_tag*, int) + 0x132
 6 ffffffff897f0ba0 (+ 240) ffffffff8009dc37   <kernel_x86_64> panic + 0xc1
 7 ffffffff897f0c90 (+  80) ffffffff800e339b   <kernel_x86_64> dec_vnode_ref_count(vnode*, bool, bool) + 0xaf
 8 ffffffff897f0ce0 (+  16) ffffffff800e3682   <kernel_x86_64> put_mount(fs_mount*) + 0x1c
 9 ffffffff897f0cf0 (+  48) ffffffff800e37d9   <kernel_x86_64> fs_read_info(int, fs_info*) + 0xb8
10 ffffffff897f0d20 (+ 528) ffffffff800ec9f5   <kernel_x86_64> _user_read_fs_info + 0x34
11 ffffffff897f0f30 (+  16) ffffffff8012c3a1   <kernel_x86_64> x86_64_syscall_entry + 0xf5
user iframe at 0xffffffff897f0f40 (end = 0xffffffff897f1000)
 rax 0x62                  rbx 0x7f6234bb0c00        rcx 0x6688b55f74
 rdx 0x47ec9cfd30          rsi 0x7f6234bb09a0        rdi 0x9
 rbp 0x7f6234bb0990         r8 0x1bfee37c570          r9 0x0
 r10 0x6688b55f91          r11 0x3202                r12 0x9
 r13 0x7f6234bb0bd0        r14 0x7f6234bb0c30        r15 0x1
 rip 0x6688b55f74          rsp 0x7f6234bb0978     rflags 0x3202
 vector: 0x63, error code: 0x0
12 ffffffff897f0f40 (+140061756357200) 0000006688b55f74   <libroot.so> _kern_read_fs_info + 0x0c
13 00007f6234bb0990 (+ 528) 00000047ec716f2e   <libbe.so> BVolume::SetTo(int) + 0x4a
14 00007f6234bb0ba0 (+  32) 00000047ec717812   <libbe.so> BVolumeRoster::GetNextVolume(BVolume*) + 0x22
15 00007f6234bb0bc0 (+ 320) 0000017a01230d82   <libtracker.so> BPrivate::BTrashWatcher::CheckTrashDirs() + 0xea
16 00007f6234bb0d00 (+ 192) 0000017a01230fad   <libtracker.so> BPrivate::BTrashWatcher::MessageReceived(BMessage*) + 0xc3
17 00007f6234bb0dc0 (+  16) 00000047ec625782   <libbe.so> BLooper::DispatchMessage(BMessage*, BHandler*) + 0x36
18 00007f6234bb0dd0 (+  96) 00000047ec625b04   <libbe.so> BLooper::task_looper() + 0x1c8
19 00007f6234bb0e30 (+  32) 00000047ec624fb1   <libbe.so> BLooper::_task0_(void*) + 0x21
20 00007f6234bb0e50 (+  32) 0000006688b55576   <libroot.so> _thread_do_exit_work (nearest) + 0x60
21 00007f6234bb0e70 (+   0) 00007f74ae5982c8   <commpage> commpage_thread_exit + 0x00
kdebug> 

Change History (13)

comment:1 by bonefish, 10 years ago

Component: File Systems/BFSSystem/Kernel
Keywords: vfs added

This is likely unrelated to the virtio driver. Looks more like a ref-counting issue or race condition in the VFS. Would have been nice to have more info about the vnode (and its mount) in question. Could this have happened around the time the packagefs and bindfs instances for the chroot environment were being mounted or unmounted?

comment:2 by kallisti5, 10 years ago

Yeah, it happened right after the the openssl_source package was deactivated. I still have the VM up with access to the kdl over serial. Is there some kdl command to get this?

comment:3 by kallisti5, 10 years ago

packagefs output just before KDL:

package_daemon [794152849:  9870] Volume::_PackagesEntryRemoved("openssl-1.0.0j-5-build.hpkg")
package_daemon [794170314:  9870] Volume::_ChangePackageActivation(): activating 0, deactivating 1 packages
packagefs [794181228:  9870] Volume::_ChangeActivation(): 0 new packages, 1 old packages
packagefs [794188225:  9870] package "openssl-1.0.0j-5-build.hpkg" deactivated
package_daemon [795153637:  9870] Volume::_PackagesEntryRemoved("openssl_devel-1.0.0j-5-build.hpkg")
package_daemon [795507021:  9870] Volume::_ChangePackageActivation(): activating 0, deactivating 1 packages
packagefs [795514884:  9870] Volume::_ChangeActivation(): 0 new packages, 1 old packages
packagefs [795521521:  9870] package "openssl_devel-1.0.0j-5-build.hpkg" deactivated
package_daemon [796163432:  9870] Volume::_PackagesEntryRemoved("openssl_source-1.0.0j-5-build.hpkg")
package_daemon [796173245:  9870] Volume::_ChangePackageActivation(): activating 0, deactivating 1 packages
packagefs [796181481:  9870] Volume::_ChangeActivation(): 0 new packages, 1 old packages
packagefs [796187552:  9870] package "openssl_source-1.0.0j-5-build.hpkg" deactivated
PANIC: ASSERT FAILED (/home/kallisti5/Code/haiku/src/system/kernel/fs/vfs.cpp:1032): oldRefCount > 0; vnode 0xffffffff92edb380

kdl mounts:

kdebug> mounts
address             id root               covers             cookie             fs_name
0xffffffff8217ba80   1 0xffffffff82020d80 0x0000000000000000 0xffffffff822951b8 rootfs
0xffffffff8217b900   2 0xffffffff82020c80 0xffffffff82020d00 0xffffffff822950c8 devfs
0xffffffff8217b000   3 0xffffffff82770980 0xffffffff82020800 0xffffffff8218f180 bfs
0xffffffff809e9d88   4 0xffffffff8a3ec000 0xffffffff82770800 0xffffffff809e4cd8 packagefs
0xffffffff809e9308   6 0xffffffff8a535300 0xffffffff8a535880 0xffffffff89c052f0 packagefs
0xffffffff809e9008   7 0xffffffff8a7bf580 0xffffffff8a7bf780 0xffffffff8218d900 bfs
0xffffffff8aa2cda8   9 0xffffffff92edb380 0xdeadbeefdeadbeef 0xffffffff8f842178 packagefs
0xffffffff8aa2c328  10 0xffffffff82770880 0xffffffff92617380 0xffffffff80ba8400 bindfs

kdl vnodes 9

kdebug> vnodes 9
address            dev     inode  ref cache              fs-node            locking            flags
0xffffffff92fdc280   9        28    0 0xffffffff92fd6e08 0xffffffff8ac3ec80 0x0000000000000000 -b-
0xffffffff92fdc180   9        21    0 0x0000000000000000 0xffffffff8ac3ed20 0x0000000000000000 -b-
0xffffffff92fdc200   9        20    0 0x0000000000000000 0xffffffff926d3300 0x0000000000000000 -b-
0xffffffff93270580   9      2204    0 0xffffffff932711c0 0xffffffff92c828c8 0x0000000000000000 -b-
0xffffffff9323c480   9      2247    0 0x0000000000000000 0xffffffff92c84b68 0x0000000000000000 -b-
0xffffffff92ffd200   9      2296    0 0xffffffff93fbf0e0 0xffffffff92c8dc00 0x0000000000000000 -b-
0xffffffff93252b80   9      2311    0 0xffffffff93fbf1c0 0xffffffff92c8d2a0 0x0000000000000000 -b-
0xffffffff93f13700   9      2330    0 0xffffffff93f23c48 0xffffffff92c8f668 0x0000000000000000 -b-
0xffffffff9323cc80   9      2343    0 0xffffffff9323bee0 0xffffffff92c90dc0 0x0000000000000000 -b-
0xffffffff92ff8f00   9      2410    0 0xffffffff93fd3d28 0xffffffff92c94330 0x0000000000000000 -b-
0xffffffff92ffd180   9      2429    0 0xffffffff92ff5540 0xffffffff92c966f8 0x0000000000000000 -b-
0xffffffff92fd5080   9      2436    0 0xffffffff92fd6548 0xffffffff92c96298 0x0000000000000000 -b-
0xffffffff92fd5700   9      2457    0 0xffffffff930e5380 0xffffffff92c98520 0x0000000000000000 -b-
0xffffffff92ff8b00   9      2451    0 0xffffffff92ff5460 0xffffffff92c988e0 0x0000000000000000 -b-
0xffffffff92ff8e80   9      2476    0 0xffffffff93fbf380 0xffffffff92c9a8e8 0x0000000000000000 -b-
0xffffffff8a7bf600   9      2484    0 0xffffffff92fd61c8 0xffffffff92c9a3e8 0x0000000000000000 -b-
0xffffffff93183d80   9      2486    0 0xffffffff930e17e8 0xffffffff92c9a2a8 0x0000000000000000 -b-
0xffffffff9323ce00   9      2508    0 0xffffffff9323b2a0 0xffffffff92c9c460 0x0000000000000000 -b-
0xffffffff92fd5900   9      2519    0 0xffffffff92fd6628 0xffffffff92c9ed28 0x0000000000000000 -b-
0xffffffff93f13200   9      2537    0 0xffffffff93f81b68 0xffffffff92c9e1e8 0x0000000000000000 -b-
0xffffffff9323c880   9      2529    0 0xffffffff9323be00 0xffffffff92c9e6e8 0x0000000000000000 -b-
0xffffffff93265d80   9      2567    0 0xffffffff930c7700 0xffffffff92ca1e78 0x0000000000000000 -b-
0xffffffff92fd5100   9      8763    0 0x0000000000000000 0xffffffff92e85c40 0x0000000000000000 -b-
0xffffffff931f5900   9      8767    0 0x0000000000000000 0xffffffff92e85b60 0x0000000000000000 -b-
0xffffffff93090a00   9      8781    0 0x0000000000000000 0xffffffff92e85540 0x0000000000000000 -b-
0xffffffff931f5880   9      8768    0 0x0000000000000000 0xffffffff92e85a80 0x0000000000000000 -b-
0xffffffff92fd5180   9      8805    0 0x0000000000000000 0xffffffff92e85460 0x0000000000000000 -b-
0xffffffff93fc2680   9      6809    0 0xffffffff935907e8 0xffffffff92deac88 0x0000000000000000 -b-
0xffffffff93fc2880   9      6808    0 0xffffffff935908c8 0xffffffff92dead28 0x0000000000000000 -b-
0xffffffff93fc2580   9      6811    0 0xffffffff93590628 0xffffffff92deab48 0x0000000000000000 -b-
0xffffffff93fc2780   9      6810    0 0xffffffff93590708 0xffffffff92deabe8 0x0000000000000000 -b-
0xffffffff93fc2600   9      6813    0 0xffffffff93590468 0xffffffff92deaa08 0x0000000000000000 -b-
0xffffffff93fc2800   9      6812    0 0xffffffff93590548 0xffffffff92deaaa8 0x0000000000000000 -b-
0xffffffff93fc2400   9      6815    0 0xffffffff935902a8 0xffffffff92dea8c8 0x0000000000000000 -b-
0xffffffff93fc2700   9      6814    0 0xffffffff93590388 0xffffffff92dea968 0x0000000000000000 -b-
0xffffffff92fd5f00   9      6801    0 0xffffffff93fbf460 0xffffffff92de80a0 0x0000000000000000 -b-
0xffffffff93ffe480   9      6800    0 0x0000000000000000 0xffffffff92de1700 0x0000000000000000 -b-
0xffffffff93ffea80   9      6803    0 0x0000000000000000 0xffffffff92de1540 0x0000000000000000 -b-
0xffffffff93275b80   9      6802    0 0x0000000000000000 0xffffffff92de1620 0x0000000000000000 -b-
0xffffffff93f13900   9      6805    0 0xffffffff93590b68 0xffffffff92deaf08 0x0000000000000000 -b-
0xffffffff9323c380   9     12936    0 0x0000000000000000 0xffffffff92fcc028 0x0000000000000000 -b-
0xffffffff93f13800   9      6804    0 0xffffffff93590c48 0xffffffff92de8000 0x0000000000000000 -b-
0xffffffff93fc2c80   9      6807    0 0xffffffff935909a8 0xffffffff92deadc8 0x0000000000000000 -b-
0xffffffff9323c580   9     12938    0 0x0000000000000000 0xffffffff92fcde60 0x0000000000000000 -b-
0xffffffff93f13880   9      6806    0 0xffffffff93590a88 0xffffffff92deae68 0x0000000000000000 -b-
0xffffffff9323c200   9     12941    0 0xffffffff9323b460 0xffffffff92fcdc80 0x0000000000000000 -b-
0xffffffff9358de80   9      6825    0 0xffffffff9358ea80 0xffffffff92dea328 0x0000000000000000 -b-
0xffffffff9358df00   9      6824    0 0xffffffff9358eb60 0xffffffff92dea3c8 0x0000000000000000 -b-
0xffffffff9358dd80   9      6827    0 0xffffffff9358e8c0 0xffffffff92dea1e8 0x0000000000000000 -b-
0xffffffff9358de00   9      6826    0 0xffffffff9358e9a0 0xffffffff92dea288 0x0000000000000000 -b-
0xffffffff9358dc80   9      6829    0 0xffffffff9358e700 0xffffffff92dea0a8 0x0000000000000000 -b-
0xffffffff9358dd00   9      6828    0 0xffffffff9358e7e0 0xffffffff92dea148 0x0000000000000000 -b-
0xffffffff9358db80   9      6831    0 0xffffffff9358e540 0xffffffff92decf10 0x0000000000000000 -b-
0xffffffff9358dc00   9      6830    0 0xffffffff9358e620 0xffffffff92dea008 0x0000000000000000 -b-
0xffffffff93fc2300   9      6817    0 0x0000000000000000 0xffffffff92de1460 0x0000000000000000 -b-
0xffffffff9323c280   9     12932    0 0x0000000000000000 0xffffffff92fcc2a8 0x0000000000000000 -b-
0xffffffff93fc2380   9      6816    0 0xffffffff935901c8 0xffffffff92dea828 0x0000000000000000 -b-
0xffffffff93fc2200   9      6819    0 0xffffffff93590008 0xffffffff92dea6e8 0x0000000000000000 -b-
0xffffffff93fc2280   9      6818    0 0xffffffff935900e8 0xffffffff92dea788 0x0000000000000000 -b-
0xffffffff93fc2100   9      6821    0 0xffffffff9358ee00 0xffffffff92dea5a8 0x0000000000000000 -b-
0xffffffff9323c400   9      2743    0 0x0000000000000000 0xffffffff92ca98c0 0x0000000000000000 -b-
0xffffffff93fc2180   9      6820    0 0xffffffff9358eee0 0xffffffff92dea648 0x0000000000000000 -b-
0xffffffff92fd5500   9     12955    0 0xffffffff930e5540 0xffffffff92fcd3c0 0x0000000000000000 -b-
0xffffffff93fc2000   9      6823    0 0xffffffff9358ec40 0xffffffff92dea468 0x0000000000000000 -b-
0xffffffff93270080   9     10901    0 0xffffffff930b5b68 0xffffffff92f2fd38 0x0000000000000000 -b-
0xffffffff93fc2080   9      6822    0 0xffffffff9358ed20 0xffffffff92dea508 0x0000000000000000 -b-
0xffffffff9358d680   9      6841    0 0xffffffff9358cd28 0xffffffff92dec970 0x0000000000000000 -b-
0xffffffff9358d700   9      6840    0 0xffffffff9358ce08 0xffffffff92deca10 0x0000000000000000 -b-
0xffffffff92fdc580   9     10902    0 0xffffffff92ff51c0 0xffffffff92f2fc98 0x0000000000000000 -b-
0xffffffff9358d580   9      6843    0 0xffffffff9358cb68 0xffffffff92dec830 0x0000000000000000 -b-
0xffffffff9358d600   9      6842    0 0xffffffff9358cc48 0xffffffff92dec8d0 0x0000000000000000 -b-
0xffffffff92ffd080   9     12945    0 0xffffffff92ff50e0 0xffffffff92fcda00 0x0000000000000000 -b-
0xffffffff9358d480   9      6845    0 0xffffffff9358c9a8 0xffffffff92dec6f0 0x0000000000000000 -b-
0xffffffff93265e00   9     12944    0 0xffffffff93fbf000 0xffffffff92fcdaa0 0x0000000000000000 -b-
0xffffffff9358d500   9      6844    0 0xffffffff9358ca88 0xffffffff92dec790 0x0000000000000000 -b-
0xffffffff9358d380   9      6847    0 0xffffffff9358c7e8 0xffffffff92dec5b0 0x0000000000000000 -b-
0xffffffff9358d400   9      6846    0 0xffffffff9358c8c8 0xffffffff92dec650 0x0000000000000000 -b-
0xffffffff9358da80   9      6833    0 0xffffffff9358e380 0xffffffff92decdd0 0x0000000000000000 -b-
0xffffffff9323c300   9     12948    0 0xffffffff9323b540 0xffffffff92fcd820 0x0000000000000000 -b-
0xffffffff9358db00   9      6832    0 0xffffffff9358e460 0xffffffff92dece70 0x0000000000000000 -b-
0xffffffff9358d980   9      6835    0 0xffffffff9358e1c0 0xffffffff92decc90 0x0000000000000000 -b-
0xffffffff9323c500   9     12950    0 0xffffffff9323b620 0xffffffff92fcd6e0 0x0000000000000000 -b-
0xffffffff9358da00   9      6834    0 0xffffffff9358e2a0 0xffffffff92decd30 0x0000000000000000 -b-
0xffffffff9358d880   9      6837    0 0xffffffff9358e000 0xffffffff92decb50 0x0000000000000000 -b-
0xffffffff9358d900   9      6836    0 0xffffffff9358e0e0 0xffffffff92decbf0 0x0000000000000000 -b-
0xffffffff9358d780   9      6839    0 0xffffffff9358cee8 0xffffffff92decab0 0x0000000000000000 -b-
0xffffffff9358d800   9      6838    0 0x0000000000000000 0xffffffff92de1380 0x0000000000000000 -b-
0xffffffff9358be00   9      6857    0 0x0000000000000000 0xffffffff92de12a0 0x0000000000000000 -b-
0xffffffff93090c00   9      8894    0 0x0000000000000000 0xffffffff92e85000 0x0000000000000000 -b-
0xffffffff9358be80   9      6856    0 0xffffffff9358c008 0xffffffff92dec010 0x0000000000000000 -b-
0xffffffff9358bd00   9      6859    0 0xffffffff9358ae00 0xffffffff92deee78 0x0000000000000000 -b-
0xffffffff9358bd80   9      6858    0 0xffffffff9358aee0 0xffffffff92deef18 0x0000000000000000 -b-
0xffffffff9358bc00   9      6861    0 0xffffffff9358ac40 0xffffffff92deed38 0x0000000000000000 -b-
0xffffffff9358bc80   9      6860    0 0xffffffff9358ad20 0xffffffff92deedd8 0x0000000000000000 -b-
0xffffffff9358bb00   9      6863    0 0xffffffff9358aa80 0xffffffff92deebf8 0x0000000000000000 -b-
0xffffffff9358bb80   9      6862    0 0xffffffff9358ab60 0xffffffff92deec98 0x0000000000000000 -b-
0xffffffff9358d280   9      6849    0 0xffffffff9358c628 0xffffffff92dec470 0x0000000000000000 -b-
0xffffffff9358d300   9      6848    0 0xffffffff9358c708 0xffffffff92dec510 0x0000000000000000 -b-
0xffffffff9358d180   9      6851    0 0xffffffff9358c468 0xffffffff92dec330 0x0000000000000000 -b-
0xffffffff9358d200   9      6850    0 0xffffffff9358c548 0xffffffff92dec3d0 0x0000000000000000 -b-
0xffffffff9358d080   9      6853    0 0xffffffff9358c2a8 0xffffffff92dec1f0 0x0000000000000000 -b-
0xffffffff9358d100   9      6852    0 0xffffffff9358c388 0xffffffff92dec290 0x0000000000000000 -b-
0xffffffff9358bf00   9      6855    0 0xffffffff9358c0e8 0xffffffff92dec0b0 0x0000000000000000 -b-
0xffffffff9358d000   9      6854    0 0xffffffff9358c1c8 0xffffffff92dec150 0x0000000000000000 -b-
0xffffffff9358b600   9      6873    0 0xffffffff9358a1c0 0xffffffff92dee5b8 0x0000000000000000 -b-
0xffffffff9358b680   9      6872    0 0xffffffff9358a2a0 0xffffffff92dee658 0x0000000000000000 -b-
0xffffffff9358b500   9      6875    0 0x0000000000000000 0xffffffff92de11c0 0x0000000000000000 -b-
0xffffffff9358b580   9      6874    0 0xffffffff9358a0e0 0xffffffff92dee518 0x0000000000000000 -b-
0xffffffff9358b400   9      6877    0 0xffffffff93589ee8 0xffffffff92dee3d8 0x0000000000000000 -b-
0xffffffff9358b480   9      6876    0 0xffffffff9358a000 0xffffffff92dee478 0x0000000000000000 -b-
0xffffffff9358b300   9      6879    0 0xffffffff93589d28 0xffffffff92dee298 0x0000000000000000 -b-
0xffffffff9358b380   9      6878    0 0xffffffff93589e08 0xffffffff92dee338 0x0000000000000000 -b-
0xffffffff9358ba00   9      6865    0 0xffffffff9358a8c0 0xffffffff92deeab8 0x0000000000000000 -b-
0xffffffff9358ba80   9      6864    0 0xffffffff9358a9a0 0xffffffff92deeb58 0x0000000000000000 -b-
0xffffffff9358b900   9      6867    0 0xffffffff9358a700 0xffffffff92dee978 0x0000000000000000 -b-
0xffffffff9358b980   9      6866    0 0xffffffff9358a7e0 0xffffffff92deea18 0x0000000000000000 -b-
0xffffffff9358b800   9      6869    0 0xffffffff9358a540 0xffffffff92dee838 0x0000000000000000 -b-
0xffffffff9358b880   9      6868    0 0xffffffff9358a620 0xffffffff92dee8d8 0x0000000000000000 -b-
0xffffffff9358b700   9      6871    0 0xffffffff9358a380 0xffffffff92dee6f8 0x0000000000000000 -b-
0xffffffff9358b780   9      6870    0 0xffffffff9358a460 0xffffffff92dee798 0x0000000000000000 -b-
0xffffffff93588d80   9      6889    0 0xffffffff93589468 0xffffffff92df1c00 0x0000000000000000 -b-
0xffffffff93588e00   9      6888    0 0xffffffff93589548 0xffffffff92df1ca0 0x0000000000000000 -b-
0xffffffff93588c80   9      6891    0 0xffffffff935892a8 0xffffffff92df1ac0 0x0000000000000000 -b-
0xffffffff93588d00   9      6890    0 0xffffffff93589388 0xffffffff92df1b60 0x0000000000000000 -b-
0xffffffff93588b80   9      6893    0 0xffffffff935890e8 0xffffffff92df1980 0x0000000000000000 -b-
0xffffffff93588c00   9      6892    0 0xffffffff935891c8 0xffffffff92df1a20 0x0000000000000000 -b-
0xffffffff93588a80   9      6895    0 0xffffffff93587ee0 0xffffffff92df1840 0x0000000000000000 -b-
0xffffffff93588b00   9      6894    0 0xffffffff93589008 0xffffffff92df18e0 0x0000000000000000 -b-
0xffffffff9358b200   9      6881    0 0xffffffff93589b68 0xffffffff92dee158 0x0000000000000000 -b-
0xffffffff9358b280   9      6880    0 0xffffffff93589c48 0xffffffff92dee1f8 0x0000000000000000 -b-
0xffffffff9358b100   9      6883    0 0xffffffff935899a8 0xffffffff92dee018 0x0000000000000000 -b-
0xffffffff9358b180   9      6882    0 0xffffffff93589a88 0xffffffff92dee0b8 0x0000000000000000 -b-
0xffffffff9358b000   9      6885    0 0xffffffff935897e8 0xffffffff92df1e80 0x0000000000000000 -b-
0xffffffff9358b080   9      6884    0 0xffffffff935898c8 0xffffffff92df1f20 0x0000000000000000 -b-
0xffffffff93588e80   9      6887    0 0xffffffff93589628 0xffffffff92df1d40 0x0000000000000000 -b-
0xffffffff93588f00   9      6886    0 0xffffffff93589708 0xffffffff92df1de0 0x0000000000000000 -b-
0xffffffff93588580   9      6905    0 0xffffffff93587620 0xffffffff92df1200 0x0000000000000000 -b-
0xffffffff93588600   9      6904    0 0xffffffff93587700 0xffffffff92df12a0 0x0000000000000000 -b-
0xffffffff93588480   9      6907    0 0xffffffff93587460 0xffffffff92df10c0 0x0000000000000000 -b-
0xffffffff93588500   9      6906    0 0xffffffff93587540 0xffffffff92df1160 0x0000000000000000 -b-
0xffffffff93588380   9      6909    0 0xffffffff935872a0 0xffffffff92df3f28 0x0000000000000000 -b-
0xffffffff93588400   9      6908    0 0xffffffff93587380 0xffffffff92df1020 0x0000000000000000 -b-
0xffffffff93588280   9      6911    0 0xffffffff935870e0 0xffffffff92df3de8 0x0000000000000000 -b-
0xffffffff93588300   9      6910    0 0xffffffff935871c0 0xffffffff92df3e88 0x0000000000000000 -b-
0xffffffff93588980   9      6897    0 0xffffffff93587d20 0xffffffff92df1700 0x0000000000000000 -b-
0xffffffff93588a00   9      6896    0 0xffffffff93587e00 0xffffffff92df17a0 0x0000000000000000 -b-
0xffffffff93588880   9      6899    0 0xffffffff93587b60 0xffffffff92df15c0 0x0000000000000000 -b-
0xffffffff93588900   9      6898    0 0xffffffff93587c40 0xffffffff92df1660 0x0000000000000000 -b-
0xffffffff93588780   9      6901    0 0xffffffff935879a0 0xffffffff92df1480 0x0000000000000000 -b-
0xffffffff93090900   9      8954    0 0x0000000000000000 0xffffffff92e94b68 0x0000000000000000 -b-
0xffffffff93588800   9      6900    0 0xffffffff93587a80 0xffffffff92df1520 0x0000000000000000 -b-
0xffffffff93588680   9      6903    0 0xffffffff935877e0 0xffffffff92df1340 0x0000000000000000 -b-
0xffffffff93588700   9      6902    0 0xffffffff935878c0 0xffffffff92df13e0 0x0000000000000000 -b-
0xffffffff93583d00   9      6921    0 0xffffffff935867e8 0xffffffff92df37a8 0x0000000000000000 -b-
0xffffffff93583d80   9      6920    0 0xffffffff935868c8 0xffffffff92df3848 0x0000000000000000 -b-
0xffffffff93583c00   9      6923    0 0xffffffff93586628 0xffffffff92df3668 0x0000000000000000 -b-
0xffffffff93090d80   9      8944    0 0x0000000000000000 0xffffffff92e94c48 0x0000000000000000 -b-
0xffffffff93583c80   9      6922    0 0xffffffff93586708 0xffffffff92df3708 0x0000000000000000 -b-
0xffffffff93583b00   9      6925    0 0xffffffff93586468 0xffffffff92df3528 0x0000000000000000 -b-
0xffffffff93583b80   9      6924    0 0xffffffff93586548 0xffffffff92df35c8 0x0000000000000000 -b-
0xffffffff93583a00   9      6927    0 0xffffffff935862a8 0xffffffff92df33e8 0x0000000000000000 -b-
0xffffffff93583a80   9      6926    0 0xffffffff93586388 0xffffffff92df3488 0x0000000000000000 -b-
0xffffffff93588180   9      6913    0 0xffffffff93586ee8 0xffffffff92df3ca8 0x0000000000000000 -b-
0xffffffff93588200   9      6912    0 0xffffffff93587000 0xffffffff92df3d48 0x0000000000000000 -b-
0xffffffff93588080   9      6915    0 0xffffffff93586d28 0xffffffff92df3b68 0x0000000000000000 -b-
0xffffffff93588100   9      6914    0 0xffffffff93586e08 0xffffffff92df3c08 0x0000000000000000 -b-
0xffffffff93583f00   9      6917    0 0xffffffff93586b68 0xffffffff92df3a28 0x0000000000000000 -b-
0xffffffff93588000   9      6916    0 0xffffffff93586c48 0xffffffff92df3ac8 0x0000000000000000 -b-
0xffffffff93583e00   9      6919    0 0xffffffff935869a8 0xffffffff92df38e8 0x0000000000000000 -b-
0xffffffff93583e80   9      6918    0 0xffffffff93586a88 0xffffffff92df3988 0x0000000000000000 -b-
0xffffffff93583500   9      6937    0 0xffffffff9358f9a0 0xffffffff92df4d20 0x0000000000000000 -b-
0xffffffff93583580   9      6936    0 0xffffffff9358fa80 0xffffffff92df4dc0 0x0000000000000000 -b-
0xffffffff93583400   9      6939    0 0xffffffff9358f7e0 0xffffffff92df4be0 0x0000000000000000 -b-
0xffffffff93583480   9      6938    0 0xffffffff9358f8c0 0xffffffff92df4c80 0x0000000000000000 -b-
0xffffffff93090e80   9      8963    0 0x0000000000000000 0xffffffff92e94a88 0x0000000000000000 -b-
0xffffffff93583300   9      6941    0 0xffffffff9358f620 0xffffffff92df4aa0 0x0000000000000000 -b-
0xffffffff93583380   9      6940    0 0xffffffff9358f700 0xffffffff92df4b40 0x0000000000000000 -b-
0xffffffff93583200   9      6943    0 0xffffffff9358f460 0xffffffff92df4960 0x0000000000000000 -b-
0xffffffff93583280   9      6942    0 0xffffffff9358f540 0xffffffff92df4a00 0x0000000000000000 -b-
0xffffffff93583900   9      6929    0 0xffffffff935860e8 0xffffffff92df32a8 0x0000000000000000 -b-
0xffffffff93583980   9      6928    0 0xffffffff935861c8 0xffffffff92df3348 0x0000000000000000 -b-
0xffffffff93583800   9      6931    0 0xffffffff9358fee0 0xffffffff92df3168 0x0000000000000000 -b-
0xffffffff93583880   9      6930    0 0xffffffff93586008 0xffffffff92df3208 0x0000000000000000 -b-
0xffffffff93583700   9      6933    0 0xffffffff9358fd20 0xffffffff92df3028 0x0000000000000000 -b-
0xffffffff93583780   9      6932    0 0xffffffff9358fe00 0xffffffff92df30c8 0x0000000000000000 -b-
0xffffffff93583600   9      6935    0 0xffffffff9358fb60 0xffffffff92df4e60 0x0000000000000000 -b-
0xffffffff93583680   9      6934    0 0xffffffff9358fc40 0xffffffff92df4f00 0x0000000000000000 -b-
0xffffffff931fbc80   9      6953    0 0xffffffff931fab68 0xffffffff92df4320 0x0000000000000000 -b-
0xffffffff931fbd00   9      6952    0 0xffffffff931fac48 0xffffffff92df43c0 0x0000000000000000 -b-
0xffffffff931fbb80   9      6955    0 0xffffffff931fa9a8 0xffffffff92df41e0 0x0000000000000000 -b-
0xffffffff931fbc00   9      6954    0 0xffffffff931faa88 0xffffffff92df4280 0x0000000000000000 -b-
0xffffffff931fba80   9      6957    0 0xffffffff931fa7e8 0xffffffff92df40a0 0x0000000000000000 -b-
0xffffffff931fbb00   9      6956    0 0xffffffff931fa8c8 0xffffffff92df4140 0x0000000000000000 -b-
0xffffffff931fb980   9      6959    0 0xffffffff931fa628 0xffffffff92df6f08 0x0000000000000000 -b-
0xffffffff931fba00   9      6958    0 0xffffffff931fa708 0xffffffff92df4000 0x0000000000000000 -b-
0xffffffff93583100   9      6945    0 0xffffffff9358f2a0 0xffffffff92df4820 0x0000000000000000 -b-
0xffffffff93583180   9      6944    0 0xffffffff9358f380 0xffffffff92df48c0 0x0000000000000000 -b-
0xffffffff93583000   9      6947    0 0xffffffff9358f0e0 0xffffffff92df46e0 0x0000000000000000 -b-
0xffffffff93583080   9      6946    0 0xffffffff9358f1c0 0xffffffff92df4780 0x0000000000000000 -b-
0xffffffff931fbe80   9      6949    0 0xffffffff931faee8 0xffffffff92df45a0 0x0000000000000000 -b-
0xffffffff931fbf00   9      6948    0 0xffffffff9358f000 0xffffffff92df4640 0x0000000000000000 -b-
0xffffffff931fbd80   9      6951    0 0xffffffff931fad28 0xffffffff92df4460 0x0000000000000000 -b-
0xffffffff931fbe00   9      6950    0 0xffffffff931fae08 0xffffffff92df4500 0x0000000000000000 -b-
0xffffffff931fb480   9      6969    0 0xffffffff931fdd20 0xffffffff92df68c8 0x0000000000000000 -b-
0xffffffff931fb500   9      6968    0 0xffffffff931fde00 0xffffffff92df6968 0x0000000000000000 -b-
0xffffffff931fb380   9      6971    0 0xffffffff931fdb60 0xffffffff92df6788 0x0000000000000000 -b-
0xffffffff931fb400   9      6970    0 0xffffffff931fdc40 0xffffffff92df6828 0x0000000000000000 -b-
0xffffffff931fb280   9      6973    0 0xffffffff931fd9a0 0xffffffff92df6648 0x0000000000000000 -b-
0xffffffff931fb300   9      6972    0 0xffffffff931fda80 0xffffffff92df66e8 0x0000000000000000 -b-
0xffffffff931fb180   9      6975    0 0xffffffff931fd7e0 0xffffffff92df6508 0x0000000000000000 -b-
0xffffffff931fb200   9      6974    0 0xffffffff931fd8c0 0xffffffff92df65a8 0x0000000000000000 -b-
0xffffffff931fb880   9      6961    0 0xffffffff931fa468 0xffffffff92df6dc8 0x0000000000000000 -b-
0xffffffff931fb900   9      6960    0 0xffffffff931fa548 0xffffffff92df6e68 0x0000000000000000 -b-
0xffffffff931fb780   9      6963    0 0xffffffff931fa2a8 0xffffffff92df6c88 0x0000000000000000 -b-
0xffffffff931fb800   9      6962    0 0xffffffff931fa388 0xffffffff92df6d28 0x0000000000000000 -b-
0xffffffff931fb680   9      6965    0 0xffffffff931fa0e8 0xffffffff92df6b48 0x0000000000000000 -b-
0xffffffff931fb700   9      6964    0 0xffffffff931fa1c8 0xffffffff92df6be8 0x0000000000000000 -b-
0xffffffff931fb580   9      6967    0 0xffffffff931fdee0 0xffffffff92df6a08 0x0000000000000000 -b-
0xffffffff931fb600   9      6966    0 0xffffffff931fa008 0xffffffff92df6aa8 0x0000000000000000 -b-
0xffffffff930f0c00   9      6985    0 0xffffffff930efee8 0xffffffff92df8e70 0x0000000000000000 -b-
0xffffffff930f0c80   9      6984    0 0xffffffff931fd000 0xffffffff92df8f10 0x0000000000000000 -b-
0xffffffff930f0b00   9      6987    0 0xffffffff930efd28 0xffffffff92df8d30 0x0000000000000000 -b-
0xffffffff930f0b80   9      6986    0 0xffffffff930efe08 0xffffffff92df8dd0 0x0000000000000000 -b-
0xffffffff930f0a00   9      6989    0 0xffffffff930efb68 0xffffffff92df8bf0 0x0000000000000000 -b-
0xffffffff930f0a80   9      6988    0 0xffffffff930efc48 0xffffffff92df8c90 0x0000000000000000 -b-
0xffffffff930f0900   9      6991    0 0xffffffff930ef9a8 0xffffffff92df8ab0 0x0000000000000000 -b-
0xffffffff930f0980   9      6990    0 0xffffffff930efa88 0xffffffff92df8b50 0x0000000000000000 -b-
0xffffffff931fb080   9      6977    0 0xffffffff931fd620 0xffffffff92df63c8 0x0000000000000000 -b-
0xffffffff931fb100   9      6976    0 0xffffffff931fd700 0xffffffff92df6468 0x0000000000000000 -b-
0xffffffff930f0f00   9      6979    0 0xffffffff931fd460 0xffffffff92df6288 0x0000000000000000 -b-
0xffffffff931fb000   9      6978    0 0xffffffff931fd540 0xffffffff92df6328 0x0000000000000000 -b-
0xffffffff930f0e00   9      6981    0 0xffffffff931fd2a0 0xffffffff92df6148 0x0000000000000000 -b-
0xffffffff930f0e80   9      6980    0 0xffffffff931fd380 0xffffffff92df61e8 0x0000000000000000 -b-
0xffffffff930f0d00   9      6983    0 0xffffffff931fd0e0 0xffffffff92df6008 0x0000000000000000 -b-
0xffffffff930f0d80   9      6982    0 0xffffffff931fd1c0 0xffffffff92df60a8 0x0000000000000000 -b-
0xffffffff930f0400   9      7001    0 0xffffffff930ef0e8 0xffffffff92df8470 0x0000000000000000 -b-
0xffffffff930f0480   9      7000    0 0xffffffff930ef1c8 0xffffffff92df8510 0x0000000000000000 -b-
0xffffffff930f0300   9      7003    0 0xffffffff93ff1ee0 0xffffffff92df8330 0x0000000000000000 -b-
0xffffffff930f0380   9      7002    0 0xffffffff930ef008 0xffffffff92df83d0 0x0000000000000000 -b-
0xffffffff930f0200   9      7005    0 0xffffffff93ff1d20 0xffffffff92df81f0 0x0000000000000000 -b-
0xffffffff93270380   9     11083    0 0xffffffff930b5ee8 0xffffffff92f3e980 0x0000000000000000 -b-
0xffffffff930f0280   9      7004    0 0xffffffff93ff1e00 0xffffffff92df8290 0x0000000000000000 -b-
0xffffffff93270300   9     11082    0 0xffffffff930b5e08 0xffffffff92f3ea20 0x0000000000000000 -b-
0xffffffff930f0100   9      7007    0 0xffffffff93ff1b60 0xffffffff92df80b0 0x0000000000000000 -b-
0xffffffff930f0180   9      7006    0 0xffffffff93ff1c40 0xffffffff92df8150 0x0000000000000000 -b-
0xffffffff930f0800   9      6993    0 0xffffffff930ef7e8 0xffffffff92df8970 0x0000000000000000 -b-
0xffffffff930f0880   9      6992    0 0xffffffff930ef8c8 0xffffffff92df8a10 0x0000000000000000 -b-
0xffffffff930f0700   9      6995    0 0xffffffff930ef628 0xffffffff92df8830 0x0000000000000000 -b-
0xffffffff930f0780   9      6994    0 0xffffffff930ef708 0xffffffff92df88d0 0x0000000000000000 -b-
0xffffffff930f0600   9      6997    0 0xffffffff930ef468 0xffffffff92df86f0 0x0000000000000000 -b-
0xffffffff930f0680   9      6996    0 0xffffffff930ef548 0xffffffff92df8790 0x0000000000000000 -b-
0xffffffff930f0500   9      6999    0 0xffffffff930ef2a8 0xffffffff92df85b0 0x0000000000000000 -b-
0xffffffff930f0580   9      6998    0 0xffffffff930ef388 0xffffffff92df8650 0x0000000000000000 -b-
0xffffffff93090d00   9      9055    0 0x0000000000000000 0xffffffff92e948c8 0x0000000000000000 -b-
0xffffffff93fefb80   9      7017    0 0xffffffff93ff12a0 0xffffffff92dfaa18 0x0000000000000000 -b-
0xffffffff93fefc00   9      7016    0 0xffffffff93ff1380 0xffffffff92dfaab8 0x0000000000000000 -b-
0xffffffff93fefa80   9      7019    0 0xffffffff93ff10e0 0xffffffff92dfa8d8 0x0000000000000000 -b-
0xffffffff93fefb00   9      7018    0 0xffffffff93ff11c0 0xffffffff92dfa978 0x0000000000000000 -b-
0xffffffff93fef980   9      7021    0 0xffffffff93fedee8 0xffffffff92dfa798 0x0000000000000000 -b-
0xffffffff93fefa00   9      7020    0 0xffffffff93ff1000 0xffffffff92dfa838 0x0000000000000000 -b-
0xffffffff93fef880   9      7023    0 0xffffffff93fedd28 0xffffffff92dfa658 0x0000000000000000 -b-
0xffffffff92fd5300   9      9044    0 0x0000000000000000 0xffffffff92e949a8 0x0000000000000000 -b-
0xffffffff93fef900   9      7022    0 0xffffffff93fede08 0xffffffff92dfa6f8 0x0000000000000000 -b-
0xffffffff930f0000   9      7009    0 0xffffffff93ff19a0 0xffffffff92dfaf18 0x0000000000000000 -b-
0xffffffff93270400   9     11103    0 0xffffffff93271000 0xffffffff92f40f28 0x0000000000000000 -b-
0xffffffff930f0080   9      7008    0 0xffffffff93ff1a80 0xffffffff92df8010 0x0000000000000000 -b-
0xffffffff93fefe80   9      7011    0 0xffffffff93ff17e0 0xffffffff92dfadd8 0x0000000000000000 -b-
0xffffffff930ea100   9     11089    0 0xffffffff930e5700 0xffffffff92f3e660 0x0000000000000000 -b-
0xffffffff93feff00   9      7010    0 0xffffffff93ff18c0 0xffffffff92dfae78 0x0000000000000000 -b-
0xffffffff93fefd80   9      7013    0 0xffffffff93ff1620 0xffffffff92dfac98 0x0000000000000000 -b-
0xffffffff93fefe00   9      7012    0 0xffffffff93ff1700 0xffffffff92dfad38 0x0000000000000000 -b-
0xffffffff93fefc80   9      7015    0 0xffffffff93ff1460 0xffffffff92dfab58 0x0000000000000000 -b-
0xffffffff93fefd00   9      7014    0 0xffffffff93ff1540 0xffffffff92dfabf8 0x0000000000000000 -b-
0xffffffff93fef380   9      7033    0 0xffffffff93fed468 0xffffffff92dfa018 0x0000000000000000 -b-
0xffffffff93fef400   9      7032    0 0xffffffff93fed548 0xffffffff92dfa0b8 0x0000000000000000 -b-
0xffffffff93fef280   9      7035    0 0xffffffff93fed2a8 0xffffffff92dfce80 0x0000000000000000 -b-
0xffffffff93fef300   9      7034    0 0xffffffff93fed388 0xffffffff92dfcf20 0x0000000000000000 -b-
0xffffffff93fef180   9      7037    0 0xffffffff93fed0e8 0xffffffff92dfcd40 0x0000000000000000 -b-
0xffffffff93fef200   9      7036    0 0xffffffff93fed1c8 0xffffffff92dfcde0 0x0000000000000000 -b-
0xffffffff93fef080   9      7039    0 0xffffffff93fecee0 0xffffffff92dfcc00 0x0000000000000000 -b-
0xffffffff93fef100   9      7038    0 0xffffffff93fed008 0xffffffff92dfcca0 0x0000000000000000 -b-
0xffffffff93fef780   9      7025    0 0xffffffff93fedb68 0xffffffff92dfa518 0x0000000000000000 -b-
0xffffffff93fef800   9      7024    0 0xffffffff93fedc48 0xffffffff92dfa5b8 0x0000000000000000 -b-
0xffffffff93fef680   9      7027    0 0xffffffff93fed9a8 0xffffffff92dfa3d8 0x0000000000000000 -b-
0xffffffff93fef700   9      7026    0 0xffffffff93feda88 0xffffffff92dfa478 0x0000000000000000 -b-
0xffffffff93fef580   9      7029    0 0xffffffff93fed7e8 0xffffffff92dfa298 0x0000000000000000 -b-
0xffffffff93fef600   9      7028    0 0xffffffff93fed8c8 0xffffffff92dfa338 0x0000000000000000 -b-
0xffffffff930c8d00   9     11106    0 0xffffffff930b5708 0xffffffff92f40d48 0x0000000000000000 -b-
0xffffffff93fef480   9      7031    0 0xffffffff93fed628 0xffffffff92dfa158 0x0000000000000000 -b-
0xffffffff93fef500   9      7030    0 0xffffffff93fed708 0xffffffff92dfa1f8 0x0000000000000000 -b-
0xffffffff93ff4b00   9      7049    0 0xffffffff93fec620 0xffffffff92dfc5c0 0x0000000000000000 -b-
0xffffffff930c8e80   9     11111    0 0xffffffff930b58c8 0xffffffff92f40a28 0x0000000000000000 -b-
0xffffffff93ff4b80   9      7048    0 0xffffffff93fec700 0xffffffff92dfc660 0x0000000000000000 -b-
0xffffffff93ff4a00   9      7051    0 0xffffffff93fec460 0xffffffff92dfc480 0x0000000000000000 -b-
0xffffffff93ff4a80   9      7050    0 0xffffffff93fec540 0xffffffff92dfc520 0x0000000000000000 -b-
0xffffffff93ff4900   9      7053    0 0xffffffff93fec2a0 0xffffffff92dfc340 0x0000000000000000 -b-
0xffffffff93ff4980   9      7052    0 0xffffffff93fec380 0xffffffff92dfc3e0 0x0000000000000000 -b-
0xffffffff93ff4800   9      7055    0 0xffffffff93fec0e0 0xffffffff92dfc200 0x0000000000000000 -b-
0xffffffff93ff4880   9      7054    0 0xffffffff93fec1c0 0xffffffff92dfc2a0 0x0000000000000000 -b-
0xffffffff93ff4f00   9      7041    0 0xffffffff93fecd20 0xffffffff92dfcac0 0x0000000000000000 -b-
0xffffffff93fef000   9      7040    0 0xffffffff93fece00 0xffffffff92dfcb60 0x0000000000000000 -b-
0xffffffff93ff4e00   9      7043    0 0xffffffff93fecb60 0xffffffff92dfc980 0x0000000000000000 -b-
0xffffffff93ff4e80   9      7042    0 0xffffffff93fecc40 0xffffffff92dfca20 0x0000000000000000 -b-
0xffffffff92fd5b80   9     11120    0 0xffffffff92fd68c8 0xffffffff92f405c8 0x0000000000000000 -b-
0xffffffff93ff4d00   9      7045    0 0xffffffff93fec9a0 0xffffffff92dfc840 0x0000000000000000 -b-
0xffffffff92fd5280   9      9098    0 0x0000000000000000 0xffffffff92e94628 0x0000000000000000 -b-
0xffffffff93ff4d80   9      7044    0 0xffffffff93feca80 0xffffffff92dfc8e0 0x0000000000000000 -b-
0xffffffff93ff4c00   9      7047    0 0xffffffff93fec7e0 0xffffffff92dfc700 0x0000000000000000 -b-
0xffffffff93ff4c80   9      7046    0 0xffffffff93fec8c0 0xffffffff92dfc7a0 0x0000000000000000 -b-
0xffffffff93ff4300   9      7065    0 0xffffffff93ff27e8 0xffffffff92dfeb68 0x0000000000000000 -b-
0xffffffff93ff4380   9      7064    0 0xffffffff93ff28c8 0xffffffff92dfec08 0x0000000000000000 -b-
0xffffffff93ff4200   9      7067    0 0xffffffff93ff2628 0xffffffff92dfea28 0x0000000000000000 -b-
0xffffffff93090b80   9      9088    0 0x0000000000000000 0xffffffff92e94708 0x0000000000000000 -b-
0xffffffff93ff4280   9      7066    0 0xffffffff93ff2708 0xffffffff92dfeac8 0x0000000000000000 -b-
0xffffffff93ff4100   9      7069    0 0xffffffff93ff2468 0xffffffff92dfe8e8 0x0000000000000000 -b-
0xffffffff93ff4180   9      7068    0 0xffffffff93ff2548 0xffffffff92dfe988 0x0000000000000000 -b-
0xffffffff93ff4000   9      7071    0 0xffffffff93ff22a8 0xffffffff92dfe7a8 0x0000000000000000 -b-
0xffffffff93ff4080   9      7070    0 0xffffffff93ff2388 0xffffffff92dfe848 0x0000000000000000 -b-
0xffffffff93ff4700   9      7057    0 0xffffffff93ff2ee8 0xffffffff92dfc0c0 0x0000000000000000 -b-
0xffffffff93ff4780   9      7056    0 0xffffffff93fec000 0xffffffff92dfc160 0x0000000000000000 -b-
0xffffffff93ff4600   9      7059    0 0xffffffff93ff2d28 0xffffffff92dfef28 0x0000000000000000 -b-
0xffffffff93ff4680   9      7058    0 0xffffffff93ff2e08 0xffffffff92dfc020 0x0000000000000000 -b-
0xffffffff93ff4500   9      7061    0 0xffffffff93ff2b68 0xffffffff92dfede8 0x0000000000000000 -b-
0xffffffff93ff4580   9      7060    0 0xffffffff93ff2c48 0xffffffff92dfee88 0x0000000000000000 -b-
0xffffffff93ff4400   9      7063    0 0xffffffff93ff29a8 0xffffffff92dfeca8 0x0000000000000000 -b-
0xffffffff93ff4480   9      7062    0 0xffffffff93ff2a88 0xffffffff92dfed48 0x0000000000000000 -b-
0xffffffff93ff6a80   9      7081    0 0xffffffff93ff59a0 0xffffffff92dfe168 0x0000000000000000 -b-
0xffffffff93ff6b00   9      7080    0 0xffffffff93ff5a80 0xffffffff92dfe208 0x0000000000000000 -b-
0xffffffff93ff6980   9      7083    0 0xffffffff93ff57e0 0xffffffff92dfe028 0x0000000000000000 -b-
0xffffffff93ff6a00   9      7082    0 0xffffffff93ff58c0 0xffffffff92dfe0c8 0x0000000000000000 -b-
0xffffffff92fd5000   9      9107    0 0x0000000000000000 0xffffffff92e94548 0x0000000000000000 -b-
0xffffffff93ff6880   9      7085    0 0xffffffff93ff5620 0xffffffff92e00e60 0x0000000000000000 -b-
0xffffffff93ff6900   9      7084    0 0xffffffff93ff5700 0xffffffff92e00f00 0x0000000000000000 -b-
0xffffffff93ff6780   9      7087    0 0xffffffff93ff5460 0xffffffff92e00d20 0x0000000000000000 -b-
0xffffffff93ff6800   9      7086    0 0xffffffff93ff5540 0xffffffff92e00dc0 0x0000000000000000 -b-
0xffffffff93ff6e80   9      7073    0 0xffffffff93ff20e8 0xffffffff92dfe668 0x0000000000000000 -b-
0xffffffff93ff6f00   9      7072    0 0xffffffff93ff21c8 0xffffffff92dfe708 0x0000000000000000 -b-
0xffffffff93ff6d80   9      7075    0 0xffffffff93ff5ee0 0xffffffff92dfe528 0x0000000000000000 -b-
0xffffffff93ff6e00   9      7074    0 0xffffffff93ff2008 0xffffffff92dfe5c8 0x0000000000000000 -b-
0xffffffff93ff6c80   9      7077    0 0xffffffff93ff5d20 0xffffffff92dfe3e8 0x0000000000000000 -b-
0xffffffff93ff6d00   9      7076    0 0xffffffff93ff5e00 0xffffffff92dfe488 0x0000000000000000 -b-
0xffffffff93ff6b80   9      7079    0 0xffffffff93ff5b60 0xffffffff92dfe2a8 0x0000000000000000 -b-
0xffffffff93ff6c00   9      7078    0 0xffffffff93ff5c40 0xffffffff92dfe348 0x0000000000000000 -b-
0xffffffff93ff6280   9      7097    0 0xffffffff93ff9b68 0xffffffff92e006e0 0x0000000000000000 -b-
0xffffffff93ff6300   9      7096    0 0xffffffff93ff9c48 0xffffffff92e00780 0x0000000000000000 -b-
0xffffffff93ff6180   9      7099    0 0xffffffff93ff99a8 0xffffffff92e005a0 0x0000000000000000 -b-
0xffffffff93ff6200   9      7098    0 0xffffffff93ff9a88 0xffffffff92e00640 0x0000000000000000 -b-
0xffffffff93ff6080   9      7101    0 0xffffffff93ff97e8 0xffffffff92e00460 0x0000000000000000 -b-
0xffffffff93ff6100   9      7100    0 0xffffffff93ff98c8 0xffffffff92e00500 0x0000000000000000 -b-
0xffffffff93ff8f00   9      7103    0 0xffffffff93ff9628 0xffffffff92e00320 0x0000000000000000 -b-
0xffffffff93ff6000   9      7102    0 0xffffffff93ff9708 0xffffffff92e003c0 0x0000000000000000 -b-
0xffffffff93ff6680   9      7089    0 0xffffffff93ff52a0 0xffffffff92e00be0 0x0000000000000000 -b-
0xffffffff93090a80   9      9126    0 0x0000000000000000 0xffffffff92e94468 0x0000000000000000 -b-
0xffffffff93ff6700   9      7088    0 0xffffffff93ff5380 0xffffffff92e00c80 0x0000000000000000 -b-
0xffffffff93ff6580   9      7091    0 0xffffffff93ff50e0 0xffffffff92e00aa0 0x0000000000000000 -b-
0xffffffff93ff6600   9      7090    0 0xffffffff93ff51c0 0xffffffff92e00b40 0x0000000000000000 -b-
0xffffffff93ff6480   9      7093    0 0xffffffff93ff9ee8 0xffffffff92e00960 0x0000000000000000 -b-
0xffffffff93ff6500   9      7092    0 0xffffffff93ff5000 0xffffffff92e00a00 0x0000000000000000 -b-
0xffffffff93ff6380   9      7095    0 0xffffffff93ff9d28 0xffffffff92e00820 0x0000000000000000 -b-
0xffffffff93ff6400   9      7094    0 0xffffffff93ff9e08 0xffffffff92e008c0 0x0000000000000000 -b-
0xffffffff93ff8a00   9      7113    0 0xffffffff93ffdd20 0xffffffff92e02c88 0x0000000000000000 -b-
0xffffffff93ff8a80   9      7112    0 0xffffffff93ffde00 0xffffffff92e02d28 0x0000000000000000 -b-
0xffffffff93ff8900   9      7115    0 0xffffffff93ffdb60 0xffffffff92e02b48 0x0000000000000000 -b-
0xffffffff93ff8980   9      7114    0 0xffffffff93ffdc40 0xffffffff92e02be8 0x0000000000000000 -b-
0xffffffff93ff8800   9      7117    0 0xffffffff93ffd9a0 0xffffffff92e02a08 0x0000000000000000 -b-
0xffffffff93ff8880   9      7116    0 0xffffffff93ffda80 0xffffffff92e02aa8 0x0000000000000000 -b-
0xffffffff93ff8700   9      7119    0 0xffffffff93ffd7e0 0xffffffff92e028c8 0x0000000000000000 -b-
0xffffffff93ff8780   9      7118    0 0xffffffff93ffd8c0 0xffffffff92e02968 0x0000000000000000 -b-
0xffffffff93ff8e00   9      7105    0 0xffffffff93ff9468 0xffffffff92e001e0 0x0000000000000000 -b-
0xffffffff93ff8e80   9      7104    0 0xffffffff93ff9548 0xffffffff92e00280 0x0000000000000000 -b-
0xffffffff93ff8d00   9      7107    0 0xffffffff93ff92a8 0xffffffff92e000a0 0x0000000000000000 -b-
0xffffffff93ff8d80   9      7106    0 0xffffffff93ff9388 0xffffffff92e00140 0x0000000000000000 -b-
0xffffffff93ff8c00   9      7109    0 0xffffffff93ff90e8 0xffffffff92e02f08 0x0000000000000000 -b-
0xffffffff93ff8c80   9      7108    0 0xffffffff93ff91c8 0xffffffff92e00000 0x0000000000000000 -b-
0xffffffff93ff8b00   9      7111    0 0xffffffff93ffdee0 0xffffffff92e02dc8 0x0000000000000000 -b-
0xffffffff93ff8b80   9      7110    0 0xffffffff93ff9008 0xffffffff92e02e68 0x0000000000000000 -b-
0xffffffff93ff8280   9      7128    0 0xffffffff93ffd000 0xffffffff92e02328 0x0000000000000000 -b-
0xffffffff93ff8600   9      7121    0 0xffffffff93ffd620 0xffffffff92e02788 0x0000000000000000 -b-
0xffffffff93ff8680   9      7120    0 0xffffffff93ffd700 0xffffffff92e02828 0x0000000000000000 -b-
0xffffffff93ff8500   9      7123    0 0xffffffff93ffd460 0xffffffff92e02648 0x0000000000000000 -b-
0xffffffff93ff8580   9      7122    0 0xffffffff93ffd540 0xffffffff92e026e8 0x0000000000000000 -b-
0xffffffff93ff8400   9      7125    0 0xffffffff93ffd2a0 0xffffffff92e02508 0x0000000000000000 -b-
0xffffffff93ff8480   9      7124    0 0xffffffff93ffd380 0xffffffff92e025a8 0x0000000000000000 -b-
0xffffffff93ff8300   9      7127    0 0xffffffff93ffd0e0 0xffffffff92e023c8 0x0000000000000000 -b-
0xffffffff93ff8380   9      7126    0 0xffffffff93ffd1c0 0xffffffff92e02468 0x0000000000000000 -b-
0xffffffff92ff8d00   9      7166    0 0x0000000000000000 0xffffffff92e07e08 0x0000000000000000 -b-
0xffffffff93090980   9      9234    0 0x0000000000000000 0xffffffff92e94008 0x0000000000000000 -b-
0xffffffff93090880   9      9261    0 0x0000000000000000 0xffffffff92eaeee0 0x0000000000000000 -b-
0xffffffff93090680   9      9262    0 0x0000000000000000 0xffffffff92eaee00 0x0000000000000000 -b-
0xffffffff930eae80   9      9250    0 0xffffffff930eb468 0xffffffff92ead640 0x0000000000000000 -b-
0xffffffff93090800   9      9274    0 0x0000000000000000 0xffffffff92eaea80 0x0000000000000000 -b-
0xffffffff93090580   9      9277    0 0x0000000000000000 0xffffffff92eae9a0 0x0000000000000000 -b-
0xffffffff93090600   9      9264    0 0x0000000000000000 0xffffffff92eaed20 0x0000000000000000 -b-
0xffffffff93090780   9      9266    0 0x0000000000000000 0xffffffff92eaec40 0x0000000000000000 -b-
0xffffffff93270180   9     11327    0 0x0000000000000000 0xffffffff92f4e7e0 0x0000000000000000 -b-
0xffffffff93090700   9      9270    0 0x0000000000000000 0xffffffff92eaeb60 0x0000000000000000 -b-
0xffffffff93090400   9      9288    0 0x0000000000000000 0xffffffff92eae700 0x0000000000000000 -b-
0xffffffff93090480   9      9290    0 0x0000000000000000 0xffffffff92eae620 0x0000000000000000 -b-
0xffffffff93090b00   9      9295    0 0x0000000000000000 0xffffffff92eae460 0x0000000000000000 -b-
0xffffffff930c8880   9     11336    0 0x0000000000000000 0xffffffff92f4e620 0x0000000000000000 -b-
0xffffffff930ecb00   9      9282    0 0xffffffff930ed9a0 0xffffffff92eb0648 0x0000000000000000 -b-
0xffffffff93090380   9      9285    0 0x0000000000000000 0xffffffff92eae7e0 0x0000000000000000 -b-
0xffffffff93090500   9      9284    0 0x0000000000000000 0xffffffff92eae8c0 0x0000000000000000 -b-
0xffffffff930c8400   9     11329    0 0xffffffff930c7b60 0xffffffff92f50140 0x0000000000000000 -b-
0xffffffff930c8700   9     11328    0 0xffffffff930c7ee0 0xffffffff92f501e0 0x0000000000000000 -b-
0xffffffff931e9800   9      9311    0 0xffffffff931ea2a8 0xffffffff92eb28d0 0x0000000000000000 -b-
0xffffffff930c8980   9     11335    0 0xffffffff930b52a8 0xffffffff92f52dc8 0x0000000000000000 -b-
0xffffffff93090100   9      9310    0 0x0000000000000000 0xffffffff92eae2a0 0x0000000000000000 -b-
0xffffffff93090c80   9      9301    0 0x0000000000000000 0xffffffff92eae380 0x0000000000000000 -b-
0xffffffff930c8800   9     11356    0 0xffffffff930b50e8 0xffffffff92f52148 0x0000000000000000 -b-
0xffffffff9309a580   9      9313    0 0xffffffff93097628 0xffffffff92eb2790 0x0000000000000000 -b-
0xffffffff930ec280   9      9312    0 0xffffffff930eba88 0xffffffff92eb2830 0x0000000000000000 -b-
0xffffffff931f5780   9      9315    0 0x0000000000000000 0xffffffff92eae0e0 0x0000000000000000 -b-
0xffffffff931f5800   9      9314    0 0x0000000000000000 0xffffffff92eae1c0 0x0000000000000000 -b-
0xffffffff931f5700   9      9318    0 0xffffffff931f4700 0xffffffff92eb25b0 0x0000000000000000 -b-
0xffffffff930c8380   9     11365    0 0xffffffff930c7a80 0xffffffff92f54b50 0x0000000000000000 -b-
0xffffffff930c8780   9     11364    0 0xffffffff930b5008 0xffffffff92f54bf0 0x0000000000000000 -b-
0xffffffff930ec480   9      9343    0 0xffffffff930ebe08 0xffffffff92eb58d8 0x0000000000000000 -b-
0xffffffff930ec100   9      9342    0 0xffffffff930eb7e8 0xffffffff92eb5978 0x0000000000000000 -b-
0xffffffff93270100   9     11384    0 0xffffffff930b5c48 0xffffffff92f54010 0x0000000000000000 -b-
0xffffffff930c8280   9     11386    0 0xffffffff930c78c0 0xffffffff92f56e78 0x0000000000000000 -b-
0xffffffff930c8900   9     11390    0 0xffffffff930b51c8 0xffffffff92f56bf8 0x0000000000000000 -b-
0xffffffff930ec800   9      9352    0 0xffffffff930ed460 0xffffffff92eb5338 0x0000000000000000 -b-
0xffffffff931f5300   9      9354    0 0x0000000000000000 0xffffffff92eb4b68 0x0000000000000000 -b-
0xffffffff930c8300   9     11381    0 0xffffffff930c79a0 0xffffffff92f541f0 0x0000000000000000 -b-
0xffffffff930ea300   9      9348    0 0xffffffff930e58c0 0xffffffff92eb55b8 0x0000000000000000 -b-
0xffffffff931c0c00   9      9351    0 0xffffffff931bed20 0xffffffff92eb53d8 0x0000000000000000 -b-
0xffffffff930ecd00   9      9369    0 0xffffffff930edc40 0xffffffff92eb7980 0x0000000000000000 -b-
0xffffffff93180000   9      9370    0 0xffffffff93181000 0xffffffff92eb78e0 0x0000000000000000 -b-
0xffffffff931f5500   9      9372    0 0xffffffff931f4380 0xffffffff92eb77a0 0x0000000000000000 -b-
0xffffffff93180280   9      9375    0 0xffffffff931812a0 0xffffffff92eb75c0 0x0000000000000000 -b-
0xffffffff930d2680   9      9374    0 0xffffffff9325c8c0 0xffffffff92eb7660 0x0000000000000000 -b-
0xffffffff931f5280   9      9361    0 0xffffffff931f40e0 0xffffffff92eb7de0 0x0000000000000000 -b-
0xffffffff931f5480   9      9365    0 0xffffffff931f42a0 0xffffffff92eb7b60 0x0000000000000000 -b-
0xffffffff93180600   9      9367    0 0xffffffff93181620 0xffffffff92eb7ac0 0x0000000000000000 -b-
0xffffffff930ecd80   9      9366    0 0x0000000000000000 0xffffffff92eb4a88 0x0000000000000000 -b-
0xffffffff931f6d00   9      9385    0 0xffffffff931f7b68 0xffffffff92eb9f28 0x0000000000000000 -b-
0xffffffff931f5b00   9      9376    0 0xffffffff931f4a80 0xffffffff92eb7520 0x0000000000000000 -b-
0xffffffff931f5a80   9      9379    0 0xffffffff931f49a0 0xffffffff92eb7340 0x0000000000000000 -b-
0xffffffff931f5b80   9      9378    0 0xffffffff931f4b60 0xffffffff92eb73e0 0x0000000000000000 -b-
0xffffffff9323cd80   9      1241    0 0xffffffff9323bb60 0xffffffff92c33660 0x0000000000000000 -b-
0xffffffff931f5580   9      9381    0 0xffffffff931f4460 0xffffffff92eb7200 0x0000000000000000 -b-
0xffffffff9323ca80   9      1240    0 0xffffffff9323bd20 0xffffffff92c33700 0x0000000000000000 -b-
0xffffffff931f5400   9      9380    0 0xffffffff931f41c0 0xffffffff92eb72a0 0x0000000000000000 -b-
0xffffffff9323c900   9      1243    0 0x0000000000000000 0xffffffff92c33520 0x0000000000000000 -b-
0xffffffff931f5180   9      9403    0 0xffffffff931f4000 0xffffffff92eb9488 0x0000000000000000 -b-
0xffffffff931f5100   9      9404    0 0xffffffff931f7ee8 0xffffffff92eb93e8 0x0000000000000000 -b-
0xffffffff931f5680   9      9407    0 0xffffffff931f4620 0xffffffff92eb9208 0x0000000000000000 -b-
0xffffffff930ec880   9      9393    0 0xffffffff930ed540 0xffffffff92eb9a28 0x0000000000000000 -b-
0xffffffff930eaf00   9      9392    0 0xffffffff930eb548 0xffffffff92eb9ac8 0x0000000000000000 -b-
0xffffffff930ec380   9      9395    0 0xffffffff930ebc48 0xffffffff92eb98e8 0x0000000000000000 -b-
0xffffffff930ecf00   9      9397    0 0xffffffff930edd20 0xffffffff92eb97a8 0x0000000000000000 -b-
0xffffffff931f6100   9      9396    0 0xffffffff931f7008 0xffffffff92eb9848 0x0000000000000000 -b-
0xffffffff931f5200   9      9399    0 0x0000000000000000 0xffffffff92eb49a8 0x0000000000000000 -b-
0xffffffff93090f00   9      1259    0 0x0000000000000000 0xffffffff92c28548 0x0000000000000000 -b-
0xffffffff930ec080   9      9398    0 0xffffffff930eb708 0xffffffff92eb9708 0x0000000000000000 -b-
0xffffffff930ec780   9      1261    0 0xffffffff930ed380 0xffffffff92c35b68 0x0000000000000000 -b-
0xffffffff930ec700   9      1260    0 0xffffffff930ed2a0 0xffffffff92c35c08 0x0000000000000000 -b-
0xffffffff930eca00   9      9419    0 0xffffffff930ed7e0 0xffffffff92ebcaa0 0x0000000000000000 -b-
0xffffffff92fd5480   9      1263    0 0x0000000000000000 0xffffffff92c28468 0x0000000000000000 -b-
0xffffffff930ec680   9      9423    0 0xffffffff930ed1c0 0xffffffff92ebc960 0x0000000000000000 -b-
0xffffffff930ec180   9      9409    0 0xffffffff930eb8c8 0xffffffff92eb90c8 0x0000000000000000 -b-
0xffffffff93090000   9      9408    0 0xffffffff930ede00 0xffffffff92eb9168 0x0000000000000000 -b-
0xffffffff931f6e00   9      9411    0 0x0000000000000000 0xffffffff92eb48c8 0x0000000000000000 -b-
0xffffffff93183f00   9      9415    0 0xffffffff93196ee8 0xffffffff92ebcd20 0x0000000000000000 -b-
0xffffffff931f6d80   9      9414    0 0xffffffff931f7c48 0xffffffff92ebcdc0 0x0000000000000000 -b-
0xffffffff930eca80   9      9433    0 0xffffffff930ed8c0 0xffffffff92ebc320 0x0000000000000000 -b-
0xffffffff931f6f00   9      9435    0 0xffffffff931f7d28 0xffffffff92ebc280 0x0000000000000000 -b-
0xffffffff931f5000   9      9434    0 0x0000000000000000 0xffffffff92eb4628 0x0000000000000000 -b-
0xffffffff930ec980   9      1278    0 0xffffffff930ed700 0xffffffff92c35168 0x0000000000000000 -b-
0xffffffff931f6c80   9      9437    0 0xffffffff931f7a88 0xffffffff92ebc140 0x0000000000000000 -b-
0xffffffff92fdcb80   9      7383    0 0x0000000000000000 0xffffffff92e070e8 0x0000000000000000 -b-
0xffffffff9323cc00   9      7401    0 0xffffffff9323b700 0xffffffff92e18208 0x0000000000000000 -b-
0xffffffff931f5980   9      9424    0 0xffffffff931f47e0 0xffffffff92ebc8c0 0x0000000000000000 -b-
0xffffffff930ea500   9      9427    0 0xffffffff930e5b60 0xffffffff92ebc6e0 0x0000000000000000 -b-
0xffffffff930ec580   9      9426    0 0xffffffff930ed000 0xffffffff92ebc780 0x0000000000000000 -b-
0xffffffff93252780   9      7404    0 0xffffffff930dcb60 0xffffffff92e18028 0x0000000000000000 -b-
0xffffffff9309ac00   9      9428    0 0xffffffff93097c48 0xffffffff92ebc640 0x0000000000000000 -b-
0xffffffff93237880   9      7406    0 0x0000000000000000 0xffffffff92e1be60 0x0000000000000000 -b-
0xffffffff93237a80   9      7395    0 0x0000000000000000 0xffffffff92e185c8 0x0000000000000000 -b-
0xffffffff9323c700   9      7394    0 0xffffffff9323ba80 0xffffffff92e18668 0x0000000000000000 -b-
0xffffffff930ecc00   9      9451    0 0xffffffff930edb60 0xffffffff92ebe968 0x0000000000000000 -b-
0xffffffff930ecc80   9      9450    0 0x0000000000000000 0xffffffff92eb4468 0x0000000000000000 -b-
0xffffffff930ec200   9      1280    0 0xffffffff930eb9a8 0xffffffff92c35028 0x0000000000000000 -b-
0xffffffff930ecb80   9      9452    0 0xffffffff930eda80 0xffffffff92ebe8c8 0x0000000000000000 -b-
0xffffffff930ece00   9      7417    0 0x0000000000000000 0xffffffff92e1de00 0x0000000000000000 -b-
0xffffffff930ea480   9      9441    0 0xffffffff930e5a80 0xffffffff92ebee68 0x0000000000000000 -b-
0xffffffff93090180   9      7416    0 0x0000000000000000 0xffffffff92e1dee0 0x0000000000000000 -b-
0xffffffff93090200   9      7419    0 0x0000000000000000 0xffffffff92e1dd20 0x0000000000000000 -b-
0xffffffff931f5080   9      9443    0 0xffffffff931f7e08 0xffffffff92ebed28 0x0000000000000000 -b-
0xffffffff930ec600   9      1305    0 0xffffffff930ed0e0 0xffffffff92c370a0 0x0000000000000000 -b-
0xffffffff930ec300   9      7423    0 0xffffffff930ebb68 0xffffffff92e1b6e0 0x0000000000000000 -b-
0xffffffff93090300   9      9444    0 0x0000000000000000 0xffffffff92eb4548 0x0000000000000000 -b-
0xffffffff93090280   9      7422    0 0x0000000000000000 0xffffffff92e1dc40 0x0000000000000000 -b-
0xffffffff9323c780   9      7413    0 0xffffffff9323b8c0 0xffffffff92e1ba00 0x0000000000000000 -b-
0xffffffff93090e00   9      7415    0 0x0000000000000000 0xffffffff92e07008 0x0000000000000000 -b-
0xffffffff931f5d00   9      7433    0 0xffffffff931f4c40 0xffffffff92e1b1e0 0x0000000000000000 -b-
0xffffffff931f5600   9      7434    0 0xffffffff931f4540 0xffffffff92e1b140 0x0000000000000000 -b-
0xffffffff930ec000   9      7437    0 0xffffffff930eb628 0xffffffff92e1ef08 0x0000000000000000 -b-
0xffffffff92fd5600   9      1321    0 0xffffffff92fd6008 0xffffffff92c39648 0x0000000000000000 -b-
0xffffffff930ec400   9      7439    0 0xffffffff930ebd28 0xffffffff92e1edc8 0x0000000000000000 -b-
0xffffffff930ec900   9      7438    0 0xffffffff930ed620 0xffffffff92e1ee68 0x0000000000000000 -b-
0xffffffff931f5380   9      7425    0 0x0000000000000000 0xffffffff92e1db60 0x0000000000000000 -b-
0xffffffff930ec500   9      7424    0 0xffffffff930ebee8 0xffffffff92e1b640 0x0000000000000000 -b-
0xffffffff930ece80   9      7430    0 0x0000000000000000 0xffffffff92e1da80 0x0000000000000000 -b-
0xffffffff931f5a00   9      7449    0 0xffffffff931f48c0 0xffffffff92e1e828 0x0000000000000000 -b-
0xffffffff9323c980   9      1317    0 0xffffffff9323b7e0 0xffffffff92c398c8 0x0000000000000000 -b-
0xffffffff9323c800   9      1319    0 0xffffffff9323bc40 0xffffffff92c39788 0x0000000000000000 -b-
0xffffffff9323c680   9      1318    0 0xffffffff9323b9a0 0xffffffff92c39828 0x0000000000000000 -b-
0xffffffff93090080   9      7443    0 0xffffffff930edee0 0xffffffff92e1eb48 0x0000000000000000 -b-
0xffffffff931f6e80   9      7444    0 0x0000000000000000 0xffffffff92e1d9a0 0x0000000000000000 -b-
0xffffffff93237900   9      9503    0 0x0000000000000000 0xffffffff92ec2dd8 0x0000000000000000 -b-
0xffffffff92fdcc00   9      9515    0 0x0000000000000000 0xffffffff92ea5700 0x0000000000000000 -b-
0xffffffff92fdcb00   9      9516    0 0x0000000000000000 0xffffffff92ec2798 0x0000000000000000 -b-
0xffffffff92fdc880   9      9519    0 0x0000000000000000 0xffffffff92eb40e8 0x0000000000000000 -b-
0xffffffff93237a00   9      9505    0 0x0000000000000000 0xffffffff92ec2c98 0x0000000000000000 -b-
0xffffffff93237980   9      9504    0 0x0000000000000000 0xffffffff92ec2d38 0x0000000000000000 -b-
0xffffffff931a4600   9      9507    0 0xffffffff931999a8 0xffffffff92ec2b58 0x0000000000000000 -b-
0xffffffff931a4580   9      9508    0 0xffffffff931998c8 0xffffffff92ec2ab8 0x0000000000000000 -b-
0xffffffff92fd5b00   9      9530    0 0x0000000000000000 0xffffffff92ec3d20 0x0000000000000000 -b-
0xffffffff92fdc780   9      9521    0 0x0000000000000000 0xffffffff92ec3ee0 0x0000000000000000 -b-
0xffffffff92fdc800   9      9520    0 0x0000000000000000 0xffffffff92eb4008 0x0000000000000000 -b-
0xffffffff93270500   9     11608    0 0x0000000000000000 0xffffffff92f610e0 0x0000000000000000 -b-
0xffffffff93270480   9     11610    0 0xffffffff932710e0 0xffffffff92f66980 0x0000000000000000 -b-
0xffffffff930c8180   9     11626    0 0xffffffff930c77e0 0xffffffff92f660c0 0x0000000000000000 -b-
0xffffffff930c8200   9     11616    0 0x0000000000000000 0xffffffff92f68ee8 0x0000000000000000 -b-
0xffffffff92fd5e00   9     11705    0 0xffffffff92fd6c48 0xffffffff92f6d468 0x0000000000000000 -b-
0xffffffff93270200   9     11707    0 0xffffffff930b5d28 0xffffffff92f6d3c8 0x0000000000000000 -b-
0xffffffff93270280   9     11706    0 0x0000000000000000 0xffffffff92f68548 0x0000000000000000 -b-
0xffffffff930c8c80   9      9655    0 0x0000000000000000 0xffffffff92eced28 0x0000000000000000 -b-
0xffffffff930c8a80   9     11710    0 0x0000000000000000 0xffffffff92f68468 0x0000000000000000 -b-
0xffffffff930c8c00   9      9672    0 0xffffffff930b5628 0xffffffff92ecfd28 0x0000000000000000 -b-
0xffffffff930c8b80   9      9671    0 0xffffffff930b5548 0xffffffff92ecfdc8 0x0000000000000000 -b-
0xffffffff92fd5980   9      9701    0 0xffffffff92fd6708 0xffffffff92ecf288 0x0000000000000000 -b-
0xffffffff92fd5a80   9      9700    0 0x0000000000000000 0xffffffff92ed1e00 0x0000000000000000 -b-
0xffffffff92fd5a00   9      9702    0 0xffffffff92fd67e8 0xffffffff92ecf1e8 0x0000000000000000 -b-
0xffffffff93270000   9     11745    0 0xffffffff930b5a88 0xffffffff92f700b0 0x0000000000000000 -b-
0xffffffff930c8580   9      9787    0 0xffffffff930c7d20 0xffffffff92ed8d40 0x0000000000000000 -b-
0xffffffff930c8600   9      9786    0 0x0000000000000000 0xffffffff92ed6548 0x0000000000000000 -b-
0xffffffff930c8500   9      9788    0 0x0000000000000000 0xffffffff92ed6468 0x0000000000000000 -b-
0xffffffff930c8480   9      9791    0 0xffffffff930c7c40 0xffffffff92ed8b60 0x0000000000000000 -b-
0xffffffff930c8f00   9      9801    0 0xffffffff930b59a8 0xffffffff92ed8520 0x0000000000000000 -b-
0xffffffff930c8e00   9      9802    0 0x0000000000000000 0xffffffff92ed6388 0x0000000000000000 -b-
0xffffffff930c8a00   9      9822    0 0xffffffff930b5388 0xffffffff92edcb68 0x0000000000000000 -b-
0xffffffff930c8b00   9      9825    0 0xffffffff930b5468 0xffffffff92edc988 0x0000000000000000 -b-
0xffffffff930c8d80   9      9831    0 0xffffffff930b57e8 0xffffffff92edc668 0x0000000000000000 -b-
0xffffffff92fdc700   9      9850    0 0x0000000000000000 0xffffffff92edd8c0 0x0000000000000000 -b-
0xffffffff92fd5e80   9      9841    0 0xffffffff92fd6d28 0xffffffff92edc208 0x0000000000000000 -b-
0xffffffff930c8680   9      9845    0 0xffffffff930c7e00 0xffffffff92edff00 0x0000000000000000 -b-
0xffffffff93270600   9     11914    0 0xffffffff932712a0 0xffffffff92f80ab0 0x0000000000000000 -b-
0xffffffff92fdc680   9      9896    0 0xffffffff92ff52a0 0xffffffff92ee10a8 0x0000000000000000 -b-
0xffffffff92ff8780   9     11924    0 0xffffffff92ff5380 0xffffffff92f80470 0x0000000000000000 -b-
0xffffffff92fd5d00   9      9933    0 0x0000000000000000 0xffffffff92edd620 0x0000000000000000 -b-
0xffffffff92fd5c00   9      9932    0 0xffffffff92fd69a8 0xffffffff92ee5ab8 0x0000000000000000 -b-
0xffffffff92fd5c80   9      9934    0 0xffffffff92fd6a88 0xffffffff92ee5a18 0x0000000000000000 -b-
0xffffffff92fd5d80   9      9940    0 0xffffffff92fd6b68 0xffffffff92ee56f8 0x0000000000000000 -b-
0xffffffff93ff8100   9     12025    0 0xffffffff93fd3e08 0xffffffff92f88820 0x0000000000000000 -b-

comment:4 by bonefish, 10 years ago

The vnode in question is the root node of a packagefs:

kdebug> mounts
address             id root               covers             cookie             fs_name
...
0xffffffff8aa2cda8   9 0xffffffff92edb380 0xdeadbeefdeadbeef 0xffffffff8f842178 packagefs

The "covers" field would normally suggest that the mount has already been deleted, but the other fields aren't 0xdeadbeef (and look quite plausible even), which they would be in that case. Moreover, the mount wouldn't be in the mounts hash table anymore and thus wouldn't be listed by mounts. Given that "covers" (like "root") is an immutable field (initialized when mounting and never modified afterward), it's a bit of a mystery how it can get that value.

The root node is not in the mount's vnode list, which is at least consistent with it's ref count. Though, obviously, that should never happen. The root node is kept until unmounting.

It would be interesting to know whether another thread is currently performing a mount/unmount operation

comment:5 by kallisti5, 10 years ago

kdl threads:

kdebug> threads
thread                 id  state     wait for  object              cpu pri  stack              team  name
0xffffffff801adae0      1  ready     -                               -   0  0xffffffff81001000    1  idle thread 1
0xffffffff801ae000      2  running   -                               1   0  0xffffffff81809000    1  idle thread 2
0xffffffff8221f600      3  waiting   cvar      0xffffffff801ada40    -  15  0xffffffff81175000    1  undertaker
0xffffffff8221f0e0      4  zzz                                       -   5  0xffffffff8117a000    1  kernel daemon
0xffffffff8221ebc0      5  zzz                                       -   5  0xffffffff8117f000    1  resource resizer
0xffffffff8221e6a0      6  waiting   sem       15                    -  10  0xffffffff81184000    1  acpi_task
0xffffffff8221e180      7  zzz                                       -   1  0xffffffff8118a000    1  page scrubber
0xffffffff8221dc60      8  waiting   cvar      0xffffffff801d30a0    -  11  0xffffffff8118f000    1  page writer
0xffffffff8221d740      9  waiting   cvar      0xffffffff801d3040    -  10  0xffffffff81194000    1  page daemon
0xffffffff8221d220     10  waiting   cvar      0xffffffff801d2f40    - 110  0xffffffff81199000    1  object cache resizer
0xffffffff8221cd00     11  waiting   sem       32                    -   5  0xffffffff8119e000    1  low resource manager
0xffffffff8221c7e0     12  waiting   cvar      0xffffffff801a4e28    -  10  0xffffffff811a3000    1  dpc: normal priority
0xffffffff8221c2c0     13  waiting   cvar      0xffffffff801a4dc8    -  20  0xffffffff811a8000    1  dpc: high priority
0xffffffff8221bda0     14  waiting   cvar      0xffffffff801a4d68    - 100  0xffffffff811ad000    1  dpc: real-time priority
0xffffffff8221b880     15  waiting   sem       45                    -   5  0xffffffff811b2000    1  block notifier/writer
0xffffffff8221ae40    358  waiting   sem       1418                  -  20  0xffffffff812bc000    1  uhci finish thread
0xffffffff8221a920    359  waiting   sem       1419                  -  10  0xffffffff812c1000    1  uhci cleanup thread
0xffffffff8221a400    360  waiting   sem       1426                  -  20  0xffffffff812c6000    1  uhci isochronous finish thread
0xffffffff82219ee0    361  zzz                                       -   5  0xffffffff812cb000    1  usb explore
0xffffffff822199c0    362  zzz                                       -  10  0xffffffff81762000    1  media checker
0xffffffff82218f80    387  waiting   sem       1539                  -  10  0xffffffff81767000    1  locked_pool_enlarger
0xffffffff822194a0    388  waiting   sem       1545                  -  20  0xffffffff8176e000    1  scsi_bus_service
0xffffffff82218a60    389  waiting   sem       1575                  -  20  0xffffffff812d4000    1  scsi_bus_service
0xffffffff82218540    390  waiting   cvar      0xffffffff82296958    -  12  0xffffffff8135d000    1  virtio scheduler 1
0xffffffff82218020    391  waiting   cvar      0xffffffff822969a8    -  12  0xffffffff81362000    1  virtio notifier 1
0xffffffff82217b00    392  waiting   cvar      0xffffffff82296798    -  12  0xffffffff8954e000    1  virtio scheduler 2
0xffffffff822175e0    393  waiting   cvar      0xffffffff822967e8    -  12  0xffffffff89553000    1  virtio notifier 2
0xffffffff82215c40    398  waiting   sem       1654                  -   5  0xffffffff8177b000    1  syslog sender
0xffffffff82215720    399  waiting   sem       1658                  -  10  0xffffffff81403000    1  invalidate_loop
0xffffffff82215200    400  waiting   sem       1662                  -  10  0xffffffff8173e000    1  run_on_exit_loop
0xffffffff82216160    419  ready     -                               -  11  0xffffffff81748000  419  _roster_thread_
0xffffffff822147c0    421  zzz                                       -  11  0xffffffff813df000  419  message deliverer
0xffffffff822142a0    422  waiting   sem       1798                  -  16  0xffffffff813e4000  419  timer_thread
0xffffffff82213d80    423  waiting   cvar      0xffffffff8a61ce88    -  11  0xffffffff81451000  419  authentication manager
0xffffffff82213860    424  waiting   cvar      0xffffffff8a61cc88    -  10  0xffffffff81456000  419  main_mime
0xffffffff82213340    425  waiting   sem       1816                  -  15  0xffffffff814b0000  419  messaging command processor
0xffffffff82212e20    426  waiting   cvar      0xffffffff8a601688    -  10  0xffffffff814b5000  426  debug_server
0xffffffff8221b360    427  waiting   cvar      0xffffffff8a62b888    -  10  0xffffffff8174d000  427  package_daemon
0xffffffff82212900    428  waiting   cvar      0xffffffff8a62b388    -  10  0xffffffff81678000  428  net_server
0xffffffff822123e0    429  waiting   cvar      0xffffffff8a62b788    -  10  0xffffffff8167d000  429  picasso
0xffffffff82216ba0    432  waiting   cvar      0xffffffff8a601588    -  10  0xffffffff817ec000  426  kernel listener
0xffffffff82211480    435  waiting   cvar      0xffffffff813b9db8    -  10  0xffffffff813b5000  427  job runner
0xffffffff82210f60    436  waiting   cvar      0xffffffff8a62b288    -  10  0xffffffff813ba000  428  PathMonitor looper
0xffffffff82210000    439  waiting   cvar      0xffffffff8a62b688    -  10  0xffffffff817f1000  429  Font Manager
0xffffffff8a72e6b0    443  waiting   sem       1960                  -  10  0xffffffff817ab000    1  net timer
0xffffffff8a72ebd0    444  waiting   sem       1966                  -  15  0xffffffff81713000    1  loop consumer
0xffffffff8a72e190    445  waiting   cvar      0xffffffff8a62b188    -  10  0xffffffff81732000  429  screen manager
0xffffffff82211ec0    446  waiting   cvar      0xffffffff8a67d388    -  10  0xffffffff81718000  446  syslog_daemon
0xffffffff8a72dc70    448  waiting   sem       1997                  -  15  0xffffffff81116000    1  fbsd callout
0xffffffff8a72d750    449  waiting   sem       2001                  - 120  0xffffffff8111b000    1  fast taskq
0xffffffff82210520    452  waiting   cvar      0xffffffff8a672c88    -  20  0xffffffff81120000  452  input_server
0xffffffff82210a40    453  waiting   cvar      0xffffffff8a67d188    -  15  0xffffffff8115a000  429  d:0:baron
0xffffffff8a72f610    454  waiting   cvar      0xffffffff8a672588    -  15  0xffffffff81125000  429  a:446:x-vnd.Haiku-SystemLogger
0xffffffff82216680    455  waiting   cvar      0xffffffff8a799c88    -  10  0xffffffff8112a000  446  daemon
0xffffffff822119a0    457  waiting   cvar      0xffffffff8a799988    -  15  0xffffffff8115f000  429  a:452:x-vnd.Be-input_server
0xffffffff822170c0    458  waiting   cvar      0xffffffff8a799688    - 103  0xffffffff81164000  452  _input_server_event_loop_
0xffffffff8a72d230    459  waiting   cvar      0xffffffff8a799488    -  10  0xffffffff81169000  452  AddOnMonitor
0xffffffff8a72cd10    460  waiting   cvar      0xffffffff8a7a0c88    -  90  0xffffffff8967f000  429  event loop
0xffffffff8a72c7f0    461  waiting   sem       2098                  -  95  0xffffffff89684000  429  cursor loop
0xffffffff8a72c2d0    462  waiting   cvar      0xffffffff8a7a0b88    -  10  0xffffffff89689000  452  PathMonitor looper
0xffffffff8a72bdb0    463  waiting   sem       2114                  -  99  0xffffffff8968e000    1  lem_taskq
0xffffffff8a72b890    464  waiting   cvar      0xffffffff8a7da788    -  10  0xffffffff8112f000  464  mount_server
0xffffffff8a72ae50    466  waiting   sem       2133                  -  20  0xffffffff896a1000    1  ps2 service
0xffffffff8a72f0f0    468  waiting   cvar      0xffffffff8a7da188    -  15  0xffffffff896ab000  429  a:464:x-vnd.Haiku-mount_server
0xffffffff8a72a930    469  waiting   cvar      0xffffffff8a541338    - 104  0xffffffff896b0000  452  Tablet Tablet 1 watcher
0xffffffff8a72b370    473  waiting   cvar      0xffffffff8a7f3b88    -   5  0xffffffff896f3000  452  screensaver controller
0xffffffff8a7294b0    474  waiting   cvar      0xffffffff8a7f3788    -  10  0xffffffff896d2000  452  Shortcuts map watcher
0xffffffff8a728f90    475  waiting   cvar      0xffffffff8a7f3a88    -  10  0xffffffff896d7000  452  Shortcuts commands executor
0xffffffff8a728a70    477  waiting   cvar      0xffffffff8aa41a88    -  10  0xffffffff896e1000  477  Tracker
0xffffffff8a72a410    478  waiting   cvar      0xffffffff8aa59388    -  10  0xffffffff896e6000  478  Deskbar
0xffffffff8a728550    479  waiting   cvar      0xffffffff8aa2f888    -  10  0xffffffff896b5000  479  media_server
0xffffffff8a728030    480  waiting   cvar      0xffffffff8aa2d088    -  10  0xffffffff896ba000  480  midi_server
0xffffffff8a727b10    481  waiting   cvar      0xffffffff8aa46988    -  10  0xffffffff896bf000  481  print_server
0xffffffff8a7299d0    483  waiting   cvar      0xffffffff8aa55a88    -  10  0xffffffff896eb000  483  cddb_daemon
0xffffffff8a7270d0    484  waiting   cvar      0xffffffff8aa59d88    -  10  0xffffffff896c9000  484  notification_server
0xffffffff8a726bb0    485  waiting   cvar      0xffffffff8aa55588    -  10  0xffffffff89729000  485  power_daemon
0xffffffff8a725730    489  waiting   sem       2273                  -  15  0xffffffff89716000    1  /dev/net/ipro1000/0 consumer
0xffffffff8a725210    490  waiting   sem       2272                  -   5  0xffffffff89720000    1  ethernet link state checker
0xffffffff8a724cf0    491  waiting   sem       2118                  -  90  0xffffffff89733000    1  /dev/net/ipro1000/0 reader
0xffffffff8a7247d0    492  waiting   cvar      0xffffffff8a7ada88    -  10  0xffffffff89738000  428  /dev/net/ipro1000/0
0xffffffff8a723d90    494  waiting   sem       2510                  -  10  0xffffffff89742000  428  services listener
0xffffffff8a723870    496  waiting   cvar      0xffffffff8aa2fd88    -  15  0xffffffff89747000  429  a:480:x-vnd.Haiku-midi_server
0xffffffff82214ce0    498  waiting   cvar      0xffffffff8aa2f988    -  10  0xffffffff89756000  480  PathMonitor looper
0xffffffff8a723350    499  waiting   cvar      0xffffffff8aa2fc88    -  10  0xffffffff8975b000  480  MIDI devices watcher
0xffffffff8a729ef0    501  waiting   cvar      0xffffffff8aa2f688    -  15  0xffffffff8974c000  429  a:479:x-vnd.Be.media-server
0xffffffff8a722e30    502  waiting   sem       2486                  -  19  0xffffffff89760000  479  notification broadcast
0xffffffff8a722910    503  waiting   sem       2494                  -  10  0xffffffff89765000  479  big brother is watching you
0xffffffff8a7223f0    504  waiting   cvar      0xffffffff8aa2f088    - 105  0xffffffff8976a000  479  media_server control
0xffffffff8a7242b0    506  waiting   cvar      0xffffffff8aa46588    -  10  0xffffffff89774000  506  media_addon_server
0xffffffff8a721ed0    508  waiting   cvar      0xffffffff8aa41888    -  15  0xffffffff89779000  429  a:477:x-vnd.Be-TRAK
0xffffffff8a721490    510  waiting   cvar      0xffffffff8aa41688    -  10  0xffffffff89783000  477  launch looper
0xffffffff8a720f70    512  waiting   cvar      0xffffffff8aa46788    -  15  0xffffffff89788000  429  a:481:x-vnd.Be-PSRV
0xffffffff8a720a50    513  waiting   cvar      0xffffffff8aa46488    -  10  0xffffffff8978d000  479  AddOnMonitor
0xffffffff8abdf100    519  waiting   cvar      0xffffffff8aa55288    -  15  0xffffffff89792000  429  a:483:x-vnd.Haiku-cddb_daemon
0xffffffff8abdf620    520  waiting   cvar      0xffffffff8aa59088    -  15  0xffffffff8970c000  429  a:485:x-vnd.Haiku-powermanageme
0xffffffff8abdebe0    521  waiting   cvar      0xffffffff8aa62e88    -  15  0xffffffff89797000  429  a:478:x-vnd.Be-TSKB
0xffffffff8abde6c0    522  waiting   cvar      0xffffffff8aa62d88    -  15  0xffffffff8979c000  429  a:484:x-vnd.Haiku-notification_
0xffffffff8abde1a0    523  waiting   cvar      0xffffffff8aa62c88    -  15  0xffffffff897a1000  429  a:506:x-vnd.Be.addon-host
0xffffffff8a720010    524  waiting   cvar      0xffffffff8aa62988    -  20  0xffffffff897a6000  506  _BMediaRoster_
0xffffffff8a720530    525  waiting   cvar      0xffffffff8aa62788    -  12  0xffffffff897ab000  506  media_addon_server control
0xffffffff8a726690    526  waiting   cvar      0xffffffff8aa62688    -  12  0xffffffff897b0000  506  System clock control
0xffffffff8abddc80    527  waiting   cvar      0xffffffff8aa6ae88    -  15  0xffffffff897b5000  429  w:484:Notification
0xffffffff8abdcd20    530  waiting   cvar      0xffffffff8aa6a788    -  20  0xffffffff897c4000  479  _BMediaRoster_
0xffffffff8abdc800    531  waiting   cvar      0xffffffff8aa6a988    -  15  0xffffffff897c9000  429  w:478:Deskbar
0xffffffff8abdc2e0    532  waiting   cvar      0xffffffff8aa62188    -  15  0xffffffff897d3000  484  w>Notification
0xffffffff8abdd240    533  waiting   sem       2761                  -  10  0xffffffff897d8000  485  _power_daemon_event_loop_
0xffffffff8abdbdc0    534  waiting   sem       2773                  -   5  0xffffffff897dd000  481  IPPListener
0xffffffff8a726170    535  waiting   cvar      0xffffffff8aa41188    -  15  0xffffffff897e2000  429  w:477:Tracker status
0xffffffff8a7275f0    536  waiting   cvar      0xffffffff8aa41388    -  15  0xffffffff897e7000  477  w>Tracker status
0xffffffff8a725c50    537  running   -                               0   5  0xffffffff897ec000  477  TrashWatcher
0xffffffff8abdb8a0    538  waiting   cvar      0xffffffff8aa02988    -   5  0xffffffff897f1000  477  ClipboardRefsWatcher
0xffffffff8abdb380    539  waiting   cvar      0xffffffff8aa7b288    -  15  0xffffffff897f6000  429  w:477:Desktop
0xffffffff8abdae60    540  waiting   cvar      0xffffffff8aa7b488    -  15  0xffffffff88503000  477  w>Desktop
0xffffffff8abda940    541  zzz                                       -   5  0xffffffff88508000  478  Expando Window Watcher
0xffffffff8abda420    542  waiting   cvar      0xffffffff8aa75888    -  10  0xffffffff8850d000  477  PathMonitor looper
0xffffffff8abd9f00    543  waiting   cvar      0xffffffff8aa75588    -  15  0xffffffff88512000  429  w:478:Twitcher
0xffffffff8abd99e0    544  waiting   cvar      0xffffffff8aa75288    -  15  0xffffffff88517000  429  w:478:offscreen
0xffffffff8abd94c0    545  waiting   cvar      0xffffffff8aa75788    -  15  0xffffffff8851c000  478  w>Twitcher
0xffffffff8abd8fa0    546  waiting   cvar      0xffffffff8aa6ab88    -  15  0xffffffff88521000  478  w>Deskbar
0xffffffff8abd8040    549  zzz                                       -   5  0xffffffff88530000  477  TrackerTaskLoop
0xffffffff8abd8560    550  waiting   sem       2879                  -   5  0xffffffff88526000    1  hda_codec_unsol_thread
0xffffffff8abd8a80    551  waiting   cvar      0xffffffff8aa3bb88    - 120  0xffffffff8855a000  506  HD Audio control
0xffffffff8abd7600    553  waiting   sem       2883                  - 120  0xffffffff88564000  506  multi_audio audio output
0xffffffff8abd66a0    557  waiting   cvar      0xffffffff8aa3b788    - 120  0xffffffff88569000  506  Audio Mixer control
0xffffffff8abd6bc0    559  waiting   cvar      0xffffffff8aa3b288    -  20  0xffffffff88578000  478  _BMediaRoster_
0xffffffff8abd5220    563  waiting   sem       2946                  - 104  0xffffffff8856e000  452  Extended Ps/2 Mouse 1 watcher
0xffffffff8abd4d00    564  waiting   sem       2951                  - 104  0xffffffff8857d000  452  AT Keyboard 1 watcher
0xffffffff8abd3da0    569  waiting   sem       2975                  - 120  0xffffffff88591000  506  Yeah baby, very shagadelic
0xffffffff8abd3360    574  waiting   cvar      0xffffffff8ac1e588    -  10  0xffffffff88582000  574  Terminal
0xffffffff8abd2e40    576  waiting   cvar      0xffffffff8ac1e488    -  15  0xffffffff88587000  429  a:574:x-vnd.Haiku-Terminal
0xffffffff8abd47e0    577  waiting   cvar      0xffffffff8aa7e388    -  15  0xffffffff88596000  429  w:574:Terminal : work-1.0.0j: p
0xffffffff8abd5740    578  waiting   cvar      0xffffffff8a9bdd20    -  10  0xffffffff8859b000  578  bash
0xffffffff8abd5c60    580  waiting   cvar      0xffffffff885a9c60    -  10  0xffffffff885a5000  574  PtyReader
0xffffffff8abd3880    581  waiting   sem       3057                  -  15  0xffffffff885aa000  574  EscParse
0xffffffff8abd6180    582  waiting   cvar      0xffffffff8aa7e588    -  15  0xffffffff885af000  574  w>Terminal : work-1.0.0j: pytho
0xffffffff8a7219b0    599  waiting   cvar      0xffffffff8a9ba120    -  10  0xffffffff897ba000  599  python
0xffffffff8ad6ebf0   9870  waiting   cvar      0xffffffff885ccdb8    -  10  0xffffffff885c8000  427  job runner
0xffffffff8abd0540  22315  waiting   cvar      0xffffffff8a9b7920    -  10  0xffffffff885cd00022315  bash
0xffffffff8abd0020  22321  ready     -                               -  10  0xffffffff885f000022321  unmount

comment:6 by bonefish, 10 years ago

sc 22321 ?

comment:7 by kallisti5, 10 years ago

sc 22321:

kdebug> sc 22321
stack trace for thread 22321 "unmount"
    kernel stack: 0xffffffff885f0000 to 0xffffffff885f5000
      user stack: 0x00007f85e7dc7000 to 0x00007f85e8dc7000
frame                       caller             <image>:function + offset
 0 ffffffff885f4be0 (+ 128) ffffffff8008e764   <kernel_x86_64> reschedule(int) + 0xb48
 1 ffffffff885f4c60 (+  32) ffffffff8008eea3   <kernel_x86_64> scheduler_reschedule + 0x6c
 2 ffffffff885f4c80 (+  32) ffffffff801332e1   <kernel_x86_64> x86_hardware_interrupt + 0xb0
 3 ffffffff885f4ca0 (+  16) ffffffff8012c12e   <kernel_x86_64> int_bottom + 0x45
kernel iframe at 0xffffffff885f4cb0 (end = 0xffffffff885f4d70)
 rax 0x1                   rbx 0xffffffff837192d0    rcx 0x22
 rdx 0x1                   rsi 0xffffffff801d31c0    rdi 0xffffffff801d31c0
 rbp 0xffffffff885f4db0     r8 0xffffffff885f4de0     r9 0xffffffff837151d0
 r10 0x161ed80284          r11 0x3246                r12 0xffffffff801d31b8
 r13 0x0                   r14 0xffffffff801d31c0    r15 0x1
 rip 0xffffffff8011867d    rsp 0xffffffff885f4d70 rflags 0x13202
 vector: 0xfb, error code: 0x0
 4 ffffffff885f4cb0 (+ 256) ffffffff8011867d   <kernel_x86_64> free_page(vm_page*, bool) + 0x1f6
 5 ffffffff885f4db0 (+  32) ffffffff8011cc6f   <kernel_x86_64> vm_page_free + 0x62
 6 ffffffff885f4dd0 (+  64) ffffffff801262c0   <kernel_x86_64> VMCache::Delete() + 0x27e
 7 ffffffff885f4e10 (+  64) ffffffff8012559e   <kernel_x86_64> VMCache::Unlock(bool) + 0xe4
 8 ffffffff885f4e50 (+  32) ffffffff800e277e   <kernel_x86_64> free_vnode(vnode*, bool) + 0x132
 9 ffffffff885f4e70 (+ 112) ffffffff800e8d2c   <kernel_x86_64> fs_unmount(char*, int, unsigned int, bool) + 0x333
10 ffffffff885f4ee0 (+  80) ffffffff800ec9a2   <kernel_x86_64> _user_unmount + 0x6f
11 ffffffff885f4f30 (+  16) ffffffff8012c3a1   <kernel_x86_64> x86_64_syscall_entry + 0xf5
user iframe at 0xffffffff885f4f40 (end = 0xffffffff885f5000)
 rax 0x61                  rbx 0x7f85e8dc76c0        rcx 0x161ed7ff64
 rdx 0x1                   rsi 0x0                   rdi 0x7f85e8dc76c0
 rbp 0x7f85e8dc64b0         r8 0x80                   r9 0x2125eebac7c
 r10 0x161ed80284          r11 0x3246                r12 0x7f85e8dc7650
 r13 0x7f85e8dc76b8        r14 0x0                   r15 0x0
 rip 0x161ed7ff64          rsp 0x7f85e8dc64a8     rflags 0x3246
 vector: 0x63, error code: 0x0
12 ffffffff885f4f40 (+140215121155440) 000000161ed7ff64   <libroot.so> _kern_unmount + 0x0c
13 00007f85e8dc64b0 (+ 176) 000002125eebab94   <_APP_> main + 0xf4
14 00007f85e8dc6560 (+  48) 000002125eeba9d8   <_APP_> _start + 0x54
15 00007f85e8dc6590 (+  48) 00000090f455517b   </boot/system/runtime_loader@0x00000090f4546000> <unknown> + 0xf17b
16 00007f85e8dc65c0 (+   0) 00007f42357932c8   <commpage> commpage_thread_exit + 0x00

comment:8 by bonefish, 10 years ago

A pity, that we can't get the function arguments on x86-64. But I guess it is safe to assume that fs_read_info() and fs_unmount() are currently invoked for the same mount and that there's some kind of race condition.

comment:9 by kallisti5, 10 years ago

Platform: Allx86-64

I've figured out that you can get past the crash with two continues in kdl. (and everything seems to pick up where it left off)

Adjusting platform to x86_64 as it isn't seen on any other architectures.

comment:10 by korli, 10 years ago

I had a look at the code:

  • get_mount() acquires a read lock for sVnodeLock and a mutex lock for sMountMutex
  • inc_vnode_ref_count() requires sVnodeLock read locked and the vnode's lock, or sVnodeLock write locked.

My guess would be to add a AutoLocker<Vnode> nodeLocker(rootNode); here. Other questions are:

  • why we increment the refcount on mount->root_vnode and not rootNode.
  • what to do if the rootNode is unused after acquiring the lock.

comment:11 by korli, 10 years ago

I tested the following and the same crash occurs :(

--- a/src/system/kernel/fs/vfs.cpp
+++ b/src/system/kernel/fs/vfs.cpp
@@ -703,7 +703,8 @@ get_mount(dev_t id, struct fs_mount** _mount)
                return B_BUSY;
        }
 
-       inc_vnode_ref_count(mount->root_vnode);
+       AutoLocker<Vnode> vnodeLocker(rootNode);
+       inc_vnode_ref_count(rootNode);
        *_mount = mount;
        return B_OK;
 }

in reply to:  10 comment:12 by bonefish, 10 years ago

Replying to korli:

I had a look at the code:

  • get_mount() acquires a read lock for sVnodeLock and a mutex lock for sMountMutex
  • inc_vnode_ref_count() requires sVnodeLock read locked and the vnode's lock, or sVnodeLock write locked.

As the documentation says, an alternative is "ensuring that a reference to the node exists and remains in existence". As long as the mount isn't unmounted (fs_unmount()) it owns a reference to the root node. So, ensuring that the mount isn't unmounted would satisfy the condition. fs_unmount() checks the ref counts of all nodes (must be 0, respectively 1 for the root node) and then marks them busy. All while holding sVnodeLock write-locked (well, safe for the force unmount case, which I believe to be broken anyway).

So, by holding sVnodeLock read-locked get_mount() ensures that fs_unmounted() can't process the nodes. If it is already past that point, the root node check (not NULL, not busy, ref count > 0) is supposed to detect that. But it doesn't look like this can work. fs_unmount() doesn't set the root node to NULL (the root node field is NULL only during a short period in fs_mount()), but it just frees the nodes after releasing sVnodeLock. So the busy and ref count > 0 checks could already access freed memory.

Other questions are:

  • why we increment the refcount on mount->root_vnode and not rootNode.

It doesn't make a difference. The root_vnode field is immutable after fs_mount() sets it to non-NULL. For performance reasons one could change the check.

  • what to do if the rootNode is unused after acquiring the lock.

The lock doesn't need to be acquired. Besides, if the root node is unused, it is too late already, since it would be (or already has been) freed at any time.

I would change the root node check in get_mount() to first check whether the mount's unmounting flag is already set.

comment:13 by korli, 10 years ago

Resolution: fixed
Status: newclosed

Thanks for this in-depth explanation (which I took the liberty to quote). Tested OK and committed in hrev47340.

Note: See TracTickets for help on using tickets.