updatedb/mdadm caused a kernel panic?
Jan 16 04:02:03 centosbox syslogd 1.4.1: restart.
Jan 16 04:07:34 centosbox kernel: INFO: task updatedb:20771 blocked for more than 300 seconds.
Jan 16 04:07:34 centosbox kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 04:07:34 centosbox kernel: updatedb D F78BE050 6476 20771 20766 (NOTLB)
Jan 16 04:07:34 centosbox kernel: ecc25dd4 00000086 7741afc0 000eb176 f78fc2ac 00000001 f78be050 7750f200
Jan 16 04:07:34 centosbox kernel: 000eb176 000f4240 2081e57f 00266012 f78be174 f7d25000 2081fdc3 00266012
Jan 16 04:07:34 centosbox kernel: 00000002 00000000 00000001 00000000 c0419058 f7d25000 c06e9d80 f6e62dec
Jan 16 04:07:34 centosbox kernel: Call Trace:
Jan 16 04:07:34 centosbox kernel: [<c0419058>] __wake_up+0x2a/0x3d
Jan 16 04:07:34 centosbox kernel: [<c0623e66>] io_schedule+0x3b/0x64
Jan 16 04:07:34 centosbox kernel: [<c04604e5>] sync_page+0x0/0x3b
Jan 16 04:07:34 centosbox kernel: [<c046051d>] sync_page+0x38/0x3b
Jan 16 04:07:34 centosbox kernel: [<c0623f7e>] __wait_on_bit_lock+0x2a/0x52
Jan 16 04:07:34 centosbox kernel: [<c0460460>] __lock_page+0x52/0x59
Jan 16 04:07:34 centosbox kernel: [<c0435f50>] wake_bit_function+0x0/0x3c
Jan 16 04:07:34 centosbox kernel: [<c0467b3a>] truncate_inode_pages_range+0x20b/0x260
Jan 16 04:07:34 centosbox kernel: [<f8c698d3>] journal_stop+0x208/0x213 [jbd]
Jan 16 04:07:34 centosbox kernel: [<c0467b98>] truncate_inode_pages+0x9/0xd
Jan 16 04:07:34 centosbox kernel: [<f8ca5a1e>] ext3_delete_inode+0x13/0xba [ext3]
Jan 16 04:07:34 centosbox kernel: [<f8ca5a0b>] ext3_delete_inode+0x0/0xba [ext3]
Jan 16 04:07:34 centosbox kernel: [<c0498dda>] generic_delete_inode+0x91/0xfe
Jan 16 04:07:34 centosbox kernel: [<c04988cc>] iput+0x67/0x69
Jan 16 04:07:34 centosbox kernel: [<c0496351>] d_kill+0x19/0x32
Jan 16 04:07:34 centosbox kernel: [<c049743a>] dput+0x148/0x155
Jan 16 04:07:34 centosbox kernel: [<c048fc5c>] sys_renameat+0x15f/0x1af
Jan 16 04:07:34 centosbox kernel: [<c04ea832>] _atomic_dec_and_lock+0x2a/0x44
Jan 16 04:07:34 centosbox kernel: [<c0453864>] audit_syscall_entry+0x160/0x192
Jan 16 04:07:34 centosbox kernel: [<c048fcbd>] sys_rename+0x11/0x15
Jan 16 04:07:34 centosbox kernel: [<c06271d7>] syscall_call+0x7/0xb
Jan 16 04:07:34 centosbox kernel: =======================
Jan 16 04:10:45 centosbox openvpn[6864]: MANAGEMENT: Client connected from 127.0.0.1:50005
Jan 16 04:10:45 centosbox openvpn[6864]: MANAGEMENT: Client disconnected
Jan 16 04:12:34 centosbox kernel: INFO: task updatedb:20771 blocked for more than 300 seconds.
Jan 16 04:12:34 centosbox kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 04:12:34 centosbox kernel: updatedb D F78BE050 6476 20771 20766 (NOTLB)
Jan 16 04:12:34 centosbox kernel: ecc25dd4 00000086 7741afc0 000eb176 f78fc2ac 00000001 f78be050 7750f200
Jan 16 04:12:34 centosbox kernel: 000eb176 000f4240 2081e57f 00266012 f78be174 f7d25000 2081fdc3 00266012
Jan 16 04:12:34 centosbox kernel: 00000002 00000000 00000001 00000000 c0419058 f7d25000 c06e9d80 f6e62dec
Jan 16 04:12:34 centosbox kernel: Call Trace:
Jan 16 04:12:34 centosbox kernel: [<c0419058>] __wake_up+0x2a/0x3d
Jan 16 04:12:34 centosbox kernel: [<c0623e66>] io_schedule+0x3b/0x64
Jan 16 04:12:34 centosbox kernel: [<c04604e5>] sync_page+0x0/0x3b
Jan 16 04:12:34 centosbox kernel: [<c046051d>] sync_page+0x38/0x3b
Jan 16 04:12:34 centosbox kernel: [<c0623f7e>] __wait_on_bit_lock+0x2a/0x52
Jan 16 04:12:34 centosbox kernel: [<c0460460>] __lock_page+0x52/0x59
Jan 16 04:12:34 centosbox kernel: [<c0435f50>] wake_bit_function+0x0/0x3c
Jan 16 04:12:34 centosbox kernel: [<c0467b3a>] truncate_inode_pages_range+0x20b/0x260
Jan 16 04:12:34 centosbox kernel: [<f8c698d3>] journal_stop+0x208/0x213 [jbd]
Jan 16 04:12:34 centosbox kernel: [<c0467b98>] truncate_inode_pages+0x9/0xd
Jan 16 04:12:34 centosbox kernel: [<f8ca5a0b>] ext3_delete_inode+0x0/0xba [ext3]
Jan 16 04:12:34 centosbox kernel: [<c0498dda>] generic_delete_inode+0x91/0xfe
Jan 16 04:12:34 centosbox kernel: [<c04988cc>] iput+0x67/0x69
Jan 16 04:12:34 centosbox kernel: [<c0496351>] d_kill+0x19/0x32
Jan 16 04:12:34 centosbox kernel: [<c049743a>] dput+0x148/0x155
Jan 16 04:12:34 centosbox kernel: [<c048fc5c>] sys_renameat+0x15f/0x1af
Jan 16 04:12:34 centosbox kernel: [<c04ea832>] _atomic_dec_and_lock+0x2a/0x44
Jan 16 04:12:34 centosbox kernel: [<c0453864>] audit_syscall_entry+0x160/0x192
Jan 16 04:12:34 centosbox kernel: [<c048fcbd>] sys_rename+0x11/0x15
Jan 16 04:12:34 centosbox kernel: [<c06271d7>] syscall_call+0x7/0xb
Jan 16 04:12:34 centosbox kernel: =======================
Jan 16 04:17:34 centosbox kernel: INFO: task updatedb:20771 blocked for more than 300 seconds.
Jan 16 04:17:34 centosbox kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 04:17:34 centosbox kernel: updatedb D F78BE050 6476 20771 20766 (NOTLB)
Jan 16 04:17:34 centosbox kernel: ecc25dd4 00000086 7741afc0 000eb176 f78fc2ac 00000001 f78be050 7750f200
Jan 16 04:17:34 centosbox kernel: 000eb176 000f4240 2081e57f 00266012 f78be174 f7d25000 2081fdc3 00266012
Jan 16 04:17:34 centosbox kernel: 00000002 00000000 00000001 00000000 c0419058 f7d25000 c06e9d80 f6e62dec
Jan 16 04:17:34 centosbox kernel: Call Trace:
Jan 16 04:17:34 centosbox kernel: [<c0419058>] __wake_up+0x2a/0x3d
Jan 16 04:17:34 centosbox kernel: [<c0623e66>] io_schedule+0x3b/0x64
Jan 16 04:17:34 centosbox kernel: [<c04604e5>] sync_page+0x0/0x3b
Jan 16 04:17:34 centosbox kernel: [<c046051d>] sync_page+0x38/0x3b
Jan 16 04:17:34 centosbox kernel: [<c0623f7e>] __wait_on_bit_lock+0x2a/0x52
Jan 16 04:17:34 centosbox kernel: [<c0460460>] __lock_page+0x52/0x59
Jan 16 04:17:34 centosbox kernel: [<c0435f50>] wake_bit_function+0x0/0x3c
Jan 16 04:17:34 centosbox kernel: [<c0467b3a>] truncate_inode_pages_range+0x20b/0x260
Jan 16 04:17:34 centosbox kernel: [<f8c698d3>] journal_stop+0x208/0x213 [jbd]
Jan 16 04:17:34 centosbox kernel: [<c0467b98>] truncate_inode_pages+0x9/0xd
Jan 16 04:17:34 centosbox kernel: [<f8ca5a1e>] ext3_delete_inode+0x13/0xba [ext3]
Jan 16 04:17:34 centosbox kernel: [<f8ca5a0b>] ext3_delete_inode+0x0/0xba [ext3]
Jan 16 04:17:34 centosbox kernel: [<c0498dda>] generic_delete_inode+0x91/0xfe
Jan 16 04:17:34 centosbox kernel: [<c04988cc>] iput+0x67/0x69
Jan 16 04:17:34 centosbox kernel: [<c0496351>] d_kill+0x19/0x32
Jan 16 04:17:34 centosbox kernel: [<c049743a>] dput+0x148/0x155
Jan 16 04:17:34 centosbox kernel: [<c048fc5c>] sys_renameat+0x15f/0x1af
Jan 16 04:17:34 centosbox kernel: [<c04ea832>] _atomic_dec_and_lock+0x2a/0x44
Jan 16 04:17:34 centosbox kernel: [<c0453864>] audit_syscall_entry+0x160/0x192
Jan 16 04:17:34 centosbox kernel: [<c048fcbd>] sys_rename+0x11/0x15
Jan 16 04:17:34 centosbox kernel: [<c06271d7>] syscall_call+0x7/0xb
Jan 16 04:17:34 centosbox kernel: =======================
Jan 16 04:22:01 centosbox kernel: md: syncing RAID array md1
Jan 16 04:22:01 centosbox kernel: md: minimum _guaranteed_ reconstruction speed: 1000 KB/sec/disc.
Jan 16 04:22:01 centosbox kernel: md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for reconstruction.
Jan 16 04:22:01 centosbox kernel: md: using 128k window, over a total of 30716160 blocks.
Jan 16 04:22:34 centosbox kernel: INFO: task updatedb:20771 blocked for more than 300 seconds.
Jan 16 04:22:34 centosbox kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 04:22:34 centosbox kernel: updatedb D F78BE050 6476 20771 20766 (NOTLB)
Jan 16 04:22:34 centosbox kernel: ecc25dd4 00000086 7741afc0 000eb176 f78fc2ac 00000001 f78be050 7750f200
Jan 16 04:22:34 centosbox kernel: 000eb176 000f4240 2081e57f 00266012 f78be174 f7d25000 2081fdc3 00266012
Jan 16 04:22:34 centosbox kernel: Call Trace:
Jan 16 04:22:34 centosbox kernel: [<c0419058>] __wake_up+0x2a/0x3d
Jan 16 04:22:34 centosbox kernel: [<c0623e66>] io_schedule+0x3b/0x64
Jan 16 04:22:34 centosbox kernel: [<c04604e5>] sync_page+0x0/0x3b
Jan 16 04:22:34 centosbox kernel: [<c046051d>] sync_page+0x38/0x3b
Jan 16 04:22:34 centosbox kernel: [<c0623f7e>] __wait_on_bit_lock+0x2a/0x52
Jan 16 04:22:34 centosbox kernel: [<c0460460>] __lock_page+0x52/0x59
Jan 16 04:22:34 centosbox kernel: [<c0435f50>] wake_bit_function+0x0/0x3c
Jan 16 04:22:34 centosbox kernel: [<c0467b3a>] truncate_inode_pages_range+0x20b/0x260
Jan 16 04:22:35 centosbox kernel: [<f8c698d3>] journal_stop+0x208/0x213 [jbd]
Jan 16 04:22:35 centosbox kernel: [<c0467b98>] truncate_inode_pages+0x9/0xd
Jan 16 04:22:35 centosbox kernel: [<f8ca5a1e>] ext3_delete_inode+0x13/0xba [ext3]
Jan 16 04:22:36 centosbox kernel: [<f8ca5a0b>] ext3_delete_inode+0x0/0xba [ext3]
Jan 16 04:22:36 centosbox kernel: [<c0498dda>] generic_delete_inode+0x91/0xfe
Jan 16 04:22:36 centosbox kernel: [<c04988cc>] iput+0x67/0x69
Jan 16 04:22:36 centosbox kernel: [<c0496351>] d_kill+0x19/0x32
Jan 16 04:22:37 centosbox kernel: [<c049743a>] dput+0x148/0x155
Jan 16 04:22:37 centosbox kernel: [<c048fc5c>] sys_renameat+0x15f/0x1af
Jan 16 04:22:38 centosbox kernel: [<c04ea832>] _atomic_dec_and_lock+0x2a/0x44
Jan 16 04:22:38 centosbox kernel: [<c0453864>] audit_syscall_entry+0x160/0x192
Jan 16 04:22:38 centosbox kernel: [<c048fcbd>] sys_rename+0x11/0x15
Jan 16 04:22:38 centosbox kernel: [<c06271d7>] syscall_call+0x7/0xb
Jan 16 04:22:39 centosbox kernel: =======================
Jan 16 04:27:34 centosbox kernel: INFO: task updatedb:20771 blocked for more than 300 seconds.
Jan 16 04:27:34 centosbox kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 04:27:34 centosbox kernel: updatedb D F78BE050 6476 20771 20766 (NOTLB)
Jan 16 04:27:34 centosbox kernel: ecc25dd4 00000086 7741afc0 000eb176 f78fc2ac 00000001 f78be050 7750f200
Jan 16 04:27:34 centosbox kernel: 000eb176 000f4240 2081e57f 00266012 f78be174 f7d25000 2081fdc3 00266012
Jan 16 04:27:34 centosbox kernel: 00000002 00000000 00000001 00000000 c0419058 f7d25000 c06e9d80 f6e62dec
Jan 16 04:27:34 centosbox kernel: Call Trace:
Jan 16 04:27:34 centosbox kernel: [<c0419058>] __wake_up+0x2a/0x3d
Jan 16 04:27:34 centosbox kernel: [<c0623e66>] io_schedule+0x3b/0x64
Jan 16 04:27:34 centosbox kernel: [<c04604e5>] sync_page+0x0/0x3b
Jan 16 04:27:34 centosbox kernel: [<c046051d>] sync_page+0x38/0x3b
Jan 16 04:27:34 centosbox kernel: [<c0623f7e>] __wait_on_bit_lock+0x2a/0x52
Jan 16 04:27:34 centosbox kernel: [<c0460460>] __lock_page+0x52/0x59
Jan 16 04:27:34 centosbox kernel: [<c0435f50>] wake_bit_function+0x0/0x3c
Jan 16 04:27:34 centosbox kernel: [<c0467b3a>] truncate_inode_pages_range+0x20b/0x260
Jan 16 04:27:34 centosbox kernel: [<f8c698d3>] journal_stop+0x208/0x213 [jbd]
Jan 16 04:27:34 centosbox kernel: [<c0467b98>] truncate_inode_pages+0x9/0xd
Jan 16 04:27:34 centosbox kernel: [<f8ca5a1e>] ext3_delete_inode+0x13/0xba [ext3]
Jan 16 04:27:34 centosbox kernel: [<f8ca5a0b>] ext3_delete_inode+0x0/0xba [ext3]
Jan 16 04:27:34 centosbox kernel: [<c0498dda>] generic_delete_inode+0x91/0xfe
Jan 16 04:27:35 centosbox kernel: [<c04988cc>] iput+0x67/0x69
Jan 16 04:27:35 centosbox kernel: [<c0496351>] d_kill+0x19/0x32
Jan 16 04:27:35 centosbox kernel: [<c049743a>] dput+0x148/0x155
Jan 16 04:27:36 centosbox kernel: [<c048fc5c>] sys_renameat+0x15f/0x1af
Jan 16 04:27:36 centosbox kernel: [<c04ea832>] _atomic_dec_and_lock+0x2a/0x44
Jan 16 04:27:36 centosbox kernel: [<c0453864>] audit_syscall_entry+0x160/0x192
Jan 16 04:27:36 centosbox kernel: [<c048fcbd>] sys_rename+0x11/0x15
Jan 16 04:27:36 centosbox kernel: [<c06271d7>] syscall_call+0x7/0xb
Jan 16 04:27:36 centosbox kernel: =======================
Jan 16 04:28:18 centosbox kernel: md: md1: sync done.
Jan 16 04:28:18 centosbox kernel: RAID1 conf printout:
Jan 16 04:28:18 centosbox kernel: --- wd:2 rd:2
Jan 16 04:28:18 centosbox kernel: disk 0, wo:0, o:1, dev:sda2
Jan 16 04:28:18 centosbox kernel: disk 1, wo:0, o:1, dev:sdb2
Tags:
updatedb, mdadm, kernel, centosbox, syslogd, restart, info, task, blocked, quot, echo, proc, sys, hung_task_timeout_secs, disables, notlb, ecc, dd, afc, eb, fc, ac, fdc, dec, __wake_up, io_schedule, sync_page, __wait_on_bit_lock, __lock_page, wake_bit_function, truncate_inode_pages_range, journal_stop, jbd, truncate_inode_pages, xd, ca, ext, _delete_inode, xba, dda, generic_delete_inode, xfe, cc, iput, d_kill, dput, sys_renameat, af, ea, _atomic_dec_and_lock, audit_syscall_entry, fcbd, sys_rename, syscall_call, xb, openvpn, disconnected, md, syncing, raid, array, _guaranteed_, reconstruction, kb, disc, maximum, idle, io, bandwidth, sync, conf, printout, wd, rd, disk, wo, dev, sda, sdb,