Details
-
Type: Bug
-
Status: Resolved
-
Priority: Major
-
Resolution: Fixed
-
Fix Version/s: OpenVZ-legacy
-
Component/s: Containers::Kernel
-
Security Level: Public
-
Environment:Centos 6, Kernels 2.6.32-042stab120.5 and 2.6.32-042stab117.14
vzctl version 4.9.4
ploop-1.15-1.x86_64
Description
Hello!
We have cycle node crash on unsuspend container with errors like
<4>[2359424.233248] ------------[ cut here ]------------
<2>[2359424.233487] kernel BUG at include/linux/cpt_context.h:242!
<4>[2359424.233724] invalid opcode: 0000 [#1] SMP
<4>[2359424.234081] last sysfs file: /sys/devices/virtual/block/ploop13588/ploop13588p1/stat
<4>[2359424.234474] CPU 43
<4>[2359424.234544] Modules linked in: xt_set ip_set nfnetlink kcare(U) sch_sfq cls_u32 sch_htb coretemp xt_hashlimit xt_TCPMSS xt_length ipt_addrtype nfsd xt_limit ipt_REJECT drbg ansi_cprng ctr twofish_x86_64 twofish_common camellia serpent blowfish cast5 des_generic cbc crypto_null xt_multiport aesni_intel ablk_helper cryptd lrw gf128mul glue_helper aes_x86_64 aes_generic xcbc rmd160 sha512_generic xt_conntrack vzethdev pio_kaio pio_nfs pio_direct pfmt_raw pfmt_ploop1 ploop simfs vziolimit vzdquota ip6t_REJECT ip6table_mangle vzevent configfs 8021q garp stp llc vznetdev bonding xt_comment iptable_filter ip6table_filter ip6_tables ipip tunnel4 nf_conntrack_ftp xt_recent vzrst vzcpt vzmon vzdev nfs lockd fscache auth_rpcgss nfs_acl sunrpc ipt_MASQUERADE iptable_raw iptable_mangle xt_connlimit ipt_REDIRECT xt_owner nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ipt_LOG xfrm_ipcomp xfrm4_mode_transport pppol2tp pppox xfrm6_mode_tunnel xfrm4_mode_tunnel esp6 ipv6 esp4 af_key arc4 ecb ppp_mppe ppp_deflate zlib_deflate ppp_async ppp_generic slhc crc_ccitt fuse iptable_nat nf_nat ip_tables nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 tun acpi_cpufreq freq_table mperf iTCO_wdt iTCO_vendor_support power_meter acpi_ipmi ipmi_si ipmi_msghandler sg ses enclosure sb_edac edac_core i2c_i801 lpc_ich mfd_core shpchp joydev ioatdma igb dca i2c_algo_bit i2c_core ptp pps_core ext4 jbd2 mbcache sd_mod crc_t10dif megaraid_sas xhci_hcd wmi dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_wait_scan]
<4>[2359424.248175]
<4>[2359424.248403] Pid: 603569, comm: init veid: 82584 Tainted: G W -- ------------ 2.6.32-042stab117.14 #1 042stab117_14 Supermicro Super Server/X10DRi-LN4+
<4>[2359424.249165] RIP: 0010:[<ffffffffa057174c>] [<ffffffffa057174c>] fixup_reg_data+0x34c/0x420 [vzrst]
<4>[2359424.249659] RSP: 0018:ffff883366c039a0 EFLAGS: 00010a02
<4>[2359424.249661] RAX: ffff8860049a0000 RBX: ffff885fd1a5b000 RCX: 0000000200000000
<4>[2359424.249664] RDX: 00000000081425f0 RSI: 0000000029aae542 RDI: 0000000058127305
<4>[2359424.249667] RBP: ffff883366c03a50 R08: 0000000000000003 R09: ffffea0110e2ad88
<4>[2359424.249669] R10: 0000000000000000 R11: 0000000000000000 R12: ffff883366c03fd8
<4>[2359424.249671] R13: 0000000000011000 R14: 0000000000001000 R15: 00000000ffffffff
<4>[2359424.249674] FS: 00007f2bdcbb2b20(0000) GS:ffff8831413c0000(0000) knlGS:0000000000000000
<4>[2359424.249677] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
<4>[2359424.249679] CR2: 00007f6d209eb000 CR3: 0000004fc3660000 CR4: 00000000001407e0
<4>[2359424.249682] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
<4>[2359424.249684] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
<4>[2359424.249689] Process init (pid: 603569, veid: 82584, threadinfo ffff883366c00000, task ffff8832658ec340)
<4>[2359424.249692] Stack:
<4>[2359424.249693] 0000000000000000 0000001000000000 ffff8832658ec340 ffff8832658ec340
<4>[2359424.249697] <d> 00000000081535f0 0000000000000010 00000000081425d0 ffff885fcfb04ac0
<4>[2359424.249701] <d> 00000000081425f0 00007ffffffff000 0000000000011020 0002002000001002
<4>[2359424.249705] Call Trace:
<4>[2359424.249724] [<ffffffffa0574f84>] rst_file+0x1e44/0x23e0 [vzrst]
<4>[2359424.249745] [<ffffffff810b0b80>] ? autoremove_wake_function+0x0/0x40
<4>[2359424.249756] [<ffffffffa05679ad>] ? file_pread+0x6d/0x160 [vzrst]
<4>[2359424.249764] [<ffffffff811a8410>] ? ub_slab_ptr+0x20/0x90
<4>[2359424.249772] [<ffffffff810c78d6>] ? ub_slab_charge+0xc6/0x120
<4>[2359424.249783] [<ffffffffa0577524>] rst_skb+0x654/0xac0 [vzrst]
<4>[2359424.249790] [<ffffffffa05679ad>] ? file_pread+0x6d/0x160 [vzrst]
<4>[2359424.249800] [<ffffffffa0567c65>] ? _rst_get_object+0x45/0x3e0 [vzrst]
<4>[2359424.249816] [<ffffffffa057906a>] rst_sockets_complete+0x26a/0x570 [vzrst]
<4>[2359424.249826] [<ffffffffa0566e17>] hook+0x1617/0x1af0 [vzrst]
<4>[2359424.249835] [<ffffffff810770c8>] ? finish_task_switch+0xc8/0x120
<4>[2359424.249842] [<ffffffffa0565800>] ? hook+0x0/0x1af0 [vzrst]
<4>[2359424.249849] [<ffffffffa05637ff>] child_rip+0xa/0x1b [vzrst]
<4>[2359424.249857] [<ffffffffa0565800>] ? hook+0x0/0x1af0 [vzrst]
<4>[2359424.249865] [<ffffffffa0565800>] ? hook+0x0/0x1af0 [vzrst]
<4>[2359424.249871] [<ffffffffa05637f5>] ? child_rip+0x0/0x1b [vzrst]
<4>[2359424.249874] Code: 80 a6 58 a0 31 c0 e8 64 48 d4 e0 48 98 4e 8d 2c 28 4c 89 6b 60 e9 80 fd ff ff b8 ea ff ff ff e9 54 ff ff ff 31 c0 e9 4d ff ff ff <0f> 0b 66 90 eb fc 8b 93 60 03 00 00 48 89 de 48 c7 c7 50 a6 58
<1>[2359424.249898] RIP [<ffffffffa057174c>] fixup_reg_data+0x34c/0x420 [vzrst]
<4>[2359424.249904] RSP <ffff883366c039a0>
on one container and it crashed few times until problem container not moved.
We can upload core dumps if it need and etc.
We have cycle node crash on unsuspend container with errors like
<4>[2359424.233248] ------------[ cut here ]------------
<2>[2359424.233487] kernel BUG at include/linux/cpt_context.h:242!
<4>[2359424.233724] invalid opcode: 0000 [#1] SMP
<4>[2359424.234081] last sysfs file: /sys/devices/virtual/block/ploop13588/ploop13588p1/stat
<4>[2359424.234474] CPU 43
<4>[2359424.234544] Modules linked in: xt_set ip_set nfnetlink kcare(U) sch_sfq cls_u32 sch_htb coretemp xt_hashlimit xt_TCPMSS xt_length ipt_addrtype nfsd xt_limit ipt_REJECT drbg ansi_cprng ctr twofish_x86_64 twofish_common camellia serpent blowfish cast5 des_generic cbc crypto_null xt_multiport aesni_intel ablk_helper cryptd lrw gf128mul glue_helper aes_x86_64 aes_generic xcbc rmd160 sha512_generic xt_conntrack vzethdev pio_kaio pio_nfs pio_direct pfmt_raw pfmt_ploop1 ploop simfs vziolimit vzdquota ip6t_REJECT ip6table_mangle vzevent configfs 8021q garp stp llc vznetdev bonding xt_comment iptable_filter ip6table_filter ip6_tables ipip tunnel4 nf_conntrack_ftp xt_recent vzrst vzcpt vzmon vzdev nfs lockd fscache auth_rpcgss nfs_acl sunrpc ipt_MASQUERADE iptable_raw iptable_mangle xt_connlimit ipt_REDIRECT xt_owner nf_conntrack_ipv6 nf_defrag_ipv6 xt_state ipt_LOG xfrm_ipcomp xfrm4_mode_transport pppol2tp pppox xfrm6_mode_tunnel xfrm4_mode_tunnel esp6 ipv6 esp4 af_key arc4 ecb ppp_mppe ppp_deflate zlib_deflate ppp_async ppp_generic slhc crc_ccitt fuse iptable_nat nf_nat ip_tables nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 tun acpi_cpufreq freq_table mperf iTCO_wdt iTCO_vendor_support power_meter acpi_ipmi ipmi_si ipmi_msghandler sg ses enclosure sb_edac edac_core i2c_i801 lpc_ich mfd_core shpchp joydev ioatdma igb dca i2c_algo_bit i2c_core ptp pps_core ext4 jbd2 mbcache sd_mod crc_t10dif megaraid_sas xhci_hcd wmi dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_wait_scan]
<4>[2359424.248175]
<4>[2359424.248403] Pid: 603569, comm: init veid: 82584 Tainted: G W -- ------------ 2.6.32-042stab117.14 #1 042stab117_14 Supermicro Super Server/X10DRi-LN4+
<4>[2359424.249165] RIP: 0010:[<ffffffffa057174c>] [<ffffffffa057174c>] fixup_reg_data+0x34c/0x420 [vzrst]
<4>[2359424.249659] RSP: 0018:ffff883366c039a0 EFLAGS: 00010a02
<4>[2359424.249661] RAX: ffff8860049a0000 RBX: ffff885fd1a5b000 RCX: 0000000200000000
<4>[2359424.249664] RDX: 00000000081425f0 RSI: 0000000029aae542 RDI: 0000000058127305
<4>[2359424.249667] RBP: ffff883366c03a50 R08: 0000000000000003 R09: ffffea0110e2ad88
<4>[2359424.249669] R10: 0000000000000000 R11: 0000000000000000 R12: ffff883366c03fd8
<4>[2359424.249671] R13: 0000000000011000 R14: 0000000000001000 R15: 00000000ffffffff
<4>[2359424.249674] FS: 00007f2bdcbb2b20(0000) GS:ffff8831413c0000(0000) knlGS:0000000000000000
<4>[2359424.249677] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
<4>[2359424.249679] CR2: 00007f6d209eb000 CR3: 0000004fc3660000 CR4: 00000000001407e0
<4>[2359424.249682] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
<4>[2359424.249684] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
<4>[2359424.249689] Process init (pid: 603569, veid: 82584, threadinfo ffff883366c00000, task ffff8832658ec340)
<4>[2359424.249692] Stack:
<4>[2359424.249693] 0000000000000000 0000001000000000 ffff8832658ec340 ffff8832658ec340
<4>[2359424.249697] <d> 00000000081535f0 0000000000000010 00000000081425d0 ffff885fcfb04ac0
<4>[2359424.249701] <d> 00000000081425f0 00007ffffffff000 0000000000011020 0002002000001002
<4>[2359424.249705] Call Trace:
<4>[2359424.249724] [<ffffffffa0574f84>] rst_file+0x1e44/0x23e0 [vzrst]
<4>[2359424.249745] [<ffffffff810b0b80>] ? autoremove_wake_function+0x0/0x40
<4>[2359424.249756] [<ffffffffa05679ad>] ? file_pread+0x6d/0x160 [vzrst]
<4>[2359424.249764] [<ffffffff811a8410>] ? ub_slab_ptr+0x20/0x90
<4>[2359424.249772] [<ffffffff810c78d6>] ? ub_slab_charge+0xc6/0x120
<4>[2359424.249783] [<ffffffffa0577524>] rst_skb+0x654/0xac0 [vzrst]
<4>[2359424.249790] [<ffffffffa05679ad>] ? file_pread+0x6d/0x160 [vzrst]
<4>[2359424.249800] [<ffffffffa0567c65>] ? _rst_get_object+0x45/0x3e0 [vzrst]
<4>[2359424.249816] [<ffffffffa057906a>] rst_sockets_complete+0x26a/0x570 [vzrst]
<4>[2359424.249826] [<ffffffffa0566e17>] hook+0x1617/0x1af0 [vzrst]
<4>[2359424.249835] [<ffffffff810770c8>] ? finish_task_switch+0xc8/0x120
<4>[2359424.249842] [<ffffffffa0565800>] ? hook+0x0/0x1af0 [vzrst]
<4>[2359424.249849] [<ffffffffa05637ff>] child_rip+0xa/0x1b [vzrst]
<4>[2359424.249857] [<ffffffffa0565800>] ? hook+0x0/0x1af0 [vzrst]
<4>[2359424.249865] [<ffffffffa0565800>] ? hook+0x0/0x1af0 [vzrst]
<4>[2359424.249871] [<ffffffffa05637f5>] ? child_rip+0x0/0x1b [vzrst]
<4>[2359424.249874] Code: 80 a6 58 a0 31 c0 e8 64 48 d4 e0 48 98 4e 8d 2c 28 4c 89 6b 60 e9 80 fd ff ff b8 ea ff ff ff e9 54 ff ff ff 31 c0 e9 4d ff ff ff <0f> 0b 66 90 eb fc 8b 93 60 03 00 00 48 89 de 48 c7 c7 50 a6 58
<1>[2359424.249898] RIP [<ffffffffa057174c>] fixup_reg_data+0x34c/0x420 [vzrst]
<4>[2359424.249904] RSP <ffff883366c039a0>
on one container and it crashed few times until problem container not moved.
We can upload core dumps if it need and etc.