Uploaded image for project: 'OpenVZ'
  1. OpenVZ
  2. OVZ-6816

Container network and vzctl enter fail on 042stab120.3

    XMLWordPrintable

    Details

      Description

      >Description of problem:

      Previous kernel (2.6.32-042stab117.16) was working ok, but when booted into 2.6.32-042stab120.3 container does not start properly. Network is not working correctly (external primary ip of container is not pingable, its configured as veth) and `vzctl ente 28r` can not enter to container with `enter into CT 28 failed` message after some timeout. Also, there is dmesg messages appearing:

      ```
      kernel: [ 241.252961] INFO: task vzctl:1905 blocked for more than 120 seconds.
      kernel: [ 241.252965] Not tainted 2.6.32-042stab120.3 #1
      kernel: [ 241.252967] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
      kernel: [ 241.252973] vzctl D ffff880337936ec0 0 1905 1 0 0x00000080
      kernel: [ 241.252981] ffff88033b477bc8 0000000000000082 0000000000000000 0000000000800000
      kernel: [ 241.252985] ffff88033b50f0c0 ffff88033b477be0 ffffffff8108252a ffff880300000000
      kernel: [ 241.252989] ffff880300000000 0000000000000082 ffff88033b477b78 ffffffff810b5071
      kernel: [ 241.252993] Call Trace:
      kernel: [ 241.253008] [<ffffffff8108252a>] ? do_fork_pid+0x13a/0x4d0
      kernel: [ 241.253013] [<ffffffff810b5071>] ? lock_hrtimer_base+0x31/0x60
      kernel: [ 241.253019] [<ffffffff81555595>] schedule_timeout+0x215/0x2e0
      kernel: [ 241.253024] [<ffffffff8107b284>] ? enqueue_task_fair+0xa4/0x1f0
      kernel: [ 241.253027] [<ffffffff81038569>] ? native_smp_send_reschedule+0x49/0x60
      kernel: [ 241.253032] [<ffffffff815552f4>] wait_for_completion+0xe4/0x120
      kernel: [ 241.253036] [<ffffffff8106d420>] ? default_wake_function+0x0/0x20
      kernel: [ 241.253049] [<ffffffffa0753379>] vps_rst_restore_tree+0x259/0x2c0 [vzrst]
      kernel: [ 241.253055] [<ffffffffa075561c>] vps_rst_undump+0x18c/0x210 [vzrst]
      kernel: [ 241.253059] [<ffffffffa07524c1>] rst_ioctl+0x681/0x790 [vzrst]
      kernel: [ 241.253064] [<ffffffffa0751e40>] ? rst_ioctl+0x0/0x790 [vzrst]
      kernel: [ 241.253068] [<ffffffff8123276e>] proc_reg_unlocked_ioctl+0xde/0x100
      kernel: [ 241.253074] [<ffffffff811d6882>] vfs_ioctl+0x22/0xa0
      kernel: [ 241.253078] [<ffffffff810c90bb>] ? ub_memory_uncharge+0x5b/0x90
      kernel: [ 241.253081] [<ffffffff811d6d66>] do_vfs_ioctl+0x3c6/0x5b0
      kernel: [ 241.253085] [<ffffffff811d6f9f>] sys_ioctl+0x4f/0x80
      kernel: [ 241.253089] [<ffffffff8110657e>] ? __audit_syscall_exit+0x25e/0x290
      kernel: [ 241.253092] [<ffffffff8100b1a2>] system_call_fastpath+0x16/0x1b
      kernel: [ 241.253095] INFO: task init:1918 blocked for more than 120 seconds.
      kernel: [ 241.253098] Not tainted 2.6.32-042stab120.3 #1
      kernel: [ 241.253099] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
      kernel: [ 241.253102] init D ffff88033b50f0c0 0 1918 1905 28 0x00000084
      kernel: [ 241.253106] ffff88033b513c70 0000000000000086 0000000000000000 0000000000800000
      kernel: [ 241.253109] ffff88033939cdc0 ffff88033b513c88 0000000823b9563c ffffffff00002e2e
      kernel: [ 241.253113] 0000000000000000 0000000000000000 00000000fffbf3b1 ffffffff810b5071
      kernel: [ 241.253117] Call Trace:
      kernel: [ 241.253119] [<ffffffff810b5071>] ? lock_hrtimer_base+0x31/0x60
      kernel: [ 241.253123] [<ffffffff81555595>] schedule_timeout+0x215/0x2e0
      kernel: [ 241.253126] [<ffffffff8107b284>] ? enqueue_task_fair+0xa4/0x1f0
      kernel: [ 241.253129] [<ffffffff81038569>] ? native_smp_send_reschedule+0x49/0x60
      kernel: [ 241.253133] [<ffffffff815552f4>] wait_for_completion+0xe4/0x120
      kernel: [ 241.253136] [<ffffffff8106d420>] ? default_wake_function+0x0/0x20
      kernel: [ 241.253141] [<ffffffffa0753680>] make_baby+0x2a0/0x420 [vzrst]
      kernel: [ 241.253145] [<ffffffffa0754326>] hook+0xb26/0x1af0 [vzrst]
      kernel: [ 241.253148] [<ffffffff8108010e>] ? __mmdrop+0x4e/0x80
      kernel: [ 241.253151] [<ffffffff81076eb8>] ? finish_task_switch+0xc8/0x120
      kernel: [ 241.253156] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253160] [<ffffffffa07517ff>] child_rip+0xa/0x1b [vzrst]
      kernel: [ 241.253165] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253169] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253177] [<ffffffffa07517f5>] ? child_rip+0x0/0x1b [vzrst]
      kernel: [ 241.253207] INFO: task udevd:2317 blocked for more than 120 seconds.
      kernel: [ 241.253210] Not tainted 2.6.32-042stab120.3 #1
      kernel: [ 241.253211] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
      kernel: [ 241.253214] udevd D ffff8803364f1000 0 2317 1918 28 0x00000084
      kernel: [ 241.253218] ffff880339c4fe70 0000000000000086 0000000000000000 ffff88033b513df8
      kernel: [ 241.253221] 0000000000000001 ffff88033b513e10 000000076171a416 0000000000000000
      kernel: [ 241.253225] ffff880339c4fdf0 0000000000000000 00000000fffbe6f0 ffffffff81061909
      kernel: [ 241.253229] Call Trace:
      kernel: [ 241.253234] [<ffffffff81061909>] ? __wake_up_common+0x59/0x90
      kernel: [ 241.253239] [<ffffffffa075391b>] hook+0x11b/0x1af0 [vzrst]
      kernel: [ 241.253244] [<ffffffff8115a26e>] ? free_pages+0x3e/0x40
      kernel: [ 241.253246] [<ffffffff8108010e>] ? __mmdrop+0x4e/0x80
      kernel: [ 241.253249] [<ffffffff81076eb8>] ? finish_task_switch+0xc8/0x120
      kernel: [ 241.253254] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253258] [<ffffffffa07517ff>] child_rip+0xa/0x1b [vzrst]
      kernel: [ 241.253264] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253272] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253278] [<ffffffffa07517f5>] ? child_rip+0x0/0x1b [vzrst]
      kernel: [ 241.253283] INFO: task dbus-daemon:2318 blocked for more than 120 seconds.
      kernel: [ 241.253288] Not tainted 2.6.32-042stab120.3 #1
      kernel: [ 241.253292] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
      kernel: [ 241.253296] dbus-daemon D ffff8803379dc4c0 0 2318 1918 28 0x00000084
      kernel: [ 241.253304] ffff880339c53e70 0000000000000082 0000000000000000 ffff88033b513df8
      kernel: [ 241.253326] 0000000000000001 ffff88033b513e10 000000076517b16f 0000000000000000
      kernel: [ 241.253334] ffff880339c53df0 0000000000000000 00000000fffbe6f0 ffffffff81061909
      kernel: [ 241.253341] Call Trace:
      kernel: [ 241.253345] [<ffffffff81061909>] ? __wake_up_common+0x59/0x90
      kernel: [ 241.253352] [<ffffffffa075391b>] hook+0x11b/0x1af0 [vzrst]
      kernel: [ 241.253358] [<ffffffff81076eb8>] ? finish_task_switch+0xc8/0x120
      kernel: [ 241.253364] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253371] [<ffffffffa07517ff>] child_rip+0xa/0x1b [vzrst]
      kernel: [ 241.253382] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253395] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253401] [<ffffffffa07517f5>] ? child_rip+0x0/0x1b [vzrst]
      kernel: [ 241.253406] INFO: task nscd:2319 blocked for more than 120 seconds.
      kernel: [ 241.253410] Not tainted 2.6.32-042stab120.3 #1
      kernel: [ 241.253416] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
      kernel: [ 241.253421] nscd D ffff8803379ec400 0 2319 1918 28 0x00000080
      kernel: [ 241.253429] ffff880339c6be70 0000000000000082 00000000000001c8 ffff88033b513df8
      kernel: [ 241.253437] 0000000000000001 ffff88033b513e10 0000000000000000 0000000000000000
      kernel: [ 241.253447] ffff880339c6bdf0 ffffffff8106d432 ffff880339c6be40 ffffffff81061909
      kernel: [ 241.253455] Call Trace:
      kernel: [ 241.253496] [<ffffffff8106d432>] ? default_wake_function+0x12/0x20
      kernel: [ 241.253502] [<ffffffff81061909>] ? __wake_up_common+0x59/0x90
      kernel: [ 241.253509] [<ffffffffa075391b>] hook+0x11b/0x1af0 [vzrst]
      kernel: [ 241.253515] [<ffffffff81076eb8>] ? finish_task_switch+0xc8/0x120
      kernel: [ 241.253523] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253529] [<ffffffffa07517ff>] child_rip+0xa/0x1b [vzrst]
      kernel: [ 241.253535] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253542] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253548] [<ffffffffa07517f5>] ? child_rip+0x0/0x1b [vzrst]
      kernel: [ 241.253553] INFO: task nscd:2321 blocked for more than 120 seconds.
      kernel: [ 241.253557] Not tainted 2.6.32-042stab120.3 #1
      kernel: [ 241.253560] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
      kernel: [ 241.253564] nscd D ffff88033b6c7200 0 2321 1918 28 0x00000084
      kernel: [ 241.253572] ffff880339c6fe70 0000000000000082 0000000000000000 ffff880339c6bdf8
      kernel: [ 241.253580] 0000000000000001 ffff880339c6be10 0000000770f3600e 0000000000000000
      kernel: [ 241.253588] ffff880339c6fdf0 0000000000000000 00000000fffbe81d ffffffff81061909
      kernel: [ 241.253598] Call Trace:
      kernel: [ 241.253602] [<ffffffff81061909>] ? __wake_up_common+0x59/0x90
      kernel: [ 241.253609] [<ffffffffa075391b>] hook+0x11b/0x1af0 [vzrst]
      kernel: [ 241.253615] [<ffffffff8115a26e>] ? free_pages+0x3e/0x40
      kernel: [ 241.253620] [<ffffffff8108010e>] ? __mmdrop+0x4e/0x80
      kernel: [ 241.253626] [<ffffffff81076eb8>] ? finish_task_switch+0xc8/0x120
      kernel: [ 241.253632] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253638] [<ffffffffa07517ff>] child_rip+0xa/0x1b [vzrst]
      kernel: [ 241.253645] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253651] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253660] [<ffffffffa07517f5>] ? child_rip+0x0/0x1b [vzrst]
      kernel: [ 241.253665] INFO: task nscd:2322 blocked for more than 120 seconds.
      kernel: [ 241.253669] Not tainted 2.6.32-042stab120.3 #1
      kernel: [ 241.253672] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
      kernel: [ 241.253678] nscd D ffff8803378b2480 0 2322 1918 28 0x00000080
      kernel: [ 241.253685] ffff880339c73e70 0000000000000082 0000000000000000 ffff880339c6bdf8
      kernel: [ 241.253696] 0000000000000001 ffff880339c6be10 0000000770f5da95 0000000000000000
      kernel: [ 241.253702] ffff880339c73df0 0000000000000000 00000000fffbe81d ffffffff81061909
      kernel: [ 241.253709] Call Trace:
      kernel: [ 241.253714] [<ffffffff81061909>] ? __wake_up_common+0x59/0x90
      kernel: [ 241.253722] [<ffffffffa075391b>] hook+0x11b/0x1af0 [vzrst]
      kernel: [ 241.253728] [<ffffffff81076eb8>] ? finish_task_switch+0xc8/0x120
      kernel: [ 241.253737] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253743] [<ffffffffa07517ff>] child_rip+0xa/0x1b [vzrst]
      kernel: [ 241.253750] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253757] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253762] [<ffffffffa07517f5>] ? child_rip+0x0/0x1b [vzrst]
      kernel: [ 241.253767] INFO: task nscd:2323 blocked for more than 120 seconds.
      kernel: [ 241.253772] Not tainted 2.6.32-042stab120.3 #1
      kernel: [ 241.253776] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
      kernel: [ 241.253780] nscd D ffff880335a0c940 0 2323 1918 28 0x00000080
      kernel: [ 241.253787] ffff880339c77e70 0000000000000082 0000000000000000 ffff880339c6bdf8
      kernel: [ 241.253795] 0000000000000001 ffff880339c6be10 0000000770f7ad1a 0000000000000000
      kernel: [ 241.253802] ffff880339c77df0 0000000000000000 00000000fffbe81d ffffffff81061909
      kernel: [ 241.253812] Call Trace:
      kernel: [ 241.253817] [<ffffffff81061909>] ? __wake_up_common+0x59/0x90
      kernel: [ 241.253824] [<ffffffffa075391b>] hook+0x11b/0x1af0 [vzrst]
      kernel: [ 241.253830] [<ffffffff81076eb8>] ? finish_task_switch+0xc8/0x120
      kernel: [ 241.253836] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253842] [<ffffffffa07517ff>] child_rip+0xa/0x1b [vzrst]
      kernel: [ 241.253848] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253854] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253860] [<ffffffffa07517f5>] ? child_rip+0x0/0x1b [vzrst]
      kernel: [ 241.253865] INFO: task nscd:2324 blocked for more than 120 seconds.
      kernel: [ 241.253870] Not tainted 2.6.32-042stab120.3 #1
      kernel: [ 241.253873] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
      kernel: [ 241.253878] nscd D ffff880334a7a140 0 2324 1918 28 0x00000080
      kernel: [ 241.253884] ffff880339c7be70 0000000000000082 0000000000000000 ffff880339c6bdf8
      kernel: [ 241.253899] 0000000000000001 ffff880339c6be10 0000000770f920f8 0000000000000000
      kernel: [ 241.253906] ffff880339c7bdf0 0000000000000000 00000000fffbe81d ffffffff81061909
      kernel: [ 241.253919] Call Trace:
      kernel: [ 241.253923] [<ffffffff81061909>] ? __wake_up_common+0x59/0x90
      kernel: [ 241.253930] [<ffffffffa075391b>] hook+0x11b/0x1af0 [vzrst]
      kernel: [ 241.253935] [<ffffffff81076eb8>] ? finish_task_switch+0xc8/0x120
      kernel: [ 241.253941] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253948] [<ffffffffa07517ff>] child_rip+0xa/0x1b [vzrst]
      kernel: [ 241.253954] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253960] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.253966] [<ffffffffa07517f5>] ? child_rip+0x0/0x1b [vzrst]
      kernel: [ 241.253970] INFO: task nscd:2325 blocked for more than 120 seconds.
      kernel: [ 241.253974] Not tainted 2.6.32-042stab120.3 #1
      kernel: [ 241.253980] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
      kernel: [ 241.253984] nscd D ffff880335870640 0 2325 1918 28 0x00000080
      kernel: [ 241.253988] ffff880339c7fe70 0000000000000082 0000000000000000 ffff880339c6bdf8
      kernel: [ 241.253991] 0000000000000001 ffff880339c6be10 0000000770fb789e 0000000000000000
      kernel: [ 241.253995] ffff880339c7fdf0 0000000000000000 00000000fffbe81d ffffffff81061909
      kernel: [ 241.253999] Call Trace:
      kernel: [ 241.254001] [<ffffffff81061909>] ? __wake_up_common+0x59/0x90
      kernel: [ 241.254009] [<ffffffffa075391b>] hook+0x11b/0x1af0 [vzrst]
      kernel: [ 241.254014] [<ffffffff81076eb8>] ? finish_task_switch+0xc8/0x120
      kernel: [ 241.254021] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.254027] [<ffffffffa07517ff>] child_rip+0xa/0x1b [vzrst]
      kernel: [ 241.254034] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.254039] [<ffffffffa0753800>] ? hook+0x0/0x1af0 [vzrst]
      kernel: [ 241.254043] [<ffffffffa07517f5>] ? child_rip+0x0/0x1b [vzrst]
      ```
      There is also periodically:
      ```
      vmsvc[1716]: [ warning] [guestinfo] Failed to get nic info.
      ```

      >Host OS:

      Centos 6.8

      >Guest OS:

      Centos 5.11

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              khorenko Konstantin Khorenko
              Reporter:
              do1@yandex.ru Donets
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: