From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qk0-f194.google.com (mail-qk0-f194.google.com [209.85.220.194]) by dpdk.org (Postfix) with ESMTP id 7B4F91B343 for ; Tue, 30 Jan 2018 03:19:10 +0100 (CET) Received: by mail-qk0-f194.google.com with SMTP id t134so8268256qke.5 for ; Mon, 29 Jan 2018 18:19:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=4JrA7oyWOpf+WJxtTzcI/Z/qRZQ482f3B1/m7qzAW0A=; b=d5tU4cgzSqZf6gduoTMU+UghnOtNGAdeAZqHuLHBzzuglqlwuMicqQfwMQH4DLwX25 5pAJH7WsqO5xS3qCwTLDt1vQCpcqmDIC0G0/Fl+2U4ayEZC34odVakJdDyLn2mzRPYB5 R2lRW7VLE2AOyDzvkAxCS31pVegLff1/qka6LZzjHWKtdzQKtDBYjqFdecwC3lB6+znp 86iJ4n840EiV76ZZoU5u1f5GfUPUI5SlLMzQlmtfM6SPLsium5D0qC/lBI9nZrkqAFIo 492IsStkDn4eX4bIezVXjkfnocaLEf24RyrYTN6Y0b+MTNS0dLW0pf3OPneWQYArRAqi ipPw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=4JrA7oyWOpf+WJxtTzcI/Z/qRZQ482f3B1/m7qzAW0A=; b=TiHFqcgYhD9rNIacpfWsldj9akn2DooGsxdBLggP4dLJGgts92wAQpsTYCd7NxquXH AlIS6B2N8HA3SkRAtPqrfoo1ZRDc9EXWyuySaKVth0fMYqLSGHixFQZEX0wh7m51FXkL tkeMST92LEITM27jtJKha0ru4w4YDYZAForyvydmpd/gLedei41HtyHZpX5lVjpH7Utu qf77AJWO21To21VPsEXm4YCJohC/c9q9IQ3s87dSqa2fz2VNUsAIVKN7cPCaeGgrmDYF Kv3GbJPRqlSu81CM596y4jox+LKIC7HwGrSMD7C7r3XPd3xR9xzqEzsJzfmvfWCh06WB KBsw== X-Gm-Message-State: AKwxytee5PdHzWt4eu5R8aO+OIiNwq7tHevOV6AvB2/dMaT93LquY1nG 6+sj3X8B8nAS9ZU/PADYAJWx2tKx1wO8tFXGPT9rWw== X-Google-Smtp-Source: AH8x225Lz2MTpapEtNhvJSYOo622zMaza6TKi1EXaTRlCwSt50aqlxBHkHP7a3i2RYSAr93bTvSuZ8q/3gSB9lsOVwY= X-Received: by 10.55.191.69 with SMTP id p66mr40420262qkf.315.1517278749668; Mon, 29 Jan 2018 18:19:09 -0800 (PST) MIME-Version: 1.0 Received: by 10.140.92.179 with HTTP; Mon, 29 Jan 2018 18:19:09 -0800 (PST) From: Sam Date: Tue, 30 Jan 2018 10:19:09 +0800 Message-ID: To: dev@dpdk.org, ovs-dev@openvswitch.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-dev] kernel crash bug caused by ixgbevf kernel module of centos-3.10.0-229.20.1.el7 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 30 Jan 2018 02:19:10 -0000 I found a bug about ixgbevf kernel module in centos-3.10.0-229.20.1.el7. And this bug is also in 3.10.0-514.10.2.el7. How to produce this bug: use SRIOV first, then add lots of network traffic on vf port, and then ifdow/ifup vf port, after many times, this bug happens. BUG: [308026.586026] ixgbevf 0000:01:10.0: NIC Link is Down [308026.586037] ixgbevf 0000:01:10.1: NIC Link is Down [308026.683724] bonding: bond1: link status definitely down for interface enp1s16, disabling it [308026.683728] bonding: bond1: now running without any active interface ! [308026.683729] bonding: bond1: link status definitely down for interface enp1s16f1, disabling it [308028.266060] bonding: bond1: Removing slave enp1s16. [308028.266135] bonding: bond1: Warning: the permanent HWaddr of enp1s16 - 4e:cd:a6:59:26:2c - is still in use by bond1. Set the HWaddr of enp1s16 to a different address to avoid conflicts. [308028.266139] bonding: bond1: releasing active interface enp1s16 [308028.359872] BUG: unable to handle kernel NULL pointer dereference at 0000000000000008 [308028.361319] IP: [] ixgbevf_alloc_rx_buffers+0x60/0x160 [ixgbevf] [308028.362049] PGD 0 [308028.362777] Oops: 0000 [#1] SMP [308028.363481] Modules linked in: ixgbevf(OF) igb_uio(OF) iptable_mangle iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_filter nbd(OF) vhost_net macvtap macvlan udp_diag unix_diag af_packet_diag netlink_diag tun tcp_diag inet_diag uio bonding ext4 mbcache jbd2 intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel mgag200 aesni_intel iTCO_wdt lrw dcdbas gf128mul syscopyarea sysfillrect iTCO_vendor_support glue_helper sysimgblt ablk_helper ttm cryptd ipmi_devintf igb ixgbe drm_kms_helper drm i2c_algo_bit ptp i2c_core ipmi_si pps_core sg mdio ipmi_msghandler dca sb_edac mei_me mei shpchp lpc_ich pcspkr mfd_core edac_core wmi acpi_power_meter acpi_pad ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_common ahci libahci [308028.368487] libata megaraid_sas [last unloaded: ixgbevf] [308028.369345] CPU: 0 PID: 21971 Comm: kworker/0:1 Tainted: GF W O-------------- 3.10.0-229.el7.x86_64 #1 [308028.370226] Hardware name: Dell Inc. PowerEdge R720/068CDY, BIOS 2.5.2 01/28/2015 [308028.371132] Workqueue: events ixgbevf_service_task [ixgbevf] [308028.372038] task: ffff88022b0dad80 ti: ffff88010905c000 task.ti: ffff88010905c000 [308028.372965] RIP: 0010:[] [] ixgbevf_alloc_rx_buffers+0x60/0x160 [ixgbevf] [308028.373949] RSP: 0018:ffff88010905fd10 EFLAGS: 00010287 [308028.374900] RAX: 0000000000000200 RBX: 0000000000000000 RCX: 0000000000000000 [308028.375895] RDX: 0000000000000000 RSI: 00000000000001ff RDI: ffff8800b82061c0 [308028.376841] RBP: ffff88010905fd48 R08: 0000000000000282 R09: 0000000000000001 [308028.377780] R10: 0000000000000004 R11: 0000000000000005 R12: 0000000000000000 [308028.378702] R13: 00000000fffffe00 R14: 00000000000001ff R15: ffff8800b82061c0 [308028.379628] FS: 0000000000000000(0000) GS:ffff882f7fa00000(0000) knlGS:0000000000000000 [308028.380540] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [308028.381471] CR2: 0000000000000008 CR3: 000000000190a000 CR4: 00000000001427f0 [308028.382376] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [308028.383291] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [308028.384180] Stack: [308028.385051] ffff8832d1b58bc0 ffff88010905fd28 ffff8832d1b588c0 0000000000000009 [308028.385933] ffff8832d1b58bc0 ffff8800b82061c0 0000000000001028 ffff88010905fdb8 [308028.386804] ffffffffa0496ba3 ffff8832d1b58e58 000000022b1e2000 00000000819e2108 [308028.387693] Call Trace: [308028.388520] [] ixgbevf_configure+0x5d3/0x7d0 [ixgbevf] [308028.389363] [] ixgbevf_reinit_locked+0x65/0x90 [ixgbevf] [308028.390213] [] ixgbevf_service_task+0x324/0x420 [ixgbevf] [308028.391043] [] process_one_work+0x17b/0x470 [308028.391888] [] worker_thread+0x11b/0x400 [308028.392728] [] ? rescuer_thread+0x400/0x400 [308028.393576] [] kthread+0xcf/0xe0 [308028.394434] [] ? kthread_create_on_node+0x140/0x140 [308028.395339] [] ret_from_fork+0x7c/0xb0 [308028.396205] [] ? kthread_create_on_node+0x140/0x140 [308028.397068] Code: c5 41 89 f6 49 89 c4 48 8d 14 40 48 8b 47 28 49 c1 e4 04 4c 03 67 20 48 8d 1c d0 0f b7 47 4c 41 29 c5 66 0f 1f 84 00 00 00 00 00 <48> 83 7b 08 00 74 73 8b 53 10 48 8b 03 48 01 d0 49 83 c4 10 48 [308028.398959] RIP [] ixgbevf_alloc_rx_buffers+0x60/0x160 [ixgbevf] [308028.399910] RSP [308028.400846] CR2: 0000000000000008