From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qt0-f171.google.com (mail-qt0-f171.google.com [209.85.216.171]) by dpdk.org (Postfix) with ESMTP id 6CAEA1B740 for ; Wed, 31 Jan 2018 09:59:14 +0100 (CET) Received: by mail-qt0-f171.google.com with SMTP id z11so20898613qtm.3 for ; Wed, 31 Jan 2018 00:59:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=DiR6s3oI6bNJR2h8UUinepNiICqU1DnzMUreBec+4LM=; b=inb63zt5nfWj8o1b6IZ4H3cSDigqqMWLdxjkoI1fP3IoPj2oizq6FOuF0nDB47chCL BnNfKLUMUxKIWV7OGln74pW9cBp9jFGTeIztsMubjwsPUuPU43N9qfHMsbVATNveVb5n XVYKaYqOlcKyd45GPOMNwu0C0tvrB5aUhbvNWIJ9t2tIXNgnT6ASB1fawBLbi2MzgTZ3 +fKCujbnHQg1zk6lydMCgCJg2bHpam+XWW+xxzcKxsE9hUREIcF6zDaAPoOY/hxZoEua eYVqTX9ypcOLeCpcUUmJShO0yCAjmcFiksldrTOk3f1QAOnZy5BgNCC9qWNtAui+u5p+ A88Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=DiR6s3oI6bNJR2h8UUinepNiICqU1DnzMUreBec+4LM=; b=QN2V+wbdiUQqhyD0JIuEAQCIQV8J3kCEise1jPb9/OKgyt5tuCCmWN3MlJ9Hcp0Tta S6rZo8z3CwCVNVFolxqM5miOvN0uPqzzn38TgC7myOC9WTAeoEVRpp91l70Ut4VzUvQR wRhf4stKp47vZeUdsOxE9UOpjvviDBISbMD90tY7dwyFSTsUVELQ7pXROQ/wi6qjD9X0 9dLRyoQRAsZdIVmY3hWV7hCWCvOZzusKTETQehupxZiM4hhAr0c92Lm5O9XjjApr2m1X pUMk2YZEBF0kkiRQFz3fdHMC1hOaZ63XY73c7/U6xAiHjx3YbHNC/ErywHokCUUSPjbh Qpaw== X-Gm-Message-State: AKwxyte/Y1WW+zyRY72fR1tfwY9tiWF07K2wkRDg/iyH/XQ9wEvoQMz5 bHu5defyHH8sKmxRAf8vQ3XueG/zk9PsgVAmTwhtfw== X-Google-Smtp-Source: AH8x224EG8mS1WUraC6vzeAeklutMq0pVVKc+cAPMRCeWg/1MFF6DupJZAlDbPYSBhZtRkbuXdS1FUVua11HirBOvZU= X-Received: by 10.200.43.193 with SMTP id n1mr49507682qtn.20.1517389153564; Wed, 31 Jan 2018 00:59:13 -0800 (PST) MIME-Version: 1.0 Received: by 10.140.92.179 with HTTP; Wed, 31 Jan 2018 00:59:13 -0800 (PST) In-Reply-To: References: From: Sam Date: Wed, 31 Jan 2018 16:59:13 +0800 Message-ID: To: dev@dpdk.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-dev] Kernel Crash bug of ixgbevf kernel module in "Intel(R) 10GbE PCI Express Virtual Function Driver Version: 4.0.3 Release: 1" X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Jan 2018 08:59:14 -0000 I don't know if it's because ixgbevf driver call "ixgbevf_close()" by "dev_close()" without rtnl_lock(). Refer to log "bond1: Releasing active interface enp1s16f1", bond is releasing its slaves, then call "dev_close()" function without rtnl_lock(). At the same time, "ixgbevf_service_task()" loop to "ixgbevf_reinit_locked()" function. Then two thread operate same address, then bug happens. 2018-01-31 15:44 GMT+08:00 Sam : > wrong order, actually is this: > 4. stop bond1(ifdown bond1), stop dpdkb2(rte_eth_dev_stop), sleep 5 second, > start dpdkb2(rte_eth_dev_start), start bond1(ifup bond1). > > 2018-01-31 15:34 GMT+08:00 Sam : > >> Hi all, >> >> There is a kernel crash bug of ixgbevf kernel module in "Intel(R) 10GbE >> PCI Express Virtual Function Driver Version: 4.0.3 Release: 1" >> >> How to produce: >> 1. Use SRIOV, like this: >> sudo /usr/local/share/openvswitch/scripts/dpdk_nic_bind --status >> >> Network devices using DPDK-compatible driver >> ============================================ >> 0000:01:00.0 'Ethernet Controller 10-Gigabit X540-AT2' drv=igb_uio >> unused=ixgbe >> 0000:01:00.1 'Ethernet Controller 10-Gigabit X540-AT2' drv=igb_uio >> unused=ixgbe >> >> Network devices using kernel driver >> =================================== >> 0000:01:10.0 'X540 Ethernet Controller Virtual Function' if=enp1s16 >> drv=ixgbevf unused=bak,igb_uio >> 0000:01:10.1 'X540 Ethernet Controller Virtual Function' if=enp1s16f1 >> drv=ixgbevf unused=bak,igb_uio >> 0000:08:00.0 'I350 Gigabit Network Connection' if=eth2 drv=igb >> unused=igb_uio >> 0000:08:00.1 'I350 Gigabit Network Connection' if=eth3 drv=igb >> unused=igb_uio >> >> Other network devices >> ===================== >> >> >> 2. bond enp1s16 and enp1s16f1 into bond1, by /etc/sysconfig/ifcfg-bond1. >> 3. bond 0000:01:00.0 and 0000:01:00.1 in ovs-dpdk into dpdkb2, by dpdk >> api. >> 4. stop dpdkb2(rte_eth_dev_stop), stop bond1(ifdown bond1), sleep 5 >> second, start bond1(ifup bond1), start dpdkb2(rte_eth_dev_start). >> >> After several times, bug happens, attachment is vmcore-dmesg.txt >> > >