From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qk0-f195.google.com (mail-qk0-f195.google.com [209.85.220.195]) by dpdk.org (Postfix) with ESMTP id 8DD7B7D19 for ; Fri, 5 Jan 2018 04:27:11 +0100 (CET) Received: by mail-qk0-f195.google.com with SMTP id w13so4496505qkb.5 for ; Thu, 04 Jan 2018 19:27:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=hD7odCEV0Oi3VSOB4i1jX8ZkluLELiYgjdSGrII9+xc=; b=qem/xHN1AKVO5YB1Sc6TaPqJwuvIvEoH7C0aQ4+XyxcsILK/VON0LYiUf8lNWjs0YY WQ3m3cmH7p9fgOWQi3Kl9cYyvMHA98CaQunD7UAJqfBocxx8qRm78273JCA/wrfpwlJZ KT/YrPVpZhlaxV+9994UGLqEcWFa5rPU7tkhAySZ9gr+FbnL3BBGBgd7KNpXjvFHMhC6 WZWiBOYHWNtdCa7GQgZf+vrysDgC3dQddoMOGlViQFNhmFqell8SjcwFiRHFmf/pMnRa iBdX9GrAJa8fYqilltRpLJNzBbRjaZgGgSUmGQmCGvMhG/CQk+PyBBAhScxilslaw0f8 CZ6g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=hD7odCEV0Oi3VSOB4i1jX8ZkluLELiYgjdSGrII9+xc=; b=kDwiTm0avYsG5nKiJET4qw1f/WEAyCxZ6wpNOvG1Xgsy1bF2FtSm/OPrbgBmhQR+Em La9nUeEflY1zNXogOt2BBqGk5+iYlD61gjk2Vf3OAI3tr1+AB16PmYOaIa3wjF+kmHKt yla4W+zU28UqjEHj1IU0FhUV/nfL3gB0Umu3zN4oZvO5zwDEckRDpVjbgonMW4DEbFln 8vri1ibqwpCeSW4FGcZm8ICRspvoQ4a4+LP5Ghy7mKvtpMJAuoI0W6nL01xADsMLXnb+ kQjtSL90wJk7Ts9V8j2Zt2xhkh5B74726AMeSmZWODtzlw4iA4J9Q/wSMV7WAhe7CuK6 7oPQ== X-Gm-Message-State: AKwxytdMc52XwKOdVqoW7iN/dQXefGZbAwpwZsXIGnsJP1vOtFeNrVja 8Sf7qppI+4+33JzjKW90CBTv0G4XXwaZ2nHXdZ7UMA== X-Google-Smtp-Source: ACJfBovRfhHAjYocJer0u1iACfXwhcmq3TZd3PAzTdbgikxSkdCR7oGIBRg2ofpw/E5y+J2i0iIahdhZH28LXanx1Ak= X-Received: by 10.55.156.149 with SMTP id f143mr2510457qke.173.1515122830625; Thu, 04 Jan 2018 19:27:10 -0800 (PST) MIME-Version: 1.0 Received: by 10.140.23.165 with HTTP; Thu, 4 Jan 2018 19:27:09 -0800 (PST) In-Reply-To: References: From: Sam Date: Fri, 5 Jan 2018 11:27:09 +0800 Message-ID: To: dev@dpdk.org, ovs-dev@openvswitch.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-dev] [sriov] [ixgbevf] We have to down PF and VF port to reconfig a port? X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 05 Jan 2018 03:27:11 -0000 This is kernel ixgbevf error log: Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865542] ------------[ cut here ]------------ Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865556] WARNING: at net/sched/sch_generic.c:297 dev_watchdog+0x276/0x280() Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865558] NETDEV WATCHDOG: enp1s16f1 (ixgbevf): transmit queue 0 timed out Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865559] Modules linked in: nbd iptable_mangle iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_con ntrack iptable_filter vhost_net vhost macvtap macvlan ixgbevf(OE) igb_uio(OE) udp_diag unix_diag af_packet_diag netlink_diag tun uio tcp_diag inet_diag bonding ext4 m bcache jbd2 intel_powerclamp coretemp kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ipmi_devintf sg iTCO_wdt iTCO_vendor_support dcdbas pcspkr mei_me mei lpc_ich sb_edac edac_core ipmi_si wmi shpchp ipmi_msghandler acpi_pad acpi_power_meter ip_tables xfs libcrc32c sd_mod crc_t10dif mgag200 drm_kms_helper syscopyarea crct10dif_pclmul sysfillrect crct10dif_common sysimgblt crc32c_intel fb_sys_fops ttm ahci drm ixgbe libahci igb l ibata i2c_algo_bit mdio ptp i2c_core megaraid_sas pps_core dca fjes [last unloaded: nbd] Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865619] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G OE ------------ 3.10.0-514.10.2.el7.mt20170307.x86_64 #1 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865622] Hardware name: Dell Inc. PowerEdge R720/068CDY, BIOS 2.5.2 01/28/2015 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865624] ffff880fff803d88 d4910673413043a2 ffff880fff803d40 ffffffff8168648f Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865626] ffff880fff803d78 ffffffff81085940 0000000000000000 ffff880ffdfd0000 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865629] ffff880ffdfd1940 0000000000000008 0000000000000000 ffff880fff803de0 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865631] Call Trace: Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865632] [] dump_stack+0x19/0x1b Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865639] [] warn_slowpath_common+0x70/0xb0 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865641] [] warn_slowpath_fmt+0x5c/0x80 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865644] [] dev_watchdog+0x276/0x280 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865647] [] ? dev_graft_qdisc+0x80/0x80 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865650] [] call_timer_fn+0x36/0x110 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865652] [] ? dev_graft_qdisc+0x80/0x80 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865655] [] run_timer_softirq+0x237/0x340 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865658] [] __do_softirq+0xef/0x280 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865661] [] call_softirq+0x1c/0x30 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865664] [] do_softirq+0x65/0xa0 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865667] [] irq_exit+0x115/0x120 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865670] [] smp_apic_timer_interrupt+0x45/0x60 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865672] [] apic_timer_interrupt+0x6d/0x80 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865673] [] ? hrtimer_start_range_ns+0x1c6/0x390 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865679] [] ? cpuidle_enter_state+0x52/0xc0 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865681] [] ? cpuidle_enter_state+0x48/0xc0 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865683] [] cpuidle_idle_call+0xd9/0x210 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865687] [] arch_cpu_idle+0xe/0x30 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865690] [] cpu_startup_entry+0x245/0x290 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865694] [] rest_init+0x77/0x80 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865698] [] start_kernel+0x42c/0x44d Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865700] [] ? repair_env_string+0x5c/0x5c Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865703] [] ? early_idt_handlers+0x120/0x120 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865705] [] x86_64_start_reservations+0x2a/0x2c Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865708] [] x86_64_start_kernel+0x152/0x175 Dec 27 20:23:22 yf-mos-test-net14 kernel: [103406.865709] ---[ end trace 45a157a1f564e086 ]--- 2017-12-27 10:54 GMT+08:00 Sam : > > 2017-12-27 10:42 GMT+08:00 Sam : > >> Hi all, >> >> I'm running OVS-DPDK on a two netdevice server(eth0 and eth1), and I use >> sriov to make one VF and one PF on each netdevice, as bellow. Please omit >> eth2 and eth3. Then two VF port(enp1s16 and enp1s16f1) combine into linux >> bond1 port as management port, two PF port(0000:01:00.0 and 0000:01:00.1) >> combine into OVS-DPDK bond port(mode 4) as dataplane port. >> >> [root@yf-mos-test-net14 ~]# /usr/local/share/openvswitch/scripts/dpdk_nic_bind >>> --status >>> Network devices using DPDK-compatible driver >>> ============================================ >>> 0000:01:00.0 'Ethernet Controller 10-Gigabit X540-AT2' drv=igb_uio >>> unused=ixgbe >>> 0000:01:00.1 'Ethernet Controller 10-Gigabit X540-AT2' drv=igb_uio >>> unused=ixgbe >>> Network devices using kernel driver >>> =================================== >>> 0000:01:10.0 'X540 Ethernet Controller Virtual Function' if=enp1s16 >>> drv=ixgbevf unused=igb_uio >>> 0000:01:10.1 'X540 Ethernet Controller Virtual Function' if=enp1s16f1 >>> drv=ixgbevf unused=igb_uio >>> 0000:08:00.0 'I350 Gigabit Network Connection' if=eth2 drv=igb >>> unused=igb_uio >>> 0000:08:00.1 'I350 Gigabit Network Connection' if=eth3 drv=igb >>> unused=igb_uio >>> Other network devices >>> ===================== >>> >> >> >> I change OVS-DPDK code, and use command to stop OVS-DPDK bond port and >> its slaves, and then change its txconf and rxconf, and then start up them. >> But the kernel report "Detected Tx Unit Hang ..." and no packets could go >> through OVS-DPDK bond port and linux bond port, but use command to show >> OVS-DPDK port and linux bond port, >> > all status is NOT OK(LACP status not OK, I don't if it's because link > error or LACP packet process error). > >> >> But when I stop linux bond port first, and then do the same process as >> above, no error report and packets could go through OVS-DPDK bond port and >> linux bond port. >> >> So what's this problem and how to fix it ? Thank you~ >> > I want to make OVS-DPDK bond port could be stop/start/reconfig while > running. If others use some other way to do this, could you share it, thank > you~ >