From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 2B5A7A04F0 for ; Sat, 30 Nov 2019 16:55:08 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 5E7E62BD3; Sat, 30 Nov 2019 16:55:07 +0100 (CET) Received: from mail-wm1-f51.google.com (mail-wm1-f51.google.com [209.85.128.51]) by dpdk.org (Postfix) with ESMTP id 671FA1DBD for ; Sat, 30 Nov 2019 16:55:06 +0100 (CET) Received: by mail-wm1-f51.google.com with SMTP id u8so2543074wmu.0 for ; Sat, 30 Nov 2019 07:55:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=mIxhvabNh0tD1cKtYPIEjkaPXTlSLO+57bqvYRVWaNI=; b=jCgBGfneT2rGyjJAk3UoD1U/osn7dXr0LZM9KTMM6mbBdgWe9txJSCSaOqjVbSm9xY xuHEIxbpyL/13VhWhm0pFViE5k1kWTMvbh32P0rX8kFqp421ylSrl1mNbXO4Nl3WbxcK aYv7MrA4fK7ndsXQgYGaIx+RTinnYvZiq8f2KzFtl9btjwoTNMrO23XIxYrrRDZFR8Ya Q6QQoRh3WNW/rEedetA8PLEu5QHMt+bKotQf7qZiFsVCVsecPJMLa/LCzmSBUgxNjNdx SuuOO+7Ym/n6b9Cffkyzgauqr5Rkv1gsDRYA3lqI3ZDjZrf+RorUHy+2uMvQC652vdQT khzA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=mIxhvabNh0tD1cKtYPIEjkaPXTlSLO+57bqvYRVWaNI=; b=ACDKeSupAZln1O1Rwv8HLiPyO53StTVKWayPBcN+jVnST0G4YdFSpBGG6Kcsjjowdt z9sC+wSeh6IPAZEr1z5txmgmg9rF98lDqG4p4Umoa2WiCDUU/W66BmX5Sl8zEH+HTwWy ALgKSMGRTzrzoF/HfJLkgEwejEdNxmiCjj3PJFEtv3IsJbLw85JhEhrrRcAU8IeFjvYi pN5/cCU/GnvSnE6rGe51OMlYs9ecjLlp5VBKklPHhrtiD2WVvmYvE5Z9bUysF855of3Q SPn3HLXNTDUFdsNQHQUC4PU+pO8RXr9ghhfnrLh/uiXgxQt+PlV2lAivcZZsbkJkjuo8 onrQ== X-Gm-Message-State: APjAAAVQJ7d/lGVGbDZ9YfFR7Ze1loOIdvjYqMD5ohA4n5DZ+dYXePvn MhA6RHH0BYKkwRlCO+4wyRcBPt8UtxbQ5g9XoqaiGgk= X-Google-Smtp-Source: APXvYqxAMGx3+bGhEioG90Fikz3MK2szQFwb7RlOvU9b9JNisu8ZoglUfNJ5wfl0z0oVDD0/vQGPpMa/RY5in6uMGcg= X-Received: by 2002:a1c:6a09:: with SMTP id f9mr19987517wmc.15.1575129305837; Sat, 30 Nov 2019 07:55:05 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Laurent Dumont Date: Sat, 30 Nov 2019 10:54:53 -0500 Message-ID: To: "Greg O'Rawe" Cc: "users@dpdk.org" Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] Failover not working on X520 NIC with ixgbevf driver X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Can you show the VF settings on the hypervisor? "ip link show $SRIOV_INTERFACE_NAME"? We saw similar issue with X710 where the physical state wasn't properly passed from the actual PF to the VM VF. That meant that failover could not happen since the VM thought the link was still active. We had to change the "link-state" parameter on the two VF used by the VM. That said, it was without VPP but a VM with DPDK enabled. On Thu, Nov 28, 2019 at 6:52 PM Greg O'Rawe wrote: > I have the following setup: > > * Virtual environment with Openstack with Intel X520 NIC > > * Hypervisor using ixgbe driver > > * Virtual machine using ixgbevf driver (version 4.6.1) on Red Hat > Linux 7.6 running VPP and DPDK 17.11.4 > > * VM interfaces are bonded in active-standby mode on ingress and > egress > In normal state everything is fine, the bond interfaces are operational. > However when one of the physical interfaces on the hypervisor is brought > down then failover to the standby does not work. > > The second interface in each bond does become primary but original primary > is still reported as UP by VPP. The device stats reported by VPP change to > around maximum values and traffic no longer works through the bond > interfaces: > > Name Idx Link Hardware > BondEthernet0 5 up Slave-Idx: 1 2 > Ethernet address fa:16:3e:20:2c:ae > Ethernet Bonding > carrier up full duplex speed 1000 mtu 1500 > Mode 1 > rx queues 1, rx desc 1024, tx queues 1, tx desc 4096 > cpu socket 0 > > tx frames ok 8589934243 > tx bytes ok 137438924646 > rx frames ok 8589849574 > rx bytes ok 137433171720 > extended stats: > rx good packets 8589849574 > tx good packets 8589934243 > rx good bytes 137433171720 > tx good bytes 137438924646 > > BondEthernet1 6 up Slave-Idx: 3 4 > Ethernet address fa:16:3e:f2:3c:af > Ethernet Bonding > carrier up full duplex speed 1000 mtu 1500 > Mode 1 > rx queues 1, rx desc 1024, tx queues 1, tx desc 4096 > cpu socket 0 > > tx frames ok 8589934273 > tx bytes ok 137438926918 > rx frames ok 8589849579 > rx bytes ok 137433172132 > extended stats: > rx good packets 8589849579 > tx good packets 8589934273 > rx good bytes 137433172132 > tx good bytes 137438926918 > > device_0/6/0 1 slave device_0/6/0 > Ethernet address fa:16:3e:20:2c:ae > Intel 82599 VF > carrier up full duplex speed 1000 mtu 1500 > Slave UP > Slave State StandBy > rx queues 1, rx desc 1024, tx queues 1, tx desc 4096 > cpu socket 0 > > tx frames ok 4294966950 > tx bytes ok 68719448136 > rx frames ok 4294882284 > rx bytes ok 68713695344 > > device_0/7/0 2 slave device_0/7/0 > Ethernet address fa:16:3e:20:2c:ae > Intel 82599 VF > carrier up full duplex speed 1000 mtu 1500 > Slave UP > Slave State Primary > rx queues 1, rx desc 1024, tx queues 1, tx desc 4096 > cpu socket 0 > > tx frames ok 4294967293 > tx bytes ok 68719476510 > rx frames ok 4294967290 > rx bytes ok 68719476376 > > device_0/8/0 3 slave device_0/8/0 > Ethernet address fa:16:3e:f2:3c:af > Intel 82599 VF > carrier up full duplex speed 1000 mtu 1500 > Slave UP > Slave State StandBy > rx queues 1, rx desc 1024, tx queues 1, tx desc 4096 > cpu socket 0 > > tx frames ok 4294966980 > tx bytes ok 68719450408 > rx frames ok 4294882289 > rx bytes ok 68713695756 > > device_0/9/0 4 slave device_0/9/0 > Ethernet address fa:16:3e:f2:3c:af > Intel 82599 VF > carrier up full duplex speed 1000 mtu 1500 > Slave UP > Slave State Primary > rx queues 1, rx desc 1024, tx queues 1, tx desc 4096 > cpu socket 0 > > tx frames ok 4294967293 > tx bytes ok 68719476510 > rx frames ok 4294967290 > rx bytes ok 68719476376 > > There are no specific errors reported in the /var/log/messages files on > either the VM or the hypervisor machines. > > Any ideas on this issue? Is there a configuration problem, or possibly a > change in a later DPDK version which might be relevant? > > Thanks > > Greg O'Rawe > > > > > This message, including attachments, is CONFIDENTIAL. It may also be > privileged or otherwise protected by law. If you received this email by > mistake please let us know by reply and then delete it from your system; > you should not copy it or disclose its contents to anyone. All messages > sent to and from Enea may be monitored to ensure compliance with internal > policies and to protect our business. Emails are not secure and cannot be > guaranteed to be error free as they can be intercepted, a mended, lost or > destroyed, or contain viruses. The sender therefore does not accept > liability for any errors or omissions in the contents of this message, > which arise as a result of email transmission. Anyone who communicates with > us by email accepts these risks. >