* [dpdk-users] net/i40e VF state does not track PF state @ 2019-09-30 15:12 David Harton (dharton) 2019-09-30 15:52 ` Laurent Dumont 0 siblings, 1 reply; 7+ messages in thread From: David Harton (dharton) @ 2019-09-30 15:12 UTC (permalink / raw) To: users I'm using i40evf based interfaces using DPDK 18.11. The host is rhel 7.3 and the PF driver details are: ethtool -i enp9s0f1 driver: i40e version: 1.5.10-k firmware-version: 6.01 0x800036b8 0.385.33 expansion-rom-version: bus-info: 0000:09:00.1 supports-statistics: yes supports-test: yes supports-eeprom-access: yes supports-register-dump: yes supports-priv-flags: yes When the PF is shut the VFs are not showing a 'down' state. Is this a known issue? Any tips on how to debug? Thanks, Dave ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [dpdk-users] net/i40e VF state does not track PF state 2019-09-30 15:12 [dpdk-users] net/i40e VF state does not track PF state David Harton (dharton) @ 2019-09-30 15:52 ` Laurent Dumont 2019-09-30 16:14 ` David Harton (dharton) 0 siblings, 1 reply; 7+ messages in thread From: Laurent Dumont @ 2019-09-30 15:52 UTC (permalink / raw) To: David Harton (dharton); +Cc: users Hey David, From the compute, can you check if the VF "link-state" status is set to "auto"? That parameter is required for the physical state of the PF to be reflected by the VF. Thanks On Mon, Sep 30, 2019, 11:12 AM David Harton (dharton) <dharton@cisco.com> wrote: > I'm using i40evf based interfaces using DPDK 18.11. > > The host is rhel 7.3 and the PF driver details are: > ethtool -i enp9s0f1 > driver: i40e > version: 1.5.10-k > firmware-version: 6.01 0x800036b8 0.385.33 > expansion-rom-version: > bus-info: 0000:09:00.1 > supports-statistics: yes > supports-test: yes > supports-eeprom-access: yes > supports-register-dump: yes > supports-priv-flags: yes > > When the PF is shut the VFs are not showing a 'down' state. > > Is this a known issue? Any tips on how to debug? > > Thanks, > Dave > > ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [dpdk-users] net/i40e VF state does not track PF state 2019-09-30 15:52 ` Laurent Dumont @ 2019-09-30 16:14 ` David Harton (dharton) 2019-09-30 16:24 ` Laurent Dumont 0 siblings, 1 reply; 7+ messages in thread From: David Harton (dharton) @ 2019-09-30 16:14 UTC (permalink / raw) To: Laurent Dumont; +Cc: users Yes, the VFs are set to the default ‘link-state auto’: ip link show enp9s0f1 15: enp9s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 link/ether 90:e2:ba:ac:16:19 brd ff:ff:ff:ff:ff:ff vf 0 MAC 52:54:00:63:12:97, spoof checking on, link-state auto, trust off, query_rss off vf 1 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 2 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 3 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 4 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 5 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 6 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 7 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 8 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 9 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off > From: Laurent Dumont <laurentfdumont@gmail.com> > Sent: Monday, September 30, 2019 11:53 AM > To: David Harton (dharton) <dharton@cisco.com> > Cc: users@dpdk.org > Subject: Re: [dpdk-users] net/i40e VF state does not track PF state > > Hey David, > > From the compute, can you check if the VF "link-state" status is set to "auto"? That parameter is required for the physical > state of the PF to be reflected by the VF. > > Thanks > > > > > On Mon, Sep 30, 2019, 11:12 AM David Harton (dharton) <mailto:dharton@cisco.com> wrote: > > I'm using i40evf based interfaces using DPDK 18.11. > > > > The host is rhel 7.3 and the PF driver details are: > > ethtool -i enp9s0f1 > > driver: i40e > > version: 1.5.10-k > > firmware-version: 6.01 0x800036b8 0.385.33 > > expansion-rom-version: > > bus-info: 0000:09:00.1 > > supports-statistics: yes > > supports-test: yes > > supports-eeprom-access: yes > > supports-register-dump: yes > > supports-priv-flags: yes > > > > When the PF is shut the VFs are not showing a 'down' state. > > > > Is this a known issue? Any tips on how to debug? > > > > Thanks, > > Dave ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [dpdk-users] net/i40e VF state does not track PF state 2019-09-30 16:14 ` David Harton (dharton) @ 2019-09-30 16:24 ` Laurent Dumont 2019-09-30 16:32 ` David Harton (dharton) 0 siblings, 1 reply; 7+ messages in thread From: Laurent Dumont @ 2019-09-30 16:24 UTC (permalink / raw) To: David Harton (dharton); +Cc: users Hey David, Another possibility is that you are shutting down the PF through the compute with " ip link"? It seems similar to a behavior we saw with sriov port where the host OS seems to lose a portion of control over the nic. We could shutdown the port from the compute but we still saw the traffic being forwarded from the VF towards the TOR. You can try to physically shutdown the port from the TOR or unplugging the cable. We are running 7.6 hosts with the 2.3.2 driver. Thanks! On Mon, Sep 30, 2019, 12:14 PM David Harton (dharton) <dharton@cisco.com> wrote: > Yes, the VFs are set to the default ‘link-state auto’: > > ip link show enp9s0f1 > 15: enp9s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP > mode DEFAULT group default qlen 1000 > link/ether 90:e2:ba:ac:16:19 brd ff:ff:ff:ff:ff:ff > vf 0 MAC 52:54:00:63:12:97, spoof checking on, link-state auto, trust > off, query_rss off > vf 1 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 2 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 3 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 4 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 5 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 6 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 7 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 8 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 9 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > > > > From: Laurent Dumont <laurentfdumont@gmail.com> > > Sent: Monday, September 30, 2019 11:53 AM > > To: David Harton (dharton) <dharton@cisco.com> > > Cc: users@dpdk.org > > Subject: Re: [dpdk-users] net/i40e VF state does not track PF state > > > > Hey David, > > > > From the compute, can you check if the VF "link-state" status is set to > "auto"? That parameter is required for the physical > state of the PF to be > reflected by the VF. > > > > Thanks > > > > > > > > > On Mon, Sep 30, 2019, 11:12 AM David Harton (dharton) <mailto: > dharton@cisco.com> wrote: > > > I'm using i40evf based interfaces using DPDK 18.11. > > > > > > The host is rhel 7.3 and the PF driver details are: > > > ethtool -i enp9s0f1 > > > driver: i40e > > > version: 1.5.10-k > > > firmware-version: 6.01 0x800036b8 0.385.33 > > > expansion-rom-version: > > > bus-info: 0000:09:00.1 > > > supports-statistics: yes > > > supports-test: yes > > > supports-eeprom-access: yes > > > supports-register-dump: yes > > > supports-priv-flags: yes > > > > > > When the PF is shut the VFs are not showing a 'down' state. > > > > > > Is this a known issue? Any tips on how to debug? > > > > > > Thanks, > > > Dave > ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [dpdk-users] net/i40e VF state does not track PF state 2019-09-30 16:24 ` Laurent Dumont @ 2019-09-30 16:32 ` David Harton (dharton) 2019-10-03 1:10 ` Laurent Dumont 0 siblings, 1 reply; 7+ messages in thread From: David Harton (dharton) @ 2019-09-30 16:32 UTC (permalink / raw) To: Laurent Dumont; +Cc: users From: Laurent Dumont <laurentfdumont@gmail.com> Sent: Monday, September 30, 2019 12:25 PM To: David Harton (dharton) <dharton@cisco.com> Cc: users@dpdk.org Subject: Re: [dpdk-users] net/i40e VF state does not track PF state Hey David, Another possibility is that you are shutting down the PF through the compute with " ip link"? <dharton> Yes, but shouldn’t matter the VF state should follow the PF state. For example, if I shut a ixgbe PF the VFs go down. It seems similar to a behavior we saw with sriov port where the host OS seems to lose a portion of control over the nic. We could shutdown the port from the compute but we still saw the traffic being forwarded from the VF towards the TOR. You can try to physically shutdown the port from the TOR or unplugging the cable. We are running 7.6 hosts with the 2.3.2 driver. <dharton> I assume DPDK is packaged with that release...which version is it? Thanks, Dave Thanks! On Mon, Sep 30, 2019, 12:14 PM David Harton (dharton) <dharton@cisco.com<mailto:dharton@cisco.com>> wrote: Yes, the VFs are set to the default ‘link-state auto’: ip link show enp9s0f1 15: enp9s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 link/ether 90:e2:ba:ac:16:19 brd ff:ff:ff:ff:ff:ff vf 0 MAC 52:54:00:63:12:97, spoof checking on, link-state auto, trust off, query_rss off vf 1 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 2 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 3 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 4 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 5 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 6 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 7 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 8 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 9 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off > From: Laurent Dumont <laurentfdumont@gmail.com<mailto:laurentfdumont@gmail.com>> > Sent: Monday, September 30, 2019 11:53 AM > To: David Harton (dharton) <dharton@cisco.com<mailto:dharton@cisco.com>> > Cc: users@dpdk.org<mailto:users@dpdk.org> > Subject: Re: [dpdk-users] net/i40e VF state does not track PF state > > Hey David, > > From the compute, can you check if the VF "link-state" status is set to "auto"? That parameter is required for the physical > state of the PF to be reflected by the VF. > > Thanks > > > > > On Mon, Sep 30, 2019, 11:12 AM David Harton (dharton) <mailto:dharton@cisco.com<mailto:dharton@cisco.com>> wrote: > > I'm using i40evf based interfaces using DPDK 18.11. > > > > The host is rhel 7.3 and the PF driver details are: > > ethtool -i enp9s0f1 > > driver: i40e > > version: 1.5.10-k > > firmware-version: 6.01 0x800036b8 0.385.33 > > expansion-rom-version: > > bus-info: 0000:09:00.1 > > supports-statistics: yes > > supports-test: yes > > supports-eeprom-access: yes > > supports-register-dump: yes > > supports-priv-flags: yes > > > > When the PF is shut the VFs are not showing a 'down' state. > > > > Is this a known issue? Any tips on how to debug? > > > > Thanks, > > Dave ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [dpdk-users] net/i40e VF state does not track PF state 2019-09-30 16:32 ` David Harton (dharton) @ 2019-10-03 1:10 ` Laurent Dumont 2019-10-03 13:24 ` David Harton (dharton) 0 siblings, 1 reply; 7+ messages in thread From: Laurent Dumont @ 2019-10-03 1:10 UTC (permalink / raw) To: David Harton (dharton); +Cc: users Not sure for the DPDK behavior. If a non-dpdk VF is not shutdown, the other way around with DPDK would be surpring. I'll see if it's possible for us to test. Thanks On Mon, Sep 30, 2019 at 12:32 PM David Harton (dharton) <dharton@cisco.com> wrote: > > > > > *From:* Laurent Dumont <laurentfdumont@gmail.com> > *Sent:* Monday, September 30, 2019 12:25 PM > *To:* David Harton (dharton) <dharton@cisco.com> > *Cc:* users@dpdk.org > *Subject:* Re: [dpdk-users] net/i40e VF state does not track PF state > > > > Hey David, > > > > Another possibility is that you are shutting down the PF through the > compute with " ip link"? > > *<dharton> Yes, but shouldn’t matter the VF state should follow the PF > state. For example, if I shut a ixgbe PF the VFs go down.* > > > > It seems similar to a behavior we saw with sriov port where the host OS > seems to lose a portion of control over the nic. > > > > We could shutdown the port from the compute but we still saw the traffic > being forwarded from the VF towards the TOR. > > > > You can try to physically shutdown the port from the TOR or unplugging the > cable. > > > > We are running 7.6 hosts with the 2.3.2 driver. > > *<dharton> I assume DPDK is packaged with that release...which version is > it?* > > > > *Thanks,* > > *Dave* > > > > Thanks! > > > > > > > > On Mon, Sep 30, 2019, 12:14 PM David Harton (dharton) <dharton@cisco.com> > wrote: > > Yes, the VFs are set to the default ‘link-state auto’: > > ip link show enp9s0f1 > 15: enp9s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP > mode DEFAULT group default qlen 1000 > link/ether 90:e2:ba:ac:16:19 brd ff:ff:ff:ff:ff:ff > vf 0 MAC 52:54:00:63:12:97, spoof checking on, link-state auto, trust > off, query_rss off > vf 1 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 2 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 3 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 4 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 5 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 6 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 7 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 8 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > vf 9 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off, query_rss off > > > > From: Laurent Dumont <laurentfdumont@gmail.com> > > Sent: Monday, September 30, 2019 11:53 AM > > To: David Harton (dharton) <dharton@cisco.com> > > Cc: users@dpdk.org > > Subject: Re: [dpdk-users] net/i40e VF state does not track PF state > > > > Hey David, > > > > From the compute, can you check if the VF "link-state" status is set to > "auto"? That parameter is required for the physical > state of the PF to be > reflected by the VF. > > > > Thanks > > > > > > > > > On Mon, Sep 30, 2019, 11:12 AM David Harton (dharton) <mailto: > dharton@cisco.com> wrote: > > > I'm using i40evf based interfaces using DPDK 18.11. > > > > > > The host is rhel 7.3 and the PF driver details are: > > > ethtool -i enp9s0f1 > > > driver: i40e > > > version: 1.5.10-k > > > firmware-version: 6.01 0x800036b8 0.385.33 > > > expansion-rom-version: > > > bus-info: 0000:09:00.1 > > > supports-statistics: yes > > > supports-test: yes > > > supports-eeprom-access: yes > > > supports-register-dump: yes > > > supports-priv-flags: yes > > > > > > When the PF is shut the VFs are not showing a 'down' state. > > > > > > Is this a known issue? Any tips on how to debug? > > > > > > Thanks, > > > Dave > > ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [dpdk-users] net/i40e VF state does not track PF state 2019-10-03 1:10 ` Laurent Dumont @ 2019-10-03 13:24 ` David Harton (dharton) 0 siblings, 0 replies; 7+ messages in thread From: David Harton (dharton) @ 2019-10-03 13:24 UTC (permalink / raw) To: Laurent Dumont; +Cc: users Thanks to Larry from intel I believe the answer is here: dpdk/drivers/net/i40e/i40e_ethdev_vf.c:: i40evf_dev_link_update() /* * DPDK pf host provide interfacet to acquire link status * while Linux driver does not */ It appears that the PF has to be controlled by DPDK as well in order for the VF to acquire link status. Regards, Dave From: Laurent Dumont <laurentfdumont@gmail.com> Sent: Wednesday, October 02, 2019 9:10 PM To: David Harton (dharton) <dharton@cisco.com> Cc: users@dpdk.org Subject: Re: [dpdk-users] net/i40e VF state does not track PF state Not sure for the DPDK behavior. If a non-dpdk VF is not shutdown, the other way around with DPDK would be surpring. I'll see if it's possible for us to test. Thanks On Mon, Sep 30, 2019 at 12:32 PM David Harton (dharton) <dharton@cisco.com<mailto:dharton@cisco.com>> wrote: From: Laurent Dumont <laurentfdumont@gmail.com<mailto:laurentfdumont@gmail.com>> Sent: Monday, September 30, 2019 12:25 PM To: David Harton (dharton) <dharton@cisco.com<mailto:dharton@cisco.com>> Cc: users@dpdk.org<mailto:users@dpdk.org> Subject: Re: [dpdk-users] net/i40e VF state does not track PF state Hey David, Another possibility is that you are shutting down the PF through the compute with " ip link"? <dharton> Yes, but shouldn’t matter the VF state should follow the PF state. For example, if I shut a ixgbe PF the VFs go down. It seems similar to a behavior we saw with sriov port where the host OS seems to lose a portion of control over the nic. We could shutdown the port from the compute but we still saw the traffic being forwarded from the VF towards the TOR. You can try to physically shutdown the port from the TOR or unplugging the cable. We are running 7.6 hosts with the 2.3.2 driver. <dharton> I assume DPDK is packaged with that release...which version is it? Thanks, Dave Thanks! On Mon, Sep 30, 2019, 12:14 PM David Harton (dharton) <dharton@cisco.com<mailto:dharton@cisco.com>> wrote: Yes, the VFs are set to the default ‘link-state auto’: ip link show enp9s0f1 15: enp9s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 link/ether 90:e2:ba:ac:16:19 brd ff:ff:ff:ff:ff:ff vf 0 MAC 52:54:00:63:12:97, spoof checking on, link-state auto, trust off, query_rss off vf 1 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 2 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 3 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 4 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 5 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 6 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 7 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 8 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off vf 9 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off, query_rss off > From: Laurent Dumont <laurentfdumont@gmail.com<mailto:laurentfdumont@gmail.com>> > Sent: Monday, September 30, 2019 11:53 AM > To: David Harton (dharton) <dharton@cisco.com<mailto:dharton@cisco.com>> > Cc: users@dpdk.org<mailto:users@dpdk.org> > Subject: Re: [dpdk-users] net/i40e VF state does not track PF state > > Hey David, > > From the compute, can you check if the VF "link-state" status is set to "auto"? That parameter is required for the physical > state of the PF to be reflected by the VF. > > Thanks > > > > > On Mon, Sep 30, 2019, 11:12 AM David Harton (dharton) <mailto:dharton@cisco.com<mailto:dharton@cisco.com>> wrote: > > I'm using i40evf based interfaces using DPDK 18.11. > > > > The host is rhel 7.3 and the PF driver details are: > > ethtool -i enp9s0f1 > > driver: i40e > > version: 1.5.10-k > > firmware-version: 6.01 0x800036b8 0.385.33 > > expansion-rom-version: > > bus-info: 0000:09:00.1 > > supports-statistics: yes > > supports-test: yes > > supports-eeprom-access: yes > > supports-register-dump: yes > > supports-priv-flags: yes > > > > When the PF is shut the VFs are not showing a 'down' state. > > > > Is this a known issue? Any tips on how to debug? > > > > Thanks, > > Dave ^ permalink raw reply [flat|nested] 7+ messages in thread
end of thread, other threads:[~2019-10-03 13:24 UTC | newest] Thread overview: 7+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2019-09-30 15:12 [dpdk-users] net/i40e VF state does not track PF state David Harton (dharton) 2019-09-30 15:52 ` Laurent Dumont 2019-09-30 16:14 ` David Harton (dharton) 2019-09-30 16:24 ` Laurent Dumont 2019-09-30 16:32 ` David Harton (dharton) 2019-10-03 1:10 ` Laurent Dumont 2019-10-03 13:24 ` David Harton (dharton)
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).