From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 3344DA04E6; Wed, 18 Nov 2020 10:45:19 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 782CF58C4; Wed, 18 Nov 2020 10:45:17 +0100 (CET) Received: from inbox.dpdk.org (xvm-172-178.dc0.ghst.net [95.142.172.178]) by dpdk.org (Postfix) with ESMTP id 8B9064C90 for ; Wed, 18 Nov 2020 10:45:15 +0100 (CET) Received: by inbox.dpdk.org (Postfix, from userid 33) id 7AA9AA04E7; Wed, 18 Nov 2020 10:45:14 +0100 (CET) From: bugzilla@dpdk.org To: dev@dpdk.org Date: Wed, 18 Nov 2020 09:45:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: DPDK X-Bugzilla-Component: ethdev X-Bugzilla-Version: 20.08 X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: juraj.linkes@pantheon.tech X-Bugzilla-Status: UNCONFIRMED X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: dev@dpdk.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter target_milestone Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: http://bugs.dpdk.org/ Auto-Submitted: auto-generated X-Auto-Response-Suppress: All MIME-Version: 1.0 Subject: [dpdk-dev] [Bug 578] i40evf_check_api_version(): PF/VF API version mismatch:(0.0)-(1.1) with multiple DPDK instances using different VFs with the same PF X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" https://bugs.dpdk.org/show_bug.cgi?id=3D578 Bug ID: 578 Summary: i40evf_check_api_version(): PF/VF API version mismatch:(0.0)-(1.1) with multiple DPDK instances using different VFs with the same PF Product: DPDK Version: 20.08 Hardware: All OS: Linux Status: UNCONFIRMED Severity: normal Priority: Normal Component: ethdev Assignee: dev@dpdk.org Reporter: juraj.linkes@pantheon.tech Target Milestone: --- ISSUE DESCRIPTION: VPP uses DPDK during startup with these init args: EAL init args: -c 200000000 -n 4 --in-memory --log-level debug --file-prefix vpp -w 0000:91:03.0 -w 0000:91:03.1 --master-lcore 33 When there's only one VPP starting up, the initialization is successful. Wh= en we add multiple VPPs the initialization sometimes fails: 2020/11/16 08:58:49:660 notice dpdk EAL: Detected 64 lcore(s) 2020/11/16 08:58:49:660 notice dpdk EAL: Detected 2 NUMA nodes 2020/11/16 08:58:49:660 notice dpdk EAL: Selected IOVA mode '= VA' 2020/11/16 08:58:49:660 notice dpdk EAL: Probing VFIO support= ... 2020/11/16 08:58:49:660 notice dpdk EAL: VFIO support initial= ized 2020/11/16 08:58:49:660 notice dpdk EAL: using IOMMU type 1 (Type 1) 2020/11/16 08:58:49:660 notice dpdk EAL: Probe PCI driver: net_i40e_vf (8086:154c) device: 0000:91:03.0 (socket 1) 2020/11/16 08:58:49:660 notice dpdk i40evf_check_api_version(= ): PF/VF API version mismatch:(0.0)-(1.1) 2020/11/16 08:58:49:660 notice dpdk i40evf_init_vf(): check_a= pi version failed 2020/11/16 08:58:49:660 notice dpdk i40evf_dev_init(): Init vf failed 2020/11/16 08:58:49:660 notice dpdk EAL: Releasing pci mapped resource for 0000:91:03.0 2020/11/16 08:58:49:660 notice dpdk EAL: Calling pci_unmap_resource for 0000:91:03.0 at 0x2101000000 2020/11/16 08:58:49:660 notice dpdk EAL: Calling pci_unmap_resource for 0000:91:03.0 at 0x2101010000 2020/11/16 08:58:49:660 notice dpdk EAL: Requested device 0000:91:03.0 cannot be used 2020/11/16 08:58:49:660 notice dpdk EAL: using IOMMU type 1 (Type 1) EXPANDED SETUP/FAILURE EXPLANATION: There is one testsuite running tests serially in one Jenkins job. Each test starts VPP anew, so the DPDK initialization happens multiple times during a testsuite run. When there is only one Jenkins job running, no failure is observed. With multiple Jenkins jobs (and multiple testsuites running in parallel), there is a small likelihood that a small number (usually just 1)= of initialization failures will occur, suggesting that when multiple DPDK instances are retrieving PF/VF version there's a race condition resulting i= n PF version 0.0 being retrieved. Each Jenkins job uses two different VFs from the same PF. An illustration of what likely happens: VPP1 in job1 starts and DPDK initializes VF1 and VF2 from a PF. VPP2 in job2 starts and DPDK initializes VF3 and VF4 from the same PF. One or more of VF1, VF2, VF3 or VF4 don't get properly initialized because = of: i40evf_check_api_version(): PF/VF API version mismatch:(0.0)-(1.1) NIC: Intel Ethernet Converged Network Adapter XL710-Q2 cat /sys/class/net/enp5s0f0/device/device=20 0x1583 cat /sys/class/net/enp5s0f0/device/vendor=20 0x8086 cat /sys/class/net/enp5s0f0/device/subsystem_device=20 0x0001 cat /sys/class/net/enp5s0f0/device/subsystem_vendor=20 0x8086 DRIVER/FIRMWARE VERSION: driver: i40e version: 2.1.14-k firmware-version: 6.01 0x800035da 1.1747.0 expansion-rom-version:=20 bus-info: 0000:05:00.0 supports-statistics: yes supports-test: yes supports-eeprom-access: yes supports-register-dump: yes supports-priv-flags: yes --=20 You are receiving this mail because: You are the assignee for the bug.=