From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 39EE243A66 for ; Sun, 4 Feb 2024 07:43:41 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id EF55E402A2; Sun, 4 Feb 2024 07:43:40 +0100 (CET) Received: from SG2PR03CU006.outbound.protection.outlook.com (mail-southeastasiaazon11020002.outbound.protection.outlook.com [52.101.133.2]) by mails.dpdk.org (Postfix) with ESMTP id AE7744027F for ; Sun, 4 Feb 2024 07:43:38 +0100 (CET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=mszSCzBdx8ju6cTOhpv4QsU3OkZVCffc2WW7Ale/Eq9rbWUQnymkvMU7xmmSTAEd/wR2/CDdlHiANJ8CKAY3zv00FKm51OIcOUvE9Lr0CY8ardbTNzHPRLZ08oIY+JL68AmWVlVVisHEejLLzHMhCeGjiECxM/ZGQsecG/dCJn/n8DSl2SjSDFS/NGTaWI18dscLd6RQBpGnPOg7WqCeb2gKrBqvjtrl1/TiflUZs/wwlJazQwjNBzYpENzBicQZ2fuIWWQJSPqsVBCn7E+pdVBlmUESImgNJ/VTIZnMIwR4RArxiTW9NeESwrH0FPHN5DGbTuA3kiIABxq5X7dSWg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=qJFM+otnLZfnfUFPeni9u7M7p+mASaXr6HFQqzuxanU=; b=GH0RV9fNuo/bpZgICekcneqnaZvPIkltTA/nrf4cksxfO7WWtRMCrq77UFLqnVy0q6V1AeKeu6G6DBX7RnPhcfowqT351kicbniwR9zhhVnHtBM8n3EAB7XGiW3c23liyGBFvyLZPvMfPxaNJBLvcygl7bwYfkm9wqkW+3ChPaDmht0WWNglGKNYJZIEk+kbqnQCatCz6bEdoTpAnkI9/LH4ebRzuZzIKxkbApgWmXRAAGVw0n57uaLa+Dq13lPNlpeALy7CGzFZ34CPM8OCm6oT2CbV8vbmT9K/8yPrbvPMso9VWswGKhOMSaE0AQRq/aSeReNKjFzE++so+AC2CQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=aryaka.com; dmarc=pass action=none header.from=aryaka.com; dkim=pass header.d=aryaka.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=aryaka.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qJFM+otnLZfnfUFPeni9u7M7p+mASaXr6HFQqzuxanU=; b=mkkUFzRBoZ8D+vkiCFF+0L6kSqUTzN+DB31ReK+zZ8lXeeraxh/gq681lFGHlKObpTtcyGHQWvgYjpA+qYCGJCo+QV81RWPKCaw7f3YubH5dsUTduRsl5do1lWh5t/fY3XoVWcHHV04d8Q8ko2TOPFSNYlShDGv6ked+8oaV/MQ= Received: from PSAPR01MB3781.apcprd01.prod.exchangelabs.com (2603:1096:301:20::5) by SEYPR01MB4174.apcprd01.prod.exchangelabs.com (2603:1096:101:56::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7249.33; Sun, 4 Feb 2024 06:43:32 +0000 Received: from PSAPR01MB3781.apcprd01.prod.exchangelabs.com ([fe80::a4ad:509c:2c4f:bdd1]) by PSAPR01MB3781.apcprd01.prod.exchangelabs.com ([fe80::a4ad:509c:2c4f:bdd1%2]) with mapi id 15.20.7249.032; Sun, 4 Feb 2024 06:43:31 +0000 From: Nitin Katiyar To: "users@dpdk.org" Subject: RE: Failed to enable SRIOV Thread-Topic: Failed to enable SRIOV Thread-Index: AdpPaWT5XhuJhU9TRNGsf6c9mUgLQgHy8Ugw Date: Sun, 4 Feb 2024 06:43:31 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=aryaka.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: PSAPR01MB3781:EE_|SEYPR01MB4174:EE_ x-ms-office365-filtering-correlation-id: 0159ad35-881c-40a4-fa7c-08dc254c9a2c x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: kvN69BXBm/4SVfm8hgLO7wi+0rWtdt8kaZs1TL+mt1UEgeSX3x51FtA8Yk3wLhWS1KIh1LBZRe2RdY/y9reB+eTtX//yOMc2G2cDNvG0V/Gl8UmHwN/iyu+s/IIZOZaUHbBXmtZeBapcSkObD4MMEeGP5nho51rBoa2/V0mX8JKbz5XDtceybXVCaBLzxz/DBZYE3NSGZEmxHT/4GssNQLgMHP9tkKEGhOkVC9oQBCI2JX4Bfviv2vvEDXSg2kVMH6yqVP2YbKKSsJ5b29ElmlfpWubiMZ4ARDO2Gkhirc1M5TRpG8laioW27WRks9dXEvuc8H6E+qDl5Gi54/eAPuC/BRAnG3ndv7zv/LkfMnvilTc4/FEKYKscnRB2fktGs3ZxUMXQx7puyQUItEYkrhVWdPQUOieKKZpc5pRDZnyMRNXnokZgdHuEpK/y6ZUVQ++sqmBENDJWHGDowfq3uzEQCxlgRBhzAjJq19Uw3/TNeEVXtOVhbbD/RfOpDaC+bNgjHW3ZyoQde+YBVZ5dUiBkwCKDHYmmRJ0KmJ2txhLtnZODS0STQ5ipToYhflmbRYU5DdzRNfDTve7xyrJfzOvRn8ELD94kGRAjTmUW/7gc9yccldmfeNcYP69Ab1lG89MHj40fCZOTrnaR8IplNA== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:PSAPR01MB3781.apcprd01.prod.exchangelabs.com; PTR:; CAT:NONE; SFS:(13230031)(376002)(366004)(39850400004)(136003)(396003)(346002)(230922051799003)(186009)(1800799012)(64100799003)(451199024)(41300700001)(44832011)(52536014)(8936002)(8676002)(2906002)(33656002)(5660300002)(86362001)(66556008)(66446008)(66946007)(64756008)(316002)(66476007)(6916009)(38070700009)(3480700007)(76116006)(122000001)(38100700002)(53546011)(7696005)(6506007)(9686003)(478600001)(71200400001)(83380400001)(66574015)(26005)(55016003)(473944003); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?OdHgZ5Q4Z/nE/UhSK5pee6LLs+eICArsnjHk0/tnegO2adawQDg2u8/SBasR?= =?us-ascii?Q?YJzUxjc16/6ybINW/wrguJghj1xyflvrqDbK8aREDRdJNQsB5mqCQI0318D0?= =?us-ascii?Q?5HBwToPCDyQwyN83P79VVF2Zarg0sG07T9xqrtQiswKFabvorDVxPlAgpzyS?= =?us-ascii?Q?IHyLUZMozDZP+c9iobFsk26cg5hWw9ikRuOjVf8zrCuJxEuqnJ/MJ98jSw3y?= =?us-ascii?Q?3v5nNg6fuswc/GiRCG1Hfs0WH6hdcp7djn0Crn/V7xt/TSj8+q4VTCU4E9O2?= =?us-ascii?Q?omDDUf7e94rkqJ1Z7pynjbFC87YBqnWZw2MSwGXNI8F3txSpR5G+n4eMizU1?= =?us-ascii?Q?AhjBoG5YvrTTz9uTQrrA04DamCtJnO9FOWijgKL4MMQDmKWKzVY2AnVr2m3j?= =?us-ascii?Q?NahQP+WeLLreHZt7peRTZ+YeD8t2qrPmFpjpgTp4D10gsKH8lsIRKPMj18Fl?= =?us-ascii?Q?RuPc7Ji1XlfEB+vPo+4/klHHzOTmBRjxxvr/rtIeS3S7RC6ejTr6shxqtw+N?= =?us-ascii?Q?G/ZgrFtki2aATbZkIvmklBHwWjaUQhOPQqK7052uH8Kr0MD3AS90XNle5gL3?= =?us-ascii?Q?y4GUaqXY+Y1XzqehldhGJBnu2xO4FInuRA+l5Uo6tLJJzpXcBuDGBhszWLwq?= =?us-ascii?Q?tC8aqAJH4r5rieGFi0WIjxh+fQxu8l5FAL4P1mKjd0PSWAC3NlJmSd2Oe7Wg?= =?us-ascii?Q?QDYmiS6IzOgTylebFTV8yQTNE7yKwVIrRXJW7keVQmbz4Jzj/F64nRg6clK/?= =?us-ascii?Q?dTe7Ky5hNCVpo01a9fss526SfNg4zx4EitHwAew/Bo6ifCy1Vpuk8OKv3gKL?= =?us-ascii?Q?Vu1jEAK3ii8eppGTcHoB0zmZ20RJHbfsgE0fa+w2JSniu3oHMdgAdx2ByMjG?= =?us-ascii?Q?Ot49wgLsyth4okDSLzhUQk0eK0sY75UtcrU707cCh2ZzPtLU9BoK/4avgXJD?= =?us-ascii?Q?zmQEIm28lR1oz5yHEi9iwB9jAwcAnn/kJmZFuCx82dWWk8bjulkvuHA5oXyB?= =?us-ascii?Q?v9oheJvKx25IaBaBF1EoW9fVNo7xyOQnbpXGOL7EOWu+ete4vQiE5heeqOtY?= =?us-ascii?Q?dB8by4JCVgplOZRpglb9x1U/9S6kemRCXKftJTC2iMSNGnVEPUJtCg4c/9GA?= =?us-ascii?Q?7m+14/HfvpnLAKBRb98g+kgWoC8HR4Ck/8396KkJwvi+5BcqFQwyaSzysiWb?= =?us-ascii?Q?OBkshFvMZv/axwqw+Gijhulp6c/M0YPGAsWkGF+qxYtPKWP1Pq0PHtIiRk2r?= =?us-ascii?Q?vnH868NG+xCzop6stqdhk4RSAPJcelfPciQ7004ES/2IHakvmOrzwCuv6UVP?= =?us-ascii?Q?l71GA4RHqKpB9g8VpcQHcSzBbQbmIUmVZUZXJFu4GTAFFMxVfJg0GnLKN9+w?= =?us-ascii?Q?c6UGyssTEUwSSNrnhwoSfM49hNWYhBx72PsM+fIP1JHqKDK6qtgmFa3yz/pn?= =?us-ascii?Q?fn9dI0H+L2P5GZL5MlAcnK/qZrAfOFJZG77WuIAOF6DjZWxrGdph46XbQCSG?= =?us-ascii?Q?Askka3zvnT6mTxcXnfa9QdyOcod4VK+1gkCck12fk5bFih7dzbOI7oD6uzGn?= =?us-ascii?Q?Ve2whFqdqq99ZRtwLUYpVHptv+iI1lVu0lOiRlUl?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: aryaka.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: PSAPR01MB3781.apcprd01.prod.exchangelabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: 0159ad35-881c-40a4-fa7c-08dc254c9a2c X-MS-Exchange-CrossTenant-originalarrivaltime: 04 Feb 2024 06:43:31.3671 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: d096f24a-9d6e-43e7-ba8f-713c85ebb90b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: NhxRlowmov3av51VMNVj5RC4t8Y+7O8wSqbHjl3HycsBkElapDCc6wb6xdlH+CtQsb2aP5D6E+KmrQuMO/mbaO4MQ1ik+sCY3WxPP+d1T8w= X-MS-Exchange-Transport-CrossTenantHeadersStamped: SEYPR01MB4174 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Hi, Any suggestions? I tried with Centos 7 also and it has the same issue. Regards, Nitin -----Original Message----- From: Nitin Katiyar=20 Sent: Thursday, January 25, 2024 2:44 PM To: users@dpdk.org Subject: Failed to enable SRIOV Hi, I am trying to enable SR-IOV on linux server (details below) and it throws = following error: # echo '4' > /sys/class/net/enp1s0f0/device/sriov_numvfs -bash: echo: write error: Cannot allocate memory I went through some of articles on internet and it suggested some grub chan= ges for pci but none of them helped. Following are the details of system an= d error System details: ------------------- Rocky Linux release 9.3 (Blue Onyx) model name : Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca = cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx p= dpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopo= logy nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx s= mx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe po= pcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch= cpuid_fault epb invpcid_single pti ssbd ibrs ibpb stibp tpr_shadow flexpri= ority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid = mpx rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves dthe= rm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp vnmi md_clear flu= sh_l1d arch_capabilities vmx flags : vnmi preemption_timer invvpid ept_x_only ept_ad ept_1gb f= lexpriority tsc_offset vtpr mtf vapic ept vpid unrestricted_guest ple shado= w_vmcs pml ept_mode_based_exec ixgbe ver: 5.14.0-362.8.1.el9_3.x86_64=20 [root@server221 dpdk-stable-22.11.1]# uname -r 5.14.0-362.8.1.el9_3.x86_64 # for d in $(find /sys/kernel/iommu_groups/ -type l | sort -n -k5 -t/); do = n=3D${d#*/iommu_groups/*}; n=3D${n%%/*}; printf 'IOMMU Group %s ' "$n"; lsp= ci -nns "${d##*/}"; done; IOMMU Group 0 00:00.0 Host bridge [0600]: Intel C= orporation 8th Gen Core Processor Host Bridge/DRAM Registers [8086:3eca] (r= ev 07) IOMMU Group 1 00:01.0 PCI bridge [0604]: Intel Corporation 6th-10th = Gen Core Processor PCIe Controller (x16) [8086:1901] (rev 07) IOMMU Group 1= 01:00.0 Ethernet controller [0200]: Intel Corporation 82599ES 10-Gigabit S= FI/SFP+ Network Connection [8086:10fb] (rev 01) IOMMU Group 1 01:00.1 Ether= net controller [0200]: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Networ= k Connection [8086:10fb] (rev 01) IOMMU Group 2 00:08.0 System peripheral [= 0880]: Intel Corporation Xeon E3-1200 v5/v6 / E3-1500 v5 / 6th/7th/8th Gen = Core Processor Gaussian Mixture Model [8086:1911] IOMMU Group 3 00:12.0 Sig= nal processing controller [1180]: Intel Corporation Cannon Lake PCH Thermal= Controller [8086:a379] (rev 10) IOMMU Group 4 00:14.0 USB controller [0c03= ]: Intel Corporation Cannon Lake PCH USB 3.1 xHCI Host Controller [8086:a36= d] (rev 10) IOMMU Group 4 00:14.2 RAM memory [0500]: Intel Corporation Cann= on Lake PCH Shared SRAM [8086:a36f] (rev 10) IOMMU Group 5 00:15.0 Serial b= us controller [0c80]: Intel Corporation Cannon Lake PCH Serial IO I2C Contr= oller #0 [8086:a368] (rev 10) IOMMU Group 5 00:15.1 Serial bus controller [= 0c80]: Intel Corporation Cannon Lake PCH Serial IO I2C Controller #1 [8086:= a369] (rev 10) IOMMU Group 6 00:16.0 Communication controller [0780]: Intel= Corporation Cannon Lake PCH HECI Controller [8086:a360] (rev 10) IOMMU Gro= up 6 00:16.4 Communication controller [0780]: Intel Corporation Cannon Lake= PCH HECI Controller #2 [8086:a364] (rev 10) IOMMU Group 7 00:17.0 SATA con= troller [0106]: Intel Corporation Cannon Lake PCH SATA AHCI Controller [808= 6:a352] (rev 10) IOMMU Group 8 00:1b.0 PCI bridge [0604]: Intel Corporation= Cannon Lake PCH PCI Express Root Port #21 [8086:a32c] (rev f0) IOMMU Group= 9 00:1b.5 PCI bridge [0604]: Intel Corporation Cannon Lake PCH PCI Express= Root Port #22 [8086:a32d] (rev f0) IOMMU Group 10 00:1b.6 PCI bridge [0604= ]: Intel Corporation Cannon Lake PCH PCI Express Root Port #23 [8086:a32e] = (rev f0) IOMMU Group 11 00:1b.7 PCI bridge [0604]: Intel Corporation Cannon= Lake PCH PCI Express Root Port #24 [8086:a32f] (rev f0) IOMMU Group 12 00:= 1c.0 PCI bridge [0604]: Intel Corporation Cannon Lake PCH PCI Express Root = Port #1 [8086:a338] (rev f0) IOMMU Group 13 00:1e.0 Communication controlle= r [0780]: Intel Corporation Cannon Lake PCH Serial IO UART Host Controller = [8086:a328] (rev 10) IOMMU Group 14 00:1f.0 ISA bridge [0601]: Intel Corpor= ation Device [8086:a30a] (rev 10) IOMMU Group 14 00:1f.4 SMBus [0c05]: Inte= l Corporation Cannon Lake PCH SMBus Controller [8086:a323] (rev 10) IOMMU G= roup 14 00:1f.5 Serial bus controller [0c80]: Intel Corporation Cannon Lake= PCH SPI Controller [8086:a324] (rev 10) IOMMU Group 15 02:00.0 Ethernet co= ntroller [0200]: Intel Corporation I210 Gigabit Network Connection [8086:15= 33] (rev 03) IOMMU Group 16 03:00.0 Ethernet controller [0200]: Intel Corpo= ration I210 Gigabit Network Connection [8086:1533] (rev 03) IOMMU Group 17 = 04:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit Network = Connection [8086:1533] (rev 03) IOMMU Group 18 05:00.0 Ethernet controller = [0200]: Intel Corporation I210 Gigabit Network Connection [8086:1533] (rev = 03) IOMMU Group 19 06:00.0 PCI bridge [0604]: ASPEED Technology, Inc. AST11= 50 PCI-to-PCI Bridge [1a03:1150] (rev 04) IOMMU Group 19 07:00.0 VGA compat= ible controller [0300]: ASPEED Technology, Inc. ASPEED Graphics Family [1a0= 3:2000] (rev 41) Grub: intel_iommu=3Don iommu=3Dpt pci=3Drealloc pci_pt_e820_access=3Don [1089685.120029] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count =3D= 12, Tx Queue count =3D 12 XDP Queue count =3D 0 [1089685.120334] ixgbe 000= 0:01:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [10= 89685.120417] ixgbe 0000:01:00.0: MAC: 2, PHY: 15, SFP+: 7, PBA No: 0210FF-= 0FF [1089685.120419] ixgbe 0000:01:00.0: 0c:c4:7a:8e:9e:70 [1089685.123311]= ixgbe 0000:01:00.0: Intel(R) 10 Gigabit Network Connection [1089685.123945= ] libphy: ixgbe-mdio: probed [1089685.124909] ixgbe 0000:01:00.0 enp1s0f0: = renamed from eth0 [1089685.193966] ixgbe 0000:01:00.0: registered PHC devic= e on enp1s0f0 [1089685.353711] ixgbe 0000:01:00.0 enp1s0f0: detected SFP+: = 7 [1089685.816670] ixgbe 0000:01:00.0 enp1s0f0: NIC Link is Up 10 Gbps, Flo= w Control: RX/TX [1089685.816793] IPv6: ADDRCONF(NETDEV_CHANGE): enp1s0f0: = link becomes ready [1089688.381885] ixgbe 0000:01:00.1: Multiqueue Enabled:= Rx Queue count =3D 12, Tx Queue count =3D 12 XDP Queue count =3D 0 [108968= 8.382173] ixgbe 0000:01:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/= s PCIe x8 link) [1089688.382267] ixgbe 0000:01:00.1: MAC: 2, PHY: 15, SFP+:= 65535, PBA No: 0210FF-0FF [1089688.382268] ixgbe 0000:01:00.1: 0c:c4:7a:8e= :9e:71 [1089688.385318] ixgbe 0000:01:00.1: Intel(R) 10 Gigabit Network Con= nection [1089688.385422] libphy: ixgbe-mdio: probed [1089688.390327] ixgbe = 0000:01:00.1 enp1s0f1: renamed from eth0 [1089688.458940] ixgbe 0000:01:00.= 1: registered PHC device on enp1s0f1 [1089688.566892] ixgbe 0000:01:00.1 en= p1s0f1: detected SFP+: 65535 [1089711.433915] ixgbe 0000:01:00.0 enp1s0f0: = SR-IOV enabled with 4 VFs [1089711.434093] ixgbe 0000:01:00.0: removed PHC = on enp1s0f0 [1089711.491490] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Que= ue count =3D 4, Tx Queue count =3D 4 XDP Queue count =3D 0 [1089711.509777]= ixgbe 0000:01:00.0: registered PHC device on enp1s0f0 [1089711.616376] ixg= be 0000:01:00.0: can't enable 4 VFs (bus 02 out of range of [bus 01]) [1089= 711.616379] ixgbe 0000:01:00.0: Failed to enable PCI sriov: -12 [1089711.68= 3690] ixgbe 0000:01:00.0 enp1s0f0: detected SFP+: 7 [1089712.108505] ixgbe = 0000:01:00.0 enp1s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX Grub =3D intel_iommu=3Don iommu=3Dpt pci_pt_e820_access=3Don pci=3Dassign-b= usses [ 1097.055411] ixgbe 0000:01:00.0: removed PHC on enp1s0f0 [ 1097.113139] i= xgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count =3D 4, Tx Queue count= =3D 4 XDP Queue count =3D 0 [ 1097.131961] ixgbe 0000:01:00.0: registered = PHC device on enp1s0f0 [ 1097.237630] ixgbe 0000:01:00.0: not enough MMIO r= esources for SR-IOV [ 1097.237632] ixgbe 0000:01:00.0: Failed to enable PCI= sriov: -12 [ 1097.301447] ixgbe 0000:01:00.0 enp1s0f0: detected SFP+: 7 [ = 1097.576271] ixgbe 0000:01:00.0 enp1s0f0: NIC Link is Up 10 Gbps, Flow Cont= rol: RX/TX Grub: intel_iommu=3Don iommu=3Dpt pci_pt_e820_access=3Don [ 62.686491] ixgbe 0000:01:00.0 enp1s0f0: SR-IOV enabled with 4 VFs [ 62.686644] ixgbe 0000:01:00.0: removed PHC on enp1s0f0 [ 62.744406] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count =3D 4= , Tx Queue count =3D 4 XDP Queue count =3D 0 [ 62.762909] ixgbe 0000:01:00.0: registered PHC device on enp1s0f0 [ 62.869644] ixgbe 0000:01:00.0: not enough MMIO resources for SR-IOV [ 62.869646] ixgbe 0000:01:00.0: Failed to enable PCI sriov: -12 [ 62.933507] ixgbe 0000:01:00.0 enp1s0f0: detected SFP+: 7 [ 63.285637] ixgbe 0000:01:00.0 enp1s0f0: NIC Link is Up 10 Gbps, Flow Co= ntrol: RX/TX [ 75.310635] block sda: the capability attribute has been deprecated. Grub: intel_iommu=3Don iommu=3Dpt pci_pt_e820_access=3Don pci=3Drealloc [ 67.969725] ixgbe 0000:01:00.0 enp1s0f0: SR-IOV enabled with 4 VFs [ 67.969891] ixgbe 0000:01:00.0: removed PHC on enp1s0f0 [ 68.026892] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count =3D 4= , Tx Queue count =3D 4 XDP Queue count =3D 0 [ 68.045699] ixgbe 0000:01:00.0: registered PHC device on enp1s0f0 [ 68.149395] ixgbe 0000:01:00.0: can't enable 4 VFs (bus 02 out of range = of [bus 01]) [ 68.149398] ixgbe 0000:01:00.0: Failed to enable PCI sriov: -12 [ 68.213069] ixgbe 0000:01:00.0 enp1s0f0: detected SFP+: 7 [ 68.669423] ixgbe 0000:01:00.0 enp1s0f0: NIC Link is Up 10 Gbps, Flow Co= ntrol: RX/TX Any suggestions/help will be appreciated. Thanks, Nitin