From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 8E09A439C0 for ; Thu, 25 Jan 2024 10:14:03 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 0928A402E1; Thu, 25 Jan 2024 10:14:03 +0100 (CET) Received: from APC01-SG2-obe.outbound.protection.outlook.com (mail-sgaapc01on2057.outbound.protection.outlook.com [40.107.215.57]) by mails.dpdk.org (Postfix) with ESMTP id 591564029B for ; Thu, 25 Jan 2024 10:14:01 +0100 (CET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Bg6joAaJ2Malm7uc1tqAcesfsVcCy+QePhS4UbzZ/tsI5qOipI1peI/wk3EOzBzFgpZrpSG7FcWoEc5gSXIWrKvV9im8mg3++Wff24veIqFKgGAl50ildWJ/8CjsnCU2a0m80s1v0kQBuCgNSW/tRePoPZ/8zOSccQ30xT3B7+e84+kYAg7pFjHQJWI0VuyRiDKEfNk5TfBCUtb/a9FZ1Wo3Uw8hXvTUIgrlYJH188BXUUMk5Wp7bvqVH/k6SqpU/wKy9AhgPlC+4y0anhjk5N3Afmo2OAg3faF1XByNrMvrtwDCvwkFpFasJEkIOss8M/zyWlm0WRIAZTjAovD8Ug== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Ckixx7qrGxUMGz8cY1E4AxTK5UtMDCXFZK9SOdeAaLI=; b=cYJzJEEU/TImlUQf907TaUnEOZh/tKxyF/KduyX8keXNud8If6PlhftksKCe2P4Bx2mah1RBbz+01/zLAtw+35a5D1q2K0SHUwCM7nAB3PjGceJ93SmTpIrRMKDbsbBOLmXtefN56dWGCUoDC+HYyWhSZIIfM1XEuwBFzqKn1/1BLCrjyxccVuOgk1eaDAYhVA/czfwwXOFJGjl85zSjgLOfbk2+KCY0BiqIK8BHu4a298bbVwulCZ2mkGauXLVg7wQqdxQUFYNB4yoBcGvJSr4gLCrGbebrJGUMO5kJAUaYNsanhxppJ9qBz9f0bJPSpq3hqL/0QtVgEzi53+u3jw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=aryaka.com; dmarc=pass action=none header.from=aryaka.com; dkim=pass header.d=aryaka.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=aryaka.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Ckixx7qrGxUMGz8cY1E4AxTK5UtMDCXFZK9SOdeAaLI=; b=sN/4tHET4s9Xcj+VAjsE1t5AKsDnkNKWCldq6H/DWB7sZwmMxi6YHW6IbyBQZPDNnzrOh1MJI39CRawNnKnAt9cPPGqM9QCGIYkbhhVWrymOHaCjZrYhb7UCbmKODs1MOjOxpTGFlqSHKMy6d2DOAJPDKfZG8YmXvJ8x4rUOLas= Received: from PSAPR01MB3781.apcprd01.prod.exchangelabs.com (2603:1096:301:20::5) by TYZPR01MB4091.apcprd01.prod.exchangelabs.com (2603:1096:400:1cd::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7202.40; Thu, 25 Jan 2024 09:13:56 +0000 Received: from PSAPR01MB3781.apcprd01.prod.exchangelabs.com ([fe80::a4ad:509c:2c4f:bdd1]) by PSAPR01MB3781.apcprd01.prod.exchangelabs.com ([fe80::a4ad:509c:2c4f:bdd1%2]) with mapi id 15.20.7228.026; Thu, 25 Jan 2024 09:13:55 +0000 From: Nitin Katiyar To: "users@dpdk.org" Subject: Failed to enable SRIOV Thread-Topic: Failed to enable SRIOV Thread-Index: AdpPaWT5XhuJhU9TRNGsf6c9mUgLQg== Date: Thu, 25 Jan 2024 09:13:55 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=aryaka.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: PSAPR01MB3781:EE_|TYZPR01MB4091:EE_ x-ms-office365-filtering-correlation-id: 9f97d639-b374-43a2-317b-08dc1d85f4ea x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: CDIoIOaHj/Xtr2ta9KKczWnL+gBUVYOU0GuxW+UoGdA7ZiEXhr3TuOWBlY6N7CHtAuByvBS3ZmRIVO1onkZCkXMoSVXkgVXSCF8QEFQVIY4kdsevIvU+NCiAJTxLa5+xxckiXhhAUxm0Ard/c73n3df2SGAQGtk8I+G1gFM7g1hZef886WK0P/2mOjI7o92jQuKjXI6VhEOuNvXHbWDMl8MLuleB1zxMBdJIzh6nPT1fSN71v3Wt/N7JAM9G4xpTWe6aP/+qsCiIZF7wpOIBY12ISXrepTX6NOmUxaPteSqEh1e2qCg4hXilQSZWLThvRQvvBRH3Lz/wV+IJK6T/XSbjtN8X0kLpEOauCDG/Eeu8siyNBbZzxiS8I5puCl0IoyOZU/LtP3B57kXzW09jp7tkLMzF6Nk8yY4mW85bMkw62YVGgwEvhB4+wFrONKV9pHPG0DIwfy8eWvYucgTTDrBxU/2ZqHrpBzPoTDMowBR6Ml9M5XWoxaQDN7XJXrug6fwhBmAwThVkPV8v1ZA/n+EPVS9oagvRVXt1K2Xzc/xfraE/7F4xTs1IvI9KDT0V/lwvzsnwUtOCYtytQDID3K4WyspEHcSzeui0vdspwERz6fI1BiPvVzRKz7F4S53rRg3sKXNfuaHcGR7fvAIakw== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:PSAPR01MB3781.apcprd01.prod.exchangelabs.com; PTR:; CAT:NONE; SFS:(13230031)(346002)(136003)(376002)(366004)(39850400004)(396003)(230922051799003)(451199024)(1800799012)(186009)(64100799003)(38100700002)(83380400001)(76116006)(3480700007)(66574015)(71200400001)(5660300002)(8676002)(44832011)(26005)(8936002)(52536014)(41300700001)(66556008)(6506007)(478600001)(7696005)(2906002)(64756008)(66446008)(66946007)(6916009)(9686003)(316002)(66476007)(86362001)(33656002)(38070700009)(122000001)(55016003)(473944003); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?GsVoLuCNNe/vQ0ou0hV7Zq2q7uWSAC1kvf7sACgMqAinQWCKKRFLMZYMS6A7?= =?us-ascii?Q?8oBMXrnY94EO/cR5IT5/Z+10NGGpAbhj3nEEDrMr2gSaDgpAazHCLLGLI13B?= =?us-ascii?Q?PZPGtGbHCWeS/EnBGuYQEv3cGggKzzluINsAqqOHunQRr1RKI84lNR9lAcs9?= =?us-ascii?Q?kDX0IXkCi0bCPpbWEQT0FqIzxnejJuzhXdeYizuB4NEZNOPT1/1MaEYTZqDw?= =?us-ascii?Q?K2Fuf2akN0u+5NXWl529DVJK8kHFkRhgfFm2MVv5BEJoXDJLiyX2jU1fwTVc?= =?us-ascii?Q?XO9sQ9/TSvvRiEh9L+mkewPH86ODiXYCxkKvlcU1oUfujcC/6ztkOgE2xJdv?= =?us-ascii?Q?UtFQWKenl14KCkcx9SA13wjSEiKKLeXBh9/OyVYq0yv7U/QQY3eLqYW8lH2+?= =?us-ascii?Q?k0wRkStFbrMTiFDAIjd11XSP3+Ji3e/9OV5xe19WAi5Ao+Ig8q6uxC4ZoNWS?= =?us-ascii?Q?gqiqo27aDnaDUXEIagM8lgsHIEV2yv3q+D/6L4E6jj3zQbFrA/qS5qzvdAks?= =?us-ascii?Q?HcTCMVdA+dLaihr7+lNl5OSsn17bkQyjJGUEaJXK1VzX1vWpFi4zlKdQXG4X?= =?us-ascii?Q?qcm29Z4293Ez2i+EXENRyepT7IsEF02w6TJulfgFOf1R6dMVY6ef2+X2puSU?= =?us-ascii?Q?fFqKeNBzZ/fppvnGt/j40MaWGdQZHBcVy8CUlN9wv6p4huzI0N8VuGsh6wN4?= =?us-ascii?Q?aZVwaP4L3XVRcb37ce37r7ufnvC1TpeCgAtx0am5CTWUeN0yeEo95NyyNlgM?= =?us-ascii?Q?hMB12gSv8xoDKspnGmEL0+4zA5V2TzRGiPFF2kkYCnanDZVMFfnQrXtDkiGc?= =?us-ascii?Q?FnYnbzNer4idrRKOLpFcu9QP4yQJdVwSh0ReSYlst0Ytq40+SInAHJ/KCozj?= =?us-ascii?Q?oA1nbzqIqYMRPpiPVxkZvqS2cnWXOTb/NKL7Dvyn47a4HOhAuBuLYl/p8veb?= =?us-ascii?Q?lKhur7SJRy+Ilkl8V0K2ENGpDUBi8BzcWMttkFlu60o7kibrX6dU7qzDdIgR?= =?us-ascii?Q?lmy4OoPwUwvtAPPemyBkwQOETdhxt4tqA4Oq3UY5Uf2iUD0UCsBr/y0x72Mm?= =?us-ascii?Q?jHRq6VyM544mKZJE65GCEo/qpIyBOo59h7lYE8aiEaojSA4imNKWkk7QLiIK?= =?us-ascii?Q?upm0FZEEZeY1JNCHqP2nPIiKZ9F0Uw2ggMRgGoSyHGZNIV6mpFhQuR8KeKXD?= =?us-ascii?Q?NCfb2s8WRpXhxBmKFY6pe+EdJ5rmPE75t6UzOnsqXU7GPpich9+t/xFGJDLD?= =?us-ascii?Q?DAYP5Z1ZtlB1JMz7tGivjzgOlTC0MKEMzTT196mKuv4EfTJ1fUpGCqRFSJ3V?= =?us-ascii?Q?PD8JQLyiEFRequN+ocKoo1iGaMIu1UZrd25wBFDbFALXvqDC31v+ivBsMlUR?= =?us-ascii?Q?1844PQL9Fn6kquld4x6jDS9sDkX7FhEzhU6PFq6De6mGBMkcU1Laausffurf?= =?us-ascii?Q?H5m2s2bv/j3P4ZLwwFRMiz4Ar3tXdUEnUKdCkajDgsCJypbZ4QchmWgGXtAL?= =?us-ascii?Q?jim29/96/Q+0fo6QHo7r3gQCrnq8Xws6WBIus7vDlmdmQxFs1pvH1Xsbq0bC?= =?us-ascii?Q?WBOrOTz5tV59bICQHbGAOVpJhu00xP+m125dY2Eo?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: aryaka.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: PSAPR01MB3781.apcprd01.prod.exchangelabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: 9f97d639-b374-43a2-317b-08dc1d85f4ea X-MS-Exchange-CrossTenant-originalarrivaltime: 25 Jan 2024 09:13:55.6050 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: d096f24a-9d6e-43e7-ba8f-713c85ebb90b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: MBn2TG3uVXeqG8bumm8XR4CdPiXkbsRwuOCp6/VUN26RurWUj8u7hi5zPMQcwM1JkyzSW921wruZ6FgVdKDDmlBx70qEMW2ngBfQ4CsqshA= X-MS-Exchange-Transport-CrossTenantHeadersStamped: TYZPR01MB4091 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Hi, I am trying to enable SR-IOV on linux server (details below) and it throws = following error: # echo '4' > /sys/class/net/enp1s0f0/device/sriov_numvfs -bash: echo: write error: Cannot allocate memory I went through some of articles on internet and it suggested some grub chan= ges for pci but none of them helped. Following are the details of system an= d error System details: ------------------- Rocky Linux release 9.3 (Blue Onyx) model name : Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca = cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx p= dpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopo= logy nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx s= mx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe po= pcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch= cpuid_fault epb invpcid_single pti ssbd ibrs ibpb stibp tpr_shadow flexpri= ority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid = mpx rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves dthe= rm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp vnmi md_clear flu= sh_l1d arch_capabilities vmx flags : vnmi preemption_timer invvpid ept_x_only ept_ad ept_1gb f= lexpriority tsc_offset vtpr mtf vapic ept vpid unrestricted_guest ple shado= w_vmcs pml ept_mode_based_exec ixgbe ver: 5.14.0-362.8.1.el9_3.x86_64=20 [root@server221 dpdk-stable-22.11.1]# uname -r 5.14.0-362.8.1.el9_3.x86_64 # for d in $(find /sys/kernel/iommu_groups/ -type l | sort -n -k5 -t/); do = n=3D${d#*/iommu_groups/*}; n=3D${n%%/*}; printf 'IOMMU Group %s ' "$n"; lsp= ci -nns "${d##*/}"; done; IOMMU Group 0 00:00.0 Host bridge [0600]: Intel Corporation 8th Gen Core Pr= ocessor Host Bridge/DRAM Registers [8086:3eca] (rev 07) IOMMU Group 1 00:01.0 PCI bridge [0604]: Intel Corporation 6th-10th Gen Cor= e Processor PCIe Controller (x16) [8086:1901] (rev 07) IOMMU Group 1 01:00.0 Ethernet controller [0200]: Intel Corporation 82599ES= 10-Gigabit SFI/SFP+ Network Connection [8086:10fb] (rev 01) IOMMU Group 1 01:00.1 Ethernet controller [0200]: Intel Corporation 82599ES= 10-Gigabit SFI/SFP+ Network Connection [8086:10fb] (rev 01) IOMMU Group 2 00:08.0 System peripheral [0880]: Intel Corporation Xeon E3-1= 200 v5/v6 / E3-1500 v5 / 6th/7th/8th Gen Core Processor Gaussian Mixture Mo= del [8086:1911] IOMMU Group 3 00:12.0 Signal processing controller [1180]: Intel Corporatio= n Cannon Lake PCH Thermal Controller [8086:a379] (rev 10) IOMMU Group 4 00:14.0 USB controller [0c03]: Intel Corporation Cannon Lake = PCH USB 3.1 xHCI Host Controller [8086:a36d] (rev 10) IOMMU Group 4 00:14.2 RAM memory [0500]: Intel Corporation Cannon Lake PCH = Shared SRAM [8086:a36f] (rev 10) IOMMU Group 5 00:15.0 Serial bus controller [0c80]: Intel Corporation Canno= n Lake PCH Serial IO I2C Controller #0 [8086:a368] (rev 10) IOMMU Group 5 00:15.1 Serial bus controller [0c80]: Intel Corporation Canno= n Lake PCH Serial IO I2C Controller #1 [8086:a369] (rev 10) IOMMU Group 6 00:16.0 Communication controller [0780]: Intel Corporation Ca= nnon Lake PCH HECI Controller [8086:a360] (rev 10) IOMMU Group 6 00:16.4 Communication controller [0780]: Intel Corporation Ca= nnon Lake PCH HECI Controller #2 [8086:a364] (rev 10) IOMMU Group 7 00:17.0 SATA controller [0106]: Intel Corporation Cannon Lake= PCH SATA AHCI Controller [8086:a352] (rev 10) IOMMU Group 8 00:1b.0 PCI bridge [0604]: Intel Corporation Cannon Lake PCH = PCI Express Root Port #21 [8086:a32c] (rev f0) IOMMU Group 9 00:1b.5 PCI bridge [0604]: Intel Corporation Cannon Lake PCH = PCI Express Root Port #22 [8086:a32d] (rev f0) IOMMU Group 10 00:1b.6 PCI bridge [0604]: Intel Corporation Cannon Lake PCH= PCI Express Root Port #23 [8086:a32e] (rev f0) IOMMU Group 11 00:1b.7 PCI bridge [0604]: Intel Corporation Cannon Lake PCH= PCI Express Root Port #24 [8086:a32f] (rev f0) IOMMU Group 12 00:1c.0 PCI bridge [0604]: Intel Corporation Cannon Lake PCH= PCI Express Root Port #1 [8086:a338] (rev f0) IOMMU Group 13 00:1e.0 Communication controller [0780]: Intel Corporation C= annon Lake PCH Serial IO UART Host Controller [8086:a328] (rev 10) IOMMU Group 14 00:1f.0 ISA bridge [0601]: Intel Corporation Device [8086:a3= 0a] (rev 10) IOMMU Group 14 00:1f.4 SMBus [0c05]: Intel Corporation Cannon Lake PCH SMBu= s Controller [8086:a323] (rev 10) IOMMU Group 14 00:1f.5 Serial bus controller [0c80]: Intel Corporation Cann= on Lake PCH SPI Controller [8086:a324] (rev 10) IOMMU Group 15 02:00.0 Ethernet controller [0200]: Intel Corporation I210 G= igabit Network Connection [8086:1533] (rev 03) IOMMU Group 16 03:00.0 Ethernet controller [0200]: Intel Corporation I210 G= igabit Network Connection [8086:1533] (rev 03) IOMMU Group 17 04:00.0 Ethernet controller [0200]: Intel Corporation I210 G= igabit Network Connection [8086:1533] (rev 03) IOMMU Group 18 05:00.0 Ethernet controller [0200]: Intel Corporation I210 G= igabit Network Connection [8086:1533] (rev 03) IOMMU Group 19 06:00.0 PCI bridge [0604]: ASPEED Technology, Inc. AST1150 P= CI-to-PCI Bridge [1a03:1150] (rev 04) IOMMU Group 19 07:00.0 VGA compatible controller [0300]: ASPEED Technology,= Inc. ASPEED Graphics Family [1a03:2000] (rev 41) Grub: intel_iommu=3Don iommu=3Dpt pci=3Drealloc pci_pt_e820_access=3Don [1089685.120029] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count =3D= 12, Tx Queue count =3D 12 XDP Queue count =3D 0 [1089685.120334] ixgbe 0000:01:00.0: 32.000 Gb/s available PCIe bandwidth (= 5.0 GT/s PCIe x8 link) [1089685.120417] ixgbe 0000:01:00.0: MAC: 2, PHY: 15, SFP+: 7, PBA No: 0210= FF-0FF [1089685.120419] ixgbe 0000:01:00.0: 0c:c4:7a:8e:9e:70 [1089685.123311] ixgbe 0000:01:00.0: Intel(R) 10 Gigabit Network Connection [1089685.123945] libphy: ixgbe-mdio: probed [1089685.124909] ixgbe 0000:01:00.0 enp1s0f0: renamed from eth0 [1089685.193966] ixgbe 0000:01:00.0: registered PHC device on enp1s0f0 [1089685.353711] ixgbe 0000:01:00.0 enp1s0f0: detected SFP+: 7 [1089685.816670] ixgbe 0000:01:00.0 enp1s0f0: NIC Link is Up 10 Gbps, Flow = Control: RX/TX [1089685.816793] IPv6: ADDRCONF(NETDEV_CHANGE): enp1s0f0: link becomes read= y [1089688.381885] ixgbe 0000:01:00.1: Multiqueue Enabled: Rx Queue count =3D= 12, Tx Queue count =3D 12 XDP Queue count =3D 0 [1089688.382173] ixgbe 0000:01:00.1: 32.000 Gb/s available PCIe bandwidth (= 5.0 GT/s PCIe x8 link) [1089688.382267] ixgbe 0000:01:00.1: MAC: 2, PHY: 15, SFP+: 65535, PBA No: = 0210FF-0FF [1089688.382268] ixgbe 0000:01:00.1: 0c:c4:7a:8e:9e:71 [1089688.385318] ixgbe 0000:01:00.1: Intel(R) 10 Gigabit Network Connection [1089688.385422] libphy: ixgbe-mdio: probed [1089688.390327] ixgbe 0000:01:00.1 enp1s0f1: renamed from eth0 [1089688.458940] ixgbe 0000:01:00.1: registered PHC device on enp1s0f1 [1089688.566892] ixgbe 0000:01:00.1 enp1s0f1: detected SFP+: 65535 [1089711.433915] ixgbe 0000:01:00.0 enp1s0f0: SR-IOV enabled with 4 VFs [1089711.434093] ixgbe 0000:01:00.0: removed PHC on enp1s0f0 [1089711.491490] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count =3D= 4, Tx Queue count =3D 4 XDP Queue count =3D 0 [1089711.509777] ixgbe 0000:01:00.0: registered PHC device on enp1s0f0 [1089711.616376] ixgbe 0000:01:00.0: can't enable 4 VFs (bus 02 out of rang= e of [bus 01]) [1089711.616379] ixgbe 0000:01:00.0: Failed to enable PCI sriov: -12 [1089711.683690] ixgbe 0000:01:00.0 enp1s0f0: detected SFP+: 7 [1089712.108505] ixgbe 0000:01:00.0 enp1s0f0: NIC Link is Up 10 Gbps, Flow = Control: RX/TX Grub =3D intel_iommu=3Don iommu=3Dpt pci_pt_e820_access=3Don pci=3Dassign-b= usses [ 1097.055411] ixgbe 0000:01:00.0: removed PHC on enp1s0f0 [ 1097.113139] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count =3D 4= , Tx Queue count =3D 4 XDP Queue count =3D 0 [ 1097.131961] ixgbe 0000:01:00.0: registered PHC device on enp1s0f0 [ 1097.237630] ixgbe 0000:01:00.0: not enough MMIO resources for SR-IOV [ 1097.237632] ixgbe 0000:01:00.0: Failed to enable PCI sriov: -12 [ 1097.301447] ixgbe 0000:01:00.0 enp1s0f0: detected SFP+: 7 [ 1097.576271] ixgbe 0000:01:00.0 enp1s0f0: NIC Link is Up 10 Gbps, Flow Co= ntrol: RX/TX Grub: intel_iommu=3Don iommu=3Dpt pci_pt_e820_access=3Don [ 62.686491] ixgbe 0000:01:00.0 enp1s0f0: SR-IOV enabled with 4 VFs [ 62.686644] ixgbe 0000:01:00.0: removed PHC on enp1s0f0 [ 62.744406] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count =3D 4= , Tx Queue count =3D 4 XDP Queue count =3D 0 [ 62.762909] ixgbe 0000:01:00.0: registered PHC device on enp1s0f0 [ 62.869644] ixgbe 0000:01:00.0: not enough MMIO resources for SR-IOV [ 62.869646] ixgbe 0000:01:00.0: Failed to enable PCI sriov: -12 [ 62.933507] ixgbe 0000:01:00.0 enp1s0f0: detected SFP+: 7 [ 63.285637] ixgbe 0000:01:00.0 enp1s0f0: NIC Link is Up 10 Gbps, Flow Co= ntrol: RX/TX [ 75.310635] block sda: the capability attribute has been deprecated. Grub: intel_iommu=3Don iommu=3Dpt pci_pt_e820_access=3Don pci=3Drealloc [ 67.969725] ixgbe 0000:01:00.0 enp1s0f0: SR-IOV enabled with 4 VFs [ 67.969891] ixgbe 0000:01:00.0: removed PHC on enp1s0f0 [ 68.026892] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count =3D 4= , Tx Queue count =3D 4 XDP Queue count =3D 0 [ 68.045699] ixgbe 0000:01:00.0: registered PHC device on enp1s0f0 [ 68.149395] ixgbe 0000:01:00.0: can't enable 4 VFs (bus 02 out of range = of [bus 01]) [ 68.149398] ixgbe 0000:01:00.0: Failed to enable PCI sriov: -12 [ 68.213069] ixgbe 0000:01:00.0 enp1s0f0: detected SFP+: 7 [ 68.669423] ixgbe 0000:01:00.0 enp1s0f0: NIC Link is Up 10 Gbps, Flow Co= ntrol: RX/TX Any suggestions/help will be appreciated. Thanks, Nitin