From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 6104B43A6C for ; Mon, 5 Feb 2024 04:22:22 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id D0D2B402BE; Mon, 5 Feb 2024 04:22:21 +0100 (CET) Received: from mgamail.intel.com (mgamail.intel.com [192.198.163.15]) by mails.dpdk.org (Postfix) with ESMTP id D796D400D6 for ; Mon, 5 Feb 2024 04:22:19 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1707103340; x=1738639340; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=QnQFm7s2dnidnxvMCyE9BMcJZHJbc1DWlnrXsZ5mGNY=; b=YYEJSy6H3YSfo0SZRZTpsrOAXqSWeW83EJSNwXJKhCDPNkNL7R4lcWwA XI8qUgAP2W5LpdBN90Bm1XO+8Kl6uM7JLLAW7nPCPiXxvMNJ4hUhBXp5R QfJceE8pEPtNaMBCy8sYgl7jjv6SEj+lrGvE/WQApz/sXzXudirNb9QMZ qkOFe09eAIgP/FPdoGluxPQVAYMhPOxgWV/bdCzTeX+fyKkDXjPKNh65c BFyMs1r5TflBbnEKVWEAr5B9sYit94WzemQKod3ODNS6tbEtaGetwnlsU Spu7eDKD286cDfMyFZ46Tv8FnlQrqkzisRSiP5vX+A4x41cES7O5dnH8L g==; X-IronPort-AV: E=McAfee;i="6600,9927,10974"; a="597984" X-IronPort-AV: E=Sophos;i="6.05,242,1701158400"; d="scan'208";a="597984" Received: from orviesa008.jf.intel.com ([10.64.159.148]) by fmvoesa109.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 04 Feb 2024 19:22:19 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.05,242,1701158400"; d="scan'208";a="929458" Received: from fmsmsx601.amr.corp.intel.com ([10.18.126.81]) by orviesa008.jf.intel.com with ESMTP/TLS/AES256-GCM-SHA384; 04 Feb 2024 19:22:18 -0800 Received: from fmsmsx610.amr.corp.intel.com (10.18.126.90) by fmsmsx601.amr.corp.intel.com (10.18.126.81) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35; Sun, 4 Feb 2024 19:22:17 -0800 Received: from fmsedg602.ED.cps.intel.com (10.1.192.136) by fmsmsx610.amr.corp.intel.com (10.18.126.90) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35 via Frontend Transport; Sun, 4 Feb 2024 19:22:17 -0800 Received: from NAM11-DM6-obe.outbound.protection.outlook.com (104.47.57.169) by edgegateway.intel.com (192.55.55.71) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.35; Sun, 4 Feb 2024 19:22:17 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=VO+uMl+dit9tXnGWl7jcXTEQV4YHg7FfR7JAttkEpDmEim0vaaBakIZicourhkq4Forge7oehsSk51yquBq2qkH8KPaWFaEVeAF0V45+a1nV+4zJoZ3naCGEjxmlsSzjz3zlLMyZLi3PfGAnE1zuDhweWNcIupP7p8t7mX8EYtbVIzI/AJUi4+3oSMZspVbupCqx5uDLbecZclI5DmeA9+PSC68q88LWTen+nwpOSVS8tdinorFc7TLuWvGMDmLtlEtPDm10PJKiLixctyZ3x4e7Wg7ZISH2gzBzOz098SNGLdiHjCCnbBCUtSkfuJFtILW1T2Q1YolXjKy/ewvRYQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=9Khg+gkIQ6boJ6OjClmtU2osrgSf6/UiIJBlvGLxNTY=; b=lk/eJhfJZzxx39AjKd4NYOTC4t9+y7/i6j6gnyEGn/yjaKEQNjdE2lh+UOndEBTGXnU26utGbOzD9qZrCV6izgD5MsizjS3DOcCWd9GH+u61LOXaUetp5R+a1UVK4tudmq80J8Y/8vTNi6vZWxj2MJZJi+1bMdQg1uQKxj+YlqXprubCdjGiPk4DO2ULzf6xBCJtWx6uMJMY3Vc1UOhLXN0kKYZq7/DISvHfzEofVUtz1e6YVLRG0GMAZc0UAk//Zf4cp+BWU82I1Toq66n3lkdeaRrkpdvRq/v6zdeqDWYPg8cDF9+fV2xrvyIaH+y7oI24+R5oylMJ08P6TopWXw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from SJ0PR11MB5630.namprd11.prod.outlook.com (2603:10b6:a03:3bb::6) by SJ2PR11MB7715.namprd11.prod.outlook.com (2603:10b6:a03:4f4::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7249.34; Mon, 5 Feb 2024 03:22:15 +0000 Received: from SJ0PR11MB5630.namprd11.prod.outlook.com ([fe80::6e9:fd79:48d7:891]) by SJ0PR11MB5630.namprd11.prod.outlook.com ([fe80::6e9:fd79:48d7:891%3]) with mapi id 15.20.7249.032; Mon, 5 Feb 2024 03:22:15 +0000 From: "Yang, Tao Y" To: Nitin Katiyar , "users@dpdk.org" CC: "Yang, Tao Y" Subject: RE: Failed to enable SRIOV Thread-Topic: Failed to enable SRIOV Thread-Index: AdpPaWT5XhuJhU9TRNGsf6c9mUgLQgHy8UgwACtLSSA= Date: Mon, 5 Feb 2024 03:22:15 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: SJ0PR11MB5630:EE_|SJ2PR11MB7715:EE_ x-ms-office365-filtering-correlation-id: 4c8ca879-777e-41a2-55de-08dc25f9a6c4 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: z4/rE9RvXANsxpnlPswp/rT4BUJ350peSxvc+4KfbfRYNgfKFC9rqXxVzlRhNooeYbsyqtr6MUHR63gO2h/HpIZLzOTSgjkPInkjEqpvo3AJiFj5MTeeql7VDlNAk1BwlPBgA88nf4h3GnDgWPi0TizeBNjBBRQmQgHBkChA+cpos9DFjOfaODBWDlIm53ByiuD8DSaWX6/7BcRMoSwcj2kXDkU1BXrE+rf20Tq6jvYivKDDT4OWgyPvOjzjQF/FIbujAxG5KGq9hHh27GomFEKFhYVfCuCkr5qGuX9XtjWEMUfcNHny6OIHop+zadekNCq0NuVDoI1//5liWx1sbnaQBb1ZvI6CXZsZ6gSLmxXUWx1ZVadI1fDjzlHEHecRIXydENTdZeOAt1qSj3V8I+O3WHeWKR5ENcRtG0DF3GVfOAnuX8j25D0Nrj/0V2xaRoBONCoAV9wkNe11sW5uvZ7FEfgvl+jjOuILWXd6j/sLpRhFJewXpUbaos8bw1qkzCc9cQG9tv594jc2bRY/3YjP7uGt3g4CIb0VaPS8/y1FQCjxmwr2NmQ1Mh6fjXuJ2/bxuMP0h+3RY/fYT81WAuhi4dI7ek6o5PFcuJnqraZ8Nq6ypKBkVOr6ZxQqQXzL x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SJ0PR11MB5630.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031)(136003)(376002)(346002)(39860400002)(366004)(396003)(230922051799003)(186009)(1800799012)(451199024)(64100799003)(3480700007)(66574015)(107886003)(26005)(83380400001)(82960400001)(41300700001)(8676002)(38100700002)(122000001)(316002)(8936002)(4326008)(110136005)(76116006)(6506007)(66476007)(66556008)(52536014)(30864003)(2906002)(64756008)(66946007)(5660300002)(66446008)(71200400001)(53546011)(9686003)(478600001)(86362001)(38070700009)(7696005)(33656002)(55016003); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?OtHhh5kK9tTIG7S+gOgmFe8OK/g/IMeBMBLWIaZdtTysbJ6686uMd7epTPCF?= =?us-ascii?Q?aU+tjNtp21/wbg7LTTY/uWN5I3KWU7zE7U01EyuMhZv8K2tvgby0BXw+se51?= =?us-ascii?Q?oHWf8OsqLuydfMfMlii3/6CArflDDRyrOD1F3L1ngC/ff3keddOLtGHpmcOu?= =?us-ascii?Q?HZn0lwTCpwgG7mCNTJ9ksRNQuH6msHRJCEnbq1nCdob444V4sWb56pT612Jy?= =?us-ascii?Q?XLWAgGMecJzrLG6BShU69p8Vhlwx/rfCehSS8iaRNpFUEkJ/fk6Ue+aDe2SZ?= =?us-ascii?Q?SWoYrBUqRyVlTRUXJMQgqEMaOHZW6mxWXdQGrXHmLutWvaJ6PSLa/bu44AsX?= =?us-ascii?Q?N2qIOSz31tVlUkXLEnQ4ZZjMtFlgxuaWzuWW4BDs3a0GcK83pZlR2aoCvoqk?= =?us-ascii?Q?H1vCV1fmP2kp9FaAAc/MdzAufjiA3kKVqsMswjU6SKlryfbRAn3x0clLWpZo?= =?us-ascii?Q?vYT1jPPS67bT4w2zCC/7X92pKP+R3/k9PtARFhPzoMBQ6FURYq1L8wuM2+fr?= =?us-ascii?Q?M/SlwQWEGquCpIIxs5A2x5VtU9dSPEcOgYvCgkmccH9eHYcVtfPr3tff6xMA?= =?us-ascii?Q?MGM8bjKB+QCLpDCZWzFhr8/XyTw47feH4qD2PF1E7j0VG/Wr6IooTnq+0HUO?= =?us-ascii?Q?uNLCnV0BDUAvKIWSdW+9bfW+vRZAZV9cFnn4vNyjqoAY4DRlC+eXNgVdAmPp?= =?us-ascii?Q?hYwow/NEvlHDmDmhsek/EbOJprl5Bm3YMxjPXmsZNawpsuy6KuY7BTj+yA3z?= =?us-ascii?Q?YNlXn61yEwGVhY3Nh0esbasVhuZxkUTPLUtRacqAbv+X5ZqjNadyRhBgO0Jl?= =?us-ascii?Q?jiMd3cGmT9pnrp+IPJAULGtq3eXibHYIZvtE9h7qyCVQU7liRSh4OUYQZ6ah?= =?us-ascii?Q?Lz3nJXulgJRsrbbgQ1B/1kJJ5vP9KjVbT264/tWEJL406aWObQew76Z5dX0o?= =?us-ascii?Q?sYPI4eX2IAePo6Jvs/G079PCpDdfKKDEKx46jNJR6KdgNYQS6ojQePNRTie4?= =?us-ascii?Q?3X/4z9qGUwaSVYrA46a/ry9YSL23yPoo8XLnVMN2lqF9EsnUx4hZCkCh7bTf?= =?us-ascii?Q?tSUo2hEktuUNa+B+3GXyWwX9fv606k5XS3AQBQi0Hjlb3yAR0eBQsiv6G09u?= =?us-ascii?Q?DeYTIKbVnXQ8Wh7KumUwZOptwna8wSNmULL3Xn49wuHPcLwHlfc/+6a0kUwj?= =?us-ascii?Q?AM8jBf1GkMvKxOikwmExKlSMPNiQFks1z71OAquuawYzG07TR0PwE6K9hGdL?= =?us-ascii?Q?qTeku8G4D0VPc5mlccMUFbVTGiIem4f5bxviyCCxzFmWSn0B+UxUJWc/RU2j?= =?us-ascii?Q?5NGHtQwZUThHIFNxOl1CS21NgGzaaFpkr+Ls7nKg0PgHXiJXtAFzlYufXjCH?= =?us-ascii?Q?YjTF2TuMLn5LSjGGGAiRO4rrI1b172LenBLFRRSank2UfI++wM1gH0NdNHPB?= =?us-ascii?Q?Bsn+F6o6LUnIT4NhNkxZDUYd0EDtWAUqPHSAD8XM5o932xd8Fhwg8wORcA63?= =?us-ascii?Q?uy6PBDeNWr68AwGZ5Ta3OnuYXIdbgDPLmd9rP1qo3jSLulEGuFFaG0aRzotj?= =?us-ascii?Q?zb5w8i3LKCN0Sd/R9FGPBhYpX24gQQIv3NU1oqhL?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SJ0PR11MB5630.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 4c8ca879-777e-41a2-55de-08dc25f9a6c4 X-MS-Exchange-CrossTenant-originalarrivaltime: 05 Feb 2024 03:22:15.4718 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: L35in4nvH+q1rLehw4FpPjnO3tcGKzPTqx6tzSb+pgy9Di2DPgT38fdo9MVoZRVjH2Z/arTBrdgWPloswWs71Q== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ2PR11MB7715 X-OriginatorOrg: intel.com X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org This should relate with your server BIOS,=20 It doesn't reserve enough PCIe resource for the NIC to create VF. [ 62.869644] ixgbe 0000:01:00.0: not enough MMIO resources for SR-IOV -----Original Message----- From: Nitin Katiyar =20 Sent: Sunday, February 4, 2024 2:44 PM To: users@dpdk.org Subject: RE: Failed to enable SRIOV Hi, Any suggestions? I tried with Centos 7 also and it has the same issue. Regards, Nitin -----Original Message----- From: Nitin Katiyar=20 Sent: Thursday, January 25, 2024 2:44 PM To: users@dpdk.org Subject: Failed to enable SRIOV Hi, I am trying to enable SR-IOV on linux server (details below) and it throws = following error: # echo '4' > /sys/class/net/enp1s0f0/device/sriov_numvfs -bash: echo: write error: Cannot allocate memory I went through some of articles on internet and it suggested some grub chan= ges for pci but none of them helped. Following are the details of system an= d error System details: ------------------- Rocky Linux release 9.3 (Blue Onyx) model name : Intel(R) Xeon(R) E-2236 CPU @ 3.40GHz flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca = cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx p= dpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopo= logy nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx s= mx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe po= pcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch= cpuid_fault epb invpcid_single pti ssbd ibrs ibpb stibp tpr_shadow flexpri= ority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid = mpx rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves dthe= rm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp vnmi md_clear flu= sh_l1d arch_capabilities vmx flags : vnmi preemption_timer invvpid ept_x_only ept_ad ept_1gb f= lexpriority tsc_offset vtpr mtf vapic ept vpid unrestricted_guest ple shado= w_vmcs pml ept_mode_based_exec ixgbe ver: 5.14.0-362.8.1.el9_3.x86_64=20 [root@server221 dpdk-stable-22.11.1]# uname -r 5.14.0-362.8.1.el9_3.x86_64 # for d in $(find /sys/kernel/iommu_groups/ -type l | sort -n -k5 -t/); do = n=3D${d#*/iommu_groups/*}; n=3D${n%%/*}; printf 'IOMMU Group %s ' "$n"; lsp= ci -nns "${d##*/}"; done; IOMMU Group 0 00:00.0 Host bridge [0600]: Intel C= orporation 8th Gen Core Processor Host Bridge/DRAM Registers [8086:3eca] (r= ev 07) IOMMU Group 1 00:01.0 PCI bridge [0604]: Intel Corporation 6th-10th = Gen Core Processor PCIe Controller (x16) [8086:1901] (rev 07) IOMMU Group 1= 01:00.0 Ethernet controller [0200]: Intel Corporation 82599ES 10-Gigabit S= FI/SFP+ Network Connection [8086:10fb] (rev 01) IOMMU Group 1 01:00.1 Ether= net controller [0200]: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Networ= k Connection [8086:10fb] (rev 01) IOMMU Group 2 00:08.0 System peripheral [= 0880]: Intel Corporation Xeon E3-1200 v5/v6 / E3-1500 v5 / 6th/7th/8th Gen = Core Processor Gaussian Mixture Model [8086:1911] IOMMU Group 3 00:12.0 Sig= nal processing controller [1180]: Intel Corporation Cannon Lake PCH Thermal= Controller [8086:a379] (rev 10) IOMMU Group 4 00:14.0 USB controller [0c03= ]: Intel Corporation Cannon Lake PCH USB 3.1 xHCI Host Controller [8086:a36= d] (rev 10) IOMMU Group 4 00:14.2 RAM memory [0500]: Intel Corporation Cann= on Lake PCH Shared SRAM [8086:a36f] (rev 10) IOMMU Group 5 00:15.0 Serial b= us controller [0c80]: Intel Corporation Cannon Lake PCH Serial IO I2C Contr= oller #0 [8086:a368] (rev 10) IOMMU Group 5 00:15.1 Serial bus controller [= 0c80]: Intel Corporation Cannon Lake PCH Serial IO I2C Controller #1 [8086:= a369] (rev 10) IOMMU Group 6 00:16.0 Communication controller [0780]: Intel= Corporation Cannon Lake PCH HECI Controller [8086:a360] (rev 10) IOMMU Gro= up 6 00:16.4 Communication controller [0780]: Intel Corporation Cannon Lake= PCH HECI Controller #2 [8086:a364] (rev 10) IOMMU Group 7 00:17.0 SATA con= troller [0106]: Intel Corporation Cannon Lake PCH SATA AHCI Controller [808= 6:a352] (rev 10) IOMMU Group 8 00:1b.0 PCI bridge [0604]: Intel Corporation= Cannon Lake PCH PCI Express Root Port #21 [8086:a32c] (rev f0) IOMMU Group= 9 00:1b.5 PCI bridge [0604]: Intel Corporation Cannon Lake PCH PCI Express= Root Port #22 [8086:a32d] (rev f0) IOMMU Group 10 00:1b.6 PCI bridge [0604= ]: Intel Corporation Cannon Lake PCH PCI Express Root Port #23 [8086:a32e] = (rev f0) IOMMU Group 11 00:1b.7 PCI bridge [0604]: Intel Corporation Cannon= Lake PCH PCI Express Root Port #24 [8086:a32f] (rev f0) IOMMU Group 12 00:= 1c.0 PCI bridge [0604]: Intel Corporation Cannon Lake PCH PCI Express Root = Port #1 [8086:a338] (rev f0) IOMMU Group 13 00:1e.0 Communication controlle= r [0780]: Intel Corporation Cannon Lake PCH Serial IO UART Host Controller = [8086:a328] (rev 10) IOMMU Group 14 00:1f.0 ISA bridge [0601]: Intel Corpor= ation Device [8086:a30a] (rev 10) IOMMU Group 14 00:1f.4 SMBus [0c05]: Inte= l Corporation Cannon Lake PCH SMBus Controller [8086:a323] (rev 10) IOMMU G= roup 14 00:1f.5 Serial bus controller [0c80]: Intel Corporation Cannon Lake= PCH SPI Controller [8086:a324] (rev 10) IOMMU Group 15 02:00.0 Ethernet co= ntroller [0200]: Intel Corporation I210 Gigabit Network Connection [8086:15= 33] (rev 03) IOMMU Group 16 03:00.0 Ethernet controller [0200]: Intel Corpo= ration I210 Gigabit Network Connection [8086:1533] (rev 03) IOMMU Group 17 = 04:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit Network = Connection [8086:1533] (rev 03) IOMMU Group 18 05:00.0 Ethernet controller = [0200]: Intel Corporation I210 Gigabit Network Connection [8086:1533] (rev = 03) IOMMU Group 19 06:00.0 PCI bridge [0604]: ASPEED Technology, Inc. AST11= 50 PCI-to-PCI Bridge [1a03:1150] (rev 04) IOMMU Group 19 07:00.0 VGA compat= ible controller [0300]: ASPEED Technology, Inc. ASPEED Graphics Family [1a0= 3:2000] (rev 41) Grub: intel_iommu=3Don iommu=3Dpt pci=3Drealloc pci_pt_e820_access=3Don [1089685.120029] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count =3D= 12, Tx Queue count =3D 12 XDP Queue count =3D 0 [1089685.120334] ixgbe 000= 0:01:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [10= 89685.120417] ixgbe 0000:01:00.0: MAC: 2, PHY: 15, SFP+: 7, PBA No: 0210FF-= 0FF [1089685.120419] ixgbe 0000:01:00.0: 0c:c4:7a:8e:9e:70 [1089685.123311]= ixgbe 0000:01:00.0: Intel(R) 10 Gigabit Network Connection [1089685.123945= ] libphy: ixgbe-mdio: probed [1089685.124909] ixgbe 0000:01:00.0 enp1s0f0: = renamed from eth0 [1089685.193966] ixgbe 0000:01:00.0: registered PHC devic= e on enp1s0f0 [1089685.353711] ixgbe 0000:01:00.0 enp1s0f0: detected SFP+: = 7 [1089685.816670] ixgbe 0000:01:00.0 enp1s0f0: NIC Link is Up 10 Gbps, Flo= w Control: RX/TX [1089685.816793] IPv6: ADDRCONF(NETDEV_CHANGE): enp1s0f0: = link becomes ready [1089688.381885] ixgbe 0000:01:00.1: Multiqueue Enabled:= Rx Queue count =3D 12, Tx Queue count =3D 12 XDP Queue count =3D 0 [108968= 8.382173] ixgbe 0000:01:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/= s PCIe x8 link) [1089688.382267] ixgbe 0000:01:00.1: MAC: 2, PHY: 15, SFP+:= 65535, PBA No: 0210FF-0FF [1089688.382268] ixgbe 0000:01:00.1: 0c:c4:7a:8e= :9e:71 [1089688.385318] ixgbe 0000:01:00.1: Intel(R) 10 Gigabit Network Con= nection [1089688.385422] libphy: ixgbe-mdio: probed [1089688.390327] ixgbe = 0000:01:00.1 enp1s0f1: renamed from eth0 [1089688.458940] ixgbe 0000:01:00.= 1: registered PHC device on enp1s0f1 [1089688.566892] ixgbe 0000:01:00.1 en= p1s0f1: detected SFP+: 65535 [1089711.433915] ixgbe 0000:01:00.0 enp1s0f0: = SR-IOV enabled with 4 VFs [1089711.434093] ixgbe 0000:01:00.0: removed PHC = on enp1s0f0 [1089711.491490] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Que= ue count =3D 4, Tx Queue count =3D 4 XDP Queue count =3D 0 [1089711.509777]= ixgbe 0000:01:00.0: registered PHC device on enp1s0f0 [1089711.616376] ixg= be 0000:01:00.0: can't enable 4 VFs (bus 02 out of range of [bus 01]) [1089= 711.616379] ixgbe 0000:01:00.0: Failed to enable PCI sriov: -12 [1089711.68= 3690] ixgbe 0000:01:00.0 enp1s0f0: detected SFP+: 7 [1089712.108505] ixgbe = 0000:01:00.0 enp1s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX Grub =3D intel_iommu=3Don iommu=3Dpt pci_pt_e820_access=3Don pci=3Dassign-b= usses [ 1097.055411] ixgbe 0000:01:00.0: removed PHC on enp1s0f0 [ 1097.113139] i= xgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count =3D 4, Tx Queue count= =3D 4 XDP Queue count =3D 0 [ 1097.131961] ixgbe 0000:01:00.0: registered = PHC device on enp1s0f0 [ 1097.237630] ixgbe 0000:01:00.0: not enough MMIO r= esources for SR-IOV [ 1097.237632] ixgbe 0000:01:00.0: Failed to enable PCI= sriov: -12 [ 1097.301447] ixgbe 0000:01:00.0 enp1s0f0: detected SFP+: 7 [ = 1097.576271] ixgbe 0000:01:00.0 enp1s0f0: NIC Link is Up 10 Gbps, Flow Cont= rol: RX/TX Grub: intel_iommu=3Don iommu=3Dpt pci_pt_e820_access=3Don [ 62.686491] ixgbe 0000:01:00.0 enp1s0f0: SR-IOV enabled with 4 VFs [ 62.686644] ixgbe 0000:01:00.0: removed PHC on enp1s0f0 [ 62.744406] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count =3D 4= , Tx Queue count =3D 4 XDP Queue count =3D 0 [ 62.762909] ixgbe 0000:01:00.0: registered PHC device on enp1s0f0 [ 62.869644] ixgbe 0000:01:00.0: not enough MMIO resources for SR-IOV [ 62.869646] ixgbe 0000:01:00.0: Failed to enable PCI sriov: -12 [ 62.933507] ixgbe 0000:01:00.0 enp1s0f0: detected SFP+: 7 [ 63.285637] ixgbe 0000:01:00.0 enp1s0f0: NIC Link is Up 10 Gbps, Flow Co= ntrol: RX/TX [ 75.310635] block sda: the capability attribute has been deprecated. Grub: intel_iommu=3Don iommu=3Dpt pci_pt_e820_access=3Don pci=3Drealloc [ 67.969725] ixgbe 0000:01:00.0 enp1s0f0: SR-IOV enabled with 4 VFs [ 67.969891] ixgbe 0000:01:00.0: removed PHC on enp1s0f0 [ 68.026892] ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count =3D 4= , Tx Queue count =3D 4 XDP Queue count =3D 0 [ 68.045699] ixgbe 0000:01:00.0: registered PHC device on enp1s0f0 [ 68.149395] ixgbe 0000:01:00.0: can't enable 4 VFs (bus 02 out of range = of [bus 01]) [ 68.149398] ixgbe 0000:01:00.0: Failed to enable PCI sriov: -12 [ 68.213069] ixgbe 0000:01:00.0 enp1s0f0: detected SFP+: 7 [ 68.669423] ixgbe 0000:01:00.0 enp1s0f0: NIC Link is Up 10 Gbps, Flow Co= ntrol: RX/TX Any suggestions/help will be appreciated. Thanks, Nitin