From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 07331400C9; Tue, 21 Feb 2023 15:45:41 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id E3CF2431E2; Tue, 21 Feb 2023 15:45:40 +0100 (CET) Received: from mga01.intel.com (mga01.intel.com [192.55.52.88]) by mails.dpdk.org (Postfix) with ESMTP id C952F40E0F for ; Tue, 21 Feb 2023 15:45:39 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1676990740; x=1708526740; h=date:from:to:cc:subject:message-id:references: in-reply-to:mime-version; bh=bjmpsbyNHp01UuUBDcX1CNseqg3ahU8fkNJmJprMmaA=; b=C1YnAGqg+Umpbj89y7pY1Wc0IYvO4/GzQXXnnR1+m81BJTQXulDdTyKM CyeMozBN6OYc2OqYL4FYzvpWfkwfKNO/gSB9BJKPPrwcJiTTorMxAALay AaA/Rgbi5RUn9u2WSFTTChRr5IwBBpuwbwS5T+AZtxuh9JEvtJHC/T3LY Xg4TxxsqAg9y5DrKexH/8+lO6+1b6zo4lSs96AkbLHNE5bEkP/fm701b2 DNOidisBpgiguBP1g6iPTOOuo7oPOFfIxphTjVhI9/JyeUdnWHs0ElO9N e/mozaMvqBULb9imUvhqpjiYnuzsZkpZZqRUaKwlIqESdTAAI96bvhzwL A==; X-IronPort-AV: E=McAfee;i="6500,9779,10627"; a="360118073" X-IronPort-AV: E=Sophos;i="5.97,315,1669104000"; d="scan'208";a="360118073" Received: from orsmga007.jf.intel.com ([10.7.209.58]) by fmsmga101.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 21 Feb 2023 06:45:31 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6500,9779,10627"; a="665000026" X-IronPort-AV: E=Sophos;i="5.97,315,1669104000"; d="scan'208";a="665000026" Received: from orsmsx601.amr.corp.intel.com ([10.22.229.14]) by orsmga007.jf.intel.com with ESMTP; 21 Feb 2023 06:45:31 -0800 Received: from orsmsx610.amr.corp.intel.com (10.22.229.23) by ORSMSX601.amr.corp.intel.com (10.22.229.14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16; Tue, 21 Feb 2023 06:45:31 -0800 Received: from ORSEDG602.ED.cps.intel.com (10.7.248.7) by orsmsx610.amr.corp.intel.com (10.22.229.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16 via Frontend Transport; Tue, 21 Feb 2023 06:45:31 -0800 Received: from NAM12-BN8-obe.outbound.protection.outlook.com (104.47.55.172) by edgegateway.intel.com (134.134.137.103) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.16; Tue, 21 Feb 2023 06:45:30 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=ccyrgQ9jEzMbH/PvKVrzAGCzJ8vdhhJSsW/5rsgu7W9EzNWClvh86kYreYhU0t/8tFCbexppFSk8lk0Hk0m1q75rnEKMk6oD6P9DHnmWJnOnW6emu9k5eMfmzbYE7uqaAjl8g59XSZDAshtZ82RL7JBulVplhqZKDk6T1+kHHPB6nt5BR6NhxfBR4XkM7xtmb7E7TaXwyw0X4SlHmmLXLLe+3WGvaKG26CFVf8uYPLHJO8wa022/Gv+6IzcB+Y2KArMb6AYjFkfxpXW9SxxtYDd/ULdh0QdKKHk6eT8tY63bBlsjC4/dI9B1QtYTYbG9ipQTAI19Dp+vngm1jl0uRQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=xFlJd85WtjJeVtG9zv0pfIy/A6CPcwur+hAIBx9Sb+s=; b=SNgNOmtAi5dL+PTvUKoNV0Oo8WcegwfS/n7FDL02uWtHVej4ohHF3K8kY/U5ek3hhy5CFJSCPWFbEo74Z+AAXIK5CQSM/P4xq2WTHXzKYJ+VspxhDJ/0vpgvW+op/Lno1QNKmebsoP/KvvaBebRRfng2vmtCYxsf8TKaDIOAuPM6k/sQQWPQh/Ksj2h7Z/zykpVSJQ/yEIDUtw8rDUfBH2xwfZb4zs9okOEhsxVW3SUD1bwnKHaWkgiltgEeaTf33DOn8UMZ7VJDlzMz7Li1wCsRrdTOpYseTYz8fi/NFJUP6svRPhwLBoRSAHsBlJxZafUwLrkUmdvJ5YNdqitjpw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; Received: from DS0PR11MB7309.namprd11.prod.outlook.com (2603:10b6:8:13e::17) by SJ2PR11MB7648.namprd11.prod.outlook.com (2603:10b6:a03:4c3::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6111.19; Tue, 21 Feb 2023 14:45:28 +0000 Received: from DS0PR11MB7309.namprd11.prod.outlook.com ([fe80::aaba:abb7:8794:def]) by DS0PR11MB7309.namprd11.prod.outlook.com ([fe80::aaba:abb7:8794:def%7]) with mapi id 15.20.6111.021; Tue, 21 Feb 2023 14:45:28 +0000 Date: Tue, 21 Feb 2023 14:45:23 +0000 From: Bruce Richardson To: Nagendra Prabhu A T CC: , , Subject: Re: unable to bind to vfio-pci Message-ID: References: Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: X-ClientProxiedBy: LO3P265CA0005.GBRP265.PROD.OUTLOOK.COM (2603:10a6:600:bb::10) To DS0PR11MB7309.namprd11.prod.outlook.com (2603:10b6:8:13e::17) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DS0PR11MB7309:EE_|SJ2PR11MB7648:EE_ X-MS-Office365-Filtering-Correlation-Id: acdd3625-0ee7-4319-eea7-08db141a4644 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: YGfxmrxQLIvK9JeIfedotHa4ZfqY7WNsIP8l6aLNKwqpLJwnjFVTQiiWJJL1fMrCdNCO1Cg3HikEHR3+5rTE94GmcYY0jE2Es+hYAzgKjcfSFxg0Z0CMsYmU3fFXGxg1ushwmcUisV4IgHs4ORF9344/dHBxm/FF5qy2UKi1KED3KVeGoBxeiEEpwP28bFNXorUcuf82TaMMsYw1Ud18w4/iwzDdZiNU2Rb5o0uVIBsXX0UB+d4aSid08vevl4bVzlbggWK/5MDX1iyJAzPwfq2FfDqR5XKd8P+UCo7afmzcXKIoaqayeSKlqAzmFIh2xixv4DxP+sTOfooyJl5V7i2Ar9F/CeLWUV2yRR/Kj+OFkE95iEQeHOsA5foDnE2+clwe9WJ4vxeDf+66c2pFdPIeEXGkOAlnwJ3oNibEI/fFjVr+BGzni6nxYdF8nb0YoqP9P13afoWy8fmCcas157lWorIZSjVKa92fSHWiWTb+dWGmR93o8tEVCZju+qYsydwE8EwYieZ+sk/0yc5gjdHBPqx9bNIuiGGjIC7a2u2RFEQpRSVLIgWV13MN/pexZDc43EGuu3gNmMbsHu0WzRMzWe6ijEx1cbKt/MF+4weph1KSZYQ2U64ioGEk1woSO0vthkP15oefmm4iKWEtbA== X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DS0PR11MB7309.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230025)(39860400002)(366004)(136003)(376002)(346002)(396003)(451199018)(82960400001)(6506007)(6666004)(478600001)(6486002)(4326008)(186003)(41300700001)(316002)(8676002)(6512007)(66556008)(66946007)(66476007)(26005)(2906002)(38100700002)(5660300002)(8936002)(44832011)(86362001)(83380400001)(6916009); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?GLnxbZR4vpkGXZLsTG+oSwCIDs6lJMG7BF/Bu/nRTrVlT9/rBg+ZKmqmtLjq?= =?us-ascii?Q?RijdnD3atemodtXNKhUiPdl87DcB0xxh1YyTKHfAJmmFgD7QhOFyMqcm2/aA?= =?us-ascii?Q?iyODWeQUpEjsQOVBRdxmOVzitaGhirjcAtgcP4hFCMXhB2vB9JOEgLGxUYBW?= =?us-ascii?Q?hT0+urPBFGG3TzA+36J3GWpEhGgYx5L4+/w8CcAXTEzv5exw81BvR3qC7Ukc?= =?us-ascii?Q?JsfNxlPb4NhWm/UDBGaxUieW5rZxDk6R516DE38tlv5ykH81bIpi0vEANLMq?= =?us-ascii?Q?ks54tfGkIg3QQ5vtbpoJoeZsC9YbtTnzViy4NOsXyF6LVtJYD7/tFGI+cebF?= =?us-ascii?Q?Tu6e2tKHipCPAaXQXxhSPWlxZHztpQ0ROluscrIza1I8x1o++buIm+xkXDsp?= =?us-ascii?Q?Jn7d0IMKJpxyWIakT80iSdjmIK9QS/IDgb441zoswwV3ZvA7UfHXw4jKM7Ff?= =?us-ascii?Q?wxmd8zcAmmfdvOGnzCPmVqXBLdSnSZ053cAsUq3T6Hra8/hCNlQ2jrGMPdHI?= =?us-ascii?Q?MhjE8z4xVYNZQQRCPXG26KRnan5/LF+e2i6jugSR8zeH3NOcOqS2f+0uJ3uL?= =?us-ascii?Q?Rzb1MBZsmodFPq25kmhpH8zPjMGv6LdOn+W1CKCXBvRTpEkDNBTZkbgL7Unx?= =?us-ascii?Q?2id79VZFNoK7LRrQgvtdObryU4Xs+VAUpXmEGdWT8x5zW/hIX8zRkyfCiS04?= =?us-ascii?Q?n4VOz8aF5nlSehFiU6rvFkD2GBm1bLW30OFszB3KVFHxMjCsw1IMTSHHbV/F?= =?us-ascii?Q?a++VbtWbw2xFKcS8DrU4X9JF8PzTLNPB/deMazwE02vhpah511wgobNv1Pp6?= =?us-ascii?Q?k6EXFq8noEgdCtTYkwloo9H+kmqumPFgdmbmcQMqCjcgYOcx/8rwj0bQRbXl?= =?us-ascii?Q?YdXy+IaV8BwmKBIrtYEyH3TyJEzpM2QKppLjgq0//mVLJO354Et3bOiiNw3F?= =?us-ascii?Q?X6hjIYkv6UxUKbdrXbTeo9x5tRoOde731808gGWeluuoLlbelk8FB8ZtPtG0?= =?us-ascii?Q?41CGP3X3bv1kWBhelyeL4Lgf2LIn9OWkV7IWINM41xZkW5C0o1S3TLbMLroH?= =?us-ascii?Q?/7UuKxW4IDiCGAQyLqNp1i0a0QwpMmHiWcQkQW5p2sfMVEoHonj2ETb3zqT5?= =?us-ascii?Q?d+v+k3Iy+IZCA9pV/5Z1iLJoNfBBLD7DsNDe40vThCqSGLVqQ3wR2fwNhMjJ?= =?us-ascii?Q?Og1knqt6saa39ryiENaKZX56qSXZ5I+HxdlKtewJMDyoNYXr4PYzgfSayjhh?= =?us-ascii?Q?lZK3ca7LNJIOf+dg1eH0P+PXLqtIe8u8uGZiEjMRtI5hjozUOEPB6RLeKveT?= =?us-ascii?Q?l26MgpDJmVwbp8/QOdQhsbz7juv5QUXexk0HejVEhdBHDf+5LAm26Oi6Hm5t?= =?us-ascii?Q?dVcAjN67srjUMXe/ExEOT6fjO9ff6NdONJ6L9B+Pw5CpZBzMPZYsqHJYUuLN?= =?us-ascii?Q?3O1rkBlQ31Zfeg4PEE2NnMdm/vKh8+/aWFuuQUyYn2ppQKBpTvLC/nV056Kc?= =?us-ascii?Q?U9HjL5Jobjd4FW4mxkDNpLrGTFgkEzpQq1Kj2+uyZ27hz/wSPR73QCBYSBKC?= =?us-ascii?Q?Wq+skVEs1mO1l+aeS2moP3rDWEN/sxq5k5x0ZBPMd8daQ9IHWLIXTaWXqXQO?= =?us-ascii?Q?qJwRk7HzxT+ZAlAyqegp5Qw=3D?= X-MS-Exchange-CrossTenant-Network-Message-Id: acdd3625-0ee7-4319-eea7-08db141a4644 X-MS-Exchange-CrossTenant-AuthSource: DS0PR11MB7309.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Feb 2023 14:45:28.6185 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: U/y2rsxdBEIeEO/uLABf32hF9X7Z7KA+/cwyKv4Le3x2Q0Is+knr5sb7qldLV13yUSODQkEupK3/rtMKQAcQq+W52sINCfAmlx0ev8mEWls= X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ2PR11MB7648 X-OriginatorOrg: intel.com X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On Tue, Feb 21, 2023 at 08:05:20PM +0530, Nagendra Prabhu A T wrote: > Hi All, > I am trying to bind vfio-pci using dpdk-devbind.py, But i am seeing teh > following error : > root@nat-kvm:/usr/src/dpdk-22.11/usertools# dpdk-devbind.py > --bind=vfio-pci 0000:51:00.0 Error: bind failed for 0000:51:00.0 - > Cannot bind to driver vfio-pci: [Errno 22] Invalid argument > root@nat-kvm:/usr/src/dpdk-22.11/usertools# > I see that Sarosh has faced the same issue earlier. I saw the mail > thread and followed all the steps mentioned there. But it dint help. > Can you please help. An error like that I would attribute to one of two possible likely causes. [There may be other causes, but these two come to mind immediately]. 1. No IOMMU available for use. In this case you need to enable no-iommu mode for VFIO and see if that works. 2. You have other ports on the same card bound to a kernel driver. You cannot use one port bound to the kernel (and therefore using IOMMU mappings for the kernel), while another port on the same card is bound to userspace vfio (and therefore looking for userspace IOMMU mappings). If this is the case, you need to unbind the other port from the kernel, and leave it unbound or else also bound to vfio. It's possible that no-iommu mode may help here too, but I have never tested that. Regards, /Bruce