From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id EDB3841D30; Tue, 21 Feb 2023 17:27:42 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id DD5E643203; Tue, 21 Feb 2023 17:27:42 +0100 (CET) Received: from mga17.intel.com (mga17.intel.com [192.55.52.151]) by mails.dpdk.org (Postfix) with ESMTP id F3E6243202 for ; Tue, 21 Feb 2023 17:27:40 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1676996861; x=1708532861; h=date:from:to:cc:subject:message-id:references: in-reply-to:mime-version; bh=qFRtwZwcG9LKdhRnNz9f9g0qm9zto81H9tDKoWOjkvE=; b=EwQ/lERqCwj2FBJQ5Ace4TLDVEdgSXzOu1Y6DbShmr/TDd/3Q61OV98c KYIkWFbyVKpiUCgaw6gmrSzFzsm3J/4XJi7yLIGPzXq1hI3WgVwzmbjuZ wEqEyQBjxWYaRucYA9Z+e/P8dfbuTiPcSm0/4RAbS4tcIX3130uJCnO7w 5Ff6kf8OnvMpUfDDHRWRCf694PRo46Etb1ETECf++0tyx8N0+iNjlF1lq CLwnveCI1yByAbqwLyPmbDc5WO6lgqLB0iRRhM11+K1S5flajTIq+fGRH 8+L3pm0puU2dYi9pUdBAItPfq6rWhkzHgeZAns2WjNK2omx4sLcCT5BEP Q==; X-IronPort-AV: E=McAfee;i="6500,9779,10628"; a="313050062" X-IronPort-AV: E=Sophos;i="5.97,315,1669104000"; d="scan'208";a="313050062" Received: from fmsmga008.fm.intel.com ([10.253.24.58]) by fmsmga107.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 21 Feb 2023 08:27:40 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6500,9779,10628"; a="735533581" X-IronPort-AV: E=Sophos;i="5.97,315,1669104000"; d="scan'208";a="735533581" Received: from orsmsx603.amr.corp.intel.com ([10.22.229.16]) by fmsmga008.fm.intel.com with ESMTP; 21 Feb 2023 08:27:39 -0800 Received: from orsmsx603.amr.corp.intel.com (10.22.229.16) by ORSMSX603.amr.corp.intel.com (10.22.229.16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16; Tue, 21 Feb 2023 08:27:39 -0800 Received: from ORSEDG602.ED.cps.intel.com (10.7.248.7) by orsmsx603.amr.corp.intel.com (10.22.229.16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16 via Frontend Transport; Tue, 21 Feb 2023 08:27:39 -0800 Received: from NAM11-CO1-obe.outbound.protection.outlook.com (104.47.56.170) by edgegateway.intel.com (134.134.137.103) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.16; Tue, 21 Feb 2023 08:27:39 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=QaKE2w0Jo22ycXwu6V/SEqGuuFwbME3ygjBpqxsY/11bK9oIy9su8BHF2vJKpparw2MVyh86DM/1vpSjeVq1ID5bvOsNNLMU5PMWnrOhha1Y7IgFr/8WB2dKivk0p7hebBAQpdhZbcgkSQgT/6JpdPQXnQBBAU58h+1sMjL6OKsVvoUgYyqEXfU69EtPMp3W/ZmoAYYQyhH+diyZognGnbPlCVnpM8gUCU9t+e9VuCvDvLyGmsO20KBynzasjHyjOYphaZYAyXmSq61yMdeuRP3+mTD7wAZg4PGn+6c4qLfpAdEb5GNjosB1URIqZgoKGjf+GdO3qpfjQ7MJTaPxxA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=2zl9cA4MBrwDWfhjmus3Ek0I0ge339SPvETbXm8WPCg=; b=IzRhChzlwFk8jsvewFAUxCiXxBGrx1H98sN4Ee4TsDh9iUoeryqn9ZDXM0RfkL6i/mtsCLPP1aH8QL/7s8Yw5JOs0emoIdK4xt8chAw0AbAkbAK/gV/t5RXX0ZZFuFDVKWthVhVDJUEkcBFvZtmuhNUjT9URjcYfVNr8uxHfM+4IToL1CchE7f3ij4ydK8g0fz3VCxE3iE23WRPXNsn4v39eoOVQHu+xp9biKTS3sjP7kG/+yK5oMg6QWjv6Jy2NrH1Dgl7qINRLaDJym0aXTl4g3GwmfppMCKnYK+U6WG5CsBH/9VUczWmDDDSRdII2hvbqhJsgnJNl6luVeYJKLQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; Received: from DS0PR11MB7309.namprd11.prod.outlook.com (2603:10b6:8:13e::17) by CO6PR11MB5633.namprd11.prod.outlook.com (2603:10b6:303:13c::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6111.20; Tue, 21 Feb 2023 16:27:37 +0000 Received: from DS0PR11MB7309.namprd11.prod.outlook.com ([fe80::aaba:abb7:8794:def]) by DS0PR11MB7309.namprd11.prod.outlook.com ([fe80::aaba:abb7:8794:def%7]) with mapi id 15.20.6111.021; Tue, 21 Feb 2023 16:27:37 +0000 Date: Tue, 21 Feb 2023 16:27:31 +0000 From: Bruce Richardson To: Nagendra Prabhu A T CC: , Subject: Re: unable to bind to vfio-pci Message-ID: References: Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: X-ClientProxiedBy: LO4P265CA0178.GBRP265.PROD.OUTLOOK.COM (2603:10a6:600:311::9) To DS0PR11MB7309.namprd11.prod.outlook.com (2603:10b6:8:13e::17) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DS0PR11MB7309:EE_|CO6PR11MB5633:EE_ X-MS-Office365-Filtering-Correlation-Id: e88acea7-005e-4121-2731-08db14288b67 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: jTCNZTiSFrrhsWcLeqqW62nC868LPIT5jR8gULFzQbkdGGcF49XvtDRsNuq62e4morGZoXcHhKp/fD8zSAZHTl0V2yc8X/WjLMFhZIoZ2kPiZ3O1qQItBiNHUMaxaPOhw4qrcqo5yHFocRoftfsj1bSjlHI7GhEYE86waJPLfLCOy/5oiig62hvZpLLiEXweBYncjZp8ajdJgFPBxkLAeAvlRubUCXmRrd8XL+pEQKyUwbz6k0kd+9W71J1gey8orZG+xgroZ8yEHuQUP72bWgpa/EPNPB/TJLD3KycwvaZ8lLQaSWpRT55fWymZ0pYl01OvaoLffgy8e6CLNJ+BjKQrBsfDf15q11a5QTCe/Uosrs53OfiybU//6LN4lzBMA9b5BDajxDsvkWpyNZZVE5Fq5o53UYUUAj/m8Guo9PA58WFwoCXENeDfroYqwGk+gaABIKgFlJLS5x6BKw2dPPnsJsYeMWWpHN34BcUtSq8mSTWtSDugpITwgIarzLMpVvEDrHqgLTqJmYnRT3bH0VF1TZ91svQOBEbZr8IUffl9/lEzkHMfD3S9eS1DBwfLPgRywTe6cXRonuRf/ozEsLu6XrgvADpqlmmYpL2p1bN+8w6wFk2IeYod2R2i8liGzT6hXxx0LKzqi76SU7zLGg== X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DS0PR11MB7309.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230025)(366004)(396003)(39860400002)(136003)(346002)(376002)(451199018)(38100700002)(2906002)(6512007)(186003)(26005)(41300700001)(53546011)(44832011)(6666004)(82960400001)(6506007)(478600001)(5660300002)(8936002)(316002)(6486002)(86362001)(66556008)(66476007)(66946007)(6916009)(4326008)(8676002)(83380400001); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?utmGOn/pMmDEMKTP3CBECl8AsHz1mfaKi8zY3cw96arDciprzY8qyueIaCtW?= =?us-ascii?Q?qGqxX5xEaoJZpC7NoZVWTllpPM0XNXQLB/fnI8QHifeJ7nXzeCoSEHnWrgIF?= =?us-ascii?Q?3guhjLo8BdmS3Sw100008rdm694gUa/BiBcVXfWwxsF1O9RACu+bLll8/mV3?= =?us-ascii?Q?9D6R1TRYjRisBRBmWR4NOkj83dyfLKAJfX65f5E0jKC6hWYAjJ2umtPGObwI?= =?us-ascii?Q?/39oiCNSksROxAlGdfJD3rNR+QkoguPUVafoG1fqkXvuV78IiKJpfzsBWPCN?= =?us-ascii?Q?gknfanR2K6Kc5OTWwx9vdm7G8SMPy3F7QnHNYEZYhD1MvMy19XERcWA+HWQu?= =?us-ascii?Q?wyEk4MYQNeiA2b+AdBEvQAVKxp68yNb2wTSjV9d/M4RoMewnPTsZKUv0Q/8a?= =?us-ascii?Q?ja0CDOPv2wv+tP0aRQmtNUTvOLZ0rK+sKLILFN++thazfdQH/i0Kfv0nPqNI?= =?us-ascii?Q?WDuJY2aZSwlW78X9QrTJuHxA07Il75wAHorVitHRWqf8erjYq/iUgnqJZqNk?= =?us-ascii?Q?b3lGFWgYWUXmpcbOCp8c1urq6GeoM8spwlY1aFVjNfWXfcy6R+C30y6rM1zV?= =?us-ascii?Q?SM1AuSEynz/2OcR0huhhw50CZ43O3J+HyXOCl47gJf7keytpvS6Aj47v9KTO?= =?us-ascii?Q?gQr9mKhOtOMh5y6ioMhiEYwJBOa28UdHw9mYWzivcwNCbQ2XjBmmh1neylMN?= =?us-ascii?Q?nNrcuvToM6GOAVK92NQgJsNTOcs8YbWdBeXGS/0B8AIpLzAze6skNf1OKLDZ?= =?us-ascii?Q?rjsTq3GnEAU9wZ2oysz5x6y4iOlQUiMHb/AOkYD1d8+O60RkR2EwtunGG/Ef?= =?us-ascii?Q?3kBR29Wl7TEQMVEf7dzRjujkeRFFGEh3MH36GiZqOAa6lHy6tU3cY89LXQso?= =?us-ascii?Q?j5n6AmiEfTYkIhQSoaUJLFk4LmdHT/HYxbmZWARtezETTBCftcVL2zU8qwTn?= =?us-ascii?Q?MjzHjcbfXmZ9VQMLt4iflkfLhP/AWId2Vuej3QO5WDWTtUeWdNWtwHoRB5Fu?= =?us-ascii?Q?NKylz9D6TcaimjTMGeXojuTD2yWrRxz4oLjFwcUPMChaWWTv4ttgkULf/MO0?= =?us-ascii?Q?rPqFgxOgXfMo/NJqtNMe0CYw0QyrpELLmYCO1q7nBjhbvWEhh2QX+AG7tgfy?= =?us-ascii?Q?wGLJYS7RTWMvRapOv+R8/DA0KQLPKQOsFw0T6W3qi7oxr11BU7jJEt9EtgYI?= =?us-ascii?Q?3iZA2lsdMi1BK3IFzMVn0AgyZCVxb2qnuEzWwCPCm+H2s5gcxWpU2k26Z/bO?= =?us-ascii?Q?+0HMFCVJTbVtol61bM9oYzsiM4cQH2+QbyPiTgOkybs1N2pVDdZas9lEpeag?= =?us-ascii?Q?Zy9w/dog3xEUbRH82E1BfOMtUBRt5htW2cVQkhR5RUyXy0BOBfiCdq+yLUaY?= =?us-ascii?Q?LW+C1cu86278i52gYDij78fZRGbPCDDUj8SN2BEKTaRUM60ZexqibRUK82ge?= =?us-ascii?Q?an4eNbG+/Q4FI+AcKkoLU+u+XNoYMAyPRFp/2lcew9r2G0pKqtOrWfO7JeRE?= =?us-ascii?Q?XG5+fjKfSez3EAbstWhlYrGzEjnTwHI+ns0eu2S3/y/MkdlIcOkJ6oPNQww5?= =?us-ascii?Q?xwH+LA6W6+/oiIVks9fHvIrRKbUqjzMF8FAb8sB2gV8+66FSwgZ8WT8+V32e?= =?us-ascii?Q?V0QQiCLQGwclrWGclL2+I+o=3D?= X-MS-Exchange-CrossTenant-Network-Message-Id: e88acea7-005e-4121-2731-08db14288b67 X-MS-Exchange-CrossTenant-AuthSource: DS0PR11MB7309.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Feb 2023 16:27:37.5129 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: lmwldLk4UEW16yFd13B3BHYx6fb0/Y69SRw4/9Y9QJ7iFB4XKfA+8xIg7m6fijjSI4VOFMe5SIVgL0o/aoTv2iZ8yH0CIa12/j4+ZO95Xrc= X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO6PR11MB5633 X-OriginatorOrg: intel.com X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On Tue, Feb 21, 2023 at 09:46:30PM +0530, Nagendra Prabhu A T wrote: > These are the messages i am seeing dmesg > [16588.298660] vfio-pci: probe of 0000:8a:00.2 failed with error -22 > [16591.574630] i40e 0000:8a:00.3: i40e_ptp_stop: removed PHC on > enp138s0f3 > [16593.138613] vfio-pci: probe of 0000:8a:00.3 failed with error -22 > [16593.138674] vfio-pci: probe of 0000:8a:00.3 failed with error -22 > [16627.551866] vfio-pci: probe of 0000:51:00.0 failed with error -22 > [16627.551922] vfio-pci: probe of 0000:51:00.0 failed with error -22 > [16716.344530] vfio-pci: probe of 0000:51:00.0 failed with error -22 > [16716.344585] vfio-pci: probe of 0000:51:00.0 failed with error -22 > [17859.876566] vfio-pci: probe of 0000:51:00.0 failed with error -22 > [17859.876622] vfio-pci: probe of 0000:51:00.0 failed with error -22 > root@nat-kvm:/home/nat# cat /boot/config-$(uname -r) | grep NOIOMMU > CONFIG_VFIO_NOIOMMU=y > root@nat-kvm:/home/nat# > Interface type : > Other Network devices > ===================== > 0000:51:00.0 'Ethernet Controller X710 for 10GbE SFP+ 1572' > unused=i40e,vfio-pci > 0000:51:00.1 'Ethernet Controller X710 for 10GbE SFP+ 1572' > unused=i40e,vfio-pci > 0000:51:00.2 'Ethernet Controller X710 for 10GbE SFP+ 1572' > unused=i40e,vfio-pci > 0000:51:00.3 'Ethernet Controller X710 for 10GbE SFP+ 1572' > unused=i40e,vfio-pci > 0000:8a:00.0 'Ethernet Controller X710 for 10GbE SFP+ 1572' > unused=i40e,vfio-pci > 0000:8a:00.1 'Ethernet Controller X710 for 10GbE SFP+ 1572' > unused=i40e,vfio-pci > 0000:8a:00.2 'Ethernet Controller X710 for 10GbE SFP+ 1572' > unused=i40e,vfio-pci > 0000:8a:00.3 'Ethernet Controller X710 for 10GbE SFP+ 1572' > unused=i40e,vfio-pci > Please try the following: echo 1 > /sys/module/vfio/parameters/enable_unsafe_noiommu_mode dpdk-devbind.py -b vfio-pci 8a:00.* Does anything change then? /Bruce PS: For mailing list discussions, please don't top-post. Replies are easier to follow if posted immediately below the relevant content. > On Tue, Feb 21, 2023 at 9:37 PM Bruce Richardson > <[1]bruce.richardson@intel.com> wrote: > > On Tue, Feb 21, 2023 at 09:30:15PM +0530, Nagendra Prabhu A T wrote: > > HI Bruce, > > Thanks for your reply. > > I have removed the binding of all other ports. So , i can > confirm that > > #2 is taken care of. > > I tried using a different driver "uio_pci_generic". I still see > the > > same issue for that driver as well. > > The problem seems to be because the write operation is not > happening in > > "bind" file. > > Infact tried doing the following step manually. That also > failed > > echo sh -c 0000:51:00.0 > > /sys/bus/pci/drivers/uio_pci_generic/bind > > bash: echo: write error: No such device > The "sh -c" doesn't look right in that command. It should just echo > the > device id to the bind file. However, it's generally recommended just > to use > the devbind script, as more writes to sysfs may be necessary first, > e.g. to > register the device ids first. > > I have required permission for the file. > > I tried doing with "sudo" > > I dont have selinux running > > So not sure whats blocking me. Infact , even > > "cat /sys/bus/pci/drivers/uio_pci_generic/bind" is failing > > Can you please help. > To track down issues other than the obvious, I think we need more > information. For example, what NIC card is this? Are there any > useful error > messages in dmesg? > /Bruce > > References > > 1. mailto:bruce.richardson@intel.com