From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id D4DD1A00C5 for ; Thu, 14 Jul 2022 09:33:26 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 5CCAF42836; Thu, 14 Jul 2022 09:33:26 +0200 (CEST) Received: from NAM02-BN1-obe.outbound.protection.outlook.com (mail-bn1nam07on2048.outbound.protection.outlook.com [40.107.212.48]) by mails.dpdk.org (Postfix) with ESMTP id 2399941156 for ; Thu, 14 Jul 2022 09:33:25 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=fhy4XAjFt34Oyn/hNaxKrwNu662iSr50aZREcLrQHeiano1/6Opvl+Uk+SKTqyL0NgXMm6rQ9bvR+E1al9WXGi3Q5pTzeuMavKkMXBvGu526fK4h5vZUb2vKylv7WTQZr4YZuEtfm6kNVG4imwhj88Ecy/Fy71YjlZjLpATVngP3HKVH4xVZEqPK7UpWKyoAkWhB3u42rTkwbSqY/IluxWpp65Hp6IEQ3SFaBLRC4ReDXkbTaV7e9b7ZMm2Im6hbZpvzezaFkRMgxLDY2+lQKcPz/R+Ebc0BOKJonHGTLLhWbHpvnWOaoRMN9v6rZi3ZF/6Uj2i3R3umH1aMUBrhcA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=McLFyFaoJbqI09dypBbzSNRMuYBSJ6Tz4Umz/awmob8=; b=nCmPzu3Rj4fvCQZCqq+G2HZ6TWvtaBsCjIttSHcXS9aGGfa7/9qfePE/PtRRFfgaS31vxnsrk2vNiopoRQlDg8Sxlm7+ty3evJ0MOBidoM08i3+TYLgaoyikqI1w0sYT8ql01JfRbrPBGQxFLshjg3A+Hkz0zGAp0KH4j5Zu8fy5PCJveDCNexSyvykVwUBAohw7UH9HsRMrzAT/bnxwNhcaljZIUdasHYx7Y5b1Zi47sF2Ssf/e+2Mz6AmiamvxDsaWErHA+pANiphwasu7P1RD9lQ7Eg70AVJEyIGfLVVhaSEzyriqMcWbnj4IzAfhb4AUrt9pgyachvqaXT3upw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=McLFyFaoJbqI09dypBbzSNRMuYBSJ6Tz4Umz/awmob8=; b=mzjJN9xL3zdqnZ4v7hzInXZx7UoqFxuJUKiF9vUJ0jireZUv17I4HucogxKw4Ogug7vm7m0r9Qg2XFW5Qv25CZceqj6MQQJt9B++wtpchhleatRQhSR1b/KBAPJGAiPqKpmLJdVqRIV3henal8PGw0WiZDgEGJm9Oz7XDJeqXgY= Received: from MN2PR12MB3085.namprd12.prod.outlook.com (2603:10b6:208:c5::29) by MW4PR12MB6801.namprd12.prod.outlook.com (2603:10b6:303:1e8::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5395.20; Thu, 14 Jul 2022 07:33:21 +0000 Received: from MN2PR12MB3085.namprd12.prod.outlook.com ([fe80::40f6:2711:14a1:ff16]) by MN2PR12MB3085.namprd12.prod.outlook.com ([fe80::40f6:2711:14a1:ff16%6]) with mapi id 15.20.5417.026; Thu, 14 Jul 2022 07:33:21 +0000 From: "Varghese, Vipin" To: Lokesh Chakka , "ajit.khaparde@broadcom.com" CC: "users@dpdk.org" , "Yigit, Ferruh" , "Tummala, Sivaprasad" Subject: RE: skeleton code failing (Lokesh Chakka) Thread-Topic: skeleton code failing (Lokesh Chakka) Thread-Index: AQHYl0RVWs8mBPFJSU2zXVtKcOGVAq19YldAgAAU7oCAAADS4A== Date: Thu, 14 Jul 2022 07:33:21 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-IN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: MSIP_Label_d4243a53-6221-4f75-8154-e4b33a5707a1_Enabled=true; MSIP_Label_d4243a53-6221-4f75-8154-e4b33a5707a1_SetDate=2022-07-14T07:32:48Z; MSIP_Label_d4243a53-6221-4f75-8154-e4b33a5707a1_Method=Privileged; MSIP_Label_d4243a53-6221-4f75-8154-e4b33a5707a1_Name=Public-AIP 2.0; MSIP_Label_d4243a53-6221-4f75-8154-e4b33a5707a1_SiteId=3dd8961f-e488-4e60-8e11-a82d994e183d; MSIP_Label_d4243a53-6221-4f75-8154-e4b33a5707a1_ActionId=6225f93f-481c-467c-9f6c-904eaef7ad5f; MSIP_Label_d4243a53-6221-4f75-8154-e4b33a5707a1_ContentBits=1 msip_label_d4243a53-6221-4f75-8154-e4b33a5707a1_enabled: true msip_label_d4243a53-6221-4f75-8154-e4b33a5707a1_setdate: 2022-07-14T07:33:18Z msip_label_d4243a53-6221-4f75-8154-e4b33a5707a1_method: Privileged msip_label_d4243a53-6221-4f75-8154-e4b33a5707a1_name: Public-AIP 2.0 msip_label_d4243a53-6221-4f75-8154-e4b33a5707a1_siteid: 3dd8961f-e488-4e60-8e11-a82d994e183d msip_label_d4243a53-6221-4f75-8154-e4b33a5707a1_actionid: d82f3618-a64f-4738-a463-ef93ef595448 msip_label_d4243a53-6221-4f75-8154-e4b33a5707a1_contentbits: 0 authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=amd.com; x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 40ac7163-0511-41ef-3e84-08da656b20d6 x-ms-traffictypediagnostic: MW4PR12MB6801:EE_ x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: yyFRrGbvzzyAhZR63ODal11g9eI9iqFLJ995a6qtOoVwZwZl2bWRz/Y14Uzk56HDz2A+RUhyv+S64v6MRH6o+lk1ji3nKoUitHKFbLeaS5szWodAqKZjZg41uTEEQhTMSSNjRyY+ZfessF0h8hG9ikLYcjd+iFMNg8074buiK8FucFhQgkG2oSTcL8p4ZHL/HfYZbmkfCaivygbXL/Y1iOB2JDLdha0udK2rCp9jTfFEYo/koN0zcXG38F5wYEUJyPzSlydJxpKRbgCN81LymU6/pAk+1zloYqr5/fof9rT4ZSZA0YsdcvWVkdbJlty4sQbDd0FpUfBm/WMZR/crjj7oxfVfNCSpU8ZsruIm6fXcp6kRvHFMr81nPTpqv5b/51nY1kuzT+SzOCJmV6jYLq6ILGZVWu1yy30eFjOVAoJR8psFaFu1GDY1CymoOiykFjv+y/B/upT5wFMkYlb1fe+h8ehr/IYLh98P+1XjnWxxBkNwRpqgdXclEsXSIUyALT5SnbhtD9vkHArahslskIV7vaslfhDBytCoJZMuk0MUBk5uSLue0gxQLNLErkJ+93/2n43+kTVLPaI8DNWnTRMVIpegTDqrsWJf9K267+uixq66mEzflZSX3IzS/7NTuBwcb5TPkotJzkWZbwzHpJe3ku+wltVv7P/m3GcUF6LVrzTGZIvI1w31dIRO3sbfNrL/Sj5ld2rqmkhCoo3tSl31z/3D8yJ6uZ9uKXVf8uMySESro5cSX7Wfkr+K34x1GYVQzoDzkrP/kdycmmPrRor9LFRqGaLIAcOKSp7FD2YVTl8fo3KWTvhJyUGBerfl1dHoIOVSZ/qF+HbbhdmO6y4ZN12Fl75DJyWZspgEslE= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:MN2PR12MB3085.namprd12.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230016)(4636009)(366004)(396003)(346002)(39860400002)(376002)(136003)(316002)(83380400001)(33656002)(66946007)(19627235002)(86362001)(4326008)(66556008)(64756008)(66446008)(19273905006)(21615005)(76116006)(38100700002)(54906003)(166002)(53546011)(186003)(8676002)(30864003)(966005)(110136005)(45080400002)(5660300002)(55016003)(9686003)(6506007)(122000001)(2906002)(478600001)(26005)(38070700005)(7696005)(41300700001)(52536014)(8936002)(66476007)(71200400001); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?S+v2Pc67xPmzfz2npRnFzLqMQFhQASZCQH5Qm6ZUsnRwSdGbzaKnDL5Vbrhj?= =?us-ascii?Q?n0Fi8BOb1AEwGHBdF0VdRVe924EjI53B0o7D56nFqXXO9CE29wrnoMd+VBTW?= =?us-ascii?Q?pKSQ9eXA8yDZv2h2hzFhgCahI91SNDfAQb227taKPbtk/8D7rjggEbaUDuUi?= =?us-ascii?Q?iA9j/QkBPfRftABOpuUvfK3kqNmXOzrAesS/CGDOrRJP7vblqCpCfxMnHuHS?= =?us-ascii?Q?d5jo8ffPO9mCqTaDK9QUazNPiPnfg4lRSFK+zCtd09CVNIgo3rjSrIY33eJW?= =?us-ascii?Q?dp0QFpoJVCoScSQzVAvdifcVA8nQ4vKv2ohnEssKE0or3s+MPfki7n5PQOwF?= =?us-ascii?Q?jQTny67k+s6BX+YOI/tzZ46PjjUgnu5NIteqSgZ6+UuQDEr3/GC+ns9i7TAb?= =?us-ascii?Q?2xGxj7UNC/SCyaKfOQ0ZPj/TJzWmDcfRch3dO09nLSxFielx88R4Bl0pw0ts?= =?us-ascii?Q?8IHbrb6no/lSAH20IiVf7cWWPYQPEW8wDOgwoAJlCrFn6MFnPc0GiFJKd04p?= =?us-ascii?Q?jN7yuDZaCumSGma9MNanBfoviKrOq94EboiHnx9o6aR17Z6HZTDOf2ODfPkd?= =?us-ascii?Q?W81Q9BGOBQNL9oDfl67n/YxzC15uSD61tqmtDkuJzpLOy1VXNgQE8yHgxzFX?= =?us-ascii?Q?MAcg1Gyohs+jbj6FTb9KZ55rI3MJVpy8t+q/pmo3eORCjkgCgsU8SOsCxQKo?= =?us-ascii?Q?z2TsWn40GoYa0jIlMbAcJC4Dklfz8wmzfkvl5qx+OL0DDPwARcdzqgF7YC4k?= =?us-ascii?Q?MqrkUIDeHXDZC5zuO0sordHergLo4GP6nrcqS9xjMHvIErHkSEhcrjmI5s9Q?= =?us-ascii?Q?VkRYbDWV5udXV/lJ6EHNdrCyFMdchMmklKU8Wa8oYru+4PsLGJQSRAq+dBb6?= =?us-ascii?Q?ZNQdTDeQa104pEsefwf9ybM4nSrFcKiIdAT7rCAMNRNxBuEfYyOGSoJO5Kbc?= =?us-ascii?Q?Mpv7SWuXqyLmNMDwnEI8ZZBH37iuEVaicWv0YXgnUVTbLkqqplx0VGa6umxa?= =?us-ascii?Q?/BfzDOWwHO1Rgqgm38gDs5bS1JecjXItUjX3EIq3/n1gWRn1bBP467u0gwAL?= =?us-ascii?Q?Anj6nLK4c6WUJJCRhQKVnrwyQnMeBoGQXjY6iLvRPLs3jyTKiL05kz+mtlPZ?= =?us-ascii?Q?3IkvbrZQrI2VNQXDfF7TW4ACfwnjWRw5nlzRToDSWIrI02q5uQhSOoVUPLUS?= =?us-ascii?Q?8Cihtosh2xhsD1gkHH/l9vG4nZb7i995vJzVSVayLX2R29FmujPMuXFGHglb?= =?us-ascii?Q?gAkwJdHEAz7lLPoTOiWRkSwsu6POuuS+fxzKfL0LWTtMNelFLfcxMCSv72dA?= =?us-ascii?Q?L7xyS+uAaGzQZEmO/hLBkh6/ViiGdLnyfmLZG8i9dBLhP77TfxG0AKxz96bU?= =?us-ascii?Q?0IEcGhnQ/6+ER+D1tv6VIeUzuu+lNwEe+O/rPTNRcOlVlptG/e/Thr/bQAEG?= =?us-ascii?Q?NKXisXcLWNJoZ54rsddUaxMiEqYM3r+MWWlSJW7C+YdeEhvgjbMAQQM/VndG?= =?us-ascii?Q?U9TrQ9WwuWDfuUdq9wmIx95PqHBAAZ5vc5lbsji9RIGGxAIdLmlydutisQm9?= =?us-ascii?Q?unZn4klnTZWkNNO77Giy1i5RYG9A5jwm4O5CnW8+?= Content-Type: multipart/alternative; boundary="_000_MN2PR12MB3085898D0DADAB7BDD885EF782889MN2PR12MB3085namp_" MIME-Version: 1.0 X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: MN2PR12MB3085.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 40ac7163-0511-41ef-3e84-08da656b20d6 X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Jul 2022 07:33:21.3007 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: BHx9D99f7NCEO2lu5GRMs4cZf+P5jZwr700hTIUqUavPRPxfsi8s33T4iqe/bAap0KveeokNGGNMJkRhUs0oBQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR12MB6801 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org --_000_MN2PR12MB3085898D0DADAB7BDD885EF782889MN2PR12MB3085namp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable [Public] [LC] I am having is https://www.broadcom.com/products/ethernet-connectivity= /network-adapters/p2100g However, cards are up after waiti= ng for around 10 minutes. [VV] I do face similar issue, hence I have recommended ` Observation: due s= ome hardware or firmware bug auto-neg take more time with the current DPDK = BXNT PMD. Hence my advice is try to wait longer for link state up in DPDK.`= . Please try reaching out to Broadcom PMD maintainer `ajit.khaparde@broadco= m.com`. Once the solution is identified please share too [LC] If netdevice is not available, how can I capture the packets using wir= eshark? [VV] Please explore DPDK tool PDUMP. https://doc.dpdk.org/guides/tools/pdum= p.html [LC] Interfaces are not visible to the wireshark. Very basic requirement is= to send the packets, capture them and see the contents. [VV] If you want the kernel netdev visible and use it under DPDK, I recomme= nd using LIBPCAP PMD by sacrificing performance and higher functionality. From: Lokesh Chakka Sent: Thursday, July 14, 2022 12:56 PM To: Varghese, Vipin Cc: users@dpdk.org; Yigit, Ferruh ; Tummala, Sivapras= ad Subject: Re: skeleton code failing (Lokesh Chakka) [CAUTION: External Email] The card I am having is https://www.broadcom.com/products/ethernet-connecti= vity/network-adapters/p2100g However, cards are up after waiting for around 10 minutes. Thanks for the valuable input. skeleton code is running till I press ctrl+c= . Now I have a big concern. If netdevice is not available, how can I capture the packets using wireshar= k? Interfaces are not visible to the wireshark. Very basic requirement is to s= end the packets, capture them and see the contents. Thanks & Regards -- Lokesh Chakka. On Thu, Jul 14, 2022 at 11:46 AM Varghese, Vipin > wrote: [AMD Official Use Only - General] Is this not Broadcom extreme net card? Please refer http://doc.dpdk.org/gui= des/nics/bnxt.html, onc= e you bind with `igb_uio, vfio_pci or uio_pci_generic` all linux netdevice = instance will be no longer available. This is because it is not a `port rep= resentator` Observation: due some hardware or firmware bug auto-neg take more time with= the current DPDK BXNT PMD. Hence my advice is try to wait longer for link = state up in DPDK. You can verify the same with testpmd. From: Lokesh Chakka > Sent: Thursday, July 14, 2022 11:11 AM To: Varghese, Vipin > Cc: users@dpdk.org; Yigit, Ferruh >; Tummala, Sivaprasad > Subject: Re: skeleton code failing (Lokesh Chakka) [CAUTION: External Email] I have one more observation here. After "$ sudo dpdk-devbind.py -b vfio-pci 83:00.0 83:00.1" Cards are shutting down. ifconfig is not showing the cards. reinsert of sfp= is also not bringing the cards up. I had to restart the server. Not sure w= hy the cards are going down. Thanks & Regards -- Lokesh Chakka. On Thu, Jul 14, 2022 at 8:50 AM Varghese, Vipin > wrote: [AMD Official Use Only - General] Based on the compilation command shared it looks like you are using the bui= ld in shared library mode ` gcc main.c -g `pkg-config --cflags libdpdk --li= bs libdpdk` Hence in EAL PCIe probe, the BNXT PMD is not triggered to identify the NIC. Solutions for these can be 1. Build with static library ` gcc main.c -g `pkg-config --cflags libdpdk -= -libs --static libdpdk` 2. pass the bxnt_en PMD shared library to eal args by ` sudo ./a.out -l 1 -= d librte_net_bnxt.so` Can you try any of the above ? > -----Original Message----- > From: users-request@dpdk.org > > Sent: Wednesday, July 13, 2022 3:30 PM > To: users@dpdk.org > Subject: users Digest, Vol 347, Issue 6 > > [CAUTION: External Email] > > Send users mailing list submissions to > users@dpdk.org > > To subscribe or unsubscribe via the World Wide Web, visit > > https://nam11.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Fmails= .dp > dk.org%2Flistinfo%2Fusers&data=3D05%7C01%7Cvip= in.varghese%40amd.co > m%7C55465d0d4faa4cd8496a08da64b674f4%7C3dd8961fe4884e608e11a82d9 > 94e183d%7C0%7C0%7C637933032067208770%7CUnknown%7CTWFpbGZsb3d8 > eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D > %7C3000%7C%7C%7C&sdata=3D6JHjf2Fu%2BkQ56CF9xTZvBS%2Bh8Uomlqv > E9dq9M7VefiU%3D&reserved=3D0 > or, via email, send a message with subject or body 'help' to > users-request@dpdk.org > > You can reach the person managing the list at > users-owner@dpdk.org > > When replying, please edit your Subject line so it is more specific than = "Re: > Contents of users digest..." > > > Today's Topics: > > 1. Re: skeleton code failing (Lokesh Chakka) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Wed, 13 Jul 2022 12:56:37 +0530 > From: Lokesh Chakka > > To: David Marchand > > Cc: users > > Subject: Re: skeleton code failing > Message-ID: > Nm_pwq59fY9QVNH+GBgwRg@mail.gmail.com> > Content-Type: text/plain; charset=3D"utf-8" > > Dear David, > > following is some more stuff i did > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D > $ sudo dpdk-devbind.py -b vfio-pci 83:00.0 $ sudo dpdk-devbind.py -b vfio= -pci > 83:00.1 $ sudo dpdk-devbind.py -b uio_pci_generic 83:00.0 83:00.1 > Error: Driver 'uio_pci_generic' is not loaded. > $ sudo dpdk-devbind.py -b igb_uio 83:00.0 83:00.1 > Error: Driver 'igb_uio' is not loaded. > $ sudo dpdk-devbind.py -b vfio-pci 83:00.0 83:00.1 > Notice: 0000:83:00.0 already bound to driver vfio-pci, skipping > Notice: 0000:83:00.1 already bound to driver vfio-pci, skipping > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D > ~/Desktop/dpdk_examples/skeleton$ gcc main.c -g `pkg-config --cflags libd= pdk > --libs libdpdk` lokesh@lokesh-ProLiant-DL385- > Gen10:~/Desktop/dpdk_examples/skeleton$ sudo ./a.out > EAL: Detected CPU lcores: 64 > EAL: Detected NUMA nodes: 4 > EAL: Detected shared linkage of DPDK > EAL: Multi-process socket /var/run/dpdk/rte/mp_socket > EAL: Selected IOVA mode 'VA' > EAL: No available 1048576 kB hugepages reported > EAL: VFIO support initialized > EAL: Using IOMMU type 1 (Type 1) > EAL: Probe PCI driver: net_bnxt (14e4:1750) device: 0000:83:00.0 (socket = 2) > EAL: Probe PCI driver: net_bnxt (14e4:1750) device: 0000:83:00.1 (socket = 2) > TELEMETRY: No legacy callbacks, legacy socket not created Port 0 MAC: bc = 97 > e1 ce 84 f0 Port 1 MAC: bc 97 e1 ce 84 f1 > > WARNING: Too many lcores enabled. Only 1 used. > WARNING, port 0 is on remote NUMA node to polling thread. > Performance will not be optimal. > WARNING, port 1 is on remote NUMA node to polling thread. > Performance will not be optimal. > > Core 0 forwarding packets. [Ctrl+C to quit] ^C > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D > After a few seconds, I presses ctrl+c > > surprisingly cards are not showing up even in ifconfig. > > > > Thanks & Regards > -- > Lokesh Chakka. > > > On Wed, Jul 13, 2022 at 12:43 PM Lokesh Chakka < > lvenkatakumarchakka@gmail.com> wrot= e: > > > Dear David, > > > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D > > $ lspci | grep -i broadcom > > 83:00.0 Ethernet controller: Broadcom Inc. and subsidiaries BCM57508 > > NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet (rev 11) > > 83:00.1 Ethernet controller: Broadcom Inc. and subsidiaries BCM57508 > > NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet (rev 11) $ lspci > > -n -s 83:00.0 > > 83:00.0 0200: 14e4:1750 (rev 11) > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D > > > > I am compiling my code like this : > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D > > gcc main.c `pkg-config --cflags libdpdk --libs libdpdk` > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D > > > > Hence it is statically linked code. > > If I try > > $ dpdk-pmdinfo.py ./a.out > > > > But I am not seeing any output > > > > > > > > Thanks & Regards > > -- > > Lokesh Chakka. > > > > > > On Wed, Jul 13, 2022 at 12:22 PM David Marchand > > > > > wrote: > > > >> On Wed, Jul 13, 2022 at 7:35 AM Lokesh Chakka > >> > = wrote: > >> > Would like to understand if I am missing something. I am new to > >> > this > >> platform. > >> > rte_eth_dev_count_avail is returning zero. > >> > OS is Ubuntu 22.04. DPDK is latest version. > >> > Cards are being detected by Linux. Ifconfig is showing the cards up. > >> LED is also glowing. > >> > >> Indeed, DPDK provides a userspace driver for some NetXtreme nics > >> (which is net/bnxt). > >> This userspace driver does not rely on the bnxt Linux kernel driver. > >> IOW, this card being detecting and working with the Linux kernel does > >> not automatically mean that this nic can work with DPDK. > >> > >> We need more info on your nic, first. > >> > >> Can you share the pci id of this nic (like running lspci -n -s > >> $pci_address)? > >> It should be a 14e4:XXXX. > >> > >> Then you can check this XXXX against what your dpdk application suppor= ts. > >> > >> If it is a statically linked application, you can run: > >> $ dpdk-pmdinfo.py /path/to/your/application > >> > >> Else, if your application is dynamically linked against DPDK driver, > >> you can run this command against the net/bnxt driver .so.22 (for > >> 21.11 and later releases): > >> $ dpdk-pmdinfo.py /path/to/your/dpdk/drivers/librte_net_bnxt.so.22 > >> > >> You should get a list of supported NetXtreme nics, like: > >> > >> [snipped some other drivers compiled in my application] PMD NAME: > >> net_bnxt PMD HW SUPPORT: > >> Broadcom Inc. and subsidiaries (14e4) : BCM5745X NetXtreme-E RDMA > >> Virtual Function (1606) (All Subdevices) Broadcom Inc. and > >> subsidiaries (14e4) : BCM5745X NetXtreme-E Ethernet Virtual Function > >> (1609) (All Subdevices) Broadcom Inc. and subsidiaries (14e4) : > >> BCM57454 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb Ethernet (1614) (All > >> Subdevices) Broadcom Inc. and subsidiaries (14e4) : NetXtreme-E RDMA > >> Virtual Function (16c1) (All Subdevices) Broadcom Inc. and > >> subsidiaries (14e4) : NetXtreme-C Ethernet Virtual Function (16cb) > >> (All Subdevices) [snipped the rest] > >> > >> I hope you can find a (XXXX) corresponding to your NIC. > >> > >> > >> -- > >> David Marchand > >> > >> > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > > dk.org%2Farchives%2Fusers%2Fattachments%2F20220713= %2Fa362f7fe%2Fatta > chment- > 0001.htm&data=3D05%7C01%7Cvipin.varghese%40amd.com%7C55465d0d4f > aa4cd8496a08da64b674f4%7C3dd8961fe4884e608e11a82d994e183d%7C0%7C > 0%7C637933032067208770%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjA > wMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C > %7C&sdata=3DjXnaf1qrCA5VSCMyrPPc5S5WYsHveR1tNBL4lczkGVE%3D&am > p;reserved=3D0> > > End of users Digest, Vol 347, Issue 6 > ************************************* --_000_MN2PR12MB3085898D0DADAB7BDD885EF782889MN2PR12MB3085namp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

[Public]

 

[LC] I am having is https://www.broadcom.com/products/ethernet-connectivity/network-adapters/p2= 100g However, cards are up after waiting for around 10 minutes.

[VV] I do face similar issue, =
hence I have recommended ` Observation: due some hardware or firmware bug a=
uto-neg take more time with the current DPDK BXNT PMD. Hence my advice is t=
ry to wait longer for link state up in DPDK.`. Please try reaching out to B=
roadcom PMD maintainer `ajit.khaparde@broadcom.com`. Once the solution is i=
dentified please share too  

 

 

[LC] If netdevice is not available, how can I captur= e the packets using wireshark?

[VV] Please explore DPDK tool PDUMP. https://doc.dpdk.org/guides/tools/pdump.html

 

[LC] Interfaces are not visible to the wireshark. Ve= ry basic requirement is to send the packets, capture them and see the conte= nts.

[VV] If you want the kernel netdev visible and use i= t under DPDK, I recommend using LIBPCAP PMD by sacrificing performance and = higher functionality.

 

From: Lokesh Chakka <lvenkatakumarchakka@g= mail.com>
Sent: Thursday, July 14, 2022 12:56 PM
To: Varghese, Vipin <Vipin.Varghese@amd.com>
Cc: users@dpdk.org; Yigit, Ferruh <Ferruh.Yigit@amd.com>; Tumm= ala, Sivaprasad <Sivaprasad.Tummala@amd.com>
Subject: Re: skeleton code failing (Lokesh Chakka)

 

[CAUTION: External Email]


However, cards are up after waiting for around 10 mi= nutes.

 

Thanks for the valuable input. skeleton code is runn= ing till I press ctrl+c.

Now I have a big concern.

If netdevice is not available, how can I capture the= packets using wireshark?

Interfaces are not visible to the wireshark. Very ba= sic requirement is to send the packets, capture them and see the contents.<= o:p>

 


Thanks & Regards
--
Lokesh Chakka.

 

 

On Thu, Jul 14, 2022 at 11:46 AM Varghese, Vipin <= ;Vipin.Varghese@amd.com> w= rote:

[AMD Official Use Only - General]

 

Is this not Broadcom extreme net card? Please refer http://doc.dpdk.org/guides/nics/bnxt.html, once you bind with `igb_uio,= vfio_pci or uio_pci_generic` all linux netdevice instance will be no longe= r available. This is because it is not a `port representator`

 

Observation: due some hardware or firmware bug auto-neg take more = time with the current DPDK BXNT PMD. Hence my advice is try to wait longer = for link state up in DPDK.

You can verify the same with testpmd.

 

From: Lokesh Chakka <lvenkatakumarchakka@gmail.com>
Sent: Thursday, July 14, 2022 11:11 AM
To: Varghese, Vipin <Vipin.Varghese@amd.com>
Cc: users@dpdk.o= rg; Yigit, Ferruh <Ferruh.Yigit@amd.com>; Tummala, Sivaprasad <Sivaprasad.Tummala@amd.= com>
Subject: Re: skeleton code failing (Lokesh Chakka)

 

[CAUTION: External Email]

I have one more observation here.

After "$ sudo dpdk-devbind.py -b vfio-pci 83:00.0 83:00.1&quo= t;

 

Cards are shutting down. ifconfig is not showing the cards. reinse= rt of sfp is also not bringing the cards up. I had to restart the server. N= ot sure why the cards are going down.

 

Thanks & Regards
--
Lokesh Chakka.

 

 

On Thu, Jul 14, 2022 at 8:50 AM Varghese, Vipin <Vipin.Varghese@amd.com>= ; wrote:

[AMD Official Use Only - General]

Based on the compilation command shared it looks like you are using the bui= ld in shared library mode ` gcc main.c -g `pkg-config --cflags libdpdk --li= bs libdpdk`
Hence in EAL PCIe probe, the BNXT PMD is not triggered to identify the NIC.=

Solutions for these can be
1. Build with static library ` gcc main.c -g `pkg-config --cflags libdpdk -= -libs --static libdpdk`
2. pass the bxnt_en PMD shared library to eal args by ` sudo ./a.out -l 1 -= d librte_net_bnxt.so`

Can you try any of the above ?

> -----Original Message-----
> From: user= s-request@dpdk.org <users-request@dpdk.org>
> Sent: Wednesday, July 13, 2022 3:30 PM
> To: users@dpdk.org=
> Subject: users Digest, Vol 347, Issue 6
>
> [CAUTION: External Email]
>
> Send users mailing list submissions to
>         users@dpdk.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
>
> https://nam11.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Fmails.d= p
> dk.org%2Flistinfo%2Fusers&amp;data=3D05%7C01%7Cvipin.varghese%40amd.co
> m%7C55465d0d4faa4cd8496a08da64b674f4%7C3dd8961fe4884e608e11a82d9
> 94e183d%7C0%7C0%7C637933032067208770%7CUnknown%7CTWFpbGZsb3d8
> eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D
> %7C3000%7C%7C%7C&amp;sdata=3D6JHjf2Fu%2BkQ56CF9xTZvBS%2Bh8Uomlqv > E9dq9M7VefiU%3D&amp;reserved=3D0
> or, via email, send a message with subject or body 'help' to
>         users-request@dpdk.org
>
> You can reach the person managing the list at
>         users-owner@dpdk.org
>
> When replying, please edit your Subject line so it is more specific th= an "Re:
> Contents of users digest..."
>
>
> Today's Topics:
>
>    1. Re: skeleton code failing (Lokesh Chakka)
>
>
> ----------------------------------------------------------------------=
>
> Message: 1
> Date: Wed, 13 Jul 2022 12:56:37 +0530
> From: Lokesh Chakka <lvenkatakumarchakka@gmail.com>
> To: David Marchand <david.marchand@redhat.com>
> Cc: users <user= s@dpdk.org>
> Subject: Re: skeleton code failing
> Message-ID:
>         <CACh--sgKJ9B2=3DNd-EUUx4D7Kz87- > Nm_pwq59fY9QVNH+GBgwRg@mail.gmail.com>
> Content-Type: text/plain; charset=3D"utf-8"
>
> Dear David,
>
> following is some more stuff i did
> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D
> $ sudo dpdk-devbind.py -b vfio-pci 83:00.0 $ sudo dpdk-devbind.py -b v= fio-pci
> 83:00.1 $ sudo dpdk-devbind.py -b uio_pci_generic 83:00.0 83:00.1
> Error: Driver 'uio_pci_generic' is not loaded.
> $ sudo dpdk-devbind.py -b igb_uio 83:00.0 83:00.1
> Error: Driver 'igb_uio' is not loaded.
> $ sudo dpdk-devbind.py -b vfio-pci 83:00.0 83:00.1
> Notice: 0000:83:00.0 already bound to driver vfio-pci, skipping
> Notice: 0000:83:00.1 already bound to driver vfio-pci, skipping
> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D
> ~/Desktop/dpdk_examples/skeleton$ gcc main.c -g `pkg-config --cflags l= ibdpdk
> --libs libdpdk` lokesh@lokesh-ProLiant-DL385-
> Gen10:~/Desktop/dpdk_examples/skeleton$ sudo ./a.out
> EAL: Detected CPU lcores: 64
> EAL: Detected NUMA nodes: 4
> EAL: Detected shared linkage of DPDK
> EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
> EAL: Selected IOVA mode 'VA'
> EAL: No available 1048576 kB hugepages reported
> EAL: VFIO support initialized
> EAL: Using IOMMU type 1 (Type 1)
> EAL: Probe PCI driver: net_bnxt (14e4:1750) device: 0000:83:00.0 (sock= et 2)
> EAL: Probe PCI driver: net_bnxt (14e4:1750) device: 0000:83:00.1 (sock= et 2)
> TELEMETRY: No legacy callbacks, legacy socket not created Port 0 MAC: = bc 97
> e1 ce 84 f0 Port 1 MAC: bc 97 e1 ce 84 f1
>
> WARNING: Too many lcores enabled. Only 1 used.
> WARNING, port 0 is on remote NUMA node to polling thread.
> Performance will not be optimal.
> WARNING, port 1 is on remote NUMA node to polling thread.
> Performance will not be optimal.
>
> Core 0 forwarding packets. [Ctrl+C to quit] ^C
> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D
> After a few seconds, I presses ctrl+c
>
> surprisingly cards are not showing up even in ifconfig.
>
>
>
> Thanks & Regards
> --
> Lokesh Chakka.
>
>
> On Wed, Jul 13, 2022 at 12:43 PM Lokesh Chakka <
> lve= nkatakumarchakka@gmail.com> wrote:
>
> > Dear David,
> >
> > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D
> > $ lspci | grep -i broadcom
> > 83:00.0 Ethernet controller: Broadcom Inc. and subsidiaries BCM57= 508
> > NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet (rev 11)
> > 83:00.1 Ethernet controller: Broadcom Inc. and subsidiaries BCM57= 508
> > NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethernet (rev 11) $ l= spci
> > -n -s 83:00.0
> > 83:00.0 0200: 14e4:1750 (rev 11)
> > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D
> >
> > I am compiling my code like this :
> > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D
> > gcc main.c `pkg-config --cflags libdpdk --libs libdpdk`
> > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D
> >
> > Hence it is statically linked code.
> > If I try
> > $ dpdk-pmdinfo.py ./a.out
> >
> > But I am not seeing any output
> >
> >
> >
> > Thanks & Regards
> > --
> > Lokesh Chakka.
> >
> >
> > On Wed, Jul 13, 2022 at 12:22 PM David Marchand
> > <david.marchand@redhat.com>
> > wrote:
> >
> >> On Wed, Jul 13, 2022 at 7:35 AM Lokesh Chakka
> >> <lvenkatakumarchakka@gmail.com> wrote:
> >> > Would like to understand if I am missing something. I am= new to
> >> > this
> >> platform.
> >> > rte_eth_dev_count_avail is returning zero.
> >> > OS is Ubuntu 22.04. DPDK is latest version.
> >> > Cards are being detected by Linux. Ifconfig is showing t= he cards up.
> >> LED is also glowing.
> >>
> >> Indeed, DPDK provides a userspace driver for some NetXtreme n= ics
> >> (which is net/bnxt).
> >> This userspace driver does not rely on the bnxt Linux kernel = driver.
> >> IOW, this card being detecting and working with the Linux ker= nel does
> >> not automatically mean that this nic can work with DPDK.
> >>
> >> We need more info on your nic, first.
> >>
> >> Can you share the pci id of this nic (like running lspci -n -= s
> >> $pci_address)?
> >> It should be a 14e4:XXXX.
> >>
> >> Then you can check this XXXX against what your dpdk applicati= on supports.
> >>
> >> If it is a statically linked application, you can run:
> >> $ dpdk-pmdinfo.py /path/to/your/application
> >>
> >> Else, if your application is dynamically linked against DPDK = driver,
> >> you can run this command against the net/bnxt driver .so.22 (= for
> >> 21.11 and later releases):
> >> $ dpdk-pmdinfo.py /path/to/your/dpdk/drivers/librte_net_bnxt.= so.22
> >>
> >> You should get a list of supported NetXtreme nics, like:
> >>
> >> [snipped some other drivers compiled in my application] PMD N= AME:
> >> net_bnxt PMD HW SUPPORT:
> >>  Broadcom Inc. and subsidiaries (14e4) : BCM5745X NetXtr= eme-E RDMA
> >> Virtual Function (1606) (All Subdevices)  Broadcom Inc. = and
> >> subsidiaries (14e4) : BCM5745X NetXtreme-E Ethernet Virtual F= unction
> >> (1609) (All Subdevices)  Broadcom Inc. and subsidiaries = (14e4) :
> >> BCM57454 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb Ethernet (1614= ) (All
> >> Subdevices)  Broadcom Inc. and subsidiaries (14e4) : Net= Xtreme-E RDMA
> >> Virtual Function (16c1) (All Subdevices)  Broadcom Inc. = and
> >> subsidiaries (14e4) : NetXtreme-C Ethernet Virtual Function (= 16cb)
> >> (All Subdevices) [snipped the rest]
> >>
> >> I hope you can find a (XXXX) corresponding to your NIC.
> >>
> >>
> >> --
> >> David Marchand
> >>
> >>
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL:
> <http= s://nam11.safelinks.protection.outlook.com/?url=3Dhttp%3A%2F%2Fmails.dp=
> dk.org%2Farchives%2Fusers%2Fattachments%2F20220713%2Fa362f7fe%2Fatta > chment-
> 0001.htm&amp;data=3D05%7C01%7Cvipin.varghese%40amd.com%7C55465d0d4f<= br> > aa4cd8496a08da64b674f4%7C3dd8961fe4884e608e11a82d994e183d%7C0%7C
> 0%7C637933032067208770%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjA
> wMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C
> %7C&amp;sdata=3DjXnaf1qrCA5VSCMyrPPc5S5WYsHveR1tNBL4lczkGVE%3D&= ;am
> p;reserved=3D0>
>
> End of users Digest, Vol 347, Issue 6
> *************************************

--_000_MN2PR12MB3085898D0DADAB7BDD885EF782889MN2PR12MB3085namp_--