From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id E1F7142E5C for ; Thu, 13 Jul 2023 09:29:10 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id B35E840DDB; Thu, 13 Jul 2023 09:29:10 +0200 (CEST) Received: from NAM10-MW2-obe.outbound.protection.outlook.com (mail-mw2nam10on2077.outbound.protection.outlook.com [40.107.94.77]) by mails.dpdk.org (Postfix) with ESMTP id ADE3740DDA for ; Thu, 13 Jul 2023 09:29:08 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=oGhHW5wtbINFAFZKmNdGcA3PdTMMBL7SkP7X7XHz7FGPHsPEI7wMx3Nud2nY2R4YQ3h2uLK3TBpa2dwmsk95MmPU0dNkHQEPkE893BRUqEmy7cxwLAhNkq79HI7LA0FmW6XthhyoXM87pdJfVYFXlX3qUu69IZ6TEXqvJBlGguOIRa6RWrUEpqPzMZE9tkk1UVTgSSFoGtDDwFR5AOdXqjFe9XdAflHwT0Ws3eaK/Avf3qG3Ux8ixPwOzxIwmVg8iTdnm8jIOuU4fMvFZyvTCPEdIOn9jNe7IPH+RStp1TTflBaSxFLpBAW7BXeKhwm/BwdstnbpnFVfjUz9w3OIiQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=1mOHtN/mGsThWnE2qSm4oKbwWOg0mWOKQnM0IWiKs6I=; b=i4olhkMbTnOZTDWUMrUAZ1DHqLjkW708c8W4GwqeCG5H8WkF0ufRDVgcuz2UScnedoUYRah99aoQevEEywwYLwUjz5qmKnutYf/3D1kZWRSxUcUJ3Yl2T8Kd9pxNnn2fCbLZzT0x7vGqdF/5jMyxkg58fgW6MRk/puIirqXD0shWNBLGX3vMpBJcsx4xMnsvlFBWUBoJ4NfrlD/th1mM51438r868xEPeZRQzhpVKYTr5up8VBKMlxYelmX1TRwEAXrC5j3NFPErqu3dcQ/olYlnXCo6LfPx+DLjsSytsuPTRGYCRQwgjHp3VYT/185apu4IJPaLQFvJApV36Gohog== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1mOHtN/mGsThWnE2qSm4oKbwWOg0mWOKQnM0IWiKs6I=; b=K263JRnaSsFXDb60aEZIU82htwWAHrGb3tY4GD7UBaTOJxqlBivthuTfC6s6A7VXGv2McQylbw1J7t7gcH2qOh08s2AxoGvT1O2NQ5JK+s2744Yx2LoXdqCKwx53RMIvncavDgv/8Ub4DKEhqLnmmFdfmgn6PabG1uZnReiTyYAOZ9FafhEZY5hQV/2F+JsW07JD94SVfgLT+1MCfzrf2Jv+kcHWP5cA0Eu9UrMU+r+kCKtZ+BjmUyQISi1HFCJuNqiBqPLQ1MU5xxx/A8BI6ANBVC3linKNYtohbZrF3pZa7Yxr+OOjgrKhRZ0g7b5w7etxtj6Do6a9VN+8urkidQ== Received: from DM6PR12MB3753.namprd12.prod.outlook.com (2603:10b6:5:1c7::18) by SJ2PR12MB9139.namprd12.prod.outlook.com (2603:10b6:a03:564::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6588.20; Thu, 13 Jul 2023 07:29:06 +0000 Received: from DM6PR12MB3753.namprd12.prod.outlook.com ([fe80::d334:fbf1:5059:a0ec]) by DM6PR12MB3753.namprd12.prod.outlook.com ([fe80::d334:fbf1:5059:a0ec%6]) with mapi id 15.20.6588.022; Thu, 13 Jul 2023 07:29:06 +0000 From: Slava Ovsiienko To: "jiangheng (G)" , Matan Azrad CC: "users@dpdk.org" Subject: RE: dpdk coredump when i used mlx5 NIC send packets in secondary process Thread-Topic: dpdk coredump when i used mlx5 NIC send packets in secondary process Thread-Index: Adm0uTghKODOHpmMSrOdq+g/wkE4UwAoW26w Date: Thu, 13 Jul 2023 07:29:06 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nvidia.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: DM6PR12MB3753:EE_|SJ2PR12MB9139:EE_ x-ms-office365-filtering-correlation-id: 4a1be200-5eb3-42b4-664d-08db8372d74f x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: BCt2cGRxvZYmxecUqbFlXyOGwxflHDgtTc+FDZbCnfyn9vymRoXD19Wo2rhx4hKawDyIi93Y3agjmlizcVCFOhzI9P08gd3zHi15bRlP3YuQ1YeTGtK9dWdVEnGr/dU2vdUu2bQgkJWVRkrg3mHDkNjmuhHNV1X3vWOqNOd+YlThsUKO3NWWzrUFEmqfNZ/uJ4laXA7PxPEM09V4pkHJC7HTYzIh05jPos+Eyi4QEKFaHGfHOQEjWwnFhL2zTS4IZ/25Z72CJ3a4u1W980iOJoIP2aOmDeeuwfGV79KyXYy5Dhsqh35l5ATLr+DrEGy3hYutKV7SvOVmQfKs+G6rl/Kf188B6s6PNrpztfOtywUx0EdjPNwRcE5MB4P11relEsiUCSOXuHzlFR+VrpcfUUNwKm54qiaI1f2hVVIxQ+LJzaL1TVaAQunHL1MuO5uWdh4a2sGgtcr5mgF07olLiCzKWle8k6erDKyNNyYyqC1Cg1LyZldXjOpz3U64Va+TB9ux++pI5iwcp1Rp3R2eMoZ40BTeVjVXPqLepD+1aIPpKGoqXZ5HlK5H77Z5gSzY0FHvpOm6R77hFliqYQV0dT4pA7cGnC9mYKFZfP3kTAnn7tIx1yklOe+Fnr8zU4NZLPJgoR4Qwy3HmzYMTkji7A== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DM6PR12MB3753.namprd12.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230028)(4636009)(346002)(366004)(136003)(39860400002)(376002)(396003)(451199021)(2906002)(55016003)(122000001)(166002)(38100700002)(83380400001)(53546011)(26005)(186003)(6506007)(86362001)(5660300002)(33656002)(52536014)(38070700005)(9686003)(8676002)(8936002)(110136005)(478600001)(71200400001)(7696005)(66556008)(66946007)(41300700001)(4326008)(6636002)(64756008)(9326002)(76116006)(316002)(66476007)(66446008); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?jR7IJpStRWaEhjpaJjHlY6G2BIFb6AEj9yd4eDhTJLwATDoXxprkGgM4YYGo?= =?us-ascii?Q?oTlsS/kngLm0yxLeY+eQ7PWIrqUKdXitqJDN2/bSTTZF/BJN5LWFCSomQKjv?= =?us-ascii?Q?u+zgnRYyRfHVtJvxbtrSuoCQs+vST42U8/jMEYmhMiZ6SiIdIoCV5hyTL2kn?= =?us-ascii?Q?uAzxHWDoGqF+5dA11ZIE1yrmUkxIAMcaxH72vLHP59mfcgjDL9/G3fFRjLsy?= =?us-ascii?Q?HVz17sdxyz8geGt4h3j6hX3XII2mPsEsNDKONWJB1Bx8G0s7b2rBUCtD92gN?= =?us-ascii?Q?J4t22CFNgtNfumfZE6pWU2MBE/2k4DRMM8YpWHZ/uDPMeyEEKuGYrfHWLNmP?= =?us-ascii?Q?yGMjBJFV1U1L3N4QBI7EXHsNr5p360g3+qZvRU8455AWau3ETcXr8oLz2VtX?= =?us-ascii?Q?VDT8yvkiz8XbKHntFxtn8do3sdu647qYYj0m0S94Zhh6PUdzffXN0/8Rfopm?= =?us-ascii?Q?9NKUVCG9tfBoTyUNWnivRz6E3xpePtFJrfkPrA8tShG7ML3dsZAjNy14J/hj?= =?us-ascii?Q?5IOFD6pG9Y+XnjKt1BMP2sQr87UTMASp8dfpZo+Efkipvf93ZpmKzwf4Nvba?= =?us-ascii?Q?CV+9VJ/mfiy6B4sjbt41cI1MJZm69pKtwJyV3ee8sr9YRTR7SvlmI7DxkF/0?= =?us-ascii?Q?PSbmwaaphRyyUgQqnKf5sR0VN1QRQtVPse+gINdfNFdbnmTlJYhETa0mNWzs?= =?us-ascii?Q?0aWgLLzk5KzluBu/HhPlHnrjRzXbAQ/5HB8VhrvKgvj6loAmuYIdONK02dg3?= =?us-ascii?Q?uMEqrxNuct7Lh/0MSxtC1cw8bMIfvXPpLLOB3SK0KvGrEa8m0lIqlvb/Gsz0?= =?us-ascii?Q?S88efGVVzXmqcL2Psdxyvm0TYcFK+ehVAorumKaqpZcj6u8UtjMDMZ3MZ8+z?= =?us-ascii?Q?7z7u+UJVdCXMYLymCVGErCNo5QLP/EGQU7aWzme1c01x3RRUD9EPJEA4rtr+?= =?us-ascii?Q?ntvJHyCpH7ZLTAHw40KnL7t9Si2LC5bn2DwTLR6uCEzGzybyidBFaDUP/uRN?= =?us-ascii?Q?6ya2znf1oP4J/Ev8wBHlzxgz6+eo4ylZ//NukxYHYKvxCk87LSnyI7JOJ+cK?= =?us-ascii?Q?WaVs0LVZDLq/dpeH2Ze01YZBTauLa5iV6V/MOSisSai5ugW2+9/sLa2GYhkC?= =?us-ascii?Q?o4IVgwm8OHhK0FTHVbDaf7UrtUV/6RlarI3H6bAoAkeYpfhZzsOqofmw1z6r?= =?us-ascii?Q?ft5qzsDooBmbFXtpoDZ4UPG5mFsY2heQEOMo3RScEkcT0LkmTDQvjUIN1EfH?= =?us-ascii?Q?xROVpsII7CovgmjadYa0c1BTn41iRlLz1huhxvVu4ytEOrkU3QTqbSfvwKZA?= =?us-ascii?Q?D9Ujdo8pAo3qpWR1/M7T5VykunsVFI8c+j25lT0XGqTr5U0l4H4wbmDktP9j?= =?us-ascii?Q?A3cux+Qnkk03k2IvIg4ex/7lE+AOD1yR3U6FwdBoaJkcXsdGePkR3PclWiLW?= =?us-ascii?Q?h1sSo044/YiDTstb1XzSqTLosIdnyuwxJRLwZIrj64q4BstUnTwyN7VGzcC8?= =?us-ascii?Q?zYBHI3+S/J7EZ0laZUBAEIfJrGY7G8HCAONoSoIHvyGG970Q9Elmq509EfSl?= =?us-ascii?Q?M5jmH8MlqFX9geZTpAOwyon4EpVI2FQPV9lNBQPz?= Content-Type: multipart/alternative; boundary="_000_DM6PR12MB375399CC6D90035110083A91DF37ADM6PR12MB3753namp_" MIME-Version: 1.0 X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DM6PR12MB3753.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 4a1be200-5eb3-42b4-664d-08db8372d74f X-MS-Exchange-CrossTenant-originalarrivaltime: 13 Jul 2023 07:29:06.4347 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 7TNXdNYftOT6CsXB/CxWhh34GiPyDTsCmWnpVknE16QtDZqPCTSp7rSm+9o1aY58rosreexQa0Zv4IJJYylQOQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ2PR12MB9139 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org --_000_DM6PR12MB375399CC6D90035110083A91DF37ADM6PR12MB3753namp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, We see the array of queue data (Rx/Tx) is not filled correctly (NULLs). Was device started ? When the secondary process was started? After the primary probed the device and started traffic successfully ? Could you, please, tell the scenario of the pri/sec proceses start? With best regards, Slava From: jiangheng (G) Sent: Wednesday, July 12, 2023 3:08 PM To: Matan Azrad ; Slava Ovsiienko Cc: users@dpdk.org Subject: dpdk coredump when i used mlx5 NIC send packets in secondary proce= ss Hi matan and Slava: I observed dpdk coredump when I used mlx5 NIC send packets in secondary pro= cess: Thread 6 received signal SIGSEGV, Segmentation fault. [Switching to LWP 593263] 0x00007ffff7f5b44e in rte_eth_tx_burst (port_id=3D0, queue_id=3D3, tx_pkts= =3D0x7fffefff7f28, nb_pkts=3D1) at /usr/local/include/rte_ethdev.h:5777 5777 qd =3D p->txq.data[queue_id]; (gdb) bt #0 0x00007ffff7f5b44e in rte_eth_tx_burst (port_id=3D0, queue_id=3D3, tx_pk= ts=3D0x7fffefff7f28, nb_pkts=3D1) at /usr/local/include/rte_ethdev.h:5777 #1 0x00007ffff7f5ed7a in vdev_tx_xmit (stack=3D0x7fffe8000b20, pkts=3D0x7ff= fefff7f28, nr_pkts=3D1) at netif/lstack_vdev.c:142 #2 0x00007ffff7f4bd77 in eth_dev_output (netif=3D0x7fffe8002528, pbuf=3D0x0= ) at netif/lstack_ethdev.c:876 #3 0x00007ffff7e84ab8 in etharp_raw (netif=3D0x7fffe8002528, ethsrc_addr=3D= 0x7fffe8002564, ethdst_addr=3D0x7ffff7f775da , hwsrc_addr=3D0x7fffe8002564, i= psrc_addr=3D0x7fffe8002530, hwdst_addr=3D0x7ffff7f775d4 , ipdst_addr=3D0x7fffe8002530, opcode= =3D1) at core/ipv4/etharp.c:1179 #4 0x00007ffff7e84ec8 in etharp_request_dst (hw_dst_addr=3D,= ipaddr=3D, netif=3D) at core/ipv4/etharp.c:1206 #5 etharp_request (netif=3D, ipaddr=3D) at co= re/ipv4/etharp.c:1224 (gdb) p *p $1 =3D {rx_pkt_burst =3DJiang 0x7ffff63288c0 , rx_queue_= count =3D 0x0, rx_descriptor_status =3D 0x7ffff61709d0 , rxq = =3D {data =3D 0x0, clbk =3D 0x7ffff6e515a8 }, reserved1 =3D {0, 0, 0}, tx= _pkt_burst =3D 0x7ffff623ba60 , tx_pkt_prepare =3D 0x0, tx_descriptor_status =3D 0x7ffff618a870 , txq =3D {data =3D 0x0, clbk =3D 0x7ffff6e535a8 }, reserved2 =3D {0, 0, 0}} (gdb) p p->txq.data $2 =3D (void **) 0x0 (gdb) P->txq.data is NULL I used dpdk-21.11. (https://github.com/DPDK/dpdk/tree/v22.11), I looked up = the stable branch, and there doesn't seem to be a relevant bugfix patch. The same app does not have this coredump on i40e/ixgbe NIC. Thanks --_000_DM6PR12MB375399CC6D90035110083A91DF37ADM6PR12MB3753namp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi,

We see the array of queue data (Rx/Tx) is not filled correctly (NULLs).
Was device started ?

When the secondary = process was started?

After the primary p= robed the device and started traffic successfully ?
Could you, please, tell the scenario of the pri/sec proceses start?

 

With best regards,<= br> Slava

 

From: = jiangheng (G) <jiangheng14@huawei.com>
Sent: Wednesday, July 12, 2023 3:08 PM
To: Matan Azrad <matan@nvidia.com>; Slava Ovsiienko <viache= slavo@nvidia.com>
Cc: users@dpdk.org
Subject: dpdk coredump when i used mlx5 NIC send packets in secondar= y process

 =

Hi matan = and Slava:

I observe= d dpdk coredump when I used mlx5 NIC send packets in secondary process:

&nbs= p;

Thread 6 = received signal SIGSEGV, Segmentation fault.
[Switching to LWP 593263]
0x00007ffff7f5b44e in rte_eth_tx_burst (port_id=3D0, queue_id=3D3, tx_pkts= =3D0x7fffefff7f28, nb_pkts=3D1)
at /usr/local/include/rte_ethdev.h:5777
5777 qd =3D p->txq.data[queue_id];
(gdb) bt
#0 0x00007ffff7f5b44e in rte_eth_tx_burst (port_id=3D0, queue_id=3D3, tx_pk= ts=3D0x7fffefff7f28, nb_pkts=3D1)
at /usr/local/include/rte_ethdev.h:5777
#1 0x00007ffff7f5ed7a in vdev_tx_xmit (stack=3D0x7fffe8000b20, pkts=3D0x7ff= fefff7f28, nr_pkts=3D1) at netif/lstack_vdev.c:142
#2 0x00007ffff7f4bd77 in eth_dev_output (netif=3D0x7fffe8002528, pbuf=3D0x0= ) at netif/lstack_ethdev.c:876
#3 0x00007ffff7e84ab8 in etharp_raw (netif=3D0x7fffe8002528, ethsrc_addr=3D= 0x7fffe8002564,
ethdst_addr=3D0x7ffff7f775da <ethbroadcast>, hwsrc_addr=3D0x7fffe8002= 564, ipsrc_addr=3D0x7fffe8002530,
hwdst_addr=3D0x7ffff7f775d4 <ethzero>, ipdst_addr=3D0x7fffe8002530, o= pcode=3D1) at core/ipv4/etharp.c:1179
#4 0x00007ffff7e84ec8 in etharp_request_dst (hw_dst_addr=3D<optimized ou= t>, ipaddr=3D<optimized out>, netif=3D<optimized out>)
at core/ipv4/etharp.c:1206
#5 etharp_request (netif=3D<optimized out>, ipaddr=3D<optimized ou= t>) at core/ipv4/etharp.c:1224

(gdb) p *p
$1 =3D {rx_pkt_burst =3DJiang 0x7ffff63288c0 <mlx5_rx_burst_vec>, rx_= queue_count =3D 0x0,
rx_descriptor_status =3D 0x7ffff61709d0 <mlx5_rx_descriptor_status>, = rxq =3D {data =3D 0x0,
clbk =3D 0x7ffff6e515a8 <rte_eth_devices+104>}, reserved1 =3D {0, 0, = 0}, tx_pkt_burst =3D 0x7ffff623ba60 <mlx5_tx_burst_none>,
tx_pkt_prepare =3D 0x0, tx_descriptor_status =3D 0x7ffff618a870 <mlx5_tx= _descriptor_status>, txq =3D {data =3D 0x0,
clbk =3D 0x7ffff6e535a8 <rte_eth_devices+8296>}, reserved2 =3D {0, 0,= 0}}
(gdb) p p->txq.data
$2 =3D (void **) 0x0
(gdb)

&nbs= p;

&nbs= p;

P->txq= .data is NULL

&nbs= p;

I used dp= dk-21.11. (https://git= hub.com/DPDK/dpdk/tree/v22.11), I looked up the stable branch, and ther= e doesn't seem to be a relevant bugfix patch.

The same = app does not have this coredump on i40e/ixgbe NIC.

&nbs= p;

&nbs= p;

Thanks

--_000_DM6PR12MB375399CC6D90035110083A91DF37ADM6PR12MB3753namp_--