From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 2FBEBA00C4; Tue, 26 Jul 2022 03:08:12 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id C3B0940697; Tue, 26 Jul 2022 03:08:10 +0200 (CEST) Received: from mga09.intel.com (mga09.intel.com [134.134.136.24]) by mails.dpdk.org (Postfix) with ESMTP id 4C0B840684 for ; Tue, 26 Jul 2022 03:08:09 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1658797689; x=1690333689; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=Vhnd4fKlgK/wkkxVckWjnTFnf+v0hxC1XEfUmdKV3Mo=; b=fgrGHlcLxzPKscFgtkMR91kClhRSbxcwzLxZzytSipyrNWd0Rb7A5HSq 1imrdfG2eJ/DwSnW/K0BfWVQLvlQ2zJZ7nahX5ZisAbN8DosAkC3jRZQL pHt/pRA2KIL9lpc03fUS4lyGAdNAnNtesnu6Abec2M8696EmZSZlFQpz+ JQFW70P1mv752vtLTZH31FGBxUfNwGxjdScRD7vTeIVPAg7aUsn44Dzys lG/McNE2xr95YI74x7EBwzVMVp87dMyCEaxcVZLzQYeul/ZUcizDL78bo wOtue0P2pvhMmYWOaftxxvVUaKJdkb/Ij2ka1S54f6/9Vh2lnhSmhB8o0 A==; X-IronPort-AV: E=McAfee;i="6400,9594,10419"; a="288587915" X-IronPort-AV: E=Sophos;i="5.93,193,1654585200"; d="scan'208";a="288587915" Received: from orsmga005.jf.intel.com ([10.7.209.41]) by orsmga102.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 25 Jul 2022 18:08:08 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.93,193,1654585200"; d="scan'208";a="776131995" Received: from fmsmsx606.amr.corp.intel.com ([10.18.126.86]) by orsmga005.jf.intel.com with ESMTP; 25 Jul 2022 18:08:07 -0700 Received: from fmsmsx611.amr.corp.intel.com (10.18.126.91) by fmsmsx606.amr.corp.intel.com (10.18.126.86) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.28; Mon, 25 Jul 2022 18:08:07 -0700 Received: from fmsedg602.ED.cps.intel.com (10.1.192.136) by fmsmsx611.amr.corp.intel.com (10.18.126.91) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.28 via Frontend Transport; Mon, 25 Jul 2022 18:08:07 -0700 Received: from NAM04-DM6-obe.outbound.protection.outlook.com (104.47.73.41) by edgegateway.intel.com (192.55.55.71) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2375.28; Mon, 25 Jul 2022 18:08:07 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=R8A0Dh4tNvYYPxa9f6AR0ppeHcko6XyN8a8VkPk2QQgvgIBv0CipoCqCvZjMJtmxRf1GhtB1a9HOD0BgJr7JJwqLSfrP39c8EOeuHCGhaHQR3ZDQS4RM+1apsuF43l6oyoYhTTTztgmTuYstlseKHaMbS52Dx93u984sAEe/WcB/grOHhWBoYAiOAEQqsWnviqS7SYMYmz2NsQetBhr41N+6fqCCXFL779n6yfgvP1w+0fStOinH5Dhcnedtx5H3wNAchkjHSv5yN9msQGMOi1Llj+IEWx4cN/FTudZXSLn4NR//sO6SAg/FS+DE9j0nr2WpGCUFIxg/h8FLCZGeXg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Vhnd4fKlgK/wkkxVckWjnTFnf+v0hxC1XEfUmdKV3Mo=; b=KFSdl1c3aRRYv6wV7Qj/u5MP0OyDsERsuvLfxJToaRcC2IVSZDeCV3PqD4liQr46CFjHuHuyuJIUhNSXMpVThLM2FcjIaewbWC4egsmmW5Sl7MZZOHoP2BGxTtsIdHiMO4MqAS5AymnHHtUhGk4/19qd3qoJXqWnE5fCpZMsfhCEu5Adz1a3o9nMuPjAJ6uRfMInC/n4HVMtT6YsFAko01T5qxf66dt7yftaqQTnOrhrQ0nivIIgukmkyMh+FBcjQxanpyx1ljmMgHVILKLfyX6MqaewnBx97AjgzFNE3B7fb4OTRVZFYPYmrYo9myOkb+pEDXsyyCwKqVYznUtCoQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from SN6PR11MB3504.namprd11.prod.outlook.com (2603:10b6:805:d0::17) by BL0PR11MB3219.namprd11.prod.outlook.com (2603:10b6:208:61::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5458.19; Tue, 26 Jul 2022 01:08:05 +0000 Received: from SN6PR11MB3504.namprd11.prod.outlook.com ([fe80::9df2:719:c1bb:7992]) by SN6PR11MB3504.namprd11.prod.outlook.com ([fe80::9df2:719:c1bb:7992%7]) with mapi id 15.20.5458.024; Tue, 26 Jul 2022 01:08:05 +0000 From: "Xia, Chenbo" To: Chinmaya Agarwal CC: "dev@dpdk.org" Subject: RE: Issue seen in DPDK behavior for virtio driver Thread-Topic: Issue seen in DPDK behavior for virtio driver Thread-Index: AQHYn/+hKWqhW1Fpg0C/y+XFo2/Upa2P1y/A Date: Tue, 26 Jul 2022 01:08:05 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US, zh-CN Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: dlp-product: dlpe-windows dlp-reaction: no-action dlp-version: 11.6.500.17 authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 7fd9371a-c2e4-4567-1ed3-08da6ea34bca x-ms-traffictypediagnostic: BL0PR11MB3219:EE_ x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: Ud4GdeF+lAMWVJsPS213I205PaGHHiS04P7dHyAGLSgYDUe39+a4AAdUOk+Olm2h5XQq1yq7lWt3TvvIWfHe1geKQ6LdECrlkz5UaTxLCAg6nyfmgIov8PNA4Pcl9KGKdQM9mVBN61l7dZDusFuj/pZ8t5z7EcQOwvtu9g1KCRspKmBbhWwh57u5nFY7iOnW+aZShDy21tkSwDxCkjwnr08n/Ud13CIYQA80PJVAd99GiTma8lR4Z0GgzmF7vTX9luwD1RZU1XAF8aQV0hdpty4wJAEeEnUH9TsV/W3QEV2mvLldnduX6+wLUBst/jaWssHIsuJfZxN90a3p4h8J0chrWsIwycZRk9v9qQsCkzVSuw4X18Nj9K2FC5YZsgJFRXUxlLwhaCJcNGc3wlN9skEoDL5ZxhJfgVFWZcVA19Ho5EbdEGxAe5oCmrSkDBWJ3oIB/s35AnKXlkwJ71KXRSn/Dw4QRvVUwPExQ9NTC2LtB9+lvK84zfvbDBHwr/Ulv/17YYGXurwXBfLXYdwspfzFgN/D8PGMX+hL4zPISDz1/5yON2ZQlJHHO0brvIXoVpUdKce66ChYOm/KX1K5VHtXWNUBZFTfnK51WoUX3A062sqA7xveqv65BQ7Fe+GKqT4C8LLCVQWwHwlFKD/supfFtP7xHTsUlnpMEf5q2A3BZZVJxCsZLTtj4RMjquUV3cabUHdP70SVat8UTnyvizkOLR6d+qonXkRgTAk6lDuxIsYooFvbLsLXDNaJ4emqFS5l+Yajo4gCuokJ7v+U6Ml1Z1da2JFiT0DimDtLcQKp1yI56SQ0/q3K+rUDP39I x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SN6PR11MB3504.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230016)(396003)(366004)(136003)(39860400002)(346002)(376002)(82960400001)(122000001)(53546011)(38100700002)(8936002)(5660300002)(52536014)(2906002)(478600001)(86362001)(41300700001)(6862004)(66446008)(7696005)(6506007)(83380400001)(4326008)(66476007)(64756008)(66946007)(26005)(76116006)(66574015)(8676002)(316002)(38070700005)(186003)(55016003)(33656002)(66556008)(71200400001)(9686003); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?OlnURGmPs0Zl/HtR+8KX+k4187MCBYkOdU3T7d4/OXa4lpSEHFnw9SjXOx?= =?iso-8859-1?Q?4blWc0rx0Y0JnDas1MZIpkWg/YbSNJ3NQAbIXCF5JGsnJu7NHAjysV4yjc?= =?iso-8859-1?Q?5vBmMAjiJxX9py3TG6HNAMZV4mSsu/dL2zlhGjbqKu/GqG8WCkjxJNMSQb?= =?iso-8859-1?Q?1Q9qFImf7rj65XYRskwX2xwiRpqRXrl68xJWRFoDZUF2ZO2EwalPu3hsZg?= =?iso-8859-1?Q?+AU71CjMhxpIFqFeQXzGqvOQE5Or1Zlr76rneZfYDEU5a9Dpc5meziLNfO?= =?iso-8859-1?Q?ALULR1tIqnmnJSmbTcO7/E0w7kh5NvYObQFBwDiIguTJGY3vqR456RR6lH?= =?iso-8859-1?Q?x88Hvpw9llBQV0zad2zzDRnlpL0REBrBTaIwMFvgntzkYSaTgthSPpjOEQ?= =?iso-8859-1?Q?cdHm7igjJDsxPwIdJ049IRifzfSZCQ1zPauHa/xb3cgOgzgXPiogvtHAs/?= =?iso-8859-1?Q?swZ1UfmtioG7Ig06eNROtyASnQU6ebdfEgjM1FB0MlC3sisVFYIkgcaiMC?= =?iso-8859-1?Q?PrEMyZjey4rZPHEDHxcvrNYZ1whxlDLQjBTJRmoWtceyhF9VUT/IW0NK22?= =?iso-8859-1?Q?TophLuvJB5RtDf4tKKgKvq7M3Ez1J2SsfubVt288pYmJqTqTQJDoutK5LT?= =?iso-8859-1?Q?IAEgFt4Lf4pXrL3cMyAjZGzXjd+X+oDUm9CBBi1PneZpjBhRwcJs1f14hq?= =?iso-8859-1?Q?wiwdRrUpzsTRL7/66zui7/dywGZx1n3dcG9hPsnlBcVJg9KgzWNoE91Pmz?= =?iso-8859-1?Q?cW1g7xfbo5BcN2EJcsodu5jyNRUiMZ+Loi5tUzs6vT0FJLeKStniNyZYjr?= =?iso-8859-1?Q?3CRgG7hRCoh6Ubr/GzvjZ9BeLWLh2vxV/6g5KTi30ZSPwn6uW34kJC2gwk?= =?iso-8859-1?Q?HMoPTctTZ+nVSBRAbpG4wWQneHo5Fv8Y0gPhTJa1BG5WqOWtXspqCUwo4w?= =?iso-8859-1?Q?uplQIypqmGuulh84hIO5UwgJI/LaEfcc+O3m0NWWqMNhQUNwVsvBiQbRad?= =?iso-8859-1?Q?NN3FQ5Sz0ILOZ2c+bsUfxnreIiqAmUxVaWGBN3HrvROnuWtubv6fHGaKjC?= =?iso-8859-1?Q?Gvl3MQ6OuTQvRykiXbNjPFeRqQtN3Y7GpIhSQ7SxrGyBCrNoVtOV1nyh09?= =?iso-8859-1?Q?jvSlQNyu7qztnxEA+908pYa6R/zxdhEXnhDo/Me4foNb0undADFuDuh9ku?= =?iso-8859-1?Q?ZIvQlCKTaIrGGxGQJR6s68VjuIIxoQDXZrBnCu8ONCDu0aiUmSj2KgJCD2?= =?iso-8859-1?Q?fsNXIst1D5//odU0jR9XeaOuK9H4FZodEg+KiRiSDSpBBFP3LsVGQyMK4T?= =?iso-8859-1?Q?y9gFvL8Q4JdNLvo56zatK93DPGA+fEkZIIIp7ALvM5e4a7t5VeU+9BFkML?= =?iso-8859-1?Q?xvoLu5C6WLjG74ZaLxH9F+zsGazUz0HlmNqVUwMxLYSTug42crv0evrO46?= =?iso-8859-1?Q?FJRa3CFF+dSuOv3jaXChHI8t6UIacGdif2VDkftjRXFh86qxbqdD2Dn81m?= =?iso-8859-1?Q?dvqGYGsB2lOslapGTL/maH0zD+GMaasBLLPwGbfS6mzqIbvetoGga9qDHN?= =?iso-8859-1?Q?npfktDZTvnD1dtKB411iMwH/+6EHKjhZF+fACtmJqZ5V6MWZ3P7lEhxeQ3?= =?iso-8859-1?Q?a/GiuUPBa0FIYWYvWNvY4ccRLx+oYLAeWd?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SN6PR11MB3504.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 7fd9371a-c2e4-4567-1ed3-08da6ea34bca X-MS-Exchange-CrossTenant-originalarrivaltime: 26 Jul 2022 01:08:05.6139 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: nwxIFpVr14lgp2dSIX/r0WmB/L1xuvDkEIZaVPU9yFrXQDl+N5a1nRw9FyzceJg3da4B1JSVZvmGnr6a95gL5g== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR11MB3219 X-OriginatorOrg: intel.com X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Hi, Please check the cause of segfaults, null pointer, or? Then you can have so= me clues Thanks, Chenbo From: Chinmaya Agarwal =20 Sent: Monday, July 25, 2022 4:25 PM To: dev@dpdk.org Subject: Issue seen in DPDK behavior for virtio driver Hi, We are running VPP v22.02 and DPDK v21.11.0 on Centos 8 VM. We are facing a= n issue where if we configure an SRv6 policy on VPP with sid list having 4 = SIDs we don't see packet coming out of the VPP interface and if we configur= e 5 SIDs, again we don't see the packets coming out of the interface plus V= PP crashes after some time. We analyzed the crash dump, and it seems that t= he crash is happening in DPDK library in the virtio driver code leg. The in= terface we are using has virtio driver associated with it. Below is the DPD= K core dump:-=20 Thread 1 "vpp_main" received signal SIGSEGV, Segmentation fault. 0x00007fe67f1cf256 in virtio_update_packet_stats () from /usr/lib/vpp_plugi= ns//dpdk_plugin.so (gdb) bt #0 =A00x00007fe67f1cf256 in virtio_update_packet_stats () from /usr/lib/vpp= _plugins//dpdk_plugin.so #1 =A00x00007fe67f1d6646 in virtio_xmit_pkts () from /usr/lib/vpp_plugins//= dpdk_plugin.so #2 =A00x00007fe67f42d60e in rte_eth_tx_burst (nb_pkts=3D, tx= _pkts=3D0x7fe6862afc00, queue_id=3D, =A0 =A0 port_id=3D) at /opt/vpp/external/x86_64/include/rte_= ethdev.h:5680 #3 =A0tx_burst_vector_internal (n_left=3D1, mb=3D0x7fe6862afc00, xd=3D, vm=3D) =A0 =A0 at /usr/src/debug/vpp-22.02.0-35~ge3c583654.x86_64/src/plugins/dpdk= /device/device.c:175 #4 =A0dpdk_device_class_tx_fn_hsw (vm=3D, node=3D, f=3D) =A0 =A0 at /usr/src/debug/vpp-22.02.0-35~ge3c583654.x86_64/src/plugins/dpdk= /device/device.c:435 #5 =A00x00007fe6c66bd802 in dispatch_node (last_time_stamp=3D, frame=3D, =A0 =A0 dispatch_state=3DVLIB_NODE_STATE_POLLING, type=3DVLIB_NODE_TYPE_INT= ERNAL, node=3D0x7fe685e93c00, vm=3D0x7fe68547a680) =A0 =A0 at /usr/src/debug/vpp-22.02.0-35~ge3c583654.x86_64/src/vlib/main.c:= 975 #6 =A0dispatch_pending_node (vm=3Dvm@entry=3D0x7fe68547a680, pending_frame_= index=3Dpending_frame_index@entry=3D10, =A0 =A0 last_time_stamp=3D) at /usr/src/debug/vpp-22.02.0-35= ~ge3c583654.x86_64/src/vlib/main.c:1134 #7 =A00x00007fe6c66c1ebf in vlib_main_or_worker_loop (is_main=3D1, vm=3D) =A0 =A0 at /usr/src/debug/vpp-22.02.0-35~ge3c583654.x86_64/src/vlib/main.c:= 1600 #8 =A0vlib_main_loop (vm=3D) at /usr/src/debug/vpp-22.02.0-3= 5~ge3c583654.x86_64/src/vlib/main.c:1728 #9 =A0vlib_main (vm=3D, vm@entry=3D0x7fe68547a680, input=3Di= nput@entry=3D0x7fe675df5fa0) =A0 =A0 at /usr/src/debug/vpp-22.02.0-35~ge3c583654.x86_64/src/vlib/main.c:= 2017 #10 0x00007fe6c670cc86 in thread0 (arg=3D140628055271040) =A0 =A0 at /usr/src/debug/vpp-22.02.0-35~ge3c583654.x86_64/src/vlib/unix/ma= in.c:671 #11 0x00007fe6c5c29388 in clib_calljmp () at /usr/src/debug/vpp-22.02.0-35~= ge3c583654.x86_64/src/vppinfra/longjmp.S:123 #12 0x00007ffcdf319c80 in ?? () #13 0x00007fe6c670e210 in vlib_unix_main (argc=3D, argv=3D) =A0 =A0 at /usr/src/debug/vpp-22.02.0-35~ge3c583654.x86_64/src/vlib/unix/ma= in.c:751 #14 0xffffffffffffffff in ?? () #15 0x0001a53c00005137 in ?? () We repeated the above test with interface having ixgbe driver and we don't = see this issue and we can see packet coming out of the interface with corre= ct sid list.=20 What could be the possible reason for this issue? Can we modify any paramet= er at dpdk code level as part of debugging this issue? Also, we tried subscribing to dpdk dev mailing list (using the same email i= d), but our subscription request is still pending. This issue is kind of a = blocker for us that's why sending it on mail. Thanks and Regards, Chinmaya Agarwal. DISCLAIMER: This electronic message and all of its contents, contains infor= mation which is privileged, confidential or otherwise protected from disclo= sure. The information contained in this electronic mail transmission is int= ended for use only by the individual or entity to which it is addressed. If= you are not the intended recipient or may have received this electronic ma= il transmission in error, please notify the sender immediately and delete /= destroy all copies of this electronic mail transmission without disclosing= , copying, distributing, forwarding, printing or retaining any part of it. = Hughes Systique accepts no responsibility for loss or damage arising from t= he use of the information transmitted by this email including damage from v= irus.=20