From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 131C4A0598; Tue, 21 Apr 2020 18:20:21 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id E09731D502; Tue, 21 Apr 2020 18:20:20 +0200 (CEST) Received: from mga05.intel.com (mga05.intel.com [192.55.52.43]) by dpdk.org (Postfix) with ESMTP id 353801D440 for ; Tue, 21 Apr 2020 18:20:17 +0200 (CEST) IronPort-SDR: x7a6tInGzkLzYfmKK0d4z0pgm1vhfbsy5NLJrboF0VTXEAU96/Tfbkc3tTrqrMMXblLzBpKhVk XywSXIenb6Sw== X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga002.fm.intel.com ([10.253.24.26]) by fmsmga105.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 21 Apr 2020 09:20:16 -0700 IronPort-SDR: nyvbGwbryQA7RNfSRojMZuuN2HppgEim9rn6U9jy/LDgT/JDKM5A1WVHRdZWz/Wh2roWq1WtQy usrCCqpq0W9Q== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.72,410,1580803200"; d="scan'208";a="290516984" Received: from orsmsx109.amr.corp.intel.com ([10.22.240.7]) by fmsmga002.fm.intel.com with ESMTP; 21 Apr 2020 09:20:16 -0700 Received: from orsmsx125.amr.corp.intel.com (10.22.240.125) by ORSMSX109.amr.corp.intel.com (10.22.240.7) with Microsoft SMTP Server (TLS) id 14.3.439.0; Tue, 21 Apr 2020 09:20:16 -0700 Received: from ORSEDG001.ED.cps.intel.com (10.7.248.4) by ORSMSX125.amr.corp.intel.com (10.22.240.125) with Microsoft SMTP Server (TLS) id 14.3.439.0; Tue, 21 Apr 2020 09:20:16 -0700 Received: from NAM10-DM6-obe.outbound.protection.outlook.com (104.47.58.100) by edgegateway.intel.com (134.134.137.100) with Microsoft SMTP Server (TLS) id 14.3.439.0; Tue, 21 Apr 2020 09:20:15 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=InluLmfsr/vGtfnFxaiUq2elcmPSgbP1xfk+TSNMJURkX7s5Jls/SvKwCpXkfM2pTuEz9WzXw9thBLD0CdAH+KoZR2AfZaRPBy+O/SDWRlB820wA+dgb247BAKHnc+zP71JF77l9MLHiLMH+Sd5UpDWJ5TMhedqs0++mFwDB2Zo1HOGzyzCMxi5pv0QYICS3cQz0XqxR4oYIk7+A1ZpIUH+WM96ftDRsHhPH5nni/tKAJ8jwaCg6lbtHEOmzPklDShWZacT+pBD+OtcmdiezCJtrlHBqMhZPheYehh0ut3bzXelZ8WT1I7kdx2Fa7qj6BqEq6ghQmh38yAoETvsMzA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=a4NkCahANEsteyGrQSBo0SCFeMWBrsYd2M0K8Do+YgE=; b=ER9ImplWgQEzwmiv98TZzUo0O21dHN7iN3uWt+1EeqeVqwKLVSoyqHj3XYQiJkEsH1Y1TPbqcMWERBZVO3E2s4pxh822a94MqTvCWF/1Hqj9jLZlqcNz51fR1TeXN3bwRFa+13wy092lL3Pg74NV6MLMm71tcnt6kKfdOVgTLqj6gAv80eKUTxr/jyqiMATx09Ex4oLAJL86mf907dccCCcaVrFjB5NsYsihibuabEebQP1hCzOwp0hpkUAOWnNSxBGJYHVjtUbeAcGKSlppe7G67zTEsWJlOEwCutWwnnbq99tAuG9qZ391jHRx/80UZ5GaOPVEtYqYNpayH2iNbA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intel.onmicrosoft.com; s=selector2-intel-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=a4NkCahANEsteyGrQSBo0SCFeMWBrsYd2M0K8Do+YgE=; b=LJOJFKykDdw9POd1adDl5IO8OdvXWaPlZZHouJLF+4acmwfBQ0w1UgYx/9jFgXb+ZXjtMlQB/3J1O9ot04YZRtWTRcmbjPouCZrV/1VRrdf4k0ZTAr4xVpoHgVyZDfhifJqq+7flwDPIGXuSrpOiLEkxm0Hp8WPOFWhByE1S4cY= Received: from BYAPR11MB3301.namprd11.prod.outlook.com (2603:10b6:a03:7f::26) by BYAPR11MB2983.namprd11.prod.outlook.com (2603:10b6:a03:88::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2921.25; Tue, 21 Apr 2020 16:20:14 +0000 Received: from BYAPR11MB3301.namprd11.prod.outlook.com ([fe80::f8cb:58cd:e958:fff4]) by BYAPR11MB3301.namprd11.prod.outlook.com ([fe80::f8cb:58cd:e958:fff4%6]) with mapi id 15.20.2937.012; Tue, 21 Apr 2020 16:20:14 +0000 From: "Ananyev, Konstantin" To: Aaron Conole , "dev@dpdk.org" Thread-Topic: [dpdk-dev] ISSUE: compiling with asan+ubsan Thread-Index: AQHWF/BvEZNhHl9JVkKn2j1egYOlWKiDueKQ Date: Tue, 21 Apr 2020 16:20:10 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: dlp-product: dlpe-windows dlp-reaction: no-action dlp-version: 11.2.0.6 authentication-results: spf=none (sender IP is ) smtp.mailfrom=konstantin.ananyev@intel.com; x-originating-ip: [192.198.151.161] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 8b8bc42b-9145-44fa-a3e3-08d7e60fdf6a x-ms-traffictypediagnostic: BYAPR11MB2983: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:6790; x-forefront-prvs: 038002787A x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BYAPR11MB3301.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(10019020)(39860400002)(136003)(396003)(346002)(376002)(366004)(66556008)(33656002)(5660300002)(8676002)(66446008)(76116006)(81156014)(8936002)(66476007)(110136005)(64756008)(7696005)(71200400001)(52536014)(66946007)(186003)(26005)(316002)(9686003)(86362001)(6666004)(478600001)(6506007)(55016002)(2906002); DIR:OUT; SFP:1102; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: ssMnVmgYvEAa4QQHt1KUsFQZZAopGqdosCVPVdVzKPs2Vw2oQoWYstcrPb1Pw75tw+pdw1Ghk3Q10fY+qxaHf9kvShzCA/GTirXxSKhuJnLSogv0YTmfdT3RSNZJmqdzDnQ83Zw8P5N+p4hiTEBk/THpH8CIv6qQZSekl7ZIo+ojUawLrU3uXZc/7l+E644/0LZU+KR0Wxtj6RXKWbvcbo/HS7eYBxdWPolpTOOo24vfVcQ9QybppULbYJ7kqFgRcsxkt8Fi5/gfu3/llU4qp3zpBwbDceo+6Y1JhTASfGs9PcM9WD8rogt3TN7LSRTlH2aXa6bRd0Wa4xj7E+OZnlH9I2K90fAZ6vcuzMXzk3DjW1tpN/NKAP4dbHvxBx+Z03gZMHdikf/6276ci+YO+mcowWk6ZKn65R/CGwDQQgmBzMF9ipphSBIUMgItt3DR x-ms-exchange-antispam-messagedata: XESz0w+FmBqtKxf1lODpLnEMVqrMLvzJHN+Lo91xTV8qFqzfez00YB03jQZZ6D6Dd1nAVS9N0Aag9PYTLty1n9aZsGsD2lwN1QKH/yeFLm7B/WnEP1Bj/pg49TdfYmt+ZBqp1Ct7TounI21DAMt/vw== x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-Network-Message-Id: 8b8bc42b-9145-44fa-a3e3-08d7e60fdf6a X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Apr 2020 16:20:10.3773 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: mopz0G9l5UTPGs0e+vALzquH0SuqhvGmaJtadl+3dhoSxeyXIHeuwe6OKPHVa1pA4Q8WYSDafooWHCCXwhlXpzilsjNFgCwjlDYeNn/eTMQ= X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR11MB2983 X-OriginatorOrg: intel.com Subject: Re: [dpdk-dev] ISSUE: compiling with asan+ubsan X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Hi Aaron, =20 > While compiling with asan and ubsan I run into the following error: >=20 > FAILED: app/test/app@test@@dpdk-test@exe/test_ring.c.o >=20 > gcc -Iapp/test/app@test@@dpdk-test@exe -Iapp/test -I../app/test -Ilib/lib= rte_acl -I../lib/librte_acl -I. -I../ -Iconfig -I../config - > Ilib/librte_eal/include -I../lib/librte_eal/include -Ilib/librte_eal/linu= x/include -I../lib/librte_eal/linux/include -Ilib/librte_eal/common - > I../lib/librte_eal/common -Ilib/librte_eal/x86/include -I../lib/librte_ea= l/x86/include -Ilib/librte_eal -I../lib/librte_eal -Ilib/librte_kvargs - > I../lib/librte_kvargs -Ilib/librte_bitratestats -I../lib/librte_bitratest= ats -Ilib/librte_ethdev -I../lib/librte_ethdev -Ilib/librte_net - > I../lib/librte_net -Ilib/librte_mbuf -I../lib/librte_mbuf -Ilib/librte_me= mpool -I../lib/librte_mempool -Ilib/librte_ring -I../lib/librte_ring - > Ilib/librte_meter -I../lib/librte_meter -Ilib/librte_metrics -I../lib/lib= rte_metrics -Ilib/librte_bpf -I../lib/librte_bpf -Ilib/librte_cfgfile - > I../lib/librte_cfgfile -Ilib/librte_cmdline -I../lib/librte_cmdline -Ilib= /librte_cryptodev -I../lib/librte_cryptodev -Ilib/librte_distributor - > I../lib/librte_distributor -Ilib/librte_efd -I../lib/librte_efd -Ilib/lib= rte_hash -I../lib/librte_hash -Ilib/librte_eventdev -I../lib/librte_eventde= v - > Ilib/librte_timer -I../lib/librte_timer -Ilib/librte_fib -I../lib/librte_= fib -Ilib/librte_rib -I../lib/librte_rib -Ilib/librte_flow_classify - > I../lib/librte_flow_classify -Ilib/librte_table -I../lib/librte_table -Il= ib/librte_port -I../lib/librte_port -Ilib/librte_sched -I../lib/librte_sche= d - > Ilib/librte_ip_frag -I../lib/librte_ip_frag -Ilib/librte_kni -I../lib/lib= rte_kni -Ilib/librte_pci -I../lib/librte_pci -Ilib/librte_lpm -I../lib/libr= te_lpm - > Ilib/librte_ipsec -I../lib/librte_ipsec -Ilib/librte_security -I../lib/li= brte_security -Ilib/librte_latencystats -I../lib/librte_latencystats - > Ilib/librte_member -I../lib/librte_member -Ilib/librte_pipeline -I../lib/= librte_pipeline -Ilib/librte_rawdev -I../lib/librte_rawdev -Ilib/librte_rcu= - > I../lib/librte_rcu -Ilib/librte_reorder -I../lib/librte_reorder -Ilib/lib= rte_stack -I../lib/librte_stack -Idrivers/mempool/ring - > I../drivers/mempool/ring -Idrivers/mempool/stack -I../drivers/mempool/sta= ck -Idrivers/event/skeleton -I../drivers/event/skeleton - > Idrivers/bus/pci -I../drivers/bus/pci -I../drivers/bus/pci/linux -Idriver= s/bus/vdev -I../drivers/bus/vdev -Idrivers/net/bonding - > I../drivers/net/bonding -Idrivers/net/ring -I../drivers/net/ring -Ilib/li= brte_power -I../lib/librte_power -Ilib/librte_pdump -I../lib/librte_pdump > -Ilib/librte_compressdev -I../lib/librte_compressdev -fdiagnostics-color= =3Dalways -fsanitize=3Daddress,undefined -fno-omit-frame-pointer -pipe > -D_FILE_OFFSET_BITS=3D64 -Wall -Winvalid-pch -Werror -O2 -g -include rte_= config.h -Wextra -Wcast-qual -Wdeprecated -Wformat- > nonliteral -Wformat-security -Wmissing-declarations -Wmissing-prototypes = -Wnested-externs -Wold-style-definition -Wpointer-arith - > Wsign-compare -Wstrict-prototypes -Wundef -Wwrite-strings -Wno-missing-fi= eld-initializers -march=3Dnative -mno-avx512f - > DALLOW_EXPERIMENTAL_API -Wno-format-truncation -D_GNU_SOURCE -MD -MQ 'ap= p/test/app@test@@dpdk-test@exe/test_ring.c.o' > -MF 'app/test/app@test@@dpdk-test@exe/test_ring.c.o.d' -o 'app/test/app@t= est@@dpdk-test@exe/test_ring.c.o' -c > ../app/test/test_ring.c >=20 > cc1: out of memory allocating 65536 bytes after a total of 4609626112 > bytes I also noticed that test_ring.c compilation takes a huge amount of time and= memory. On my box it not as bad as yours (up to ~100 sec and ~1 GB) , but still se= ems too much. Will try to have a look later this week. >=20 > This is in a constrained (read: container) environment. I guess one way > of resolving would be to allocate more memory to the container, but I'm > also curious why the object files are getting so large? Should I > consider this a bug or "working as intended"? This will have > implications if we want asan/ubsan under the travis build also. >=20 > -Aaron