From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 67BC3A09EF for ; Mon, 11 Jan 2021 11:37:21 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 5B6BC140CCA; Mon, 11 Jan 2021 11:37:21 +0100 (CET) Received: from mailout2.w1.samsung.com (mailout2.w1.samsung.com [210.118.77.12]) by mails.dpdk.org (Postfix) with ESMTP id 68C00140CAF for ; Mon, 11 Jan 2021 11:37:18 +0100 (CET) Received: from eucas1p2.samsung.com (unknown [182.198.249.207]) by mailout2.w1.samsung.com (KnoxPortal) with ESMTP id 20210111103717euoutp02df5c9ecb736c7b1cc7429d400324838e~ZJzH6CT9_0873808738euoutp02X for ; Mon, 11 Jan 2021 10:37:17 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 mailout2.w1.samsung.com 20210111103717euoutp02df5c9ecb736c7b1cc7429d400324838e~ZJzH6CT9_0873808738euoutp02X DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=samsung.com; s=mail20170921; t=1610361437; bh=Q449dtIaiAerZ3K8fLWAGNZMXRpZ+OzyVopvWZ5SuYA=; h=Subject:To:Cc:From:Date:In-Reply-To:References:From; b=AxarBhVjG652lk3RtpFZPj0vH/oV4qLF3qGjvJe5L7WpdJFRHKHdITEUElx8p51+X yBof3yajm2ZE01STEALWhacj9w/ZVHNpZNAgb0xs6AXfELhMs/a2g8fVnsKGwVZ5zV RsRgBZqxVaZBdc2xd0dFtGUeDdgdItYxMTdnHF78= Received: from eusmges1new.samsung.com (unknown [203.254.199.242]) by eucas1p2.samsung.com (KnoxPortal) with ESMTP id 20210111103717eucas1p2bbc2b472305bbf99f9d9f777b40d7e37~ZJzHyOkhK2147421474eucas1p2D; Mon, 11 Jan 2021 10:37:17 +0000 (GMT) Received: from eucas1p1.samsung.com ( [182.198.249.206]) by eusmges1new.samsung.com (EUCPMTA) with SMTP id 81.72.27958.C5A2CFF5; Mon, 11 Jan 2021 10:37:16 +0000 (GMT) Received: from eusmtrp1.samsung.com (unknown [182.198.249.138]) by eucas1p1.samsung.com (KnoxPortal) with ESMTPA id 20210111103716eucas1p16536aa4827852833d05ae502793459ba~ZJzHAK6Kq1042810428eucas1p11; Mon, 11 Jan 2021 10:37:16 +0000 (GMT) Received: from eusmgms1.samsung.com (unknown [182.198.249.179]) by eusmtrp1.samsung.com (KnoxPortal) with ESMTP id 20210111103716eusmtrp1a9edb1908f0affd5e8dd22d30651c954~ZJzG-glv50500805008eusmtrp1Y; Mon, 11 Jan 2021 10:37:16 +0000 (GMT) X-AuditID: cbfec7f2-f15ff70000006d36-d8-5ffc2a5ceb93 Received: from eusmtip1.samsung.com ( [203.254.199.221]) by eusmgms1.samsung.com (EUCPMTA) with SMTP id CE.4B.21957.C5A2CFF5; Mon, 11 Jan 2021 10:37:16 +0000 (GMT) Received: from [106.210.134.142] (unknown [106.210.134.142]) by eusmtip1.samsung.com (KnoxPortal) with ESMTPA id 20210111103715eusmtip1462b6e52269ecba82e990990af998340~ZJzGXd5W-2242422424eusmtip1W; Mon, 11 Jan 2021 10:37:15 +0000 (GMT) To: David Marchand , David Hunt Cc: dev , ci@dpdk.org, Aaron Conole From: Lukasz Wojciechowski Message-ID: <263e6c13-b87c-2fe0-36ef-ac6aa600c18f@partner.samsung.com> Date: Mon, 11 Jan 2021 11:37:13 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.6.0 MIME-Version: 1.0 In-Reply-To: Content-Transfer-Encoding: 8bit Content-Language: en-US X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFmpjleLIzCtJLcpLzFFi42LZduznOd0YrT/xBgoWv948YLd4N+8ls0Xf pI9MFttXdLFZvPu0ncmB1ePXgqWsHov3vGTyeL/vKlsAcxSXTUpqTmZZapG+XQJXxo6+P0wF U/kr+lbdYGlgXMbTxcjJISFgInHr6Q0WEFtIYAWjxM9P7l2MXED2F0aJe9M2sEM4nxklDj/d ww7T8WzDeWaIxHJGiRP7X0I5HxklZp0+CjSLg0NYwEyi+4Q6SIOIQLDE9TuzwVYwC7hJHFl0 iRnEZhOwlTgy8ysriM0LFD95/RrYAhYBVYnp01rZQGxRgSSJ4/u6mSFqBCVOznwCNp5TIFDi 0gcbiJHyEs1bZzND2OISt57MZ4K48wCHxKLdvhC2i8TRxgZWCFtY4tXxLVC/yEicntzDAnK+ hMA2Romrv38yQjj7GSWu966AqrKWOPzvNxvIYmYBTYn1u/Qhwo4SZ7eBLOMAsvkkbrwVhLiB T2LStunMEGFeiY42IYhqPYmnPVMZYdb+WfuEZQKj0iwkj81C8s0sJN/MQti7gJFlFaN4amlx bnpqsWFearlecWJucWleul5yfu4mRmBSOf3v+KcdjHNffdQ7xMjEwXiIUYKDWUmEd+GuH/FC vCmJlVWpRfnxRaU5qcWHGKU5WJTEeVfNXhMvJJCeWJKanZpakFoEk2Xi4JRqYNI9a5ncKTBT vZ/3SPfk5Up25hu+Hetpd7tdEj59ZfT1O1sr+TXq8u47z5tcnnZw/b6FHl25+tNNdB7q3X+p qaxrLuPDfaU8+gFbt2ow32sl34v/2TbPld4jIv85eQo/B6++2N58s+jXcnHTp3D3SuinVKjn H/hevbLliP9t3wWVrQf4zFYrugr5rO6/EDO3Nqfr/bMNcy+l9WzVy2qzLLENvL//zolLBQqO 9+Q4+HIONnxlC25RTeTQ3aTe1qXw3+KDJovDlKI7zte//HZjTdovejenb35y+95NuxLikvIO l7OobMh7e6fy7b3eV9usWVuqFt5n5+j5sujhtrknim2P5XVWNp6N1zFtzs5SYinOSDTUYi4q TgQASwyMs5kDAAA= X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFprFIsWRmVeSWpSXmKPExsVy+t/xu7oxWn/iDU41Clr8evOA3eLdvJfM Fn2TPjJZbF/RxWbx7tN2JgdWj18LlrJ6LN7zksnj/b6rbAHMUXo2RfmlJakKGfnFJbZK0YYW RnqGlhZ6RiaWeobG5rFWRqZK+nY2Kak5mWWpRfp2CXoZO/r+MBVM5a/oW3WDpYFxGU8XIyeH hICJxLMN55m7GLk4hASWMko83zITyOEASshIfLgkAFEjLPHnWhcbRM17RolDzzYzgtQIC5hJ dJ9QB6kREQiW2PhsHyOIzSzgJnFk0SWomUsYJdonLGADSbAJ2EocmfmVFcTmBSo6ef0aO4jN IqAqMX1aKxvITFGBJInFb50gSgQlTs58wgIS5hQIlLj0wQZivJnEvM0PmSFseYnmrbOhbHGJ W0/mM01gFJqFpHsWkpZZSFpmIWlZwMiyilEktbQ4Nz232FCvODG3uDQvXS85P3cTIzCSth37 uXkH47xXH/UOMTJxMB5ilOBgVhLhXbjrR7wQb0piZVVqUX58UWlOavEhRlOgbyYyS4km5wNj Oa8k3tDMwNTQxMzSwNTSzFhJnHfr3DXxQgLpiSWp2ampBalFMH1MHJxSDUy7FP5vvj71Q3KG T31nP/cnR/9jHEEB5rdkTs30WVBnaJzt+VxAqVvToWHHh0BrBw7HJ1/8ig4c3sXM2bD0TWHe d1OWUwxZhnODLvgtc511inXtsc9+7KfnZx39PC2R7+hccdfgiG33zD/8Cgw/U6lQ1xFm8+vz Jj7egHfHf2rN3i+6T7378sdA/WLXVyt2Xj2hmGqqX2Jp7TT1cBGbxpurrbUvks2+L1DadH2v 12QeSftVRp/1/0smXrsWyry3psPFiueNgrxa85am09s39/6/eOKTx8ddojvEOZrETPp5/6u3 H3XJNnx+T7X4mztPoODjdxP37Cs1OrH216YLx1b5CVb3xYrWr3Y2e7Fo2mMlluKMREMt5qLi RABZ0m6jLQMAAA== X-CMS-MailID: 20210111103716eucas1p16536aa4827852833d05ae502793459ba X-Msg-Generator: CA Content-Type: text/plain; charset="utf-8" X-RootMTR: 20210111081428eucas1p1f5f234cef3e3582ab8ba2726d8d105ea X-EPHeader: CA CMS-TYPE: 201P X-CMS-RootMailID: 20210111081428eucas1p1f5f234cef3e3582ab8ba2726d8d105ea References: Subject: Re: [dpdk-ci] distributor test failure in UNH CI on ARM X-BeenThere: ci@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK CI discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ci-bounces@dpdk.org Sender: "ci" Hello David, I took a look at the logs. The issue appeared in testing big burst in sanity_test() for burst implementation of distributor. My guess is that the cyclic buffer for holding packets returned from workers might be overflown and dropping some of the packets. It's designed this way, to hold only 127 latest packets. Older, not collected on time with rte_distributor_returned_pkts(), are lost. Although it's just a guess until I can confirm it with some tests on my machine. However the guess is possible, so the question is about the functionality of collecting the returned packets. We can: 1) keep it as is and fix tests not to send new packets until old ones are returned and collected 2) make changes to the distributor library and change behavior of the returned packages queue - however this requires some discussion as any solution will have its drawbacks (e.g. blocking workers until there is a place to store packets or using more space for the queue) Write, what do you think about it. Meanwhile I'll try to reproduce the issue Best regards Lukasz W dniu 11.01.2021 o 09:14, David Marchand pisze: > Hello guys, > > UNH CI is raising failures on a ARM server for the distributor test: > https://protect2.fireeye.com/v1/url?k=ebf50f8c-b46e3693-ebf484c3-000babdfecba-48457a70d8248142&q=1&e=9f688513-9c17-4e71-a095-953f146ca22a&u=https%3A%2F%2Flab.dpdk.org%2Fresults%2Fdashboard%2Fpatchsets%2F15077%2F > > Worker 59 handled 0 packets > Worker 60 handled 0 packets > Worker 61 handled 0 packets > Worker 62 handled 0 packets > Sanity test with non-zero hashes done > === testing big burst (burst) === > line 258: Missing packets, expected 783 > Test Failed > RTE>> > --- stderr --- > > -- Lukasz Wojciechowski Principal Software Engineer Samsung R&D Institute Poland Samsung Electronics Office +48 22 377 88 25 l.wojciechow@partner.samsung.com