From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 021CEA04AF for ; Thu, 20 Aug 2020 06:29:31 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id C36F7AAD5; Thu, 20 Aug 2020 06:29:31 +0200 (CEST) Received: from mail-ot1-f50.google.com (mail-ot1-f50.google.com [209.85.210.50]) by dpdk.org (Postfix) with ESMTP id CCED75F69 for ; Thu, 20 Aug 2020 06:29:29 +0200 (CEST) Received: by mail-ot1-f50.google.com with SMTP id x24so469392otp.3 for ; Wed, 19 Aug 2020 21:29:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=broadcom.com; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=hefzneZMD+APyrRYyllOS+zliJVTAhoRwnLWqBTcoeg=; b=WW4xup3MJi3bzfL1GKng6Se6S9c7vTjJ+GSMt84wjaeshxKz78Im1FmeCbPZ9izpw3 x0AfGVkd217Xjz7zT+DWiO4xjtpBDTYIwWlNBdAchGCZ9hlLig+YgsIHbgU1s0XWwwWq 8vaQhyIWlqAtcbfdgxLwd2EdBgCJDYadXo5go= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=hefzneZMD+APyrRYyllOS+zliJVTAhoRwnLWqBTcoeg=; b=ZRfnbFsFNsMU2yNrbc+7/+9ranW0Rv5UE7nDDMom3Lb1SEj99nvbiWtu4AYECXjrv0 w/6j3mSbx0CnGT46Ggixe4CsJD7zLzKwvYc2A/e13HI1r6sbR113REWQcjjrx6zW/Mps QoWdnc1kOS92rqtJ1/reEMFwum9D4m84Ig17spf1mZElwaI2JzMkPlEKlE4KPmiRmpmw lkUKOHYAUCMsS3uxAknokJhol/I79r3poUNZaeWiKs6bL8dU24t+IZzFGHoxd2FLbXzf A3i3CIE/rCXmF3ckzx7n2DYuQBZqSaui68/HZZmb/oluzMQtFiPbdisSNlhPSXi2SsH1 fmFA== X-Gm-Message-State: AOAM533BMaxWFBAjCtvWL114GCPAPjcHu934CiN25VBQkERcMppuV9Ao 81h61gtqc8PjkNCAZKIy6fQTpwWD1PV+f1q2Fwm1sQ== X-Google-Smtp-Source: ABdhPJxJCL6Vw1ixMC/9xwUX3Io3peEtAITH0OdClW5aKFyrni5VXdk4cFw8bNNdatSM79wdcBwi30I7+SmZ/1NrP5Q= X-Received: by 2002:a05:6830:614:: with SMTP id w20mr902161oti.283.1597897768923; Wed, 19 Aug 2020 21:29:28 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Ajit Khaparde Date: Wed, 19 Aug 2020 21:29:12 -0700 Message-ID: To: Brandon Lo Cc: ci@dpdk.org, dpdklab Content-Type: multipart/alternative; boundary="000000000000e7cea205ad4790c1" Subject: Re: [dpdk-ci] New 100G Broadcom NIC Ubuntu X-BeenThere: ci@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK CI discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ci-bounces@dpdk.org Sender: "ci" --000000000000e7cea205ad4790c1 Content-Type: text/plain; charset="UTF-8" Hi Brandon, I was trying to see what exactly is happening on the setup and what is causing the problem. But I will need your help to use the proper code and commands. I believe you run the testpmd command on io. And the trex is executed on rhea? Can you point me to the location of the code and the steps you are following while running the test? Thanks Ajit On Tue, Aug 11, 2020 at 10:47 AM Ajit Khaparde wrote: > Hi Brandon, > I haven't. I tried to login as well. But I had some issues doing it from > the office. > I just have to remind myself to try it again once I get home before I > connect to the company VPN. > Thanks for checking in. I will try to update you as soon as I can. > > Thanks > Ajit > > On Tue, Aug 11, 2020 at 10:46 AM Brandon Lo wrote: > >> Hi Ajit, >> >> I'm just checking in; have you heard of any updates on this issue? >> >> Thanks, >> Brandon >> >> On Tue, Aug 4, 2020 at 1:42 PM Brandon Lo wrote: >> >>> Hi Ajit, >>> >>> Yes, I believe the issue is coming from the trex/tester system with the >>> 100G NIC. >>> I'm not sure what causes this issue; if I run trex using the command "cd >>> /opt/v2.82;./t-rex-64 -i --cfg /etc/trex_cfg_100g.yaml -c 7", which is the >>> same command used in DTS, it seems to launch without failing. >>> >>> If you want to replicate it, here are the steps that I ran: >>> >>> 1. (on io) cd /opt/dts >>> 2. export DTS_CFG_FOLDER='conf_100g' >>> - conf_100g has the new configuration files to use the new PCI id >>> and pktgen config file >>> 3. ./dts -s >>> >>> >>> Thanks for your help, >>> Brandon >>> >>> On Tue, Aug 4, 2020 at 12:38 PM Ajit Khaparde < >>> ajit.khaparde@broadcom.com> wrote: >>> >>>> Hi Brandon, >>>> No, I haven't seen or heard this before. >>>> But I will try to have someone run it again. >>>> >>>> Just to make sure - >>>> You are running trex on the 100G NIC and the problem is encountered on >>>> that setup? >>>> Or is it the system that is running testpmd where you are running into >>>> the issue? >>>> >>>> Thanks >>>> Ajit >>>> >>>> On Tue, Aug 4, 2020 at 9:16 AM Brandon Lo wrote: >>>> >>>>> Hi Ajit, >>>>> >>>>> I'm running into a problem with trying to run nic_single_core_perf on >>>>> the new NIC. >>>>> The current configuration uses trex version v2.82. >>>>> However, I'm running into an error when it tries to actually do a test >>>>> case in the nic_single_core_perf. >>>>> >>>>> The output looks like this when it reaches a test case: >>>>> >>>>> TestNicSingleCorePerf: Test running at parameters: framesize: 64, >>>>>> rxd/txd: 512 >>>>>> dut.rhea: >>>>>> ./x86_64-native-linuxapp-gcc/app/testpmd -l 16,17 -n 4 -w 0000:81:00.0 -w >>>>>> 0000:81:00.1 --file-prefix=dpdk_11307_20200804160513 -- -i >>>>>> --portmask=0x3 --txd=512 --rxd=512 >>>>>> dut.rhea: start >>>>>> TestNicSingleCorePerf: Test Case test_perf_nic_single_core >>>>>> Result ERROR: Traceback (most recent call last): >>>>>> File "/opt/dts/framework/test_case.py", line 316, in >>>>>> _execute_test_case >>>>>> case_obj() >>>>>> File "tests/TestSuite_nic_single_core_perf.py", line 198, in >>>>>> test_perf_nic_single_core >>>>>> self.perf_test(self.nb_ports) >>>>>> File "tests/TestSuite_nic_single_core_perf.py", line 259, in >>>>>> perf_test >>>>>> _, packets_received = >>>>>> self.tester.pktgen.measure_throughput(stream_ids=streams, >>>>>> options=traffic_opt) >>>>>> File "/opt/dts/framework/pktgen_base.py", line 245, in >>>>>> measure_throughput >>>>>> self._prepare_transmission(stream_ids=stream_ids) >>>>>> File "/opt/dts/framework/pktgen_trex.py", line 779, in >>>>>> _prepare_transmission >>>>>> self._conn.reset(ports=self._ports) >>>>>> File >>>>>> "/opt/v2.82/automation/trex_control_plane/interactive/trex/common/trex_api_annotators.py", >>>>>> line 51, in wrap2 >>>>>> ret = f(*args, **kwargs) >>>>>> File >>>>>> "/opt/v2.82/automation/trex_control_plane/interactive/trex/stl/trex_stl_client.py", >>>>>> line 339, in reset >>>>>> self.clear_stats(ports) >>>>>> File >>>>>> "/opt/v2.82/automation/trex_control_plane/interactive/trex/common/trex_api_annotators.py", >>>>>> line 51, in wrap2 >>>>>> ret = f(*args, **kwargs) >>>>>> File >>>>>> "/opt/v2.82/automation/trex_control_plane/interactive/trex/stl/trex_stl_client.py", >>>>>> line 1467, in clear_stats >>>>>> self._clear_stats_common(ports, clear_global, clear_xstats) >>>>>> File >>>>>> "/opt/v2.82/automation/trex_control_plane/interactive/trex/common/trex_client.py", >>>>>> line 2840, in _clear_stats_common >>>>>> raise TRexError(rc) >>>>>> trex.common.trex_exceptions.TRexError: *** [RPC] - Failed to get >>>>>> server response from tcp://127.0.0.1:4501 >>>>> >>>>> >>>>> I have found one similar case on the github repository for trex, but >>>>> the solution was vendor-specific: >>>>> https://github.com/cisco-system-traffic-generator/trex-core/issues/147 >>>>> . >>>>> Have you ran into this issue before? >>>>> >>>>> Thanks, >>>>> Brandon >>>>> >>>> >>> >>> -- >>> >>> Brandon Lo >>> >>> UNH InterOperability Laboratory >>> >>> 21 Madbury Rd, Suite 100, Durham, NH 03824 >>> >>> blo@iol.unh.edu >>> >>> www.iol.unh.edu >>> >> >> >> -- >> >> Brandon Lo >> >> UNH InterOperability Laboratory >> >> 21 Madbury Rd, Suite 100, Durham, NH 03824 >> >> blo@iol.unh.edu >> >> www.iol.unh.edu >> > --000000000000e7cea205ad4790c1 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Brandon,
I was trying to see what exactly is happening on the = setup and what is causing the=C2=A0problem.
But I will need your help to use= the proper code and commands.

I believe you run the testpmd command on= io. And the trex is executed on rhea?
Can you point me to the location of t= he code and the steps you are following while running the test?

Thanks
Aj= it

On Tue, Aug 11, 2020 at 10:47 AM Ajit Khaparde <ajit.khaparde@broadcom.com> wrote:
=
Hi Brand= on,
I haven't. I tried to login as well. But I had some issues doing it = from the office.
I just have to remind myself to try it=C2=A0again once I ge= t home before I connect to the company VPN.
Thanks for checking in. I will t= ry to update you as soon as I can.

Thanks
Ajit

On Tue, Aug 11, 2020= at 10:46 AM Brandon Lo <blo@iol.unh.edu> wrote:
Hi Ajit,

I'm j= ust checking in; have you heard of any updates on this issue?
Thanks,
Brandon

On Tue, Aug 4, 2020 at 1:42 PM B= randon Lo <blo@iol.= unh.edu> wrote:
Hi Ajit,

Yes, I believe the issu= e is coming from the trex/tester system with the 100G NIC.
I'= m not sure what causes this issue; if I run trex using the command "cd= /opt/v2.82;./t-rex-64 -i --cfg /etc/trex_cfg_100g.yaml -c 7", which i= s the same command used in DTS, it seems to launch without failing.

If you want to replicate it, here are the steps that I ra= n:
  1. (on io) cd /opt/dts
  2. export DTS_CFG_FOLDER=3D&#= 39;conf_100g'
    • conf_100g has the new configuration files to = use the new PCI id and pktgen config file
  3. ./dts -s

Thanks for your help,
Brandon
=
On Tue= , Aug 4, 2020 at 12:38 PM Ajit Khaparde <ajit.khaparde@broadcom.com> wrote:<= br>
Hi Br= andon,
No, I haven't seen or heard this=C2=A0before.
But I will try t= o have someone=C2=A0run it again.

Just to make sure -
You are running = trex on the 100G NIC and the problem is encountered on that setup?
Or is it = the system that is running testpmd where you are running into the issue?
Thanks
Ajit

On Tue, Aug 4, 2020 at 9:16 AM Brandon Lo <blo@iol.unh.edu> wrote:
=
Hi Ajit,

I'm running=C2=A0into a problem wi= th trying to run nic_single_core_perf on the new NIC.
The current= configuration uses trex version v2.82.
However, I'm running = into an error when it tries to actually=C2=A0do a test case in the nic_sing= le_core_perf.

The output looks like this when it r= eaches a test case:

TestNicSingleCorePerf: Test running= at parameters: framesize: 64, rxd/txd: 512
=C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 dut.rhea: ./x86_64-native-= linuxapp-gcc/app/testpmd -l 16,17 -n 4 -w 0000:81:00.0 -w 0000:81:00.1 =C2= =A0--file-prefix=3Ddpdk_11307_20200804160513 =C2=A0 =C2=A0-- -i =C2=A0--por= tmask=3D0x3 --txd=3D512 --rxd=3D512
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 dut.rhea: start
=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0TestNicSingleCorePerf: Test Case test_perf_nic_single_c= ore Result ERROR: Traceback (most recent call last):
=C2=A0 File "/= opt/dts/framework/test_case.py", line 316, in _execute_test_case
= =C2=A0 =C2=A0 case_obj() =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
=C2=A0 File= "tests/TestSuite_nic_single_core_perf.py", line 198, in test_per= f_nic_single_core
=C2=A0 =C2=A0 self.perf_test(self.nb_ports)
=C2=A0 = File "tests/TestSuite_nic_single_core_perf.py", line 259, in perf= _test
=C2=A0 =C2=A0 _, packets_received =3D self.tester.pktgen.measure_t= hroughput(stream_ids=3Dstreams, options=3Dtraffic_opt)
=C2=A0 File "= ;/opt/dts/framework/pktgen_base.py", line 245, in measure_throughput=C2=A0 =C2=A0 self._prepare_transmission(stream_ids=3Dstream_ids)
=C2= =A0 File "/opt/dts/framework/pktgen_trex.py", line 779, in _prepa= re_transmission
=C2=A0 =C2=A0 self._conn.reset(ports=3Dself._ports)
= =C2=A0 File "/opt/v2.82/automation/trex_control_plane/interactive/trex= /common/trex_api_annotators.py", line 51, in wrap2
=C2=A0 =C2=A0 re= t =3D f(*args, **kwargs) =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0
=C2=A0 File "/opt/v2.82/automation/trex_control_plane/i= nteractive/trex/stl/trex_stl_client.py", line 339, in reset
=C2=A0 = =C2=A0 self.clear_stats(ports) =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0
=C2=A0 File "/opt/v2.82/automation/trex_co= ntrol_plane/interactive/trex/common/trex_api_annotators.py", line 51, = in wrap2
=C2=A0 =C2=A0 ret =3D f(*args, **kwargs) =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
=C2=A0 File "/opt/v2.82/aut= omation/trex_control_plane/interactive/trex/stl/trex_stl_client.py", l= ine 1467, in clear_stats
=C2=A0 =C2=A0 self._clear_stats_common(ports, c= lear_global, clear_xstats)
=C2=A0 File "/opt/v2.82/automation/trex_= control_plane/interactive/trex/common/trex_client.py", line 2840, in _= clear_stats_common
=C2=A0 =C2=A0 raise TRexError(rc) =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
trex.comm= on.trex_exceptions.TRexError: *** [RPC] - Failed to get server response fro= m tcp://127.0.0.1:4501<= /a>

Have you ran into this issue before= ?

Thanks,
Brandon
=


--

Brandon Lo

UNH InterOperability Laborator= y

21 Madbury Rd, Suite 100, Durham, NH 03824

blo@iol.unh.edu

www.iol.unh.edu



--

Brandon Lo

UNH InterOperability Laborator= y

21 Madbury Rd, Suite 100, Durham, NH 03824

blo@iol.unh.edu

www.iol.unh.edu

--000000000000e7cea205ad4790c1--