From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id B4568A054A for ; Thu, 18 Feb 2021 19:01:09 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 8860D40040; Thu, 18 Feb 2021 19:01:08 +0100 (CET) Received: from mail-lj1-f173.google.com (mail-lj1-f173.google.com [209.85.208.173]) by mails.dpdk.org (Postfix) with ESMTP id 32AFB4003D for ; Thu, 18 Feb 2021 19:01:08 +0100 (CET) Received: by mail-lj1-f173.google.com with SMTP id k22so6864593ljg.3 for ; Thu, 18 Feb 2021 10:01:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=ebSdgNtEJEJ9MJVl5R4/WioJ9ZkAEIkfeWnnpWwZa6g=; b=XPUZj/t4PRasPLJrW6baVrrhCs0AfEuI08ltjPBy78C6TtIAa924pV2xj9FnYLlUDO VCKM09V5ce/V3tjBfVT3+YGn9PJ7jn5YuXY0dpny7l/BpQjCHuNnwf052OJwdXuIoi15 amIaOjkIQKlEacx6pjW4W944ipE7XluL2KWAQ= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ebSdgNtEJEJ9MJVl5R4/WioJ9ZkAEIkfeWnnpWwZa6g=; b=VN3w5McMMljMX0mUzYUu1oE/fd3zbRfvSqeQNQeaYSW0wtnT4ToGmxXjWp4Aj82/rE Ug2sNJKgRjNMBZZKnaPEFKbyv5piWv64qG692CncZYO2rydHnV/+ZscAgVQsdWFXxSoG wri3wEu1mFIEWtOWTYYUsE2yn98LtVT3oCq2UzisYRTDPqgm0bq/+88NECBTdVdHSycl 5sYlwhkPg2d0f/dwoD167Cq3agHejLAYduKmJSl4cAgEtN6aPvjoov4+FOXWqpJzX0Hi zHdk28EeEsJvmcdXhwNhAqF6WOZSvJm8lFPtDhTwGoNP4yPynZAtL46EQYbgVc70AVeS qTVQ== X-Gm-Message-State: AOAM530gUFmHRes7jmdHn3WncJoXPqdp5wPH8wTuJl5Z3FlRdqmCHRhq GfgTlQRASHxd4KjB7O+H5ZKDTesHyNN7tidZfujvNg== X-Google-Smtp-Source: ABdhPJycciDGZgSCY4UbxhoYe8u1MTMy2n0IvioyGIZG3dzs+g3FeHyhpi1BnfaGanxONlXkA/NQ/SbpFWRdFA0xCVc= X-Received: by 2002:a19:4047:: with SMTP id n68mr3046216lfa.166.1613671267686; Thu, 18 Feb 2021 10:01:07 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: David Liu Date: Thu, 18 Feb 2021 13:00:31 -0500 Message-ID: To: Ajit Khaparde Cc: Owen Hilyard , ci@dpdk.org, dpdklab Content-Type: multipart/alternative; boundary="000000000000b1ef2205bba01e58" Subject: Re: [dpdk-ci] [dpdklab] Re: [DPDKLAB] 25G Broadcom NIC in Arm hardware X-BeenThere: ci@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK CI discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ci-bounces@dpdk.org Sender: "ci" --000000000000b1ef2205bba01e58 Content-Type: text/plain; charset="UTF-8" Hi Ajit, This is likely caused by when dts try to ssh into another machine as a normal user which will prompt you for the password. One solution would be "sudo su" as root to run the command line since you should have root access. Another solution would be to let me add your public ssh key into both machines. Let me know if this helps. Best, David On Fri, Feb 12, 2021 at 5:48 PM Ajit Khaparde wrote: > Thanks Owen. > > When I run the dts command line suggested, I get the following error. > > Thanks > Ajit > > Traceback (most recent call last): > File "/opt/dts/framework/ssh_pexpect.py", line 60, in _connect_host > self.password, original_prompt='[$#>]', > password_regex=r'(?i)(?:password:)|(?:passphrase for key)|(?i)(password for > .+:)') > File "/usr/local/lib/python3.6/dist-packages/pexpect/pxssh.py", line > 440, in login > raise ExceptionPxssh('password refused') > pexpect.pxssh.ExceptionPxssh: password refused > ^^^^^^^^^^^^^^ > > > > On Fri, Feb 12, 2021 at 12:09 PM Owen Hilyard > wrote: > >> Hello Ajit, >> >> There was a misconfiguration in our identity management system. The issue >> should now be resolved. >> >> Owen Hilyard >> >> On Thu, Feb 11, 2021 at 9:38 PM 'Ajit Khaparde' via dpdklab < >> dpdklab@iol.unh.edu> wrote: >> >>> David, >>> I can use my credentials to login to rhea. >>> But the same credentials are not allowing me to login onto the servers >>> you provided. >>> >>> Thanks >>> Ajit >>> >>> ssh -l ajitkhaparde arm-gigabyte.dpdklab.iol.unh.edu >>> Connection closed by 172.18.0.41 port 22 >>> >>> ssh -l ajitkhaparde arm-dell.dpdklab.iol.unh.edu >>> Connection closed by 172.18.0.40 port 22 >>> >>> On Tue, Feb 9, 2021 at 6:36 AM David Liu wrote: >>> >>>> Hi Ajit, >>>> >>>> Thanks for the update. Let me know if you need anything from me. >>>> >>>> >>>> Best, >>>> David >>>> >>>> On Sun, Feb 7, 2021 at 11:04 PM Ajit Khaparde < >>>> ajit.khaparde@broadcom.com> wrote: >>>> >>>>> David, >>>>> I had some trouble with my system over the past week. >>>>> So I could not login into the setup. I am hoping that my system will >>>>> be restored early this week >>>>> I will login into the setup after that. >>>>> >>>>> Thanks >>>>> Ajit >>>>> >>>>> On Tue, Feb 2, 2021 at 10:57 AM Ajit Khaparde < >>>>> ajit.khaparde@broadcom.com> wrote: >>>>> >>>>>> Hi David, >>>>>> I actually did miss it. I will take a look. >>>>>> Thanks for the refresh mail. >>>>>> >>>>>> Thanks >>>>>> Ajit >>>>>> >>>>>> On Tue, Feb 2, 2021 at 8:58 AM David Liu wrote: >>>>>> > >>>>>> > Hi Ajit, >>>>>> > >>>>>> > Ping again in case if you miss the last email. >>>>>> > >>>>>> > Did you have a chance to give it a try on login to the machines? >>>>>> > >>>>>> > Just some notes, we are currently running compile and some >>>>>> performance/functional testing. >>>>>> > Which it may be hard for you to run dts, so please let me know if >>>>>> you want me to stop these tests for you to debug. >>>>>> > >>>>>> > Step I run: >>>>>> > CONF="conf_dpdk" ./switch.sh Broadcom #this is to switch the dts >>>>>> configuration to Broadcom >>>>>> > ./dts -s >>>>>> #To start the dts >>>>>> > >>>>>> > Informatio: >>>>>> > arm-dell.dpdklab.iol.unh.edu >>>>>> > - dts - located in /opt/dts >>>>>> > - Trex - located in /opt/trex/v2.87 >>>>>> > >>>>>> > arm-gigabyte.dpdklab.iol.unh.edu >>>>>> > - dpdk - located in /root/dpdk >>>>>> > >>>>>> > Best, >>>>>> > David >>>>>> > >>>>>> > On Tue, Jan 26, 2021 at 4:59 PM David Liu wrote: >>>>>> >> >>>>>> >> Also, I had changed the configuration when I run Broadcom nic. >>>>>> >> In the dts folder, you can start it with ./dts -s >>>>>> >> >>>>>> >> On Tue, Jan 26, 2021 at 4:54 PM David Liu >>>>>> wrote: >>>>>> >>> >>>>>> >>> Hi Ajit, >>>>>> >>> Sorry for the late reply. >>>>>> >>> >>>>>> >>> You can ssh into the machine using the same VPN Username and >>>>>> Password. >>>>>> >>> Can you try and see if that works? >>>>>> >>> >>>>>> >>> Informatio: >>>>>> >>> arm-dell.dpdklab.iol.unh.edu >>>>>> >>> - dts - located in /opt/dts >>>>>> >>> - Trex - located in /opt/trex/v2.87 >>>>>> >>> >>>>>> >>> arm-gigabyte.dpdklab.iol.unh.edu >>>>>> >>> - dpdk - located in /root/dpdk >>>>>> >>> >>>>>> >>> >>>>>> >>> Thanks, >>>>>> >>> David >>>>>> >>> >>>>>> >>> On Tue, Jan 19, 2021 at 5:20 PM Ajit Khaparde < >>>>>> ajit.khaparde@broadcom.com> wrote: >>>>>> >>>> >>>>>> >>>> Hi David, >>>>>> >>>> Thanks for pinging me. Do you think I could login into the setup >>>>>> and >>>>>> >>>> see what is happening? >>>>>> >>>> I do have the credentials for two systems in your lab - >>>>>> >>>> rhea.dpdklab.iol.unh.edu and io.dpdklab.iol.unh.edu >>>>>> >>>> If you can provide me details of the systems you are trying to >>>>>> >>>> configure, I could take a look. >>>>>> >>>> >>>>>> >>>> Thanks >>>>>> >>>> Ajit >>>>>> >>>> >>>>>> >>>> On Tue, Jan 19, 2021 at 1:41 PM David Liu >>>>>> wrote: >>>>>> >>>> > >>>>>> >>>> > Hi Ajit, >>>>>> >>>> > >>>>>> >>>> > Thank you for helping out. >>>>>> >>>> > >>>>>> >>>> > How are you doing with this issue? >>>>>> >>>> > >>>>>> >>>> > Please let me know if you need anything information from us. >>>>>> >>>> > >>>>>> >>>> > Just some extra information that both Trex and dts are on the >>>>>> same intel tester machine. >>>>>> >>>> > >>>>>> >>>> > Best, >>>>>> >>>> > David >>>>>> >>>> > >>>>>> >>>> > On Thu, Jan 14, 2021 at 2:12 PM David Liu >>>>>> wrote: >>>>>> >>>> >> >>>>>> >>>> >> Yes, so this is the same NIC work on x86. >>>>>> >>>> >> By seeing the link, I am assuming you mean the ports that are >>>>>> using for Trex. If so they are UP before I start the Trex. >>>>>> >>>> >> >>>>>> >>>> >> Thank, >>>>>> >>>> >> David >>>>>> >>>> >> >>>>>> >>>> >> >>>>>> >>>> >> On Thu, Jan 14, 2021 at 1:11 AM Ajit Khaparde < >>>>>> ajit.khaparde@broadcom.com> wrote: >>>>>> >>>> >>> >>>>>> >>>> >>> Does the same NIC work on x86? >>>>>> >>>> >>> Also do you see link before you start the trex? I am trying >>>>>> to see if the port failed to successfully come up >>>>>> >>>> >>> or if there is a problem with the link. Can you check and >>>>>> tell? >>>>>> >>>> >>> >>>>>> >>>> >>> Thanks >>>>>> >>>> >>> Ajit >>>>>> >>>> >>> >>>>>> >>>> >>> On Wed, Jan 13, 2021 at 4:20 PM David Liu >>>>>> wrote: >>>>>> >>>> >>>> >>>>>> >>>> >>>> Hi Ajit, >>>>>> >>>> >>>> >>>>>> >>>> >>>> Thank you for helping out. >>>>>> >>>> >>>> >>>>>> >>>> >>>> We have it working on the x86, but not the Arm. >>>>>> >>>> >>>> >>>>>> >>>> >>>> >>>>>> >>>> >>>> Thanks, >>>>>> >>>> >>>> David >>>>>> >>>> >>>> >>>>>> >>>> >>>> On Wed, Jan 13, 2021 at 5:34 PM Ajit Khaparde < >>>>>> ajit.khaparde@broadcom.com> wrote: >>>>>> >>>> >>>>> >>>>>> >>>> >>>>> Hi David, >>>>>> >>>> >>>>> I will take a look. >>>>>> >>>> >>>>> Do you see similar issues on x86? I am asking because >>>>>> >>>> >>>>> even I would start with that to create a baseline and then >>>>>> >>>> >>>>> attempt on ARM. >>>>>> >>>> >>>>> >>>>>> >>>> >>>>> Thanks >>>>>> >>>> >>>>> Ajit >>>>>> >>>> >>>>> >>>>>> >>>> >>>>> On Wed, Jan 13, 2021 at 12:08 PM David Liu < >>>>>> dliu@iol.unh.edu> wrote: >>>>>> >>>> >>>>>> >>>>>> >>>> >>>>>> Hi Ajit, >>>>>> >>>> >>>>>> >>>>>> >>>> >>>>>> We have a 25G Broadcom NIC that is installed on an Arm >>>>>> machine. >>>>>> >>>> >>>>>> And I am running into a problem when I try to run >>>>>> nic_single_core_perf on the NIC. >>>>>> >>>> >>>>>> Currently, we are using: Trex v2.86 and dts from >>>>>> http://git.dpdk.org/tools/dts/ >>>>>> >>>> >>>>>> All the NICs are up and running when testing. >>>>>> >>>> >>>>>> >>>>>> >>>> >>>>>> The problem is an error when I try to run the test case >>>>>> inside the nic_single_core_perf: >>>>>> >>>> >>>>>> >>>>>> >>>> >>>>>>> TestNicSingleCorePerf: Test running at parameters: >>>>>> framesize: 64, rxd/txd: 512 >>>>>> >>>> >>>>>>> dut.172.18.0.41: >>>>>> x86_64-native-linuxapp-gcc/app/dpdk-testpmd -l 32,33 -n 4 >>>>>> --file-prefix=dpdk_15311_20210113190237 -a 0000:93:00.0 -a 0000:93:00.1 >>>>>> -- -i --portmask=0x3 --txd=512 --rxd=512 --nb-cores=1 >>>>>> >>>> >>>>>>> dut.172.18.0.41: start >>>>>> >>>> >>>>>>> TestNicSingleCorePerf: Test Case >>>>>> test_perf_nic_single_core Result ERROR: Traceback (most recent call last): >>>>>> >>>> >>>>>>> File "/opt/dts/framework/test_case.py", line 319, in >>>>>> _execute_test_case >>>>>> >>>> >>>>>>> case_obj() >>>>>> >>>> >>>>>>> File "tests/TestSuite_nic_single_core_perf.py", line >>>>>> 196, in test_perf_nic_single_core >>>>>> >>>> >>>>>>> self.perf_test(self.nb_ports) >>>>>> >>>> >>>>>>> File "tests/TestSuite_nic_single_core_perf.py", line >>>>>> 270, in perf_test >>>>>> >>>> >>>>>>> _, packets_received = >>>>>> self.tester.pktgen.measure_throughput(stream_ids=streams, >>>>>> options=traffic_opt) >>>>>> >>>> >>>>>>> File "/opt/dts/framework/pktgen_base.py", line 245, in >>>>>> measure_throughput >>>>>> >>>> >>>>>>> self._prepare_transmission(stream_ids=stream_ids) >>>>>> >>>> >>>>>>> File "/opt/dts/framework/pktgen_trex.py", line 778, in >>>>>> _prepare_transmission >>>>>> >>>> >>>>>>> self._conn.reset(ports=self._ports) >>>>>> >>>> >>>>>>> File >>>>>> "/opt/trex/v2.86/automation/trex_control_plane/interactive/trex/common/trex_api_annotators.py", >>>>>> line 51, in wrap2 >>>>>> >>>> >>>>>>> ret = f(*args, **kwargs) >>>>>> >>>> >>>>>>> File >>>>>> "/opt/trex/v2.86/automation/trex_control_plane/interactive/trex/stl/trex_stl_client.py", >>>>>> line 339, in reset >>>>>> >>>> >>>>>>> self.clear_stats(ports) >>>>>> >>>> >>>>>>> File >>>>>> "/opt/trex/v2.86/automation/trex_control_plane/interactive/trex/common/trex_api_annotators.py", >>>>>> line 51, in wrap2 >>>>>> >>>> >>>>>>> ret = f(*args, **kwargs) >>>>>> >>>> >>>>>>> File >>>>>> "/opt/trex/v2.86/automation/trex_control_plane/interactive/trex/stl/trex_stl_client.py", >>>>>> line 1492, in clear_stats >>>>>> >>>> >>>>>>> self._clear_stats_common(ports, clear_global, >>>>>> clear_xstats) >>>>>> >>>> >>>>>>> File >>>>>> "/opt/trex/v2.86/automation/trex_control_plane/interactive/trex/common/trex_client.py", >>>>>> line 2876, in _clear_stats_common >>>>>> >>>> >>>>>>> raise TRexError(rc) >>>>>> >>>> >>>>>>> trex.common.trex_exceptions.TRexError: *** [RPC] - >>>>>> Failed to get server response from tcp://172.18.0.40:4501 >>>>>> >>>> >>>>>> >>>>>> >>>> >>>>>> >>>>>> >>>> >>>>>> I also try to run TRex in stateless mode with./t-rex-64 >>>>>> -i --cfg /etc/trex_cfg.yaml and connect with ./trex-console >>>>>> >>>> >>>>>> >>>>>> >>>> >>>>>> Then start sending traffic with command >>>>>> >>>> >>>>>>> >>>>>> >>>> >>>>>>> trex>start -f stl/imix.py >>>>>> >>>> >>>>>> >>>>>> >>>> >>>>>> >>>>>> >>>> >>>>>> But this will cause an error to turn off Trex. >>>>>> >>>> >>>>>> >>>>>> >>>> >>>>>>> trex> >>>>>> >>>> >>>>>>> 2021-01-13 19:56:21 - [server][warning] - Server has >>>>>> been shutdown - cause: 'WATCHDOG: task 'Trex DP core 1' has not responded >>>>>> for more than 1.00135 seconds - timeout is 1 seconds >>>>>> >>>> >>>>>>> *** traceback follows *** >>>>>> >>>> >>>>>>> 1 0x561be173cf5a ./_t-rex-64(+0x19af5a) >>>>>> [0x561be173cf5a] >>>>>> >>>> >>>>>>> 2 0x7feea3ac0980 >>>>>> /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7feea3ac0980] >>>>>> >>>> >>>>>>> 3 0x561be1a05a2a rte_delay_us_block + 106 >>>>>> >>>> >>>>>>> 4 0x561be16ce874 >>>>>> CCoreEthIF::send_burst(CCorePerPort*, unsigned short, >>>>>> CVirtualIFPerSideStats*) + 3220 >>>>>> >>>> >>>>>>> 5 0x561be16abf57 CCoreEthIF::flush_tx_queue() + 31 >>>>>> >>>> >>>>>>> 6 0x561be171e3d9 >>>>>> CNodeGenerator::handle_maintenance(CFlowGenListPerThread*) + 265 >>>>>> >>>> >>>>>>> 7 0x561be171f7ec >>>>>> CNodeGenerator::handle_flow_sync(CGenNode*, CFlowGenListPerThread*, bool&) >>>>>> + 92 >>>>>> >>>> >>>>>>> 8 0x561be171fc98 >>>>>> CNodeGenerator::handle_slow_messages(unsigned char, CGenNode*, >>>>>> CFlowGenListPerThread*, bool) + 184 >>>>>> >>>> >>>>>>> 9 0x561be16cb5f1 int >>>>>> CNodeGenerator::flush_file_realtime<23, false>(double, double, >>>>>> CFlowGenListPerThread*, double&) + 881 >>>>>> >>>> >>>>>>> 10 0x561be1905212 >>>>>> TrexStatelessDpCore::start_scheduler() + 226 >>>>>> >>>> >>>>>>> 11 0x561be1883ae9 TrexDpCore::start() + 89 >>>>>> >>>> >>>>>>> 12 0x561be1714113 >>>>>> CFlowGenListPerThread::start(std::__cxx11::basic_string>>>>> std::char_traits, std::allocator >&, CPreviewMode&) + 115 >>>>>> >>>> >>>>>>> 13 0x561be16af8dd CGlobalTRex::run_in_core(unsigned >>>>>> char) + 487 >>>>>> >>>> >>>>>>> 14 0x561be16d11ad ./_t-rex-64(+0x12f1ad) >>>>>> [0x561be16d11ad] >>>>>> >>>> >>>>>>> 15 0x561be1a1dfaa eal_thread_loop + 426 >>>>>> >>>> >>>>>>> 16 0x7feea3ab56db >>>>>> /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7feea3ab56db] >>>>>> >>>> >>>>>>> 17 0x7feea2a8571f clone + 63 >>>>>> >>>> >>>>>>> >>>>>> >>>> >>>>>>> *** addr2line information follows *** >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ??:0 >>>>>> >>>> >>>>>>> ' >>>>>> >>>> >>>>>> >>>>>> >>>> >>>>>> >>>>>> >>>> >>>>>> I believe if everything is working, this should not turn >>>>>> off trex but please correct me if I am wrong. >>>>>> >>>> >>>>>> I wonder if you have any suggestion of how I can approach >>>>>> this issue? >>>>>> >>>> >>>>>> >>>>>> >>>> >>>>>> Best, >>>>>> >>>> >>>>>> David >>>>>> >>>> >>>>>> >>>>>> >>>> >>>>>> >>>>>> >>>>> --000000000000b1ef2205bba01e58 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi=C2=A0Ajit,

This is likely caused by = when dts try to=C2=A0ssh into another machine = as a normal user which will prompt you for the password.

One solution would be "sudo su" as root to run = the command line since you should have root access.

Another solu= tion would be to let me add your public ssh key into both machines.

=
Let= me know if this helps.

Best,
David

On Fri, Feb 1= 2, 2021 at 5:48 PM Ajit Khaparde <ajit.khaparde@broadcom.com> wrote:
Thanks=C2=A0Owen.

When I ru= n the dts command line suggested, I get the following error.

Thanks
Ajit<= /div>
<= br>
Traceback (most recent call last):
=C2=A0 File "/opt/dts/framewo= rk/ssh_pexpect.py", line 60, in _connect_host
=C2=A0 =C2=A0 self.pa= ssword, original_prompt=3D'[$#>]', password_regex=3Dr'(?i)(?= :password:)|(?:passphrase for key)|(?i)(password for .+:)')
=C2=A0 F= ile "/usr/local/lib/python3.6/dist-packages/pexpect/pxssh.py", li= ne 440, in login
=C2=A0 =C2=A0 raise ExceptionPxssh('password refuse= d')
pexpect.pxssh.ExceptionPxssh: password refused
=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0^^^^^^^^^^^^^^


On Fri, Feb 12, 2021 at 12:09 PM Owen Hilyard <ohilyard@iol.unh.edu> w= rote:
Hello Ajit,

There was a misconfiguration in our= identity management system. The issue should now=C2=A0be resolved.=C2=A0

Owen Hilyard

On Thu, Feb 11, 2021 at 9:38 PM &= #39;Ajit Khaparde' via dpdklab <dpdklab@iol.unh.edu> wrote:
David,
I can use my cre= dentials to login to rhea.
But the same credentials are not allowing me to l= ogin onto the servers you provided.

Thanks
Ajit

ssh -l ajitkhaparde arm-gig= abyte.dpdklab.iol.unh.edu
Connection closed by 172.18.0.41 port 22

ssh -l ajitkhaparde arm-dell.dpdklab.iol.unh.edu
Connection closed by 1= 72.18.0.40 port 22

On Tue, Feb 9, 2021 at 6:36 AM David Liu <= dliu@iol.unh.edu&= gt; wrote:
Hi=C2=A0Ajit,

Thanks for the update. Let me = know if you need anything from me.


= Best,
David

On Sun, Feb 7, 2021 at 11:04 PM Ajit Khaparde &l= t;ajit.khap= arde@broadcom.com> wrote:
David,
I had some trouble with my system over t= he past week.
So I could not login into the setup. I am hoping that my syste= m will be restored early this week
I will login into the setup after that.<= /div>
<= br>
Thanks
Ajit

On Tue, Feb 2, 2021 at 10:57 AM Ajit Khaparde <ajit.khaparde@bro= adcom.com> wrote:
Hi David,
I actually did miss it. I will take a look.
Thanks for the refresh mail.

Thanks
Ajit

On Tue, Feb 2, 2021 at 8:58 AM David Liu <dliu@iol.unh.edu> wrote:
>
> Hi Ajit,
>
> Ping again in case if you miss the last email.
>
> Did you have a chance to give it a try on login to the machines?
>
> Just some notes, we are currently running compile and some performance= /functional testing.
> Which it may be hard for you to run dts, so please let me know if you = want me to stop these tests for you to debug.
>
> Step I run:
> CONF=3D"conf_dpdk" ./switch.sh Broadcom=C2=A0 =C2=A0#this is= to switch the dts configuration to Broadcom
> ./dts -s=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0#T= o start the dts
>
> Informatio:
> arm-dell.dpdklab.iol.unh.edu
> - dts - located in /opt/dts
> - Trex - located in /opt/trex/v2.87
>
> arm-gigabyte.dpdklab.iol.unh.edu
> - dpdk - located in /root/dpdk
>
> Best,
> David
>
> On Tue, Jan 26, 2021 at 4:59 PM David Liu <dliu@iol.unh.edu> wrote:
>>
>> Also, I had changed the configuration when I run Broadcom nic.
>> In the dts folder, you can start it with ./dts -s
>>
>> On Tue, Jan 26, 2021 at 4:54 PM David Liu <dliu@iol.unh.edu> wrote:
>>>
>>> Hi Ajit,
>>> Sorry for the late reply.
>>>
>>> You can ssh into the machine using the same VPN Username and P= assword.
>>> Can you try and see if that works?
>>>
>>> Informatio:
>>> arm-dell.dpdklab.iol.unh.edu
>>> - dts - located in /opt/dts
>>> - Trex - located in /opt/trex/v2.87
>>>
>>> arm-gigabyte.dpdklab.iol.unh.edu
>>> - dpdk - located in /root/dpdk
>>>
>>>
>>> Thanks,
>>> David
>>>
>>> On Tue, Jan 19, 2021 at 5:20 PM Ajit Khaparde <ajit.khaparde@broadcom.= com> wrote:
>>>>
>>>> Hi David,
>>>> Thanks for pinging me. Do you think I could login into the= setup and
>>>> see what is happening?
>>>> I do have the credentials for two systems in your lab - >>>> rhea.dpdklab.iol.unh.edu and io.dpdklab.iol.= unh.edu
>>>> If you can provide me details of the systems you are tryin= g to
>>>> configure, I could take a look.
>>>>
>>>> Thanks
>>>> Ajit
>>>>
>>>> On Tue, Jan 19, 2021 at 1:41 PM David Liu <dliu@iol.unh.edu> wrote: >>>> >
>>>> > Hi Ajit,
>>>> >
>>>> > Thank you for helping out.
>>>> >
>>>> > How are you doing with this issue?
>>>> >
>>>> > Please let me know if you need anything information f= rom us.
>>>> >
>>>> > Just some extra information that both Trex and dts ar= e on the same intel tester machine.
>>>> >
>>>> > Best,
>>>> > David
>>>> >
>>>> > On Thu, Jan 14, 2021 at 2:12 PM David Liu <dliu@iol.unh.edu> wro= te:
>>>> >>
>>>> >> Yes, so this is the same NIC work on x86.
>>>> >> By seeing the link, I am assuming you mean the po= rts that are using for Trex. If so they are UP before I start the Trex.
>>>> >>
>>>> >> Thank,
>>>> >> David
>>>> >>
>>>> >>
>>>> >> On Thu, Jan 14, 2021 at 1:11 AM Ajit Khaparde <= ;ajit.khapa= rde@broadcom.com> wrote:
>>>> >>>
>>>> >>> Does the same NIC work on x86?
>>>> >>> Also do you see link before you start the tre= x? I am trying to see if the port failed to successfully come up
>>>> >>> or if there is a problem with the link. Can y= ou check and tell?
>>>> >>>
>>>> >>> Thanks
>>>> >>> Ajit
>>>> >>>
>>>> >>> On Wed, Jan 13, 2021 at 4:20 PM David Liu <= ;dliu@iol.unh.edu= > wrote:
>>>> >>>>
>>>> >>>> Hi Ajit,
>>>> >>>>
>>>> >>>> Thank you for helping out.
>>>> >>>>
>>>> >>>> We have it working on the x86, but not th= e Arm.
>>>> >>>>
>>>> >>>>
>>>> >>>> Thanks,
>>>> >>>> David
>>>> >>>>
>>>> >>>> On Wed, Jan 13, 2021 at 5:34 PM Ajit Khap= arde <aj= it.khaparde@broadcom.com> wrote:
>>>> >>>>>
>>>> >>>>> Hi David,
>>>> >>>>> I will take a look.
>>>> >>>>> Do you see similar issues on x86? I a= m asking because
>>>> >>>>> even I would start with that to creat= e a baseline and then
>>>> >>>>> attempt on ARM.
>>>> >>>>>
>>>> >>>>> Thanks
>>>> >>>>> Ajit
>>>> >>>>>
>>>> >>>>> On Wed, Jan 13, 2021 at 12:08 PM Davi= d Liu <dliu@iol.un= h.edu> wrote:
>>>> >>>>>>
>>>> >>>>>> Hi Ajit,
>>>> >>>>>>
>>>> >>>>>> We have a 25G Broadcom NIC that i= s installed on an Arm machine.
>>>> >>>>>> And I am running into a problem w= hen I try to run nic_single_core_perf on the NIC.
>>>> >>>>>> Currently, we are using: Trex v2.= 86 and dts from http://git.dpdk.org/tools/dts/
>>>> >>>>>> All the NICs are up and running w= hen testing.
>>>> >>>>>>
>>>> >>>>>> The problem is an error when I tr= y to run the test case inside the nic_single_core_perf:
>>>> >>>>>>
>>>> >>>>>>> TestNicSingleCorePerf: Test r= unning at parameters: framesize: 64, rxd/txd: 512
>>>> >>>>>>>=C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 dut.172.18.0.41: x86_64-native-linuxapp-gcc/app= /dpdk-testpmd -l 32,33 -n 4=C2=A0 --file-prefix=3Ddpdk_15311_20210113190237= =C2=A0 =C2=A0-a 0000:93:00.0 -a 0000:93:00.1 -- -i --portmask=3D0x3 --txd= =3D512 --rxd=3D512 --nb-cores=3D1
>>>> >>>>>>>=C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 dut.172.18.0.41: start
>>>> >>>>>>>=C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 TestNicSingleCorePerf: Test Case test_perf_nic_single_core Result ER= ROR: Traceback (most recent call last):
>>>> >>>>>>>=C2=A0 =C2=A0File "/opt/d= ts/framework/test_case.py", line 319, in _execute_test_case
>>>> >>>>>>>=C2=A0 =C2=A0 =C2=A0case_obj()=
>>>> >>>>>>>=C2=A0 =C2=A0File "tests/= TestSuite_nic_single_core_perf.py", line 196, in test_perf_nic_single_= core
>>>> >>>>>>>=C2=A0 =C2=A0 =C2=A0self.perf_= test(self.nb_ports)
>>>> >>>>>>>=C2=A0 =C2=A0File "tests/= TestSuite_nic_single_core_perf.py", line 270, in perf_test
>>>> >>>>>>>=C2=A0 =C2=A0 =C2=A0_, packets= _received =3D self.tester.pktgen.measure_throughput(stream_ids=3Dstreams, o= ptions=3Dtraffic_opt)
>>>> >>>>>>>=C2=A0 =C2=A0File "/opt/d= ts/framework/pktgen_base.py", line 245, in measure_throughput
>>>> >>>>>>>=C2=A0 =C2=A0 =C2=A0self._prep= are_transmission(stream_ids=3Dstream_ids)
>>>> >>>>>>>=C2=A0 =C2=A0File "/opt/d= ts/framework/pktgen_trex.py", line 778, in _prepare_transmission
>>>> >>>>>>>=C2=A0 =C2=A0 =C2=A0self._conn= .reset(ports=3Dself._ports)
>>>> >>>>>>>=C2=A0 =C2=A0File "/opt/t= rex/v2.86/automation/trex_control_plane/interactive/trex/common/trex_api_an= notators.py", line 51, in wrap2
>>>> >>>>>>>=C2=A0 =C2=A0 =C2=A0ret =3D f(= *args, **kwargs)
>>>> >>>>>>>=C2=A0 =C2=A0File "/opt/t= rex/v2.86/automation/trex_control_plane/interactive/trex/stl/trex_stl_clien= t.py", line 339, in reset
>>>> >>>>>>>=C2=A0 =C2=A0 =C2=A0self.clear= _stats(ports)
>>>> >>>>>>>=C2=A0 =C2=A0File "/opt/t= rex/v2.86/automation/trex_control_plane/interactive/trex/common/trex_api_an= notators.py", line 51, in wrap2
>>>> >>>>>>>=C2=A0 =C2=A0 =C2=A0ret =3D f(= *args, **kwargs)
>>>> >>>>>>>=C2=A0 =C2=A0File "/opt/t= rex/v2.86/automation/trex_control_plane/interactive/trex/stl/trex_stl_clien= t.py", line 1492, in clear_stats
>>>> >>>>>>>=C2=A0 =C2=A0 =C2=A0self._clea= r_stats_common(ports, clear_global, clear_xstats)
>>>> >>>>>>>=C2=A0 =C2=A0File "/opt/t= rex/v2.86/automation/trex_control_plane/interactive/trex/common/trex_client= .py", line 2876, in _clear_stats_common
>>>> >>>>>>>=C2=A0 =C2=A0 =C2=A0raise TRex= Error(rc)
>>>> >>>>>>> trex.common.trex_exceptions.T= RexError: *** [RPC] - Failed to get server response from tcp://172.18.0.40:45= 01
>>>> >>>>>>
>>>> >>>>>>
>>>> >>>>>> I also try to run TRex in statele= ss mode with./t-rex-64 -i --cfg /etc/trex_cfg.yaml and=C2=A0 connect with .= /trex-console
>>>> >>>>>>
>>>> >>>>>> Then start sending traffic with c= ommand
>>>> >>>>>>>
>>>> >>>>>>> trex>start -f stl/imix.py<= br> >>>> >>>>>>
>>>> >>>>>>
>>>> >>>>>> But this will cause an error to t= urn off Trex.
>>>> >>>>>>
>>>> >>>>>>> trex>
>>>> >>>>>>> 2021-01-13 19:56:21 - [server= ][warning]=C2=A0 - Server has been shutdown - cause: 'WATCHDOG: task &#= 39;Trex DP core 1' has not responded for more than 1.00135 seconds - ti= meout is 1 seconds
>>>> >>>>>>> *** traceback follows ***
>>>> >>>>>>> 1=C2=A0 =C2=A0 =C2=A0 =C2=A00= x561be173cf5a ./_t-rex-64(+0x19af5a) [0x561be173cf5a]
>>>> >>>>>>> 2=C2=A0 =C2=A0 =C2=A0 =C2=A00= x7feea3ac0980 /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7feea3ac09= 80]
>>>> >>>>>>> 3=C2=A0 =C2=A0 =C2=A0 =C2=A00= x561be1a05a2a rte_delay_us_block + 106
>>>> >>>>>>> 4=C2=A0 =C2=A0 =C2=A0 =C2=A00= x561be16ce874 CCoreEthIF::send_burst(CCorePerPort*, unsigned short, CVirtua= lIFPerSideStats*) + 3220
>>>> >>>>>>> 5=C2=A0 =C2=A0 =C2=A0 =C2=A00= x561be16abf57 CCoreEthIF::flush_tx_queue() + 31
>>>> >>>>>>> 6=C2=A0 =C2=A0 =C2=A0 =C2=A00= x561be171e3d9 CNodeGenerator::handle_maintenance(CFlowGenListPerThread*) + = 265
>>>> >>>>>>> 7=C2=A0 =C2=A0 =C2=A0 =C2=A00= x561be171f7ec CNodeGenerator::handle_flow_sync(CGenNode*, CFlowGenListPerTh= read*, bool&) + 92
>>>> >>>>>>> 8=C2=A0 =C2=A0 =C2=A0 =C2=A00= x561be171fc98 CNodeGenerator::handle_slow_messages(unsigned char, CGenNode*= , CFlowGenListPerThread*, bool) + 184
>>>> >>>>>>> 9=C2=A0 =C2=A0 =C2=A0 =C2=A00= x561be16cb5f1 int CNodeGenerator::flush_file_realtime<23, false>(doub= le, double, CFlowGenListPerThread*, double&) + 881
>>>> >>>>>>> 10=C2=A0 =C2=A0 =C2=A0 0x561b= e1905212 TrexStatelessDpCore::start_scheduler() + 226
>>>> >>>>>>> 11=C2=A0 =C2=A0 =C2=A0 0x561b= e1883ae9 TrexDpCore::start() + 89
>>>> >>>>>>> 12=C2=A0 =C2=A0 =C2=A0 0x561b= e1714113 CFlowGenListPerThread::start(std::__cxx11::basic_string<char, s= td::char_traits<char>, std::allocator<char> >&, CPreview= Mode&) + 115
>>>> >>>>>>> 13=C2=A0 =C2=A0 =C2=A0 0x561b= e16af8dd CGlobalTRex::run_in_core(unsigned char) + 487
>>>> >>>>>>> 14=C2=A0 =C2=A0 =C2=A0 0x561b= e16d11ad ./_t-rex-64(+0x12f1ad) [0x561be16d11ad]
>>>> >>>>>>> 15=C2=A0 =C2=A0 =C2=A0 0x561b= e1a1dfaa eal_thread_loop + 426
>>>> >>>>>>> 16=C2=A0 =C2=A0 =C2=A0 0x7fee= a3ab56db /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7feea3ab56db] >>>> >>>>>>> 17=C2=A0 =C2=A0 =C2=A0 0x7fee= a2a8571f clone + 63
>>>> >>>>>>>
>>>> >>>>>>> *** addr2line information fol= lows ***
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> ??:0
>>>> >>>>>>> '
>>>> >>>>>>
>>>> >>>>>>
>>>> >>>>>> I believe if everything is workin= g, this should not turn off trex but please correct me if I am wrong.
>>>> >>>>>> I wonder if you have any suggesti= on of how I can approach this issue?
>>>> >>>>>>
>>>> >>>>>> Best,
>>>> >>>>>> David
>>>> >>>>>>
>>>> >>>>>>
--000000000000b1ef2205bba01e58--