From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga05.intel.com (mga05.intel.com [192.55.52.43]) by dpdk.org (Postfix) with ESMTP id 95C08F72 for ; Thu, 1 Sep 2016 03:35:52 +0200 (CEST) Received: from fmsmga006.fm.intel.com ([10.253.24.20]) by fmsmga105.fm.intel.com with ESMTP; 31 Aug 2016 18:35:51 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.30,264,1470726000"; d="scan'208";a="3353507" Received: from fmsmsx106.amr.corp.intel.com ([10.18.124.204]) by fmsmga006.fm.intel.com with ESMTP; 31 Aug 2016 18:35:51 -0700 Received: from fmsmsx102.amr.corp.intel.com (10.18.124.200) by FMSMSX106.amr.corp.intel.com (10.18.124.204) with Microsoft SMTP Server (TLS) id 14.3.248.2; Wed, 31 Aug 2016 18:35:51 -0700 Received: from shsmsx151.ccr.corp.intel.com (10.239.6.50) by FMSMSX102.amr.corp.intel.com (10.18.124.200) with Microsoft SMTP Server (TLS) id 14.3.248.2; Wed, 31 Aug 2016 18:35:50 -0700 Received: from shsmsx102.ccr.corp.intel.com ([169.254.2.109]) by SHSMSX151.ccr.corp.intel.com ([169.254.3.250]) with mapi id 14.03.0248.002; Thu, 1 Sep 2016 09:35:49 +0800 From: "Xu, Qian Q" To: "kmcheng@cht.com.tw" , "users@dpdk.org" Thread-Topic: 2VMs with dpdk app-testpmd effect each other Thread-Index: AdID6m4IFJ8JsjwvQL2I+1zrbt7A8AABfx9A Date: Thu, 1 Sep 2016 01:35:48 +0000 Message-ID: <82F45D86ADE5454A95A89742C8D1410E39120C50@shsmsx102.ccr.corp.intel.com> References: <3E5680DCFAC5554BA7954FF786773692B7645809@mbs8.app.corp.cht.com.tw> In-Reply-To: <3E5680DCFAC5554BA7954FF786773692B7645809@mbs8.app.corp.cht.com.tw> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.239.127.40] Content-Type: text/plain; charset="iso-2022-jp" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: Re: [dpdk-users] 2VMs with dpdk app-testpmd effect each other X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Sep 2016 01:35:53 -0000 Maybe VM1 and VM2 are using the same core for the forwarding? I guess 2VMs = are using the same core for fwd.=20 What do you mean by testpmd fwd=3Dnone, if you don't set the fwd mode, it's= IO fwd.=20 -----Original Message----- From: users [mailto:users-bounces@dpdk.org] On Behalf Of ??? Sent: Thursday, September 1, 2016 8:47 AM To: users@dpdk.org Subject: [dpdk-users] 2VMs with dpdk app-testpmd effect each other Hi all I am facing a wierd situation when i start testpmd app inside two VMs( Case= 3 ). Please see the following setup. Hardware Information System Dell Inc. PowerEdge R630 =1B$B!!=1B(B =1B$B!!=1B(B BIOS Dell Inc. version1.0.4 =1B$B!!=1B(B CPU Intel(R) Xeon(R) x86_64 E5-2630 v3 2.40 Ghz =1B$B!!=1B(B Processor(s): 16 =1B$B!!=1B(B =1B$B!!=1B(B Cache: 20480 KB =1B$B!!=1B(B =1B$B!!=1B(B =1B$B!!=1B(B Memory Size: 16 GB*6 =1B$B!!=1B(B =1B$B!!=1B(B =1B$B!!=1B(B =1B$B!!=1B(B Type: DDR4 =1B$B!!=1B(B =1B$B!!=1B(B Speed: 2133MHz =1B$B!!=1B(B =1B$B!!=1B(B =1B$B!!=1B(B Ethernet Controller Intel Corporation Ethernet 10G 2P X520 Adapter *2 Software information Qemu =3D qemu-2.5.1.1 DPDK =3D dpdk-2.2.0 OVS =3D ovs-branch-2.5 Input stream : 10Gbps(5G with vlan 1001 and 5G with vlan 1002) which is gen= erated by Spirent testcenter | VM1 | | VM2 | =1B$B",=1B(B1001=1B$B"-=1B(B =1B$B",=1B(B1002=1B$B"-=1B(B ----------------------- | OVS | ----------------------- =1B$B",=1B(B =1B$B"-=1B(B ----------------------- TestCenter | ----------------------- ovs setup: modprobe openvswitch rm -rf /usr/local/var/run/openvswitch/* rm -rf /opt/ovs-vswitchd.log modprobe uio insmod $DPDK_BUILD/kmod/igb_uio.ko $DPDK_DIR/tools/dpdk_nic_bind.py --bind=3Digb_uio p3p1 $DPDK_DIR/tools/dpdk_nic_bind.py --bind=3Digb_uio p3p2 $DPDK_DIR/tools/dpdk_nic_bind.py --status rm /usr/local/etc/openvswitch/conf.db -rf mkdir -p /usr/local/etc/openvswitch mkdir -p /usr/local/var/run/openvswitch cd $OVS_DIR ./ovsdb/ovsdb-tool create /usr/local/etc/openvswitch/conf.db ./vswitchd/v= switch.ovsschema ./ovsdb/ovsdb-server --remote=3Dpunix:/usr/local/var/run/openvswitch/db.s= ock --remote=3Ddb:Open_vSwitch,Open_vSwitch,manager_options --private-key= =3Ddb:Open_vSwitch,SSL,private_key --certificate=3Ddb:Open_vSwitch,SSL,cert= ificate --bootstrap-ca-cert=3Ddb:Open_vSwitch,SSL,ca_cert --pidfile --detac= h ./utilities/ovs-vsctl --no-wait init ./utilities/ovs-vsctl --no-wait set Open_vSwitch . other_config:dpdk-init= =3Dtrue ./vswitchd/ovs-vswitchd --dpdk --socket-mem 4096,4096 -n 4 -- unix:/usr/l= ocal/var/run/openvswitch/db.sock --log-file=3D$OVS_LOG --pidfile --detach Case 1: VM1 start testpmd, fwd =3D iofwd VM2 start testpmd,fwd =3D iofwd Result =3D Spirent testcenter show output stream is reaching line speed 10= G. Case 2: VM1 testpmd =3D started, fwd =3D iofwd VM2 testpmd=3Dstopped,fwd =3D none Result =3D Spirent testcenter show output stream is reaching 5G. Which is reasonable. Case 3: VM1 testpmd =3D started, fwd =3D iofwd VM2 testpmd =3D started ,fwd =3D none Result =3D Spirent testcenter show output stream is less than 200Mbps. I am confused about the case 3. What is the reason VM2 effects VM1 so signi= ficantly? How can i solve such problem? I will appreciate for your answer. Thx =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D =1B$BE"3.Xl=1B(B Kai-Mao Cheng =1B$BCf2ZEE?.8&5f1!=1B(B =1B$BynIQLVO)8&5f=3Dj=1B(B 231=1B$B7WaA=1B(B =1B$BEEOC=1B(B:03-4244093 =1B$B