From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <qian.q.xu@intel.com>
Received: from mga11.intel.com (mga11.intel.com [192.55.52.93])
 by dpdk.org (Postfix) with ESMTP id ED1AD6936
 for <users@dpdk.org>; Wed,  7 Sep 2016 04:11:33 +0200 (CEST)
Received: from fmsmga001.fm.intel.com ([10.253.24.23])
 by fmsmga102.fm.intel.com with ESMTP; 06 Sep 2016 19:11:34 -0700
X-ExtLoop1: 1
X-IronPort-AV: E=Sophos;i="5.30,294,1470726000"; d="scan'208";a="1036350017"
Received: from fmsmsx104.amr.corp.intel.com ([10.18.124.202])
 by fmsmga001.fm.intel.com with ESMTP; 06 Sep 2016 19:11:33 -0700
Received: from fmsmsx123.amr.corp.intel.com (10.18.125.38) by
 fmsmsx104.amr.corp.intel.com (10.18.124.202) with Microsoft SMTP Server (TLS)
 id 14.3.248.2; Tue, 6 Sep 2016 19:11:32 -0700
Received: from shsmsx104.ccr.corp.intel.com (10.239.4.70) by
 fmsmsx123.amr.corp.intel.com (10.18.125.38) with Microsoft SMTP Server (TLS)
 id 14.3.248.2; Tue, 6 Sep 2016 19:11:32 -0700
Received: from shsmsx102.ccr.corp.intel.com ([169.254.2.109]) by
 SHSMSX104.ccr.corp.intel.com ([169.254.5.174]) with mapi id 14.03.0248.002;
 Wed, 7 Sep 2016 10:11:30 +0800
From: "Xu, Qian Q" <qian.q.xu@intel.com>
To: "kmcheng@cht.com.tw" <kmcheng@cht.com.tw>, "users@dpdk.org"
 <users@dpdk.org>
Thread-Topic: 2VMs with dpdk app-testpmd effect each other
Thread-Index: AdID6m4IFJ8JsjwvQL2I+1zrbt7A8AABfx9AADrIcQAA8+wp4AAASBiQ
Date: Wed, 7 Sep 2016 02:11:29 +0000
Message-ID: <82F45D86ADE5454A95A89742C8D1410E3912D24B@shsmsx102.ccr.corp.intel.com>
References: <3E5680DCFAC5554BA7954FF786773692B7645809@mbs8.app.corp.cht.com.tw>
 <82F45D86ADE5454A95A89742C8D1410E39120C50@shsmsx102.ccr.corp.intel.com>,
 <3E5680DCFAC5554BA7954FF786773692B7645C30@mbs8.app.corp.cht.com.tw>
 <3E5680DCFAC5554BA7954FF786773692B7645FFF@mbs8.app.corp.cht.com.tw>
In-Reply-To: <3E5680DCFAC5554BA7954FF786773692B7645FFF@mbs8.app.corp.cht.com.tw>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
x-originating-ip: [10.239.127.40]
Content-Type: text/plain; charset="iso-2022-jp"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Subject: Re: [dpdk-users] 2VMs with dpdk app-testpmd effect each other
X-BeenThere: users@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: usage discussions <users.dpdk.org>
List-Unsubscribe: <http://dpdk.org/ml/options/users>,
 <mailto:users-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://dpdk.org/ml/archives/users/>
List-Post: <mailto:users@dpdk.org>
List-Help: <mailto:users-request@dpdk.org?subject=help>
List-Subscribe: <http://dpdk.org/ml/listinfo/users>,
 <mailto:users-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Wed, 07 Sep 2016 02:11:34 -0000

It's not normal, and I think first we need figure out it's DPDK issue or OV=
S issue or some configuration issue.=20
Are you using 2 10G port to inject traffic?=20
What's your qemu launch commands for each VM?
Can you use "top -H" command to check the core usage when u running the cas=
e2 and case3?=20


-----Original Message-----
From: =1B$BE"3.Xl=1B(B [mailto:kmcheng@cht.com.tw]=20
Sent: Wednesday, September 7, 2016 10:04 AM
To: Xu, Qian Q <qian.q.xu@intel.com>; users@dpdk.org
Subject: RE: 2VMs with dpdk app-testpmd effect each other

So my question is : is it normal ?
Is there any way i can solve the problem?

Is the problem related to qemu-img?=20
________________________________________
=1B$BWO=1B(B: =1B$BE"3.Xl=1B(B
=1B$B4s7oF|4|=1B(B: 2016=1B$BG/=1B(B9=1B$B7n=1B(B2=1B$BF|=1B(B =1B$B2<8a=1B=
(B 01:37
=1B$B;j=1B(B: Xu, Qian Q; users@dpdk.org
=1B$B<g;]=1B(B: RE: 2VMs with dpdk app-testpmd effect each other

I am sure that VM1 and VM2 are using different core with different coremask=
 setting.
Yes, I know that default fwd enging is IO fwd. And fwd engine will start wh=
ile testpmd is started.

I used "stop" command to stop fwd engine inside testpmd.
The I can see effect ion on the other VM.

-----Original Message-----
From: Xu, Qian Q [mailto:qian.q.xu@intel.com]
Sent: Thursday, September 01, 2016 9:36 AM
To: =1B$BE"3.Xl=1B(B; users@dpdk.org
Subject: RE: 2VMs with dpdk app-testpmd effect each other

Maybe VM1 and VM2 are using the same core for the forwarding? I guess 2VMs =
are using the same core for fwd.
What do you mean by testpmd fwd=3Dnone, if you don't set the fwd mode, it's=
 IO fwd.

-----Original Message-----
From: users [mailto:users-bounces@dpdk.org] On Behalf Of ???
Sent: Thursday, September 1, 2016 8:47 AM
To: users@dpdk.org
Subject: [dpdk-users] 2VMs with dpdk app-testpmd effect each other

Hi all

I am facing a wierd situation when i start testpmd app inside two VMs( Case=
 3 ).
Please see the following setup.


Hardware Information

System

Dell Inc. PowerEdge R630

=1B$B!!=1B(B

=1B$B!!=1B(B

BIOS

Dell Inc. version1.0.4

=1B$B!!=1B(B

CPU

Intel(R) Xeon(R) x86_64 E5-2630 v3 2.40 Ghz

=1B$B!!=1B(B

Processor(s): 16

=1B$B!!=1B(B

=1B$B!!=1B(B

Cache: 20480 KB

=1B$B!!=1B(B

=1B$B!!=1B(B

=1B$B!!=1B(B

Memory

Size: 16 GB*6

=1B$B!!=1B(B

=1B$B!!=1B(B

=1B$B!!=1B(B

=1B$B!!=1B(B

Type: DDR4

=1B$B!!=1B(B

=1B$B!!=1B(B

Speed: 2133MHz

=1B$B!!=1B(B

=1B$B!!=1B(B

=1B$B!!=1B(B

Ethernet Controller

Intel Corporation Ethernet 10G 2P X520 Adapter *2


Software information
Qemu =3D qemu-2.5.1.1
DPDK =3D dpdk-2.2.0
OVS =3D ovs-branch-2.5

Input stream : 10Gbps(5G with vlan 1001 and 5G with vlan 1002) which is gen=
erated by Spirent testcenter

| VM1 |       | VM2 |

 =1B$B",=1B(B1001=1B$B"-=1B(B      =1B$B",=1B(B1002=1B$B"-=1B(B
-----------------------
|    OVS        |
-----------------------
        =1B$B",=1B(B       =1B$B"-=1B(B
-----------------------
 TestCenter     |
-----------------------

ovs setup:
  modprobe openvswitch
  rm -rf /usr/local/var/run/openvswitch/*
  rm -rf /opt/ovs-vswitchd.log
  modprobe uio
  insmod $DPDK_BUILD/kmod/igb_uio.ko
  $DPDK_DIR/tools/dpdk_nic_bind.py --bind=3Digb_uio p3p1
  $DPDK_DIR/tools/dpdk_nic_bind.py --bind=3Digb_uio p3p2
  $DPDK_DIR/tools/dpdk_nic_bind.py --status
  rm /usr/local/etc/openvswitch/conf.db -rf
  mkdir -p /usr/local/etc/openvswitch
  mkdir -p /usr/local/var/run/openvswitch
  cd $OVS_DIR
  ./ovsdb/ovsdb-tool create /usr/local/etc/openvswitch/conf.db ./vswitchd/v=
switch.ovsschema
  ./ovsdb/ovsdb-server --remote=3Dpunix:/usr/local/var/run/openvswitch/db.s=
ock --remote=3Ddb:Open_vSwitch,Open_vSwitch,manager_options --private-key=
=3Ddb:Open_vSwitch,SSL,private_key --certificate=3Ddb:Open_vSwitch,SSL,cert=
ificate --bootstrap-ca-cert=3Ddb:Open_vSwitch,SSL,ca_cert --pidfile --detac=
h

  ./utilities/ovs-vsctl --no-wait init
  ./utilities/ovs-vsctl --no-wait set Open_vSwitch . other_config:dpdk-init=
=3Dtrue
  ./vswitchd/ovs-vswitchd --dpdk --socket-mem 4096,4096 -n 4 -- unix:/usr/l=
ocal/var/run/openvswitch/db.sock --log-file=3D$OVS_LOG --pidfile --detach


Case 1:
VM1 start testpmd, fwd =3D iofwd
VM2 start testpmd,fwd =3D iofwd
Result =3D  Spirent testcenter show output stream is reaching line speed 10=
G.


Case 2:
VM1 testpmd =3D started, fwd =3D iofwd
VM2 testpmd=3Dstopped,fwd =3D none
Result =3D  Spirent testcenter show output stream is reaching 5G.
Which is reasonable.

Case 3:
VM1 testpmd =3D started, fwd =3D iofwd
VM2 testpmd =3D started ,fwd =3D none
Result =3D  Spirent testcenter show output stream is less than 200Mbps.



I am confused about the case 3. What is the reason VM2 effects VM1 so signi=
ficantly?
How can i solve such problem? I will appreciate for your answer.
Thx


=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D
=1B$BE"3.Xl=1B(B Kai-Mao Cheng
=1B$BCf2ZEE?.8&5f1!=1B(B =1B$BynIQLVO)8&5f=3Dj=1B(B 231=1B$B7WaA=1B(B
=1B$BEEOC=1B(B:03-4244093 =1B$B<j5!=1B(B:0912314847
E-mail:kmcheng@cht.com.tw
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D


Please be advised that this email message (including any attachments) conta=
ins confidential information and may be legally privileged. If you are not =
the intended recipient, please destroy this message and all attachments fro=
m your system and do not further collect, process, or use them. Chunghwa Te=
lecom and all its subsidiaries and associated companies shall not be liable=
 for the improper or incomplete transmission of the information contained i=
n this email nor for any delay in its receipt or damage to your system. If =
you are the intended recipient, please protect the confidential and/or pers=
onal information contained in this email with due care. Any unauthorized us=
e, disclosure or distribution of this message in whole or in part is strict=
ly prohibited.  Also, please self-inspect attachments and hyperlinks contai=
ned in this email to ensure the information security and to protect persona=
l information.