From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <dev-bounces@dpdk.org>
Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124])
	by inbox.dpdk.org (Postfix) with ESMTP id D0446A0580;
	Tue, 22 Nov 2022 10:36:47 +0100 (CET)
Received: from mails.dpdk.org (localhost [127.0.0.1])
	by mails.dpdk.org (Postfix) with ESMTP id C16AB42D57;
	Tue, 22 Nov 2022 10:36:47 +0100 (CET)
Received: from mail-pg1-f174.google.com (mail-pg1-f174.google.com
 [209.85.215.174])
 by mails.dpdk.org (Postfix) with ESMTP id E3A90427EB
 for <dev@dpdk.org>; Tue, 22 Nov 2022 06:48:01 +0100 (CET)
Received: by mail-pg1-f174.google.com with SMTP id 130so13174574pgc.5
 for <dev@dpdk.org>; Mon, 21 Nov 2022 21:48:01 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112;
 h=to:subject:message-id:date:from:mime-version:from:to:cc:subject
 :date:message-id:reply-to;
 bh=QAFPWpvIFaaVR/kLPbg2miEns+JxMvxQ6voAVxEpBt0=;
 b=D19P+HbNaWgzJ+E2hsyDVcJcwoM3E8/K0OkMarNvFaH1NlMs4nUuv0iWsbTqzlCKYj
 3/6XFrxZSGf2jW23DpMh95DZOKGP1ipY7lxQYWr6BYEb84/E0Jv9fcM0EoH57L6fM67t
 H0Xvvb8zSW2WBahyT0OEtL3IOmLmd2wdspIu0D2zw+2H4Bo0sMQK5hE1VZ8R8bzGZ2Lv
 mDQubDvttPNYuYhqUZOPWtL3lpKHru2zyoHHkrDhJe8Di3Jp9wJFLfiwqXgY2wesdTfu
 D5d8oH3/c+tk2nWHl5ZqMi91yd+ihzVNQIqcy2HuuYPW6BoKt2+qMvUky4KijJ5MdUjQ
 I2pA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20210112;
 h=to:subject:message-id:date:from:mime-version:x-gm-message-state
 :from:to:cc:subject:date:message-id:reply-to;
 bh=QAFPWpvIFaaVR/kLPbg2miEns+JxMvxQ6voAVxEpBt0=;
 b=THFoZvxHlcyXjbnT67g7NOYD7dVXQPw8kmd0pTjZCxCkcoIyhy69Yg63AyDDkikqSq
 4rWdDEjLZVsAzQxn8ABXk+x08O9KCzr9cxV8Iydpm1pugGM2k6bEiM90tGA1lVi7Ho/D
 XZUfiRB3G9zGQwS1V3FsajD9wPkJjeDKlvHUrDy6ic7shUiz1I3Y+o1em5vQMIHk+7d/
 8rrelw8N3Ot+deY2nZy2ed6OyE/e02aU29N+JNtqUslC9gzZWUAZxvZPJPjID3xltejB
 U//LGwWdlIk+JiiVbDHg4jvEuPEFnSlnt8QGw23yg2wDvyeR6xyBGdHsOxU6UIZSzCt+
 jx4g==
X-Gm-Message-State: ANoB5plufnYWtFrHWvNeOggNKtFOrSpWO+2qSTHefSNwSLlxIoUB5gwV
 VhDGXD6VTxXSdPsbpXjlre0iKbWiur1LdB5NQ9iNId+lejh3WIFe
X-Google-Smtp-Source: AA0mqf7rwVpS/fyjKs2PfKNAv9h8r4MVZpp5hMCkPHt91CK6aznAPZ4CYpzO6RzvjugJr3mqRUdhk7KFJnnxShtA6V4=
X-Received: by 2002:a05:6a00:3004:b0:56c:dba2:30b with SMTP id
 ay4-20020a056a00300400b0056cdba2030bmr23855310pfb.72.1669096080260; Mon, 21
 Nov 2022 21:48:00 -0800 (PST)
MIME-Version: 1.0
From: Illayaraja M <illayaraj02@gmail.com>
Date: Tue, 22 Nov 2022 11:17:48 +0530
Message-ID: <CAJDjCCDt=Au6PDqhTqg8-xhUxXk35hSTwyk-RFjrYczbx2krXQ@mail.gmail.com>
Subject: dpdk l2fwd performance issue in VM
To: dev@dpdk.org
Content-Type: multipart/alternative; boundary="000000000000f5c39f05ee08b685"
X-Mailman-Approved-At: Tue, 22 Nov 2022 10:36:46 +0100
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: DPDK patches and discussions <dev.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/dev>,
 <mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/dev>,
 <mailto:dev-request@dpdk.org?subject=subscribe>
Errors-To: dev-bounces@dpdk.org

--000000000000f5c39f05ee08b685
Content-Type: text/plain; charset="UTF-8"

Hi All,

I'm trying to deploy a l2fwd application on VMs to test it.
I have a 1Gbps link speed NIC, when I run a simple l2fwd application able
to achieve 1gbps traffic without any loss of packet. I have modified the
l2fwd application a bit.
I have two l2fwd applications namely P1 and P2. P1 receives the external
traffic and sends it to P2 and P2 simply changes the mac address and sends
it back to P1. Finally P1 sends the packet out to the external network.
With the above setup I'm able to achieve only 330Mbps traffic without
packet loss.

I'm trying to understand how the internal communication happens between the
P1 and P2 process, does it use PCI bus for communication?
Why is there a drop in tps and observe packet loss?

The setup details are given below.

The minimum hardware requirements to use UPF are as follows:

Hardware

Requirement Details

Machine Type

Virtual Machine

Host Kernel

3.10.0-1160.el7.x86_64

CPU Architecture

(Important)

x86_64 should support Intel SSE, VT-x, AVX

At least Intel Skylake or later gen

Host OS

Centos

Host Interfaces

At least 3 Physical Interfaces

VM Manager

QEMU/KVM minimum V 2.2.1

VM OS

CentOS Linux release 7.9 (Core)

VM Configuration

Minimum Memory 8 GB

Minimum 8 core CPUs

Minimum 10 GB disk space

Network Interfaces

(5 e1000e Interfaces including the Management interface)

Network Source

Name

Mode

Host Device

(Management)

Interface-1

Bridge


Host Device

Interface-2

Bridge

Interface-3

Bridge

Interface-4

Bridge

Interface-5

Bridge

Virtual Network(open Network)

Interface-6

Open

Interface-7

Open

Interface-8

Open

Can you please suggest the best recommended drivers and internal network.

Regards,
illaya

--000000000000f5c39f05ee08b685
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi All,<div><br></div><div>I&#39;m trying to deploy a l2fw=
d application on VMs to test it.=C2=A0</div><div>I have a 1Gbps link speed =
NIC, when I run a simple l2fwd application able to achieve 1gbps traffic wi=
thout any loss of packet. I have modified the l2fwd application a bit.</div=
><div>I have two l2fwd applications namely P1 and P2. P1 receives the exter=
nal traffic and sends it to P2 and P2 simply changes the mac address and se=
nds it back to P1. Finally P1 sends the packet out to the external network.=
</div><div>With the above setup I&#39;m able to achieve only 330Mbps traffi=
c=C2=A0without packet loss.=C2=A0</div><div><br></div><div>I&#39;m trying t=
o understand how the internal communication happens between the P1 and P2 p=
rocess, does it use PCI bus for communication?=C2=A0</div><div>Why is there=
 a drop in tps and observe packet loss?</div><div><br></div><div>The setup =
details are given=C2=A0below.</div><div><span id=3D"gmail-docs-internal-gui=
d-12c123e9-7fff-273c-7d69-c84e2fb1195a"><p dir=3D"ltr" style=3D"line-height=
:1.295;margin-top:0pt;margin-bottom:8pt"><span style=3D"font-size:11pt;font=
-family:Calibri,sans-serif;color:rgb(0,0,0);background-color:transparent;fo=
nt-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:bas=
eline;white-space:pre-wrap">The minimum hardware requirements to use UPF ar=
e as follows:</span></p><div dir=3D"ltr" style=3D"" align=3D"left"><table s=
tyle=3D"border:none;border-collapse:collapse"><colgroup><col width=3D"198">=
<col width=3D"134"><col width=3D"134"><col width=3D"160"></colgroup><tbody>=
<tr style=3D"height:0pt"><td style=3D"border-width:0.5pt;border-style:solid=
;border-color:rgb(0,0,0);vertical-align:top;background-color:rgb(204,204,20=
4);padding:0pt 5.4pt;overflow:hidden"><p dir=3D"ltr" style=3D"line-height:1=
.2;text-align:center;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-=
size:12pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;f=
ont-weight:700;font-variant-numeric:normal;font-variant-east-asian:normal;v=
ertical-align:baseline;white-space:pre-wrap">Hardware</span></p></td><td co=
lspan=3D"3" style=3D"border-width:0.5pt;border-style:solid;border-color:rgb=
(0,0,0);vertical-align:top;background-color:rgb(204,204,204);padding:0pt 5.=
4pt;overflow:hidden"><p dir=3D"ltr" style=3D"line-height:1.2;text-align:cen=
ter;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-size:12pt;font-fa=
mily:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:700;fo=
nt-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:bas=
eline;white-space:pre-wrap">Requirement Details</span></p></td></tr><tr sty=
le=3D"height:0pt"><td style=3D"border-width:0.5pt;border-style:solid;border=
-color:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;overflow:hidden"><p =
dir=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;margin-bottom:2pt"><spa=
n style=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,0);background-col=
or:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;v=
ertical-align:baseline;white-space:pre-wrap">Machine Type</span></p></td><t=
d colspan=3D"3" style=3D"border-width:0.5pt;border-style:solid;border-color=
:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;overflow:hidden"><p dir=3D=
"ltr" style=3D"line-height:1.2;margin-top:2pt;margin-bottom:2pt"><span styl=
e=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,0);background-color:tra=
nsparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertica=
l-align:baseline;white-space:pre-wrap">Virtual Machine</span></p></td></tr>=
<tr style=3D"height:0pt"><td style=3D"border-width:0.5pt;border-style:solid=
;border-color:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;overflow:hidd=
en"><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;margin-bottom:2p=
t"><span style=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,0);backgro=
und-color:transparent;font-variant-numeric:normal;font-variant-east-asian:n=
ormal;vertical-align:baseline;white-space:pre-wrap">Host Kernel=C2=A0</span=
></p></td><td colspan=3D"3" style=3D"border-width:0.5pt;border-style:solid;=
border-color:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;overflow:hidde=
n"><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;margin-bottom:2pt=
"><span style=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,0);backgrou=
nd-color:transparent;font-variant-numeric:normal;font-variant-east-asian:no=
rmal;vertical-align:baseline;white-space:pre-wrap">3.10.0-1160.el7.x86_64</=
span></p></td></tr><tr style=3D"height:0pt"><td style=3D"border-width:0.5pt=
;border-style:solid;border-color:rgb(0,0,0);vertical-align:top;padding:0pt =
5.4pt;overflow:hidden"><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2=
pt;margin-bottom:2pt"><span style=3D"font-size:10pt;font-family:Arial;color=
:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-v=
ariant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">CPU =
Architecture</span></p><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2=
pt;margin-bottom:2pt"><span style=3D"font-size:10pt;font-family:Arial;color=
:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-v=
ariant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">(Imp=
ortant)</span></p></td><td colspan=3D"3" style=3D"border-width:0.5pt;border=
-style:solid;border-color:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;o=
verflow:hidden"><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;marg=
in-bottom:2pt"><span style=3D"font-size:10pt;font-family:Arial;color:rgb(0,=
0,0);background-color:transparent;font-variant-numeric:normal;font-variant-=
east-asian:normal;vertical-align:baseline;white-space:pre-wrap">x86_64 shou=
ld support Intel SSE, VT-x, AVX</span></p><p dir=3D"ltr" style=3D"line-heig=
ht:1.2;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-size:10pt;font=
-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-nu=
meric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-s=
pace:pre-wrap">At least Intel Skylake or later gen</span></p></td></tr><tr =
style=3D"height:0pt"><td style=3D"border-width:0.5pt;border-style:solid;bor=
der-color:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;overflow:hidden">=
<p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;margin-bottom:2pt"><=
span style=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,0);background-=
color:transparent;font-variant-numeric:normal;font-variant-east-asian:norma=
l;vertical-align:baseline;white-space:pre-wrap">Host OS</span></p></td><td =
colspan=3D"3" style=3D"border-width:0.5pt;border-style:solid;border-color:r=
gb(0,0,0);vertical-align:top;padding:0pt 5.4pt;overflow:hidden"><p dir=3D"l=
tr" style=3D"line-height:1.2;margin-top:2pt;margin-bottom:2pt"><span style=
=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,0);background-color:tran=
sparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical=
-align:baseline;white-space:pre-wrap">Centos</span></p></td></tr><tr style=
=3D"height:0pt"><td style=3D"border-width:0.5pt;border-style:solid;border-c=
olor:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;overflow:hidden"><p di=
r=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;margin-bottom:2pt"><span =
style=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,0);background-color=
:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;ver=
tical-align:baseline;white-space:pre-wrap">Host Interfaces</span></p></td><=
td colspan=3D"3" style=3D"border-width:0.5pt;border-style:solid;border-colo=
r:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;overflow:hidden"><p dir=
=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;margin-bottom:2pt"><span s=
tyle=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,0);background-color:=
transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vert=
ical-align:baseline;white-space:pre-wrap">At least 3 Physical Interfaces</s=
pan></p></td></tr><tr style=3D"height:0pt"><td style=3D"border-width:0.5pt;=
border-style:solid;border-color:rgb(0,0,0);vertical-align:top;padding:0pt 5=
.4pt;overflow:hidden"><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2p=
t;margin-bottom:2pt"><span style=3D"font-size:10pt;font-family:Arial;color:=
rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-va=
riant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">VM Ma=
nager</span></p></td><td colspan=3D"3" style=3D"border-width:0.5pt;border-s=
tyle:solid;border-color:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;ove=
rflow:hidden"><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;margin=
-bottom:2pt"><span style=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,=
0);background-color:transparent;font-variant-numeric:normal;font-variant-ea=
st-asian:normal;vertical-align:baseline;white-space:pre-wrap">QEMU/KVM mini=
mum V 2.2.1</span></p></td></tr><tr style=3D"height:0pt"><td style=3D"borde=
r-width:0.5pt;border-style:solid;border-color:rgb(0,0,0);vertical-align:top=
;padding:0pt 5.4pt;overflow:hidden"><p dir=3D"ltr" style=3D"line-height:1.2=
;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-size:10pt;font-famil=
y:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:=
normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:p=
re-wrap">VM OS</span></p></td><td colspan=3D"3" style=3D"border-width:0.5pt=
;border-style:solid;border-color:rgb(0,0,0);vertical-align:top;padding:0pt =
5.4pt;overflow:hidden"><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2=
pt;margin-bottom:2pt"><span style=3D"font-size:10pt;font-family:Arial;color=
:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-v=
ariant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Cent=
OS Linux release 7.9 (Core)</span></p></td></tr><tr style=3D"height:0pt"><t=
d style=3D"border-width:0.5pt;border-style:solid;border-color:rgb(0,0,0);ve=
rtical-align:top;padding:0pt 5.4pt;overflow:hidden"><p dir=3D"ltr" style=3D=
"line-height:1.2;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-size=
:10pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-=
variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseli=
ne;white-space:pre-wrap">VM Configuration</span></p></td><td colspan=3D"3" =
style=3D"border-width:0.5pt;border-style:solid;border-color:rgb(0,0,0);vert=
ical-align:top;padding:0pt 5.4pt;overflow:hidden"><p dir=3D"ltr" style=3D"l=
ine-height:1.2;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-size:1=
0pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-va=
riant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline=
;white-space:pre-wrap">Minimum Memory 8 GB</span></p><p dir=3D"ltr" style=
=3D"line-height:1.2;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-s=
ize:10pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;fo=
nt-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:bas=
eline;white-space:pre-wrap">Minimum 8 core CPUs</span></p><p dir=3D"ltr" st=
yle=3D"line-height:1.2;margin-top:2pt;margin-bottom:2pt"><span style=3D"fon=
t-size:10pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent=
;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:=
baseline;white-space:pre-wrap">Minimum 10 GB disk space</span></p></td></tr=
><tr style=3D"height:10pt"><td rowspan=3D"9" style=3D"border-width:0.5pt;bo=
rder-style:solid;border-color:rgb(0,0,0);vertical-align:top;padding:0pt 5.4=
pt;overflow:hidden"><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;=
margin-bottom:2pt"><span style=3D"font-size:10pt;font-family:Arial;color:rg=
b(0,0,0);background-color:transparent;font-variant-numeric:normal;font-vari=
ant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Network=
 Interfaces</span></p><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2p=
t;margin-bottom:2pt"><span style=3D"font-size:10pt;font-family:Arial;color:=
rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-va=
riant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">(5 e1=
000e Interfaces including the Management interface)</span></p></td><td styl=
e=3D"border-width:0.5pt;border-style:solid;border-color:rgb(0,0,0);vertical=
-align:top;padding:0pt 5.4pt;overflow:hidden"><p dir=3D"ltr" style=3D"line-=
height:1.2;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-size:10pt;=
font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight=
:700;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-al=
ign:baseline;white-space:pre-wrap">Network Source</span></p></td><td style=
=3D"border-width:0.5pt;border-style:solid;border-color:rgb(0,0,0);vertical-=
align:top;padding:0pt 5.4pt;overflow:hidden"><p dir=3D"ltr" style=3D"line-h=
eight:1.2;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-size:10pt;f=
ont-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:=
700;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-ali=
gn:baseline;white-space:pre-wrap">Name</span></p></td><td style=3D"border-w=
idth:0.5pt;border-style:solid;border-color:rgb(0,0,0);vertical-align:top;pa=
dding:0pt 5.4pt;overflow:hidden"><p dir=3D"ltr" style=3D"line-height:1.2;ma=
rgin-top:2pt;margin-bottom:2pt"><span style=3D"font-size:10pt;font-family:A=
rial;color:rgb(0,0,0);background-color:transparent;font-weight:700;font-var=
iant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;=
white-space:pre-wrap">Mode</span></p></td></tr><tr style=3D"height:10pt"><t=
d style=3D"border-width:0.5pt;border-style:solid;border-color:rgb(0,0,0);ve=
rtical-align:top;padding:0pt 5.4pt;overflow:hidden"><p dir=3D"ltr" style=3D=
"line-height:1.2;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-size=
:10pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-=
variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseli=
ne;white-space:pre-wrap">Host Device</span></p><p dir=3D"ltr" style=3D"line=
-height:1.2;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-size:10pt=
;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-varia=
nt-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;wh=
ite-space:pre-wrap">(Management)</span></p></td><td style=3D"border-width:0=
.5pt;border-style:solid;border-color:rgb(0,0,0);vertical-align:top;padding:=
0pt 5.4pt;overflow:hidden"><p dir=3D"ltr" style=3D"line-height:1.2;margin-t=
op:2pt;margin-bottom:2pt"><span style=3D"font-size:10pt;font-family:Arial;c=
olor:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;fo=
nt-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">=
Interface-1</span></p></td><td style=3D"border-width:0.5pt;border-style:sol=
id;border-color:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;overflow:hi=
dden"><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;margin-bottom:=
2pt"><span style=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,0);backg=
round-color:transparent;font-variant-numeric:normal;font-variant-east-asian=
:normal;vertical-align:baseline;white-space:pre-wrap">Bridge</span></p></td=
></tr><tr style=3D"height:10pt"><td rowspan=3D"4" style=3D"border-width:0.5=
pt;border-style:solid;border-color:rgb(0,0,0);vertical-align:top;padding:0p=
t 5.4pt;overflow:hidden"><br><br><p dir=3D"ltr" style=3D"line-height:1.2;ma=
rgin-top:2pt;margin-bottom:2pt"><span style=3D"font-size:10pt;font-family:A=
rial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:nor=
mal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-=
wrap">Host Device</span></p></td><td style=3D"border-width:0.5pt;border-sty=
le:solid;border-color:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;overf=
low:hidden"><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;margin-b=
ottom:2pt"><span style=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,0)=
;background-color:transparent;font-variant-numeric:normal;font-variant-east=
-asian:normal;vertical-align:baseline;white-space:pre-wrap">Interface-2</sp=
an></p></td><td style=3D"border-width:0.5pt;border-style:solid;border-color=
:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;overflow:hidden"><p dir=3D=
"ltr" style=3D"line-height:1.2;margin-top:2pt;margin-bottom:2pt"><span styl=
e=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,0);background-color:tra=
nsparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertica=
l-align:baseline;white-space:pre-wrap">Bridge</span></p></td></tr><tr style=
=3D"height:10pt"><td style=3D"border-width:0.5pt;border-style:solid;border-=
color:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;overflow:hidden"><p d=
ir=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;margin-bottom:2pt"><span=
 style=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,0);background-colo=
r:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;ve=
rtical-align:baseline;white-space:pre-wrap">Interface-3</span></p></td><td =
style=3D"border-width:0.5pt;border-style:solid;border-color:rgb(0,0,0);vert=
ical-align:top;padding:0pt 5.4pt;overflow:hidden"><p dir=3D"ltr" style=3D"l=
ine-height:1.2;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-size:1=
0pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-va=
riant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline=
;white-space:pre-wrap">Bridge</span></p></td></tr><tr style=3D"height:10pt"=
><td style=3D"border-width:0.5pt;border-style:solid;border-color:rgb(0,0,0)=
;vertical-align:top;padding:0pt 5.4pt;overflow:hidden"><p dir=3D"ltr" style=
=3D"line-height:1.2;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-s=
ize:10pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;fo=
nt-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:bas=
eline;white-space:pre-wrap">Interface-4</span></p></td><td style=3D"border-=
width:0.5pt;border-style:solid;border-color:rgb(0,0,0);vertical-align:top;p=
adding:0pt 5.4pt;overflow:hidden"><p dir=3D"ltr" style=3D"line-height:1.2;m=
argin-top:2pt;margin-bottom:2pt"><span style=3D"font-size:10pt;font-family:=
Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:no=
rmal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre=
-wrap">Bridge</span></p></td></tr><tr style=3D"height:10pt"><td style=3D"bo=
rder-width:0.5pt;border-style:solid;border-color:rgb(0,0,0);vertical-align:=
top;padding:0pt 5.4pt;overflow:hidden"><p dir=3D"ltr" style=3D"line-height:=
1.2;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-size:10pt;font-fa=
mily:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numer=
ic:normal;font-variant-east-asian:normal;vertical-align:baseline;white-spac=
e:pre-wrap">Interface-5</span></p></td><td style=3D"border-width:0.5pt;bord=
er-style:solid;border-color:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt=
;overflow:hidden"><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;ma=
rgin-bottom:2pt"><span style=3D"font-size:10pt;font-family:Arial;color:rgb(=
0,0,0);background-color:transparent;font-variant-numeric:normal;font-varian=
t-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Bridge</s=
pan></p></td></tr><tr style=3D"height:10pt"><td rowspan=3D"3" style=3D"bord=
er-width:0.5pt;border-style:solid;border-color:rgb(0,0,0);vertical-align:to=
p;padding:0pt 5.4pt;overflow:hidden"><br><p dir=3D"ltr" style=3D"line-heigh=
t:1.2;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-size:10pt;font-=
family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-num=
eric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-sp=
ace:pre-wrap">Virtual Network(open Network)</span></p></td><td style=3D"bor=
der-width:0.5pt;border-style:solid;border-color:rgb(0,0,0);vertical-align:t=
op;padding:0pt 5.4pt;overflow:hidden"><p dir=3D"ltr" style=3D"line-height:1=
.2;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-size:10pt;font-fam=
ily:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeri=
c:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space=
:pre-wrap">Interface-6</span></p></td><td style=3D"border-width:0.5pt;borde=
r-style:solid;border-color:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;=
overflow:hidden"><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;mar=
gin-bottom:2pt"><span style=3D"font-size:10pt;font-family:Arial;color:rgb(0=
,0,0);background-color:transparent;font-variant-numeric:normal;font-variant=
-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Open</span=
></p></td></tr><tr style=3D"height:10pt"><td style=3D"border-width:0.5pt;bo=
rder-style:solid;border-color:rgb(0,0,0);vertical-align:top;padding:0pt 5.4=
pt;overflow:hidden"><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;=
margin-bottom:2pt"><span style=3D"font-size:10pt;font-family:Arial;color:rg=
b(0,0,0);background-color:transparent;font-variant-numeric:normal;font-vari=
ant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Interfa=
ce-7</span></p></td><td style=3D"border-width:0.5pt;border-style:solid;bord=
er-color:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;overflow:hidden"><=
p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;margin-bottom:2pt"><s=
pan style=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,0);background-c=
olor:transparent;font-variant-numeric:normal;font-variant-east-asian:normal=
;vertical-align:baseline;white-space:pre-wrap">Open</span></p></td></tr><tr=
 style=3D"height:10pt"><td style=3D"border-width:0.5pt;border-style:solid;b=
order-color:rgb(0,0,0);vertical-align:top;padding:0pt 5.4pt;overflow:hidden=
"><p dir=3D"ltr" style=3D"line-height:1.2;margin-top:2pt;margin-bottom:2pt"=
><span style=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,0);backgroun=
d-color:transparent;font-variant-numeric:normal;font-variant-east-asian:nor=
mal;vertical-align:baseline;white-space:pre-wrap">Interface-8</span></p></t=
d><td style=3D"border-width:0.5pt;border-style:solid;border-color:rgb(0,0,0=
);vertical-align:top;padding:0pt 5.4pt;overflow:hidden"><p dir=3D"ltr" styl=
e=3D"line-height:1.2;margin-top:2pt;margin-bottom:2pt"><span style=3D"font-=
size:10pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;f=
ont-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:ba=
seline;white-space:pre-wrap">Open</span></p></td></tr></tbody></table></div=
></span></div><div><br></div><div>Can you please suggest the best recommend=
ed drivers and internal network.</div><div><br></div><div>Regards,</div><di=
v>illaya</div></div>

--000000000000f5c39f05ee08b685--