From: "Shawn Zheng" <forsakening@sina.cn>
To: "users" <users@dpdk.org>
Subject: [dpdk-users] Vcenter DVS Vlan Vmxnet3 DPDK Performance Poor
Date: Mon, 24 Jun 2019 16:24:45 +0800 [thread overview]
Message-ID: <20190624082445.961205D000A2@webmail.sinamail.sina.com.cn> (raw)
Hi,all:
We are facing a problem with vmxnet3 poor performance issue.
Our envrionment is below: Esxi 6.5 and 6.7, using vmxnet3 nic, we are use a l2fwd vm to trunk all the packet, and do the packets retransmit There are 3 vm in my env, 1 tx-vm , 1 rx-vm and 1 l2fwd-vm
1) Tx vm using vlan 4 in portgroup1, send packets; 2) Rx vm using vlan 5 in portgroup2, receivce packets;
3) Our L2fwd vm using vlan trunk in portgroup3, and change the vlan-4 to vlan-5 so that rx-vm can receive the packets. 4) Use dpdk 18.05 , 18.11 and 19.02
Here is my l2fwd code changes when forward the packets : struct ether_hdr *eth; void *tmp; eth = rte_pktmbuf_mtod(m, struct ether_hdr *); uint16_t ether_type = eth->ether_type; uint16_t hdr_len = sizeof(struct ether_hdr); if (ether_type == rte_cpu_to_be_16(ETHER_TYPE_VLAN)) { struct vlan_hdr * vh = rte_pktmbuf_mtod_offset(m, struct vlan_hdr *, hdr_len); vh->vlan_tci = 0x0500; // change the vlan tag to vlan 5 }
And we see l2fwd dropped many packets when tx-vm transimit about 5G (1518bytes) packets, about 420000 pps , and only receive about 350000 pps. [root@vrouter1 home]# ./l2fwd -c 6 -n 4 --socket-mem 1000,0 -- -p 1 -T1
Port statistics ====================================Statistics for port 0 ------------------------------Packets sent: 8836653Packets received: 10000022Packets dropped: 1163369Aggregate statistics ===============================Total packets sent: 8836653Total packets received: 10000022Total packets dropped: 1163369==================================================== I know the dropped stats means the vmxnet3 tx ring exhausted , but when tx-vm and rx-vm in same vlan , there is no drop packets. Or with diffrent vlan , the kernel driver is better than dpdk.
Could somebody give some suggestion ? Thanks in advance !!
--------------------------------
Regards
Shawn Zheng
reply other threads:[~2019-06-24 8:24 UTC|newest]
Thread overview: [no followups] expand[flat|nested] mbox.gz Atom feed
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20190624082445.961205D000A2@webmail.sinamail.sina.com.cn \
--to=forsakening@sina.cn \
--cc=users@dpdk.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).