* Re: [dpdk-dev] dpdkvhostuser fail to alloc memory when receive packet from other host
@ 2015-06-17 14:58 Wiles, Keith
0 siblings, 0 replies; 2+ messages in thread
From: Wiles, Keith @ 2015-06-17 14:58 UTC (permalink / raw)
To: Du, Fan, Loftus, Ciara; +Cc: dev, dev
On 6/17/15, 4:49 AM, "Du, Fan" <fan.du@intel.com> wrote:
>Hi,
>
>I'm playing dpdkvhostuser ports with latest DPDK and ovs master tree with
>iperf benchmarking.
>When kvm guest1(backed up dpdkvhostuser port)siting on HOST1 is receiving
>packets from either other physical HOST2,
>or similar kvm guest2 with dpdkvhostuser port siting on HOST2. The
>connectivity will break, iperf show no bandwidth and stall finally.
>
>Other test scenario like, two kvm guest sitting on one host, or a single
>kvm guest send packets to a physical host works like a charm.
>
>Swiitch debug option on, dpdk lib spit as below:
>VHOST_CONFIG: read message VHOST_USER_SET_VRING_CALL
>VHOST_CONFIG: vring call idx:0 file:62
>VHOST_CONFIG: read message VHOST_USER_SET_VRING_CALL
>VHOST_CONFIG: vring call idx:0 file:58
>
>VHOST_DATA: F0 Failed to allocate memory for mbuf.
>mbuf_pool:0x7fc7411ab5c0
>VHOST_DATA: F0 Failed to allocate memory for mbuf.
>mbuf_pool:0x7fc7411ab5c0
>VHOST_DATA: F0 Failed to allocate memory for mbuf.
>mbuf_pool:0x7fc7411ab5c0
>VHOST_DATA: F0 Failed to allocate memory for mbuf.
>mbuf_pool:0x7fc7411ab5c0
>VHOST_DATA: F0 Failed to allocate memory for mbuf.
>mbuf_pool:0x7fc7411ab5c0
>VHOST_DATA: F0 Failed to allocate memory for mbuf.
>mbuf_pool:0x7fc7411ab5c0
>VHOST_DATA: F0 Failed to allocate memory for mbuf.
>mbuf_pool:0x7fc7411ab5c0
>VHOST_DATA: F0 Failed to allocate memory for mbuf.
>mbuf_pool:0x7fc7411ab5c0
>
>After some tweaks of logging code, and looks like bad things happens
>within below code snippet:
>In lib/librte_vhost/vhost_rxtx.c function: rte_vhost_dequeue_burst
>
>612 vb_offset = 0;
>613 vb_avail = desc->len;
>614 /* Allocate an mbuf and populate the structure. */
>615 m = rte_pktmbuf_alloc(mbuf_pool);
>616 if (unlikely(m == NULL)) {
>617 RTE_LOG(ERR, VHOST_DATA,
>618 "F0 Failed to allocate memory for
>mbuf. mbuf_pool:%p\n", mbuf_pool);
>619 break;
>620 }
>621 seg_offset = 0;
>622 seg_avail = m->buf_len - RTE_PKTMBUF_HEADROOM;
>623 cpy_len = RTE_MIN(vb_avail, seg_avail);
To me this code is only reporting the mbuf_pool does not have any more
mbufs, not that this code has some type of error. It seems the number of
mbufs allocated to the mbuf_pool is not enough or someplace in the code is
not freeing the mbufs after being consumed.
You need to find out the reason for why you have run out of mbufs. It is
also possible the message should not have been an error, but
informational/warning instead as it maybe under some high volume loads
this may occur and no amount of mbufs may resolve the condition.
Regards,
++Keith
>
>
>
^ permalink raw reply [flat|nested] 2+ messages in thread
* [dpdk-dev] dpdkvhostuser fail to alloc memory when receive packet from other host
@ 2015-06-17 9:49 Du, Fan
0 siblings, 0 replies; 2+ messages in thread
From: Du, Fan @ 2015-06-17 9:49 UTC (permalink / raw)
To: Loftus, Ciara; +Cc: dev, dev
Hi,
I'm playing dpdkvhostuser ports with latest DPDK and ovs master tree with iperf benchmarking.
When kvm guest1(backed up dpdkvhostuser port)siting on HOST1 is receiving packets from either other physical HOST2,
or similar kvm guest2 with dpdkvhostuser port siting on HOST2. The connectivity will break, iperf show no bandwidth and stall finally.
Other test scenario like, two kvm guest sitting on one host, or a single kvm guest send packets to a physical host works like a charm.
Swiitch debug option on, dpdk lib spit as below:
VHOST_CONFIG: read message VHOST_USER_SET_VRING_CALL
VHOST_CONFIG: vring call idx:0 file:62
VHOST_CONFIG: read message VHOST_USER_SET_VRING_CALL
VHOST_CONFIG: vring call idx:0 file:58
VHOST_DATA: F0 Failed to allocate memory for mbuf. mbuf_pool:0x7fc7411ab5c0
VHOST_DATA: F0 Failed to allocate memory for mbuf. mbuf_pool:0x7fc7411ab5c0
VHOST_DATA: F0 Failed to allocate memory for mbuf. mbuf_pool:0x7fc7411ab5c0
VHOST_DATA: F0 Failed to allocate memory for mbuf. mbuf_pool:0x7fc7411ab5c0
VHOST_DATA: F0 Failed to allocate memory for mbuf. mbuf_pool:0x7fc7411ab5c0
VHOST_DATA: F0 Failed to allocate memory for mbuf. mbuf_pool:0x7fc7411ab5c0
VHOST_DATA: F0 Failed to allocate memory for mbuf. mbuf_pool:0x7fc7411ab5c0
VHOST_DATA: F0 Failed to allocate memory for mbuf. mbuf_pool:0x7fc7411ab5c0
After some tweaks of logging code, and looks like bad things happens within below code snippet:
In lib/librte_vhost/vhost_rxtx.c function: rte_vhost_dequeue_burst
612 vb_offset = 0;
613 vb_avail = desc->len;
614 /* Allocate an mbuf and populate the structure. */
615 m = rte_pktmbuf_alloc(mbuf_pool);
616 if (unlikely(m == NULL)) {
617 RTE_LOG(ERR, VHOST_DATA,
618 "F0 Failed to allocate memory for mbuf. mbuf_pool:%p\n", mbuf_pool);
619 break;
620 }
621 seg_offset = 0;
622 seg_avail = m->buf_len - RTE_PKTMBUF_HEADROOM;
623 cpy_len = RTE_MIN(vb_avail, seg_avail);
^ permalink raw reply [flat|nested] 2+ messages in thread
end of thread, other threads:[~2015-06-17 14:58 UTC | newest]
Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-06-17 14:58 [dpdk-dev] dpdkvhostuser fail to alloc memory when receive packet from other host Wiles, Keith
-- strict thread matches above, loose matches on Subject: below --
2015-06-17 9:49 Du, Fan
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).