From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mx-3.enea.com (sestofw01.enea.se [192.36.1.252]) by dpdk.org (Postfix) with SMTP id CAF09E82 for ; Fri, 3 Oct 2014 09:59:27 +0200 (CEST) Received: from SESTOEX04.enea.se ([fe80::bc2d:9299:d6b2:d0b7]) by SESTOEX08.enea.se ([fe80::1c3:4003:dc47:23c0%11]) with mapi id 14.03.0158.001; Fri, 3 Oct 2014 10:06:20 +0200 From: Huimin She To: "dev@dpdk.org" Thread-Topic: [dpdk-dev] Endless errors when starting multiple dpdk applications Thread-Index: Ac/e3jXFMcV0chtRTmyUZbMFkX6nlQ== Date: Fri, 3 Oct 2014 08:06:20 +0000 Message-ID: <79AD82BE44B82847A99BB3270D2ED3C7032E990F@SESTOEX04.enea.se> Accept-Language: en-US, sv-SE Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.16.140.20] MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-dev] Endless errors when starting multiple dpdk applications X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Oct 2014 07:59:28 -0000 Hi, I am trying to run multiple dpdk forwarding applications on VMs (KVM). The = settings are as followings Dpdk version: master PF1 (port 2 of an Intel I350-T4 NIC) has two VFs: VF1(pci: 0000:01:01.0), V= F2 (pci: 0000:01:02.0) PF2 (port 3 of an Intel I350-T4NIC ) has two VFs: VF3 (pci: 0000:01:03.0), = VF4 (pci: 0000:01:04.0) The VFs are started by: sudo insmod igb.ko max_vfs=3D0,2,2,0 VMDQ=3D0,4,4,0 Dpdk-fwd-app-1 runs on the VM between VF1 and VF4 like this: sudo ./dpdk-app --syslog syslog -c 0x2 -n 2 -m 32 --use-device 01:01.0,01:= 04.0 --file-prefix 11 -- -q 4 If I only start single application, the packets are successfully forwarded. However when I start the second dpdk application: Dpdk-fwd-app-2 between VF= 2 and VF3 like this: sudo ./dpdk-app --syslog syslog -c 0x4 -n 2 -m 32 --use-device 01:02.0,01:0= 3.0 --file-prefix 22 -- -q 4 Then endless error messages are printed out: ---------------------------------------------------------------------------= ------------------- ...... CPU-2: CMTL: put_msg: tx buffer is full! CPU-2: CMTL: shmem_dc_transmit: Tx queue is full,dropping message! CPU-2: CMTL: Force disconnect! Error: user_called:1 ecode:0x0000f001 extra:0x00000000 ...... ---------------------------------------------------------------------------= ----------------------- I tried to change the parameters for: -c, -n, -q, -m. Still see the errors. Has any of you seen similar things before? Is this caused by any missing configurations? (Such as specifying separate = TX/RX queues for different VFs, how to do this?) Thanks a lot. Best regards, Huimin She